Personal relative deprivation impairs ability to filter out threat-related distractors from visual working memory

The literature has indicated that personal relative deprivation (PRD) results in anxiety disorders. Given that some cognitive models propose that attention bias toward a threat causes and maintains anxiety, relatively deprived individuals may have difficulty gating threat from working memory. To test this hypothesis, this study investigated the influence of PRD on the filtering ability of happy, angry, and neutral facial distractors from visual working memory using electroencephalography (EEG). Participants were randomly assigned to a PRD (n = 24) or a non-PRD group (n = 24). Filtering ability was reflected by comparing the contralateral delay activity (CDA) amplitude for one-target, one-target-one-distractor, and two-targets conditions. The CDA was measured as the difference in mean amplitudes between activity in the hemispheres contralateral and ipsilateral to the to-be-remembered information. Results indicated that individuals in the PRD group showed a reduced ability to filter out neutral and angry facial distractors, as reflected by similar CDA amplitudes for one-target-one-distractor and two-targets conditions for both angry and neutral distractors in the PRD group. However, PRD did not impair the ability to filter out happy facial distractors, as reflected by similar CDA amplitudes for one-target-one-distractor and one-target conditions for happy distractors in the PRD group. As neutral faces might then be taken as potentially threatening information by relatively deprived individuals, these results support the hypothesis that relatively deprived individuals might have difficulty filtering out threat-related information.

Global and local interference effects in ensemble encoding are best explained by interactions between summary representations of the mean and the range

Through ensemble encoding, the visual system compresses redundant statistical properties from multiple items into a single summary metric (e.g., average size). Numerous studies have shown that global summary information is extracted quickly, does not require access to single-item representations, and often interferes with reports of single items from the set. Yet a thorough understanding of ensemble processing would benefit from a more extensive investigation at the local level. Thus, the purpose of this study was to provide a more critical inspection of global-local processing in ensemble perception. Taking inspiration from Navon (Cognitive Psychology, 9(3), 353-383, 1977), we employed a novel paradigm that independently manipulates the degree of interference at the global (mean) or local (single item) level of the ensemble. Initial results were consistent with reciprocal interference between global and local ensemble processing. However, further testing revealed that local interference effects were better explained by interference from another summary statistic, the range of the set. Furthermore, participants were unable to disambiguate single items from the ensemble display from other items that were within the ensemble range but, critically, were not actually present in the ensemble. Thus, it appears that local item values are likely inferred based on their relationship to higher-order summary statistics such as the range and the mean. These results conflict with claims that local information is captured alongside global information in summary representations. In such studies, successful identification of set members was not compared with misidentification of items within the range, but which were nevertheless not presented within the set.

The storage mechanism of dynamic relations in visual working memory

The ability to briefly hold and manipulate object relations provides a foundation for interacting with our complex environment. Previous studies on working memory focused more on objects than their relations, which is disproportionate in the context of their theoretical importance. This study examined dynamic relations of objects to better understand the storage mechanism (capacity and representation) using a self-developed modified change detection paradigm, where an object moved dynamically, based on its relation to other objects. Eighty-four university students participated in four experiments (21 each), wherein they observed dynamic relations between objects presented on a display, memorized them, and reported whether the memorized relations were identical to the probatory relations. Results showed that visual working memory had an upper limitation of holding dynamic relations. When relations were independent of each other, the limitation was two; whereas in non-independent cases where different relations shared an object, memory accuracy decreased with increasing relations complexity, rather than with the number of objects or relations. Thus, dynamic relations are probably not stored as object features, nor stored independent of objects. More likely, relations and objects are represented in visual working memory as an integrated perceptual unit.

Consequence of stroke for feature recall and binding in visual working memory

Visual memory for objects involves the integration, or binding, of individual features into a coherent representation. We used a novel approach to assess feature binding, using a delayed-reproduction task in combination with computational modeling and lesion analysis. We assessed stroke patients and neurotypical controls on a visual working memory task in which spatial arrays of colored disks were presented. After a brief delay, participants either had to report the color of one disk cued by its location or the location of one disk cued by its color. Our results demonstrate that, in the controls, report imprecision and swap errors (non-target reports) can be explained by a single source of variability. Stroke patients showed an overall decrease in memory precision for both color and location, with only limited evidence for deviations from the predicted relationship between report precision and swap errors. These deviations were primarily deficits in reporting items rather than selecting items based on the cue. Atlas-based lesion-symptom mapping showed that selection and reporting deficits, precision in reporting color, and precision in reporting location were associated with different lesion profiles. Deficits in binding are associated with lesions in the left somatosensory cortex, deficits in the precision of reporting color with bilateral fronto-parietal regions, and no anatomical substrates were identified for precision in reporting location. Our results converge with previous reports that working memory representations are widely distributed in the brain and can be found across sensory, parietal, temporal, and prefrontal cortices. Stroke patients demonstrate mostly subtle impairments in visual working memory, perhaps because representations from different areas in the brain can partly compensate for impaired encoding in lesioned areas. These findings contribute to understanding of the relation between memorizing features and their bound representations.

A direct comparison of central tendency recall and temporal integration in the successive field iconic memory task

The ensemble coding literature suggests the existence of a fast, automatic formation of some ensemble codes. Can statistical representations, such as memory for the central tendency along a particular visual feature dimension, be extracted from information held in the sensory register? Furthermore, can knowledge of early, iconic memory processes be used to determine how central tendency is extracted? We focused on the potential role of visible persistence mechanisms that support temporal integration. We tested whether mean orientation could be accurately recalled from brief visual displays using the successive field task. On separate blocks of trials, participants were asked to report the location of a split element (requiring differentiation of frames), a missing element (requiring integration across frames), and the average orientation of elements pooled across both frames (central tendency recall). Results replicate the expected tradeoff between differentiation and integration performance across inter-frame interval (IFI). In contrast, precision of mean estimates was high and invariant across IFIs. A manipulation of within-frame distributional similarity coupled with simulations using 12 models supported 2-item subsampling. The results argue against the “strategic” interpretation of subsampling since 2-item readout was predicted by information theoretic estimates of STM encoding rate: the 2 items were not from a superset in STM. Most crucially, the results argue against the various early “preattentive/parallel/global pooling” accounts and instead suggest that non-selective readout of information from iconic memory supplies a relatively small amount of item information to STM, and it is only at this point that the computation of ensemble averages begins.

Disgust face captures more attention in individuals with high social anxiety when cognitive resources are abundant: Evidence from N2pc

There is a debate about the relative contributions of top-down and bottom-up attention to the threat-related attentional bias. In this study we investigated the attentional bias in individuals with social anxiety under conditions of no, low and high visual working memory (WM) load. Event-related potential (ERP) and response time (RT) data were recorded while participants performed the dot-probe task and a concurrent change-detection task. The ERP results revealed that the maximum N2pc effect emerged in no visual WM load condition in individuals with social anxiety. The difference of N2pc effect between high socially anxious (HSA) and low socially anxious (LSA) groups was observed in no visual WM load condition, whereas this difference was eliminated under low and high load conditions. However, no significant main effects or interactions were observed in the behavioral index (reflected by Trial Level-Bias Score variability). Overall, the findings indicate the critical role of top-down attention on social anxiety-related attentional bias, which have important implication for attentional bias modification.

How retaining objects containing multiple features in visual working memory regulates the priority for access to visual awareness

The content of visual working memory influences the access to visual awareness. Thus far, research has focused on retention of a single feature, whereas memoranda in real life typically contain multiple features. Here, we intermixed a delayed match-to-sample task to manipulate VWM content, and a breaking Continuous Flash Suppression (b-CFS) task to measure prioritization for visual awareness. Observers memorized either the color (Exp. 1), the shape (Exp. 2) or both the features (Exp. 3) of an item and indicated the location of a suppressed target. We observed that color-matching targets broke suppression faster than color-mismatching targets both when color was memory relevant or irrelevant. Shape only impacted priority for visual awareness through an interaction with color. We conclude that: (1) VWM can regulate the priority of visual information to access visual awareness along a single feature dimension; (2) different features of a memorandum vary in their potency to impact access to visual awareness, and the more dominant feature may even suppress the effect of the less dominant feature; (3) even stimuli that match an irrelevant feature dimension of the memorandum can be prioritized for visual awareness.

Visual Working Memory Guides Spatial Attention: Evidence from alpha oscillations and sustained potentials

Selective attention can facilitate performance by filtering irrelevant information and temporary maintaining limited information to accomplish the current task. However, the neural substrate how attentional selection can be guided by visual working memory (vWM) is not clear. Here, we recorded electrophysiological signals during vWM retention and investigated the relationship between objects held in memorial templates and the subsequent attentional selection during visual search. We observed that sustained posterior contralateral delay activity (CDA) was present and scaled with lateral vWM loads during the whole period of vWM retention, but that it was absent when objects were bilaterally held in vWM. Surprisingly, a strikingly similar pattern emerged for modulations in the averaged posterior alpha (8-12 Hz) power during the late period but not during the early period of retention. More importantly, it was the alpha modulation, but not the CDA, that strongly predicted the subsequent biomarker of attentional selection (the memorial template-induced N2pc) during visual search. We further observed the N2pc amplitudes decreased with increasing memory loads and predicted the same gradation of the final behavioral accuracy in visual search. All these results suggested that the subsequent memorial template-induced N2pc is response to the level of top-down attentional guiding effect caused by vWM. Our results provide neurophysiological evidence that keeping multiple templates in working memory simultaneously weakens the guiding effect to the following attentional selection.

Incidental encoding of visual information in temporal reference frames in working memory

Visual events are structured in space and time, yet models of visual working memory (VWM) have largely relied on tasks emphasizing spatial aspects. Here, we show that temporal properties of visual events are incidentally encoded along with spatial properties. In five experiments, participants performed change-detection tasks, in which items had unique spatial and temporal coordinates at encoding. Crucially, neither space nor time was task-relevant. The key manipulation concerned the retrieval context: The test array was identical to the memory array either in its entire spatiotemporal structure, or only its spatial or temporal structure. Removing spatial or temporal information at retrieval resulted in costs, indicating that memory relied on both spatial and temporal context in which items were initially perceived. Encoding of spatiotemporal structure occurred incidentally, not strategically, as it was robust even when the retrieval context was perfectly predictable. However, spatial and temporal inter-item spacings influenced the weighting of spatial and temporal information: It favoured the domain in which items were more widely spaced, facilitating their individuation and, likely, access to representations. Across individuals, the weighting of spatial and temporal information varied substantially, but it remained consistent across sessions, suggesting stable preferences for coding in the spatial or temporal domain. No comparable incidental encoding occurred for other task-irrelevant feature dimensions (size or colour). We propose that temporal structure serves as fundamental a function in VWM as spatial structure, scaffolding events that unfold over time.

Visual and verbal working memory loads interfere with scene-viewing

Working memory is thought to be divided into distinct visual and verbal subsystems. Studies of visual working memory frequently use verbal working memory tasks as control conditions and/or use articulatory suppression to ensure that visual load is not transferred to verbal working memory. Using these verbal tasks relies on the assumption that the verbal working memory load will not interfere with the same processes as visual working memory. In the present study, participants maintained a visual or verbal working memory load as they simultaneously viewed scenes while their eye movements were recorded. Because eye movements and visual working memory are closely linked, we anticipated the visual load would interfere with scene-viewing (and vice versa), while the verbal load would not. Surprisingly, both visual and verbal memory loads interfered with scene-viewing behavior, while eye movements during scene-viewing did not significantly interfere with performance on either memory task. These results suggest that a verbal working memory load can interfere with eye movements in a visual task.

Oculomotor capture by search-irrelevant features in visual working memory: on the crucial role of target-distractor similarity

When searching for varying targets in the environment, a target template has to be maintained in visual working memory (VWM). Recently, we showed that search-irrelevant features of a VWM template bias attention in an object-based manner, so that objects sharing such features with a VWM template capture the eyes involuntarily. Here, we investigated whether target-distractor similarity modulates capture strength. Participants saccaded to a target accompanied by a distractor. A single feature (e.g., shape) defined the target in each trial indicated by a cue, and the cue also varied in one irrelevant feature (e.g., color). The distractor matched the cue's irrelevant feature in half of the trials. Nine experiments showed that target-distractor similarity consistently influenced the degree of oculomotor capture. High target-distractor dissimilarity in the search-relevant feature reduced capture by the irrelevant feature (Experiments 1, 3, 6, 7). However, capture was reduced by high target-distractor similarity in the search-irrelevant feature (Experiments 1, 4, 5, 8). Strong oculomotor capture was observed if target-distractor similarity was reasonably low in the relevant and high in the irrelevant feature, irrespective of whether color or shape were relevant (Experiments 2 and 5). These findings argue for involuntary and object-based, top-down control by VWM templates, whereas its manifestation in oculomotor capture depends crucially on target-distractor similarity in relevant and irrelevant feature dimensions of the search object.

Prioritization within visual working memory reflects a flexible focus of attention

When motivated, people can keep nonrecent items in a list active during the presentation of new items, facilitating fast and accurate recall of the earlier items. It has been proposed that this occurs by flexibly orienting attention to a single prioritized list item, thus increasing the amount of attention-based maintenance directed toward this item at the expense of other items. This is manipulated experimentally by associating a single distinct feature with a higher reward value, such as a single red item in a list of black items. These findings may be more parsimoniously explained under a distinctiveness of encoding framework rather than a flexible attention allocation framework. The retrieval advantage for the prioritized list position may be because the incongruent feature stands out in the list perceptually and causes it to become better encoded. Across three visual working memory experiments, we contrast a flexible attention theory against a distinctiveness of encoding theory by manipulating the reward value associated with the incongruent feature. Findings from all three experiments show strong support in favor of the flexible attention theory and no support for the distinctiveness of encoding theory. We also evaluate and find no evidence that strategy use, motivation, or tiredness/fatigue associated with reward value can adequately explain flexible prioritization of attention. Flexible attentional prioritization effects may be best understood under the context of an online attentional refreshing mechanism.

Dual task interference on early perceptual processing

When two tasks, Task 1 and Task 2, are conducted in close temporal proximity and a separate speeded response is required for each target (T1 and T2), T2 report performance decreases as a function of its temporal proximity to T1. This so-called psychological refractory period (PRP) effect on T2 processing is largely assumed to reflect interference from T1 response selection on T2 response selection. However, interference on early perceptual processing of T2 has been observed in a modified paradigm, which required changes in visual-spatial attention, sensory modality, task modality, and response modality across targets. The goal of the present study was to investigate the possibility of early perceptual interference by systematically and iteratively removing each of these possible non perceptual confounds, in a series of four experiments. To assess T2 visual memory consolidation success, T2 was presented for a varying duration and immediately masked. T2 report accuracy, which was taken as a measure of perceptual-encoding or consolidation-success, decreased across all experimental control conditions as T1-T2 onset proximity increased. We argue that our results, in light of previous studies, show that central processing of a first target, responsible for the classical PRP effect, also interferes with early perceptual processing of a second target. We end with a discussion of broader implications for psychological refractory period and attentional blink effects.

Object-based grouping benefits without integrated feature representations in visual working memory

Visual working memory (VWM) is typically considered to represent complete objects—that is, separate parts of an object are maintained as bound objects. Yet it remains unclear whether and how the features of disparate parts are integrated into a whole-object memory representation. Using a change detection paradigm, the present study investigated whether VWM performance varies as a function of grouping strength for features that either determine the grouped object (orientation) or that are not directly grouping relevant (color). Our results showed a large grouping benefit for grouping-relevant orientation features and, additionally, a much smaller, albeit reliable, benefit for grouping-irrelevant color features when both were potentially task relevant. By contrast, when color was the only task-relevant feature, no grouping benefit from the orientation feature was revealed both under lower or relatively high demands for precision. Together, these results indicate that different features of an object are stored independently in VWM; and an emerging, higher-order grouping structure does not automatically lead to an integrated representation of all available features of an object. Instead, an object benefit depends on the specific task demands, which may generate a linked, task-dependent representation of independent features.

The priority for access to awareness of information matching VWM is mirror-invariant

Previous studies suggest that 1) storing a visual representation of an item in visual working memory (VWM) prioritizes access to visual awareness for this item and that 2) VWM can contain representations of bound items instead of separate features. It is currently unclear whether VWM affects access to visual awareness at the individual feature level, the conjunction of multiple features level or the object level. To investigate this question, we conducted a series of experiments in which we combined a delayed match to sample task with a breaking Continuous Flash Suppression (b-CFS) task. On each trial, subjects memorized an object consisting of a disk with two halves with different colors for the later recall test and, between them, had to detect the location of a target initially presented under suppression. We varied the congruence in colors between the memory representation and to-be-detected target. Our results show that memory congruent objects (consisting of a conjunction of features) break CFS faster than memory incongruent objects. Interestingly, we also observe this congruence effect when we presented the memorized object in a horizontally-mirrored configuration of colors. However, we do not observe a faster effect when the target shares only a single feature of a memorized object (semi-congruent) or when the memory congruent target is rotated by 90°. Our results suggest that VWM prioritizes access to visual awareness for complex visual memoranda for which the spatial lay-out of the individual features does not need to exactly match the lay-out of the memoranda.

Coordinating the interaction between past and present: Visual working memory for feature bindings overwritten by subsequent action to matching features

The object-file framework forwarded by Kaheman, Treisman, and Gibbs (1992) has been enormously influential in our understanding of how the visual system links together prior visual content with a current input. Although this framework was initially developed to account for the perceptual benefits associated with feature conjunction repetitions, the present series of experiments examines how the core processes of this framework may also help explain behavior in tasks that require explicit remembering of visual information over the short term. Building off our previous work (Fiacconi & Milliken, 2012, 2013), here we introduce a procedure that affords the opportunity to examine the contributions of object-file review processes to both speeded performance and visual short-term memory (VWM) within the same task. Across two experiments we demonstrate a novel coupling between memory accuracy and speeded performance, such that the conditions that promote faster performance also tend to produce better memory, and vice versa. These findings are discussed in relation to the object-file framework and suggest that the object-file review processes known to guide behavior in speeded performance tasks may also have important mnemonic consequences. Together, these findings unite two lines of research to which Anne Treisman made indelible contributions.

Distraction biases working memory for faces

Working memory persists in the face of distraction, yet not without consequence. Previous research has shown that memory for low-level visual features is systematically influenced by the maintenance or presentation of a similar distractor stimulus. Responses are frequently biased in stimulus space towards a perceptual distractor, though this has yet to be determined for high-level stimuli. We investigated whether these influences are shared for complex visual stimuli such as faces. To quantify response accuracies for these stimuli, we used a delayed-estimation task with a computer-generated "face space" consisting of 80 faces that varied continuously as a function of age and sex. In a set of three experiments, we found that responses for a target face held in working memory were biased towards a distractor face presented during the maintenance period. The amount of response bias did not vary as a function of distance between target and distractor. Our data suggest that, similar to low-level visual features, high-level face representations in working memory are biased by the processing of related but task-irrelevant information.

Cognitive aging and verbal labeling in continuous visual memory

The decline of working memory (WM) is a common feature of general cognitive decline, and visual and verbal WM capacity appear to decline at different rates with age. Visual material may be remembered via verbal codes or visual traces, or both. Souza and Skóra, Cognition, 166, 277-297 (2017) found that labeling boosted memory in younger adults by activating categorical visual long-term memory (LTM) knowledge. Here, we replicated this and tested whether it held in healthy older adults. We compared performance in silence, under instructed overt labeling (participants were asked to say color names out loud), and articulatory suppression (repeating irrelevant syllables to prevent labeling) in the delayed estimation paradigm. Overt labeling improved memory performance in both age groups. However, comparing the effect of overt labeling and suppression on the number of coarse, categorical representations in the two age groups suggested that older adults used verbal labels subvocally more than younger adults, when performing the task in silence. Older adults also appeared to benefit from labels differently than younger adults. In younger adults labeling appeared to improve visual, continuous memory, suggesting that labels activated visual LTM representations. However, for older adults, labels did not appear to enhance visual, continuous representations, but instead boosted memory via additional verbal (categorical) memory traces. These results challenged the assumption that visual memory paradigms measure the same cognitive ability in younger and older adults, and highlighted the importance of controlling differences in age-related strategic preferences in visual memory tasks.

The limited contribution of early visual cortex in visual working memory for surface roughness

Are visual representations in the human early visual cortex necessary for visual working memory (VWM)? Previous studies suggest that VWM is underpinned by distributed representations across several brain regions, including the early visual cortex. Notably, in these studies, participants had to memorize images under consistent visual conditions. However, in our daily lives, we must retain the essential visual properties of objects despite changes in illumination or viewpoint. The role of brain regions-particularly the early visual cortices-in these situations remains unclear. The present study investigated whether the early visual cortex was essential for achieving stable VWM. Focusing on VWM for object surface properties, we conducted fMRI experiments, while male and female participants performed a delayed roughness discrimination task in which sample and probe spheres were presented under varying illumination. By applying multi-voxel pattern analysis to brain activity in regions of interest, we found that the ventral visual cortex and intraparietal sulcus were involved in roughness VWM under changing illumination conditions. In contrast, VWM was not supported as robustly by the early visual cortex. These findings show that visual representations in the early visual cortex alone are insufficient for the robust roughness VWM representation required during changes in illumination.

Bottom-up perceptual salience and top-down retro-cues concurrently determine state in visual working memory

Recent studies have demonstrated that in visual working memory (VWM), only items in an active state can guide attention. Further evidence has revealed that items with higher perceptual salience or items prioritised by a valid retro-cue in VWM tend to be in an active state. However, it is unclear which factor (perceptual salience or retro-cues) is more important for influencing the item state in VWM or whether the factors can act concurrently. Experiment 1 examined the role of perceptual salience by asking participants to hold two features with relatively different perceptual salience (colour vs. shape) in VWM while completing a visual search task. Guidance effects were found when either colour or both colour and shape in VWM matched one of the search distractors but not when shape matched. This demonstrated that the more salient feature in VWM can actively guide attention, while the less salient feature cannot. However, when shape in VWM was cued to be more relevant (prioritised) in Experiment 2, we found guidance effects in both colour-match and shape-match conditions. That is, both more salient but non-cued colour and less salient but cued shape could be active in VWM, such that attentional selection was affected by the matching colour or shape in the visual search task. This suggests that bottom-up perceptual salience and top-down retro-cues can jointly determine the active state in VWM.

Strategic prioritisation enhances young and older adults' visual feature binding in working memory

Visual working memory for features and bindings is susceptible to age-related decline. Two experiments were used to examine whether older adults are able to strategically prioritise more valuable information in working memory and whether this could reduce age-related impairments. Younger (18–33 years) and older (60–90 years) adults were presented with coloured shapes and, following a brief delay, asked to recall the feature that had accompanied the probe item. In Experiment 1, participants were either asked to prioritise a more valuable object in the array (serial position 1, 2, or 3) or to treat them all equally. Older adults exhibited worse overall memory performance but were as able as younger adults to prioritise objects. In both groups, this ability was particularly apparent at the middle serial position. Experiment 2 then explored whether younger and older adults’ prioritisation is affected by presentation time. Replicating Experiment 1, older adults were able to prioritise the more valuable object in working memory, showing equivalent benefits and costs as younger adults. However, processing speed, as indexed by presentation time, was shown not to limit strategic prioritisation in either age group. Taken together, these findings demonstrate that, although older adults have poorer visual working memory overall, the ability to strategically direct attention to more valuable items in working memory is preserved across ageing.

Delay-dependent cholinergic modulation of visual short-term memory in rhesus macaques

Cholinergic neuromodulation is known to play a key role in visual working memory (VWM) - keeping relevant stimulus representations available for cognitive processes for short time periods (up to a few minutes). Despite the growing body of evidence on how the neural and cognitive mechanisms of VWM dynamically change over retention time, there is mixed evidence available on cholinergic effects as a function of VWM delay period in non-human primates. Using the delayed matching to sample VWM task in rhesus macaques (N = 6), we aimed to characterize VWM maintenance in terms of performance changes as a function of delay duration (across a wide range of delays from 1 to 76 s). Then, we studied how cholinergic neuromodulation influences VWM maintenance using the muscarinic receptor antagonist scopolamine administered alone as transient amnestic treatment, and in combination with two doses of the acetylcholinesterase inhibitor donepezil, a widely used Alzheimer's medication probing for the reversal of scopolamine-induced impairments. Results indicate that scopolamine-induced impairments of VWM maintenance are delay-dependent and specifically affect the 15-33 s time range, suggesting that scopolamine worsens the normal decay of VWM with the passage of time. Donepezil partially rescued the observed scopolamine-induced impairments of VWM performance. These results provide strong behavioral evidence for the role of increased cholinergic tone and muscarinic neuromodulation in the maintenance of VWM beyond a few seconds, in line with our current knowledge on the role of muscarinic acetylcholine receptors in sustained neural activity during VWM delay periods.

A single, simple, statistical mechanism explains resource distribution and temporal updating in visual short-term memory

Investigations into the way that information is held and integrated within the visual system provides some basis for understanding how visual information is represented and processed. Just over sixty years ago, Swets, Shipley, McKey, and Green (1959) demonstrated that performance within an auditory detection task increases as a function of the square root of the number of stimulus observation intervals, following the predictions of basic sampling theory, indicating the efficient perceptual integration of stimulus information. This principle of observer performance contingent on a constant rate of stimulus sampling also forms the basis of the sample-size model (Palmer, 1990; Sewell, Lilburn, & Smith, 2014) which seeks to provide an account of how memory resources might be divided among item representations in visual short-term memory (VSTM). In this article, we combine the multiple observations paradigm of Swets and colleagues with the VSTM paradigm of Sewell and colleagues and show that the sample-size relationship accounts for both the increase in performance with the number of presentation intervals and the way that performance changes as a function of the number of items in memory. The model provides an account of both the overall information limit of VSTM and an account of the dynamics of that limit, demonstrating not only that observers can selectively update specific representations in memory but that performance in this task is accounted for by a simple statistical constraint. We discuss the implications for models of VSTM capacity and architecture generally, focusing on the implications for objecthood and the characteristics of encoding to and retrieval from memory.

The transition from feature to object: Storage unit in visual working memory depends on task difficulty

Visual working memory (VWM) is a cognitive memory buffer for temporarily processing and storing visual information. Previous studies suggest that its capacity is severely limited, and there is an ongoing debate on whether the storage capacity is object-based or feature-based in VWM. In this study, a change-detection task was employed to investigate whether and how task difficulty can affect VWM, specifically, its capacity and the unit of storage. Task difficulty was manipulated through the set size of memory items, memory fidelity required by the resolution of representation and the type of feature tested. We examined two types of stimuli: the single-feature type, where each memory item was composed of a single feature (color or shape), and the conjunctive-feature type, where each item was composed of a conjunction of two features (colored shape). Experiment 1 replicated the previous findings that memory capacity for colors was larger than shapes, and decreased with the resolution demand regardless of the type of stimuli. In Experiment 2, we analyzed and compared the results from single-feature items and conjunctive-feature items in the low- and high-resolution conditions while controlling for the number of to-be-remembered features. By directly matching the estimated capacity based on an object-unit and a feature-unit with the theoretical prediction, the results showed that the unit storage in VWM tended to be feature-based with low task difficulty, and to be object-based with high task difficulty. This suggests that VWM is dynamic and flexible, dependent on the load of the current task.

Coding of featural information in visual working memory in 2.5-year-old toddlers

The number of objects that infants can remember in visual working memory (VWM) increases rapidly during the first few years of life (Kaldy & Leslie, 2005; Ross-Sheehy, Oakes, & Luck, 2003). However, less is understood about the representational format of VWM: whether storage is determined by fixed-precision memory slots, or the allocation of a limited continuous resource. In the current study, we adapted the Delayed Match Retrieval eye-tracking paradigm (Kaldy, Guillory, & Blaser, 2016), to test 2.5-year-old toddlers' ability to remember three object-location bindings when the to-be-remembered objects were all unique (Experiment 1) versus when they shared features such as color or shape (Experiment 2). 2.5-year-olds succeeded in Experiment 1, but only performed marginally better than chance in Experiment 2. Interestingly, when incorrect, participants in Experiment 2 were no more likely to select a decoy item that shared a feature with the target item. It seems that the increased similarity of to-be-remembered objects did not impair memory for the objects directly, but instead increased the likelihood of catastrophic forgetting.