Visual working memory capacity and stimulus categories: a behavioral and electrophysiological investigation

Lateral Bias in Visual Working Memory

The present study aimed to evaluate functional cerebral asymmetries of visual working memory (VWM) in relation to language lateralization. The bilateral change detection paradigm with capital letters as stimuli and the translingual lexical decision task were used to assess VWM and language asymmetry, respectively, in a sample of 99 younger healthy participants (59 women). Participant attention was cued towards right or left visual half-field. For the VWM task, men and women were more accurate and faster when stimuli were presented in the right visual half-field compared to the left visual half-field. As expected, a significant right visual half-field advantage was demonstrated in the lexical decision task in performance accuracy (but not response time). The results also revealed no relationship between lateralization in VWM and lexical decision. VWM performance accuracy decreased significantly with increasing asymmetry. This relationship was significant for women, but not men. Taken together, the present study demonstrates that the lateral bias in visual working memory is independent from language lateralization, and less lateralized individuals perform better than individuals with larger asymmetries in both visual half-field tasks.

Persistent neuronal firing in the medial temporal lobe supports performance and workload of visual working memory in humans

The involvement of the medial temporal lobe (MTL) in working memory is controversially discussed. Recent findings suggest that persistent neural firing in the hippocampus during maintenance in verbal working memory is associated with workload. Here, we recorded single neuron firing in 13 epilepsy patients (7 male) while they performed a visual working memory task. The number of coloured squares in the stimulus set determined the workload of the trial. Performance was almost perfect for low workload (1 and 2 squares) and dropped at high workload (4 and 6 squares), suggesting that high workload exceeded working memory capacity. We identified maintenance neurons in MTL neurons that showed persistent firing during the maintenance period. More maintenance neurons were found in the hippocampus for trials with correct compared to incorrect performance. Maintenance neurons increased and decreased firing in the hippocampus and increased firing in the entorhinal cortex for high compared to low workload. Population firing predicted workload particularly during the maintenance period. Prediction accuracy of workload based on single-trial activity during maintenance was strongest for neurons in the entorhinal cortex and hippocampus. The data suggest that persistent neural firing in the MTL reflects a domain-general process of maintenance supporting performance and workload of multiple items in working memory below and beyond working memory capacity. Persistent neural firing during maintenance in the entorhinal cortex may be associated with its preference to process visual-spatial arrays.

Neural processing of working memory in adults with ADHD in a visuospatial change detection task with distractors

Individuals with Attention-Deficit Hyperactivity Disorder (ADHD) are often characterized by deficits in working memory (WM), which manifest in academic, professional, and mental health difficulties. To better understand the underlying mechanisms of these presumed WM deficits, we compared adults with ADHD to their peers on behavioral and neural indices of WM. We used a visuospatial change detection task with distractors which was designed to assess the brain’s ability to effectively filter out distractors from WM, in addition to testing for effects of WM load. Twenty-seven unmedicated adults with ADHD were compared to 27 matched peers on event-related potential (ERP) measures of WM, i.e., the contralateral delay activity (CDA). Despite severe impairments in everyday life functioning, findings showed no difference in deficits in behavioral tests of working memory for adults with ADHD compared to their peers. Interestingly, there were differences in neural activity between individuals with ADHD and their peers showing that the CDA of individuals with ADHD did not distinguish between high, distractor, and low memory load conditions. These data suggest, in the face of comparable behavioral performance, a difference in neural processing efficiency, wherein the brains of individuals with ADHD may not be as selective in the allocation of neural resources to perform a WM task.

Contralateral delay activity does not reflect behavioral feature load in visual working memory

An ongoing debate in visual working memory research is concentrated on whether visual working memory capacity is determined solely by the number of objects to be memorized, or additionally by the number of relevant features contained within objects. Using a novel change detection task that contained multi-feature objects we examined the effect of both object number and feature number on visual working memory capacity, change detection sensitivity, and posterior slow wave event-related brain potential (ERP) activity. Behaviorally, working memory capacity and sensitivity were modulated as a function of both the number of objects and the number of features memorized per object. However, the Contralateral Delay Activity (CDA) was only sensitive to the number of objects, but not to the number of features. This suggests that while both objects and features contribute to limitations in visual working memory capacity, the CDA is an insufficient mechanism to account for feature level representations.

An unpleasant emotional state reduces working memory capacity: electrophysiological evidence

Emotional states can guide the actions and decisions we make in our everyday life through their influence on cognitive processes such as working memory (WM). We investigated the long-lasting interference that an unpleasant emotional state had on goal-relevant WM representations from an electrophysiological perspective. Participants performed a change detection task that was preceded by the presentation of unpleasant or neutral task-irrelevant pictures in a blocked fashion. We focused on the contralateral delay activity (CDA), an event-related potential that is sensitive to the number of task-relevant items stored in WM. We found that the asymptotic limit for the CDA amplitude was lower during the unpleasant emotional state than during the neutral one; that is, an emotional state was capable of reducing how many task-relevant items the participants could hold in WM. Furthermore, both the individuals who experienced more intrusive thoughts and those who were dispositionally anxious were more susceptible to the influence of the emotional state. We provide evidence that an unpleasant emotional state diminished visual WM for task-relevant items, particularly in susceptible individuals. These results open new avenues to uncover the emotional-cognitive processing that underlies maladaptive WM representations and the role of such processing in the development of mental illness.

Simultaneous EEG-fMRI for working memory of the human brain

Memory plays an important role in human life. Memory can be divided into two categories, i.e., long term memory and short term memory (STM). STM or working memory (WM) stores information for a short span of time and it is used for information manipulations and fast response activities. WM is generally involved in the higher cognitive functions of the brain. Different studies have been carried out by researchers to understand the WM process. Most of these studies were based on neuroimaging modalities like fMRI, EEG, MEG etc., which use standalone processes. Each neuroimaging modality has some pros and cons. For example, EEG gives high temporal resolution but poor spatial resolution. On the other hand, the fMRI results have a high spatial resolution but poor temporal resolution. For a more in depth understanding and insight of what is happening inside the human brain during the WM process or during cognitive tasks, high spatial as well as high temporal resolution is desirable. Over the past decade, researchers have been working to combine different modalities to achieve a high spatial and temporal resolution at the same time. Developments of MRI compatible EEG equipment in recent times have enabled researchers to combine EEG-fMRI successfully. The research publications in simultaneous EEG-fMRI have been increasing tremendously. This review is focused on the WM research involving simultaneous EEG-fMRI data acquisition and analysis. We have covered the simultaneous EEG-fMRI application in WM and data processing. Also, it adds to potential fusion methods which can be used for simultaneous EEG-fMRI for WM and cognitive tasks.

The contralateral delay activity as a neural measure of visual working memory

The contralateral delay activity (CDA) is a negative slow wave sensitive to the number of objects maintained in visual working memory (VWM). In recent years, a growing number of labs started to use the CDA in order to investigate VWM, leading to many fascinating discoveries. Here, we discuss the recent developments and contribution of the CDA in various research fields. Importantly, we report two meta-analyses that unequivocally validate the relationship between the set-size increase in the CDA amplitude and the individual VWM capacity, and between the CDA and filtering efficiency. We further discuss how the CDA was used to study the role of VWM in visual search, multiple object tracking, grouping, binding, and whether VWM capacity allocation is determined by the items' resolution or instead by the number of objects regardless of their complexity. In addition, we report how the CDA has been used to characterize specific VWM deficits in special populations.

A multisensory perspective of working memory

Although our sensory experience is mostly multisensory in nature, research on working memory representations has focused mainly on examining the senses in isolation. Results from the multisensory processing literature make it clear that the senses interact on a more intimate manner than previously assumed. These interactions raise questions regarding the manner in which multisensory information is maintained in working memory. We discuss the current status of research on multisensory processing and the implications of these findings on our theoretical understanding of working memory. To do so, we focus on reviewing working memory research conducted from a multisensory perspective, and discuss the relation between working memory, attention, and multisensory processing in the context of the predictive coding framework. We argue that a multisensory approach to the study of working memory is indispensable to achieve a realistic understanding of how working memory processes maintain and manipulate information.

Visual working memory capacity for color is independent of representation resolution

Background

The relationship between visual working memory (VWM) capacity and resolution of representation have been extensively investigated. Several recent ERP studies using orientation (or arrow) stimuli suggest that there is an inverse relationship between VWM capacity and representation resolution. However, different results have been obtained in studies using color stimuli. This could be due to important differences in the experimental paradigms used in previous studies.

Methodology/Principal Findings

We examined whether the same relationship between capacity and resolution holds for color information. Participants performed a color change detection task while their electroencephalography was recorded. We manipulated representation resolution by asking participants to detect either a salient change (low-resolution) or a subtle change (high-resolution) in color. We used an ERP component known as contralateral delay activity (CDA) to index the amount of information maintained in VWM. The result demonstrated the same pattern for both low- and high-resolution conditions, with no difference between conditions.

Conclusions/Significance

This result suggests that VWM always represents a fixed number of approximately 3–4 colors regardless of the resolution of representation.

Coarse-to-fine construction for high-resolution representation in visual working memory

Background

This study explored whether the high-resolution representations created by visual working memory (VWM) are constructed in a coarse-to-fine or all-or-none manner. The coarse-to-fine hypothesis suggests that coarse information precedes detailed information in entering VWM and that its resolution increases along with the processing time of the memory array, whereas the all-or-none hypothesis claims that either both enter into VWM simultaneously, or neither does.

Methodology/Principal Findings

We tested the two hypotheses by asking participants to remember two or four complex objects. An ERP component, contralateral delay activity (CDA), was used as the neural marker. CDA is higher for four objects than for two objects when coarse information is primarily extracted; yet, this CDA difference vanishes when detailed information is encoded. Experiment 1 manipulated the comparison difficulty of the task under a 500-ms exposure time to determine a condition in which the detailed information was maintained. No CDA difference was found between two and four objects, even in an easy-comparison condition. Thus, Experiment 2 manipulated the memory array’s exposure time under the easy-comparison condition and found a significant CDA difference at 100 ms while replicating Experiment 1′s results at 500 ms. In Experiment 3, the 500-ms memory array was blurred to block the detailed information; this manipulation reestablished a significant CDA difference.

Conclusions/Significance

These findings suggest that the creation of high-resolution representations in VWM is a coarse-to-fine process.

Building blocks of visual working memory: objects or Boolean maps?

The nature of the building blocks of information in visual working memory (VWM) is a fundamental issue that has not been well resolved. Most researchers take objects as the building blocks, although this perspective has received criticism. The objects could be physically separated ones (strict object hypothesis) or hierarchical objects created from separated individuals (broad object hypothesis). Meanwhile, a newly proposed Boolean map theory for visual attention suggests that Boolean maps may be the building blocks of VWM (Boolean map hypothesis); this perspective could explain many critical findings of VWM. However, no previous study has examined these hypotheses. We explored this issue by focusing on a critical point on which they make distinct predictions. We asked participants to remember two distinct objects (2-object), three distinct objects (3-object), or three objects with repeated information (mixed-3-object, e.g., one red bar and two green bars, green bars could be represented as one hierarchical object) and adopted contralateral delay activity (CDA) to tap into the maintenance phase of VWM. The mixed-3-object condition could generate two Boolean maps, three objects, or three objects most of the time (hierarchical objects are created in certain trials, retaining two objects). Simple orientations (Experiment 1) and colors (Experiments 2 and 3) were used as stimuli. Although the CDA of the mixed-3-object condition was slightly lower than that of the 3-object condition, no significant difference was revealed between them. Both conditions displayed significantly higher CDAs than the 2-object condition. These findings support the broad object hypothesis. We further suggest that Boolean maps might be the unit for retrieval/comparison in VWM.

Contralateral delay activity tracks object identity information in visual short term memory

Previous studies suggested that ERP component contralateral delay activity (CDA) tracks the number of objects containing identity information stored in visual short term memory (VSTM). Later MEG and fMRI studies implied that its neural source lays in superior IPS. However, since the memorized stimuli in previous studies were displayed in distinct spatial locations, hence possibly CDA tracks the object-location information instead. Moreover, a recent study implied the activation in superior IPS reflected the location load. The current research thus explored whether CDA tracks the object-location load or the object-identity load, and its neural sources. Participants were asked to remember one color, four identical colors or four distinct colors. The four-identical-color condition was the critical one because it contains the same amount of identity information as that of one color while the same amount of location information as that of four distinct colors. To ensure the participants indeed selected four colors in the four-identical-color condition, we also split the participants into two groups (low- vs. high-capacity), analyzed late positive component (LPC) in the prefrontal area, and collected participant's subjective-report. Our results revealed that most of the participants selected four identical colors. Moreover, regardless of capacity-group, there was no difference on CDA between one color and four identical colors yet both were lower than 4 distinct colors. Besides, the source of CDA was located in the superior parietal lobule, which is very close to the superior IPS. These results support the statement that CDA tracks the object identity information in VSTM.