Neuronal firing rates account for distractor effects on mnemonic accuracy in a visuo-spatial working memory task

Strategy-dependent effects of working-memory limitations on human perceptual decision-making

Deliberative decisions based on an accumulation of evidence over time depend on working memory, and working memory has limitations, but how these limitations affect deliberative decision-making is not understood. We used human psychophysics to assess the impact of working-memory limitations on the fidelity of a continuous decision variable. Participants decided the average location of multiple visual targets. This computed, continuous decision variable degraded with time and capacity in a manner that depended critically on the strategy used to form the decision variable. This dependence reflected whether the decision variable was computed either: (1) immediately upon observing the evidence, and thus stored as a single value in memory; or (2) at the time of the report, and thus stored as multiple values in memory. These results provide important constraints on how the brain computes and maintains temporally dynamic decision variables.

Working memory, the brain’s ability to temporarily store and recall information, is a critical part of decision making – but it has its limits. The brain can only store so much information, for so long. Since decisions are not often acted on immediately, information held in working memory ‘degrades’ over time. However, it is unknown whether or not this degradation of information over time affects the accuracy of later decisions.

The tactics that people use, knowingly or otherwise, to store information in working memory also remain unclear. Do people store pieces of information such as numbers, objects and particular details? Or do they tend to compute that information, make some preliminary judgement and recall their verdict later? Does the strategy chosen impact people’s decision-making?

To investigate, Schapiro et al. devised a series of experiments to test whether the limitations of working memory, and how people store information, affect the accuracy of decisions they make. First, participants were shown an array of colored discs on a screen. Then, either immediately after seeing the disks or a few seconds later, the participants were asked to recall the position of one of the disks they had seen, or the average position of all the disks. This measured how much information degraded for a decision based on multiple items, and how much for a decision based on a single item. From this, the method of information storage used to make a decision could be inferred.

Schapiro et al. found that the accuracy of people’s responses worsened over time, whether they remembered the position of each individual disk, or computed their average location before responding. The greater the delay between seeing the disks and reporting their location, the less accurate people’s responses tended to be. Similarly, the more disks a participant saw, the less accurate their response became. This suggests that however people store information, if working memory reaches capacity, decision-making suffers and that, over time, stored information decays.

Schapiro et al. also noticed that participants remembered location information in different ways depending on the task and how many disks they were shown at once. This suggests people adopt different strategies to retain information momentarily.

In summary, these findings help to explain how people process and store information to make decisions and how the limitations of working memory impact their decision-making ability. A better understanding of how people use working memory to make decisions may also shed light on situations or brain conditions where decision-making is impaired.

The Functional Interactions between Cortical Regions through Theta-Gamma Coupling during Resting-State and a Visual Working Memory Task

Theta phase-gamma amplitude coupling (TGC) plays an important role in several different cognitive processes. Although spontaneous brain activity at the resting state is crucial in preparing for cognitive performance, the functional role of resting-state TGC remains unclear. To investigate the role of resting-state TGC, electroencephalogram recordings were obtained for 56 healthy volunteers while they were in the resting state, with their eyes closed, and then when they were engaged in a retention interval period in the visual memory task. The TGCs of the two different conditions were calculated and compared. The results indicated that the modulation index of TGC during the retention interval of the visual working memory (VWM) task was not higher than that during the resting state; however, the topographical distribution of TGC during the resting state was negatively correlated with TGC during VWM task at the local level. The topographical distribution of TGC during the resting state was negatively correlated with TGC coordinates’ engagement of brain areas in local and large-scale networks and during task performance at the local level. These findings support the view that TGC reflects information-processing and signal interaction across distant brain areas. These results demonstrate that TGC could explain the efficiency of competing brain networks.

Working Memory and Cross-Frequency Coupling of Neuronal Oscillations

Working memory (WM) is the active retention and processing of information over a few seconds and is considered an essential component of cognitive function. The reduced WM capacity is a common feature in many diseases, such as schizophrenia, attention deficit hyperactivity disorder (ADHD), mild cognitive impairment (MCI), and Alzheimer's disease (AD). The theta-gamma neural code is an essential component of memory representations in the multi-item WM. A large body of studies have examined the association between cross-frequency coupling (CFC) across the cerebral cortices and WM performance; electrophysiological data together with the behavioral results showed the associations between CFC and WM performance. The oscillatory entrainment (sensory, non-invasive electrical/magnetic, and invasive electrical) remains the key method to investigate the causal relationship between CFC and WM. The frequency-tuned non-invasive brain stimulation is a promising way to improve WM performance in healthy and non-healthy patients with cognitive impairment. The WM performance is sensitive to the phase and rhythm of externally applied stimulations. CFC-transcranial-alternating current stimulation (CFC-tACS) is a recent approach in neuroscience that could alter cognitive outcomes. The studies that investigated (1) the association between CFC and WM and (2) the brain stimulation protocols that enhanced WM through modulating CFC by the means of the non-invasive brain stimulation techniques have been included in this review. In principle, this review can guide the researchers to identify the most prominent form of CFC associated with WM processing (e.g., theta/gamma phase-amplitude coupling), and to define the previously published studies that manipulate endogenous CFC externally to improve WM. This in turn will pave the path for future studies aimed at investigating the CFC-tACS effect on WM. The CFC-tACS protocols need to be thoroughly studied before they can be considered as therapeutic tools in patients with WM deficits.

Latching dynamics as a basis for short-term recall

We discuss simple models for the transient storage in short-term memory of cortical patterns of activity, all based on the notion that their recall exploits the natural tendency of the cortex to hop from state to state—latching dynamics. We show that in one such model, and in simple spatial memory tasks we have given to human subjects, short-term memory can be limited to similar low capacity by interference effects, in tasks terminated by errors, and can exhibit similar sublinear scaling, when errors are overlooked. The same mechanism can drive serial recall if combined with weak order-encoding plasticity. Finally, even when storing randomly correlated patterns of activity the network demonstrates correlation-driven latching waves, which are reflected at the outer extremes of pattern space.

What makes short-term memory so poor, that over a minute we tend to forget even phone numbers, if we cannot rehearse or record them electronically? In comparison, long-term memory can be amazingly rich and accurate. Was it so difficult to equip our brain with a short-term memory device of reasonable capacity?

We discuss the hypothesis that instead of an ad hoc device, short-term memory relies on long-term representations, and that the short-term recall of multiple items exploits the natural tendency of the cortex to jump from state to state, by only adding imprecisely determined “kicks” that spur cortical dynamics towards the states representing those items. We show that a plausible neural model for such kicks performs similarly to human subjects we have tested, both in conditions when short-term recall is terminated by errors, and when errors are overlooked and subjects are asked to keep trying. The same mechanism can drive serial recall, if combined with equally imprecise kicks encoding item order. Our analysis suggests that a proper short-term memory device may have never evolved in our brain, which had, therefore, to make do with tweaking its superb long-term memory capabilities.

Robust spatial ventriloquism effect and trial-by-trial aftereffect under memory interference

Our brain adapts to discrepancies in the sensory inputs. One example is provided by the ventriloquism effect, experienced when the sight and sound of an object are displaced. Here the discrepant multisensory stimuli not only result in a biased localization of the sound, but also recalibrate the perception of subsequent unisensory acoustic information in the so-called ventriloquism aftereffect. This aftereffect has been linked to memory-related processes based on its parallels to general sequential effects in perceptual decision making experiments and insights obtained in neuroimaging studies. For example, we have recently implied memory-related medial parietal regions in the trial-by-trial ventriloquism aftereffect. Here, we tested the hypothesis that the trial-by-trial (or immediate) ventriloquism aftereffect is indeed susceptible to manipulations interfering with working memory. Across three experiments we systematically manipulated the temporal delays between stimuli and response for either the ventriloquism or the aftereffect trials, or added a sensory-motor masking trial in between. Our data reveal no significant impact of either of these manipulations on the aftereffect, suggesting that the recalibration reflected by the trial-by-trial ventriloquism aftereffect is surprisingly resilient to manipulations interfering with memory-related processes.

Stability of working memory in continuous attractor networks under the control of short-term plasticity

Continuous attractor models of working-memory store continuous-valued information in continuous state-spaces, but are sensitive to noise processes that degrade memory retention. Short-term synaptic plasticity of recurrent synapses has previously been shown to affect continuous attractor systems: short-term facilitation can stabilize memory retention, while short-term depression possibly increases continuous attractor volatility. Here, we present a comprehensive description of the combined effect of both short-term facilitation and depression on noise-induced memory degradation in one-dimensional continuous attractor models. Our theoretical description, applicable to rate models as well as spiking networks close to a stationary state, accurately describes the slow dynamics of stored memory positions as a combination of two processes: (i) diffusion due to variability caused by spikes; and (ii) drift due to random connectivity and neuronal heterogeneity. We find that facilitation decreases both diffusion and directed drifts, while short-term depression tends to increase both. Using mutual information, we evaluate the combined impact of short-term facilitation and depression on the ability of networks to retain stable working memory. Finally, our theory predicts the sensitivity of continuous working memory to distractor inputs and provides conditions for stability of memory.

The ability to transiently memorize positions in the visual field is crucial for behavior. Models and experiments have shown that such memories can be maintained in networks of cortical neurons with a continuum of possible activity states, that reflects the continuum of positions in the environment. However, the accuracy of positions stored in such networks will degrade over time due to the noisiness of neuronal signaling and imperfections of the biological substrate. Previous work in simplified models has shown that synaptic short-term plasticity could stabilize this degradation by dynamically up- or down-regulating the strength of synaptic connections, thereby “pinning down” memorized positions. Here, we present a general theory that accurately predicts the extent of this “pinning down” by short-term plasticity in a broad class of biologically plausible network models, thereby untangling the interplay of varying biological sources of noise with short-term plasticity. Importantly, our work provides a novel theoretical link from the microscopic substrate of working memory—neurons and synaptic connections—to observable behavioral correlates, for example the susceptibility to distracting stimuli.

The neuroscience of working memory capacity and training

Working memory - the ability to maintain and manipulate information over a period of seconds - is a core component of higher cognitive functions. The storage capacity of working memory is limited but can be expanded by training, and evidence of the neural mechanisms underlying this effect is accumulating. Human imaging studies and neurophysiological recordings in non-human primates, together with computational modelling studies, reveal that training increases the activity of prefrontal neurons and the strength of connectivity in the prefrontal cortex and between the prefrontal and parietal cortex. Dopaminergic transmission could have a facilitatory role. These changes more generally inform us of the plasticity of higher cognitive functions.

Neural circuit basis of visuo-spatial working memory precision: a computational and behavioral study

The amount of information that can be retained in working memory (WM) is limited. Limitations of WM capacity have been the subject of intense research, especially in trying to specify algorithmic models for WM. Comparatively, neural circuit perspectives have barely been used to test WM limitations in behavioral experiments. Here we used a neuronal microcircuit model for visuo-spatial WM (vsWM) to investigate memory of several items. The model assumes that there is a topographic organization of the circuit responsible for spatial memory retention. This assumption leads to specific predictions, which we tested in behavioral experiments. According to the model, nearby locations should be recalled with a bias, as if the two memory traces showed attraction or repulsion during the delay period depending on distance. Another prediction is that the previously reported loss of memory precision for an increasing number of memory items (memory load) should vanish when the distances between items are controlled for. Both predictions were confirmed experimentally. Taken together, our findings provide support for a topographic neural circuit organization of vsWM, they suggest that interference between similar memories underlies some WM limitations, and they put forward a circuit-based explanation that reconciles previous conflicting results on the dependence of WM precision with load.

Ghosts in the machine: memory interference from the previous trial

Previous memoranda can interfere with the memorization or storage of new information, a concept known as proactive interference. Studies of proactive interference typically use categorical memoranda and match-to-sample tasks with categorical measures such as the proportion of correct to incorrect responses. In this study we instead train five macaques in a spatial memory task with continuous memoranda and responses, allowing us to more finely probe working memory circuits. We first ask whether the memoranda from the previous trial result in proactive interference in an oculomotor delayed response task. We then characterize the spatial and temporal profile of this interference and ask whether this profile can be predicted by an attractor network model of working memory. We find that memory in the current trial shows a bias toward the location of the memorandum of the previous trial. The magnitude of this bias increases with the duration of the memory period within which it is measured. Our simulations using standard attractor network models of working memory show that these models easily replicate the spatial profile of the bias. However, unlike the behavioral findings, these attractor models show an increase in bias with the duration of the previous rather than the current memory period. To model a bias that increases with current trial duration we posit two separate memory stores, a rapidly decaying visual store that resists proactive interference effects and a sustained memory store that is susceptible to proactive interference.

Trade-off between capacity and precision in visuospatial working memory

Limitations in the performance of working memory (WM) tasks have been characterized in terms of the number of items retained (capacity) and in terms of the precision with which the information is retained. The neural mechanisms behind these limitations are still unclear. Here we used a biological constrained computational model to study the capacity and precision of visuospatial WM. The model consists of two connected networks of spiking neurons. One network is responsible for storage of information. The other provides a nonselective excitatory input to the storage network. Simulations showed that this excitation boost could temporarily increase storage capacity but also predicted that this would be associated with a decrease in precision of the memory. This prediction was subsequently tested in a behavioral (38 participants) and fMRI (22 participants) experiment. The behavioral results confirmed the trade-off effect, and the fMRI results suggest that a frontal region might be engaged in the trial-by-trial control of WM performance. The average effects were small, but individuals differed in the amount of trade-off, and these differences correlated with the frontal activation. These results support a two-module model of WM where performance is determined both by storage capacity and by top-down influence, which can vary on a trial-by-trial basis, affecting both the capacity and precision of WM.

Fronto-parietal connection asymmetry regulates working memory distractibility

Recent functional magnetic resonance imaging studies demonstrate that increased task-related neural activity in parietal and frontal cortex during development and training is positively correlated with improved visuospatial working memory (vsWM) performance. Yet, the analysis of the corresponding underlying functional reorganization of the fronto-parietal network has received little attention. Here, we perform an integrative experimental and computational analysis to determine the effective balance between the superior frontal sulcus (SFS) and intraparietal sulcus (IPS) and their putative role(s) in protecting against distracters. To this end, we performed electroencephalographic (EEG) recordings during a vsWM task. We utilized a biophysically based computational cortical network model to analyze the effects of different neural changes in the underlying cortical networks on the directed transfer function (DTF) and spiking activity. Combining a DTF analysis of our EEG data with the DTF analysis of the computational model, a directed strong SFS --> IPS network was revealed. Such a configuration offers protection against distracters, whereas the opposite is true for strong IPS --> SFS connections. Our results therefore suggest that the previously demonstrated improvement of vsWM performance during development could be due to a shift in the control of the effective balance between the SFS-IPS networks.

Attractor models of working memory and their modulation by reward

This work reports an empirical examination of two key issues in theoretical neuroscience: distractibility in the context of working memory (WM) and its reward dependence. While these issues have been examined fruitfully in isolation (e.g. Macoveanu et al. in Biol Cybern 96(4): 407-19, 2007), we address them here in tandem, with a focus on how distractibility and reward interact. In particular, we parameterise an observation model that embodies the nonlinear form of such interactions, as described in a recent neuronal network model (Gruber et al. in J Comput Neurosci 20:153-166, 2006). We observe that memory for a target stimulus can be corrupted by distracters in the delay period. Interestingly, in contrast to our theoretical predictions, this corruption was only partial. Distracters do not simply overwrite target; rather, a compromise is reached between target and distracter. Finally, we observed a trend towards a reduced distractibility under conditions of high reward. We discuss the implications of these findings for theoretical formulations of basal and dopamine (DA)-modulated neural bump- attractor networks of working memory.