1
|
Mao Chao C, Xu C, Loaiza V, Rose NS. Are latent working memory items retrieved from long-term memory? Q J Exp Psychol (Hove) 2024; 77:1703-1726. [PMID: 37981748 DOI: 10.1177/17470218231217723] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2023]
Abstract
Switching one's focus of attention between to-be-remembered items in working memory (WM) is critical for cognition, but the mechanisms by which this is accomplished are unclear. A long-term memory (LTM) account suggests that switching attention away from an item, and passively retaining and reactivating such "latent" items back into the focus of attention involves episodic LTM retrieval processes, even for delays of only a few seconds. We tested this hypothesis using a two-item, double-retrocue WM task that requires participants to switch attention away from and reactivate items followed by subsequent LTM tests for reactivated items from the initial WM task (vs. continuously retained or untested control items). We compared performance on these tests between older adults (a population with LTM deficits) and young adults with either full (Experiment 1) or divided (Experiment 2) attention during the WM delay periods. The effects of reactivating latent items, as well as ageing and divided attention, had significant effects on WM performance, but did not interact with or systematically affect subsequent LTM for reactivated versus control items on item-, location-, or associative-recognition memory judgements made with either high or low confidence. Experiment 3 confirmed that these effects did not depend on whether or not young participants were warned about the subsequent LTM tests before performing the WM task. These dissociations between WM and LTM are inconsistent with the LTM account of latent WM; they are more consistent with the dynamic processing model of WM (Current Directions in Psychological Science).
Collapse
|
2
|
Stroud JP, Duncan J, Lengyel M. The computational foundations of dynamic coding in working memory. Trends Cogn Sci 2024; 28:614-627. [PMID: 38580528 DOI: 10.1016/j.tics.2024.02.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2023] [Revised: 02/29/2024] [Accepted: 02/29/2024] [Indexed: 04/07/2024]
Abstract
Working memory (WM) is a fundamental aspect of cognition. WM maintenance is classically thought to rely on stable patterns of neural activities. However, recent evidence shows that neural population activities during WM maintenance undergo dynamic variations before settling into a stable pattern. Although this has been difficult to explain theoretically, neural network models optimized for WM typically also exhibit such dynamics. Here, we examine stable versus dynamic coding in neural data, classical models, and task-optimized networks. We review principled mathematical reasons for why classical models do not, while task-optimized models naturally do exhibit dynamic coding. We suggest an update to our understanding of WM maintenance, in which dynamic coding is a fundamental computational feature rather than an epiphenomenon.
Collapse
Affiliation(s)
- Jake P Stroud
- Computational and Biological Learning Lab, Department of Engineering, University of Cambridge, Cambridge, UK.
| | - John Duncan
- MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, UK
| | - Máté Lengyel
- Computational and Biological Learning Lab, Department of Engineering, University of Cambridge, Cambridge, UK; Center for Cognitive Computation, Department of Cognitive Science, Central European University, Budapest, Hungary
| |
Collapse
|
3
|
Bays PM, Schneegans S, Ma WJ, Brady TF. Representation and computation in visual working memory. Nat Hum Behav 2024; 8:1016-1034. [PMID: 38849647 DOI: 10.1038/s41562-024-01871-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2022] [Accepted: 03/22/2024] [Indexed: 06/09/2024]
Abstract
The ability to sustain internal representations of the sensory environment beyond immediate perception is a fundamental requirement of cognitive processing. In recent years, debates regarding the capacity and fidelity of the working memory (WM) system have advanced our understanding of the nature of these representations. In particular, there is growing recognition that WM representations are not merely imperfect copies of a perceived object or event. New experimental tools have revealed that observers possess richer information about the uncertainty in their memories and take advantage of environmental regularities to use limited memory resources optimally. Meanwhile, computational models of visuospatial WM formulated at different levels of implementation have converged on common principles relating capacity to variability and uncertainty. Here we review recent research on human WM from a computational perspective, including the neural mechanisms that support it.
Collapse
Affiliation(s)
- Paul M Bays
- Department of Psychology, University of Cambridge, Cambridge, UK
| | | | - Wei Ji Ma
- Center for Neural Science and Department of Psychology, New York University, New York, NY, USA
| | - Timothy F Brady
- Department of Psychology, University of California, San Diego, La Jolla, CA, USA.
| |
Collapse
|
4
|
Duncan DH, van Moorselaar D, Theeuwes J. Pinging the brain to reveal the hidden attentional priority map using encephalography. Nat Commun 2023; 14:4749. [PMID: 37550310 PMCID: PMC10406833 DOI: 10.1038/s41467-023-40405-8] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2022] [Accepted: 07/27/2023] [Indexed: 08/09/2023] Open
Abstract
Attention has been usefully thought of as organized in priority maps - putative maps of space where attentional priority is weighted across spatial regions in a winner-take-all competition for attentional deployment. Recent work has highlighted the influence of past experiences on the weighting of spatial priority - called selection history. Aside from being distinct from more well-studied, top-down forms of attentional enhancement, little is known about the neural substrates of history-mediated attentional priority. Using a task known to induce statistical learning of target distributions, in an EEG study we demonstrate that this otherwise invisible, latent attentional priority map can be visualized during the intertrial period using a 'pinging' technique in conjunction with multivariate pattern analyses. Our findings not only offer a method of visualizing the history-mediated attentional priority map, but also shed light on the underlying mechanisms allowing our past experiences to influence future behavior.
Collapse
Affiliation(s)
- Dock H Duncan
- Vrije Universiteit Amsterdam, Amsterdam, the Netherlands.
- Institute Brain and Behavior Amsterdam (iBBA), Amsterdam, the Netherlands.
| | - Dirk van Moorselaar
- Vrije Universiteit Amsterdam, Amsterdam, the Netherlands
- Institute Brain and Behavior Amsterdam (iBBA), Amsterdam, the Netherlands
| | - Jan Theeuwes
- Vrije Universiteit Amsterdam, Amsterdam, the Netherlands
- Institute Brain and Behavior Amsterdam (iBBA), Amsterdam, the Netherlands
- William James Center for Research, ISPA-Instituto Universitario, Lisbon, Portugal
| |
Collapse
|
5
|
Rhilinger JP, Xu C, Rose NS. Are irrelevant items actively deleted from visual working memory?: No evidence from repulsion and attraction effects in dual-retrocue tasks. Atten Percept Psychophys 2023:10.3758/s13414-023-02724-2. [PMID: 37226042 PMCID: PMC10208559 DOI: 10.3758/s13414-023-02724-2] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/26/2023] [Indexed: 05/26/2023]
Abstract
Some theories propose that working memory (WM) involves the active deletion of irrelevant information, including items that were retained in WM, but are no longer relevant for ongoing cognition. Considerable evidence suggests that active-deletion occurs for categorical representations, but whether it also occurs for recall of features that are typically bound together in an object, such as line orientations, is unclear. In two experiments, with or without binding instructions, healthy young adults maintained two orientations, focused attention to recall the orientation cued first, and then switched attention to recall the orientation cued second, at which point the uncued orientation was no longer relevant on the trial. In contrast to the active-deletion hypothesis, the results showed that the no-longer-relevant items exerted the strongest bias on participants' recall, which was either repulsive or attractive depending on both the degree of difference between the target and nontarget orientations and the proximity to cardinal axes. We suggest that visual WM can bind features like line orientations into chunked representations, and an irrelevant feature of a chunked object cannot be actively deleted - it biases recall of the target feature. Models of WM need to be updated to explain this and related dynamic phenomena.
Collapse
Affiliation(s)
- Joshua P Rhilinger
- University of Notre Dame, 390 Corbett Family Hall, Notre Dame, IN, 46556, USA
| | - Chenlingxi Xu
- University of Notre Dame, 390 Corbett Family Hall, Notre Dame, IN, 46556, USA
| | - Nathan S Rose
- University of Notre Dame, 390 Corbett Family Hall, Notre Dame, IN, 46556, USA.
| |
Collapse
|
6
|
Black J, Nozari N. Precision of phonological errors in aphasia supports resource models of phonological working memory in language production. Cogn Neuropsychol 2023; 40:1-24. [PMID: 37127940 PMCID: PMC10336978 DOI: 10.1080/02643294.2023.2206012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2022] [Revised: 04/12/2023] [Accepted: 04/18/2023] [Indexed: 05/03/2023]
Abstract
Working memory (WM) is critical for many cognitive functions including language production. A key feature of WM is its capacity limitation. Two models have been proposed to account for such capacity limitation: slot models and resource models. In recent years, resource models have found support in both visual and auditory perception, but do they also extend to production? We investigate this by analyzing sublexical errors from four individuals with aphasia. Using tools from computational linguistics, we first define the concept of "precision" of sublexical errors. We then demonstrate that such precision decreases with increased working memory load, i.e., word length, as predicted by resource models. Finally, we rule out alternative accounts of this effect, such as articulatory simplification. These data provide the first evidence for the applicability of the resource model to production and further point to the generalizability of this account as a model of resource division in WM.
Collapse
Affiliation(s)
- Jenah Black
- Department of Psychology, Carnegie Mellon University, Pittsburgh, PA, USA
- Center for the Neural Basis of Cognition (CNBC), Pittsburgh, PA, USA
| | - Nazbanou Nozari
- Department of Psychology, Carnegie Mellon University, Pittsburgh, PA, USA
- Center for the Neural Basis of Cognition (CNBC), Pittsburgh, PA, USA
| |
Collapse
|
7
|
Wan Q, Menendez JA, Postle BR. Priority-based transformations of stimulus representation in visual working memory. PLoS Comput Biol 2022; 18:e1009062. [PMID: 35653404 PMCID: PMC9197029 DOI: 10.1371/journal.pcbi.1009062] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2021] [Revised: 06/14/2022] [Accepted: 05/12/2022] [Indexed: 11/18/2022] Open
Abstract
How does the brain prioritize among the contents of working memory (WM) to appropriately guide behavior? Previous work, employing inverted encoding modeling (IEM) of electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) datasets, has shown that unprioritized memory items (UMI) are actively represented in the brain, but in a “flipped”, or opposite, format compared to prioritized memory items (PMI). To acquire independent evidence for such a priority-based representational transformation, and to explore underlying mechanisms, we trained recurrent neural networks (RNNs) with a long short-term memory (LSTM) architecture to perform a 2-back WM task. Visualization of LSTM hidden layer activity using Principal Component Analysis (PCA) confirmed that stimulus representations undergo a representational transformation–consistent with a flip—while transitioning from the functional status of UMI to PMI. Demixed (d)PCA of the same data identified two representational trajectories, one each within a UMI subspace and a PMI subspace, both undergoing a reversal of stimulus coding axes. dPCA of data from an EEG dataset also provided evidence for priority-based transformations of the representational code, albeit with some differences. This type of transformation could allow for retention of unprioritized information in WM while preventing it from interfering with concurrent behavior. The results from this initial exploration suggest that the algorithmic details of how this transformation is carried out by RNNs, versus by the human brain, may differ.
Collapse
Affiliation(s)
- Quan Wan
- Department of Psychology, University of Wisconsin–Madison, Madison, Wisconsin, United States of America
- * E-mail:
| | - Jorge A. Menendez
- Gatsby Computational Neuroscience Unit, University College London, London, United Kingdom
| | - Bradley R. Postle
- Department of Psychology, University of Wisconsin–Madison, Madison, Wisconsin, United States of America
- Department of Psychiatry, University of Wisconsin–Madison, Madison, Wisconsin, United States of America
| |
Collapse
|
8
|
Barbosa J, Lozano-Soldevilla D, Compte A. Pinging the brain with visual impulses reveals electrically active, not activity-silent, working memories. PLoS Biol 2021; 19:e3001436. [PMID: 34673775 PMCID: PMC8641864 DOI: 10.1371/journal.pbio.3001436] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2021] [Revised: 12/03/2021] [Accepted: 10/04/2021] [Indexed: 11/18/2022] Open
Abstract
Persistently active neurons during mnemonic periods have been regarded as the mechanism underlying working memory maintenance. Alternatively, neuronal networks could instead store memories in fast synaptic changes, thus avoiding the biological cost of maintaining an active code through persistent neuronal firing. Such "activity-silent" codes have been proposed for specific conditions in which memories are maintained in a nonprioritized state, as for unattended but still relevant short-term memories. A hallmark of this "activity-silent" code is that these memories can be reactivated from silent, synaptic traces. Evidence for "activity-silent" working memory storage has come from human electroencephalography (EEG), in particular from the emergence of decodability (EEG reactivations) induced by visual impulses (termed pinging) during otherwise "silent" periods. Here, we reanalyze EEG data from such pinging studies. We find that the originally reported absence of memory decoding reflects weak statistical power, as decoding is possible based on more powered analyses or reanalysis using alpha power instead of raw voltage. This reveals that visual pinging EEG "reactivations" occur in the presence of an electrically active, not silent, code for unattended memories in these data. This crucial change in the evidence provided by this dataset prompts a reinterpretation of the mechanisms of EEG reactivations. We provide 2 possible explanations backed by computational models, and we discuss the relationship with TMS-induced EEG reactivations.
Collapse
Affiliation(s)
- Joao Barbosa
- Institut d’Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Spain
- Laboratoire de Neurosciences Cognitives et Computationnelles, Département d’Études Cognitives, École Normale Supérieure, PSL University, Paris, France
| | - Diego Lozano-Soldevilla
- Institut d’Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Spain
- Centro de Investigación Biomédica en Red de Enfermedades Raras (CIBERER), Madrid, Spain
- Laboratory for Clinical Neuroscience, Centre for Biomedical Technology, Universidad Politécnica de Madrid, Campus de Montegancedo, Pozuelo de Alarcón, Madrid, Spain
| | - Albert Compte
- Institut d’Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Spain
| |
Collapse
|
9
|
Wojtak W, Coombes S, Avitabile D, Bicho E, Erlhagen W. A dynamic neural field model of continuous input integration. BIOLOGICAL CYBERNETICS 2021; 115:451-471. [PMID: 34417880 DOI: 10.1007/s00422-021-00893-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/01/2021] [Accepted: 08/01/2021] [Indexed: 06/13/2023]
Abstract
The ability of neural systems to turn transient inputs into persistent changes in activity is thought to be a fundamental requirement for higher cognitive functions. In continuous attractor networks frequently used to model working memory or decision making tasks, the persistent activity settles to a stable pattern with the stereotyped shape of a "bump" independent of integration time or input strength. Here, we investigate a new bump attractor model in which the bump width and amplitude not only reflect qualitative and quantitative characteristics of a preceding input but also the continuous integration of evidence over longer timescales. The model is formalized by two coupled dynamic field equations of Amari-type which combine recurrent interactions mediated by a Mexican-hat connectivity with local feedback mechanisms that balance excitation and inhibition. We analyze the existence, stability and bifurcation structure of single and multi-bump solutions and discuss the relevance of their input dependence to modeling cognitive functions. We then systematically compare the pattern formation process of the two-field model with the classical Amari model. The results reveal that the balanced local feedback mechanisms facilitate the encoding and maintenance of multi-item memories. The existence of stable subthreshold bumps suggests that different to the Amari model, the suppression effect of neighboring bumps in the range of lateral competition may not lead to a complete loss of information. Moreover, bumps with larger amplitude are less vulnerable to noise-induced drifts and distance-dependent interaction effects resulting in more faithful memory representations over time.
Collapse
Affiliation(s)
- Weronika Wojtak
- Research Centre of Mathematics, University of Minho, Guimarães, Portugal.
- Research Centre Algoritmi, University of Minho, Guimarães, Portugal.
| | - Stephen Coombes
- Centre for Mathematical Medicine and Biology, School of Mathematical Sciences, University of Nottingham, Nottingham, UK
| | - Daniele Avitabile
- Department of Mathematics, Vrije Universiteit, Amsterdam, The Netherlands
- MathNeuro Team, Inria Sophia Antipolis Méditerranée Research Centre, Sophia Antipolis, France
| | - Estela Bicho
- Research Centre Algoritmi, University of Minho, Guimarães, Portugal
| | - Wolfram Erlhagen
- Research Centre of Mathematics, University of Minho, Guimarães, Portugal
| |
Collapse
|
10
|
Curtis CE, Sprague TC. Persistent Activity During Working Memory From Front to Back. Front Neural Circuits 2021; 15:696060. [PMID: 34366794 PMCID: PMC8334735 DOI: 10.3389/fncir.2021.696060] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2021] [Accepted: 06/28/2021] [Indexed: 01/06/2023] Open
Abstract
Working memory (WM) extends the duration over which information is available for processing. Given its importance in supporting a wide-array of high level cognitive abilities, uncovering the neural mechanisms that underlie WM has been a primary goal of neuroscience research over the past century. Here, we critically review what we consider the two major "arcs" of inquiry, with a specific focus on findings that were theoretically transformative. For the first arc, we briefly review classic studies that led to the canonical WM theory that cast the prefrontal cortex (PFC) as a central player utilizing persistent activity of neurons as a mechanism for memory storage. We then consider recent challenges to the theory regarding the role of persistent neural activity. The second arc, which evolved over the last decade, stemmed from sophisticated computational neuroimaging approaches enabling researchers to decode the contents of WM from the patterns of neural activity in many parts of the brain including early visual cortex. We summarize key findings from these studies, their implications for WM theory, and finally the challenges these findings pose. Our goal in doing so is to identify barriers to developing a comprehensive theory of WM that will require a unification of these two "arcs" of research.
Collapse
Affiliation(s)
- Clayton E. Curtis
- Department of Psychology, New York University, New York, NY, United States
- Center for Neural Science, New York University, New York, NY, United States
| | - Thomas C. Sprague
- Department of Psychological and Brain Sciences, University of California, Santa Barbara, Santa Barbara, CA, United States
| |
Collapse
|
11
|
Xu Y. Towards a better understanding of information storage in visual working memory. VISUAL COGNITION 2021; 29:437-445. [DOI: 10.1080/13506285.2021.1946230] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Affiliation(s)
- Yaoda Xu
- Department of Psychology, Yale University, New Haven, USA
| |
Collapse
|
12
|
Shared mechanisms underlie the control of working memory and attention. Nature 2021; 592:601-605. [PMID: 33790467 DOI: 10.1038/s41586-021-03390-w] [Citation(s) in RCA: 134] [Impact Index Per Article: 44.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2020] [Accepted: 02/24/2021] [Indexed: 11/08/2022]
Abstract
Cognitive control guides behaviour by controlling what, when, and how information is represented in the brain1. For example, attention controls sensory processing; top-down signals from prefrontal and parietal cortex strengthen the representation of task-relevant stimuli2-4. A similar 'selection' mechanism is thought to control the representations held 'in mind'-in working memory5-10. Here we show that shared neural mechanisms underlie the selection of items from working memory and attention to sensory stimuli. We trained rhesus monkeys to switch between two tasks, either selecting one item from a set of items held in working memory or attending to one stimulus from a set of visual stimuli. Neural recordings showed that similar representations in prefrontal cortex encoded the control of both selection and attention, suggesting that prefrontal cortex acts as a domain-general controller. By contrast, both attention and selection were represented independently in parietal and visual cortex. Both selection and attention facilitated behaviour by enhancing and transforming the representation of the selected memory or attended stimulus. Specifically, during the selection task, memory items were initially represented in independent subspaces of neural activity in prefrontal cortex. Selecting an item caused its representation to transform from its own subspace to a new subspace used to guide behaviour. A similar transformation occurred for attention. Our results suggest that prefrontal cortex controls cognition by dynamically transforming representations to control what and when cognitive computations are engaged.
Collapse
|
13
|
The development of retro-cue benefits with extensive practice: Implications for capacity estimation and attentional states in visual working memory. Mem Cognit 2021; 49:1036-1049. [PMID: 33616865 PMCID: PMC7899059 DOI: 10.3758/s13421-021-01138-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/07/2021] [Indexed: 11/18/2022]
Abstract
Accessing the contents of visual short-term memory (VSTM) is compromised by information bottlenecks and visual interference between memorization and recall. Retro-cues, displayed after the offset of a memory stimulus and prior to the onset of a probe stimulus, indicate the test item and improve performance in VSTM tasks. It has been proposed that retro-cues aid recall by transferring information from a high-capacity memory store into visual working memory (multiple-store hypothesis). Alternatively, retro-cues could aid recall by redistributing memory resources within the same (low-capacity) working memory store (single-store hypothesis). If retro-cues provide access to a memory store with a capacity exceeding the set size, then, given sufficient training in the use of the retro-cue, near-ceiling performance should be observed. To test this prediction, 10 observers each performed 12 hours across 8 sessions in a retro-cue change-detection task (40,000+ trials total). The results provided clear support for the single-store hypothesis: retro-cue benefits (difference between a condition with and without retro-cues) emerged after a few hundred trials and then remained constant throughout the testing sessions, consistently improving performance by two items, rather than reaching ceiling performance. Surprisingly, we also observed a general increase in performance throughout the experiment in conditions with and without retro-cues, calling into question the generalizability of change-detection tasks in assessing working memory capacity as a stable trait of an observer (data and materials are available at osf.io/9xr82 and github.com/paulzerr/retrocues). In summary, the present findings suggest that retro-cues increase capacity estimates by redistributing memory resources across memoranda within a low-capacity working memory store.
Collapse
|
14
|
Olivers CN, Roelfsema PR. Attention for action in visual working memory. Cortex 2020; 131:179-194. [DOI: 10.1016/j.cortex.2020.07.011] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2020] [Revised: 06/22/2020] [Accepted: 07/14/2020] [Indexed: 12/27/2022]
|
15
|
Stokes MG, Muhle-Karbe PS, Myers NE. Theoretical distinction between functional states in working memory and their corresponding neural states. VISUAL COGNITION 2020; 28:420-432. [PMID: 33223922 PMCID: PMC7655036 DOI: 10.1080/13506285.2020.1825141] [Citation(s) in RCA: 26] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2020] [Accepted: 09/10/2020] [Indexed: 12/15/2022]
Abstract
Working memory (WM) is important for guiding behaviour, but not always for the next possible action. Here we define a WM item that is currently relevant for guiding behaviour as the functionally "active" item; whereas items maintained in WM, but not immediately relevant to behaviour, are defined as functionally "latent". Traditional neurophysiological theories of WM proposed that content is maintained via persistent neural activity (e.g., stable attractors); however, more recent theories have highlighted the potential role for "activity-silent" mechanisms (e.g., short-term synaptic plasticity). Given these somewhat parallel dichotomies, functionally active and latent cognitive states of WM have been associated with storage based on persistent-activity and activity-silent neural mechanisms, respectively. However, in this article we caution against a one-to-one correspondence between functional and activity states. We argue that the principal theoretical requirement for active and latent WM is that the corresponding neural states play qualitatively different functional roles. We consider a number of candidate solutions, and conclude that the neurophysiological mechanisms for functionally active and latent WM items are theoretically independent of the distinction between persistent activity-based and activity-silent forms of WM storage.
Collapse
Affiliation(s)
- Mark G. Stokes
- Wellcome Centre for Integrative Neuroimaging and Department of Experimental Psychology, University of Oxford, Oxford, UK
| | - Paul S. Muhle-Karbe
- Wellcome Centre for Integrative Neuroimaging and Department of Experimental Psychology, University of Oxford, Oxford, UK
| | - Nicholas E. Myers
- Wellcome Centre for Integrative Neuroimaging and Department of Experimental Psychology, University of Oxford, Oxford, UK
| |
Collapse
|
16
|
Abstract
Recent shifts in the understanding of how the mind and brain retain information in working memory (WM) call for revision to traditional theories. Evidence of dynamic, “activity-silent,” short-term retention processes diverges from conventional models positing that information is always retained in WM by sustained neural activity in buffers. Such evidence comes from machine-learning methods that can decode patterns of brain activity and the simultaneous administration of transcranial magnetic stimulation (TMS) to causally manipulate brain activity in specific areas and time points. TMS can “ping” brain areas to both reactivate latent representations retained in WM and affect memory performance. On the basis of these findings, I argue for a supplement to sustained retention mechanisms. Brain-decoding methods also reveal that dynamic levels of representational codes are retained in WM, and these vary according to task context, from perceptual (sensory) codes in posterior areas to abstract, recoded representations distributed across frontoparietal regions. A dynamic-processing model of WM is advanced to account for the overall pattern of results.
Collapse
Affiliation(s)
- Nathan S. Rose
- Cognitive Neuroscience of Memory & Aging Lab and Department of Psychology, University of Notre Dame
| |
Collapse
|
17
|
Abstract
Working memory is characterized by neural activity that persists during the retention interval of delay tasks. Despite the ubiquity of this delay activity across tasks, species and experimental techniques, our understanding of this phenomenon remains incomplete. Although initially there was a narrow focus on sustained activation in a small number of brain regions, methodological and analytical advances have allowed researchers to uncover previously unobserved forms of delay activity various parts of the brain. In light of these new findings, this Review reconsiders what delay activity is, where in the brain it is found, what roles it serves and how it may be generated.
Collapse
Affiliation(s)
- Kartik K Sreenivasan
- Division of Science and Mathematics, New York University Abu Dhabi, Abu Dhabi, United Arab Emirates.
| | - Mark D'Esposito
- Helen Wills Neuroscience Institute and Department of Psychology, University of California, Berkeley, CA, USA.
| |
Collapse
|
18
|
Working memory prioritization impacts neural recovery from distraction. Cortex 2019; 121:225-238. [PMID: 31629945 DOI: 10.1016/j.cortex.2019.08.019] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2019] [Revised: 06/22/2019] [Accepted: 08/30/2019] [Indexed: 01/25/2023]
Abstract
The ability to protect goal-relevant information from disruption over short intervals is a hallmark of working memory. Recent behavioral data suggest that high-priority items in working memory are more vulnerable to disruption. We used functional magnetic resonance imaging to evaluate the hypothesis that prioritization of working memories might impact the recovery of their neural representation(s) after distraction. A delay-period retrospective cue informed participants which of two memory items (a face or a scene) to prioritize during a first delay period. Consistent with prior work, and confirming successful prioritization, multivoxel pattern classifier evidence in perceptual brain regions was higher for cued versus uncued memory items. A distraction task was then imposed before a second retrospective cue informed participants to either "stay" remembering the previously cued item or "switch" to the previously uncued item. This allowed for the evaluation of recovery for high-priority items (on stay trials) and also low-priority items (on switch trials). Classifiers showed successful reinstatement of both high- and low-priority items after distraction, but only low-priority items recovered to their pre-distraction representational levels. Moreover, the degree of prioritization before distraction predicted the amount of disruption for high-priority items after distraction, suggesting that the more a participant prioritized the cued item, the greater the impact of distraction. Our data provide neural evidence that prioritizing working memory information in perceptual regions makes that information more vulnerable to disruption.
Collapse
|
19
|
Masse NY, Yang GR, Song HF, Wang XJ, Freedman DJ. Circuit mechanisms for the maintenance and manipulation of information in working memory. Nat Neurosci 2019; 22:1159-1167. [PMID: 31182866 PMCID: PMC7321806 DOI: 10.1038/s41593-019-0414-3] [Citation(s) in RCA: 98] [Impact Index Per Article: 19.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2018] [Accepted: 04/22/2019] [Indexed: 11/09/2022]
Abstract
Recently it has been proposed that information in working memory (WM) may not always be stored in persistent neuronal activity but can be maintained in 'activity-silent' hidden states, such as synaptic efficacies endowed with short-term synaptic plasticity. To test this idea computationally, we investigated recurrent neural network models trained to perform several WM-dependent tasks, in which WM representation emerges from learning and is not a priori assumed to depend on self-sustained persistent activity. We found that short-term synaptic plasticity can support the short-term maintenance of information, provided that the memory delay period is sufficiently short. However, in tasks that require actively manipulating information, persistent activity naturally emerges from learning, and the amount of persistent activity scales with the degree of manipulation required. These results shed insight into the current debate on WM encoding and suggest that persistent activity can vary markedly between short-term memory tasks with different cognitive demands.
Collapse
Affiliation(s)
- Nicolas Y Masse
- Department of Neurobiology, The University of Chicago, Chicago, IL, USA.
| | - Guangyu R Yang
- Center for Neural Science, New York University, New York, NY, USA
- Mortimer B. Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, NY, USA
| | - H Francis Song
- Center for Neural Science, New York University, New York, NY, USA
- Google DeepMind, London, UK
| | - Xiao-Jing Wang
- Center for Neural Science, New York University, New York, NY, USA
| | - David J Freedman
- Department of Neurobiology, The University of Chicago, Chicago, IL, USA.
- The Grossman Institute for Neuroscience, Quantitative Biology and Human Behavior, The University of Chicago, Chicago, IL, USA.
| |
Collapse
|
20
|
Manohar SG, Zokaei N, Fallon SJ, Vogels TP, Husain M. Neural mechanisms of attending to items in working memory. Neurosci Biobehav Rev 2019; 101:1-12. [PMID: 30922977 PMCID: PMC6525322 DOI: 10.1016/j.neubiorev.2019.03.017] [Citation(s) in RCA: 73] [Impact Index Per Article: 14.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2019] [Revised: 03/18/2019] [Accepted: 03/23/2019] [Indexed: 02/03/2023]
Abstract
Working memory, the ability to keep recently accessed information available for immediate manipulation, has been proposed to rely on two mechanisms that appear difficult to reconcile: self-sustained neural firing, or the opposite-activity-silent synaptic traces. Here we review and contrast models of these two mechanisms, and then show that both phenomena can co-exist within a unified system in which neurons hold information in both activity and synapses. Rapid plasticity in flexibly-coding neurons allows features to be bound together into objects, with an important emergent property being the focus of attention. One memory item is held by persistent activity in an attended or "focused" state, and is thus remembered better than other items. Other, previously attended items can remain in memory but in the background, encoded in activity-silent synaptic traces. This dual functional architecture provides a unified common mechanism accounting for a diversity of perplexing attention and memory effects that have been hitherto difficult to explain in a single theoretical framework.
Collapse
Affiliation(s)
- Sanjay G Manohar
- Nuffield Department of Clinical Neurosciences, University of Oxford, OX3 9DU, United Kingdom.
| | - Nahid Zokaei
- Department of Experimental Psychology, University of Oxford, United Kingdom; Oxford Centre for Human Brain Activity, University of Oxford, United Kingdom
| | - Sean J Fallon
- Department of Experimental Psychology, University of Oxford, United Kingdom
| | - Tim P Vogels
- Centre for Neural Circuits and Behaviour, University of Oxford, United Kingdom
| | - Masud Husain
- Nuffield Department of Clinical Neurosciences, University of Oxford, OX3 9DU, United Kingdom; Department of Experimental Psychology, University of Oxford, United Kingdom
| |
Collapse
|
21
|
van Loon AM, Olmos-Solis K, Fahrenfort JJ, Olivers CNL. Current and future goals are represented in opposite patterns in object-selective cortex. eLife 2018; 7:e38677. [PMID: 30394873 PMCID: PMC6279347 DOI: 10.7554/elife.38677] [Citation(s) in RCA: 46] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2018] [Accepted: 10/31/2018] [Indexed: 11/21/2022] Open
Abstract
Adaptive behavior requires the separation of current from future goals in working memory. We used fMRI of object-selective cortex to determine the representational (dis)similarities of memory representations serving current and prospective perceptual tasks. Participants remembered an object drawn from three possible categories as the target for one of two consecutive visual search tasks. A cue indicated whether the target object should be looked for first (currently relevant), second (prospectively relevant), or if it could be forgotten (irrelevant). Prior to the first search, representations of current, prospective and irrelevant objects were similar, with strongest decoding for current representations compared to prospective (Experiment 1) and irrelevant (Experiment 2). Remarkably, during the first search, prospective representations could also be decoded, but revealed anti-correlated voxel patterns compared to currently relevant representations of the same category. We propose that the brain separates current from prospective memories within the same neuronal ensembles through opposite representational patterns.
Collapse
Affiliation(s)
- Anouk Mariette van Loon
- Department of Experimental and Applied PsychologyVrije Universiteit AmsterdamAmsterdamThe Netherlands
- Institute of Brain and Behavior AmsterdamVrije Universiteit AmsterdamAmsterdamThe Netherlands
| | - Katya Olmos-Solis
- Department of Experimental and Applied PsychologyVrije Universiteit AmsterdamAmsterdamThe Netherlands
| | - Johannes Jacobus Fahrenfort
- Department of Experimental and Applied PsychologyVrije Universiteit AmsterdamAmsterdamThe Netherlands
- Department of Brain and CognitionUniversity of AmsterdamAmsterdamThe Netherlands
| | - Christian NL Olivers
- Department of Experimental and Applied PsychologyVrije Universiteit AmsterdamAmsterdamThe Netherlands
- Institute of Brain and Behavior AmsterdamVrije Universiteit AmsterdamAmsterdamThe Netherlands
| |
Collapse
|
22
|
Retrospective Cues Mitigate Information Loss in Human Cortex during Working Memory Storage. J Neurosci 2018; 38:8538-8548. [PMID: 30126971 DOI: 10.1523/jneurosci.1566-18.2018] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2018] [Revised: 08/06/2018] [Accepted: 08/16/2018] [Indexed: 12/29/2022] Open
Abstract
Working memory (WM) enables the flexible representation of information over short intervals. It is well established that WM performance can be enhanced by a retrospective cue presented during storage, yet the neural mechanisms responsible for this benefit are unclear. Here, we tested several explanations for retrospective cue benefits by quantifying changes in spatial WM representations reconstructed from alpha-band (8-12 Hz) EEG activity recorded from human participants (both sexes) before and after the presentation of a retrospective cue. This allowed us to track cue-related changes in WM representations with high temporal resolution (tens of milliseconds). Participants encoded the locations of two colored discs for subsequent report. During neutral trials, an uninformative cue instructed participants to remember the locations of both discs across a blank delay, and we observed a monotonic decrease in the fidelity of reconstructed spatial WM representations with time. During valid trials, a 100% reliable cue indicated that the color of the disc participants would be probed to report. Critically, valid cues were presented immediately after the termination of the encoding display ["valid early" (VE) trials] or midway through the delay period ["valid late" (VL) trials]. During VE trials, the gradual loss of location-specific information observed during neutral trials was eliminated, while during VL trials it was partially reversed. Our findings suggest that retrospective cues engage several different mechanisms that together serve to mitigate information loss during WM storage.SIGNIFICANCE STATEMENT Working memory (WM) performance can be improved by a cue presented during storage. This effect, termed a retrospective cue benefit, has been used to explore the limitations of attentional prioritization in WM. However, the mechanisms responsible for retrospective cue benefits are unclear. Here we tested several explanations for retrospective cue benefits by examining how they influence WM representations reconstructed from human EEG activity. This approach allowed us to visualize, quantify, and track the effects of retrospective cues with high temporal resolution (on the order of tens of milliseconds). We show that under different circumstances retrospective cues can both eliminate and even partially reverse information loss during WM storage, suggesting that retrospective cue benefits have manifold origins.
Collapse
|
23
|
Lewis-Peacock JA, Kessler Y, Oberauer K. The removal of information from working memory. Ann N Y Acad Sci 2018; 1424:33-44. [PMID: 29741212 DOI: 10.1111/nyas.13714] [Citation(s) in RCA: 58] [Impact Index Per Article: 9.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2017] [Revised: 03/12/2018] [Accepted: 03/16/2018] [Indexed: 01/15/2023]
Abstract
What happens to goal-relevant information in working memory after it is no longer needed? Here, we review evidence for a selective removal process that operates on outdated information to limit working memory load and hence facilitates the maintenance of goal-relevant information. Removal alters the representations of irrelevant content so as to reduce access to it, thereby improving access to the remaining relevant content and also facilitating the encoding of new information. Both behavioral and neural evidence support the existence of a removal process that is separate from forgetting due to decay or interference. We discuss the potential mechanisms involved in removal and characterize the time course and duration of the process. In doing so, we propose the existence of two forms of removal: one is temporary, and reversible, which modifies working memory content without impacting content-to-context bindings, and another is permanent, which unbinds the content from its context in working memory (without necessarily impacting long-term forgetting). Finally, we discuss limitations on removal and prescribe conditions for evaluating evidence for or against this process.
Collapse
Affiliation(s)
- Jarrod A Lewis-Peacock
- Department of Psychology and Institute for Neuroscience, University of Texas at Austin, Austin, Texas
| | - Yoav Kessler
- Department of Psychology and Zlotowski Center for Neuroscience, Ben-Gurion University of the Negev, Beer-Sheva, Israel
| | - Klaus Oberauer
- Department of Psychology, University of Zurich, Zurich, Switzerland
| |
Collapse
|
24
|
Drift in Neural Population Activity Causes Working Memory to Deteriorate Over Time. J Neurosci 2018; 38:4859-4869. [PMID: 29703786 PMCID: PMC5966793 DOI: 10.1523/jneurosci.3440-17.2018] [Citation(s) in RCA: 34] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2017] [Revised: 02/09/2018] [Accepted: 03/14/2018] [Indexed: 11/21/2022] Open
Abstract
Short-term memories are thought to be maintained in the form of sustained spiking activity in neural populations. Decreases in recall precision observed with increasing number of memorized items can be accounted for by a limit on total spiking activity, resulting in fewer spikes contributing to the representation of each individual item. Longer retention intervals likewise reduce recall precision, but it is unknown what changes in population activity produce this effect. One possibility is that spiking activity becomes attenuated over time, such that the same mechanism accounts for both effects of set size and retention duration. Alternatively, reduced performance may be caused by drift in the encoded value over time, without a decrease in overall spiking activity. Human participants of either sex performed a variable-delay cued recall task with a saccadic response, providing a precise measure of recall latency. Based on a spike integration model of decision making, if the effects of set size and retention duration are both caused by decreased spiking activity, we would predict a fixed relationship between recall precision and response latency across conditions. In contrast, the drift hypothesis predicts no systematic changes in latency with increasing delays. Our results show both an increase in latency with set size, and a decrease in response precision with longer delays within each set size, but no systematic increase in latency for increasing delay durations. These results were quantitatively reproduced by a model based on a limited neural resource in which working memories drift rather than decay with time. SIGNIFICANCE STATEMENT Rapid deterioration over seconds is a defining feature of short-term memory, but what mechanism drives this degradation of internal representations? Here, we extend a successful population coding model of working memory by introducing possible mechanisms of delay effects. We show that a decay in neural signal over time predicts that the time required for memory retrieval will increase with delay, whereas a random drift in the stored value predicts no effect of delay on retrieval time. Testing these predictions in a multi-item memory task with an eye movement response, we identified drift as a key mechanism of memory decline. These results provide evidence for a dynamic spiking basis for working memory, in contrast to recent proposals of activity-silent storage.
Collapse
|
25
|
Mallett R, Lewis-Peacock JA. Behavioral decoding of working memory items inside and outside the focus of attention. Ann N Y Acad Sci 2018; 1424:256-267. [PMID: 29604084 DOI: 10.1111/nyas.13647] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2017] [Revised: 01/25/2018] [Accepted: 01/30/2018] [Indexed: 11/29/2022]
Abstract
How we attend to our thoughts affects how we attend to our environment. Holding information in working memory can automatically bias visual attention toward matching information. By observing attentional biases on reaction times to visual search during a memory delay, it is possible to reconstruct the source of that bias using machine learning techniques and thereby behaviorally decode the content of working memory. Can this be done when more than one item is held in working memory? There is some evidence that multiple items can simultaneously bias attention, but the effects have been inconsistent. One explanation may be that items are stored in different states depending on the current task demands. Recent models propose functionally distinct states of representation for items inside versus outside the focus of attention. Here, we use behavioral decoding to evaluate whether multiple memory items-including temporarily irrelevant items outside the focus of attention-exert biases on visual attention. Only the single item in the focus of attention was decodable. The other item showed a brief attentional bias that dissipated until it returned to the focus of attention. These results support the idea of dynamic, flexible states of working memory across time and priority.
Collapse
Affiliation(s)
- Remington Mallett
- Department of Psychology, University of Texas at Austin, Austin, Texas
| | | |
Collapse
|
26
|
Yue Q, Martin RC, Hamilton AC, Rose NS. Non-perceptual Regions in the Left Inferior Parietal Lobe Support Phonological Short-term Memory: Evidence for a Buffer Account? Cereb Cortex 2018. [DOI: 10.1093/cercor/bhy037] [Citation(s) in RCA: 31] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/16/2022] Open
Affiliation(s)
- Qiuhai Yue
- Department of Psychology, Rice University, MS-25, P.O. Box 1892, Houston, TX, USA
| | - Randi C Martin
- Department of Psychology, Rice University, MS-25, P.O. Box 1892, Houston, TX, USA
| | - A Cris Hamilton
- Department of Psychology, Rice University, MS-25, P.O. Box 1892, Houston, TX, USA
| | - Nathan S Rose
- Department of Psychology, University of Notre Dame, Notre Dame, IN, USA
| |
Collapse
|
27
|
Cortical specialization for attended versus unattended working memory. Nat Neurosci 2018; 21:494-496. [PMID: 29507410 DOI: 10.1038/s41593-018-0094-4] [Citation(s) in RCA: 105] [Impact Index Per Article: 17.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2017] [Accepted: 01/23/2018] [Indexed: 11/08/2022]
Abstract
Items held in working memory can be either attended or not, depending on their current behavioral relevance. It has been suggested that unattended contents might be solely retained in an activity-silent form. Instead, we demonstrate here that encoding unattended contents involves a division of labor. While visual cortex only maintains attended items, intraparietal areas and the frontal eye fields represent both attended and unattended items.
Collapse
|