1
|
Chen KW, Bae GY. Working memory flips the direction of serial bias through memory-based decision. Cognition 2024; 250:105843. [PMID: 38850840 DOI: 10.1016/j.cognition.2024.105843] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2023] [Revised: 03/29/2024] [Accepted: 05/30/2024] [Indexed: 06/10/2024]
Abstract
Reported perception of a new stimulus is either attracted toward or repelled away from task-irrelevant prior stimuli. While prevailing theories propose that the opposing serial biases may stem from distinct stages of information processing, the exact role of working memory (WM) in the serial bias remains unclear despite its consistent involvement in nearly all pertinent studies. Additionally, it is not well understood whether this bias is primarily driven by the biased representation itself or by the decision-making process for the new stimulus. In the present study, we used an orientation delayed estimation paradigm with an attention-demanding intervening task, designed to disrupt the maintenance of stimulus information to investigate the role of WM in serial bias. In the analysis, we scrutinized the trajectory of mouse reports and response time to investigate how the response unfolds over time. Our findings indicate that the serial bias went from repulsive to attractive when WM maintenance was interrupted by the intervening task, and that the associated response trajectories and response time exhibited patterns that cannot be explained by the biased representation alone. These results demonstrate that the task-irrelevant prior stimulus influences the decision for the new stimulus, with the direction of the bias being determined by attentional demand during WM maintenance, thereby placing significant constraints on existing theories on the serial bias effect.
Collapse
Affiliation(s)
- Kuo-Wei Chen
- Department of Psychology, Arizona State University, USA
| | - Gi-Yeul Bae
- Department of Psychology, Arizona State University, USA.
| |
Collapse
|
2
|
Kumle L, Võ MLH, Nobre AC, Draschkow D. Multifaceted consequences of visual distraction during natural behaviour. COMMUNICATIONS PSYCHOLOGY 2024; 2:49. [PMID: 38812582 PMCID: PMC11129948 DOI: 10.1038/s44271-024-00099-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/09/2023] [Accepted: 05/15/2024] [Indexed: 05/31/2024]
Abstract
Visual distraction is a ubiquitous aspect of everyday life. Studying the consequences of distraction during temporally extended tasks, however, is not tractable with traditional methods. Here we developed a virtual reality approach that segments complex behaviour into cognitive subcomponents, including encoding, visual search, working memory usage, and decision-making. Participants copied a model display by selecting objects from a resource pool and placing them into a workspace. By manipulating the distractibility of objects in the resource pool, we discovered interfering effects of distraction across the different cognitive subcomponents. We successfully traced the consequences of distraction all the way from overall task performance to the decision-making processes that gate memory usage. Distraction slowed down behaviour and increased costly body movements. Critically, distraction increased encoding demands, slowed visual search, and decreased reliance on working memory. Our findings illustrate that the effects of visual distraction during natural behaviour can be rather focal but nevertheless have cascading consequences.
Collapse
Affiliation(s)
- Levi Kumle
- Department of Experimental Psychology, University of Oxford, Oxford, UK
- Wellcome Centre for Integrative Neuroimaging, University of Oxford, Oxford, UK
| | - Melissa L.-H. Võ
- Department of Psychology, Goethe University Frankfurt, Frankfurt, Germany
| | - Anna C. Nobre
- Department of Experimental Psychology, University of Oxford, Oxford, UK
- Wellcome Centre for Integrative Neuroimaging, University of Oxford, Oxford, UK
- Wu Tsai Institute and Department of Psychology, Yale University, New Haven, CT USA
| | - Dejan Draschkow
- Department of Experimental Psychology, University of Oxford, Oxford, UK
- Wellcome Centre for Integrative Neuroimaging, University of Oxford, Oxford, UK
| |
Collapse
|
3
|
Weber S, Christophel T, Görgen K, Soch J, Haynes J. Working memory signals in early visual cortex are present in weak and strong imagers. Hum Brain Mapp 2024; 45:e26590. [PMID: 38401134 PMCID: PMC10893972 DOI: 10.1002/hbm.26590] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Revised: 12/06/2023] [Accepted: 12/29/2023] [Indexed: 02/26/2024] Open
Abstract
It has been suggested that visual images are memorized across brief periods of time by vividly imagining them as if they were still there. In line with this, the contents of both working memory and visual imagery are known to be encoded already in early visual cortex. If these signals in early visual areas were indeed to reflect a combined imagery and memory code, one would predict them to be weaker for individuals with reduced visual imagery vividness. Here, we systematically investigated this question in two groups of participants. Strong and weak imagers were asked to remember images across brief delay periods. We were able to reliably reconstruct the memorized stimuli from early visual cortex during the delay. Importantly, in contrast to the prediction, the quality of reconstruction was equally accurate for both strong and weak imagers. The decodable information also closely reflected behavioral precision in both groups, suggesting it could contribute to behavioral performance, even in the extreme case of completely aphantasic individuals. Our data thus suggest that working memory signals in early visual cortex can be present even in the (near) absence of phenomenal imagery.
Collapse
Affiliation(s)
- Simon Weber
- Bernstein Center for Computational Neuroscience Berlin and Berlin Center for Advanced NeuroimagingCharité ‐ Universitätsmedizin Berlin, corporate member of the Freie Universität Berlin and Humboldt‐Universität zu BerlinBerlinGermany
- Research Training Group “Extrospection” and Berlin School of Mind and Brain, Humboldt‐Universität zu BerlinBerlinGermany
- Research Cluster of Excellence “Science of Intelligence”Technische Universität BerlinBerlinGermany
| | - Thomas Christophel
- Bernstein Center for Computational Neuroscience Berlin and Berlin Center for Advanced NeuroimagingCharité ‐ Universitätsmedizin Berlin, corporate member of the Freie Universität Berlin and Humboldt‐Universität zu BerlinBerlinGermany
- Department of PsychologyHumboldt‐Universität zu BerlinBerlinGermany
| | - Kai Görgen
- Bernstein Center for Computational Neuroscience Berlin and Berlin Center for Advanced NeuroimagingCharité ‐ Universitätsmedizin Berlin, corporate member of the Freie Universität Berlin and Humboldt‐Universität zu BerlinBerlinGermany
- Research Cluster of Excellence “Science of Intelligence”Technische Universität BerlinBerlinGermany
| | - Joram Soch
- Bernstein Center for Computational Neuroscience Berlin and Berlin Center for Advanced NeuroimagingCharité ‐ Universitätsmedizin Berlin, corporate member of the Freie Universität Berlin and Humboldt‐Universität zu BerlinBerlinGermany
- Institute of Psychology, Otto von Guericke University MagdeburgMagdeburgGermany
| | - John‐Dylan Haynes
- Bernstein Center for Computational Neuroscience Berlin and Berlin Center for Advanced NeuroimagingCharité ‐ Universitätsmedizin Berlin, corporate member of the Freie Universität Berlin and Humboldt‐Universität zu BerlinBerlinGermany
- Research Training Group “Extrospection” and Berlin School of Mind and Brain, Humboldt‐Universität zu BerlinBerlinGermany
- Research Cluster of Excellence “Science of Intelligence”Technische Universität BerlinBerlinGermany
- Department of PsychologyHumboldt‐Universität zu BerlinBerlinGermany
- Collaborative Research Center “Volition and Cognitive Control”Technische Universität DresdenDresdenGermany
| |
Collapse
|
4
|
Linde-Domingo J, Spitzer B. Geometry of visuospatial working memory information in miniature gaze patterns. Nat Hum Behav 2024; 8:336-348. [PMID: 38110511 PMCID: PMC10896725 DOI: 10.1038/s41562-023-01737-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2023] [Accepted: 09/25/2023] [Indexed: 12/20/2023]
Abstract
Stimulus-dependent eye movements have been recognized as a potential confound in decoding visual working memory information from neural signals. Here we combined eye-tracking with representational geometry analyses to uncover the information in miniature gaze patterns while participants (n = 41) were cued to maintain visual object orientations. Although participants were discouraged from breaking fixation by means of real-time feedback, small gaze shifts (<1°) robustly encoded the to-be-maintained stimulus orientation, with evidence for encoding two sequentially presented orientations at the same time. The orientation encoding on stimulus presentation was object-specific, but it changed to a more object-independent format during cued maintenance, particularly when attention had been temporarily withdrawn from the memorandum. Finally, categorical reporting biases increased after unattended storage, with indications of biased gaze geometries already emerging during the maintenance periods before behavioural reporting. These findings disclose a wealth of information in gaze patterns during visuospatial working memory and indicate systematic changes in representational format when memory contents have been unattended.
Collapse
Affiliation(s)
- Juan Linde-Domingo
- Research Group Adaptive Memory and Decision Making, Max Planck Institute for Human Development, Berlin, Germany.
- Center for Adaptive Rationality, Max Planck Institute for Human Development, Berlin, Germany.
- Mind, Brain and Behavior Research Center, University of Granada, Granada, Spain.
- Department of Experimental Psychology, University of Granada, Granada, Spain.
| | - Bernhard Spitzer
- Research Group Adaptive Memory and Decision Making, Max Planck Institute for Human Development, Berlin, Germany.
- Center for Adaptive Rationality, Max Planck Institute for Human Development, Berlin, Germany.
| |
Collapse
|
5
|
Hu H, Zhang M, Wu B, Wu X. Effects of different types of interference on nurses' working memory: An ERP study. J Adv Nurs 2023; 79:4326-4338. [PMID: 37431098 DOI: 10.1111/jan.15784] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2023] [Revised: 06/08/2023] [Accepted: 06/24/2023] [Indexed: 07/12/2023]
Abstract
AIM To explore the effects of different types of interference on nurses' working memory, and the role of attention control. DESIGN A repeated measures design. METHODS A single-factor, four-level within-subjects design was adopted. Thirty-one nurses completed a delay-recognition task with four blocks in September 2020: Interrupting Stimulus (stimuli requiring attention), Distracting Stimulus (stimuli to-be-ignored), No Interference and Passively View. Behavioural responses of the participants and EEG data were recorded. MATLAB 21b and EEGLAB 21b were used for electroencephalogram data preprocessing and data extraction. RESULTS Firstly, when nursing information system was used as task material, the accuracy rate and false alarm rate of primary tasks under interruption condition was statistically significantly different with that of distraction and no interference condition. There is a statistically significant difference in electroencephalogram measurement between correct and wrong response under interruption. Secondly, the role of attention control was different under interruption and distraction. There was a statistically significant positive correlation between the average amplitude distraction attention control index and task accuracy, and statistically significant negative correlation between the latency interruption attention control index and the accuracy of working memory task. CONCLUSIONS There were different effects of interruptions and distractions on nurses' working memory and the role of attention control were also different. Measures can be designed according to these results to reduce the negative impact of interference on nurses, so as to improve work efficiency and reduce patient risk. IMPACT This study has implications for clinical nursing during human-computer interaction. Resumption of the speed of the target information after an interruption affected task performance. Therefore, interventions should be designed to reduce the time needed for nurses to extract task information after an interruption, such as providing key clues in the information system interface. PATIENT OR PUBLIC CONTRIBUTION Registered nurses participated in the study as subjects.
Collapse
Affiliation(s)
- Huiling Hu
- School of Nursing, Peking University, Beijing, P.R. China
| | - Mingming Zhang
- School of Nursing, Peking University, Beijing, P.R. China
| | - Bilin Wu
- School of Nursing, Peking University, Beijing, P.R. China
| | - Xue Wu
- School of Nursing, Peking University, Beijing, P.R. China
| |
Collapse
|
6
|
Deutsch P, Czoschke S, Fischer C, Kaiser J, Bledowski C. Decoding of Working Memory Contents in Auditory Cortex Is Not Distractor-Resistant. J Neurosci 2023; 43:3284-3293. [PMID: 36944488 PMCID: PMC10162453 DOI: 10.1523/jneurosci.1890-22.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2022] [Revised: 02/16/2023] [Accepted: 03/08/2023] [Indexed: 03/23/2023] Open
Abstract
Working memory enables the temporary storage of relevant information in the service of behavior. Neuroimaging studies have suggested that sensory cortex is involved in maintaining contents in working memory. This raised the question of how sensory regions maintain memory representations during the exposure to distracting stimuli. Multivariate pattern analysis of fMRI signals in visual cortex has shown that the contents of visual working memory could be decoded concurrently with passively viewed distractors. The present fMRI study tested whether this finding extends to auditory working memory and to active distractor processing. We asked participants to memorize the pitch of a target sound and to compare it with a probe sound presented after a 13 s delay period. In separate conditions, we compared a blank delay phase (no distraction) with either passive listening to, or active processing of, an auditory distractor presented throughout the memory delay. Consistent with previous reports, pitch-specific memory information could be decoded in auditory cortex during the delay in trials without distraction. In contrast, decoding of target sounds in early auditory cortex dropped to chance level during both passive and active distraction. This was paralleled by memory performance decrements under distraction. Extending the analyses beyond sensory cortex yielded some evidence for memory content-specific activity in inferior frontal and superior parietal cortex during active distraction. In summary, while our findings question the involvement of early auditory cortex in the maintenance of distractor-resistant working memory contents, further research should elucidate the role of hierarchically higher regions.SIGNIFICANCE STATEMENT Information about sensory features held in working memory can be read out from hemodynamic activity recorded in human sensory cortices. Moreover, visual cortex can in parallel store visual content and process newly incoming, task-irrelevant visual input. The present study investigated the role of auditory cortex for working memory maintenance under distraction. While memorized sound frequencies could be decoded in auditory cortex in the absence of distraction, auditory distraction during the delay phase impaired memory performance and prevented decoding of information stored in working memory. Apparently, early auditory cortex is not sufficient to represent working memory contents under distraction that impairs performance. However, exploratory analyses indicated that, under distraction, higher-order frontal and parietal regions might contribute to content-specific working memory storage.
Collapse
Affiliation(s)
- Philipp Deutsch
- Institute of Medical Psychology, Medical Faculty, Goethe University, Frankfurt am Main 60528, Germany
- Brain Imaging Center, Medical Faculty, Goethe University, Frankfurt am Main, 60528, Germany
| | - Stefan Czoschke
- Institute of Medical Psychology, Medical Faculty, Goethe University, Frankfurt am Main 60528, Germany
- Brain Imaging Center, Medical Faculty, Goethe University, Frankfurt am Main, 60528, Germany
| | - Cora Fischer
- Institute of Medical Psychology, Medical Faculty, Goethe University, Frankfurt am Main 60528, Germany
- Brain Imaging Center, Medical Faculty, Goethe University, Frankfurt am Main, 60528, Germany
| | - Jochen Kaiser
- Institute of Medical Psychology, Medical Faculty, Goethe University, Frankfurt am Main 60528, Germany
- Brain Imaging Center, Medical Faculty, Goethe University, Frankfurt am Main, 60528, Germany
| | - Christoph Bledowski
- Institute of Medical Psychology, Medical Faculty, Goethe University, Frankfurt am Main 60528, Germany
- Brain Imaging Center, Medical Faculty, Goethe University, Frankfurt am Main, 60528, Germany
| |
Collapse
|
7
|
Zhou C, Lorist MM, Mathôt S. Is Categorization in Visual Working Memory a Way to Reduce Mental Effort? A Pupillometry Study. Cogn Sci 2022; 46:e13194. [PMID: 36070854 PMCID: PMC9539610 DOI: 10.1111/cogs.13194] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2022] [Revised: 08/03/2022] [Accepted: 08/05/2022] [Indexed: 11/30/2022]
Abstract
Recent studies on visual working memory (VWM) have shown that visual information can be stored in VWM as continuous (e.g., a specific shade of red) as well as categorical representations (e.g., the general category red). It has been widely assumed, yet never directly tested, that continuous representations require more VWM mental effort than categorical representations; given limited VWM capacity, this would mean that fewer continuous, as compared to categorical, representations can be maintained simultaneously. We tested this assumption by measuring pupil size, as a proxy for mental effort, in a delayed estimation task. Participants memorized one to four ambiguous (boundaries between adjacent color categories) or prototypical colors to encourage continuous or categorical representations, respectively; after a delay, a probe indicated the location of the to‐be‐reported color. We found that, for memory load 1, pupil size was larger while maintaining ambiguous as compared to prototypical colors, but without any difference in memory precision; this suggests that participants relied on an effortful continuous representation to maintain a single ambiguous color, thus resulting in pupil dilation while preserving precision. Strikingly, this effect gradually inverted, such that for memory load 4, pupil size was smaller while maintaining ambiguous and prototypical colors, but memory precision was now substantially reduced for ambiguous colors; this suggests that with increased memory load participants increasingly relied on categorical representations for ambiguous colors (which are by definition a poor fit to any category). Taken together, our results suggest that continuous representations are more effortful than categorical representations and that very few continuous representations (perhaps only one) can be maintained simultaneously.
Collapse
Affiliation(s)
- Cherie Zhou
- Department of Experimental Psychology, University of Groningen
| | - Monicque M Lorist
- Department of Experimental Psychology, University of Groningen.,Faculty of Medical Sciences, Biomedical Sciences of Cells & Systems, Neurosciences, Neuroimaging Center, University of Groningen
| | | |
Collapse
|
8
|
Revisiting congruency effects in the working memory Stroop task. Atten Percept Psychophys 2022; 84:1635-1650. [PMID: 35501589 DOI: 10.3758/s13414-022-02494-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/15/2022] [Indexed: 11/08/2022]
Abstract
The working memory Stroop task is to name the color of a rectangular patch with keypress while holding a color word in working memory. Previous studies using this variant of the Stroop task have shown that congruency between the color patch and the color word significantly affects both color naming and working memory, with the worsening of task performance when the color patch is semantically incongruent rather than congruent with the color word. However, it remains unclear with regard to cognitive mechanisms underlying such congruency effects in the working memory Stroop task. By including a control condition among the congruent and incongruent conditions in a working memory Stroop task, the present study showed that nearly all of the working memory Stroop effect can be facilitation, and that interference, if present, is markedly smaller than facilitation in this form of the Stroop effect. There was also a critical contrast between the working memory and classic Stroop effects in terms of facilitation and interference, with larger facilitation and smaller interference in the working memory Stroop effect than in the classic Stroop effect. Moreover, working memory for a color word can be either facilitated or interfered with by the perceptual judgment (color naming) of an interposed color patch during the retention interval, depending on whether the color patch is semantically congruent or incongruent with the color word. Together, these results suggest that both facilitation and interference mechanisms can contribute to the overall congruency effects in the working memory Stroop task.
Collapse
|
9
|
Categorical bias as a crucial parameter in visual working memory: the effect of memory load and retention interval. Cortex 2022; 154:311-321. [DOI: 10.1016/j.cortex.2022.05.007] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2022] [Revised: 04/21/2022] [Accepted: 05/09/2022] [Indexed: 11/24/2022]
|
10
|
Wang B, Knapen T, Olivers CNL. Visual Working Memory Adapts to the Nature of Anticipated Interference. J Cogn Neurosci 2022; 34:1148-1163. [PMID: 35468211 DOI: 10.1162/jocn_a_01853] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Visual working memory has been proven to be relatively robust against interference. However, little is known on whether such robust coding is obligatory, or can be flexibly recruited depending on its expected usefulness. To address this, participants remembered both the color and orientation of a grating. During the maintenance, we inserted a secondary color/orientation memory task, interfering with the primary task. Crucially, we varied the expectations of the type of interference by varying the probability of the two types of intervening task. Behavioral data indicate that to-be-remembered features for which interference is expected are bolstered, whereas to-be-remembered features for which no interference is expected are left vulnerable. This was further supported by fMRI data obtained from visual cortex. In conclusion, the flexibility of visual working memory allows it to strengthen memories for which it anticipates the highest risk of interference.
Collapse
Affiliation(s)
- Benchi Wang
- South China Normal University, China.,Cognition and Education Sciences (South China Normal University), China.,Vrije Universiteit Amsterdam, The Netherlands
| | | | | |
Collapse
|
11
|
Kreither J, Papaioannou O, Luck SJ. Active Working Memory and Simple Cognitive Operations. J Cogn Neurosci 2021; 34:313-331. [PMID: 34964891 DOI: 10.1162/jocn_a_01791] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Working memory is thought to serve as a buffer for ongoing cognitive operations, even in tasks that have no obvious memory requirements. This conceptualization has been supported by dual-task experiments, in which interference is observed between a primary task involving short-term memory storage and a secondary task that presumably requires the same buffer as the primary task. Little or no interference is typically observed when the secondary task is very simple. Here, we test the hypothesis that even very simple tasks require the working memory buffer, but interference can be minimized by using activity-silent representations to store the information from the primary task. We tested this hypothesis using dual-task paradigm in which a simple discrimination task was interposed in the retention interval of a change detection task. We used contralateral delay activity (CDA) to track the active maintenance of information for the change detection task. We found that the CDA was massively disrupted after the interposed task. Despite this disruption of active maintenance, we found that performance in the change detection task was only slightly impaired, suggesting that activity-silent representations were used to retain the information for the change detection task. A second experiment replicated this result and also showed that automated discriminations could be performed without producing a large CDA disruption. Together, these results suggest that simple but non-automated discrimination tasks require the same processes that underlie active maintenance of information in working memory.
Collapse
|
12
|
Gresch D, Boettcher SEP, van Ede F, Nobre AC. Shielding working-memory representations from temporally predictable external interference. Cognition 2021; 217:104915. [PMID: 34600356 PMCID: PMC8543071 DOI: 10.1016/j.cognition.2021.104915] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2021] [Revised: 09/01/2021] [Accepted: 09/21/2021] [Indexed: 12/15/2022]
Abstract
Protecting working-memory content from distracting external sensory inputs and intervening tasks is an ubiquitous demand in daily life. Here, we ask whether and how temporal expectations about external events can help mitigate effects of such interference during working-memory retention. We manipulated the temporal predictability of interfering items that occurred during the retention period of a visual working-memory task and report that temporal expectations reduce the detrimental influence of external interference on subsequent memory performance. Moreover, to determine if the protective effects of temporal expectations rely on distractor suppression or involve shielding of internal representations, we compared effects after irrelevant distractors that could be ignored vs. interrupters that required a response. Whereas distractor suppression may be sufficient to confer protection from predictable distractors, any benefits after interruption are likely to involve memory shielding. We found similar benefits of temporal expectations after both types of interference. We conclude that temporal expectations may play an important role in safeguarding behaviour based on working memory - acting through mechanisms that include the shielding of internal content from external interference.
Collapse
Affiliation(s)
- Daniela Gresch
- Department of Experimental Psychology, University of Oxford, Oxford, UK; Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford, UK.
| | - Sage E P Boettcher
- Department of Experimental Psychology, University of Oxford, Oxford, UK; Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford, UK
| | - Freek van Ede
- Institute for Brain and Behavior Amsterdam, Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, The Netherlands
| | - Anna C Nobre
- Department of Experimental Psychology, University of Oxford, Oxford, UK; Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford, UK
| |
Collapse
|
13
|
Zickerick B, Rösner M, Sabo M, Schneider D. How to refocus attention on working memory representations following interruptions-Evidence from frontal theta and posterior alpha oscillations. Eur J Neurosci 2021; 54:7820-7838. [PMID: 34687107 DOI: 10.1111/ejn.15506] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2021] [Revised: 10/08/2021] [Accepted: 10/19/2021] [Indexed: 11/27/2022]
Abstract
Interruptions lead to a deterioration of primary task performance. Applied research usually describes a delay in primary task resumption as an essential component of this performance deficit. Here, we investigate this approach using electrophysiological correlates of the focusing of attention within working memory, a process that is fundamental to switching between different tasks. A lateralized working memory task was frequently interrupted by either a high- or low-demanding arithmetic task and a subsequent retrospective cue indicated the working memory item required for later report. The detrimental effect of interruptions on primary task performance was most pronounced for high-demanding interruptions. After retro-cue presentation, fronto-central theta power (4-7 Hz) was lowest following high-demanding interruptions and posterior alpha power (8-14 Hz) was less suppressed in the two interruption conditions. These effects might be related to a deficit in attentional control processes following the retrospective cue. Furthermore, we introduce the suppression of posterior alpha power contralateral to the remembered primary task stimuli during the interruption phase as a temporal marker for primary task resumption. Especially for cognitively demanding interruption tasks, this effect seems to overlap in time with the processing of the interruption, which should contribute to the primary task performance deficit.
Collapse
Affiliation(s)
- Bianca Zickerick
- Ergonomics Department, Leibniz Research Centre for Working Environment and Human Factors, Dortmund, Germany
| | - Marlene Rösner
- Ergonomics Department, Leibniz Research Centre for Working Environment and Human Factors, Dortmund, Germany
| | - Melinda Sabo
- Ergonomics Department, Leibniz Research Centre for Working Environment and Human Factors, Dortmund, Germany
| | - Daniel Schneider
- Ergonomics Department, Leibniz Research Centre for Working Environment and Human Factors, Dortmund, Germany
| |
Collapse
|
14
|
Breaking the cardinal rule: The impact of interitem interaction and attentional priority on the cardinal biases in orientation working memory. Atten Percept Psychophys 2021; 84:2186-2194. [PMID: 34658001 DOI: 10.3758/s13414-021-02374-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/30/2021] [Indexed: 11/08/2022]
Abstract
Although it is not typically assumed in influential models of visual working memory (WM), representations in WM are systematically biased by multiple factors. Orientation representations are biased away from the cardinal axis (i.e., cardinal bias) and they are biased away from or toward the other orientation simultaneously held in WM (i.e., interitem interaction). The present study investigated the extent to which these two bias mechanisms interact in WM. In Experiment 1, participants remembered two sequentially presented orientations and reproduced both orientations after a short delay. Cardinal biases were assessed separately for the trials where the two mechanisms produce biases in the same direction (i.e., congruent trials) and the trials where they produce biases in the opposite direction (i.e., incongruent trials). Whereas congruent trials exhibited a typical cardinal bias, incongruent trials exhibited no cardinal bias, demonstrating that the cardinal bias was canceled out by the interitem interaction. Follow-up experiments extended these results by manipulating attentional priority for the two orientations by means of precue (Experiment 2) and postcue (Experiment 3). In both experiments, attentionally prioritized items exhibited a typical cardinal bias irrespective of the congruency whereas attentionally unprioritized items exhibited a reversal of the cardinal bias in the incongruent trials, demonstrating that selective attention modulates the influence of the interitem interaction. Together, these results suggest that WM leverages information about specific stimuli and their relationship to support a given behavioral goal.
Collapse
|
15
|
Lively Z, Robinson MM, Benjamin AS. Memory Fidelity Reveals Qualitative Changes in Interactions Between Items in Visual Working Memory. Psychol Sci 2021; 32:1426-1441. [PMID: 34406899 DOI: 10.1177/0956797621997367] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
Memory for objects in a display sometimes reveals attraction-the objects are remembered as more similar to one another than they actually were-and sometimes reveals repulsion-the objects are remembered as more different from one another. The conditions that lead to these opposing memory biases are poorly understood; there is no theoretical framework that explains these contrasting dynamics. In three experiments (each N = 30 adults), we demonstrate that memory fidelity provides a unifying dimension that accommodates the existence of both types of visual working memory interactions. We show that either attraction or repulsion can arise simply as a function of manipulations of memory fidelity. We also demonstrate that subjective ratings of fidelity predict the presence of attraction or repulsion on a trial-by-trial basis. We discuss how these results bear on computational models of visual working memory and contextualize these results within the literature of attraction and repulsion effects in long-term memory and perception.
Collapse
Affiliation(s)
- Zachary Lively
- Department of Psychology, University of Illinois at Urbana-Champaign
| | | | - Aaron S Benjamin
- Department of Psychology, University of Illinois at Urbana-Champaign
| |
Collapse
|
16
|
Bae GY. Neural evidence for categorical biases in location and orientation representations in a working memory task. Neuroimage 2021; 240:118366. [PMID: 34242785 DOI: 10.1016/j.neuroimage.2021.118366] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2021] [Revised: 06/29/2021] [Accepted: 07/03/2021] [Indexed: 11/25/2022] Open
Abstract
Previous research demonstrated that visual representations in working memory exhibit biases with respect to the categorical structure of the stimulus space. However, a majority of those studies used behavioral measures of working memory, and it is not clear whether the working memory representations per se are influenced by the categorical structure or whether the biases arise in decision or response processes during the report. Here, I applied a multivariate decoding technique to EEG data collected during working memory tasks to determine whether neural activity associated with the representations in working memory is categorically biased prior to the report. I found that the decoding of spatial working memory was biased away from the nearest cardinal location, consistent with the biases observed in the behavioral responses. In a follow-up experiment which was designed to prevent the use of a response preparation strategy, I found that the decoding still exhibited categorical biases. Together, these results provide neural evidence that working memory representations themselves are categorically biased, imposing important constraints on the models of working memory representations.
Collapse
Affiliation(s)
- Gi-Yeul Bae
- Department of Psychology, Arizona State University, 950 S. McAllister Ave., Tempe, AZ 85287, United States.
| |
Collapse
|
17
|
A Hierarchy of Functional States in Working Memory. J Neurosci 2021; 41:4461-4475. [PMID: 33888611 PMCID: PMC8152603 DOI: 10.1523/jneurosci.3104-20.2021] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2020] [Revised: 02/22/2021] [Accepted: 02/23/2021] [Indexed: 11/21/2022] Open
Abstract
Extensive research has examined how information is maintained in working memory (WM), but it remains unknown how WM is used to guide behavior. We addressed this question by combining human electrophysiology (50 subjects, male and female) with pattern analyses, cognitive modeling, and a task requiring the prolonged maintenance of two WM items and priority shifts between them. This enabled us to discern neural states coding for memories that were selected to guide the next decision from states coding for concurrently held memories that were maintained for later use, and to examine how these states contribute to WM-based decisions. Selected memories were encoded in a functionally active state. This state was reflected in spontaneous brain activity during the delay period, closely tracked moment-to-moment fluctuations in the quality of evidence integration, and also predicted when memories would interfere with each other. In contrast, concurrently held memories were encoded in a functionally latent state. This state was reflected only in stimulus-evoked brain activity, tracked memory precision at longer timescales, but did not engage with ongoing decision dynamics. Intriguingly, the two functional states were highly flexible, as priority could be dynamically shifted back and forth between memories without degrading their precision. These results delineate a hierarchy of functional states, whereby latent memories supporting general maintenance are transformed into active decision circuits to guide flexible behavior.SIGNIFICANCE STATEMENT Working memory enables maintenance of information that is no longer available in the environment. Abundant neuroscientific work has examined where in the brain working memories are stored, but it remains unknown how they are represented and used to guide behavior. Our study shows that working memories are represented in qualitatively different formats, depending on behavioral priorities. Memories that are selected for guiding behavior are encoded in an active state that transforms sensory input into decision variables, whereas other concurrently held memories are encoded in a latent state that supports precise maintenance without affecting ongoing cognition. These results dissociate mechanisms supporting memory storage and usage, and open the door to reveal not only where memories are stored but also how.
Collapse
|
18
|
Lorenc ES, Sreenivasan KK. Reframing the debate: The distributed systems view of working memory. VISUAL COGNITION 2021. [DOI: 10.1080/13506285.2021.1899091] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Affiliation(s)
| | - Kartik K. Sreenivasan
- Division of Science and Mathematics, New York University Abu Dhabi, Abu Dhabi, United Arab Emirates
| |
Collapse
|
19
|
Lorenc ES, Mallett R, Lewis-Peacock JA. Distraction in Visual Working Memory: Resistance is Not Futile. Trends Cogn Sci 2021; 25:228-239. [PMID: 33397602 PMCID: PMC7878345 DOI: 10.1016/j.tics.2020.12.004] [Citation(s) in RCA: 49] [Impact Index Per Article: 16.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2020] [Revised: 11/30/2020] [Accepted: 12/04/2020] [Indexed: 01/19/2023]
Abstract
Over half a century of research focused on understanding how working memory is capacity constrained has overshadowed the fact that it is also remarkably resistant to interference. Protecting goal-relevant information from distraction is a cornerstone of cognitive function that involves a multifaceted collection of control processes and storage mechanisms. Here, we discuss recent advances in cognitive psychology and neuroscience that have produced new insights into the nature of visual working memory and its ability to resist distraction. We propose that distraction resistance should be an explicit component in any model of working memory and that understanding its behavioral and neural correlates is essential for building a comprehensive understanding of real-world memory function.
Collapse
Affiliation(s)
- Elizabeth S Lorenc
- Department of Psychology, University of Texas at Austin, Austin, TX 78712, USA.
| | - Remington Mallett
- Department of Psychology, University of Texas at Austin, Austin, TX 78712, USA
| | | |
Collapse
|
20
|
Abstract
Working memory is thought to be divided into distinct visual and verbal subsystems. Studies of visual working memory frequently use verbal working memory tasks as control conditions and/or use articulatory suppression to ensure that visual load is not transferred to verbal working memory. Using these verbal tasks relies on the assumption that the verbal working memory load will not interfere with the same processes as visual working memory. In the present study, participants maintained a visual or verbal working memory load as they simultaneously viewed scenes while their eye movements were recorded. Because eye movements and visual working memory are closely linked, we anticipated the visual load would interfere with scene-viewing (and vice versa), while the verbal load would not. Surprisingly, both visual and verbal memory loads interfered with scene-viewing behavior, while eye movements during scene-viewing did not significantly interfere with performance on either memory task. These results suggest that a verbal working memory load can interfere with eye movements in a visual task.
Collapse
|
21
|
Abstract
Working memory persists in the face of distraction, yet not without consequence. Previous research has shown that memory for low-level visual features is systematically influenced by the maintenance or presentation of a similar distractor stimulus. Responses are frequently biased in stimulus space towards a perceptual distractor, though this has yet to be determined for high-level stimuli. We investigated whether these influences are shared for complex visual stimuli such as faces. To quantify response accuracies for these stimuli, we used a delayed-estimation task with a computer-generated "face space" consisting of 80 faces that varied continuously as a function of age and sex. In a set of three experiments, we found that responses for a target face held in working memory were biased towards a distractor face presented during the maintenance period. The amount of response bias did not vary as a function of distance between target and distractor. Our data suggest that, similar to low-level visual features, high-level face representations in working memory are biased by the processing of related but task-irrelevant information.
Collapse
|
22
|
Abstract
A key challenge for the visual system entails the extraction of constant properties of objects from sensory information that varies moment by moment due to changes in viewing conditions. Although successful performance in constancy tasks requires cooperation between perception and working memory, the function of the memory system has been under-represented in recent material perception literature. Here, we addressed the limits of material constancy by elucidating if and how working memory is involved in constancy tasks by using a variety of material stimuli, such as metals, glass, and translucent objects. We conducted experiments with a simultaneous and a successive matching-to-sample paradigm in which participants matched the perceived material properties of objects with or without a temporal delay under varying illumination contexts. The current study combined a detailed analysis of matching errors, data on the strategy use obtained via a self-report questionnaire, and the statistical image analysis of diagnostic image cues used for material discrimination. We found a comparable material constancy between simultaneous and successive matching conditions, and it was suggested that, in both matching conditions, participants used similar information processing strategies for the discrimination of materials. The study provides converging evidence on the critical role of working memory in material constancy, where working memory serves as a shared processing bottleneck that constrains both simultaneous and successive material constancy.
Collapse
Affiliation(s)
- Hiroyuki Tsuda
- Keio Advanced Research Center, Keio University, Tokyo, Japan
| | - Munendo Fujimichi
- Graduate School of Human and Environmental Studies, Kyoto University, Kyoto, Japan
| | | | - Jun Saiki
- Graduate School of Human and Environmental Studies, Kyoto University, Kyoto, Japan
| |
Collapse
|
23
|
Zickerick B, Thönes S, Kobald SO, Wascher E, Schneider D, Küper K. Differential Effects of Interruptions and Distractions on Working Memory Processes in an ERP Study. Front Hum Neurosci 2020; 14:84. [PMID: 32231527 PMCID: PMC7088125 DOI: 10.3389/fnhum.2020.00084] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2019] [Accepted: 02/26/2020] [Indexed: 11/13/2022] Open
Abstract
Interruptions (interfering stimuli to respond to) and distractions (interfering stimuli to be ignored) have been shown to negatively impact performance, particularly in tasks requiring working memory (WM). This study investigated how these two types of external interference affect task performance and attentional and WM processes as indexed by specific event-related potentials (ERPs) of the EEG. A Continuous Number Task (CNT) was applied, in which participants had to either decide whether the current number (condition without WM load) or the sum of the current and the preceding number (condition with WM load) was odd or even while responding to interlaced single letters (interruptions) or ignoring them (distractions). Contrary to previous research, we did not find external interference to affect performance under WM load. Unexpectedly, our results rather show that performance was significantly improved in trials after distractions compared to before. This effect was reflected particularly in a significantly increased P3 mean amplitude indicating enhanced attentional reallocation to task-relevant stimuli. Interestingly, this P3 effect appeared independent of WM load and also following interruptions. This underpins the account of P3 amplitudes being modulated by the interval between two task-relevant stimuli rather than by overall task-difficulty. Moreover, a pronounced fronto-central and posterior slow wave following interference suggest more control resources to maintain task-relevant stimuli in WM independent of the preceding interfering stimulus. Our results thus suggest that the type and foreknowledge of external interference may modulate the amount of interference and may also facilitate resource preparation under WM load.
Collapse
Affiliation(s)
- Bianca Zickerick
- Leibniz Research Centre for Working Environment and Human Factors, TU Dortmund, Dortmund, Germany
| | - Sven Thönes
- Experimental Psychology, Department of Psychology, Johannes Gutenberg University Mainz, Mainz, Germany
| | - S Oliver Kobald
- Leibniz Research Centre for Working Environment and Human Factors, TU Dortmund, Dortmund, Germany
| | - Edmund Wascher
- Leibniz Research Centre for Working Environment and Human Factors, TU Dortmund, Dortmund, Germany
| | - Daniel Schneider
- Leibniz Research Centre for Working Environment and Human Factors, TU Dortmund, Dortmund, Germany
| | - Kristina Küper
- Bundeswehr Institute for Preventive Medicine, Koblenz, Germany
| |
Collapse
|
24
|
Working memory prioritization impacts neural recovery from distraction. Cortex 2019; 121:225-238. [PMID: 31629945 DOI: 10.1016/j.cortex.2019.08.019] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2019] [Revised: 06/22/2019] [Accepted: 08/30/2019] [Indexed: 01/25/2023]
Abstract
The ability to protect goal-relevant information from disruption over short intervals is a hallmark of working memory. Recent behavioral data suggest that high-priority items in working memory are more vulnerable to disruption. We used functional magnetic resonance imaging to evaluate the hypothesis that prioritization of working memories might impact the recovery of their neural representation(s) after distraction. A delay-period retrospective cue informed participants which of two memory items (a face or a scene) to prioritize during a first delay period. Consistent with prior work, and confirming successful prioritization, multivoxel pattern classifier evidence in perceptual brain regions was higher for cued versus uncued memory items. A distraction task was then imposed before a second retrospective cue informed participants to either "stay" remembering the previously cued item or "switch" to the previously uncued item. This allowed for the evaluation of recovery for high-priority items (on stay trials) and also low-priority items (on switch trials). Classifiers showed successful reinstatement of both high- and low-priority items after distraction, but only low-priority items recovered to their pre-distraction representational levels. Moreover, the degree of prioritization before distraction predicted the amount of disruption for high-priority items after distraction, suggesting that the more a participant prioritized the cued item, the greater the impact of distraction. Our data provide neural evidence that prioritizing working memory information in perceptual regions makes that information more vulnerable to disruption.
Collapse
|
25
|
Peters B, Rahm B, Kaiser J, Bledowski C. Differential trajectories of memory quality and guessing across sequential reports from working memory. J Vis 2019; 19:3. [PMID: 31287857 DOI: 10.1167/19.7.3] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Working memory enables the storage of few items for a short period of time. Previous research has shown that items in working memory cannot be accessed equally well, indicating that they are held in at least two different states with different capacity limitations. However, it is unclear whether differences between states are due to limitations of the number of items that can be stored, or the quality with which items are stored. We employed a sequential whole-report procedure where participants reported the remembered orientation of each of two or four encoded Gabor patches. In addition, they rated their memory confidence prior to each report. Participants performed 600 trials per condition, allowing us to obtain reliable subjective ratings and estimates of precision, guessing, and misreport using a mixture model, separately for each sequential report. Different measures of memory quality consistently showed discontinuous trajectories across reports with a steep drop from the first to the second remembered item but only slight decreases thereafter. In contrast, both reported and modeled guessing changed continuously across reports. Our results support the notion of two states in working memory and show that they are distinguished by memory quality rather than quantity.
Collapse
Affiliation(s)
- Benjamin Peters
- Institute of Medical Psychology, Goethe University, Frankfurt am Main, Germany.,Zuckerman Institute, Columbia University, New York, USA
| | - Benjamin Rahm
- Medical Psychology and Medical Sociology, Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Jochen Kaiser
- Institute of Medical Psychology, Goethe University, Frankfurt am Main, Germany
| | - Christoph Bledowski
- Institute of Medical Psychology, Goethe University, Frankfurt am Main, Germany
| |
Collapse
|