1
|
De Brigard F. Episodic memory without autonoetic consciousness. Philos Trans R Soc Lond B Biol Sci 2024; 379:20230410. [PMID: 39278243 DOI: 10.1098/rstb.2023.0410] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2024] [Revised: 07/08/2024] [Accepted: 07/19/2024] [Indexed: 09/18/2024] Open
Abstract
Ever since Tulving's influential 1985 article 'Memory and consciousness', it has become traditional to think of autonoetic consciousness as necessary for episodic memory. This paper questions this claim. Specifically, it argues that the construct of autonoetic consciousness lacks validity and that, even if it was valid, it would still not be necessary for episodic memory. The paper ends with a proposal to go back to a functional/computational characterization of episodic memory in which its characteristic phenomenology is a contingent feature of the retrieval process and, as a result, open to empirical scrutiny. The proposal also dovetails with recent taxonomies of memory that are independent of conscious awareness and suggests strategies to evaluate within- and between-individual variability in the conscious experience of episodic memories in human and non-human agents. This article is part of the theme issue 'Elements of episodic memory: lessons from 40 years of research'.
Collapse
|
2
|
Smithson CJR, Chow JK, Chang TY, Gauthier I. Measuring object recognition ability: Reliability, validity, and the aggregate z-score approach. Behav Res Methods 2024; 56:6598-6612. [PMID: 38438656 DOI: 10.3758/s13428-024-02372-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/14/2024] [Indexed: 03/06/2024]
Abstract
Measurement of domain-general object recognition ability (o) requires minimization of domain-specific variance. One approach is to model o as a latent variable explaining performance on a battery of tests which differ in task demands and stimuli; however, time and sample requirements may be prohibitive. Alternatively, an aggregate measure of o can be obtained by averaging z-scores across tests. Using data from Sunday et al., Journal of Experimental Psychology: General, 151, 676-694, (2022), we demonstrated that aggregate scores from just two such object recognition tests provide a good approximation (r = .79) of factor scores calculated from a model using a much larger set of tests. Some test combinations produced correlations of up to r = .87 with factor scores. We then revised these tests to reduce testing time, and developed an odd one out task, using a unique object category on nearly every trial, to increase task and stimuli diversity. To validate our measures, 163 participants completed the object recognition tests on two occasions, one month apart. Providing the first evidence that o is stable over time, our short aggregate o measure demonstrated good test-retest reliability (r = .77). The stability of o could not be completely accounted for by intelligence, perceptual speed, and early visual ability. Structural equation modeling suggested that our tests load significantly onto the same latent variable, and revealed that as a latent variable, o is highly stable (r = .93). Aggregation is an efficient method for estimating o, allowing investigation of individual differences in object recognition ability to be more accessible in future studies.
Collapse
Affiliation(s)
| | - Jason K Chow
- Department of Psychology, Vanderbilt University, Nashville, TN, USA
| | - Ting-Yun Chang
- Department of Psychology, Vanderbilt University, Nashville, TN, USA
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Isabel Gauthier
- Department of Psychology, Vanderbilt University, Nashville, TN, USA
| |
Collapse
|
3
|
Blalock LD, Weichman K, VanWormer LA. Conceptual masking disrupts change-detection performance. Mem Cognit 2024:10.3758/s13421-024-01639-z. [PMID: 39313588 DOI: 10.3758/s13421-024-01639-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/30/2024] [Indexed: 09/25/2024]
Abstract
The present study investigated the effects of long-term knowledge on backward masking interference in visual working memory (VWM) by varying the similarity of mask stimuli along categorical dimensions. To-be-remembered items and masks were taken from categories controlled for perceptual distinctiveness and distinctiveness in kinds (e.g., there are many kinds of cars and few kinds of coffee mugs). Participants completed a change-detection task in which the memory array consisted of exemplars from either a similar or distinctive category, followed by a mask array of items from the same category (conceptually similar versus conceptually distinct categories), a different category, or no mask. The results over two experiments showed greater interference from conceptually similar masks as compared with the other conditions across stimulus onset asynchrony (SOA) conditions, suggesting masking with conceptually similar categories leads to more interference even when masks are shown well after the stimulus. These results have important implications for both the nature and time course of long-term conceptual knowledge influencing VWM, particularly when using complex real-world objects.
Collapse
Affiliation(s)
- Lisa Durrance Blalock
- Department of Psychology, University of West Florida, 11000 University Parkway, Pensacola, FL, 32514, USA.
| | - Kyle Weichman
- Department of Psychology, University of West Florida, 11000 University Parkway, Pensacola, FL, 32514, USA
| | - Lisa A VanWormer
- School of Psychology, Fielding Graduate University, Santa Barbara, CA, 93105, USA
| |
Collapse
|
4
|
Jiao L, Wang Y, Liu X, Li L, Liu F, Ma W, Guo Y, Chen P, Yang S, Hou B. Causal Inference Meets Deep Learning: A Comprehensive Survey. RESEARCH (WASHINGTON, D.C.) 2024; 7:0467. [PMID: 39257419 PMCID: PMC11384545 DOI: 10.34133/research.0467] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/07/2024] [Accepted: 08/11/2024] [Indexed: 09/12/2024]
Abstract
Deep learning relies on learning from extensive data to generate prediction results. This approach may inadvertently capture spurious correlations within the data, leading to models that lack interpretability and robustness. Researchers have developed more profound and stable causal inference methods based on cognitive neuroscience. By replacing the correlation model with a stable and interpretable causal model, it is possible to mitigate the misleading nature of spurious correlations and overcome the limitations of model calculations. In this survey, we provide a comprehensive and structured review of causal inference methods in deep learning. Brain-like inference ideas are discussed from a brain-inspired perspective, and the basic concepts of causal learning are introduced. The article describes the integration of causal inference with traditional deep learning algorithms and illustrates its application to large model tasks as well as specific modalities in deep learning. The current limitations of causal inference and future research directions are discussed. Moreover, the commonly used benchmark datasets and the corresponding download links are summarized.
Collapse
Affiliation(s)
- Licheng Jiao
- The School of Artificial Intelligence, Xidian University, Xi'an, China
| | - Yuhan Wang
- The School of Artificial Intelligence, Xidian University, Xi'an, China
| | - Xu Liu
- The School of Artificial Intelligence, Xidian University, Xi'an, China
| | - Lingling Li
- The School of Artificial Intelligence, Xidian University, Xi'an, China
| | - Fang Liu
- The School of Artificial Intelligence, Xidian University, Xi'an, China
| | - Wenping Ma
- The School of Artificial Intelligence, Xidian University, Xi'an, China
| | - Yuwei Guo
- The School of Artificial Intelligence, Xidian University, Xi'an, China
| | - Puhua Chen
- The School of Artificial Intelligence, Xidian University, Xi'an, China
| | - Shuyuan Yang
- The School of Artificial Intelligence, Xidian University, Xi'an, China
| | - Biao Hou
- The School of Artificial Intelligence, Xidian University, Xi'an, China
| |
Collapse
|
5
|
Hojjati F, Motahharynia A, Adibi A, Adibi I, Sanayei M. Correlative comparison of visual working memory paradigms and associated models. Sci Rep 2024; 14:20852. [PMID: 39242827 PMCID: PMC11379810 DOI: 10.1038/s41598-024-72035-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2024] [Accepted: 09/03/2024] [Indexed: 09/09/2024] Open
Abstract
When studying the working memory (WM), the 'slot model' and the 'resource model' are two main theories used to describe how information retention occurs. The slot model shows that WM capacity consists of a certain number of predefined slots available for information storage. This theory explains that there is a binary condition during information recall in which information is either wholly maintained within a slot or forgotten. The resource model has a resolution-based approach, suggesting a continuous resource able to be distributed among a number of items in WM capacity. Recently hybrid models have been introduced, suggesting that WM may not strictly conform to only one model. Accordingly, to understand the relationship between two of the most widely used paradigms in WM evaluation, we implemented a correlational assessment in two different psychophysics tasks, an analog recall paradigm with sequential bar presentation and a delayed match-to-sample (DMS) task with checkerboard stimuli. Our study revealed significant correlations between WM performance in the DMS task and recall error, precision, and sources of errors in the sequential paradigm. Overall, the findings emphasize the importance of considering both tasks in understanding WM processes, as they shed light on the debate between the slot and resource models by revealing overlapping elements in both theories and the tasks used to evaluate WM capacity.
Collapse
Affiliation(s)
- Fatemeh Hojjati
- Isfahan Neuroscience Research Center, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Ali Motahharynia
- Isfahan Neuroscience Research Center, Isfahan University of Medical Sciences, Isfahan, Iran
- Regenerative Medicine Research Center (RMRC), Department of Medicine, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Armin Adibi
- Isfahan Neuroscience Research Center, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Iman Adibi
- Isfahan Neuroscience Research Center, Isfahan University of Medical Sciences, Isfahan, Iran
- Department of Neurology, School of Medicine, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Mehdi Sanayei
- School of Cognitive Sciences, Institute for Research in Fundamental Sciences (IPM), Tehran, 1956836484, Iran.
| |
Collapse
|
6
|
Děchtěrenko F, Bainbridge WA, Lukavský J. Visual free recall and recognition in art students and laypeople. Mem Cognit 2024:10.3758/s13421-024-01607-7. [PMID: 39078592 DOI: 10.3758/s13421-024-01607-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/19/2024] [Indexed: 07/31/2024]
Abstract
Artists and laypeople differ in their ability to create drawings. Previous research has shown that artists have improved memory performance during drawing; however, it is unclear whether they have better visual memory after the drawing is finished. In this paper, we focused on the question of differences in visual memory between art students and the general population in two studies. In Study 1, both groups studied a set of images and later drew them in a surprise visual recall test. In Study 2, the drawings from Study 1 were evaluated by a different set of raters based on their drawing quality and similarity to the original image to link drawing evaluations with memory performance for both groups. We found that both groups showed comparable visual recognition memory performance; however, the artist group showed increased recall memory performance. Moreover, they produced drawings that were both better quality and more similar to the original image. Individually, participants whose drawings were rated as better showed higher recognition accuracy. Results from Study 2 also have practical implications for the usage of drawing as a tool for measuring free recall - the majority of the drawings were recognizable, and raters showed a high level of consistency during their evaluation of the drawings. Taken together, we found that artists have better visual recall memory than laypeople.
Collapse
Affiliation(s)
- Filip Děchtěrenko
- Institute of Psychology, Czech Academy of Sciences, Pod Vodárenskou věží 4, Prague, 18200, Czech Republic.
| | - Wilma A Bainbridge
- Department of Psychology, University of Chicago, 5848 S University Ave, Beecher Hall 303, Chicago, IL, 60637, USA
- Neuroscience Institute, University of Chicago, 5812 S Ellis Ave, Chicago, IL, 60637, USA
| | - Jiří Lukavský
- Institute of Psychology, Czech Academy of Sciences, Pod Vodárenskou věží 4, Prague, 18200, Czech Republic
| |
Collapse
|
7
|
Huang Q, Luo H. Shared structure facilitates working memory of multiple sequences. eLife 2024; 12:RP93158. [PMID: 39046319 PMCID: PMC11268885 DOI: 10.7554/elife.93158] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/25/2024] Open
Abstract
Daily experiences often involve the processing of multiple sequences, yet storing them challenges the limited capacity of working memory (WM). To achieve efficient memory storage, relational structures shared by sequences would be leveraged to reorganize and compress information. Here, participants memorized a sequence of items with different colors and spatial locations and later reproduced the full color and location sequences one after another. Crucially, we manipulated the consistency between location and color sequence trajectories. First, sequences with consistent trajectories demonstrate improved memory performance and a trajectory correlation between reproduced color and location sequences. Second, sequences with consistent trajectories show neural reactivation of common trajectories, and display spontaneous replay of color sequences when recalling locations. Finally, neural reactivation correlates with WM behavior. Our findings suggest that a shared common structure is leveraged for the storage of multiple sequences through compressed encoding and neural replay, together facilitating efficient information organization in WM.
Collapse
Affiliation(s)
- Qiaoli Huang
- School of Psychological and Cognitive Sciences, Peking UniversityBeijingChina
- PKU-IDG/McGovern Institute for Brain Research, Peking UniversityBeijingChina
- Beijing Key Laboratory of Behavior and Mental Health, Peking UniversityBeijingChina
- Max Planck Institute for Human Cognitive and Brain SciencesLeipzigGermany
| | - Huan Luo
- School of Psychological and Cognitive Sciences, Peking UniversityBeijingChina
- PKU-IDG/McGovern Institute for Brain Research, Peking UniversityBeijingChina
- Beijing Key Laboratory of Behavior and Mental Health, Peking UniversityBeijingChina
| |
Collapse
|
8
|
Morra S, Patella P, Muscella L. Modelling Working Memory Capacity: Is the Magical Number Four, Seven, or Does it Depend on What You Are Counting? J Cogn 2024; 7:60. [PMID: 39035073 PMCID: PMC11259112 DOI: 10.5334/joc.387] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2023] [Accepted: 07/03/2024] [Indexed: 07/23/2024] Open
Abstract
Limited attentional capacity is essential to working memory. How its limit should be assessed is a debated issue. Five experiments compare Cowan's 4-units and Pascual-Leone's 7-units models of limited working memory capacity, with presentation time and attention to operative schemes as potential explanations of this discrepancy. Experiments 1a-1c used the Compound Stimuli Visual Information (CSVI) task, with long versus brief presentation. Capacity was estimated with the Bose-Einstein model, assuming a different number of attending acts in each condition. Participants' k estimates in both conditions were highly correlated and the means were not different, indicating that the same capacity is assessed in both conditions. Experiments 2 and 3 used the 5000-msec CSVI, and the Visual Array Task (VAT) in two conditions (5000- vs. 120-msec presentation). Capacity in the VAT was estimated with Morey's Bayesian method. Participants' k estimates in both VAT conditions were correlated, but the mean was higher with long presentation, suggesting that the long condition benefits from recoding or chunking. The k estimate in the CSVI correlated with the short VAT and (to a lesser degree in Exp.2) with the long VAT. The mean estimate of k in the CSVI was one unit more than in the short VAT. We conclude that the CSVI and the short VAT tap the same capacity, one unit of which in the short VAT is allocated to an operative scheme; we discuss how Cowan's and Pascual-Leone's views on limited capacity can be reconciled.
Collapse
Affiliation(s)
| | - Paola Patella
- Universitàdi Genova, Italy
- I.I.T. –Center for Neuroscience and Cognitive Systems, Italy
| | | |
Collapse
|
9
|
Chen W, Ye S, Yan X, Ding X. The combination operation of grouping and ensemble coding for structured biological motion crowds in working memory. Cogn Res Princ Implic 2024; 9:45. [PMID: 38985366 PMCID: PMC11236836 DOI: 10.1186/s41235-024-00574-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2023] [Accepted: 07/04/2024] [Indexed: 07/11/2024] Open
Abstract
Massive studies have explored biological motion (BM) crowds processing for their remarkable social significance, primarily focused on uniformly distributed ones. However, real-world BM crowds often exhibit hierarchical structures rather than uniform arrangements. How such structured BM crowds are processed remains a subject of inquiry. This study investigates the representation of structured BM crowds in working memory (WM), recognizing the pivotal role WM plays in our social interactions involving BM. We propose the group-based ensemble hypothesis and test it through a member identification task. Participants were required to discern whether a presented BM belonged to a prior memory display of eight BM, each with distinct walking directions. Drawing on prominent Gestalt principles as organizational cues, we constructed structured groups within BM crowds by applying proximity and similarity cues in Experiments 1 and 2, respectively. In Experiment 3, we deliberately weakened the visibility of stimuli structures by increasing the similarity between subsets, probing the robustness of results. Consistently, our findings indicate that BM aligned with the mean direction of the subsets was more likely to be recognized as part of the memory stimuli. This suggests that WM inherently organizes structured BM crowds into separate ensembles based on organizational cues. In essence, our results illuminate the simultaneous operation of grouping and ensemble encoding mechanisms for BM crowds within WM.
Collapse
Affiliation(s)
- Wei Chen
- Department of Psychology, Sun Yat-Sen University, Guangzhou, China
| | - Shujuan Ye
- Department of Psychology, Sun Yat-Sen University, Guangzhou, China
| | - Xin Yan
- Department of Psychology, Sun Yat-Sen University, Guangzhou, China
| | - Xiaowei Ding
- Department of Psychology, Sun Yat-Sen University, Guangzhou, China.
| |
Collapse
|
10
|
Zhu P, Qiu Y, Shen M, Huang L, Chen H. Boolean map and object reconcile as the unit of visual working memory. Cereb Cortex 2024; 34:bhae306. [PMID: 39077919 DOI: 10.1093/cercor/bhae306] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2023] [Revised: 07/04/2024] [Accepted: 07/17/2024] [Indexed: 07/31/2024] Open
Abstract
The unit of visual working memory is a fundamental issue under debate in the fields of cognitive psychology and neuroscience, with some traditional research suggesting that it is an object, while other recent studies demonstrating that a Boolean map offers a better account. The controversy surrounding the unit of visual working memory often centers on the representation of objects consist of same dimensional features (e.g. bicolor objects). For 2 colors in a bicolor object, some behavioral studies have suggested that they need to be represented by separate units, while some other studies using electrophysiological measures have found that they can be represented within a single unit. This apparent conflict hints that Boolean map and object may reconcile as the unit of visual working memory. Adopting the contralateral delay activity as an electrophysiological marker of visual working memory, experiments 1 and 2 consistently found that the contralateral delay activity amplitude for memorizing bicolor circles at P7/P8 conformed the Boolean map-based storage throughout the whole maintenance, while the contralateral delay activity amplitude at P3/P4 just conformed the object-based storage during the early period. It suggests though Boolean map got stronger supporting evidence than object, they 2 may coexist as the unit of visual working memory.
Collapse
Affiliation(s)
- Ping Zhu
- Department of Psychology and Behavioral Sciences, Zhejiang University, Zijingang Campus, 866 Yuhangtang Road, Hangzhou, Zhejiang, 310058, China
| | - Yiheng Qiu
- Department of Psychology and Behavioral Sciences, Zhejiang University, Zijingang Campus, 866 Yuhangtang Road, Hangzhou, Zhejiang, 310058, China
| | - Mowei Shen
- Department of Psychology and Behavioral Sciences, Zhejiang University, Zijingang Campus, 866 Yuhangtang Road, Hangzhou, Zhejiang, 310058, China
| | - Liqiang Huang
- Department of Psychology, The Chinese University of Hong Kong, Sino Building, Shatin, New Territories, Hong Kong SAR, 999077, China
| | - Hui Chen
- Department of Psychology and Behavioral Sciences, Zhejiang University, Zijingang Campus, 866 Yuhangtang Road, Hangzhou, Zhejiang, 310058, China
| |
Collapse
|
11
|
Chen S, Töllner T, Müller HJ, Conci M. ERPs and alpha oscillations track the encoding and maintenance of object-based representations in visual working memory. Psychophysiology 2024; 61:e14557. [PMID: 38459638 DOI: 10.1111/psyp.14557] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2023] [Revised: 02/15/2024] [Accepted: 02/16/2024] [Indexed: 03/10/2024]
Abstract
When memorizing an integrated object such as a Kanizsa figure, the completion of parts into a coherent whole is attained by grouping processes which render a whole-object representation in visual working memory (VWM). The present study measured event-related potentials (ERPs) and oscillatory amplitudes to track these processes of encoding and representing multiple features of an object in VWM. To this end, a change detection task was performed, which required observers to memorize both the orientations and colors of six "pacman" items while inducing configurations of the pacmen that systematically varied in terms of their grouping strength. The results revealed an effect of object configuration in VWM despite physically constant visual input: change detection for both orientation and color features was more accurate with increased grouping strength. At the electrophysiological level, the lateralized ERPs and alpha activity mirrored this behavioral pattern. Perception of the orientation features gave rise to the encoding of a grouped object as reflected by the amplitudes of the Ppc. The grouped object structure, in turn, modulated attention to both orientation and color features as indicated by the enhanced N1pc and N2pc. Finally, during item retention, the representation of individual objects and the concurrent allocation of attention to these memorized objects were modulated by grouping, as reflected by variations in the CDA amplitude and a concurrent lateralized alpha suppression, respectively. These results indicate that memorizing multiple features of grouped, to-be-integrated objects involves multiple, sequential stages of processing, providing support for a hierarchical model of object representations in VWM.
Collapse
Affiliation(s)
- Siyi Chen
- Allgemeine und Experimentelle Psychologie, Department Psychologie, Ludwig-Maximilians-Universität München, Munich, Germany
| | - Thomas Töllner
- Allgemeine und Experimentelle Psychologie, Department Psychologie, Ludwig-Maximilians-Universität München, Munich, Germany
| | - Hermann J Müller
- Allgemeine und Experimentelle Psychologie, Department Psychologie, Ludwig-Maximilians-Universität München, Munich, Germany
| | - Markus Conci
- Allgemeine und Experimentelle Psychologie, Department Psychologie, Ludwig-Maximilians-Universität München, Munich, Germany
| |
Collapse
|
12
|
Bays PM, Schneegans S, Ma WJ, Brady TF. Representation and computation in visual working memory. Nat Hum Behav 2024; 8:1016-1034. [PMID: 38849647 DOI: 10.1038/s41562-024-01871-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2022] [Accepted: 03/22/2024] [Indexed: 06/09/2024]
Abstract
The ability to sustain internal representations of the sensory environment beyond immediate perception is a fundamental requirement of cognitive processing. In recent years, debates regarding the capacity and fidelity of the working memory (WM) system have advanced our understanding of the nature of these representations. In particular, there is growing recognition that WM representations are not merely imperfect copies of a perceived object or event. New experimental tools have revealed that observers possess richer information about the uncertainty in their memories and take advantage of environmental regularities to use limited memory resources optimally. Meanwhile, computational models of visuospatial WM formulated at different levels of implementation have converged on common principles relating capacity to variability and uncertainty. Here we review recent research on human WM from a computational perspective, including the neural mechanisms that support it.
Collapse
Affiliation(s)
- Paul M Bays
- Department of Psychology, University of Cambridge, Cambridge, UK
| | | | - Wei Ji Ma
- Center for Neural Science and Department of Psychology, New York University, New York, NY, USA
| | - Timothy F Brady
- Department of Psychology, University of California, San Diego, La Jolla, CA, USA.
| |
Collapse
|
13
|
Delhaye E, D'Innocenzo G, Raposo A, Coco MI. The upside of cumulative conceptual interference on exemplar-level mnemonic discrimination. Mem Cognit 2024:10.3758/s13421-024-01563-2. [PMID: 38709388 DOI: 10.3758/s13421-024-01563-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/21/2024] [Indexed: 05/07/2024]
Abstract
Although long-term visual memory (LTVM) has a remarkable capacity, the fidelity of its episodic representations can be influenced by at least two intertwined interference mechanisms during the encoding of objects belonging to the same category: the capacity to hold similar episodic traces (e.g., different birds) and the conceptual similarity of the encoded traces (e.g., a sparrow shares more features with a robin than with a penguin). The precision of episodic traces can be tested by having participants discriminate lures (unseen objects) from targets (seen objects) representing different exemplars of the same concept (e.g., two visually similar penguins), which generates interference at retrieval that can be solved if efficient pattern separation happened during encoding. The present study examines the impact of within-category encoding interference on the fidelity of mnemonic object representations, by manipulating an index of cumulative conceptual interference that represents the concurrent impact of capacity and similarity. The precision of mnemonic discrimination was further assessed by measuring the impact of visual similarity between targets and lures in a recognition task. Our results show a significant decrement in the correct identification of targets for increasing interference. Correct rejections of lures were also negatively impacted by cumulative interference as well as by the visual similarity with the target. Most interestingly though, mnemonic discrimination for targets presented with a visually similar lure was more difficult when objects were encoded under lower, not higher, interference. These findings counter a simply additive impact of interference on the fidelity of object representations providing a finer-grained, multi-factorial, understanding of interference in LTVM.
Collapse
Affiliation(s)
- Emma Delhaye
- CICPSI, Faculdade de Psicologia, Universidade de Lisboa, Lisboa, Portugal
- GIGA-CRC In-Vivo Imaging, University of Liège, Liège, Belgium
| | | | - Ana Raposo
- CICPSI, Faculdade de Psicologia, Universidade de Lisboa, Lisboa, Portugal
| | - Moreno I Coco
- Department of Psychology, Sapienza University of Rome, Rome, Italy.
- IRCSS Santa Lucia, Roma, Italy.
| |
Collapse
|
14
|
Abstract
The body of research on visual working memory (VWM)-the system often described as a limited memory store of visual information in service of ongoing tasks-is growing rapidly. The discovery of numerous related phenomena, and the many subtly different definitions of working memory, signify a challenge to maintain a coherent theoretical framework to discuss concepts, compare models and design studies. A lack of robust theory development has been a noteworthy concern in the psychological sciences, thought to be a precursor to the reproducibility crisis (Oberauer & Lewandowsky, Psychonomic Bulletin & Review, 26, 1596-1618, 2019). I review the theoretical landscape of the VWM field by examining two prominent debates-whether VWM is object-based or feature-based, and whether discrete-slots or variable-precision best describe VWM limits. I share my concerns about the dualistic nature of these debates and the lack of clear model specification that prevents fully determined empirical tests. In hopes of promoting theory development, I provide a working theory map by using the broadly encompassing memory for latent representations model (Hedayati et al., Nature Human Behaviour, 6, 5, 2022) as a scaffold for relevant phenomena and current theories. I illustrate how opposing viewpoints can be brought into accordance, situating leading models of VWM to better identify their differences and improve their comparison. The hope is that the theory map will help VWM researchers get on the same page-clarifying hidden intuitions and aligning varying definitions-and become a useful device for meaningful discussions, development of models, and definitive empirical tests of theories.
Collapse
Affiliation(s)
- William Xiang Quan Ngiam
- Department of Psychology, University of Chicago, Chicago, Illinois, USA.
- Institute of Mind and Biology, University of Chicago, Chicago, Illinois, USA.
| |
Collapse
|
15
|
Rippee-Brooks MD, Wu W, Dong J, Pappolla M, Fang X, Bao X. Viral Infections, Are They a Trigger and Risk Factor of Alzheimer's Disease? Pathogens 2024; 13:240. [PMID: 38535583 PMCID: PMC10974111 DOI: 10.3390/pathogens13030240] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2024] [Revised: 03/02/2024] [Accepted: 03/07/2024] [Indexed: 04/01/2024] Open
Abstract
Alzheimer's Disease (AD), a progressive and debilitating condition, is reported to be the most common type of dementia, with at least 55 million people believed to be currently affected. Many causation hypotheses of AD exist, yet the intriguing link between viral infection and its possible contribution to the known etiology of AD has become an attractive focal point of research for the field and a challenging study task. In this review, we will explore the historical perspective and milestones that led the field to investigate the viral connection to AD. Specifically, several viruses such as Herpes Simplex Virus 1 (HSV-1), Zika virus (ZIKV), and severe cute respiratory syndrome coronavirus 2 (SARS-CoV-2), along with several others mentioned, include the various viruses presently considered within the field. We delve into the strong evidence implicating these viruses in the development of AD such as the lytic replication and axonal transport of HSV-1, the various mechanisms of ZIKV neurotropism through the human protein Musashi-1 (MSI1), and the spread of SARS-CoV-2 through the transfer of the virus through the BBB endothelial cells to glial cells and then to neurons via transsynaptic transfer. We will also explore beyond these mere associations by carefully analyzing the potential mechanisms by which these viruses may contribute to AD pathology. This includes but is not limited to direct neuronal infections, the dysregulation of immune responses, and the impact on protein processing (Aβ42 and hyperphosphorylated tau). Controversies and challenges of the virus-AD relationship emerge as we tease out these potential mechanisms. Looking forward, we emphasize future directions, such as distinct questions and proposed experimentations to explore, that the field should take to tackle the remaining unanswered questions and the glaring research gaps that persist. Overall, this review aims to provide a comprehensive survey of the past, present, and future of the potential link between viral infections and their association with AD development while encouraging further discussion.
Collapse
Affiliation(s)
- Meagan D. Rippee-Brooks
- Microbiology and Immunology Graduate Program, Department of Microbiology and Immunology, The University of Texas Medical Branch, Galveston, TX 77550, USA
| | - Wenzhe Wu
- Department of Pediatrics, The University of Texas Medical Branch, Galveston, TX 77550, USA
| | - Jianli Dong
- Department of Pathology, The University of Texas Medical Branch, Galveston, TX 77550, USA
| | - Miguel Pappolla
- Department of Neurology and Mitchell Center for Neurodegenerative Diseases, The University of Texas Medical Branch, Galveston, TX 77550, USA
| | - Xiang Fang
- Department of Neurology and Mitchell Center for Neurodegenerative Diseases, The University of Texas Medical Branch, Galveston, TX 77550, USA
| | - Xiaoyong Bao
- Microbiology and Immunology Graduate Program, Department of Microbiology and Immunology, The University of Texas Medical Branch, Galveston, TX 77550, USA
- Department of Pediatrics, The University of Texas Medical Branch, Galveston, TX 77550, USA
- The Institute of Translational Sciences, The University of Texas Medical Branch, Galveston, TX 77550, USA
- The Institute for Human Infections and Immunity, The University of Texas Medical Branch, Galveston, TX 77550, USA
| |
Collapse
|
16
|
Yonelinas AP. The role of recollection and familiarity in visual working memory: A mixture of threshold and signal detection processes. Psychol Rev 2024; 131:321-348. [PMID: 37326544 PMCID: PMC11089539 DOI: 10.1037/rev0000432] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/17/2023]
Abstract
Whether working memory reflects a thresholded recollection process whereby only a limited number of items are maintained in memory, or a signal detection process in which each studied item is increased in familiarity strength, is a topic of considerable debate. A review of visual working memory studies that have examined receiver operating characteristics (ROCs) across a broad set of materials and test conditions indicates that both signal detection and threshold processes contribute to working memory. In addition, the role that these two processes play varies systematically across conditions, such that a threshold process plays a particularly critical role when binary old/new judgments are required, when changes are relatively discrete, and when the hippocampus does not contribute to performance. In contrast, a signal detection process plays a greater role when confidence judgments are required, when the materials or the changes are global in nature, and when the hippocampus contributes to performance. In addition, the ROC results indicate that in standard single-probe tests of working memory, items that are maintained in an active recollected state support both recall-to-accept and recall-to-reject responses; whereas in complex-probe tests, recollection preferentially supports recall-to-reject; and in item-recognition tests it preferentially supports recall-to-accept. Moreover, there is growing evidence that these threshold and strength-based processes are related to distinct states of conscious awareness whereby they support perceiving- and sensing-based responses, respectively. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Collapse
|
17
|
Mikhailova A, Lightfoot S, Santos-Victor J, Coco MI. Differential effects of intrinsic properties of natural scenes and interference mechanisms on recognition processes in long-term visual memory. Cogn Process 2024; 25:173-187. [PMID: 37831320 DOI: 10.1007/s10339-023-01164-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2022] [Accepted: 09/20/2023] [Indexed: 10/14/2023]
Abstract
Humans display remarkable long-term visual memory (LTVM) processes. Even though images may be intrinsically memorable, the fidelity of their visual representations, and consequently the likelihood of successfully retrieving them, hinges on their similarity when concurrently held in LTVM. In this debate, it is still unclear whether intrinsic features of images (perceptual and semantic) may be mediated by mechanisms of interference generated at encoding, or during retrieval, and how these factors impinge on recognition processes. In the current study, participants (32) studied a stream of 120 natural scenes from 8 semantic categories, which varied in frequencies (4, 8, 16 or 32 exemplars per category) to generate different levels of category interference, in preparation for a recognition test. Then they were asked to indicate which of two images, presented side by side (i.e. two-alternative forced-choice), they remembered. The two images belonged to the same semantic category but varied in their perceptual similarity (similar or dissimilar). Participants also expressed their confidence (sure/not sure) about their recognition response, enabling us to tap into their metacognitive efficacy (meta-d'). Additionally, we extracted the activation of perceptual and semantic features in images (i.e. their informational richness) through deep neural network modelling and examined their impact on recognition processes. Corroborating previous literature, we found that category interference and perceptual similarity negatively impact recognition processes, as well as response times and metacognitive efficacy. Moreover, images semantically rich were less likely remembered, an effect that trumped a positive memorability boost coming from perceptual information. Critically, we did not observe any significant interaction between intrinsic features of images and interference generated either at encoding or during retrieval. All in all, our study calls for a more integrative understanding of the representational dynamics during encoding and recognition enabling us to form, maintain and access visual information.
Collapse
Affiliation(s)
- Anastasiia Mikhailova
- Institute for Systems and Robotics, Instituto Superior Técnico, Universidade de Lisboa, Lisbon, Portugal.
| | | | - José Santos-Victor
- Institute for Systems and Robotics, Instituto Superior Técnico, Universidade de Lisboa, Lisbon, Portugal
| | - Moreno I Coco
- Sapienza, University of Rome, Rome, Italy.
- I.R.C.C.S. Santa Lucia, Fondazione Santa Lucia, Roma, Italy.
| |
Collapse
|
18
|
Ikier S, Dönerkayalı C, Halıcı ÖS, Kaymak Gülseren ZA, Göksal H, Akbaş B. When is memory more reliable? Scientific findings, theories, and myths. APPLIED NEUROPSYCHOLOGY. ADULT 2024; 31:77-94. [PMID: 35944506 DOI: 10.1080/23279095.2022.2107928] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
The question of whether human memory is reliable generated extensive research. Memory is open to reconstruction and false retrieval of unpresented information or unexperienced events. These can create problems in judgments and decisions that rely on memory accuracy. In the case of eyewitness testimony, these problems can result in injustice. Then again, memory is also reliable enough. Information acquisition, processing, and retrieval capacity of our memory made it possible to survive the course of evolution. Our memory also makes it possible to continue our daily lives, most of the time without major problems. In the present review, we suggest that the right question to ask may not be whether memory is reliable, but rather to ask when and under what circumstances memory is more reliable. The review's educational aim is to identify the conditions under which memory is more versus less reliable, and its theoretical aim is to discuss memory reliability. We reviewed the literature on situational, emotional, social, and individual difference variables that affect memory reliability, identified the conditions under which memory is more versus less reliable, summarized these outcomes as easy-to-reach items, and discussed them in the light of major theories. Our discussion also touched upon the differentiation of societal myths about the reliability of memory from scientific findings, since believing in memory myths can also affect the reliability of memory. Awareness of the specific circumstances under which memory is more reliable can lead to the consideration of how much memory can be trusted under those specific circumstances.
Collapse
Affiliation(s)
- Simay Ikier
- Department of Psychology, Bahçeşehir University, Istanbul, Turkey
| | | | | | | | - Hilal Göksal
- Department of Psychology, Bahçeşehir University, Istanbul, Turkey
| | - Busenur Akbaş
- Department of Psychology, Bahçeşehir University, Istanbul, Turkey
| |
Collapse
|
19
|
Ngiam WXQ, Loetscher KB, Awh E. Object-based encoding constrains storage in visual working memory. J Exp Psychol Gen 2024; 153:86-101. [PMID: 37695325 PMCID: PMC10840914 DOI: 10.1037/xge0001479] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/12/2023]
Abstract
The fundamental unit of visual working memory (WM) has been debated for decades. WM could be object-based, such that capacity is set by the number of individuated objects, or feature-based, such that capacity is determined by the total number of feature values stored. The present work examined whether object- or feature-based models would best explain how multifeature objects (i.e., color/orientation or color/shape) are encoded into visual WM. If maximum capacity is limited by the number of individuated objects, then above-chance performance should be restricted to the same number of items as in a single-feature condition. By contrast, if the capacity is determined by independent storage resources for distinct features-without respect to the objects that contain those features-then successful storage of feature values could be distributed across a larger number of objects than when only a single feature is relevant. We conducted four experiments using a whole-report task in which subjects reported both features from every item in a six-item array. The crucial finding was that above-chance recall-for both single- and multifeatured objects-was restricted to the first three or four responses, while the later responses were best modeled as guesses. Thus, whole-report with multifeature objects reveals a distribution of recalled features that indicates an object-based limit on WM capacity. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Collapse
Affiliation(s)
| | | | - Edward Awh
- Department of Psychology, University of Chicago
| |
Collapse
|
20
|
Chung YH, Brady TF, Störmer VS. Sequential encoding aids working memory for meaningful objects' identities but not for their colors. Mem Cognit 2023:10.3758/s13421-023-01486-4. [PMID: 37948024 DOI: 10.3758/s13421-023-01486-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/19/2023] [Indexed: 11/12/2023]
Abstract
Previous studies have found that real-world objects' identities are better remembered than simple features like colored circles, and this effect is particularly pronounced when these stimuli are encoded one by one in a serial, item-based way. Recent work has also demonstrated that memory for simple features like color is improved if these colors are part of real-world objects, suggesting that meaningful objects can serve as a robust memory scaffold for their associated low-level features. However, it is unclear whether the improved color memory that arises from the colors appearing on real-world objects is affected by encoding format, in particular whether items are encoded sequentially or simultaneously. We test this using randomly colored silhouettes of recognizable versus unrecognizable scrambled objects that offer a uniquely controlled set of stimuli to test color working memory of meaningful versus non-meaningful objects. Participants were presented with four stimuli (silhouettes of objects or scrambled shapes) simultaneously or sequentially. After a short delay, they reported either which colors or which shapes they saw in a two-alternative forced-choice task. We replicated previous findings that meaningful stimuli boost working memory performance for colors (Exp. 1). We found that when participants remembered the colors (Exp. 2) there was no difference in performance across the two encoding formats. However, when participants remembered the shapes and thus identity of the objects (Exp. 3), sequential presentation resulted in better performance than simultaneous presentation. Overall, these results show that different encoding formats can flexibly impact visual working memory depending on what the memory-relevant feature is.
Collapse
Affiliation(s)
- Yong Hoon Chung
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH, USA.
| | - Timothy F Brady
- Department of Psychology, University of California San Diego, San Diego, CA, USA
| | - Viola S Störmer
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH, USA
| |
Collapse
|
21
|
Forster PP, Fiehler K, Karimpur H. Egocentric cues influence the allocentric spatial memory of object configurations for memory-guided actions. J Neurophysiol 2023; 130:1142-1149. [PMID: 37791381 DOI: 10.1152/jn.00149.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2023] [Revised: 09/27/2023] [Accepted: 09/28/2023] [Indexed: 10/05/2023] Open
Abstract
Allocentric and egocentric reference frames are used to code the spatial position of action targets in reference to objects in the environment, i.e., relative to landmarks (allocentric), or the observer (egocentric). Previous research investigated reference frames in isolation, for example, by shifting landmarks relative to the target and asking participants to reach to the remembered target location. Systematic reaching errors were found in the direction of the landmark shift and used as a proxy for allocentric spatial coding. Here, we examined the interaction of both allocentric and egocentric reference frames by shifting the landmarks as well as the observer. We asked participants to encode a three-dimensional configuration of balls and to reproduce this configuration from memory after a short delay followed by a landmark or an observer shift. We also manipulated the number of landmarks to test its effect on the use of allocentric and egocentric reference frames. We found that participants were less accurate when reproducing the configuration of balls after an observer shift, which was reflected in larger configurational errors. In addition, an increase in the number of landmarks led to a stronger reliance on allocentric cues and a weaker contribution of egocentric cues. In sum, our results highlight the important role of egocentric cues for allocentric spatial coding in the context of memory-guided actions.NEW & NOTEWORTHY Objects in our environment are coded relative to each other (allocentrically) and are thought to serve as independent and reliable cues (landmarks) in the context of unreliable egocentric signals. Contrary to this assumption, we demonstrate that egocentric cues alter the allocentric spatial memory, which could reflect recently discovered interactions between allocentric and egocentric neural processing pathways. Furthermore, additional landmarks lead to a higher contribution of allocentric and a lower contribution of egocentric cues.
Collapse
Affiliation(s)
- Pierre-Pascal Forster
- Experimental Psychology, Justus Liebig University Giessen, Giessen, Germany
- Center for Mind, Brain and Behavior (CMBB), University of Marburg and Justus Liebig University Giessen, Germany
| | - Katja Fiehler
- Experimental Psychology, Justus Liebig University Giessen, Giessen, Germany
- Center for Mind, Brain and Behavior (CMBB), University of Marburg and Justus Liebig University Giessen, Germany
| | - Harun Karimpur
- Experimental Psychology, Justus Liebig University Giessen, Giessen, Germany
- Center for Mind, Brain and Behavior (CMBB), University of Marburg and Justus Liebig University Giessen, Germany
| |
Collapse
|
22
|
Li Q, Chen Z, Sun Q, Li X. Which factor affects the storage of real-world object information in visual working memory: perceptual or conceptual information? Front Psychol 2023; 14:1239485. [PMID: 37920736 PMCID: PMC10619856 DOI: 10.3389/fpsyg.2023.1239485] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2023] [Accepted: 08/22/2023] [Indexed: 11/04/2023] Open
Abstract
Visual working memory (VWM) is a limited dynamic memory system where people temporarily store and process visual information. Previous research showed that real-world objects do not have a fixed capacity compared to simple ones. In konkle's study, they found that the conceptual information and perception information of real-world objects had different effects on visual long-term memory (VLTM) capacity. VLTM capacity was more dependent on conceptual information than the perceptual distinctiveness of real-world objects. However, we did not know how the intrinsic attribute of real-world objects affects VWM capacity yet. In the current research, we set five experiments to explore the comparative effects of conceptual vs. perceptual information of real-world objects in VWM capacity. Our results suggested that VWM capacity was more dependent on the perceptual distinctiveness of real-world objects than on conceptual structure. These data provide evidence that VWM capacity for real-world objects depends more on perceptual information than on conceptual structure.
Collapse
Affiliation(s)
- Qiankai Li
- College of Psychology, Zhejiang Normal University, Jinhua, China
| | - Zhen Chen
- College of Psychology, Zhejiang Normal University, Jinhua, China
| | - Qi Sun
- College of Psychology, Zhejiang Normal University, Jinhua, China
- Key Laboratory of Intelligent Education Technology and Application of Zhejiang Province, Zhejiang Normal University, Jinhua, China
| | - Xinyu Li
- College of Psychology, Zhejiang Normal University, Jinhua, China
- Key Laboratory of Intelligent Education Technology and Application of Zhejiang Province, Zhejiang Normal University, Jinhua, China
| |
Collapse
|
23
|
Son G, Chong SC. Similarity-based clustering of multifeature objects in visual working memory. Atten Percept Psychophys 2023; 85:2242-2256. [PMID: 36930394 DOI: 10.3758/s13414-023-02687-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/21/2023] [Indexed: 03/18/2023]
Abstract
This study investigated the similarity-based clustering mechanism of multifeature stimuli, wherein items are separated or grouped based on their similarity in visual working memory (VWM). In particular, we investigated whether clustering occurred at an individual feature level or at an integrated object level when participants encoded objects with multiple features for VWM. To test this, we conducted two experiments in which participants remembered and reconstructed a randomly chosen feature (either color or orientation) from one of five presented stimuli. As a key manipulation, we kept the distributions of the two feature dimensions constant while controlling the conjunction between the two dimensions in two different conditions: congruent conjunction (CC) and incongruent conjunction (IC). With this manipulation, we expected to observe the same number of clusters regardless of the conjunction condition when clustering occurred at the feature level. However, we expected a different number of clusters for CC and IC conditions when clustering occurred at the object level. Across two experiments, we consistently observed evidence that favored feature-level clustering. Nevertheless, we found that the swap error rates increased in the IC condition only when two features had to be encoded in VWM. These results suggest that clustering occurs at the feature level in VWM and that feature-level clustering influences item-level feature binding. Therefore, our study demonstrated the flexibility of representational units in VWM.
Collapse
Affiliation(s)
- Gaeun Son
- Graduate Program for Cognitive Science, Yonsei University, Seoul, South Korea
- Department of Psychology, University of Toronto, Toronto, ON, Canada
| | - Sang Chul Chong
- Graduate Program for Cognitive Science, Yonsei University, Seoul, South Korea.
- Department of Psychology, Yonsei University, Seoul, South Korea.
| |
Collapse
|
24
|
Sasin E, Markov Y, Fougnie D. Meaningful objects avoid attribute amnesia due to incidental long-term memories. Sci Rep 2023; 13:14464. [PMID: 37660090 PMCID: PMC10475071 DOI: 10.1038/s41598-023-41642-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2023] [Accepted: 08/29/2023] [Indexed: 09/04/2023] Open
Abstract
Attribute amnesia describes the failure to unexpectedly report the attribute of an attended stimulus, likely reflecting a lack of working memory consolidation. Previous studies have shown that unique meaningful objects are immune to attribute amnesia. However, these studies used highly dissimilar foils to test memory, raising the possibility that good performance at the surprise test was based on an imprecise (gist-like) form of long-term memory. In Experiment 1, we explored whether a more sensitive memory test would reveal attribute amnesia in meaningful objects. We used a four-alternative-forced-choice test with foils having mis-matched exemplar (e.g., apple pie/pumpkin pie) and/or state (e.g., cut/full) information. Errors indicated intact exemplar, but not state information. Thus, meaningful objects are vulnerable to attribute amnesia under the right conditions. In Experiments 2A-2D, we manipulated the familiarity signals of test items by introducing a critical object as a pre-surprise target. In the surprise trial, this critical item matched one of the foil choices. Participants selected the critical object more often than other items. By demonstrating that familiarity influences responses in this paradigm, we suggest that meaningful objects are not immune to attribute amnesia but instead side-step the effects of attribute amnesia.
Collapse
Affiliation(s)
- Edyta Sasin
- Department of Psychology, New York University Abu Dhabi, Abu Dhabi, UAE.
| | - Yuri Markov
- Department of Psychology, Goethe University Frankfurt, Frankfurt am Main, Germany
| | - Daryl Fougnie
- Department of Psychology, New York University Abu Dhabi, Abu Dhabi, UAE
| |
Collapse
|
25
|
Chawoush B, Draschkow D, van Ede F. Capacity and selection in immersive visual working memory following naturalistic object disappearance. J Vis 2023; 23:9. [PMID: 37548958 PMCID: PMC10411649 DOI: 10.1167/jov.23.8.9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2023] [Accepted: 07/06/2023] [Indexed: 08/08/2023] Open
Abstract
Visual working memory-holding past visual information in mind for upcoming behavior-is commonly studied following the abrupt removal of visual objects from static two-dimensional (2D) displays. In everyday life, visual objects do not typically vanish from the environment in front of us. Rather, visual objects tend to enter working memory following self or object motion: disappearing from view gradually and changing the spatial relation between memoranda and observer. Here, we used virtual reality (VR) to investigate whether two classic findings from visual working memory research-a capacity of around three objects and the reliance on space for object selection-generalize to more naturalistic modes of object disappearance. Our static reference condition mimicked traditional laboratory tasks whereby visual objects were held static in front of the participant and removed from view abruptly. In our critical flow condition, the same visual objects flowed by participants, disappearing from view gradually and behind the observer. We considered visual working memory performance and capacity, as well as space-based mnemonic selection, indexed by directional biases in gaze. Despite vastly distinct modes of object disappearance and altered spatial relations between memoranda and observer, we found comparable capacity and comparable gaze signatures of space-based mnemonic selection. This finding reveals how classic findings from visual working memory research generalize to immersive situations with more naturalistic modes of object disappearance and with dynamic spatial relations between memoranda and observer.
Collapse
Affiliation(s)
- Babak Chawoush
- Institute for Brain and Behavior Amsterdam, Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| | - Dejan Draschkow
- Department of Experimental Psychology, University of Oxford, United Kingdom
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford, United Kingdom
| | - Freek van Ede
- Institute for Brain and Behavior Amsterdam, Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| |
Collapse
|
26
|
Chung YH, Brady TF, Störmer VS. No Fixed Limit for Storing Simple Visual Features: Realistic Objects Provide an Efficient Scaffold for Holding Features in Mind. Psychol Sci 2023:9567976231171339. [PMID: 37227786 DOI: 10.1177/09567976231171339] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/27/2023] Open
Abstract
Prominent theories of visual working memory postulate that the capacity to maintain a particular visual feature is fixed. In contrast to these theories, recent studies have demonstrated that meaningful objects are better remembered than simple, nonmeaningful stimuli. Here, we tested whether this is solely because meaningful stimuli can recruit additional features-and thus more storage capacity-or whether simple visual features that are not themselves meaningful can also benefit from being part of a meaningful object. Across five experiments (30 young adults each), we demonstrated that visual working memory capacity for color is greater when colors are part of recognizable real-world objects compared with unrecognizable objects. Our results indicate that meaningful stimuli provide a potent scaffold to help maintain simple visual feature information, possibly because they effectively increase the objects' distinctiveness from each other and reduce interference.
Collapse
Affiliation(s)
- Yong Hoon Chung
- Department of Psychological and Brain Sciences, Dartmouth College
| | - Timothy F Brady
- Department of Psychology, University of California San Diego
| | - Viola S Störmer
- Department of Psychological and Brain Sciences, Dartmouth College
| |
Collapse
|
27
|
Danieli K, Guyon A, Bethus I. Episodic Memory formation: A review of complex Hippocampus input pathways. Prog Neuropsychopharmacol Biol Psychiatry 2023; 126:110757. [PMID: 37086812 DOI: 10.1016/j.pnpbp.2023.110757] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/03/2023] [Revised: 03/08/2023] [Accepted: 03/22/2023] [Indexed: 04/24/2023]
Abstract
Memories of everyday experiences involve the encoding of a rich and dynamic representation of present objects and their contextual features. Traditionally, the resulting mnemonic trace is referred to as Episodic Memory, i.e. the "what", "where" and "when" of a lived episode. The journey for such memory trace encoding begins with the perceptual data of an experienced episode handled in sensory brain regions. The information is then streamed to cortical areas located in the ventral Medio Temporal Lobe, which produces multi-modal representations concerning either the objects (in the Perirhinal cortex) or the spatial and contextual features (in the parahippocampal region) of the episode. Then, this high-level data is gated through the Entorhinal Cortex and forwarded to the Hippocampal Formation, where all the pieces get bound together. Eventually, the resulting encoded neural pattern is relayed back to the Neocortex for a stable consolidation. This review will detail these different stages and provide a systematic overview of the major cortical streams toward the Hippocampus relevant for Episodic Memory encoding.
Collapse
Affiliation(s)
| | - Alice Guyon
- Université Cote d'Azur, Neuromod Institute, France; Université Cote d'Azur, CNRS UMR 7275, IPMC, Valbonne, France
| | - Ingrid Bethus
- Université Cote d'Azur, Neuromod Institute, France; Université Cote d'Azur, CNRS UMR 7275, IPMC, Valbonne, France
| |
Collapse
|
28
|
Pflueger MO, Mager R, Graf M, Stieglitz RD. Encoding of everyday objects in older adults: Episodic memory assessment in virtual reality. Front Aging Neurosci 2023; 15:1100057. [PMID: 36993909 PMCID: PMC10040840 DOI: 10.3389/fnagi.2023.1100057] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2022] [Accepted: 02/03/2023] [Indexed: 03/14/2023] Open
Abstract
IntroductionAge-related decline in episodic memory performance in otherwise healthy older adults is indisputably evident. Yet, it has been shown that under certain conditions episodic memory performance in healthy older adults’ barely deviates from those seen in young adults. Here we report on the quality of object encoding in an ecologically valid, virtual-reality based memory assessment in a sample of healthy older and younger adults with comparable memory performance.MethodsWe analyzed encoding by establishing both a serial and semantic clustering index and an object memory association network.ResultsAs expected, semantic clustering was superior in older adults without need for additional allocation of executive resources whereas young adults tended more to rely on serial strategies. The association networks suggested a plethora of obvious but also less obvious memory organization principles, some of which indicated converging approaches between the groups as suggested by a subgraph analysis and some of which indicated diverging approaches as suggested by the respective network interconnectivity. A higher interconnectivity was observed in the older adults’ association networks.DiscussionWe interpreted this as a consequence of superior semantic memory organization (extent to which effective semantic strategies diverged within the group). In conclusion, these results might indicate a diminished need for compensatory cognitive effort in healthy older adults when encoding and recalling everyday objects under ecologically valid conditions. Due to an enhanced and multimodal encoding model, superior crystallized abilities might be sufficient to counteract an age-related decline in various other and specific cognitive domains. This approach might potentially elucidate age-related changes in memory performance in both healthy and pathological aging.
Collapse
Affiliation(s)
- Marlon O. Pflueger
- University of Basel, Forensic Clinic of the University Psychiatric Clinics, Basel, Switzerland
- *Correspondence: Marlon O. Pflueger,
| | - Ralph Mager
- University of Basel, Forensic Clinic of the University Psychiatric Clinics, Basel, Switzerland
| | - Marc Graf
- University of Basel, Forensic Clinic of the University Psychiatric Clinics, Basel, Switzerland
| | | |
Collapse
|
29
|
Difficulty limits of visual mental imagery. Cognition 2023; 236:105436. [PMID: 36907115 DOI: 10.1016/j.cognition.2023.105436] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2021] [Revised: 02/25/2023] [Accepted: 03/05/2023] [Indexed: 03/12/2023]
Abstract
While past work has focused on the representational format of mental imagery, and the similarities of its operation and neural substrate to online perception, surprisingly little has tested the boundaries of the level of detail that mental imagery can generate. To answer this question, we take inspiration from the visual short-term memory literature, a related field which has found that memory capacity is affected by the number of items, whether they are unique, and whether and how they move. We test these factors of set size, color heterogeneity, and transformation in mental imagery through both subjective (Exp 1; Exp 2) and objective (Exp 2) measures - difficulty ratings and a change detection task, respectively - to determine the capacity limits of our mental imagery, and find that limits on mental imagery are similar to those for visual short-term memory. In Experiment 1, participants rated the difficulty of imagining 1-4 colored items as subjectively more difficult when there were more items, when the items had unique colors instead of an identical color, and when they scaled or rotated instead of merely linearly translating. Experiment 2 isolated these subjective difficulty ratings of rotation for uniquely colored items, and added a rotation distance manipulation (10° to 110°), again finding higher subjective difficulty for more items, and for when those items rotated farther; the objective measure showed a decrease in performance for more items, but not for rotational degree. Congruities between the subjective and objective results suggest similar costs, but some incongruities suggest that subjective reports can be overly optimistic, likely because they are biased by an illusion of detail.
Collapse
|
30
|
Gandolfo M, Nägele H, Peelen MV. Predictive Processing of Scene Layout Depends on Naturalistic Depth of Field. Psychol Sci 2023; 34:394-405. [PMID: 36608172 DOI: 10.1177/09567976221140341] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/07/2023] Open
Abstract
Boundary extension is a classic memory illusion in which observers remember more of a scene than was presented. According to predictive-processing accounts, boundary extension reflects the integration of visual input and expectations of what is beyond a scene's boundaries. According to normalization accounts, boundary extension rather reflects one end of a normalization process toward a scene's typically experienced viewing distance, such that close-up views give boundary extension but distant views give boundary contraction. Here, across four experiments (N = 125 adults), we found that boundary extension strongly depends on depth of field, as determined by the aperture settings on a camera. Photographs with naturalistic depth of field led to larger boundary extension than photographs with unnaturalistic depth of field, even when distant views were shown. We propose that boundary extension reflects a predictive mechanism with adaptive value that is strongest for naturalistic views of scenes. The current findings indicate that depth of field is an important variable to consider in the study of scene perception and memory.
Collapse
Affiliation(s)
- Marco Gandolfo
- Donders Institute for Brain, Cognition, and Behaviour, Radboud University
| | - Hendrik Nägele
- Donders Institute for Brain, Cognition, and Behaviour, Radboud University
| | - Marius V Peelen
- Donders Institute for Brain, Cognition, and Behaviour, Radboud University
| |
Collapse
|
31
|
Martin D, Sun X, Gutierrez D, Masia B. A Study of Change Blindness in Immersive Environments. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2023; PP:2446-2455. [PMID: 37027712 DOI: 10.1109/tvcg.2023.3247102] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
Human performance is poor at detecting certain changes in a scene, a phenomenon known as change blindness. Although the exact reasons of this effect are not yet completely understood, there is a consensus that it is due to our constrained attention and memory capacity: We create our own mental, structured representation of what surrounds us, but such representation is limited and imprecise. Previous efforts investigating this effect have focused on 2D images; however, there are significant differences regarding attention and memory between 2D images and the viewing conditions of daily life. In this work, we present a systematic study of change blindness using immersive 3D environments, which offer more natural viewing conditions closer to our daily visual experience. We devise two experiments; first, we focus on analyzing how different change properties (namely type, distance, complexity, and field of view) may affect change blindness. We then further explore its relation with the capacity of our visual working memory and conduct a second experiment analyzing the influence of the number of changes. Besides gaining a deeper understanding of the change blindness effect, our results may be leveraged in several VR applications such as redirected walking, games, or even studies on saliency or attention prediction.
Collapse
|
32
|
Moussaoui S, Pereira CF, Niemeier M. Working memory in action: Transsaccadic working memory deficits in the left visual field and after transcallosal remapping. Cortex 2023; 159:26-38. [PMID: 36608419 DOI: 10.1016/j.cortex.2022.11.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2022] [Revised: 08/08/2022] [Accepted: 11/16/2022] [Indexed: 12/23/2022]
Abstract
Every waking second, we make three saccadic eye movements that move our retinal images. Thus, to attain a coherent image of the world we need to remember visuo-spatial information across saccades. But transsaccadic working memory (tWM) remains poorly understood. Crucially, there has been a debate whether there are any differences in tWM for the left vs. right visual field and depending on saccade direction. However, previous studies have probed tWM with minimal loads whereas spatial differences might arise with higher loads. Here we employed a task that probed higher memory load for spatial information in the left and right visual field and with horizontal as well as vertical saccades. We captured several measures of precision and accuracy of performance that, when submitted to principal component analysis, produced two components. Component 1, mainly associated with precision, yielded greater error for the left than the right visual field. Component 2 was associated with performance accuracy and unexpectedly produced a disadvantage after rightward saccades. Both components showed that performance was worse when rightward or leftward saccades afforded a shift of memory representations between visual fields compared to remapping within the same field. Our study offers several novel findings. It is the first to show that tWM involves at least two components likely reflecting working memory capacity and strategic aspects of working memory, respectively. Reduced capacity for the left, rather than the right visual field is consistent with how the left and right visual fields are known to be represented in the two hemispheres. Remapping difficulties between visual fields is consistent with the limited information transfer across the corpus callosum. Finally, the impact of rightward saccades on working memory might be due to greater interference of the accompanying shifts of attention. Our results highlight the dynamic nature of transsaccadic working memory.
Collapse
Affiliation(s)
- Simar Moussaoui
- Department of Psychology, University of Toronto at Scarborough, Toronto, ON, Canada
| | - Christina F Pereira
- Department of Psychology, University of Toronto at Scarborough, Toronto, ON, Canada
| | - Matthias Niemeier
- Department of Psychology, University of Toronto at Scarborough, Toronto, ON, Canada; Centre for Vision Research, York University, Toronto, ON, Canada; Vision Science to Applications (VISTA) Program, York University, Toronto, ON, Canada.
| |
Collapse
|
33
|
Abstract
Flexible behavior requires guidance not only by sensations that are available immediately but also by relevant mental contents carried forward through working memory. Therefore, selective-attention functions that modulate the contents of working memory to guide behavior (inside-out) are just as important as those operating on sensory signals to generate internal contents (outside-in). We review the burgeoning literature on selective attention in the inside-out direction and underscore its functional, flexible, and future-focused nature. We discuss in turn the purpose (why), targets (what), sources (when), and mechanisms (how) of selective attention inside working memory, using visual working memory as a model. We show how the study of internal selective attention brings new insights concerning the core cognitive processes of attention and working memory and how considering selective attention and working memory together paves the way for a rich and integrated understanding of how mind serves behavior.
Collapse
Affiliation(s)
- Freek van Ede
- Institute for Brain and Behavior Amsterdam, and Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Amsterdam, Netherlands;
| | - Anna C Nobre
- Departments of Experimental Psychology and Psychiatry, Oxford Centre for Human Brain Activity, and Wellcome Centre for Integrative Neuroimaging, University of Oxford, Oxford, United Kingdom;
| |
Collapse
|
34
|
Chiou SC, Schack T. Working memory for movement rhythms given spatial relevance: Effects of sequence length and maintenance delay. VISUAL COGNITION 2023. [DOI: 10.1080/13506285.2022.2162173] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/05/2023]
Affiliation(s)
- Shiau-Chuen Chiou
- Neurocognition and Action Research Group, Center for Cognitive Interaction Technology (CITEC), Bielefeld University, Bielefeld, Germany
- Faculty of Psychology and Sports Science, Bielefeld University, Bielefeld, Germany
| | - Thomas Schack
- Neurocognition and Action Research Group, Center for Cognitive Interaction Technology (CITEC), Bielefeld University, Bielefeld, Germany
- Faculty of Psychology and Sports Science, Bielefeld University, Bielefeld, Germany
| |
Collapse
|
35
|
Evaluation of eye movement patterns during reading of mixed dentition panoramic radiographs in dental students. PEDIATRIC DENTAL JOURNAL 2023. [DOI: 10.1016/j.pdj.2023.01.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/21/2023]
|
36
|
Ji-An L, Stefanini F, Benna MK, Fusi S, La Porta CA. Face familiarity detection with complex synapses. iScience 2022; 26:105856. [PMID: 36636347 PMCID: PMC9829748 DOI: 10.1016/j.isci.2022.105856] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2022] [Revised: 11/30/2022] [Accepted: 12/16/2022] [Indexed: 12/24/2022] Open
Abstract
Synaptic plasticity is a complex phenomenon involving multiple biochemical processes that operate on different timescales. Complexity can greatly increase memory capacity when the variables characterizing the synaptic dynamics have limited precision, as shown in simple memory retrieval problems involving random patterns. Here we turn to a real-world problem, face familiarity detection, and we show that synaptic complexity can be harnessed to store in memory a large number of faces that can be recognized at a later time. The number of recognizable faces grows almost linearly with the number of synapses and quadratically with the number of neurons. Complex synapses outperform simple ones characterized by a single variable, even when the total number of dynamical variables is matched. Complex and simple synapses have distinct signatures that are testable in experiments. Our results indicate that a system with complex synapses can be used in real-world tasks such as face familiarity detection.
Collapse
Affiliation(s)
- Li Ji-An
- Zuckerman Institute, Columbia University, New York, NY 10027, USA,Neurosciences Graduate Program, University of California San Diego, La Jolla, CA 92093, USA
| | - Fabio Stefanini
- Zuckerman Institute, Columbia University, New York, NY 10027, USA
| | - Marcus K. Benna
- Zuckerman Institute, Columbia University, New York, NY 10027, USA,Department of Neurobiology, School of Biological Sciences, University of California San Diego, La Jolla, CA 92093, USA,Corresponding author
| | - Stefano Fusi
- Zuckerman Institute, Columbia University, New York, NY 10027, USA,Corresponding author
| | | |
Collapse
|
37
|
Goujon A, Mathy F, Thorpe S. The fate of visual long term memories for images across weeks in adults and children. Sci Rep 2022; 12:21763. [PMID: 36526824 PMCID: PMC9758234 DOI: 10.1038/s41598-022-26002-7] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2022] [Accepted: 12/07/2022] [Indexed: 12/23/2022] Open
Abstract
What is the content and the format of visual memories in Long Term Memory (LTM)? Is it similar in adults and children? To address these issues, we investigated, in both adults and 9-year-old children, how visual LTM is affected over time and whether visual vs semantic features are affected differentially. In a learning phase, participants were exposed to hundreds of meaningless and meaningful images presented once or twice for either 120 ms or 1920 ms. Memory was assessed using a recognition task either immediately after learning or after a delay of three or six weeks. The results suggest that multiple and extended exposures are crucial for retaining an image for several weeks. Although a benefit was observed in the meaningful condition when memory was assessed immediately after learning, this benefit tended to disappear over weeks, especially when the images were presented twice for 1920 ms. This pattern was observed for both adults and children. Together, the results call into question the dominant models of LTM for images: although semantic information enhances the encoding & maintaining of images in LTM when assessed immediately, this seems not critical for LTM over weeks.
Collapse
Affiliation(s)
- Annabelle Goujon
- Laboratoire de Recherches Intégratives en Neurosciences et Psychologie Cognitive UR 481, Université de Franche-Comté, 19 rue Ambroise Paré, 25030, Besançon, Cedex, France.
| | - Fabien Mathy
- Laboratory BCL CNRS UMR 7320 & Université Côte d'Azur, Nice, France
| | - Simon Thorpe
- CerCo-CNRS & Université de Toulouse 3, Toulouse, France
| |
Collapse
|
38
|
Luo T, Tian M. Chunking in Visual Working Memory: Are Visual Features of Real-World Objects Stored in Chunks? Percept Mot Skills 2022; 129:1641-1657. [PMID: 35968723 DOI: 10.1177/00315125221121228] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Are visual features of real-world objects stored as bound units? Previous research has shown that simple visual features (e.g., colored squares or geometric shapes) can be effectively bound together when forming predictable pairs in memory tasks. Through a "memory compression" process, observers can take advantage of these features to compress them into a chunk. However, a recent study found that visual features in real-world objects are stored independently. In the present study, we explored this issue by using drawings of fruits as memory stimuli, presenting four pictures of fruit in separate test trials in which we required observers to remember eight total features (i.e., four colors and four shapes). In the congruent trials, the color of the fruit matched its natural appearance (e.g., a red apple), while in incongruent trials, the color of the fruit mismatched its natural appearance (e.g., a red banana). We paired the shape of the fruits randomly with a color (without replacement). According to chunking theory, if visual features of real-world objects are stored in a chunk, the highest memory capacity should be accompanied by the longest response time in congruent trials due to an extra decoding process required from the chunk. We did find that participants had the highest memory capacity in the congruent condition, but their response times in the congruent condition were significantly faster than in the incongruent condition. Thus, observers did not undergo a decoding process in the congruent condition, and we concluded that visual features in real-world objects are not stored in a chunk.
Collapse
Affiliation(s)
- Tianrui Luo
- Department of Psychology, 26451The Chinese University of Hong Kong, Hong Kong, PR China
| | - Mi Tian
- School of Education Science, 12534Nanjing Normal University, Nanjing, PR China
| |
Collapse
|
39
|
Kirmsse A, Zimmer HD, Ecker UKH. Task Demands Differentially Affect Processing of Intrinsic and Extrinsic Object Features in Working Memory. Exp Psychol 2022; 69:320-334. [PMID: 36809157 DOI: 10.1027/1618-3169/a000572] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/23/2023]
Abstract
Some argue that visual working memory operates on integrated object representations. Here, we contend that obligatory feature integration occurs with intrinsic but not extrinsic object features. Working memory for shapes and colors was assessed using a change-detection task with a central test probe, while recording event-related potentials (ERPs). Color was either an intrinsic surface feature of a shape or connected to the shape via a proximal but spatially disjunct extrinsic frame. There were two types of test: The direct test required memory for shape and color; the indirect test required only shape memory. Study-test changes of color were therefore either task-relevant or task-irrelevant. We assessed performance costs and event-related potential (ERP) effects arising from color changes. In the direct test, performance was poorer for extrinsic than intrinsic stimuli; task-relevant color changes elicited enhanced frontal negativity (N2, FN400) for both intrinsic and extrinsic stimuli. In the indirect test, performance costs and ERP effects associated with irrelevant color change were larger for intrinsic than extrinsic stimuli. This suggests intrinsic information is more readily integrated into the working-memory representation and evaluated against the test probe. Findings imply that feature integration is not obligatory under all conditions but influenced by stimulus-driven and task-related focus of attention.
Collapse
Affiliation(s)
- Alexander Kirmsse
- Department of Psychology, Brain and Cognition Unit, Saarland University
| | - Hubert D Zimmer
- Department of Psychology, Brain and Cognition Unit, Saarland University
| | | |
Collapse
|
40
|
Object-based visual working memory: an object benefit for equidistant memory items presented within simple contours. PSYCHOLOGICAL RESEARCH 2022; 87:1569-1589. [DOI: 10.1007/s00426-022-01757-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2022] [Accepted: 10/19/2022] [Indexed: 11/25/2022]
Abstract
AbstractPrevious research has shown that more information can be stored in visual working memory (VWM) when multiple items belong to the same object. Here, in four experiments, we investigated the object effect on memory for spatially equidistant features by manipulating simple, task-irrelevant contours that combined these features. In Experiments 1, 3, and, 4, three grating orientations, and in Experiment 2, one color and two orientations, were presented simultaneously to be memorized. Mixture modeling was applied to estimate both the precision and the guess rates of recall errors. Overall results showed that two target features were remembered more accurately when both were part of the same object. Further analysis showed that the probability of recall increased in particular when both features were extracted from the same object. In Experiment 2, we found that the object effect was greater for features from orthogonal dimensions, but this came at the cost of lower memory precision. In Experiment 3, when we kept the locations of the features perfectly consistent over trials so that the participants could attend to these locations rather than the contour, we still found object benefits. Finally, in Experiment 4 when we manipulated the temporal order of the object and the memory features presentations, it was confirmed that the object benefit is unlikely to stem from the strategical usage of object information. These results suggested that the object benefit arises automatically, likely at an early perceptual level.
Collapse
|
41
|
Chunharas C, Rademaker RL, Brady TF, Serences JT. An adaptive perspective on visual working memory distortions. J Exp Psychol Gen 2022; 151:2300-2323. [PMID: 35191726 PMCID: PMC9392817 DOI: 10.1037/xge0001191] [Citation(s) in RCA: 18] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/06/2023]
Abstract
When holding multiple items in visual working memory, representations of individual items are often attracted to, or repelled from, each other. While this is empirically well-established, existing frameworks do not account for both types of distortions, which appear to be in opposition. Here, we demonstrate that both types of memory distortion may confer functional benefits under different circumstances. When there are many items to remember and subjects are near their capacity to accurately remember each item individually, memories for each item become more similar (attraction). However, when remembering smaller sets of highly similar but discernible items, memory for each item becomes more distinct (repulsion), possibly to support better discrimination. Importantly, this repulsion grows stronger with longer delays, suggesting that it dynamically evolves in memory and is not just a differentiation process that occurs during encoding. Furthermore, both attraction and repulsion occur even in tasks designed to mitigate response bias concerns, suggesting they are genuine changes in memory representations. Together, these results are in line with the theory that attraction biases act to stabilize memory signals by capitalizing on information about an entire group of items, whereas repulsion biases reflect a tradeoff between maintaining accurate but distinct representations. Both biases suggest that human memory systems may sacrifice veridical representations in favor of representations that better support specific behavioral goals. (PsycInfo Database Record (c) 2022 APA, all rights reserved).
Collapse
Affiliation(s)
- Chaipat Chunharas
- Department of Psychology, University of California San Diego, La Jolla, California, USA
- Department of Medicine, King Chulalongkorn Memorial Hospital, Chulalongkorn University, Bangkok, Thailand
- Chulalongkorn Cognitive, Clinical & Computational Neuroscience research group, Chulalongkorn University, Bangkok, Thailand
| | - Rosanne L. Rademaker
- Department of Psychology, University of California San Diego, La Jolla, California, USA
- Ernst Strüngmann Institute for Neuroscience in cooperation with the Max Planck Society, Frankfurt, Germany
| | - Timothy F. Brady
- Department of Psychology, University of California San Diego, La Jolla, California, USA
| | - John T. Serences
- Department of Psychology, University of California San Diego, La Jolla, California, USA
- Neurosciences Graduate Program, University of California San Diego, La Jolla, California, USA
- Kavli Institute for Brain and Mind, University of California, San Diego, La Jolla, California, USA
| |
Collapse
|
42
|
Chiou SC. Effects of spatiotemporal (dis)continuity on working memory for human movements. Acta Psychol (Amst) 2022; 230:103719. [PMID: 36027709 DOI: 10.1016/j.actpsy.2022.103719] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2022] [Revised: 07/20/2022] [Accepted: 08/18/2022] [Indexed: 12/01/2022] Open
Abstract
Human movements are dynamic and continuous in nature. However, how the spatiotemporal continuity influences working memory for movements is still unclear. Specifically, spatiotemporal continuity of movements may facilitate integrative processing ("integration") and enhance memory performance by optimizing the encoding process, but it may also diminish memory benefits from distinctive processing ("separation"). In this study, we manipulated the continuity state (continuous/discontinuous) (Experiment 1) and its predictability (Experiment 2) of whole-body movement sequences and tested participants' working memory for observed movements with a single-probe recognition task. We formulated potential influence from spatiotemporal (dis)continuity by two opposite forces - integration vs. separation, and demonstrated a conflict between these two processes across space and time. Moreover, we found that the seemingly stimulus-driven perceptual effects from spatiotemporal (dis)continuity might be supported by a prediction-based mechanism, which guided the selection of an optimal processing strategy. Overall, our finding illustrates an interweaving relationship between spatial and temporal processing during action observation and highlights the importance of considering the dynamic and continuous nature of human movements in visual perception and working memory research.
Collapse
Affiliation(s)
- Shiau-Chuen Chiou
- Neurocognition and Action Research Group, Center for Cognitive Interaction Technology (CITEC), Bielefeld University, Bielefeld, Germany; Faculty of Psychology and Sports Science, Bielefeld University, Bielefeld, Germany.
| |
Collapse
|
43
|
Chuderski A. Fluid Intelligence Emerges from Representing Relations. J Intell 2022; 10:51. [PMID: 35997406 PMCID: PMC9396997 DOI: 10.3390/jintelligence10030051] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2022] [Revised: 06/21/2022] [Accepted: 07/27/2022] [Indexed: 02/04/2023] Open
Abstract
Based on recent findings in cognitive neuroscience and psychology as well as computational models of working memory and reasoning, I argue that fluid intelligence (fluid reasoning) can amount to representing in the mind the key relation(s) for the task at hand. Effective representation of relations allows for enormous flexibility of thinking but depends on the validity and robustness of the dynamic patterns of argument-object (role-filler) bindings, which encode relations in the brain. Such a reconceptualization of the fluid intelligence construct allows for the simplification and purification of its models, tests, and potential brain mechanisms.
Collapse
Affiliation(s)
- Adam Chuderski
- Cognitive Science Department, Institute of Philosophy, Jagiellonian Univeristy in Krakow, PL-31007 Kraków, Poland
| |
Collapse
|
44
|
Printzlau FAB, Myers NE, Manohar SG, Stokes MG. Neural Reinstatement Tracks Spread of Attention between Object Features in Working Memory. J Cogn Neurosci 2022; 34:1681-1701. [PMID: 35704549 DOI: 10.1162/jocn_a_01879] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Attention can be allocated in working memory (WM) to select and privilege relevant content. It is unclear whether attention selects individual features or whole objects in WM. Here, we used behavioral measures, eye-tracking, and EEG to test the hypothesis that attention spreads between an object's features in WM. Twenty-six participants completed a WM task that asked them to recall the angle of one of two oriented, colored bars after a delay while EEG and eye-tracking data were collected. During the delay, an orthogonal "incidental task" cued the color of one item for a match/mismatch judgment. On congruent trials (50%), the cued item was probed for subsequent orientation recall; on incongruent trials (50%), the other memory item was probed. As predicted, selecting the color of an object in WM brought other features of the cued object into an attended state as revealed by EEG decoding, oscillatory α-power, gaze bias, and improved orientation recall performance. Together, the results show that attentional selection spreads between an object's features in WM, consistent with object-based attentional selection. Analyses of neural processing at recall revealed that the selected object was automatically compared with the probe, whether it was the target for recall or not. This provides a potential mechanism for the observed benefits of nonpredictive cueing in WM, where a selected item is prioritized for subsequent decision-making.
Collapse
|
45
|
Liu B, Li X, Theeuwes J, Wang B. Long-term memory retrieval bypasses working memory. Neuroimage 2022; 261:119513. [PMID: 35882271 DOI: 10.1016/j.neuroimage.2022.119513] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2022] [Revised: 07/13/2022] [Accepted: 07/22/2022] [Indexed: 10/31/2022] Open
Abstract
For decades, it has been assumed that when humans retrieve information from long-term memory (LTM), information need first to be brought back into working memory (WM). However, as WM capacity is limited, it is unclear what happens if information from LTM needs to be retrieved while WM is fully engaged? To address this question, observers had to retrieve colors from LTM while WM storage capacity was fully engaged. The behavioral results showed that retrieving information from LTM is possible even when WM capacity is fully occupied. Additional evidence from electroencephalogram (EEG) confirmed that WM was fully engaged as the suppression of alpha oscillation reached its maximum when memorizing the maximum amount of information into WM; yet the suppression in alpha oscillation was even further amplified when items were retrieved simultaneously from LTM, providing a neural signature of additional LTM retrieval capacity above and beyond the maximum WM capacity. Together, our findings indicate that information retrieved from LTM does not always have to be brought back into WM, but instead might be accessed through a different mechanism when WM is fully engaged.
Collapse
Affiliation(s)
- Baiwei Liu
- Department of Psychology, Zhejiang Normal University, Jinhua, China; Department of Experimental and Applied Psychology, Vrije Universiteit, Amsterdam, the Netherlands.
| | - Xinyu Li
- Department of Psychology, Zhejiang Normal University, Jinhua, China
| | - Jan Theeuwes
- Department of Experimental and Applied Psychology, Vrije Universiteit, Amsterdam, the Netherlands
| | - Benchi Wang
- Key Laboratory of Brain, Cognition and Education Sciences (South China Normal University), Ministry of Education, China; Institute for Brain Research and Rehabilitation, South China Normal University, China; Center for Studies of Psychological Application, South China Normal University, China; Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, China.
| |
Collapse
|
46
|
Shin S, Park H. The effect of non-verbal working memory on graphic symbol selection. Augment Altern Commun 2022; 38:82-90. [PMID: 35730127 DOI: 10.1080/07434618.2022.2086909] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022] Open
Abstract
To identify the relationship between non-verbal working memory and graphic symbol selection, this study examined whether the response time to select target symbols in a sentence construction task differed between two groups: a high non-verbal working memory group and a low non-verbal working memory group. The interaction effect between non-verbal working memory skills and the degree of exposure to graphic symbols was also examined. Thirty-two non-disabled young adults participated in this study. Based on the quartile of the participants' scores on the non-verbal working memory task (i.e., the backward matrix task), data were selected from the sentence construction task completed by seven participants who belonged to the 25%ile and less and seven who belonged to the 75%ile and more; these data were used to examine group differences. A Mann-Whitney U test showed that non-verbal working memory skills had a significant effect on graphic symbol selection, as the high non-verbal working memory group combined three symbols faster than did the low memory group. No significant interaction effect was found between non-verbal working memory skills and the degree of exposure to symbols. The theoretical and clinical implications of the research findings are discussed.
Collapse
Affiliation(s)
- Sangeun Shin
- Department of Speech-Language Pathology, Chungnam National University, Daejeon, South Korea
| | - HyunJu Park
- Division of Speech-Language Pathology, Gachon University, Seongnam, South Korea
| |
Collapse
|
47
|
Valenzo D, Ciria A, Schillaci G, Lara B. Grounding Context in Embodied Cognitive Robotics. Front Neurorobot 2022; 16:843108. [PMID: 35812785 PMCID: PMC9262126 DOI: 10.3389/fnbot.2022.843108] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/24/2021] [Accepted: 05/10/2022] [Indexed: 11/13/2022] Open
Abstract
Biological agents are context-dependent systems that exhibit behavioral flexibility. The internal and external information agents process, their actions, and emotions are all grounded in the context within which they are situated. However, in the field of cognitive robotics, the concept of context is far from being clear with most studies making little to no reference to it. The aim of this paper is to provide an interpretation of the notion of context and its core elements based on different studies in natural agents, and how these core contextual elements have been modeled in cognitive robotics, to introduce a new hypothesis about the interactions between these contextual elements. Here, global context is categorized as agent-related, environmental, and task-related context. The interaction of their core elements, allows agents to first select self-relevant tasks depending on their current needs, or for learning and mastering their environment through exploration. Second, to perform a task and continuously monitor its performance. Third, to abandon a task in case its execution is not going as expected. Here, the monitoring of prediction error, the difference between sensorimotor predictions and incoming sensory information, is at the core of behavioral flexibility during situated action cycles. Additionally, monitoring prediction error dynamics and its comparison with the expected reduction rate should indicate the agent its overall performance on executing the task. Sensitivity to performance evokes emotions that function as the driving element for autonomous behavior which, at the same time, depends on the processing of the interacting core elements. Taking all these into account, an interactionist model of contexts and their core elements is proposed. The model is embodied, affective, and situated, by means of the processing of the agent-related and environmental core contextual elements. Additionally, it is grounded in the processing of the task-related context and the associated situated action cycles during task execution. Finally, the model proposed here aims to guide how artificial agents should process the core contextual elements of the agent-related and environmental context to give rise to the task-related context, allowing agents to autonomously select a task, its planning, execution, and monitoring for behavioral flexibility.
Collapse
Affiliation(s)
- Diana Valenzo
- Laboratorio de Robótica Cognitiva, Centro de Investigación en Ciencias, Universidad Autónoma del Estado de Morelos, Cuernavaca, Mexico
| | - Alejandra Ciria
- Facultad de Psicología, Universidad Nacional Autónoma de México, Mexico City, Mexico
| | | | - Bruno Lara
- Laboratorio de Robótica Cognitiva, Centro de Investigación en Ciencias, Universidad Autónoma del Estado de Morelos, Cuernavaca, Mexico
| |
Collapse
|
48
|
Collins T. Serial dependence tracks objects and scenes in parallel and independently. J Vis 2022; 22:4. [PMID: 35687353 PMCID: PMC9202337 DOI: 10.1167/jov.22.7.4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
The visual world is made up of objects and scenes. Object perception requires both discriminating an individual object from others and binding together different perceptual samples of that object across time. Such binding manifests by serial dependence, the attraction of the current perception of a visual attribute toward values of that attribute seen in the recent past. Scene perception is subserved by global mechanisms such as ensemble perception, the rapid extraction of the average feature value of a group of objects. The current study examined to what extent the perception of single objects in multi-object scenes depended on previous feature values of that object or on the average previous attribute of all objects in the ensemble. Results show that serial dependence occurs independently on two simultaneously present objects, that ensemble perception depends only on previous ensembles, and that serial dependence of an individual object occurs only for the features of that particular object. These results suggest that the temporal integration of successive perceptual samples operates simultaneously at independent levels of visual processing.
Collapse
Affiliation(s)
- Thérèse Collins
- Integrative Neuroscience and Cognition Center, University of Paris and CNRS, Paris, France.,
| |
Collapse
|
49
|
Stapel J, El Hassnaoui M, Happee R. Measuring Driver Perception: Combining Eye-Tracking and Automated Road Scene Perception. HUMAN FACTORS 2022; 64:714-731. [PMID: 32993382 PMCID: PMC9136390 DOI: 10.1177/0018720820959958] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/14/2023]
Abstract
OBJECTIVE To investigate how well gaze behavior can indicate driver awareness of individual road users when related to the vehicle's road scene perception. BACKGROUND An appropriate method is required to identify how driver gaze reveals awareness of other road users. METHOD We developed a recognition-based method for labeling of driver situation awareness (SA) in a vehicle with road-scene perception and eye tracking. Thirteen drivers performed 91 left turns on complex urban intersections and identified images of encountered road users among distractor images. RESULTS Drivers fixated within 2° for 72.8% of relevant and 27.8% of irrelevant road users and were able to recognize 36.1% of the relevant and 19.4% of irrelevant road users one min after leaving the intersection. Gaze behavior could predict road user relevance but not the outcome of the recognition task. Unexpectedly, 18% of road users observed beyond 10° were recognized. CONCLUSIONS Despite suboptimal psychometric properties leading to low recognition rates, our recognition task could identify awareness of individual road users during left turn maneuvers. Perception occurred at gaze angles well beyond 2°, which means that fixation locations are insufficient for awareness monitoring. APPLICATION Findings can be used in driver attention and awareness modelling, and design of gaze-based driver support systems.
Collapse
Affiliation(s)
- Jork Stapel
- Delft University of Technology, Netherlands
- Jork Stapel, Faculty of Mechanical Maritime and Materials Engineering, Delft University of Technology, Mekelweg 2Delft, 2628 CD, Netherlands;
| | | | | |
Collapse
|
50
|
Prieto A, Peinado V, Mayas J. Does perceptual grouping improve visuospatial working memory? Optimized processing or encoding bias. PSYCHOLOGICAL RESEARCH 2022; 86:1297-1309. [PMID: 34236493 PMCID: PMC9090850 DOI: 10.1007/s00426-021-01555-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2020] [Accepted: 06/28/2021] [Indexed: 11/09/2022]
Abstract
Visual working memory has been defined as a system of limited capacity that enables the maintenance and manipulation of visual information. However, some perceptual features like Gestalt grouping could improve visual working memory effectiveness. In two different experiments, we aimed to explore how the presence of elements grouped by color similarity affects the change detection performance of both, grouped and non-grouped items. We combined a change detection task with a retrocue paradigm in which a six item array had to be remembered. An always valid, variable-delay retrocue appeared in some trials during the retention interval, either after 100 ms (iconic-trace period) or 1400 ms (working memory period), signaling the location of the probe. The results indicated that similarity grouping biased the information entered into the visual working memory, improving change detection accuracy only for previously grouped probes, but hindering change detection for non-grouped probes in certain conditions (Exp. 1). However, this bottom-up automatic encoding bias was overridden when participants were explicitly instructed to ignore grouped items as they were irrelevant for the task (Exp. 2).
Collapse
Affiliation(s)
- Antonio Prieto
- Department of Basic Psychology I, Universidad Nacional de Educación a Distancia, C/Juan del Rosal, 10, 28040, Madrid, Madrid, Spain.
| | - Vanesa Peinado
- Department of Personality, Evaluation and Clinical Psychology, Universidad Complutense de Madrid, Campus Somosaguas, 28223, Pozuelo de Alarcón , Madrid, Spain.
| | - Julia Mayas
- Department of Basic Psychology II, Universidad Nacional de Educación a Distancia, C/Juan del Rosal, 10, 28040, Madrid, Madrid, Spain.
| |
Collapse
|