1
|
Abbaspoor S, Hoffman KL. Circuit dynamics of superficial and deep CA1 pyramidal cells and inhibitory cells in freely moving macaques. Cell Rep 2024; 43:114519. [PMID: 39018243 DOI: 10.1016/j.celrep.2024.114519] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2024] [Revised: 05/23/2024] [Accepted: 07/02/2024] [Indexed: 07/19/2024] Open
Abstract
Diverse neuron classes in hippocampal CA1 have been identified through the heterogeneity of their cellular/molecular composition. How these classes relate to hippocampal function and the network dynamics that support cognition in primates remains unclear. Here, we report inhibitory functional cell groups in CA1 of freely moving macaques whose diverse response profiles to network states and each other suggest distinct and specific roles in the functional microcircuit of CA1. In addition, pyramidal cells that were grouped by their superficial or deep layer position differed in firing rate, burstiness, and sharp-wave ripple-associated firing. They also showed strata-specific spike-timing interactions with inhibitory cell groups, suggestive of segregated neural populations. Furthermore, ensemble recordings revealed that cell assemblies were preferentially organized according to these strata. These results suggest that hippocampal CA1 in freely moving macaques bears a sublayer-specific circuit organization that may shape its role in cognition.
Collapse
Affiliation(s)
- Saman Abbaspoor
- Department of Psychology, Vanderbilt Vision Research Center, Vanderbilt Brain Institute, Vanderbilt University, Nashville, TN, USA.
| | - Kari L Hoffman
- Department of Psychology, Vanderbilt Vision Research Center, Vanderbilt Brain Institute, Vanderbilt University, Nashville, TN, USA; Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, USA.
| |
Collapse
|
2
|
Wynn JS, Schacter DL. Eye movements reinstate remembered locations during episodic simulation. Cognition 2024; 248:105807. [PMID: 38688077 DOI: 10.1016/j.cognition.2024.105807] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2023] [Revised: 03/04/2024] [Accepted: 04/25/2024] [Indexed: 05/02/2024]
Abstract
Imagining the future, like recalling the past, relies on the ability to retrieve and imagine a spatial context. Research suggests that eye movements support this process by reactivating spatial contextual details from memory, a process termed gaze reinstatement. While gaze reinstatement has been linked to successful memory retrieval, it remains unclear whether it supports the related process of future simulation. In the present study, we recorded both eye movements and audio while participants described familiar locations from memory and subsequently imagined future events occurring in those locations while either freely moving their eyes or maintaining central fixation. Restricting viewing during simulation significantly reduced self-reported vividness ratings, supporting a critical role for eye movements in simulation. When viewing was unrestricted, participants spontaneously reinstated gaze patterns specific to the simulated location, replicating findings of gaze reinstatement during memory retrieval. Finally, gaze-based location reinstatement was predictive of simulation success, indexed by the number of internal (episodic) details produced, with both measures peaking early and co-varying over time. Together, these findings suggest that the same oculomotor processes that support episodic memory retrieval - that is, gaze-based reinstatement of spatial context - also support episodic simulation.
Collapse
Affiliation(s)
- Jordana S Wynn
- Department of Psychology, University of Victoria, Victoria, Canada.
| | | |
Collapse
|
3
|
Lin Q, Li Z, Lafferty J, Yildirim I. Images with harder-to-reconstruct visual representations leave stronger memory traces. Nat Hum Behav 2024:10.1038/s41562-024-01870-3. [PMID: 38740989 DOI: 10.1038/s41562-024-01870-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2023] [Accepted: 03/19/2024] [Indexed: 05/16/2024]
Abstract
Much of what we remember is not because of intentional selection, but simply a by-product of perceiving. This raises a foundational question about the architecture of the mind: how does perception interface with and influence memory? Here, inspired by a classic proposal relating perceptual processing to memory durability, the level-of-processing theory, we present a sparse coding model for compressing feature embeddings of images, and show that the reconstruction residuals from this model predict how well images are encoded into memory. In an open memorability dataset of scene images, we show that reconstruction error not only explains memory accuracy, but also response latencies during retrieval, subsuming, in the latter case, all of the variance explained by powerful vision-only models. We also confirm a prediction of this account with 'model-driven psychophysics'. This work establishes reconstruction error as an important signal interfacing perception and memory, possibly through adaptive modulation of perceptual processing.
Collapse
Affiliation(s)
- Qi Lin
- Department of Psychology, Yale University, New Haven, CT, USA.
- Center for Brain Science, RIKEN, Wako, Japan.
| | - Zifan Li
- Department of Statistics & Data Science, Yale University, New Haven, CT, USA
| | - John Lafferty
- Department of Statistics & Data Science, Yale University, New Haven, CT, USA.
- Wu-Tsai Institute, Yale University, New Haven, CT, USA.
| | - Ilker Yildirim
- Department of Psychology, Yale University, New Haven, CT, USA.
- Department of Statistics & Data Science, Yale University, New Haven, CT, USA.
- Wu-Tsai Institute, Yale University, New Haven, CT, USA.
| |
Collapse
|
4
|
Conti F, Carnemolla S, Piguet O, Irish M. Scene construction in healthy aging - Exploring the interplay between task complexity and oculomotor behaviour. Brain Cogn 2024; 177:106163. [PMID: 38685168 DOI: 10.1016/j.bandc.2024.106163] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2024] [Revised: 04/18/2024] [Accepted: 04/18/2024] [Indexed: 05/02/2024]
Abstract
Mounting evidence indicates a close correspondence between episodic memory, mental imagery, and oculomotor behaviour. It remains unclear, however, how oculomotor variables support endogenously driven forms of mental imagery and how this relationship changes across the adult lifespan. In this study we investigated age-related changes in oculomotor signatures during scene construction and explored how task complexity impacts these processes. Younger and cognitively healthy older participants completed a guided scene construction paradigm where scene complexity was manipulated according to the number of elements to be sequentially integrated. We recorded participants' eye movements and collected subjective ratings regarding their phenomenological experience. Overall, older adults rated their constructions as more vivid and more spatially integrated, while also generating more fixations and saccades relative to the younger group, specifically on control trials. Analyses of participants' total scan paths revealed that, in the early stages of scene construction, oculomotor behaviour changed as a function of task complexity within each group. Following the introduction of a second stimulus, older but not younger adults showed a significant decrease in the production of eye movements. Whether this shift in oculomotor behaviour serves a compensatory function to bolster task performance represents an important question for future research.
Collapse
Affiliation(s)
- Federica Conti
- The University of Sydney, Brain and Mind Centre, Sydney, New South Wales, Australia; The University of Sydney, School of Psychology, Sydney, New South Wales, Australia
| | - Sarah Carnemolla
- The University of Sydney, Brain and Mind Centre, Sydney, New South Wales, Australia; The University of Sydney, School of Psychology, Sydney, New South Wales, Australia
| | - Olivier Piguet
- The University of Sydney, Brain and Mind Centre, Sydney, New South Wales, Australia; The University of Sydney, School of Psychology, Sydney, New South Wales, Australia
| | - Muireann Irish
- The University of Sydney, Brain and Mind Centre, Sydney, New South Wales, Australia; The University of Sydney, School of Psychology, Sydney, New South Wales, Australia.
| |
Collapse
|
5
|
Rosenbaum RS, Halilova JG, Agnihotri S, D'Angelo MC, Winocur G, Ryan JD, Moscovitch M. Dramatic changes to well-known places go unnoticed. Neuropsychologia 2024; 196:108818. [PMID: 38355037 DOI: 10.1016/j.neuropsychologia.2024.108818] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2024] [Accepted: 02/05/2024] [Indexed: 02/16/2024]
Abstract
How well do we know our city? It turns out, much more poorly than we might imagine. We used declarative memory and eye-tracking techniques to examine people's ability to detect modifications to real-world landmarks and scenes in Toronto locales with which they have had extensive experience. Participants were poor at identifying which scenes contained altered landmarks, whether the modification was to the landmarks' relative size, internal features, or relation to surrounding context. To determine whether an indirect measure would prove more sensitive, we tracked eye movements during viewing. Changes in overall visual exploration, but not to specific regions of change, were related to participants' explicit endorsement of scenes as modified. These results support the contention that very familiar landmarks are represented at a global or gist level, but not local or fine-grained, level. These findings offer a unified view of memory for gist across verbal and spatial domains, and across recent and remote memory, with implications for hippocampal-neocortical interactions.
Collapse
Affiliation(s)
- R S Rosenbaum
- York University, Toronto, ON, Canada; Rotman Research Institute, Baycrest, Toronto, ON, Canada.
| | | | - S Agnihotri
- York University, Toronto, ON, Canada; University of Toronto, ON, Canada
| | - M C D'Angelo
- Rotman Research Institute, Baycrest, Toronto, ON, Canada
| | - G Winocur
- Rotman Research Institute, Baycrest, Toronto, ON, Canada
| | - J D Ryan
- Rotman Research Institute, Baycrest, Toronto, ON, Canada; University of Toronto, ON, Canada
| | - M Moscovitch
- Rotman Research Institute, Baycrest, Toronto, ON, Canada; University of Toronto, ON, Canada
| |
Collapse
|
6
|
Yonelinas AP. The role of recollection and familiarity in visual working memory: A mixture of threshold and signal detection processes. Psychol Rev 2024; 131:321-348. [PMID: 37326544 PMCID: PMC11089539 DOI: 10.1037/rev0000432] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/17/2023]
Abstract
Whether working memory reflects a thresholded recollection process whereby only a limited number of items are maintained in memory, or a signal detection process in which each studied item is increased in familiarity strength, is a topic of considerable debate. A review of visual working memory studies that have examined receiver operating characteristics (ROCs) across a broad set of materials and test conditions indicates that both signal detection and threshold processes contribute to working memory. In addition, the role that these two processes play varies systematically across conditions, such that a threshold process plays a particularly critical role when binary old/new judgments are required, when changes are relatively discrete, and when the hippocampus does not contribute to performance. In contrast, a signal detection process plays a greater role when confidence judgments are required, when the materials or the changes are global in nature, and when the hippocampus contributes to performance. In addition, the ROC results indicate that in standard single-probe tests of working memory, items that are maintained in an active recollected state support both recall-to-accept and recall-to-reject responses; whereas in complex-probe tests, recollection preferentially supports recall-to-reject; and in item-recognition tests it preferentially supports recall-to-accept. Moreover, there is growing evidence that these threshold and strength-based processes are related to distinct states of conscious awareness whereby they support perceiving- and sensing-based responses, respectively. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Collapse
|
7
|
Nikolaev AR, Meghanathan RN, van Leeuwen C. Refixation behavior in naturalistic viewing: Methods, mechanisms, and neural correlates. Atten Percept Psychophys 2024:10.3758/s13414-023-02836-9. [PMID: 38169029 DOI: 10.3758/s13414-023-02836-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/17/2023] [Indexed: 01/05/2024]
Abstract
When freely viewing a scene, the eyes often return to previously visited locations. By tracking eye movements and coregistering eye movements and EEG, such refixations are shown to have multiple roles: repairing insufficient encoding from precursor fixations, supporting ongoing viewing by resampling relevant locations prioritized by precursor fixations, and aiding the construction of memory representations. All these functions of refixation behavior are understood to be underpinned by three oculomotor and cognitive systems and their associated brain structures. First, immediate saccade planning prior to refixations involves attentional selection of candidate locations to revisit. This process is likely supported by the dorsal attentional network. Second, visual working memory, involved in maintaining task-related information, is likely supported by the visual cortex. Third, higher-order relevance of scene locations, which depends on general knowledge and understanding of scene meaning, is likely supported by the hippocampal memory system. Working together, these structures bring about viewing behavior that balances exploring previously unvisited areas of a scene with exploiting visited areas through refixations.
Collapse
Affiliation(s)
- Andrey R Nikolaev
- Department of Psychology, Lund University, Box 213, 22100, Lund, Sweden.
- Brain & Cognition Research Unit, KU Leuven-University of Leuven, Leuven, Belgium.
| | | | - Cees van Leeuwen
- Brain & Cognition Research Unit, KU Leuven-University of Leuven, Leuven, Belgium
- Center for Cognitive Science, Rheinland-Pfälzische Technische Universität Kaiserslautern-Landau, Kaiserslautern, Germany
| |
Collapse
|
8
|
Favila SE, Aly M. Hippocampal mechanisms resolve competition in memory and perception. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.10.09.561548. [PMID: 37873400 PMCID: PMC10592663 DOI: 10.1101/2023.10.09.561548] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/25/2023]
Abstract
Behaving adaptively requires selection of relevant memories and sensations and suppression of competing ones. We hypothesized that these mechanisms are linked, such that hippocampal computations that resolve competition in memory also shape the precision of sensory representations to guide selective attention. We leveraged f MRI-based pattern similarity, receptive field modeling, and eye tracking to test this hypothesis in humans performing a memory-dependent visual search task. In the hippocampus, differentiation of competing memories predicted the precision of memory-guided eye movements. In visual cortex, preparatory coding of remembered target locations predicted search successes, whereas preparatory coding of competing locations predicted search failures due to interference. These effects were linked: stronger hippocampal memory differentiation was associated with lower competitor activation in visual cortex, yielding more precise preparatory representations. These results demonstrate a role for memory differentiation in shaping the precision of sensory representations, highlighting links between mechanisms that overcome competition in memory and perception.
Collapse
Affiliation(s)
- Serra E Favila
- Department of Psychology, Columbia University, New York, NY, 10027
| | - Mariam Aly
- Department of Psychology, Columbia University, New York, NY, 10027
| |
Collapse
|
9
|
Li AY, Yuan JY, Pun C, Barense MD. The effect of memory load on object reconstruction: Insights from an online mouse-tracking task. Atten Percept Psychophys 2023; 85:1612-1630. [PMID: 36600154 DOI: 10.3758/s13414-022-02650-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/20/2022] [Indexed: 01/05/2023]
Abstract
Why can't we remember everything that we experience? Previous work in the domain of object memory has suggested that our ability to resolve interference between relevant and irrelevant object features may limit how much we can remember at any given moment. Here, we developed an online mouse-tracking task to study how memory load influences object reconstruction, testing participants synchronously over virtual conference calls. We first tested up to 18 participants concurrently, replicating memory findings from a condition where participants were tested individually. Next, we examined how memory load influenced mouse trajectories as participants reconstructed target objects. We found interference between the contents of working memory and what was perceived during object reconstruction, an effect that interacted with visual similarity and memory load. Furthermore, we found interference from previously studied but currently irrelevant objects, providing evidence of object-to-location binding errors. At the greatest memory load, participants were nearly three times more likely to move their mouse cursor over previously studied nontarget objects, an effect observed primarily during object reconstruction rather than in the period before the final response. As evidence of the dynamic interplay between working memory and perception, these results show that object reconstruction behavior may be altered by (i) interference between what is represented in mind and what is currently being viewed, and (ii) interference from previously studied but currently irrelevant information. Finally, we discuss how mouse tracking can provide a rich characterization of participant behavior at millisecond temporal resolution, enormously increasing power in cognitive psychology experiments.
Collapse
Affiliation(s)
- Aedan Y Li
- Department of Psychology, University of Toronto, 100 St. George Street, Toronto, ON, M5S 3G3, Canada.
| | - James Y Yuan
- Department of Psychology, University of Toronto, 100 St. George Street, Toronto, ON, M5S 3G3, Canada.
| | - Carson Pun
- Department of Psychology, University of Toronto, 100 St. George Street, Toronto, ON, M5S 3G3, Canada
| | - Morgan D Barense
- Department of Psychology, University of Toronto, 100 St. George Street, Toronto, ON, M5S 3G3, Canada
| |
Collapse
|
10
|
Lucas HD, Daugherty AM, McAuley E, Kramer AF, Cohen NJ. Dynamic interactions between memory and viewing behaviors: Insights from dyadic modeling of eye movements. J Exp Psychol Hum Percept Perform 2023; 49:786-801. [PMID: 37166935 PMCID: PMC10621599 DOI: 10.1037/xhp0001123] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/12/2023]
Abstract
Humans use eye movements to build visual memories. We investigated how the contributions of specific viewing behaviors to memory formation evolve over individual study epochs. We used dyadic modeling to explain performance on a spatial reconstruction task based on interactions among two gaze measures: (a) the entropy of the scanpath and (b) the frequency of item-to-item gaze transitions. To measure these interactions, our hypothesized model included causal pathways by which early-trial viewing behaviors impacted subsequent memory via downstream effects on later viewing. We found that lower scanpath entropy throughout the trial predicted better memory performance. By contrast, the effect of item-to-item transition frequency changed from negative to positive as the trial progressed. The model also revealed multiple pathways by which early-trial viewing dynamically altered late-trial viewing, thereby impacting memory indirectly. Finally, individual differences in scores on an independent measure of memory ability were found to predict viewing effectiveness, and viewing behaviors partially mediated the relation between memory ability and reconstruction accuracy. In a second experiment, the model showed a good fit for an independent dataset. These results highlight the dynamic nature of memory formation and suggest that the order in which eye movements occur can critically determine their effectiveness. (PsycInfo Database Record (c) 2023 APA, all rights reserved).
Collapse
Affiliation(s)
- Heather D. Lucas
- Department of Psychology, Louisiana State University, Baton Rouge, LA, 70803, USA
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
| | - Ana M. Daugherty
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
- Department of Psychology and Institute of Gerontology, Wayne State University, Detroit, MI, 48202, USA
| | - Edward McAuley
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
- Department of Kinesiology and Community Health, University of Illinois at Urbana-Champaign, Urbana, IL, 61801, USA
| | - Arthur F. Kramer
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
- Center for Cognitive & Brain Health, Northeastern University, Boston, MA, 02115, USA
| | - Neal J. Cohen
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
- Department of Psychology, University of Illinois at Urbana-Champaign, Champaign, IL, 61820, USA
| |
Collapse
|
11
|
Talbot J, de la Salle S, Jaworska N. A Paradigm Shift in Trauma Treatment: Converging Evidence for a Novel Adaptation of Eye Movement Desensitization and Reprocessing (EMDR). CANADIAN JOURNAL OF PSYCHIATRY. REVUE CANADIENNE DE PSYCHIATRIE 2023; 68:283-285. [PMID: 36437585 PMCID: PMC10037741 DOI: 10.1177/07067437221142283] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Affiliation(s)
- Jeanne Talbot
- University of Ottawa Institute of Mental Health
Research, Ottawa, ON, Canada
- Department of Psychiatry, University of Ottawa, Ottawa, ON, Canada
| | - Sara de la Salle
- University of Ottawa Institute of Mental Health
Research, Ottawa, ON, Canada
| | - Natalia Jaworska
- University of Ottawa Institute of Mental Health
Research, Ottawa, ON, Canada
- Department of Cellular & Molecular Medicine, University of Ottawa, Ottawa, ON, Canada
| |
Collapse
|
12
|
Nikolaev AR, Bramão I, Johansson R, Johansson M. Episodic memory formation in unrestricted viewing. Neuroimage 2023; 266:119821. [PMID: 36535321 DOI: 10.1016/j.neuroimage.2022.119821] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2022] [Revised: 11/16/2022] [Accepted: 12/15/2022] [Indexed: 12/23/2022] Open
Abstract
The brain systems of episodic memory and oculomotor control are tightly linked, suggesting a crucial role of eye movements in memory. But little is known about the neural mechanisms of memory formation across eye movements in unrestricted viewing behavior. Here, we leverage simultaneous eye tracking and EEG recording to examine episodic memory formation in free viewing. Participants memorized multi-element events while their EEG and eye movements were concurrently recorded. Each event comprised elements from three categories (face, object, place), with two exemplars from each category, in different locations on the screen. A subsequent associative memory test assessed participants' memory for the between-category associations that specified each event. We used a deconvolution approach to overcome the problem of overlapping EEG responses to sequential saccades in free viewing. Brain activity was time-locked to the fixation onsets, and we examined EEG power in the theta and alpha frequency bands, the putative oscillatory correlates of episodic encoding mechanisms. Three modulations of fixation-related EEG predicted high subsequent memory performance: (1) theta increase at fixations after between-category gaze transitions, (2) theta and alpha increase at fixations after within-element gaze transitions, (3) alpha decrease at fixations after between-exemplar gaze transitions. Thus, event encoding with unrestricted viewing behavior was characterized by three neural mechanisms, manifested in fixation-locked theta and alpha EEG activity that rapidly turned on and off during the unfolding eye movement sequences. These three distinct neural mechanisms may be the essential building blocks that subserve the buildup of coherent episodic memories during unrestricted viewing behavior.
Collapse
Affiliation(s)
- Andrey R Nikolaev
- Department of Psychology, Lund Memory Lab, Lund University, Lund, Sweden; Brain and Cognition Research Unit, KU Leuven, Leuven, Belgium.
| | - Inês Bramão
- Department of Psychology, Lund Memory Lab, Lund University, Lund, Sweden
| | - Roger Johansson
- Department of Psychology, Lund Memory Lab, Lund University, Lund, Sweden
| | - Mikael Johansson
- Department of Psychology, Lund Memory Lab, Lund University, Lund, Sweden
| |
Collapse
|
13
|
Hussin AT, Abbaspoor S, Hoffman KL. Retrosplenial and Hippocampal Synchrony during Retrieval of Old Memories in Macaques. J Neurosci 2022; 42:7947-7956. [PMID: 36261267 PMCID: PMC9617609 DOI: 10.1523/jneurosci.0001-22.2022] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/01/2022] [Revised: 06/05/2022] [Accepted: 07/11/2022] [Indexed: 11/21/2022] Open
Abstract
Memory for events from the distant past relies on multiple brain regions, but little is known about the underlying neural dynamics that give rise to such abilities. We recorded neural activity in the hippocampus and retrosplenial cortex of two female rhesus macaques as they visually selected targets in year-old and newly acquired object-scene associations. Whereas hippocampal activity was unchanging with memory age, the retrosplenial cortex responded with greater magnitude alpha oscillations (10-15 Hz) and greater phase locking to memory-guided eye movements during retrieval of old events. A similar old-memory enhancement was observed in the anterior cingulate cortex but in a beta2/gamma band (28-35 Hz). In contrast, remote retrieval was associated with decreased gamma-band synchrony between the hippocampus and each neocortical area. The increasing retrosplenial alpha oscillation and decreasing hippocampocortical synchrony with memory age may signify a shift in frank memory allocation or, alternatively, changes in selection among distributed memory representations in the primate brain.SIGNIFICANCE STATEMENT Memory depends on multiple brain regions, whose involvement is thought to change with time. Here, we recorded neuronal population activity from the hippocampus and retrosplenial cortex as nonhuman primates searched for objects embedded in scenes. These memoranda were either newly presented or a year old. Remembering old material drove stronger oscillations in the retrosplenial cortex and led to a greater locking of neural activity to search movements. Remembering new material revealed stronger oscillatory synchrony between the hippocampus and retrosplenial cortex. These results suggest that with age, memories may come to rely more exclusively on neocortical oscillations for retrieval and search guidance and less on long-range coupling with the hippocampus.
Collapse
Affiliation(s)
- Ahmed T Hussin
- Department of Biology, Centre for Vision Research, York University, Toronto Ontario M3J 1P3, Canada
| | | | - Kari L Hoffman
- Department of Biology, Centre for Vision Research, York University, Toronto Ontario M3J 1P3, Canada
- Departments of Psychology
- Biomedical Engineering, Vanderbilt Vision Research Center, Vanderbilt Brain Institute, Vanderbilt University, Nashville, Tennessee 37240
| |
Collapse
|
14
|
Broers N, Bainbridge WA, Michel R, Balestrieri E, Busch NA. The extent and specificity of visual exploration determines the formation of recollected memories in complex scenes. J Vis 2022; 22:9. [PMID: 36227616 PMCID: PMC9583750 DOI: 10.1167/jov.22.11.9] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/02/2022] Open
Abstract
Our visual memories of complex scenes often appear as robust, detailed records of the past. Several studies have demonstrated that active exploration with eye movements improves recognition memory for scenes, but it is unclear whether this improvement is due to stronger feelings of familiarity or more detailed recollection. We related the extent and specificity of fixation patterns at encoding and retrieval to different recognition decisions in an incidental memory paradigm. After incidental encoding of 240 real-world scene photographs, participants (N = 44) answered a surprise memory test by reporting whether an image was new, remembered (indicating recollection), or just known to be old (indicating familiarity). To assess the specificity of their visual memories, we devised a novel report procedure in which participants selected the scene region that they specifically recollected, that appeared most familiar, or that was particularly new to them. At encoding, when considering the entire scene,subsequently recollected compared to familiar or forgotten scenes showed a larger number of fixations that were more broadly distributed, suggesting that more extensive visual exploration determines stronger and more detailed memories. However, when considering only the memory-relevant image areas, fixations were more dense and more clustered for subsequently recollected compared to subsequently familiar scenes. At retrieval, the extent of visual exploration was more restricted for recollected compared to new or forgotten scenes, with a smaller number of fixations. Importantly, fixation density and clustering was greater in memory-relevant areas for recollected versus familiar or falsely recognized images. Our findings suggest that more extensive visual exploration across the entire scene, with a subset of more focal and dense fixations in specific image areas, leads to increased potential for recollecting specific image aspects.
Collapse
Affiliation(s)
- Nico Broers
- Institute of Psychology, University of Münster, Münster, Germany.,Otto-Creutzfeldt-Center for Cognitive and Behavioral Neuroscience, University of Münster, Münster, Germany.,
| | | | - René Michel
- Institute of Psychology, University of Münster, Münster, Germany.,Otto-Creutzfeldt-Center for Cognitive and Behavioral Neuroscience, University of Münster, Münster, Germany.,
| | - Elio Balestrieri
- Institute of Psychology, University of Münster, Münster, Germany.,Otto-Creutzfeldt-Center for Cognitive and Behavioral Neuroscience, University of Münster, Münster, Germany.,
| | - Niko A Busch
- Institute of Psychology, University of Münster, Münster, Germany.,Otto-Creutzfeldt-Center for Cognitive and Behavioral Neuroscience, University of Münster, Münster, Germany.,
| |
Collapse
|
15
|
Unrestricted eye movements strengthen effective connectivity from hippocampal to oculomotor regions during scene construction. Neuroimage 2022; 260:119497. [PMID: 35870699 DOI: 10.1016/j.neuroimage.2022.119497] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2022] [Revised: 07/01/2022] [Accepted: 07/19/2022] [Indexed: 11/22/2022] Open
Abstract
Scene construction is a key component of memory recall, navigation, and future imagining, and relies on the medial temporal lobes (MTL). A parallel body of work suggests that eye movements may enable the imagination and construction of scenes, even in the absence of external visual input. There are vast structural and functional connections between regions of the MTL and those of the oculomotor system. However, the directionality of connections between the MTL and oculomotor control regions, and how it relates to scene construction, has not been studied directly in human neuroimaging. In the current study, we used dynamic causal modeling (DCM) to interrogate effective connectivity between the MTL and oculomotor regions using a scene construction task in which participants' eye movements were either restricted (fixed-viewing) or unrestricted (free-viewing). By omitting external visual input, and by contrasting free- versus fixed- viewing, the directionality of neural connectivity during scene construction could be determined. As opposed to when eye movements were restricted, allowing free-viewing during construction of scenes strengthened top-down connections from the MTL to the frontal eye fields, and to lower-level cortical visual processing regions, suppressed bottom-up connections along the visual stream, and enhanced vividness of the constructed scenes. Taken together, these findings provide novel, non-invasive evidence for the underlying, directional, connectivity between the MTL memory system and oculomotor system associated with constructing vivid mental representations of scenes.
Collapse
|
16
|
Katz CN, Schjetnan AGP, Patel K, Barkley V, Hoffman KL, Kalia SK, Duncan KD, Valiante TA. A corollary discharge mediates saccade-related inhibition of single units in mnemonic structures of the human brain. Curr Biol 2022; 32:3082-3094.e4. [PMID: 35779529 DOI: 10.1016/j.cub.2022.06.015] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2021] [Revised: 04/04/2022] [Accepted: 06/08/2022] [Indexed: 11/18/2022]
Abstract
Despite the critical link between visual exploration and memory, little is known about how neuronal activity in the human mesial temporal lobe (MTL) is modulated by saccades. Here, we characterize saccade-associated neuronal modulations, unit-by-unit, and contrast them to image onset and to occipital lobe neurons. We reveal evidence for a corollary discharge (CD)-like modulatory signal that accompanies saccades, inhibiting/exciting a unique population of broad-/narrow-spiking units, respectively, before and during saccades and with directional selectivity. These findings comport well with the timing, directional nature, and inhibitory circuit implementation of a CD. Additionally, by linking neuronal activity to event-related potentials (ERPs), which are directionally modulated following saccades, we recontextualize the ERP associated with saccades as a proxy for both the strength of inhibition and saccade direction, providing a mechanistic underpinning for the more commonly recorded saccade-related ERP in the human brain.
Collapse
Affiliation(s)
- Chaim N Katz
- Krembil Brain Institute, Toronto Western Hospital (TWH), Toronto, ON M5T 1M8, Canada; Institute of Biomedical Engineering, University of Toronto, Toronto, ON M5S 3G9, Canada; CRANIA, University Health Network and University of Toronto, Toronto, ON M5G 2A2, Canada; Faculty of Medicine, University of Calgary, Calgary, AB T2N 4N1, Canada
| | - Andrea G P Schjetnan
- Krembil Brain Institute, Toronto Western Hospital (TWH), Toronto, ON M5T 1M8, Canada; CRANIA, University Health Network and University of Toronto, Toronto, ON M5G 2A2, Canada
| | - Kramay Patel
- Krembil Brain Institute, Toronto Western Hospital (TWH), Toronto, ON M5T 1M8, Canada; Institute of Biomedical Engineering, University of Toronto, Toronto, ON M5S 3G9, Canada; Faculty of Medicine, University of Toronto, Toronto, ON M5S 1A8, Canada; CRANIA, University Health Network and University of Toronto, Toronto, ON M5G 2A2, Canada
| | - Victoria Barkley
- Krembil Brain Institute, Toronto Western Hospital (TWH), Toronto, ON M5T 1M8, Canada; CRANIA, University Health Network and University of Toronto, Toronto, ON M5G 2A2, Canada
| | - Kari L Hoffman
- Department of Psychology, Vanderbilt University, Nashville, TN 37240, USA
| | - Suneil K Kalia
- Krembil Brain Institute, Toronto Western Hospital (TWH), Toronto, ON M5T 1M8, Canada; Division of Neurosurgery, Department of Surgery, University of Toronto, Toronto, ON M5S 1A1, Canada; CRANIA, University Health Network and University of Toronto, Toronto, ON M5G 2A2, Canada; The KITE Research Institute, University Health Network, Toronto, ON M5G 2A2, Canada
| | - Katherine D Duncan
- Department of Psychology, University of Toronto, Toronto, ON M5S 3G3, Canada
| | - Taufik A Valiante
- Krembil Brain Institute, Toronto Western Hospital (TWH), Toronto, ON M5T 1M8, Canada; Institute of Biomedical Engineering, University of Toronto, Toronto, ON M5S 3G9, Canada; Division of Neurosurgery, Department of Surgery, University of Toronto, Toronto, ON M5S 1A1, Canada; Institute of Medical Sciences, University of Toronto, Toronto, ON M5S 1A8, Canada; Electrical and Computer Engineering, University of Toronto, Toronto, ON M5S 3G4, Canada; CRANIA, University Health Network and University of Toronto, Toronto, ON M5G 2A2, Canada; The KITE Research Institute, University Health Network, Toronto, ON M5G 2A2, Canada; Max Planck-University of Toronto Center for Neural Science and Technology, Toronto, ON, Canada.
| |
Collapse
|
17
|
Johansson R, Nyström M, Dewhurst R, Johansson M. Eye-movement replay supports episodic remembering. Proc Biol Sci 2022; 289:20220964. [PMID: 35703049 PMCID: PMC9198773 DOI: 10.1098/rspb.2022.0964] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/25/2022] Open
Abstract
When we bring to mind something we have seen before, our eyes spontaneously unfold in a sequential pattern strikingly similar to that made during the original encounter, even in the absence of supporting visual input. Oculomotor movements of the eye may then serve the opposite purpose of acquiring new visual information; they may serve as self-generated cues, pointing to stored memories. Over 50 years ago Donald Hebb, the forefather of cognitive neuroscience, posited that such a sequential replay of eye movements supports our ability to mentally recreate visuospatial relations during episodic remembering. However, direct evidence for this influential claim is lacking. Here we isolate the sequential properties of spontaneous eye movements during encoding and retrieval in a pure recall memory task and capture their encoding-retrieval overlap. Critically, we show that the fidelity with which a series of consecutive eye movements from initial encoding is sequentially retained during subsequent retrieval predicts the quality of the recalled memory. Our findings provide direct evidence that such scanpaths are replayed to assemble and reconstruct spatio-temporal relations as we remember and further suggest that distinct scanpath properties differentially contribute depending on the nature of the goal-relevant memory.
Collapse
|
18
|
Ryan JD, Wynn JS, Shen K, Liu ZX. Aging changes the interactions between the oculomotor and memory systems. NEUROPSYCHOLOGY, DEVELOPMENT, AND COGNITION. SECTION B, AGING, NEUROPSYCHOLOGY AND COGNITION 2022; 29:418-442. [PMID: 34856890 DOI: 10.1080/13825585.2021.2007841] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/24/2021] [Accepted: 11/12/2021] [Indexed: 06/13/2023]
Abstract
The use of multi-modal approaches, particularly in conjunction with multivariate analytic techniques, can enrich models of cognition, brain function, and how they change with age. Recently, multivariate approaches have been applied to the study of eye movements in a manner akin to that of neural activity (i.e., pattern similarity). Here, we review the literature regarding multi-modal and/or multivariate approaches, with specific reference to the use of eyetracking to characterize age-related changes in memory. By applying multi-modal and multivariate approaches to the study of aging, research has shown that aging is characterized by moment-to-moment alterations in the amount and pattern of visual exploration, and by extension, alterations in the activity and function of the hippocampus and broader medial temporal lobe (MTL). These methodological advances suggest that age-related declines in the integrity of the memory system has consequences for oculomotor behavior in the moment, in a reciprocal fashion. Age-related changes in hippocampal and MTL structure and function may lead to an increase in, and change in the patterns of, visual exploration in an effort to upregulate the encoding of information. However, such visual exploration patterns may be non-optimal and actually reduce the amount and/or type of incoming information that is bound into a lasting memory representation. This research indicates that age-related cognitive impairments are considerably broader in scope than previously realized.
Collapse
Affiliation(s)
- Jennifer D Ryan
- Rotman Research Institute at Baycrest Health Sciences, Toronto, ON, Canada
- Departments of Psychology, Psychiatry, University of Toronto, Toronto, ON, Canada
| | - Jordana S Wynn
- Department of Psychology, Harvard University, Cambridge MA, USA
| | - Kelly Shen
- Rotman Research Institute at Baycrest Health Sciences, Toronto, ON, Canada
| | - Zhong-Xu Liu
- Department of Behavioral Sciences, University of Michigan-Dearborn, Dearborn MI, USA
| |
Collapse
|
19
|
Wahlheim CN, Eisenberg ML, Stawarczyk D, Zacks JM. Understanding Everyday Events: Predictive-Looking Errors Drive Memory Updating. Psychol Sci 2022; 33:765-781. [PMID: 35439426 PMCID: PMC9248286 DOI: 10.1177/09567976211053596] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
Abstract
Memory-guided predictions can improve event comprehension by guiding attention and the eyes to the location where an actor is about to perform an action. But when events change, viewers may experience predictive-looking errors and need to update their memories. In two experiments (Ns = 38 and 98), we examined the consequences of mnemonic predictive-looking errors for comprehending and remembering event changes. University students watched movies of everyday activities with actions that were repeated exactly and actions that were repeated with changed features-for example, an actor reached for a paper towel on one occasion and a dish towel on the next. Memory guidance led to predictive-looking errors that were associated with better memory for subsequently changed event features. These results indicate that retrieving recent event features can guide predictions during unfolding events and that error signals derived from mismatches between mnemonic predictions and actual events contribute to new learning.
Collapse
Affiliation(s)
| | - Michelle L Eisenberg
- Department of Psychological and Brain Sciences, Washington University in St. Louis
| | - David Stawarczyk
- Department of Psychological and Brain Sciences, Washington University in St. Louis.,Department of Psychology, Psychology and Neuroscience of Cognition Research Unit, University of Liège
| | - Jeffrey M Zacks
- Department of Psychological and Brain Sciences, Washington University in St. Louis
| |
Collapse
|
20
|
Wynn JS, Van Genugten RDI, Sheldon S, Schacter DL. Schema-related eye movements support episodic simulation. Conscious Cogn 2022; 100:103302. [PMID: 35240421 PMCID: PMC9007866 DOI: 10.1016/j.concog.2022.103302] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2021] [Revised: 02/02/2022] [Accepted: 02/16/2022] [Indexed: 11/29/2022]
Abstract
Recent work indicates that eye movements support the retrieval of episodic memories by reactivating the spatiotemporal context in which they were encoded. Although similar mechanisms have been thought to support simulation of future episodes, there is currently no evidence favoring this proposal. In the present study, we investigated the role of eye movements in episodic simulation by comparing the gaze patterns of individual participants imagining future scene and event scenarios to across-participant gaze templates for those same scenarios, reflecting their shared features (i.e., schemas). Our results provide novel evidence that eye movements during episodic simulation in the face of distracting visual noise are (1) schema-specific and (2) predictive of simulation success. Together, these findings suggest that eye movements support episodic simulation via reinstatement of scene and event schemas, and more broadly, that interactions between the memory and oculomotor effector systems may underlie critical cognitive processes including constructive episodic simulation.
Collapse
Affiliation(s)
- Jordana S Wynn
- Department of Psychology, Harvard University, Cambridge, USA.
| | | | - Signy Sheldon
- Department of Psychology, McGill University, Montreal, Canada
| | | |
Collapse
|
21
|
Pollmann S, Schneider WX. Working memory and active sampling of the environment: Medial temporal contributions. HANDBOOK OF CLINICAL NEUROLOGY 2022; 187:339-357. [PMID: 35964982 DOI: 10.1016/b978-0-12-823493-8.00029-8] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Working memory (WM) refers to the ability to maintain and actively process information-either derived from perception or long-term memory (LTM)-for intelligent thought and action. This chapter focuses on the contributions of the temporal lobe, particularly medial temporal lobe (MTL) to WM. First, neuropsychological evidence for the involvement of MTL in WM maintenance is reviewed, arguing for a crucial role in the case of retaining complex relational bindings between memorized features. Next, MTL contributions at the level of neural mechanisms are covered-with a focus on WM encoding and maintenance, including interactions with ventral temporal cortex. Among WM use processes, we focus on active sampling of environmental information, a key input source to capacity-limited WM. MTL contributions to the bidirectional relationship between active sampling and memory are highlighted-WM control of active sampling and sampling as a way of selecting input to WM. Memory-based sampling studies relying on scene and object inspection, visual-based exploration behavior (e.g., vicarious behavior), and memory-guided visual search are reviewed. The conclusion is that MTL serves an important function in the selection of information from perception and transfer from LTM to capacity-limited WM.
Collapse
Affiliation(s)
- Stefan Pollmann
- Department of Psychology and Center for Behavioral Brain Sciences, Otto-von-Guericke-University, Magdeburg, Germany.
| | - Werner X Schneider
- Department of Psychology and Center for Cognitive Interaction Technology, Bielefeld University, Bielefeld, Germany
| |
Collapse
|
22
|
McCormick C, Maguire EA. The distinct and overlapping brain networks supporting semantic and spatial constructive scene processing. Neuropsychologia 2021; 158:107912. [PMID: 34116069 PMCID: PMC8287593 DOI: 10.1016/j.neuropsychologia.2021.107912] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2021] [Revised: 05/20/2021] [Accepted: 06/04/2021] [Indexed: 11/17/2022]
Abstract
Scene imagery features prominently when we recall autobiographical memories, imagine the future and navigate around in the world. Consequently, in this study we sought to better understand how scene representations are supported by the brain. Processing scenes involves a variety of cognitive processes that in the real world are highly interactive. Here, however, our goal was to separate semantic and spatial constructive scene processes in order to identify the brain areas that were distinct to each process, those they had in common, and the connectivity between regions. To this end, participants searched for either semantic or spatial constructive impossibilities in scenes during functional MRI. We focussed our analyses on only those scenes that were possible, thus removing any error detection that would evoke reactions such as surprise or novelty. Importantly, we also counterbalanced possible scenes across participants, enabling us to examine brain activity and connectivity for the same possible scene images under two different conditions. We found that participants adopted different cognitive strategies, which were reflected in distinct oculomotor behaviour, for each condition. These were in turn associated with increased engagement of lateral temporal and parietal cortices for semantic scene processing, the hippocampus for spatial constructive scene processing, and increased activation of the ventromedial prefrontal cortex (vmPFC) that was common to both. Connectivity analyses showed that the vmPFC switched between semantic and spatial constructive brain networks depending on the task at hand. These findings further highlight the well-known semantic functions of lateral temporal areas, while providing additional support for the previously-asserted contribution of the hippocampus to scene construction, and recent suggestions that the vmPFC may play a key role in orchestrating scene processing.
Collapse
Affiliation(s)
- Cornelia McCormick
- Wellcome Centre for Human Neuroimaging, UCL Queen Square Institute of Neurology, University College London, London, WC1N 3AR, UK; Department of Neurodegenerative Diseases and Geriatric Psychiatry, University Hospital Bonn, Bonn, Germany
| | - Eleanor A Maguire
- Wellcome Centre for Human Neuroimaging, UCL Queen Square Institute of Neurology, University College London, London, WC1N 3AR, UK.
| |
Collapse
|
23
|
Wynn JS, Liu ZX, Ryan JD. Neural Correlates of Subsequent Memory-Related Gaze Reinstatement. J Cogn Neurosci 2021; 34:1547-1562. [PMID: 34272959 DOI: 10.1162/jocn_a_01761] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Mounting evidence linking gaze reinstatement-the recapitulation of encoding-related gaze patterns during retrieval-to behavioral measures of memory suggests that eye movements play an important role in mnemonic processing. Yet, the nature of the gaze scanpath, including its informational content and neural correlates, has remained in question. In this study, we examined eye movement and neural data from a recognition memory task to further elucidate the behavioral and neural bases of functional gaze reinstatement. Consistent with previous work, gaze reinstatement during retrieval of freely viewed scene images was greater than chance and predictive of recognition memory performance. Gaze reinstatement was also associated with viewing of informationally salient image regions at encoding, suggesting that scanpaths may encode and contain high-level scene content. At the brain level, gaze reinstatement was predicted by encoding-related activity in the occipital pole and BG, neural regions associated with visual processing and oculomotor control. Finally, cross-voxel brain pattern similarity analysis revealed overlapping subsequent memory and subsequent gaze reinstatement modulation effects in the parahippocampal place area and hippocampus, in addition to the occipital pole and BG. Together, these findings suggest that encoding-related activity in brain regions associated with scene processing, oculomotor control, and memory supports the formation, and subsequent recapitulation, of functional scanpaths. More broadly, these findings lend support to scanpath theory's assertion that eye movements both encode, and are themselves embedded in, mnemonic representations.
Collapse
Affiliation(s)
| | | | - Jennifer D Ryan
- Rotman Research Institute at Baycrest Health Sciences.,University of Toronto
| |
Collapse
|
24
|
Koppelaar H, Kordestani-Moghadam P, Kouhkani S, Irandoust F, Segers G, de Haas L, Bantje T, van Warmerdam M. Proof of Concept of Novel Visuo-Spatial-Motor Fall Prevention Training for Old People. Geriatrics (Basel) 2021; 6:66. [PMID: 34210015 PMCID: PMC8293049 DOI: 10.3390/geriatrics6030066] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2021] [Revised: 06/13/2021] [Accepted: 06/22/2021] [Indexed: 11/16/2022] Open
Abstract
Falls in the geriatric population are one of the most important causes of disabilities in this age group. Its consequences impose a great deal of economic burden on health and insurance systems. This study was conducted by a multidisciplinary team with the aim of evaluating the effect of visuo-spatial-motor training for the prevention of falls in older adults. The subjects consisted of 31 volunteers aged 60 to 92 years who were studied in three groups: (1) A group under standard physical training, (2) a group under visuo-spatial-motor interventions, and (3) a control group (without any intervention). The results of the study showed that visual-spatial motor exercises significantly reduced the risk of falls of the subjects.
Collapse
Affiliation(s)
- Henk Koppelaar
- Faculty of Electric and Electronic Engineering, Mathematics and Computer Science, Delft University of Technology, 2628 CD Delft, The Netherlands
| | | | - Sareh Kouhkani
- Department of Mathematics, Islamic University Shabestar Branch, Shabestar, Iran;
| | - Farnoosh Irandoust
- Department of Ophtalmology, Lorestan University of Medical Sciences, Korramabad, Iran;
| | - Gijs Segers
- Gymi Sports & Visual Performance, 4907 BC Oosterhout, The Netherlands;
| | - Lonneke de Haas
- Monné Physical Care and Exercise, 4815 HD Breda, The Netherlands; (L.d.H.); (T.B.)
| | - Thijmen Bantje
- Monné Physical Care and Exercise, 4815 HD Breda, The Netherlands; (L.d.H.); (T.B.)
| | | |
Collapse
|
25
|
Barnett AJ, Reilly W, Dimsdale-Zucker HR, Mizrak E, Reagh Z, Ranganath C. Intrinsic connectivity reveals functionally distinct cortico-hippocampal networks in the human brain. PLoS Biol 2021; 19:e3001275. [PMID: 34077415 PMCID: PMC8202937 DOI: 10.1371/journal.pbio.3001275] [Citation(s) in RCA: 38] [Impact Index Per Article: 12.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2020] [Revised: 06/14/2021] [Accepted: 05/07/2021] [Indexed: 12/13/2022] Open
Abstract
Episodic memory depends on interactions between the hippocampus and interconnected neocortical regions. Here, using data-driven analyses of resting-state functional magnetic resonance imaging (fMRI) data, we identified the networks that interact with the hippocampus-the default mode network (DMN) and a "medial temporal network" (MTN) that included regions in the medial temporal lobe (MTL) and precuneus. We observed that the MTN plays a critical role in connecting the visual network to the DMN and hippocampus. The DMN could be further divided into 3 subnetworks: a "posterior medial" (PM) subnetwork comprised of posterior cingulate and lateral parietal cortices; an "anterior temporal" (AT) subnetwork comprised of regions in the temporopolar and dorsomedial prefrontal cortex; and a "medial prefrontal" (MP) subnetwork comprised of regions primarily in the medial prefrontal cortex (mPFC). These networks vary in their functional connectivity (FC) along the hippocampal long axis and represent different kinds of information during memory-guided decision-making. Finally, a Neurosynth meta-analysis of fMRI studies suggests new hypotheses regarding the functions of the MTN and DMN subnetworks, providing a framework to guide future research on the neural architecture of episodic memory.
Collapse
Affiliation(s)
- Alexander J. Barnett
- Center for Neuroscience, University of California at Davis, Davis, California, United States of America
| | - Walter Reilly
- Center for Neuroscience, University of California at Davis, Davis, California, United States of America
| | | | - Eda Mizrak
- Center for Neuroscience, University of California at Davis, Davis, California, United States of America
- Department of Psychology, University of Zurich, Zürich, Switzerland
| | - Zachariah Reagh
- Center for Neuroscience, University of California at Davis, Davis, California, United States of America
- Department of Neurology, University of California at Davis, Sacramento, California, United States of America
- Department of Psychological and Brain Sciences, Washington University in St. Louis, St. Louis, Missouri, United States of America
| | - Charan Ranganath
- Center for Neuroscience, University of California at Davis, Davis, California, United States of America
| |
Collapse
|
26
|
Eye-movements reveal semantic interference effects during the encoding of naturalistic scenes in long-term memory. Psychon Bull Rev 2021; 28:1601-1614. [PMID: 34009623 DOI: 10.3758/s13423-021-01920-1] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/22/2021] [Indexed: 11/08/2022]
Abstract
Similarity-based semantic interference (SI) hinders memory recognition. Within long-term visual memory paradigms, the more scenes (or objects) from the same semantic category are viewed, the harder it is to recognize each individual instance. A growing body of evidence shows that overt attention is intimately linked to memory. However, it is yet to be understood whether SI mediates overt attention during scene encoding, and so explain its detrimental impact on recognition memory. In the current experiment, participants watched 372 photographs belonging to different semantic categories (e.g., a kitchen) with different frequency (4, 20, 40 or 60 images), while being eye-tracked. After 10 minutes, they were presented with the same 372 photographs plus 372 new photographs and asked whether they recognized (or not) each photo (i.e., old/new paradigm). We found that the more the SI, the poorer the recognition performance, especially for old scenes of which memory representations existed. Scenes more widely explored were better recognized, but for increasing SI, participants focused on more local regions of the scene in search for its potentially distinctive details. Attending to the centre of the display, or to scene regions rich in low-level saliency was detrimental to recognition accuracy, and as SI increased participants were more likely to rely on visual saliency. The complexity of maintaining faithful memory representations for increasing SI also manifested in longer fixation durations; in fact, a more successful encoding was also associated with shorter fixations. Our study highlights the interdependence between attention and memory during high-level processing of semantic information.
Collapse
|
27
|
Conti F, Irish M. Harnessing Visual Imagery and Oculomotor Behaviour to Understand Prospection. Trends Cogn Sci 2021; 25:272-283. [PMID: 33618981 DOI: 10.1016/j.tics.2021.01.009] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2020] [Revised: 01/20/2021] [Accepted: 01/20/2021] [Indexed: 12/20/2022]
Abstract
Much of the rich internal world constructed by humans is derived from, and experienced through, visual mental imagery. Despite growing appreciation of visual exploration in guiding episodic memory processes, extant theories of prospection have yet to accommodate the precise role of visual mental imagery in the service of future-oriented thinking. We propose that the construction of future events relies on the assimilation of perceptual details originally experienced, and subsequently reinstantiated, predominantly in the visual domain. Individual differences in the capacity to summon discrete aspects of visual imagery can therefore account for the diversity of content generated by humans during future simulation. Our integrative framework provides a novel testbed to query alterations in future thinking in health and disease.
Collapse
Affiliation(s)
- Federica Conti
- Institut des Neurosciences de la Timone, Aix-Marseille University, 27 Boulevard Jean Moulin, 13005 Marseille, France; The University of Sydney, Brain and Mind Centre and School of Psychology, 94 Mallett Street, Camperdown, NSW 2050, Australia.
| | - Muireann Irish
- The University of Sydney, Brain and Mind Centre and School of Psychology, 94 Mallett Street, Camperdown, NSW 2050, Australia.
| |
Collapse
|
28
|
Armson MJ, Diamond NB, Levesque L, Ryan JD, Levine B. Vividness of recollection is supported by eye movements in individuals with high, but not low trait autobiographical memory. Cognition 2021; 206:104487. [DOI: 10.1016/j.cognition.2020.104487] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2020] [Revised: 10/05/2020] [Accepted: 10/07/2020] [Indexed: 11/25/2022]
|
29
|
Liu ZX, Rosenbaum RS, Ryan JD. Restricting Visual Exploration Directly Impedes Neural Activity, Functional Connectivity, and Memory. Cereb Cortex Commun 2020; 1:tgaa054. [PMID: 33154992 PMCID: PMC7595095 DOI: 10.1093/texcom/tgaa054] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2020] [Revised: 07/28/2020] [Accepted: 08/12/2020] [Indexed: 11/13/2022] Open
Abstract
We move our eyes to explore the visual world, extract information, and create memories. The number of gaze fixations-the stops that the eyes make-has been shown to correlate with activity in the hippocampus, a region critical for memory, and with later recognition memory. Here, we combined eyetracking with fMRI to provide direct evidence for the relationships between gaze fixations, neural activity, and memory during scene viewing. Compared to free viewing, fixating a single location reduced: 1) subsequent memory, 2) neural activity along the ventral visual stream into the hippocampus, 3) neural similarity between effects of subsequent memory and visual exploration, and 4) functional connectivity among the hippocampus, parahippocampal place area, and other cortical regions. Gaze fixations were uniquely related to hippocampal activity, even after controlling for neural effects due to subsequent memory. Therefore, this study provides key causal evidence supporting the notion that the oculomotor and memory systems are intrinsically related at both the behavioral and neural level. Individual gaze fixations may provide the basic unit of information on which memory binding processes operate.
Collapse
Affiliation(s)
- Zhong-Xu Liu
- Department of Behavioral Sciences, University of Michigan-Dearborn, Dearborn, Michigan 48128, USA
| | - R Shayna Rosenbaum
- Rotman Research Institute, Baycrest Health Sciences, Toronto, ON M6A 2E1, Canada
| | - Jennifer D Ryan
- Rotman Research Institute, Baycrest Health Sciences, Toronto, ON M6A 2E1, Canada
| |
Collapse
|
30
|
Wynn JS, Amer T, Schacter DL. How Older Adults Remember the World Depends On How They See It. Trends Cogn Sci 2020; 24:858-861. [PMID: 32863143 DOI: 10.1016/j.tics.2020.08.001] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2020] [Revised: 07/31/2020] [Accepted: 08/05/2020] [Indexed: 10/23/2022]
Abstract
Age-related changes in visual exploration and memory have typically been studied separately. However, recent evidence suggests that mnemonic processes both affect, and are affected by, eye movements (EMs). Thus, by relating older adults' memory deficits to age-specific visual exploration patterns, we can improve upon models of cognitive aging.
Collapse
Affiliation(s)
- Jordana S Wynn
- Department of Psychology, Harvard University, Cambridge, MA, USA.
| | - Tarek Amer
- Department of Psychology, Columbia University, New York, NY, USA
| | | |
Collapse
|
31
|
Fehlmann B, Coynel D, Schicktanz N, Milnik A, Gschwind L, Hofmann P, Papassotiropoulos A, de Quervain DJF. Visual Exploration at Higher Fixation Frequency Increases Subsequent Memory Recall. Cereb Cortex Commun 2020; 1:tgaa032. [PMID: 34296105 PMCID: PMC8153053 DOI: 10.1093/texcom/tgaa032] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2020] [Revised: 07/08/2020] [Accepted: 07/09/2020] [Indexed: 01/29/2023] Open
Abstract
Only a small proportion of what we see can later be recalled. Up to date it is unknown how far differences in visual exploration during encoding affect the strength of episodic memories. Here, we identified individual gaze characteristics by analyzing eye tracking data in a picture encoding task performed by 967 healthy subjects during fMRI. We found a positive correlation between fixation frequency during visual exploration and subsequent free recall performance. Brain imaging results showed a positive correlation of fixation frequency with activations in regions related to vision and memory, including the medial temporal lobe. To investigate if higher fixation frequency is causally linked to better memory, we experimentally manipulated visual exploration patterns in an independent population of 64 subjects. Doubling the number of fixations within a given exploration time increased subsequent free recall performance by 19%. Our findings provide evidence for a causal relationship between fixation frequency and episodic memory for visual information.
Collapse
Affiliation(s)
- Bernhard Fehlmann
- Division of Cognitive Neuroscience, Department of Psychology, University of Basel, Basel 4055, Switzerland
- Transfaculty Research Platform, University of Basel, Basel 4055, Switzerland
| | - David Coynel
- Division of Cognitive Neuroscience, Department of Psychology, University of Basel, Basel 4055, Switzerland
- Transfaculty Research Platform, University of Basel, Basel 4055, Switzerland
| | - Nathalie Schicktanz
- Division of Cognitive Neuroscience, Department of Psychology, University of Basel, Basel 4055, Switzerland
- Transfaculty Research Platform, University of Basel, Basel 4055, Switzerland
| | - Annette Milnik
- Transfaculty Research Platform, University of Basel, Basel 4055, Switzerland
- Division of Molecular Neuroscience, Department of Psychology, University of Basel, Basel 4055, Switzerland
| | - Leo Gschwind
- Transfaculty Research Platform, University of Basel, Basel 4055, Switzerland
- Division of Molecular Neuroscience, Department of Psychology, University of Basel, Basel 4055, Switzerland
| | - Pascal Hofmann
- Division of Cognitive Neuroscience, Department of Psychology, University of Basel, Basel 4055, Switzerland
- Division of Molecular Neuroscience, Department of Psychology, University of Basel, Basel 4055, Switzerland
| | - Andreas Papassotiropoulos
- Transfaculty Research Platform, University of Basel, Basel 4055, Switzerland
- Division of Molecular Neuroscience, Department of Psychology, University of Basel, Basel 4055, Switzerland
- Department Biozentrum, Life Sciences Training Facility, University of Basel, Basel 4056, Switzerland
- University Psychiatric Clinics, University of Basel, Basel 4002, Switzerland
| | - Dominique J-F de Quervain
- Division of Cognitive Neuroscience, Department of Psychology, University of Basel, Basel 4055, Switzerland
- Transfaculty Research Platform, University of Basel, Basel 4055, Switzerland
- University Psychiatric Clinics, University of Basel, Basel 4002, Switzerland
| |
Collapse
|