Attenuated boundary extension produces a paradoxical memory advantage in amnesic patients

Spatial context scaffolds long-term episodic richness of weaker real-world autobiographical memories in both older and younger adults

Remembering life experiences involves recalling not only what occurred (episodic details), but also where an event took place (spatial context), both of which decline with age. Although spatial context can cue episodic detail recollection, it is unknown whether initially recalling an event alongside greater reinstatement of spatial context protects memory for episodic details in the long term, and whether this is affected by age. Here, we analysed 1079 personally-experienced, real-world events from 29 older adults and 12 younger adults. Events were recalled first on average 6 weeks after they occurred and then again on average 24 weeks after they occurred. We developed a novel scoring protocol to quantify spatial contextual details and used the established Autobiographical Interview to quantify episodic details. We found improved recall of episodic details after a delay if those details had initially been recalled situated in greater spatial context. Notably, for both older and younger adults, this preservation was observed for memories initially recalled with low, but not high, numbers of episodic details, suggesting that spatial context aided episodic retrieval for memories that required more support. This work supports the notion that spatial context scaffolds detail-rich event recollection and inspires memory interventions that leverage this spatial scaffold.

Object-based attention during scene perception elicits boundary contraction in memory

Boundary contraction and extension are two types of scene transformations that occur in memory. In extension, viewers extrapolate information beyond the edges of the image, whereas in contraction, viewers forget information near the edges. Recent work suggests that image composition influences the direction and magnitude of boundary transformation. We hypothesize that selective attention at encoding is an important driver of boundary transformation effects, selective attention to specific objects at encoding leading to boundary contraction. In this study, one group of participants (N = 36) memorized 15 scenes while searching for targets, while a separate group (N = 36) just memorized the scenes. Both groups then drew the scenes from memory with as much object and spatial detail as they could remember. We asked online workers to provide ratings of boundary transformations in the drawings, as well as how many objects they contained and the precision of remembered object size and location. We found that search condition drawings showed significantly greater boundary contraction than drawings of the same scenes in the memorize condition. Search drawings were significantly more likely to contain target objects, and the likelihood to recall other objects in the scene decreased as a function of their distance from the target. These findings suggest that selective attention to a specific object due to a search task at encoding will lead to significant boundary contraction.

A generative model of memory construction and consolidation

Episodic memories are (re)constructed, share neural substrates with imagination, combine unique features with schema-based predictions and show schema-based distortions that increase with consolidation. Here we present a computational model in which hippocampal replay (from an autoassociative network) trains generative models (variational autoencoders) to (re)create sensory experiences from latent variable representations in entorhinal, medial prefrontal and anterolateral temporal cortices via the hippocampal formation. Simulations show effects of memory age and hippocampal lesions in agreement with previous models, but also provide mechanisms for semantic memory, imagination, episodic future thinking, relational inference and schema-based distortions including boundary extension. The model explains how unique sensory and predictable conceptual elements of memories are stored and reconstructed by efficiently combining both hippocampal and neocortical systems, optimizing the use of limited hippocampal storage for new and unusual information. Overall, we believe hippocampal replay training generative models provides a comprehensive account of memory construction, imagination and consolidation.

Impoverished details with preserved gist in remote and recent spatial memory following hippocampal and fornix lesions

INTRODUCTION

Cognitive Map Theory predicts that the hippocampus (HPC) plays a specialized, time-invariant role in supporting allocentric spatial memory, while Standard Consolidation Theory makes the competing prediction that the HPC plays a time-limited role, with more remote memories gaining independence of HPC function. These theories, however, are largely informed by the results of laboratory-based tests that are unlikely to simulate the demands of representing real-world environments in humans. Validation of these theories is further limited by an overall focus on spatial memory of newly encountered environments and on individuals with extensive lesions to the HPC and to surrounding medial temporal lobe (MTL) regions. The current study incorporates naturalistic tests of spatial memory based on recently and remotely encountered environments navigated by individuals with lesions to the HPC/MTL or that are limited to the HPC's major output, the fornix.

METHODS

Four participants with bilateral HPC/MTL and/or fornix lesions drew sketch maps of recently and remotely experienced neighbourhoods and houses. Tests of the appearance, distances, and routes between landmarks from the same real-world environments were also administered. Performance on the tasks was compared to that of control participants closely matched in terms of exposure to the same neighbourhoods and home environments as well as to actual maps.

RESULTS

The performance of individuals with fornix/MTL lesions was found to be largely comparable to that of controls on objective tests of spatial memory, other than one case who was impaired on remote and recent conditions for several tasks. The nature of deficits in recent and remote spatial memory were further revealed on house floorplan drawings, which contained spatial distortions, room/structure transpositions, and omissions, and on neighbourhood sketch maps, which were intact in terms of overall layout but sparse in details such as landmarks.

CONCLUSION

Lab-based tests of spatial memory of newly learned environments are unlikely to fully capture patterns of spared and impaired representations of real-world environments (e.g., peripheral features, configurations). Naturalistic tasks, including generative drawing tasks, indicate that contrary to Cognitive Map Theory, neither HPC nor MTL are critical for allocentric gross representations of large-scale environments. Conversely, the HPC appears critical for representing detailed spatial information of local naturalistic environments and environmental objects regardless of the age of the memory, contrary to Standard Consolidation Theory.

The Vestibulocerebellum and the Shattered Self: a Resting-State Functional Connectivity Study in Posttraumatic Stress Disorder and Its Dissociative Subtype

The flocculus is a region of the vestibulocerebellum dedicated to the coordination of neck, head, and eye movements for optimal posture, balance, and orienting responses. Despite growing evidence of vestibular and oculomotor impairments in the aftermath of traumatic stress, little is known about the effects of chronic psychological trauma on vestibulocerebellar functioning. Here, we investigated alterations in functional connectivity of the flocculus at rest among individuals with post-traumatic stress disorder (PTSD) and its dissociative subtype (PTSD + DS) as compared to healthy controls. Forty-four healthy controls, 57 PTSD, and 32 PTSD + DS underwent 6-min resting-state MRI scans. Seed-based functional connectivity analyses using the right and left flocculi as seeds were performed. These analyses revealed that, as compared to controls, PTSD and PTSD + DS showed decreased resting-state functional connectivity of the left flocculus with cortical regions involved in bodily self-consciousness, including the temporo-parietal junction, the supramarginal and angular gyri, and the superior parietal lobule. Moreover, as compared to controls, the PTSD + DS group showed decreased functional connectivity of the left flocculus with the medial prefrontal cortex, the precuneus, and the mid/posterior cingulum, key regions of the default mode network. Critically, when comparing PTSD + DS to PTSD, we observed increased functional connectivity of the right flocculus with the right anterior hippocampus, a region affected frequently by early life trauma. Taken together, our findings point toward the crucial role of the flocculus in the neurocircuitry underlying a coherent and embodied self, which can be compromised in PTSD and PTSD + DS.

Release of cognitive and multimodal MRI data including real-world tasks and hippocampal subfield segmentations

We share data from N = 217 healthy adults (mean age 29 years, range 20-41; 109 females, 108 males) who underwent extensive cognitive assessment and neuroimaging to examine the neural basis of individual differences, with a particular focus on a brain structure called the hippocampus. Cognitive data were collected using a wide array of questionnaires, naturalistic tests that examined imagination, autobiographical memory recall and spatial navigation, traditional laboratory-based tests such as recalling word pairs, and comprehensive characterisation of the strategies used to perform the cognitive tests. 3 Tesla MRI data were also acquired and include multi-parameter mapping to examine tissue microstructure, diffusion-weighted MRI, T2-weighted high-resolution partial volume structural MRI scans (with the masks of hippocampal subfields manually segmented from these scans), whole brain resting state functional MRI scans and partial volume high resolution resting state functional MRI scans. This rich dataset will be of value to cognitive and clinical neuroscientists researching individual differences, real-world cognition, brain-behaviour associations, hippocampal subfields and more. All data are freely available on Dryad.

What about "space" is important for episodic memory?

Early cognitive neuroscientific research revealed that the hippocampus is crucial for spatial navigation in rodents, and for autobiographical episodic memory in humans. Researchers quickly linked these streams to propose that the human hippocampus supports memory through its role in representing space, and research on the link between spatial cognition and episodic memory in humans has proliferated over the past several decades. Different researchers apply the term "spatial" in a variety of contexts, however, and it remains unclear what aspect of space may be critical to memory. Similarly, "episodic" has been defined and tested in different ways. Naturalistic assessment of spatial memory and episodic memory (i.e., episodic autobiographical memory) is required to unify the scale and biological relevance in comparisons of spatial and mnemonic processing. Limitations regarding the translation of rodent to human research, human ontogeny, and inter-individual variability require greater consideration in the interpretation of this literature. In this review, we outline the aspects of space that are (and are not) commonly linked to episodic memory, and then we discuss these dimensions through the lens of individual differences in naturalistic autobiographical memory. Future studies should carefully consider which aspect(s) of space are being linked to memory within the context of naturalistic human cognition. This article is categorized under: Psychology > Memory.

Perceived Distance Alters Memory for Scene Boundaries

Memory often fills in what is not there. A striking example of this is boundary extension, whereby observers mistakenly recall a view that extends beyond what was seen. However, not all visual memories extend in this way, which suggests that this process depends on specific scene properties. What factors determine when visual memories will include details that go beyond perceptual experience? Here, seven experiments (N = 1,100 adults) explored whether spatial scale-specifically, perceived viewing distance-drives boundary extension. We created fake miniatures by exploiting tilt shift, a photographic effect that selectively reduces perceived distance while preserving other scene properties (e.g., making a distant railway appear like a model train). Fake miniaturization increased boundary extension for otherwise identical scenes: Participants who performed a scene-memory task misremembered fake-miniaturized views as farther away than they actually were. This effect went beyond low-level image changes and generalized to a completely different distance manipulation. Thus, visual memory is modulated by the spatial scale at which the environment is viewed.

The hearing hippocampus

The hippocampus has a well-established role in spatial and episodic memory but a broader function has been proposed including aspects of perception and relational processing. Neural bases of sound analysis have been described in the pathway to auditory cortex, but wider networks supporting auditory cognition are still being established. We review what is known about the role of the hippocampus in processing auditory information, and how the hippocampus itself is shaped by sound. In examining imaging, recording, and lesion studies in species from rodents to humans, we uncover a hierarchy of hippocampal responses to sound including during passive exposure, active listening, and the learning of associations between sounds and other stimuli. We describe how the hippocampus' connectivity and computational architecture allow it to track and manipulate auditory information - whether in the form of speech, music, or environmental, emotional, or phantom sounds. Functional and structural correlates of auditory experience are also identified. The extent of auditory-hippocampal interactions is consistent with the view that the hippocampus makes broad contributions to perception and cognition, beyond spatial and episodic memory. More deeply understanding these interactions may unlock applications including entraining hippocampal rhythms to support cognition, and intervening in links between hearing loss and dementia.

How Imagination and Memory Shape the Moral Mind

Interdisciplinary research has proposed a multifaceted view of human cognition and morality, establishing that inputs from multiple cognitive and affective processes guide moral decisions. However, extant work on moral cognition has largely overlooked the contributions of episodic representation. The ability to remember or imagine a specific moment in time plays a broadly influential role in cognition and behavior. Yet, existing research has only begun exploring the influence of episodic representation on moral cognition. Here, we evaluate the theoretical connections between episodic representation and moral cognition, review emerging empirical work revealing how episodic representation affects moral decision-making, and conclude by highlighting gaps in the literature and open questions. We argue that a comprehensive model of moral cognition will require including the episodic memory system, further delineating its direct influence on moral thought, and better understanding its interactions with other mental processes to fundamentally shape our sense of right and wrong.

The Hippocampal Horizon: Constructing and Segmenting Experience for Episodic Memory

How do we recollect specific events that have occurred during continuous ongoing experience? There is converging evidence from non-human animals that spatially modulated cellular activity of the hippocampal formation supports the construction of ongoing events. On the other hand, recent human oriented event cognition models have outlined that our experience is segmented into discrete units, and that such segmentation can operate on shorter or longer timescales. Here, we describe a unification of how these dynamic physiological mechanisms of the hippocampus relate to ongoing externally and internally driven event segmentation, facilitating the demarcation of specific moments during experience. Our cross-species interdisciplinary approach offers a novel perspective in the way we construct and remember specific events, leading to the generation of many new hypotheses for future research.

Representation of Contralateral Visual Space in the Human Hippocampus

The initial encoding of visual information primarily from the contralateral visual field is a fundamental organizing principle of the primate visual system. Recently, the presence of such retinotopic sensitivity has been shown to extend well beyond early visual cortex to regions not historically considered retinotopically sensitive. In particular, human scene-selective regions in parahippocampal and medial parietal cortex exhibit prominent biases for the contralateral visual field. Here, we used fMRI to test the hypothesis that the human hippocampus, which is thought to be anatomically connected with these scene-selective regions, would also exhibit a biased representation of contralateral visual space. First, population receptive field (pRF) mapping with scene stimuli revealed strong biases for the contralateral visual field in bilateral hippocampus. Second, the distribution of retinotopic sensitivity suggested a more prominent representation in anterior medial portions of the hippocampus. Finally, the contralateral bias was confirmed in independent data taken from the Human Connectome Project (HCP) initiative. The presence of contralateral biases in the hippocampus, a structure considered by many as the apex of the visual hierarchy, highlights the truly pervasive influence of retinotopy. Moreover, this finding has important implications for understanding how visual information relates to the allocentric global spatial representations known to be encoded therein.SIGNIFICANCE STATEMENT Retinotopic encoding of visual information is an organizing principle of visual cortex. Recent work demonstrates this sensitivity in structures far beyond early visual cortex, including those anatomically connected to the hippocampus. Here, using population receptive field (pRF) modeling in two independent sets of data we demonstrate a consistent bias for the contralateral visual field in bilateral hippocampus. Such a bias highlights the truly pervasive influence of retinotopy, with important implications for understanding how the presence of retinotopy relates to more allocentric spatial representations.

Vector trace cells in the subiculum of the hippocampal formation

Successfully navigating in physical or semantic space requires a neural representation of allocentric (map-based) vectors to boundaries, objects and goals. Cognitive processes such as path-planning and imagination entail the recall of vector representations, but evidence of neuron-level memory for allocentric vectors has been lacking. Here, we describe a novel neuron type, vector trace cell (VTC), whose firing generates a new vector field when a cue is encountered and a 'trace' version of that field for hours after cue removal. VTCs are concentrated in subiculum, distal to CA1. Compared to non-trace cells, VTCs fire at further distances from cues and exhibit earlier-going shifts in preferred theta phase in response to newly introduced cues, which demonstrates a theta-linked neural substrate for memory encoding. VTCs suggest a vector-based model of computing spatial relationships between an agent and multiple spatial objects, or between different objects, freed from the constraints of direct perception of those objects.

Characterising the hippocampal response to perception, construction and complexity

The precise role played by the hippocampus in supporting cognitive functions such as episodic memory and future thinking is debated, but there is general agreement that it involves constructing representations comprised of numerous elements. Visual scenes have been deployed extensively in cognitive neuroscience because they are paradigmatic multi-element stimuli. However, questions remain about the specificity and nature of the hippocampal response to scenes. Here, we devised a paradigm in which we had participants search pairs of images for either colour or layout differences, thought to be associated with perceptual or spatial constructive processes respectively. Importantly, images depicted either naturalistic scenes or phase-scrambled versions of the same scenes, and were either simple or complex. Using this paradigm during functional MRI scanning, we addressed three questions: 1. Is the hippocampus recruited specifically during scene processing? 2. If the hippocampus is more active in response to scenes, does searching for colour or layout differences influence its activation? 3. Does the complexity of the scenes affect its response? We found that, compared to phase-scrambled versions of the scenes, the hippocampus was more responsive to scene stimuli. Moreover, a clear anatomical distinction was evident, with colour detection in scenes engaging the posterior hippocampus whereas layout detection in scenes recruited the anterior hippocampus. The complexity of the scenes did not influence hippocampal activity. These findings seem to align with perspectives that propose the hippocampus is especially attuned to scenes, and its involvement occurs irrespective of the cognitive process or the complexity of the scenes.

The Role of Hippocampal-Ventromedial Prefrontal Cortex Neural Dynamics in Building Mental Representations

The hippocampus and ventromedial prefrontal cortex (vmPFC) play key roles in numerous cognitive domains including mind-wandering, episodic memory, and imagining the future. Perspectives differ on precisely how they support these diverse functions, but there is general agreement that it involves constructing representations composed of numerous elements. Visual scenes have been deployed extensively in cognitive neuroscience because they are paradigmatic multielement stimuli. However, it remains unclear whether scenes, rather than other types of multifeature stimuli, preferentially engage hippocampus and vmPFC. Here, we leveraged the high temporal resolution of magnetoencephalography to test participants as they gradually built scene imagery from three successive auditorily presented object descriptions and an imagined 3-D space. This was contrasted with constructing mental images of nonscene arrays that were composed of three objects and an imagined 2-D space. The scene and array stimuli were, therefore, highly matched, and this paradigm permitted a closer examination of step-by-step mental construction than has been undertaken previously. We observed modulation of theta power in our two regions of interest-anterior hippocampus during the initial stage and vmPFC during the first two stages, of scene relative to array construction. Moreover, the scene-specific anterior hippocampal activity during the first construction stage was driven by the vmPFC, with mutual entrainment between the two brain regions thereafter. These findings suggest that hippocampal and vmPFC neural activity is especially tuned to scene representations during the earliest stage of their formation, with implications for theories of how these brain areas enable cognitive functions such as episodic memory.

Reply to Intraub

Intraub posits the existence of two separate processes in scene memory: one in which we automatically extrapolate the visual information in a scene beyond its boundaries (scene construction), and one in which we normalize our memories to either a schema or an average (normalization). She claims that scene construction will lead to transformations exclusively in the direction of boundary extension (BE), while normalization will produce bidirectional transformations of both BE and the opposite effect of boundary contraction (BC). Thus, because we observed both BE and BC in our study [1], our paradigm must be tapping into additional cognitive processes than just scene construction. However, our paper [1] questions this premise - if BE and BC are equally common using large, representative stimulus sets in the same tasks used previously [2,3], then perhaps prior studies primarily found unidirectional BE effects due to limited stimulus sampling, and there was no privileged link between boundary extension and scene construction in memory to begin with.

How Can Hearing Loss Cause Dementia?

Epidemiological studies identify midlife hearing loss as an independent risk factor for dementia, estimated to account for 9% of cases. We evaluate candidate brain bases for this relationship. These bases include a common pathology affecting the ascending auditory pathway and multimodal cortex, depletion of cognitive reserve due to an impoverished listening environment, and the occupation of cognitive resources when listening in difficult conditions. We also put forward an alternate mechanism, drawing on new insights into the role of the medial temporal lobe in auditory cognition. In particular, we consider how aberrant activity in the service of auditory pattern analysis, working memory, and object processing may interact with dementia pathology in people with hearing loss. We highlight how the effect of hearing interventions on dementia depends on the specific mechanism and suggest avenues for work at the molecular, neuronal, and systems levels to pin this down.

Episodic and semantic memory processes in the boundary extension effect: An investigation using the remember/know paradigm

BACKGROUND

Boundary extension (BE) is a phenomenon where participants report from memory that they have experienced more information of a scene than was initially presented. The goal of the current study was to investigate whether BE is fully based on episodic memory or also involves semantic scheme knowledge.

METHODS

The study incorporated the remember/know paradigm into a BE task. Scenes were first learned incidentally, with participants later indicating whether they remembered or knew that they had seen the scene before. Next, they had to rate 3 views - zoomed in, zoomed out or unchanged - of the original picture on similarity in closeness in order to measure BE.

RESULTS

The results showed a systematic BE pattern, but no difference in the amount of BE for episodic ('remember') and semantic ('know') memory. Additionally, the remember/know paradigm used in this study showed good sensitivity for both the remember and know responses.

DISCUSSION

The results suggest that BE might not critically depend on the contextual information provided by episodic memory, but rather depends on schematic knowledge shared by episodic and semantic memory. Schematic knowledge might be involved in BE by providing an expectation of what likely lies beyond the boundaries of the scene based on semantic guidance.

GEL CLASSIFICATION

2343 learning & memory.

Characterizing Strategy Use During the Performance of Hippocampal-Dependent Tasks

Recalling the past, thinking about the future, and navigating in the world are linked with a brain structure called the hippocampus. Precisely, how the hippocampus enables these critical cognitive functions is still debated. The strategies people use to perform tasks associated with these functions have been under-studied, and yet, such information could augment our understanding of the associated cognitive processes and neural substrates. Here, we devised and deployed an in-depth protocol to examine the explicit strategies used by 217 participants to perform four naturalistic tasks widely acknowledged to be hippocampal-dependent, namely, those assessing scene imagination, autobiographical memory recall, future thinking, and spatial navigation. In addition, we also investigated strategy use for three laboratory-based memory tasks, one of which is held to be hippocampal-dependent - concrete verbal paired associates (VPA) - and two tasks, which are likely hippocampal-independent - abstract VPA and the dead or alive semantic memory test. We found that scene visual imagery was the dominant strategy not only when mentally imagining scenes, but also during autobiographical memory recall, when thinking about the future and during navigation. Moreover, scene visual imagery strategies were used most frequently during the concrete VPA task, whereas verbal strategies were most prevalent for the abstract VPA task and the dead or alive semantic memory task. The ubiquity of specifically scene visual imagery use across a range of tasks may attest to its, perhaps underappreciated, importance in facilitating cognition, while also aligning with perspectives that emphasize a key role for the hippocampus in constructing scene imagery.

The status of semantic memory in medial temporal lobe amnesia varies with demands on scene construction

Semantic memory is typically preserved in medial temporal lobe (MTL) amnesia. However, there are instances of impairment, such as in the recall of semantic narratives. As some forms of semantic knowledge play out in a spatial context, one possible explanation is that semantic memory impairments, when observed, relate to demands on scene construction - the ability to bind and maintain spatial information in a coherent representation. To investigate whether semantic memory impairments in MTL amnesia can be understood with reference to a deficit in scene construction, the current study examined knowledge of scripts that vary in the extent to which they play out in a scene context in nine patients with MTL amnesia and eighteen healthy control subjects. Scripts are routine activities characterized by an ordered set of actions, including some that are essential for completing the activity. Comparing performance on scene-based scripts (e.g., buying groceries at the grocery store) and object-based scripts (e.g., addressing a letter), we found that patients generated the same number of total action steps as controls for both types of script, but patients were selectively impaired at generating essential actions steps for scene-based scripts. Furthermore, patients made more sequencing and idiosyncratic errors than controls in the scene-based, but not in the object-based, scripts. These findings demonstrate that the hippocampus plays a critical role in the retrieval of semantic knowledge about everyday activities when such retrieval entails scene construction.

Boundary Extension Effect Remembering Different Content Pictures

The goal of this study was to investigate in which cases boundary extension occurs when repainting visual images with different content from your memory. The method that was used in this study is based on a meta-analysis conducted by Hubbard et al. (2010). The method consists of 12 stimuli (dimensions 10x15 cm), which show a photographic image or sketch of a painting. Presented stimuli contain images with different content – finished object, object with its corners removed, emotionally neutral, positive and negative object, moving object; 120 respondents participated in the study, their age ranged from 14 to 45 years old (average age – 25,6). The first hypothesis, stating that boundary extension is more frequent with images of objects with removed corners than those of finished objects repainted from memory, was confirmed. The second hypothesis, stating that boundary extension is more frequent with images of emotionally neutral objects than those of emotionally positive or intense objects repainted from memory, was confirmed. The third hypothesis, stating that boundary extension while repainting images that contain containing moving objects, form memory, unfolds from the expected direction of object movement – the left side, was not confirmed. It was found that boundary extension unfolded at the top of a painting (bird) and at the bottom of a painting (vehicle). The fourth hypothesis was partly confirmed – that boundary extension while repainting images from memory with different content stimuli is more likely to happen among teenagers (years 14–19). The central tendency is more likely among younger adults (20–30), and boundary restriction – among older adults (31–45). The fifth hypothesis was confirmed. As expected, boundary extension when repainting images of different content from memory more often occurrs with women than men. The sixth hypothesis, stating that boundary extensions are more often when repainting images from memory that were painted and are not photographical images, was not confirmed.

Dreaming with hippocampal damage

The hippocampus is linked with both sleep and memory, but there is debate about whether a salient aspect of sleep - dreaming - requires its input. To address this question, we investigated if human patients with focal bilateral hippocampal damage and amnesia engaged in dreaming. We employed a provoked awakening protocol where participants were woken up at various points throughout the night, including during non-rapid eye movement and rapid eye movement sleep, to report their thoughts in that moment. Despite being roused a similar number of times, dream frequency was reduced in the patients compared to control participants, and the few dreams they reported were less episodic-like in nature and lacked content. These results suggest that hippocampal integrity may be necessary for typical dreaming to occur, and aligns dreaming with other hippocampal-dependent processes such as episodic memory that are central to supporting our mental life.

The Medial Temporal Lobe Is Critical for Spatial Relational Perception

The medial temporal lobe (MTL) is traditionally considered to be a system that is specialized for long-term memory. Recent work has challenged this notion by demonstrating that this region can contribute to many domains of cognition beyond long-term memory, including perception and attention. One potential reason why the MTL (and hippocampus specifically) contributes broadly to cognition is that it contains relational representations-representations of multidimensional features of experience and their unique relationship to one another-that are useful in many different cognitive domains. Here, we explore the hypothesis that the hippocampus/MTL plays a critical role in attention and perception via relational representations. We compared human participants with MTL damage to healthy age- and education-matched individuals on attention tasks that varied in relational processing demands. On each trial, participants viewed two images (rooms with paintings). On "similar room" trials, they judged whether the rooms had the same spatial layout from a different perspective. On "similar art" trials, they judged whether the paintings could have been painted by the same artist. On "identical" trials, participants simply had to detect identical paintings or rooms. MTL lesion patients were significantly and selectively impaired on the similar room task. This work provides further evidence that the hippocampus/MTL plays a ubiquitous role in cognition by virtue of its relational and spatial representations and highlights its important contributions to rapid perceptual processes that benefit from attention.

Scene processing following damage to the ventromedial prefrontal cortex

It has been suggested that the mental construction of scene imagery is a core process underpinning functions such as autobiographical memory, future thinking and spatial navigation. Damage to the ventromedial prefrontal cortex in humans can cause deficits in all of these cognitive domains. Moreover, it has also been reported that patients with ventromedial prefrontal cortex lesions are impaired at imagining fictitious scenes, although they seem able to describe specific scenes from autobiographical events. In general, not much is known about how ventromedial prefrontal cortex patients process scenes. Here, we deployed a recently-developed task to provide insights into this issue, which involved detecting either semantic (e.g. an elephant with butterflies for ears) or constructive (e.g. an endless staircase) violations in scene images. Identifying constructive violations typically provokes the formation of internal scene models in healthy control participants. We tested patients with bilateral ventromedial prefrontal cortex damage, brain-damaged control patients and healthy control participants. We found no evidence for statistically significant differences between the groups in detecting either type of violation. These results suggest that an intact ventromedial prefrontal cortex is not necessary for some aspects of scene processing, with implications for understanding its role in functions such as autobiographical memory and future thinking.

Boundaries Extend and Contract in Scene Memory Depending on Image Properties

Boundary extension, a memory distortion in which observers consistently recall a scene with visual information beyond its boundaries, is widely accepted across the psychological sciences as a phenomenon revealing fundamental insight into memory representations [1-3], robust across paradigms [1, 4] and age groups [5-7]. This phenomenon has been taken to suggest that the mental representation of a scene consists of an intermingling of sensory information and a schema that extrapolates the views of a presented scene [8], and it has been used to provide evidence for the role of the neocortex [9] and hippocampus [10, 11] in the schematization of scenes during memory. However, the study of boundary extension has typically focused on object-oriented images that are not representative of our visuospatial world. Here, using a broad set of 1,000 images tested on 2,000 participants in a rapid recognition task, we discover "boundary contraction" as an equally robust phenomenon. Further, image composition largely drives whether extension or contraction is observed-although object-oriented images cause more boundary extension, scene-oriented images cause more boundary contraction. Finally, these effects also occur during drawing tasks, including a task with minimal memory load-when participants copy an image during viewing. Collectively, these results show that boundary extension is not a universal phenomenon and put into question the assumption that scene memory automatically combines visual information with additional context derived from internal schema. Instead, our memory for a scene may be largely driven by its visual composition, with a tendency to extend or contract the boundaries equally likely.

Learning abilities

Learning abilities are present in infancy, as they are critical for adaptation. From simple habituation and novelty responses to stimuli, learning capacities evolve throughout the lifespan. During development, learning abilities become more flexible and integrated across sensory modalities, allowing the encoding of more complex information, and in larger amounts. In turn, an increasing knowledge base leads to adaptive changes in behavior, making responses and actions more precise and effective. The objective of this chapter is to review the main behavioral manifestations of human learning abilities in early development and their biologic underpinnings, ranging from the cellular level to neurocognitive systems and mechanisms. We first focus on the ability to learn from repetitions of stimuli and how years of research in this field have recently contributed to theories of fundamental brain mechanisms whose implications for cognitive development are under study. The ability to memorize associations between different items and events is addressed next as we review the variety of contexts in which this associative memory and its neurologic bases come into play. Together, repetition-based learning and associative memory provide powerful means of understanding the surrounding environment, not only through the gathering and consolidation of specific types of information, but also by continually testing and adjusting stored information to better adapt to changing conditions.

Scene construction impairments in frontotemporal dementia: Evidence for a primary hippocampal contribution

The capacity to generate naturalistic three-dimensional and spatially coherent representations of the world, i.e., scene construction, is posited to lie at the heart of a wide range of complex cognitive endeavours. Clinical populations with selective damage to key nodes of a putative scene construction network of the brain have provided important insights regarding the contribution of medial temporal and prefrontal regions in this regard. Here, we explored the capacity for atemporal scene construction, and its associated neural substrates, in the behavioural-variant of frontotemporal dementia (bvFTD); a neurodegenerative brain disorder in which atrophy systematically erodes medial and lateral prefrontal cortices with variable medial temporal lobe involvement. Nineteen bvFTD patients were compared to 18 typical Alzheimer's Disease (AD), and 25 healthy older Control participants on a scene construction task. Relative to Controls, both patient groups displayed marked impairments in generating contextually detailed and spatially coherent scenes, with bvFTD indistinguishable from AD patients across the majority of task metrics. Voxel-based morphometry, based on structural brain MRI, revealed divergent neural substrates of scene construction performance in each patient group. Despite widespread medial and lateral prefrontal atrophy, the capacity to generate richly detailed and spatially coherent scenes in bvFTD was found to rely predominantly upon the integrity of right medial temporal structures, including the hippocampus and parahippocampal gyrus. Scene construction impairments in AD, by contrast, hinged upon the integrity of posterior parietal brain regions. Our findings in bvFTD resonate with a large body of work implicating the right hippocampus in the construction of spatially integrated scene imagery. How these impairments relate to changes in autobiographical memory and prospection in bvFTD will be an important question for future studies to address.

Reflections on the spoon test

In this paper, we shall use Tulving's seminal empirical and theoretical research including the 'Spoon Test' to explore memory and mental time travel and its origins and role in planning for the future. We will review the comparative research on future planning and episodic foresight in pre-verbal children and non-verbal animals to explore how this may be manifest as wordless thoughts.

Picture This: A Review of Research Relating to Narrative Processing by Moving Image Versus Language

Reading fiction for pleasure is robustly correlated with improved cognitive attainment and other benefits. It is also in decline among young people in developed nations, in part because of competition from moving image fiction. We review existing research on the differences between reading or hearing verbal fiction and watching moving image fiction, as well as looking more broadly at research on image or text interactions and visual versus verbal processing. We conclude that verbal narrative generates more diverse responses than moving image narrative. We note that reading and viewing narrative are different tasks, with different cognitive loads. Viewing moving image narrative mostly involves visual processing with some working memory engagement, whereas reading narrative involves verbal processing, visual imagery, and personal memory (Xu et al., 2005). Attempts to compare the two by creating equivalent stimuli and task demands face a number of challenges. We discuss the difficulties of such comparative approaches. We then investigate the possibility of identifying lower level processing mechanisms that might distinguish cognition of the two media and propose internal scene construction and working memory as foci for future research. Although many of the sources we draw on concentrate on English-speaking participants in European or North American settings, we also cover material relating to speakers of Dutch, German, Hebrew, and Japanese in their respective countries, and studies of a remote Turkish mountain community.

Lesion Studies in Contemporary Neuroscience

Studies of humans with focal brain damage and non-human animals with experimentally induced brain lesions have provided pivotal insights into the neural basis of behavior. As the repertoire of neural manipulation and recording techniques expands, the utility of studying permanent brain lesions bears re-examination. Studies on the effects of permanent lesions provide vital data about brain function that are distinct from those of reversible manipulations. Focusing on work carried out in humans and nonhuman primates, we address the inferential strengths and limitations of lesion studies, recent methodological developments, the integration of this approach with other methods, and the clinical and ecological relevance of this research. We argue that lesion studies are essential to the rigorous assessment of neuroscience theories.

Scene Perception in the Human Brain

Humans are remarkably adept at perceiving and understanding complex real-world scenes. Uncovering the neural basis of this ability is an important goal of vision science. Neuroimaging studies have identified three cortical regions that respond selectively to scenes: parahippocampal place area, retrosplenial complex/medial place area, and occipital place area. Here, we review what is known about the visual and functional properties of these brain areas. Scene-selective regions exhibit retinotopic properties and sensitivity to low-level visual features that are characteristic of scenes. They also mediate higher-level representations of layout, objects, and surface properties that allow individual scenes to be recognized and their spatial structure ascertained. Challenges for the future include developing computational models of information processing in scene regions, investigating how these regions support scene perception under ecologically realistic conditions, and understanding how they operate in the context of larger brain networks.

Scenes facilitate associative memory and integration

How do we form mental links between related items? Forming associations between representations is a key feature of episodic memory and provides the foundation for learning and guiding behavior. Theories suggest that spatial context plays a supportive role in episodic memory, providing a scaffold on which to form associations, but this has mostly been tested in the context of autobiographical memory. We examined the memory boosting effect of spatial stimuli in memory using an associative inference paradigm combined with eye-tracking. Across two experiments, we found that memory was better for associations that included scenes, even indirectly, compared to objects and faces. Eye-tracking measures indicated that these effects may be partly mediated by greater fixations to scenes compared to objects, but did not explain the differences between scenes and faces. These results suggest that scenes facilitate associative memory and integration across memories, demonstrating evidence in support of theories of scenes as a spatial scaffold for episodic memory. A shared spatial context may promote learning and could potentially be leveraged to improve learning and memory in educational settings or for memory-impaired populations.

Long-term dynamics of mind wandering: ultradian rhythms in thought generation

Using the method of experience sampling, we studied the fluctuations in thought generation and cognitive control strength during the wakeful hours of the day, centered around episodes of mind wandering. Thought generation, measured in terms of the number of thoughts that concurrently occupy the mind at sampling time, goes through regular 4–6 h cycles, suggesting the mind operates with an alternation of focused and multitasking modes. Cognitive control strength rises and falls in relative coordination with thought generation, implying that both are occasionally misaligned. This happens, in particular, when cognitive control suddenly drops after having been keeping up with a cycle of thought generation. When this drop occurs while the thought generation cycle is still up, mind wandering appears. As cognitive control quickly resumes before returning to intermediate values, the thought generation cycle begins to fall again, and the mind wandering episode comes to an end. Implications regarding the role of long-term regulation in mind-wandering processes are discussed.

Self-related processing and future thinking: Distinct contributions of ventromedial prefrontal cortex and the medial temporal lobes

Episodic future thinking depends on a core network of regions that involves, in addition to the medial temporal lobes (MTL), the ventromedial prefrontal cortex (vmPFC). Neuroimaging studies suggest that vmPFC is particularly involved when future thinking requires consideration of self-relevant information, but lesion evidence for a special role of vmPFC in constructing self-relevant scenarios is limited. To clarify the involvement of vmPFC in future thinking, eight patients with vmPFC lesions were asked to imagine future events pertaining to the self or to another person, and their performance was contrasted with that of eight patients with MTL lesions. Patients with vmPFC lesions were no more detailed in their description of future events pertaining to the self than of events pertaining to another person. In contrast, like controls, patients with MTL lesions showed a self-benefit, despite impoverished performance overall. These findings accord with evidence from neuroimaging studies and elucidate the distinct contributions of vmPFC and MTL to future thinking.

Spared Perception of the Structure of Scenes after Hippocampal Damage

To explore whether the hippocampus might be important for certain spatial operations in addition to its well-known role in memory, we administered two tasks in which participants judged whether objects embedded in scenes or whether scenes themselves could exist in 3-D space. Patients with damage limited to the hippocampus performed as well as controls in both tasks. A patient with large medial-temporal lobe lesions had a bias to judge objects in scenes and scenes themselves as possible, performing well with possible stimuli but poorly with impossible stimuli in both tasks. All patients were markedly impaired at remembering the tasks. The hippocampus appears not to be essential for judging the structural coherence of objects in scenes or the coherence of scenes. The findings conform to what is now a sizeable literature emphasizing the importance of the hippocampus for memory. We discuss our results in light of findings that other patients have sometimes been reported to be disadvantaged by spatial tasks like the ones studied here, despite less hippocampal damage and milder memory impairment.

Identifying the cognitive processes underpinning hippocampal-dependent tasks

Autobiographical memory, future thinking, and spatial navigation are critical cognitive functions that are thought to be related and are known to depend upon a brain structure called the hippocampus. Surprisingly, direct evidence for their interrelatedness is lacking, as is an understanding of why they might be related. There is debate about whether they are linked by an underlying memory-related process or, as has more recently been suggested, because they each require the endogenous construction of scene imagery. Here, using a large sample of participants and multiple cognitive tests with a wide spread of individual differences in performance, we found that these functions are indeed related. Mediation analyses further showed that scene construction, and not memory, mediated (explained) the relationships between the functions. These findings offer a fresh perspective on autobiographical memory, future thinking, navigation, and also on the hippocampus, where scene imagery appears to play an influential role. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Differences in functional connectivity along the anterior-posterior axis of human hippocampal subfields

There is a paucity of information about how human hippocampal subfields are functionally connected to each other and to neighbouring extra-hippocampal cortices. In particular, little is known about whether patterns of functional connectivity (FC) differ down the anterior-posterior axis of each subfield. Here, using high resolution structural MRI we delineated the hippocampal subfields in healthy young adults. This included the CA fields, separating DG/CA4 from CA3, separating the pre/parasubiculum from the subiculum, and also segmenting the uncus. We then used high resolution resting state functional MRI to interrogate FC. We first analysed the FC of each hippocampal subfield in its entirety, in terms of FC with other subfields and with the neighbouring regions, namely entorhinal, perirhinal, posterior parahippocampal and retrosplenial cortices. Next, we analysed FC for different portions of each hippocampal subfield along its anterior-posterior axis, in terms of FC between different parts of a subfield, FC with other subfield portions, and FC of each subfield portion with the neighbouring cortical regions of interest. We found that intrinsic functional connectivity between the subfields aligned generally with the tri-synaptic circuit but also extended beyond it. Our findings also revealed that patterns of functional connectivity between the subfields and neighbouring cortical areas differed markedly along the anterior-posterior axis of each hippocampal subfield. Overall, these results contribute to ongoing efforts to characterise human hippocampal subfield connectivity, with implications for understanding hippocampal function.

•

High resolution resting state functional MRI scans were collected.

•

We investigated functional connectivity (FC) of human hippocampal subfields.

•

We specifically examined FC along the anterior-posterior axis of subfields.

•

FC between subfields extended beyond the canonical tri-synaptic circuit.

•

Different portions of subfields showed different patterns of FC with neocortex.

Remote Memory and the Hippocampus: A Constructive Critique

The hippocampus is known to be recruited during the recall of experiences from our distant past, despite evidence that memory traces in this region vanish over time. Extant theories of systems-level consolidation have yet to accommodate both phenomena. We propose that the hippocampus reconstructs remote memories in the absence of the original trace. It accomplishes this by assembling consolidated neocortical elements into spatially coherent scenes that form the basis of unfolding memory events. This reconstruction is likely facilitated by input from the ventromedial prefrontal cortex. This process-oriented approach to hippocampal recruitment during remote recollection is consistent with its increasingly acknowledged role in constructing mental representations beyond the domain of memory.

Verbal Paired Associates and the Hippocampus: The Role of Scenes

It is widely agreed that patients with bilateral hippocampal damage are impaired at binding pairs of words together. Consequently, the verbal paired associates (VPA) task has become emblematic of hippocampal function. This VPA deficit is not well understood and is particularly difficult for hippocampal theories with a visuospatial bias to explain (e.g., cognitive map and scene construction theories). Resolving the tension among hippocampal theories concerning the VPA could be important for leveraging a fuller understanding of hippocampal function. Notably, VPA tasks typically use high imagery concrete words and so conflate imagery and binding. To determine why VPA engages the hippocampus, we devised an fMRI encoding task involving closely matched pairs of scene words, pairs of object words, and pairs of very low imagery abstract words. We found that the anterior hippocampus was engaged during processing of both scene and object word pairs in comparison to abstract word pairs, despite binding occurring in all conditions. This was also the case when just subsequently remembered stimuli were considered. Moreover, for object word pairs, fMRI activity patterns in anterior hippocampus were more similar to those for scene imagery than object imagery. This was especially evident in participants who were high imagery users and not in mid and low imagery users. Overall, our results show that hippocampal engagement during VPA, even when object word pairs are involved, seems to be evoked by scene imagery rather than binding. This may help to resolve the issue that visuospatial hippocampal theories have in accounting for verbal memory.

Remembering rewarding futures: A simulation-selection model of the hippocampus

Despite tremendous progress, the neural circuit dynamics underlying hippocampal mnemonic processing remain poorly understood. We propose a new model for hippocampal function-the simulation-selection model-based on recent experimental findings and neuroecological considerations. Under this model, the mammalian hippocampus evolved to simulate and evaluate arbitrary navigation sequences. Specifically, we suggest that CA3 simulates unexperienced navigation sequences in addition to remembering experienced ones, and CA1 selects from among these CA3-generated sequences, reinforcing those that are likely to maximize reward during offline idling states. High-value sequences reinforced in CA1 may allow flexible navigation toward a potential rewarding location during subsequent navigation. We argue that the simulation-selection functions of the hippocampus have evolved in mammals mostly because of the unique navigational needs of land mammals. Our model may account for why the mammalian hippocampus has evolved not only to remember, but also to imagine episodes, and how this might be implemented in its neural circuits.

Boundary extension is attenuated in patients with ventromedial prefrontal cortex damage

The ventromedial prefrontal cortex (vmPFC) and hippocampus have been implicated in the mental construction of scenes and events. However, little is known about their specific contributions to these cognitive functions. Boundary extension (BE) is a robust indicator of fast, automatic, and implicit scene construction. BE occurs when individuals who are viewing scenes automatically imagine what might be beyond the view, and consequently later misremember having seen a greater expanse of the scene. Patients with hippocampal damage show attenuated BE because of their scene construction impairment. In the current study, we administered BE tasks to patients with vmPFC damage, brain-damaged control patients, and healthy control participants. We also contrasted the performance of these patients to the previously-published data from patients with hippocampal lesions (Mullally, Intraub, & Maguire, 2012). We found that vmPFC-damaged patients showed reduced BE compared to brain-damaged and healthy controls. Indeed, BE attenuation was similar following vmPFC or hippocampal damage. Notably, however, whereas hippocampal damage seems to particularly impair the spatial coherence of scenes, vmPFC damage leads to a difficulty constructing scenes in a broader sense, with the prediction of what should be in a scene, and the monitoring or integration of the scene elements being particularly compromised. We conclude that vmPFC and hippocampus play important and complementary roles in scene construction.

Animacy and real-world size shape object representations in the human medial temporal lobes

Identifying what an object is, and whether an object has been encountered before, is a crucial aspect of human behavior. Despite this importance, we do not yet have a complete understanding of the neural basis of these abilities. Investigations into the neural organization of human object representations have revealed category specific organization in the ventral visual stream in perceptual tasks. Interestingly, these categories fall within broader domains of organization, with reported distinctions between animate, inanimate large, and inanimate small objects. While there is some evidence for category specific effects in the medial temporal lobe (MTL), in particular in perirhinal and parahippocampal cortex, it is currently unclear whether domain level organization is also present across these structures. To this end, we used fMRI with a continuous recognition memory task. Stimuli were images of objects from several different categories, which were either animate or inanimate, or large or small within the inanimate domain. We employed representational similarity analysis (RSA) to test the hypothesis that object-evoked responses in MTL structures during recognition-memory judgments also show evidence for domain-level organization along both dimensions. Our data support this hypothesis. Specifically, object representations were shaped by either animacy, real-world size, or both, in perirhinal and parahippocampal cortex, and the hippocampus. While sensitivity to these dimensions differed across structures when probed individually, hinting at interesting links to functional differentiation, similarities in organization across MTL structures were more prominent overall. These results argue for continuity in the organization of object representations in the ventral visual stream and the MTL.

Coherence in the Visual Imagination

An incoherent visualization is when aspects of different senses of a word (e.g., the biological "mouse" vs. the computer "mouse") are present in the same visualization (e.g., a visualization of a biological mouse in the same image with a computer tower). We describe and implement a new model of creating contextual coherence in the visual imagination called Coherencer, based on the SOILIE model of imagination. We show that Coherencer is able to generate scene descriptions that are more coherent than SOILIE's original approach as well as a parallel connectionist algorithm that is considered competitive in the literature on general coherence. We also show that co-occurrence probabilities are a better association representation than holographic vectors and that better models of coherence improve the resulting output independent of the association type that is used. Theoretically, we show that Coherencer is consistent with other models of cognitive generation. In particular, Coherencer is a similar, but more cognitively plausible model than the C3 model of concept combination created by Costello and Keane (2000). We show that Coherencer is also consistent with both the modal schematic indices of perceptual symbol systems theory (Barsalou, 1999) and the amodal contextual constraints of Thagard's (2002) theory of coherence. Finally, we describe how Coherencer is consistent with contemporary research on the hippocampus, and we show evidence that the process of making a visualization coherent is serial.

Comparing and Contrasting the Cognitive Effects of Hippocampal and Ventromedial Prefrontal Cortex Damage: A Review of Human Lesion Studies

The hippocampus and ventromedial prefrontal cortex (vmPFC) are closely connected brain regions whose functions are still debated. In order to offer a fresh perspective on understanding the contributions of these two brain regions to cognition, in this review we considered cognitive tasks that usually elicit deficits in hippocampal-damaged patients (e.g., autobiographical memory retrieval), and examined the performance of vmPFC-lesioned patients on these tasks. We then took cognitive tasks where performance is typically compromised following vmPFC damage (e.g., decision making), and looked at how these are affected by hippocampal lesions. Three salient motifs emerged. First, there are surprising gaps in our knowledge about how hippocampal and vmPFC patients perform on tasks typically associated with the other group. Second, while hippocampal or vmPFC damage seems to adversely affect performance on so-called hippocampal tasks, the performance of hippocampal and vmPFC patients clearly diverges on classic vmPFC tasks. Third, although performance appears analogous on hippocampal tasks, on closer inspection, there are significant disparities between hippocampal and vmPFC patients. Based on these findings, we suggest a tentative hierarchical model to explain the functions of the hippocampus and vmPFC. We propose that the vmPFC initiates the construction of mental scenes by coordinating the curation of relevant elements from neocortical areas, which are then funneled into the hippocampus to build a scene. The vmPFC then engages in iterative re-initiation via feedback loops with neocortex and hippocampus to facilitate the flow and integration of the multiple scenes that comprise the coherent unfolding of an extended mental event.