Neural correlates of the encoding of multimodal contextual features

Greater Neural Differentiation in the Ventral Visual Cortex Is Associated with Youthful Memory in Superaging

Superagers are older adults who maintain youthful memory despite advanced age. Previous studies showed that superagers exhibit greater structural and intrinsic functional brain integrity, which contribute to their youthful memory. However, no studies, to date, have examined brain activity as superagers learn and remember novel information. Here, we analyzed functional magnetic resonance imaging data collected from 41 young and 40 older adults while they performed a paired associate visual recognition memory task. Superaging was defined as youthful performance on the long delay free recall of the California Verbal Learning Test. We assessed the fidelity of neural representations as participants encoded and later retrieved a series of word stimuli paired with a face or a scene image. Superagers, like young adults, exhibited more distinct neural representations in the fusiform gyrus and parahippocampal gyrus while viewing visual stimuli belonging to different categories (greater neural differentiation) and more similar category representations between encoding and retrieval (greater neural reinstatement), compared with typical older adults. Greater neural differentiation and reinstatement were associated with superior memory performance in all older adults. Given that the fidelity of cortical sensory processing depends on neural plasticity and is trainable, these mechanisms may be potential biomarkers for future interventions to promote successful aging.

Progression from Feature-Specific Brain Activity to Hippocampal Binding during Episodic Encoding

The hallmark of episodic memory is recollecting multiple perceptual details tied to a specific spatial-temporal context. To remember an event, it is therefore necessary to integrate such details into a coherent representation during initial encoding. Here we tested how the brain encodes and binds multiple, distinct kinds of features in parallel, and how this process evolves over time during the event itself. We analyzed data from 27 human subjects (16 females, 11 males) who learned a series of objects uniquely associated with a color, a panoramic scene location, and an emotional sound while fMRI data were collected. By modeling how brain activity relates to memory for upcoming or just-viewed information, we were able to test how the neural signatures of individual features as well as the integrated event changed over the course of encoding. We observed a striking dissociation between early and late encoding processes: left inferior frontal and visuo-perceptual signals at the onset of an event tracked the amount of detail subsequently recalled and were dissociable based on distinct remembered features. In contrast, memory-related brain activity shifted to the left hippocampus toward the end of an event, which was particularly sensitive to binding item color and sound associations with spatial information. These results provide evidence of early, simultaneous feature-specific neural responses during episodic encoding that predict later remembering and suggest that the hippocampus integrates these features into a coherent experience at an event transition.SIGNIFICANCE STATEMENT Understanding and remembering complex experiences are crucial for many socio-cognitive abilities, including being able to navigate our environment, predict the future, and share experiences with others. Probing the neural mechanisms by which features become bound into meaningful episodes is a vital part of understanding how we view and reconstruct the rich detail of our environment. By testing memory for multimodal events, our findings show a functional dissociation between early encoding processes that engage lateral frontal and sensory regions to successfully encode event features, and later encoding processes that recruit hippocampus to bind these features together. These results highlight the importance of considering the temporal dynamics of encoding processes supporting multimodal event representations.

Above and beyond the concrete: The diverse representational substrates of the predictive brain

In recent years, scientists have increasingly taken to investigate the predictive nature of cognition. We argue that prediction relies on abstraction, and thus theories of predictive cognition need an explicit theory of abstract representation. We propose such a theory of the abstract representational capacities that allow humans to transcend the "here-and-now." Consistent with the predictive cognition literature, we suggest that the representational substrates of the mind are built as a hierarchy, ranging from the concrete to the abstract; however, we argue that there are qualitative differences between elements along this hierarchy, generating meaningful, often unacknowledged, diversity. Echoing views from philosophy, we suggest that the representational hierarchy can be parsed into: modality-specific representations, instantiated on perceptual similarity; multimodal representations, instantiated primarily on the discovery of spatiotemporal contiguity; and categorical representations, instantiated primarily on social interaction. These elements serve as the building blocks of complex structures discussed in cognitive psychology (e.g., episodes, scripts) and are the inputs for mental representations that behave like functions, typically discussed in linguistics (i.e., predicators). We support our argument for representational diversity by explaining how the elements in our ontology are all required to account for humans' predictive cognition (e.g., in subserving logic-based prediction; in optimizing the trade-off between accurate and detailed predictions) and by examining how the neuroscientific evidence coheres with our account. In doing so, we provide a testable model of the neural bases of conceptual cognition and highlight several important implications to research on self-projection, reinforcement learning, and predictive-processing models of psychopathology.

Audiovisual integration supports face-name associative memory formation

Prior multisensory experience influences how we perceive our environment, and hence how memories are encoded for subsequent retrieval. This study investigated if audiovisual (AV) integration and associative memory formation rely on overlapping or distinct processes. Our functional magnetic resonance imaging results demonstrate that the neural mechanisms underlying AV integration and associative memory overlap substantially. In particular, activity in anterior superior temporal sulcus (STS) is increased during AV integration and also determines the success of novel AV face-name association formation. Dynamic causal modeling results further demonstrate how the anterior STS interacts with the associative memory system to facilitate successful memory formation for AV face-name associations. Specifically, the connection of fusiform gyrus to anterior STS is enhanced while the reverse connection is reduced when participants subsequently remembered both face and name. Collectively, our results demonstrate how multisensory associative memories can be formed for subsequent retrieval.

Persistent modifications of hippocampal synaptic function during remote spatial memory

A widely accepted notion for a process underlying memory formation is that learning changes the efficacy of synapses by the mechanism of synaptic plasticity. While there is compelling evidence of changes in synaptic efficacy observed after learning, demonstration of persistent synaptic changes accompanying memory has been elusive. We report that acquisition of a hippocampus and long-term potentiation dependent place memory persistently changes the function of CA1 synapses. Using extracellular recordings we measured CA3-CA1 and EC-CA1 synaptic responses and found robust changes in the CA3-CA1 pathway after memory training. Crucially, these changes in synaptic function lasted at least a month and coincided with the persistence of long-term place memories; the changes were only observed in animals that expressed robust memory, and not in animals with poor memory recall. Interestingly, our findings were observed at the level of populations of synapses; suggesting that memory formation recruits widespread synaptic circuits and persistently reorganizes their function to store information.

Altered Effective Connectivity of Hippocampus-Dependent Episodic Memory Network in mTBI Survivors

Traumatic brain injuries (TBIs) are generally recognized to affect episodic memory. However, less is known regarding how external force altered the way functionally connected brain structures of the episodic memory system interact. To address this issue, we adopted an effective connectivity based analysis, namely, multivariate Granger causality approach, to explore causal interactions within the brain network of interest. Results presented that TBI induced increased bilateral and decreased ipsilateral effective connectivity in the episodic memory network in comparison with that of normal controls. Moreover, the left anterior superior temporal gyrus (aSTG, the concept forming hub), left hippocampus (the personal experience binding hub), and left parahippocampal gyrus (the contextual association hub) were no longer network hubs in TBI survivors, who compensated for hippocampal deficits by relying more on the right hippocampus (underlying perceptual memory) and the right medial frontal gyrus (MeFG) in the anterior prefrontal cortex (PFC). We postulated that the overrecruitment of the right anterior PFC caused dysfunction of the strategic component of episodic memory, which caused deteriorating episodic memory in mTBI survivors. Our findings also suggested that the pattern of brain network changes in TBI survivors presented similar functional consequences to normal aging.

Hippocampal long-term depression is facilitated by the acquisition and updating of memory of spatial auditory content and requires mGlu5 activation

Long-term potentiation (LTP) and long-term depression (LTD) are key cellular processes that support memory formation. Whereas increases of synaptic strength by means of LTP may support the creation of a spatial memory 'engram', LTD appears to play an important role in refining and optimising experience-dependent encoding. A differentiation in the role of hippocampal subfields is apparent. For example, LTD in the dentate gyrus (DG) is enabled by novel learning about large visuospatial features, whereas in area CA1, it is enabled by learning about discrete aspects of spatial content, whereby, both discrete visuospatial and olfactospatial cues trigger LTD in CA1. Here, we explored to what extent local audiospatial cues facilitate information encoding in the form of LTD in these subfields. Coupling of low frequency afferent stimulation (LFS) with discretely localised, novel auditory tones in the sonic hearing, or ultrasonic range, facilitated short-term depression (STD) into LTD (>24 h) in CA1, but not DG. Re-exposure to the now familiar audiospatial configuration ca. 1 week later failed to enhance STD. Reconfiguration of the same audiospatial cues resulted anew in LTD when ultrasound, but not non-ultrasound cues were used. LTD facilitation that was triggered by novel exposure to spatially arranged tones, or to spatial reconfiguration of the same tones were both prevented by an antagonism of the metabotropic glutamate receptor, mGlu5. These data indicate that, if behaviourally salient enough, the hippocampus can use audiospatial cues to facilitate LTD that contributes to the encoding and updating of spatial representations. Effects are subfield-specific, and require mGlu5 activation, as is the case for visuospatial information processing. These data reinforce the likelihood that LTD supports the encoding of spatial features, and that this occurs in a qualitative and subfield-specific manner. They also support that mGlu5 is essential for synaptic encoding of spatial experience. This article is part of the Special Issue entitled 'Metabotropic Glutamate Receptors, 5 years on'.

Episodic memory in normal aging and Alzheimer disease: Insights from imaging and behavioral studies

Age-related cognitive changes often include difficulties in retrieving memories, particularly those that rely on personal experiences within their temporal and spatial contexts (i.e., episodic memories). This decline may vary depending on the studied phase (i.e., encoding, storage or retrieval), according to inter-individual differences, and whether we are talking about normal or pathological (e.g., Alzheimer disease; AD) aging. Such cognitive changes are associated with different structural and functional alterations in the human neural network that underpins episodic memory. The prefrontal cortex is the first structure to be affected by age, followed by the medial temporal lobe (MTL), the parietal cortex and the cerebellum. In AD, however, the modifications occur mainly in the MTL (hippocampus and adjacent structures) before spreading to the neocortex. In this review, we will present results that attempt to characterize normal and pathological cognitive aging at multiple levels by integrating structural, behavioral, inter-individual and neuroimaging measures of episodic memory.

The relationship between task-related and subsequent memory effects

The primary aim of this fMRI study was to assess the proposal that negative subsequent memory effects-greater activity for later forgotten relative to later remembered study items-are localized to regions demonstrating task-negative effects, and hence to potential components of the default mode network. Additionally, we assessed whether positive subsequent memory effects overlapped with regions demonstrating task-positive effects. Eighteen participants were scanned while they made easy or difficult relational judgments on visually presented word pairs. Easy and hard task blocks were interleaved with fixation-only rest periods. In the later unscanned test phase, associative recognition judgments were required on intact word pairs (studied pairs), rearranged pairs (pairs formed from words presented on different study trials) and new pairs. Subsequent memory effects were identified by contrasting the activity elicited by study pairs that went on to be correctly endorsed as intact versus incorrectly endorsed as rearranged. Task effects were identified by contrasting all study items and rest blocks. Both task-negative and task-positive effects were evident in widespread cortical regions and negative and positive subsequent memory effects were generally confined to task-negative and task-positive regions respectively. However, subsequent memory effects could be identified in only a fraction of task-sensitive voxels and, unlike task effects, were insensitive to the difficulty manipulation. The findings for the negative subsequent memory effects are consistent with recent proposals that the default mode network is functionally heterogeneous, and suggest that these effects are not accurately characterized as reflections of the modulation of the network as a whole.

Comparison of the neural correlates of encoding item-item and item-context associations

fMRI was employed to investigate the role of the left inferior frontal gyrus (LIFG) in the encoding of item-item and item-context associations. On each of a series of study trials subjects viewed a picture that was presented either to the left or right of fixation, along with a subsequently presented word that appeared at fixation. Memory was tested in a subsequent memory test that took place outside of the scanner. On each test trial one of two forced choice judgments was required. For the associative test, subjects chose between the word paired with the picture at study and a word studied on a different trial. For the source test, the judgment was whether the picture had been presented on the left or right. Successful encoding of associative information was accompanied by subsequent memory effects in several cortical regions, including much of the LIFG. By contrast, successful source encoding was selectively associated with a subsequent memory effect in right fusiform cortex. The finding that the LIFG was enhanced during successful associative, but not source, encoding is interpreted in light of the proposal that subsequent memory effects are localized to cortical regions engaged by the on-line demands of the study task.