Dissociation of the neural correlates of visual and auditory contextual encoding

Evaluating frontoparietal network topography for diagnostic markers of Alzheimer's disease

Numerous prospective biomarkers are being studied for their ability to diagnose various stages of Alzheimer's disease (AD). High-density electroencephalogram (EEG) methods show promise as an accurate, economical, non-invasive approach to measuring the electrical potentials of brains associated with AD. Event-related potentials (ERPs) may serve as clinically useful biomarkers of AD. Through analysis of secondary data, the present study examined the performance and distribution of N4/P6 ERPs across the frontoparietal network (FPN) using EEG topographic mapping. ERP measures and memory as a function of reaction time (RT) were compared between a group of (n = 63) mild untreated AD patients and a control group of (n = 73) healthy age-matched adults. Based on the literature presented, it was expected that healthy controls would outperform patients in peak amplitude and mean component latency across three parameters of memory when measured at optimal N4 (frontal) and P6 (parietal) locations. It was also predicted that the control group would exhibit neural cohesion through FPN integration during cross-modal tasks, thus demonstrating healthy cognitive functioning consistent with older healthy adults. By targeting select frontal and parietal EEG reference channels based on N4/P6 component time windows and positivity, our findings demonstrated statistically significant group variations between controls and patients in N4/P6 peak amplitudes and latencies during cross-modal testing. Our results also support that the N4 ERP might be stronger than its P6 counterpart as a possible candidate biomarker. We conclude through topographic mapping that FPN integration occurs in healthy controls but is absent in AD patients during cross-modal memory tasks.

The hearing hippocampus

The hippocampus has a well-established role in spatial and episodic memory but a broader function has been proposed including aspects of perception and relational processing. Neural bases of sound analysis have been described in the pathway to auditory cortex, but wider networks supporting auditory cognition are still being established. We review what is known about the role of the hippocampus in processing auditory information, and how the hippocampus itself is shaped by sound. In examining imaging, recording, and lesion studies in species from rodents to humans, we uncover a hierarchy of hippocampal responses to sound including during passive exposure, active listening, and the learning of associations between sounds and other stimuli. We describe how the hippocampus' connectivity and computational architecture allow it to track and manipulate auditory information - whether in the form of speech, music, or environmental, emotional, or phantom sounds. Functional and structural correlates of auditory experience are also identified. The extent of auditory-hippocampal interactions is consistent with the view that the hippocampus makes broad contributions to perception and cognition, beyond spatial and episodic memory. More deeply understanding these interactions may unlock applications including entraining hippocampal rhythms to support cognition, and intervening in links between hearing loss and dementia.

Representing the Good and Bad: fMRI signatures during the encoding of multisensory positive, negative, and neutral events

Few studies have examined how multisensory emotional experiences are processed and encoded into memory. Here, we aimed to determine whether, at encoding, activity within functionally-defined visual- and auditory-processing brain regions discriminated the emotional category (i.e., positive, negative, or neutral) of the multisensory (audio-visual) events. Participants incidentally encoded positive, negative, and neutral multisensory stimuli during event-related functional magnetic resonance imaging (fMRI). Following a 3-h post-encoding delay, their memory for studied stimuli was tested, allowing us to identify emotion-category-specific subsequent-memory effects focusing on medial temporal lobe regions (i.e., amygdala, hippocampus) and visual- and auditory-processing regions. We used a combination of univariate and multivoxel pattern fMRI analyses (MVPA) to examine emotion-category-specificity in mean activity levels and neural patterning, respectively. Univariate analyses revealed many more visual regions that showed negative-category-specificity relative to positive-category-specificity, and auditory regions only showed negative-category-specificity. These results suggest that negative emotion is more closely tied to information contained within sensory regions, a conclusion that was supported by the MVPA analyses. Functional connectivity analyses further revealed that the visual amplification of category-selective processing is driven, in part, by mean signal from the amygdala. Interestingly, while stronger representations in visuo-auditory regions were related to subsequent-memory for neutral multisensory stimuli, they were related to subsequent-forgetting of positive and negative stimuli. Neural patterning in the hippocampus and amygdala were related to memory for negative multisensory stimuli. These results provide new evidence that negative emotional stimuli are processed with increased engagement of visuosensory regions, but that this sensory engagement-that generalizes across the entire emotion category-is not the type of sensory encoding that is most beneficial for later retrieval.

Examining the influence of brain stimulation to the medial prefrontal cortex on the self-reference effect in memory

Past work shows that processing information in relation to the self improves memory which is known as the self-reference effect in memory. Other work suggests that transcranial direct current stimulation (tDCS) can also improve memory. Given recent research on self-reference context memory effects (improved memory for contextual episodic details associated with self-referential processing), we were interested in examining the extent stimulation might increase the magnitude of the self-reference context memory effect. In this investigation, participants studied objects superimposed on different background scenes in either a self-reference or other-reference condition while receiving either active or sham stimulation to the dorsal medial prefrontal cortex (dmPFC), a cortical region known to support self-reference context memory effects. Participants then completed a memory test that assessed item memory (have you seen this object before?) and context memory (with which background scene was this object paired?). Results showed a self-reference context memory effect driven by enhanced memory for stimuli processed in the self-reference compared to the other-reference condition across all participants (regardless of stimulation condition). tDCS, however, had no effect on memory. Specifically, stimulation did not increase the magnitude of the self-reference context memory effect under active compared to sham stimulation. These results suggest that stimulation of the dmPFC at encoding may not add to the memory benefits induced by self-referential processing suggesting a boundary condition to tDCS effects on memory.

Evaluating the learning of stimulus-control associations through incidental memory of reinforcement events

Cognitive control describes the ability to use internal goals to strategically guide how we process and respond to our environment. Changes in the environment lead to adaptation in control strategies. This type of control learning can be observed in performance adjustments in response to varying proportions of easy to hard trials over blocks of trials on classic control tasks. Known as the list-wide proportion congruent (LWPC) effect, increased difficulty is met with enhanced attentional control. Recent research has shown that motivational manipulations may enhance the LWPC effect, but the underlying mechanisms are not yet understood. We manipulated Stroop proportion congruency over blocks of trials and, after each trial, provided participants with either performance-contingent feedback ("correct/incorrect") or noncontingent feedback ("response logged") above trial-unique, task-irrelevant images (reinforcement events). The LWPC task was followed by a surprise recognition memory task, which allowed us to test whether attention to feedback (incidental memory for the images) varies as a function of proportion congruency, time, performance contingency, and individual differences. We replicated a robust LWPC effect in a large sample (N = 402) but observed no differences in behavior between feedback groups. Importantly, the memory data revealed better encoding of feedback images from context-defining trials (e.g., congruent trials in a mostly congruent block), especially early in a new context and in congruent conditions. Individual differences in reward and punishment sensitivity were not strongly associated with control-learning effects. These results suggest that statistical learning of contextual demand may have a larger impact on control learning than individual differences in motivation. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

The effect of value on long-term associative memory

Items with high value are often remembered better than those with low value. It is not clear, however, whether this value effect extends to the binding of associative details (e.g., word colour) in episodic memory. Here, we explored whether value enhances memory for associative information in two different scenarios that might support a more effective process of binding between identity and colour. Experiment 1 examined incidental binding between item and colour using coloured images of familiar objects, whereas Experiment 2 examined intentional learning of word colour. In both experiments, increasing value led to improvements in memory for both item and colour, and these effects persisted after approximately 24 hr. Experiment 3a and Experiment 3b replicated the value effect on intentional word–colour memory from Experiment 2 while also demonstrating this effect to be less reliable when word colour is incidental to the encoding phase. Thus, value-directed prioritisation can facilitate episodic associative memory when conditions for binding are optimised through the use of appropriate to-be remembered materials and encoding conditions.

Effects of age on goal-dependent modulation of episodic memory retrieval

Retrieval gating refers to the ability to modulate the retrieval of features of a single memory episode according to behavioral goals. Recent findings demonstrate that younger adults engage retrieval gating by attenuating the representation of task-irrelevant features of an episode. Here, we examine whether retrieval gating varies with age. Younger and older adults incidentally encoded words superimposed over scenes or scrambled backgrounds that were displayed in one of three spatial locations. Participants subsequently underwent fMRI as they completed two memory tasks: the background task, which tested memory for the word's background, and the location task, testing memory for the word's location. Employing univariate and multivariate approaches, we demonstrated that younger, but not older adults, exhibited attenuated reinstatement of scene information when it was goal-irrelevant (during the location task). Additionally, in younger adults only, the strength of scene reinstatement in the parahippocampal place area during the background task was related to item and source memory performance. Together, these findings point to an age-related decline in the ability to engage retrieval gating.

Neural Differentiation is Moderated by Age in Scene-Selective, But Not Face-Selective, Cortical Regions

The aging brain is characterized by neural dedifferentiation, an apparent decrease in the functional selectivity of category-selective cortical regions. Age-related reductions in neural differentiation have been proposed to play a causal role in cognitive aging. Recent findings suggest, however, that age-related dedifferentiation is not equally evident for all stimulus categories and, additionally, that the relationship between neural differentiation and cognitive performance is not moderated by age. In light of these findings, in the present experiment, younger and older human adults (males and females) underwent fMRI as they studied words paired with images of scenes or faces before a subsequent memory task. Neural selectivity was measured in two scene-selective (parahippocampal place area (PPA) and retrosplenial cortex (RSC)] and two face-selective [fusiform face area (FFA) and occipital face area (OFA)] regions using both a univariate differentiation index and multivoxel pattern similarity analysis. Both methods provided highly convergent results, which revealed evidence of age-related reductions in neural dedifferentiation in scene-selective but not face-selective cortical regions. Additionally, neural differentiation in the PPA demonstrated a positive, age-invariant relationship with subsequent source memory performance (recall of the image category paired with each recognized test word). These findings extend prior findings suggesting that age-related neural dedifferentiation is not a ubiquitous phenomenon, and that the specificity of neural responses to scenes is predictive of subsequent memory performance independently of age.

Age differences in the neural correlates of the specificity of recollection: An event-related potential study

In young adults, the neural correlates of successful recollection vary with the specificity (or amount) of information retrieved. We examined whether the neural correlates of recollection are modulated in a similar fashion in older adults. We compared event-related potential (ERP) correlates of recollection in samples of healthy young and older adults (N = 20 per age group). At study, participants were cued to make one of two judgments about each of a series of words. Subsequently, participants completed a memory test for studied and unstudied words in which they first made a Remember/Know/New (RKN) judgment, followed by a source memory judgment when a word attracted a 'Remember' (R) response. In young adults, the 'left parietal effect' - a putative ERP correlate of successful recollection - was largest for test items endorsed as recollected (R judgment) and attracting a correct source judgment, intermediate for items endorsed as recollected but attracting an incorrect or uncertain source judgment, and, relative to correct rejections, absent for items endorsed as familiar only (K judgment). In marked contrast, the left parietal effect was not detectable in older adults. Rather, regardless of source accuracy, studied items attracting an R response elicited a sustained, centrally maximum negative-going deflection relative to both correct rejections and studied items where recollection failed (K judgment). A similar retrieval-related negativity has been described previously in older adults, but the present findings are among the few to link this effect specifically to recollection. Finally, relative to correct rejections, all classes of correctly recognized old items elicited an age-invariant, late-onsetting positive deflection that was maximal over the right frontal scalp. This finding, which replicates several prior results, suggests that post-retrieval monitoring operations were engaged to an equivalent extent in the two age groups. Together, the present results suggest that there are circumstances where young and older adults engage qualitatively distinct retrieval-related processes during successful recollection.

Progression from Feature-Specific Brain Activity to Hippocampal Binding during Episodic Encoding

The hallmark of episodic memory is recollecting multiple perceptual details tied to a specific spatial-temporal context. To remember an event, it is therefore necessary to integrate such details into a coherent representation during initial encoding. Here we tested how the brain encodes and binds multiple, distinct kinds of features in parallel, and how this process evolves over time during the event itself. We analyzed data from 27 human subjects (16 females, 11 males) who learned a series of objects uniquely associated with a color, a panoramic scene location, and an emotional sound while fMRI data were collected. By modeling how brain activity relates to memory for upcoming or just-viewed information, we were able to test how the neural signatures of individual features as well as the integrated event changed over the course of encoding. We observed a striking dissociation between early and late encoding processes: left inferior frontal and visuo-perceptual signals at the onset of an event tracked the amount of detail subsequently recalled and were dissociable based on distinct remembered features. In contrast, memory-related brain activity shifted to the left hippocampus toward the end of an event, which was particularly sensitive to binding item color and sound associations with spatial information. These results provide evidence of early, simultaneous feature-specific neural responses during episodic encoding that predict later remembering and suggest that the hippocampus integrates these features into a coherent experience at an event transition.SIGNIFICANCE STATEMENT Understanding and remembering complex experiences are crucial for many socio-cognitive abilities, including being able to navigate our environment, predict the future, and share experiences with others. Probing the neural mechanisms by which features become bound into meaningful episodes is a vital part of understanding how we view and reconstruct the rich detail of our environment. By testing memory for multimodal events, our findings show a functional dissociation between early encoding processes that engage lateral frontal and sensory regions to successfully encode event features, and later encoding processes that recruit hippocampus to bind these features together. These results highlight the importance of considering the temporal dynamics of encoding processes supporting multimodal event representations.

Grounding the neurobiology of language in first principles: The necessity of non-language-centric explanations for language comprehension

Recent decades have ushered in tremendous progress in understanding the neural basis of language. Most of our current knowledge on language and the brain, however, is derived from lab-based experiments that are far removed from everyday language use, and that are inspired by questions originating in linguistic and psycholinguistic contexts. In this paper we argue that in order to make progress, the field needs to shift its focus to understanding the neurobiology of naturalistic language comprehension. We present here a new conceptual framework for understanding the neurobiological organization of language comprehension. This framework is non-language-centered in the computational/neurobiological constructs it identifies, and focuses strongly on context. Our core arguments address three general issues: (i) the difficulty in extending language-centric explanations to discourse; (ii) the necessity of taking context as a serious topic of study, modeling it formally and acknowledging the limitations on external validity when studying language comprehension outside context; and (iii) the tenuous status of the language network as an explanatory construct. We argue that adopting this framework means that neurobiological studies of language will be less focused on identifying correlations between brain activity patterns and mechanisms postulated by psycholinguistic theories. Instead, they will be less self-referential and increasingly more inclined towards integration of language with other cognitive systems, ultimately doing more justice to the neurobiological organization of language and how it supports language as it is used in everyday life.

Metacognition of visuomotor decisions in conversion disorder

Motor conversion disorder (CD) entails genuine disturbances in the subjective experience of patients who maintain they are unable to perform a motor function, despite lack of apparent neurological damage. Abilities by which individuals assess their own capacities during performance in a task are called metacognitive, and distinctive impairment of such abilities is observed in several disorders of self-awareness such as blindsight and anosognosia. In CD, previous research has focused on the recruitment of motor and emotional brain systems, generally linking symptoms to altered limbic-motor interactions; however, metacognitive function has not been studied to our knowledge. Here we tested ten CD patients and ten age-gender matched controls during a visually-guided motor paradigm, previously employed in healthy controls (HC), allowing us to probe for motor awareness and metacognition. Participants had to draw straight trajectories towards a visual target while, unbeknownst to them, deviations were occasionally introduced in the reaching trajectory seen on the screen. Participants then reported both awareness of deviations and confidence in their response. Activity in premotor and cingulate cortex distinguished between conscious and unconscious movement corrections in controls better than patients. Critically, whereas controls engaged the left superior precuneus and middle temporal region during confidence judgments, CD patients recruited bilateral parahippocampal and amygdalo-hippocampal regions instead. These results reveal that distinct brain regions subserve metacognitive monitoring for HC and CD, pointing to different mechanisms and sources of information used to monitor and form confidence judgments of motor performance. While brain systems involved in sensory-motor integration and vision are more engaged in controls, CD patients may preferentially rely on memory and contextual associative processing, possibly accounting for how affect and memories can imbue current motor experience in these patients.

Dynamic Hippocampal and Prefrontal Contributions to Memory Processes and Representations Blur the Boundaries of Traditional Cognitive Domains

The hippocampus has long been known to be a critical component of the memory system involved in the formation and use of long-term declarative memory. However, recent findings have revealed that the reach of hippocampal contributions extends to a variety of domains and tasks that require the flexible use of cognitive and social behavior, including domains traditionally linked to prefrontal cortex (PFC), such as decision-making. In addition, the prefrontal cortex (PFC) has gained traction as a necessary part of the memory system. These findings challenge the conventional characterizations of hippocampus and PFC as being circumscribed to traditional cognitive domains. Here, we emphasize that the ability to parsimoniously account for the breadth of hippocampal and PFC contributions to behavior, in terms of memory function and beyond, requires theoretical advances in our understanding of their characteristic processing features and mental representations. Notably, several literatures exist that touch upon this issue, but have remained disjointed because of methodological differences that necessarily limit the scope of inquiry, as well as the somewhat artificial boundaries that have been historically imposed between domains of cognition. In particular, this article focuses on the contribution of relational memory theory as an example of a framework that describes both the representations and processes supported by the hippocampus, and further elucidates the role of the hippocampal–PFC network to a variety of behaviors.

Audiovisual integration supports face-name associative memory formation

Prior multisensory experience influences how we perceive our environment, and hence how memories are encoded for subsequent retrieval. This study investigated if audiovisual (AV) integration and associative memory formation rely on overlapping or distinct processes. Our functional magnetic resonance imaging results demonstrate that the neural mechanisms underlying AV integration and associative memory overlap substantially. In particular, activity in anterior superior temporal sulcus (STS) is increased during AV integration and also determines the success of novel AV face-name association formation. Dynamic causal modeling results further demonstrate how the anterior STS interacts with the associative memory system to facilitate successful memory formation for AV face-name associations. Specifically, the connection of fusiform gyrus to anterior STS is enhanced while the reverse connection is reduced when participants subsequently remembered both face and name. Collectively, our results demonstrate how multisensory associative memories can be formed for subsequent retrieval.

The hippocampus is particularly important for building associations across stimulus domains

The medial temporal lobe (MTL) is critical for binding together different attributes that together form memory for prior episodes, but whether it is preferentially involved in supporting specific types of associations is a topic of much debate. Some have argued that the MTL, specifically the hippocampus, may be specialized for binding information from different stimulus domains (e.g., linking visual and auditory stimuli). In the current study, we examined the role of the MTL in memory for associations within- vs. across-domains. Patients with either selective hippocampal lesions or more extensive MTL lesions studied pairs of items within the same stimulus domain (i.e., image-image or sound-sound pairs) or across different domains (i.e., image-sound pairs). Associative memory was subsequently tested by having participants discriminate between previously studied and rearranged pairs. Compared to healthy controls, the patients were significantly more impaired in the across-domain condition than the within-domain conditions. Similar deficits were observed for patients with hippocampal lesions and those with more extensive MTL lesions, suggesting that the hippocampus itself is particularly important for binding associations across stimulus domains.

Cortical reinstatement and the confidence and accuracy of source memory

Cortical reinstatement refers to the overlap between neural activity elicited during the encoding and the subsequent retrieval of an episode, and is held to reflect retrieved mnemonic content. Previous findings have demonstrated that reinstatement effects reflect the quality of retrieved episodic information as this is operationalized by the accuracy of source memory judgments. The present functional magnetic resonance imaging (fMRI) study investigated whether reinstatement-related activity also co-varies with the confidence of accurate source judgments. Participants studied pictures of objects along with their visual or spoken names. At test, they first discriminated between studied and unstudied pictures and then, for each picture judged as studied, they also judged whether it had been paired with a visual or auditory name, using a three-point confidence scale. Accuracy of source memory judgments- and hence the quality of the source-specifying information--was greater for high than for low confidence judgments. Modality-selective retrieval-related activity (reinstatement effects) also co-varied with the confidence of the corresponding source memory judgment. The findings indicate that the quality of the information supporting accurate judgments of source memory is indexed by the relative magnitude of content-selective, retrieval-related neural activity.

Medial prefrontal cortex supports source memory for self-referenced materials in young and older adults

Behavioral evidence suggests that young and older adults show a benefit in source memory accuracy when processing materials in reference to the self. In the young, activity within the medial prefrontal cortex supports this source memory benefit at study. In this investigation, we examined whether the same neural regions support this memory benefit in both age groups. Using fMRI, we scanned participants while they studied and retrieved pictures of objects paired with one of three scenes (source) under self-reference and other-reference conditions. At the time of study, half of the items were presented once and half twice, allowing us to match behavioral performance between the groups. Both groups showed equivalent source accuracy benefits for objects encoded self-referentially. Activity in the left dorsal medial prefrontal cortex supported subsequent source memory in both age groups for the self-referenced relative to the other-referenced items. At the time of test, source accuracy for both the self- and other-referenced items was supported by a network of regions including the precuneus in both age groups. At both study and test, little in the way of age differences emerged, suggesting that when they are matched on behavioral performance, young and older adults engage similar regions in support of source memory when processing materials in reference to the self; however, when we did not match performance, age differences in functional recruitment were prevalent. These results suggest that by capitalizing on preserved processes (self-referential encoding), older adults can show improvement in memory for source details that they would typically not remember well, relative to the young.

Aging Affects the Interaction between Attentional Control and Source Memory: An fMRI Study

Age-related source memory impairments may be due, at least in part, to deficits in executive processes mediated by the PFC at both study and test. Behavioral work suggests that providing environmental support at encoding, such as directing attention toward item–source associations, may improve source memory and reduce age-related deficits in the recruitment of these executive processes. The present fMRI study investigated the effects of directed attention and aging on source memory encoding and retrieval. At study, participants were shown pictures of objects. They were either asked to attend to the objects and their color (source) or to their size. At test, participants determined if objects were seen before, and if so, whether they were the same color as previously. Behavioral results showed that direction of attention improved source memory for both groups; however, age-related deficits persisted. fMRI results revealed that, across groups, direction of attention facilitated medial temporal lobe-mediated contextual binding processes during study and attenuated right PFC postretrieval monitoring effects at test. However, persistent age-related source memory deficits may be related to increased recruitment of medial anterior PFC during encoding, indicative of self-referential processing, as well as underrecruitment of lateral anterior PFC-mediated relational processes. Taken together, this study suggests that, even when supported, older adults may fail to selectively encode goal-relevant contextual details supporting source memory performance.

The role of encoding strategies in contextual memory deficits in patients with bipolar disorder

Contextual memory is important for the encoding and retrieval of episodic memory, which is often impaired in euthymic patients with bipolar disorder (BD). The objective was to investigate the effect of low and high cognitive support on encoding in an incidental contextual memory task in euthymic patients with BD. Twenty-three patients with a BD type I diagnosis (aged 23-63 years, 17 women and 6 men) and 29 healthy controls completed a recognition memory task for context (location of a recognised object). Participants were assigned to one of two incidental encoding conditions: (1) with a binding cue to encourage the association of the object to its location (judging the degree of appropriateness of an object in relation to its location) or (2) without a binding cue (judging daily use of objects). Patients showed a deficit in incidental contextual memory in the absence of a binding cue at encoding. Under incidental encoding with the binding cue, no differences were observed between the groups for contextual memory. Contextual memory deficits in BD patients were reduced by providing cognitive support at encoding. The role of this strategy should be investigated in larger samples to evaluate its use for cognitive remediation in BD patients.

Self-referencing enhances recollection in both young and older adults

Processing information in relation to the self enhances subsequent item recognition in both young and older adults and further enhances recollection at least in the young. Because older adults experience recollection memory deficits, it is unknown whether self-referencing improves recollection in older adults. We examined recollection benefits from self-referential encoding in older and younger adults and further examined the quality and quantity of episodic details facilitated by self-referencing. We further investigated the influence of valence on recollection, given prior findings of age group differences in emotional memory (i.e., "positivity effects"). Across the two experiments, young and older adults processed positive and negative adjectives either for self-relevance or for semantic meaning. We found that self-referencing, relative to semantic encoding, increased recollection memory in both age groups. In Experiment 1, both groups remembered proportionally more negative than positive items when adjectives were processed semantically; however, when adjectives were processed self-referentially, both groups exhibited evidence of better recollection for the positive items, inconsistent with a positivity effect in aging. In Experiment 2, both groups reported more episodic details associated with recollected items, as measured by a memory characteristic questionnaire, for the self-reference relative to the semantic condition. Overall, these data suggest that self-referencing leads to detail-rich memory representations reflected in higher rates of recollection across age.

Re-engaging with the past: recapitulation of encoding operations during episodic retrieval

Recollection of events is accompanied by selective reactivation of cortical regions which responded to specific sensory and cognitive dimensions of the original events. This reactivation is thought to reflect the reinstatement of stored memory representations and therefore to reflect memory content, but it may also reveal processes which support both encoding and retrieval. The present study used event-related functional magnetic resonance imaging to investigate whether regions selectively engaged in encoding face and scene context with studied words are also re-engaged when the context is later retrieved. As predicted, encoding face and scene context with visually presented words elicited activity in distinct, context-selective regions. Retrieval of face and scene context also re-engaged some of the regions which had shown successful encoding effects. However, this recapitulation of encoding activity did not show the same context selectivity observed at encoding. Successful retrieval of both face and scene context re-engaged regions which had been associated with encoding of the other type of context, as well as those associated with encoding the same type of context. This recapitulation may reflect retrieval attempts which are not context-selective, but use shared retrieval cues to re-engage encoding operations in service of recollection.

The relationship between task-related and subsequent memory effects

The primary aim of this fMRI study was to assess the proposal that negative subsequent memory effects-greater activity for later forgotten relative to later remembered study items-are localized to regions demonstrating task-negative effects, and hence to potential components of the default mode network. Additionally, we assessed whether positive subsequent memory effects overlapped with regions demonstrating task-positive effects. Eighteen participants were scanned while they made easy or difficult relational judgments on visually presented word pairs. Easy and hard task blocks were interleaved with fixation-only rest periods. In the later unscanned test phase, associative recognition judgments were required on intact word pairs (studied pairs), rearranged pairs (pairs formed from words presented on different study trials) and new pairs. Subsequent memory effects were identified by contrasting the activity elicited by study pairs that went on to be correctly endorsed as intact versus incorrectly endorsed as rearranged. Task effects were identified by contrasting all study items and rest blocks. Both task-negative and task-positive effects were evident in widespread cortical regions and negative and positive subsequent memory effects were generally confined to task-negative and task-positive regions respectively. However, subsequent memory effects could be identified in only a fraction of task-sensitive voxels and, unlike task effects, were insensitive to the difficulty manipulation. The findings for the negative subsequent memory effects are consistent with recent proposals that the default mode network is functionally heterogeneous, and suggest that these effects are not accurately characterized as reflections of the modulation of the network as a whole.

Dissociable roles of default-mode regions during episodic encoding

We investigated the role of distinct regions of the default-mode network (DMN) during memory encoding with fMRI. Subjects encoded words using either a strategy that emphasized self-referential (pleasantness) processing, or one that emphasized semantic (man-made/natural) processing. During encoding subjects were intermittently presented with thought probes to evaluate if they were concentrated and on-task or exhibiting task-unrelated thoughts (TUT). After the scanning session subjects performed a source retrieval task to determine which of two judgments they performed for each word at encoding. Source retrieval accuracy was higher for words encoded with the pleasantness vs. the man-made/natural task and there was a trend for higher performance for words preceding on-task vs. TUT reports. fMRI results show that left anterior medial PFC and left angular gyrus activity was greater during successful vs. unsuccessful encoding during both encoding tasks. Greater activity in left anterior cingulate and bilateral lateral temporal cortex was related successful vs. unsuccessful encoding only in the pleasantness task. In contrast, posterior cingulate, right anterior cingulate and right temporoparietal junction were activated to a greater extent in unsuccessful vs. successful encoding across tasks. Finally, activation in posterior cingulate and bilateral dorsolateral prefrontal cortex was related to TUT across tasks; moreover, we observed a conjunction in posterior cingulate between encoding failure and TUT. We conclude that DMN regions play dissociable roles during memory formation, and that their association with subsequent memory may depend on the manner in which information is encoded and retrieved.

Intrusive images and voluntary memory for affective pictures: contextualization and dual-task interference

BACKGROUND AND OBJECTIVES

The present study addressed the role of context information and dual-task interference during the encoding of negative pictures on intrusion development and voluntary recall.

METHODS

Healthy participants were shown negative pictures with or without context information. Pictures were either viewed alone or concurrently with a visuospatial or verbal task. Participants reported their intrusive images of the pictures in a diary. At follow-up, perceptual and contextual memory was tested.

RESULTS

Participants in the context group reported more intrusive images and perceptual voluntary memory than participants in the no context group. No effects of the concurrent tasks were found on intrusive image frequency, but perceptual and contextual memory was affected according to the cognitive load of the task.

LIMITATIONS

The analogue method cannot be generalized to real-life trauma and the secondary tasks may differ in cognitive load.

CONCLUSIONS

The findings challenge a dual memory model of PTSD but support an account in which retrieval strategy, rather than encoding processes, accounts for the experience of involuntary versus voluntary recall.

Comparison of the neural correlates of encoding item-item and item-context associations

fMRI was employed to investigate the role of the left inferior frontal gyrus (LIFG) in the encoding of item-item and item-context associations. On each of a series of study trials subjects viewed a picture that was presented either to the left or right of fixation, along with a subsequently presented word that appeared at fixation. Memory was tested in a subsequent memory test that took place outside of the scanner. On each test trial one of two forced choice judgments was required. For the associative test, subjects chose between the word paired with the picture at study and a word studied on a different trial. For the source test, the judgment was whether the picture had been presented on the left or right. Successful encoding of associative information was accompanied by subsequent memory effects in several cortical regions, including much of the LIFG. By contrast, successful source encoding was selectively associated with a subsequent memory effect in right fusiform cortex. The finding that the LIFG was enhanced during successful associative, but not source, encoding is interpreted in light of the proposal that subsequent memory effects are localized to cortical regions engaged by the on-line demands of the study task.

Effects of age on negative subsequent memory effects associated with the encoding of item and item-context information

It has consistently been reported that "negative" subsequent memory effects--lower study activity for later remembered than later forgotten items--are attenuated in older individuals. The present functional magnetic resonance imaging study investigated whether these findings extend to subsequent memory effects associated with successful encoding of item-context information. Older (n = 25) and young (n = 17) subjects were scanned while making 1 of 2 encoding judgments on a series of pictures. Memory was assessed for the study item and, for items judged old, the item's encoding task. Both memory judgments were made using confidence ratings, permitting item and source memory strength to be unconfounded and source confidence to be equated across age groups. Replicating prior findings, negative item effects in regions of the default mode network in young subjects were reversed in older subjects. Negative source effects, however, were invariant with respect to age and, in both age groups, the magnitude of the effects correlated with source memory performance. It is concluded that negative item effects do not reflect processes necessary for the successful encoding of item-context associations in older subjects. Negative source effects, in contrast, appear to reflect the engagement of processes that are equally important for successful episodic encoding in older and younger individuals.

The effect of object processing in content-dependent source memory

Background

Previous studies have suggested that the study condition of an item influences how the item is encoded. However, it is still unclear whether subsequent source memory effects are dependent upon stimulus content when the item and context are unitized. The present fMRI study investigated the effect of encoding activity sensitive to stimulus content in source memory via unitization. In the scanner, participants were instructed to integrate a study item, an object in either a word or a picture form, with perceptual context into a single image.

Results

Subsequent source memory effects independent of stimulus content were identified in the left lateral frontal and parietal regions, bilateral fusiform areas, and the left perirhinal cortex extending to the anterior hippocampus. Content-dependent subsequent source memory effects were found only with words in the left medial frontal lobe, the ventral visual stream, and bilateral parahippocampal regions. Further, neural activity for source memory with words extensively overlapped with the region where pictures were preferentially processed than words, including the left mid-occipital cortex and the right parahippocampal cortex.

Conclusions

These results indicate that words that were accurately remembered with correct contextual information were processed more like pictures mediated by integrated imagery operation, compared to words that were recognized with incorrect context. In contrast, such processing did not discriminate subsequent source memory with pictures. Taken together, these findings suggest that unitization supports source memory for both words and pictures and that the requirement of the study task interacts with the nature of stimulus content in unitized source encoding.

Age-related differences in agenda-driven monitoring of format and task information

Age-related source memory deficits may arise, in part, from changes in the agenda-driven processes that control what features of events are relevant during remembering. Using fMRI, we compared young and older adults on tests assessing source memory for format (picture, word) or encoding task (self-, other-referential), as well as on old-new recognition. Behaviorally, relative to old-new recognition, older adults showed disproportionate and equivalent deficits on both source tests compared to young adults. At encoding, both age groups showed expected activation associated with format in posterior visual processing areas, and with task in medial prefrontal cortex. At test, the groups showed similar selective, agenda-related activity in these representational areas. There were, however, marked age differences in the activity of control regions in lateral and medial prefrontal cortex and lateral parietal cortex. Results of correlation analyses were consistent with the idea that young adults had greater trial-by-trial agenda-driven modulation of activity (i.e., greater selectivity) than did older adults in representational regions. Thus, under selective remembering conditions where older adults showed clear differential regional activity in representational areas depending on type of test, they also showed evidence of disrupted frontal and parietal function and reduced item-by-item modulation of test-appropriate features. This pattern of results is consistent with an age-related deficit in the engagement of selective reflective attention.

The effects of aging on emotion-induced modulations of source retrieval ERPs: evidence for valence biases

Many behavioral studies have shown that memory is enhanced for emotionally salient events across the lifespan. It has been suggested that this mnemonic boost may be observed for both age groups, particularly the old, in part because emotional information is retrieved with less effort than neutral information. Neuroimaging evidence suggests that inefficient retrieval processing (temporally delayed and attenuated) may contribute to age-related impairments in episodic memory for neutral events. It is not entirely clear whether emotional salience may reduce these age-related changes in neural activity associated with episodic retrieval for neutral events. Here, we investigated these ideas using event-related potentials (ERPs) to assess the neural correlates of successful source memory retrieval ("old-new effects") for neutral and emotional (negative and positive) images. Behavioral results showed that older adults demonstrated source memory impairments compared to the young but that both groups showed reduced source memory accuracy for negative compared to positive and neutral images; most likely due to an arousal-induced memory tradeoff for the negative images, which were subjectively more arousing than both positive and neutral images. ERP results showed that early onsetting old-new effects, between 100 and 300 ms, were observed for emotional but not neutral images in both age groups. Interestingly, these early effects were observed for negative items in the young and for positive items in the old. These ERP findings offer support for the idea that emotional events may be retrieved more automatically than neutral events across the lifespan. Furthermore, we suggest that very early retrieval mechanisms, possibly perceptual priming or familiarity, may underlie the negativity and positivity effects sometimes observed in the young and old, respectively, for various behavioral measures of attention and memory.

Neural correlates of the encoding of multimodal contextual features

Functional magnetic resonance imaging (fMRI) was employed to identify neural regions engaged during the encoding of contextual features belonging to different modalities. Subjects studied objects that were presented to the left or right of fixation. Each object was paired with its name, spoken in either a male or a female voice. The test requirement was to discriminate studied from unstudied pictures and, for each picture judged old, to retrieve its study location and the gender of the voice that spoke its name. Study trials associated with accurate rather than inaccurate location memory demonstrated enhanced activity in the fusiform and parahippocampal cortex and the hippocampus and reduced activity (a negative subsequent memory effect) in the medial occipital cortex. Successful encoding of voice information was associated with enhanced study activity in the right middle superior temporal sulcus and activity reduction in the right superior frontal cortex. These findings support the proposal that encoding of a contextual feature is associated with enhanced activity in regions engaged during its online processing. In addition, they indicate that negative subsequent memory effects can also demonstrate feature-selectivity. Relative to other classes of study trials, trials for which both contextual features were later retrieved demonstrated enhanced activity in the lateral occipital complex and reduced activity in the temporo-parietal junction. These findings suggest that multifeatural encoding was facilitated when the study item was processed efficiently and study processing was not interrupted by redirection of attention toward extraneous events.

Neural activity supporting the formation of associative memory versus source memory

The ability to form a new association with discontiguous elements constitutes the very crux of episodic memory. However, it is not fully understood whether different types of associations rely on common neural correlates for encoding associations. In the present study, we investigated whether the formation of associative memory (associations between items) and source memory (associations between an item and its context) recruits common neural activity during encoding, or whether each type of association requires different neural activity for subsequent memory. During study, participants were visually presented a list of object pairs in the scanner while the names of objects were simultaneously presented either in a male or female voice. Participants completed a post-scan recognition test for associative and source memories for object pairs and their contexts. Associative memory was predicted in the left inferior prefrontal cortex, the fusiform gyrus and the medial temporal lobe including both perirhinal and parahippocampal cortices and the posterior hippocampus. Encoding activity for source memory was identified in the right insula and the right anterior hippocampus. Further, neural activity in the right posterior hippocampus was recruited for successful formation of both associative and source memories. Collectively, these findings highlight the pivotal role of the hippocampus in successful encoding of associative and source memories and add more weight to the role of the perirhinal cortex in associative encoding of objects. The present findings have implications for roles of the medial temporal lobe sub-regions for successful formation of associative and source memories.

The path to memory is guided by strategy: distinct networks are engaged in associative encoding under visual and verbal strategy and influence memory performance in healthy and impaired individuals

Given the diversity of stimuli encountered in daily life, a variety of strategies must be used for learning new information. Relating and encoding visual and verbal stimuli into memory has been probed using various tasks and stimulus types. Engagement of specific subsequent memory and cortical processing regions depends on the stimulus modality of studied material; however, it remains unclear whether different encoding strategies similarly influence regional activity when stimulus type is held constant. In this study, participants encoded object pairs using a visual or verbal associative strategy during fMRI, and subsequent memory was assessed for pairs encoded under each strategy. Each strategy elicited distinct regional processing and subsequent memory effects: middle/superior frontal, lateral parietal, and lateral occipital for visually associated pairs and inferior frontal, medial frontal, and medial occipital for verbally associated pairs. This regional selectivity mimics the effects of stimulus modality, suggesting that cortical involvement in associative encoding is driven by strategy and not simply by stimulus type. The clinical relevance of these findings, probed in a patient with a recent aphasic stroke, suggest that training with strategies utilizing unaffected cortical regions might improve memory ability in patients with brain damage.

Cross-modal versus within-modal recall: differences in behavioral and brain responses

Although human experience is multisensory in nature, previous research has focused predominantly on memory for unisensory as opposed to multisensory information. In this work, we sought to investigate behavioral and neural differences between the cued recall of cross-modal audiovisual associations versus within-modal visual or auditory associations. Participants were presented with cue-target associations comprised of pairs of nonsense objects, pairs of nonsense sounds, objects paired with sounds, and sounds paired with objects. Subsequently, they were required to recall the modality of the target given the cue while behavioral accuracy, reaction time, and blood oxygenation level dependent (BOLD) activation were measured. Successful within-modal recall was associated with modality-specific reactivation in primary perceptual regions, and was more accurate than cross-modal retrieval. When auditory targets were correctly or incorrectly recalled using a cross-modal visual cue, there was re-activation in auditory association cortex, and recall of information from cross-modal associations activated the hippocampus to a greater degree than within-modal associations. Findings support theories that propose an overlap between regions active during perception and memory, and show that behavioral and neural differences exist between within- and cross-modal associations. Overall the current study highlights the importance of the role of multisensory information in memory.

Medial prefrontal cortex supports source memory accuracy for self-referenced items

Previous behavioral work suggests that processing information in relation to the self enhances subsequent item recognition. Neuroimaging evidence further suggests that regions along the cortical midline, particularly those of the medial prefrontal cortex (PFC), underlie this benefit. There has been little work to date, however, on the effects of self-referential encoding on source memory accuracy or whether the medial PFC might contribute to source memory for self-referenced materials. In the current study, we used fMRI to measure neural activity while participants studied and subsequently retrieved pictures of common objects superimposed on one of two background scenes (sources) under either self-reference or self-external encoding instructions. Both item recognition and source recognition were better for objects encoded self-referentially than self-externally. Neural activity predictive of source accuracy was observed in the medial PFC (Brodmann area 10) at the time of study for self-referentially but not self-externally encoded objects. The results of this experiment suggest that processing information in relation to the self leads to a mnemonic benefit for source level features, and that activity in the medial PFC contributes to this source memory benefit. This evidence expands the purported role that the medial PFC plays in self-referencing.

Effects of modality on the neural correlates of encoding processes supporting recollection and familiarity

Prior research has demonstrated that the neural correlates of successful encoding ("subsequent memory effects") partially overlap with neural regions selectively engaged by the on-line demands of the study task. The primary goal of the present experiment was to determine whether this overlap is associated solely with encoding processes supporting later recollection, or whether overlapping subsequent memory and study condition effects are also evident when later memory is familiarity-based. Subjects (N = 17) underwent fMRI scanning while studying a series of visually and auditorily presented words. Memory for the words was subsequently tested with a modified Remember/Know procedure. Auditorily selective subsequent familiarity effects were evident in bilateral temporal regions that also responded preferentially to auditory items. Although other interpretations are possible, these findings suggest that overlap between study condition-selective subsequent memory effects and regions selectively sensitive to study demands is not uniquely associated with later recollection. In addition, modality-independent subsequent memory effects were identified in several cortical regions. In every case, the effects were greatest for later recollected items, and smaller for items later recognized on the basis of familiarity. The implications of this quantitative dissociation for dual-process models of recognition memory are discussed.

The effects of aging on material-independent and material-dependent neural correlates of source memory retrieval

Age-related declines in source memory have been observed for various stimuli and associated details. These impairments may be related to alterations in brain regions contributing to source memory via material-independent processes and/or regions specialized for processing specific materials. Using event-related functional magnetic resonance imaging, we investigate the effects of aging on source memory and associated neural activity for words and objects. Source accuracy was equally impaired in older adults for both materials. Imaging data revealed both groups recruited similar networks of regions to support source memory accuracy irrespective of material, including parietal and prefrontal cortices (PFC) and the hippocampus. Age-related decreases in material-independent activity linked to postretrieval monitoring were observed in right lateral PFC. Additionally, age-related increases in source accuracy effects were shown in perirhinal cortex, which were positively correlated with performance in older adults, potentially reflecting functional compensation. In addition to group differences in material-independent regions, age-related crossover interactions for material-dependent source memory effects were observed in regions selectively engaged by objects. These results suggest that older adults' source memory impairments reflect alterations in regions making material-independent contributions to source memory retrieval, primarily the lateral PFC, but may be further impacted by changes in regions sensitive to particular materials.

Neural correlates of encoding within- and across-domain inter-item associations

The neural correlates of the encoding of associations between pairs of words, pairs of pictures, and word-picture pairs were compared. The aims were to determine, first, whether the neural correlates of associative encoding vary according to study material and, second, whether encoding of across- versus within-material item pairs is associated with dissociable patterns of hippocampal and perirhinal activity, as predicted by the "domain dichotomy" hypothesis of medial temporal lobe function. While undergoing fMRI scanning, subjects (n = 24) were presented with the three classes of study pairs, judging which of the denoted objects fit into the other. Outside of the scanner, subjects then undertook an associative recognition task, discriminating between intact study pairs, rearranged pairs comprising items that had been presented on different study trials, and unstudied item pairs. The neural correlates of successful associative encoding--subsequent associative memory effects--were operationalized as the difference in activity between study pairs correctly judged intact versus pairs incorrectly judged rearranged on the subsequent memory test. Pair type-independent subsequent memory effects were evident in the left inferior frontal gyrus (IFG) and the hippocampus. Picture-picture pairs elicited material-selective effects in regions of fusiform cortex that were also activated to a greater extent on picture trials than on word trials, whereas word-word pairs elicited material-selective subsequent memory effects in left lateral temporal cortex. Contrary to the domain-dichotomy hypothesis, neither hippocampal nor perirhinal subsequent memory effects differed depending on whether they were elicited by within- versus across-material study pairs. It is proposed that the left IFG plays a domain-general role in associative encoding, that associative encoding can also be facilitated by enhanced processing in material-selective cortical regions, and that the hippocampus and perirhinal cortex contribute equally to the formation of inter-item associations, regardless of whether the items belong to the same or to different processing domains.

Stimulus content and the neural correlates of source memory

It has been suggested that several regions of the brain, including subregions of the medial temporal lobe (MTL) and the posterior parietal cortex, contribute to source memory success in a material-general manner, with most models highlighting the importance of memory process rather than material type. For the MTL in particular, however, increasing evidence suggests that MTL subregions may be specialized for processing different materials, raising the possibility that source memory-related activity may be material-sensitive. Previous fMRI studies have not directly compared source memory activity for different categories of stimuli, and it remains unclear whether source memory effects, in the MTL or elsewhere, are influenced by material. To investigate this issue, young participants were scanned during study while they made semantic judgments about words, pictures of objects and scenes, and during test when they retrieved the context (source) in which these items were studied. Several regions, including the hippocampi, medial and lateral parietal cortex, exhibited source memory effects common to words, objects and scenes, at both study and test. Material-dependent source memory effects were also identified in the left posterior inferior frontal and left perirhinal cortex for words and objects, respectively, at study but not test. These results offer direct support for the hypothesis that the MTL and posterior parietal cortex make material-general contributions to recollection. These results also point to a dissociation between encoding and retrieval with regard to the influence of material on the neural correlates of source memory accuracy, supporting the idea that a relatively small proportion of the activity elicited by a stimulus during encoding is incorporated into an episodic memory representation of the stimulus.

Neural activity that predicts subsequent memory and forgetting: a meta-analysis of 74 fMRI studies

The present study performed a quantitative meta-analysis of functional MRI studies that used a subsequent memory approach. The meta-analysis considered both subsequent memory (SM; remembered>forgotten) and subsequent forgetting (SF; forgotten>remembered) effects, restricting the data used to that concerning visual information encoding in healthy young adults. The meta-analysis of SM effects indicated that they most consistently associated with five neural regions: left inferior frontal cortex (IFC), bilateral fusiform cortex, bilateral hippocampal formation, bilateral premotor cortex (PMC), and bilateral posterior parietal cortex (PPC). Direct comparisons of the SM effects between the studies using verbal versus pictorial material and item-memory versus associative-memory tasks yielded three main sets of findings. First, the left IFC exhibited greater SM effects during verbal material than pictorial material encoding, whereas the fusiform cortex exhibited greater SM effects during pictorial material rather than verbal material encoding. Second, bilateral hippocampal regions showed greater SM effects during pictorial material encoding compared to verbal material encoding. Furthermore, the left hippocampal region showed greater SM effects during pictorial-associative versus pictorial-item encoding. Third, bilateral PMC and PPC regions, which may support attention during encoding, exhibited greater SM effects during item encoding than during associative encoding. The meta-analysis of SF effects indicated they associated mostly with default-mode network regions, including the anterior and posterior midline cortex, the bilateral temporoparietal junction, and the bilateral superior frontal cortex. Recurrent activity oscillations between the task-positive and task-negative/default-mode networks may account for trial-to-trial variability in participants' encoding performances, which is a fundamental source of both SM and SF effects. Taken together, these findings clarify the neural activity that supports successful encoding, as well as the neural activity that leads to encoding failure.

Equivalent activation of the hippocampus by face-face and face-laugh paired associate learning and recognition

The human hippocampus is known to play an important role in relational memory. Both patient lesion studies and functional-imaging studies have shown that it is involved in the encoding and retrieval from memory of arbitrary associations. Two recent patient lesion studies, however, have found dissociations between spared and impaired memory within the domain of relational memory. Recognition of associations between information of the same kind (e.g., two faces) was spared, whereas recognition of associations between information of different kinds (e.g., face-name or face-voice associations) was impaired by hippocampal lesions. Thus, recognition of associations between information of the same kind may not be mediated by the hippocampus. Few imaging studies have directly compared activation at encoding and recognition of associations between same and different types of information. Those that have have shown mixed findings and been open to alternative interpretation. We used fMRI to compare hippocampal activation while participants studied and later recognized face-face and face-laugh paired associates. We found no differences in hippocampal activation between our two types of stimulus materials during either study or recognition. Study of both types of paired associate activated the hippocampus bilaterally, but the hippocampus was not activated by either condition during recognition. Our findings suggest that the human hippocampus is normally engaged to a similar extent by study and recognition of associations between information of the same kind and associations between information of different kinds.