The relationship between the right frontal old/new ERP effect and post-retrieval monitoring: specific or non-specific?

Post-retrieval processes are thought to be engaged when the outcome of an attempt to retrieve information from long-term memory must be monitored or evaluated. Previous research employing event-related potentials (ERPs) has implicated a specific ERP modulation - the 'right frontal old/new effect' - as a correlate of post-retrieval processing. In two experiments we examined whether the right frontal effect is specifically associated with processing of the products of an episodic retrieval attempt. During study, subjects in both experiments made one of two semantic judgments on serially presented pictures. In experiment 1, one study phase was followed by a source memory task, in which subjects responded 'new' to unstudied pictures and signaled the semantic judgment made on each studied picture. A separate study phase was followed by a task in which the studied items required a judgment about their semantic attributes. Robust right frontal effects were elicited by old items in both tasks, indicating that the effects are not selective for the monitoring of the content of information retrieved from episodic memory. In experiment 2, separate study phases were followed by test phases where semantic judgments were made either on old items (as in experiment 1), or on new items. Right frontal effects were elicited by whichever class of items, old or new, required the semantic judgment. Together, these findings indicate that the right frontal old/new effect reflects generic monitoring or decisional processes, rather than processing dedicated to the evaluation of the products of an episodic retrieval attempt.

Content dependence of the electrophysiological correlates of recollection

The neural correlates of episodic retrieval ('recollection') have been shown to differ according to the content of retrieved episodes. It has been hypothesized that these content-dependent differences reflect the 'reinstatement' of encoding-related processes or representations at the time of recollection. It remains unclear, however, whether these effects directly reflect the recollection of differential episodic content, as would be predicted by the reinstatement hypothesis, or whether they are instead associated with processes that are contingent on successful recollection. To address this issue, the present study employed event-related potentials (ERPs), permitting the investigation of the temporal dynamics of content-dependent neural effects during retrieval, and in particular, their onset with respect to well-established ERP correlates of recollection, such as the left parietal old-new effect. Subjects studied a series of words that were each presented in the context of one of two encoding tasks. One task required the covert generation of a sentence incorporating each word, whereas the other required imagining the object corresponding to each word within a superimposed scenic picture. Memory for the words was subsequently tested with the 'remember/know' procedure. ERPs elicited by recollected words differed according to the prior encoding history of the word, beginning at approximately 300 ms following word onset. These content-dependent ERP differences were maximal over the anterior scalp and, importantly, onset as early as the left parietal old-new effect. The findings demonstrate that content-dependent neural activity during retrieval can occur in a timeframe that is compatible with a direct role in the recollection and representation of episodic information.

The Relationship between Study Processing and the Effects of Cue Congruency at Retrieval: fMRI Support for Transfer Appropriate Processing

Using functional magnetic resonance imaging, the present study investigated whether the enhanced memory performance associated with congruent relative to incongruent retrieval cues is modulated by how items are encoded. Subjects studied a list of visually presented words and pictures and attempted to recognize these items in a later memory test. Half of the studied items were tested with a congruent cue (word-word and picture-picture), whereas the remainders were tested with an incongruent cue (word-picture and picture-word). For both words and pictures, regions where study activity was greater for congruently than incongruently cued items overlapped regions where activity differentiated the 2 classes of study material. Thus, word congruency effects overlapped regions where activity elicited by study words exceeded the activity elicited by pictures. Similarly, picture congruency effects overlapped regions demonstrating enhanced activity for pictures relative to words. In addition, several regions, including dorsolateral prefrontal cortex and intraparietal sulcus, demonstrated material-nonspecific congruency effects. The findings suggest that items benefit from a congruent retrieval cue when their study processing resembles the processing later engaged by the retrieval cue. Consistent with the principle of transfer appropriate processing, the benefit of a congruent retrieval cue derives from the interaction between study and retrieval processing.

Regional specificity of age effects on the neural correlates of episodic retrieval

We investigated age-related differences in episodic retrieval using a source memory procedure. Age-related differences in retrieval-related activity were analyzed in conditions where source recollection performance was statistically equivalent in young and older subjects. Analyses of BOLD activity revealed a network of regions where recollection effects were equivalent in magnitude in the two age groups. There were no regions where these effects were of greater magnitude in young than in older subjects. In some regions, however, there was a crossover interaction, such that retrieval-related effects reversed in direction between the two age groups. Further analyses of these interactions revealed a dissociation between a posterior hippocampal region where recollection-related activity was confined to the older group, and right fusiform and occipital regions where, in the young group only, activity elicited by studied items was of lower magnitude than activity to new items. We interpret the first of these age-related effects as an example of 'over-recruitment' in response to decline in neural efficiency, and discuss whether the second effect indexes an age-related decline in repetition priming.

Event-related potentials and recognition memory

According to dual-process models, recognition memory is supported by distinct retrieval processes known as familiarity and recollection. Important evidence supporting the dual-process framework has come from studies using event-related brain potentials (ERPs). These studies have identified two topographically distinct ERP correlates of recognition memory--the "parietal" and "mid-frontal" old/new effects--that are dissociated by variables that selectively modulate recollection and familiarity, respectively. We evaluate the extent to which ERP data support dual-process models in light of the proposal that recollection is a continuous rather than a discrete memory process. We also examine the claim that the putative ERP index of familiarity is a reflection of implicit rather than explicit memory. We conclude that ERP findings continue to offer strong support for the dual-process perspective.

Dissociation of the neural correlates of recognition memory according to familiarity, recollection, and amount of recollected information

The present experiment used fMRI to investigate whether neural correlates of recognition memory behave in a manner consistent with the proposal that recognition decisions are based on a unidimensional memory strength variable. A modified Remember/Know recognition test was used in which participants could indicate two levels of recollection. Participants were required to indicate whether a test item was new, familiar (known), elicited recollection of general contextual details from the study episode (R1 response), or elicited a specific recollection of the item with which it was paired at study (R2 response). Little evidence could be found to support the view that Remember/Know/New judgments reflect variations along a single strength dimension. Instead, the findings replicated prior research in indicating that the neural correlates of recollection and familiarity can be doubly dissociated. Two recollection-sensitive regions - left lateral inferior parietal and left fusiform cortex - were found to be sensitive to amount of information recollected, as operationalized in the contrast between R2 and R1 responses. It is proposed that these regions may support the representation of recollected information.

Recollection and the Reinstatement of Encoding-Related Cortical Activity

The neural correlates of episodic memory retrieval ("recollection") differ according to the type of information contained in the recollected episode. Such content-specific recollection effects have been hypothesized to reflect the reinstatement of processes or representations active during encoding. Using event-related functional magnetic resonance imaging, we evaluated this hypothesis by directly contrasting the neural activity elicited during the encoding and subsequent recollection of words studied with one of 2 encoding tasks. Study words appearing on pictures of scenes required imagining the word's referent at any location within the scene, whereas words appearing on a blank background required generating a sentence that incorporated the word. On a later memory test, the neural correlates of recollection were operationalized by contrasting the activity elicited during correct "remember" versus "know" responses. Recollected words from the "scene" task elicited activity in regions of left occipital cortex and anterior fusiform gyrus that overlapped regions where encoding-related activity was greater for the scene than sentence task. Conversely, activity elicited by words recollected from the "sentence" task overlapped with a region of ventromedial frontal cortex where encoding-related activity was greater for the sentence task. These content-specific associations between encoding- and recollection-related neural activity strongly support the reinstatement hypothesis of episodic retrieval.

Age effects on the neural correlates of episodic retrieval: increased cortical recruitment with matched performance

Functional neuroimaging investigations have revealed a range of age-related differences in the neural correlates of episodic memory retrieval. Typically, whereas activity is reduced in older compared with younger adults in some regions, other regions are engaged exclusively, or to a greater extent, in older adults. It is unclear whether such differences merely represent the neural correlates of the lower levels of memory performance and impaired recollection typical of older adults. This issue was addressed in the present event-related functional magnetic resonance imaging study. The level of recollection was matched between groups of healthy younger and older adults for a subset of picture items in a source memory task by manipulating the number of study presentations. Contrasts of the activity elicited by old items attracting correct source judgments and correctly identified new items revealed that the 2 groups recruited many of the same brain regions. However, a striking pattern of age-related differences was also observed. In older adults, retrieval-related increases in activity were more widespread and of greater magnitude than in the young. Moreover, regions demonstrating retrieval-related decreases in activity were almost absent in the older participants. These findings suggest an age-related decline in the efficiency with which neural populations support cognitive function.

Episodic encoding is more than the sum of its parts: an fMRI investigation of multifeatural contextual encoding

Episodic memories are characterized by their contextual richness, yet little is known about how the various features comprising an episode are brought together in memory. Here we employed fMRI and a multidimensional source memory procedure to investigate processes supporting the mnemonic binding of item and contextual information. Volunteers were scanned while encoding items for which the contextual features (color and location) varied independently, allowing activity elicited at the time of study to be segregated according to whether both, one, or neither feature was successfully retrieved on a later memory test. Activity uniquely associated with successful encoding of both features was identified in the intra-parietal sulcus, a region strongly implicated in the support of attentionally mediated perceptual binding. The findings suggest that the encoding of disparate features of an episode into a common memory representation requires that the features be conjoined in a common perceptual representation when the episode is initially experienced.

The relationship between electrophysiological correlates of recollection and amount of information retrieved

The electrophysiological correlates of recollection were investigated with a modified Remember/Know task in which subjects signaled whether they fully or partially recollected visual object information in each study episode. A positive-going ERP deflection--the left parietal old/new effect--was sensitive to the amount of information recollected, demonstrating greater amplitude when elicited by test items associated with full relative to partial recollection. These findings support prior proposals that the left parietal ERP old/new effect is sensitive to the amount of information recollected from episodic memory. An early-onsetting (ca. 150 ms), left frontal old/new effect differentiated items accorded correct old versus correct new responses regardless of whether the items were endorsed as familiar or recollected. This finding extends the range of circumstances under which early, frontally distributed old/new effects occur, and adds weight to previous suggestions that these effects are a neural correlate of familiarity-driven recognition memory.

Electrophysiological Correlates of Retrieval Processing: Effects of Consistent versus Inconsistent Retrieval Demands

Studies employing event-related potentials (ERPs) during tests of recognition memory have reported differences in neural activity elicited by new test items according to the specific demands of the retrieval task, such as retrieving studied words versus pictures. The present study investigated whether differential processing of new items is possible when retrieval demands vary unpredictably on a trial-by-trial basis. In separate study-test phases, subjects encoded lists of intermixed words and pictures, and undertook retrieval tests with words as test items. Each test item was preceded by a task cue that signaled whether subjects were to attempt to retrieve a word or a picture from the study list. In the “blocked”condition, the targeted study material remained constant throughout the test, whereas in the “mixed”condition, the targeted material varied unpredictably across trials. New-item ERPs were more positive-going when words rather than pictures were targeted in the “blocked” condition, replicating previous findings, but this effect was absent in the “mixed”condition. The findings are consistent with the hypothesis that differential processing of retrieval cues depends upon the adoption of different task sets (“retrieval orientations” that develop over multiple trials and cannot be adjusted merely in response to an instructional cue. Unlike the new-item ERPs, ERPs elicited by the task cues in the mixed condition differed according to targeted material, but only on trials when there was a switch between target material. The implications of these findings for understanding the different retrieval strategies engaged when retrieval demands are consistent versus inconsistent are discussed.

Neural correlates of differential retrieval orientation: Sustained and item-related components

Retrieval orientation refers to a cognitive state that biases processing of retrieval cues in service of a specific goal. The present study used a mixed fMRI design to investigate whether adoption of different retrieval orientations - as indexed by differences in the activity elicited by retrieval cues corresponding to unstudied items - is associated with differences in the state-related activity sustained across a block of test trials sharing a common retrieval goal. Subjects studied mixed lists comprising visually presented words and pictures. They then undertook a series of short test blocks in which all test items were visually presented words. The blocks varied according to whether the test items were used to cue retrieval of studied words or studied pictures. In several regions, neural activity elicited by correctly classified new items differed according to whether words or pictures were the targeted material. The loci of these effects suggest that one factor driving differential cue processing is modulation of the degree of overlap between cue and targeted memory representations. In addition to these item-related effects, neural activity sustained throughout the test blocks also differed according to the nature of the targeted material. These findings indicate that the adoption of different retrieval orientations is associated with distinct neural states. The loci of these sustained effects were distinct from those where new item activity varied, suggesting that the effects may play a role in biasing retrieval cue processing in favor of the current retrieval goal.

Electrophysiological dissociation of the neural correlates of recollection and familiarity

Event-related potentials (ERPs) were employed to investigate electrophysiological correlates of recognition memory in a task that allowed segregation of test items according to whether they were recollected (operationalized by introspective report) or, if recollection failed, their level of familiarity (operationalized by recognition confidence). The amplitude of a negative-going ERP deflection that onsets around 300 ms post-stimulus varied inversely with familiarity strength. This effect was maximal over the left frontal scalp. It did not differ between the ERPs elicited by highly familiar versus recollected items, indicating that the recollection is not merely a consequence of strong familiarity. By contrast, a later positive deflection (onset ca. 500 ms post-stimulus) was enhanced in ERPs elicited by recollected relative to highly familiar items. This effect was maximal over the left posterior scalp and was insensitive to familiarity, as indicated by its absence in the contrast between items judged highly familiar versus highly unfamiliar. The findings constitute a double dissociation between the neural correlates of recollection and familiarity. Together with the results of a parallel functional magnetic resonance imaging study (A.P. Yonelinas et al., J. Neurosci. (2005), 25, 3002-3008), they indicate that recollection and familiarity rely on qualitatively distinct neural systems and strongly support dual-process models of recognition memory.

Task and content modulate amygdala-hippocampal connectivity in emotional retrieval

The ability to remember emotional events is crucial for adapting to biologically and socially significant situations. Little is known, however, about the nature of the neural interactions supporting the integration of mnemonic and emotional information. Using fMRI and dynamic models of effective connectivity, we examined regional neural activity and specific interactions between brain regions during a contextual memory retrieval task. We independently manipulated emotional context and relevance of retrieved emotional information to task demands. We show that retrieval of emotionally valenced contextual information is associated with enhanced connectivity from hippocampus to amygdala, structures crucially involved with encoding of emotional events. When retrieval of emotional information is relevant to current behavior, amygdala-hippocampal connectivity increases bidirectionally, under modulatory influences from orbitofrontal cortex, a region implicated in representation of affective value and behavioral guidance. Our findings demonstrate that both memory content and behavioral context impact upon large scale neuronal dynamics underlying emotional retrieval.

MEG source localization under multiple constraints: An extended Bayesian framework

To use Electroencephalography (EEG) and Magnetoencephalography (MEG) as functional brain 3D imaging techniques, identifiable distributed source models are required. The reconstruction of EEG/MEG sources rests on inverting these models and is ill-posed because the solution does not depend continuously on the data and there is no unique solution in the absence of prior information or constraints. We have described a general framework that can account for several priors in a common inverse solution. An empirical Bayesian framework based on hierarchical linear models was proposed for the analysis of functional neuroimaging data [Friston, K., Penny, W., Phillips, C., Kiebel, S., Hinton, G., Ashburner, J., 2002. Classical and Bayesian inference in neuroimaging: theory. NeuroImage 16, 465-483] and was evaluated recently in the context of EEG [Phillips, C., Mattout, J., Rugg, M.D., Maquet, P., Friston, K., 2005. An empirical Bayesian solution to the source reconstruction problem in EEG. NeuroImage 24, 997-1011]. The approach consists of estimating the expected source distribution and its conditional variance that is constrained by an empirically determined mixture of prior variance components. Estimation uses Expectation-Maximization (EM) to give the Restricted Maximum Likelihood (ReML) estimate of the variance components (in terms of hyperparameters) and the Maximum A Posteriori (MAP) estimate of the source parameters. In this paper, we extend the framework to compare different combinations of priors, using a second level of inference based on Bayesian model selection. Using Monte-Carlo simulations, ReML is first compared to a classic Weighted Minimum Norm (WMN) solution under a single constraint. Then, the ReML estimates are evaluated using various combinations of priors. Both standard criterion and ROC-based measures were used to assess localization and detection performance. The empirical Bayes approach proved useful as: (1) ReML was significantly better than WMN for single priors; (2) valid location priors improved ReML source localization; (3) invalid location priors did not significantly impair performance. Finally, we show how model selection, using the log-evidence, can be used to select the best combination of priors. This enables a global strategy for multiple prior-based regularization of the MEG/EEG source reconstruction.

Separating the brain regions involved in recollection and familiarity in recognition memory

The neural substrates of recognition memory retrieval were examined in a functional magnetic resonance imaging study designed to separate activity related to recollection from that related to continuous variations in familiarity. Across a variety of brain regions, the neural signature of recollection was found to be distinct from familiarity, demonstrating that recollection cannot be attributed to familiarity strength. In the prefrontal cortex, an anterior medial region was related to recollection, but lateral regions, including the anterior and dorsolateral prefrontal cortex, were related to familiarity. Along the lateral parietal cortex, two functionally distinct regions were also observed: a lateral parietal/temporal region related to recollection and a more superior parietal region involved in familiarity. Similarly, in medial parietal regions, the posterior cingulate was related to recollection, whereas the precuneus was related to familiarity. The hippocampus was related to recollection, but also exhibited an inverse relationship to familiarity-driven recognition confidence. The results indicate that recollection and familiarity rely on different networks of brain regions and provide insights into the functional roles of different regions involved in episodic recognition memory.

Brain activity before an event predicts later recollection

Neural activity elicited by an event can predict whether the event is successfully encoded into memory. Here we assessed whether memory encoding relies not only on neural activity that follows an event, but also on activity that precedes it. In two experiments we found that human brain activity elicited by a cue presented just before a word could predict whether the word would be recollected in a later memory test.

fMRI correlates of retrieval orientation

Processes related to the cueing of memory retrieval were investigated using fMRI during a yes/no recognition memory test. Participants studied either pictures or auditory words and were subsequently tested with visual words that either corresponded to studied items (old items) or were unstudied (new items). It was expected that neural activity would differ according to the type of information participants are trying to retrieve: a manifestation of the so-called "retrieval orientation" effect. We replicated robust old/new effects in parietal, prefrontal and anterior medial temporal lobe cortices, which did not differ according to the study material. However, we did observe differential activity to test items in temporoparietal cortex and fusiform cortex as a function of the study material. More specifically, attempts to retrieve words encoded auditorily produced greater activity in auditory cortex than attempts to retrieve words encoded as pictures, whereas the converse was found in fusiform cortex. The above pattern was found for both new and old test items. These findings implicate these regions in constraining the search for specific types of encoded information and thus are in accordance with the transfer-appropriate processing framework. Further, we propose that our results can be seen as an extension of the cortical reinstatement hypothesis, in that the same material-specific cortical regions are engaged during both encoding and retrieval, and this increases the likelihood of successful recognition, or rejection, of retrieval cues in a memory test.

Encoding and the durability of episodic memory: a functional magnetic resonance imaging study

Memories vary in their durability even when encoding conditions apparently remain constant. We investigated whether, under these circumstances, memory durability is nonetheless associated with variation in the neural activity elicited during encoding. Event-related functional magnetic resonance imaging data were acquired while volunteers semantically classified visually presented words. Using the "remember/know" procedure, memory for one-half of the words was tested after 30 min and for the remaining half after 48 h. In several regions, including left hippocampus and left dorsal inferior frontal gyrus (IFG), activity at encoding differed depending on whether items were later recollected regardless of study-test delay. Delay-selective effects were also evident, however. Recollection after 48 h was associated with enhanced activity in bilateral ventral IFG, whereas recollection after 30 min was associated with greater fusiform activity. Thus, there is a relationship between the neural activity elicited by an event as it is encoded and the durability of the resulting memory representation.

ERP correlates of retrieval orientation: Direct versus indirect memory tasks

The neural correlates of the processes involved in cueing memory retrieval were investigated using ERPs to unstudied (new) items in a yes/no recognition test (direct memory task) and a semantic judgement task (indirect memory task). Subjects encoded either pictures or auditory words and were tested on visual words. We replicated previous findings that ERPs to correct rejections of new items in a yes/no recognition test differ according to the study material, with ERPs to words encoded as pictures being more negative (relative to a average mastoid reference) than words encoded auditorily [Hornberger, M., Morcom, A.M., et al., 2004. Neural correlates of retrieval orientation: effects of study-test similarity. J. Cogn. Neurosci. 16 (7), 1196-1210]. This difference was sustained from approximately 450-1,200 ms. An effect of study material on the ERP to new items was found in the indirect memory task but was both earlier onsetting and shorter lived, ca. 250-600 ms. These findings add weight to the concept of 'retrieval orientation' [Rugg, M.D., Wilding, E.L., 2000. Retrieval processing and episodic memory. Trends Cogn. Sci. 4 (3) 108-115] - differential processing of retrieval cues according to the form of the sought-for information - by showing that a putative ERP correlate of retrieval orientation is restricted to direct memory tasks.

Modulation of the electrophysiological correlates of retrieval cue processing by the specificity of task demands

Retrieval orientation refers to the differential processing of retrieval cues according to the type of information sought from memory (e.g., words vs. pictures). In the present study, event-related potentials (ERPs) were employed to investigate whether the neural correlates of differential retrieval orientations are sensitive to the specificity of the retrieval demands of the test task. In separate study-test phases, subjects encoded lists of intermixed words and pictures, and then undertook one of two retrieval tests, in both of which the retrieval cues were exclusively words. In the recognition test, subjects performed 'old/new' discriminations on the test items, and old items corresponded to only one class of studied material (words or pictures). In the exclusion test, old items corresponded to both classes of study material, and subjects were required to respond 'old' only to test items corresponding to a designated class of material. Thus, demands for retrieval specificity were greater in the exclusion test than during recognition. ERPs elicited by correctly classified new items in the two types of test were contrasted according to whether words or pictures were the sought-for material. Material-dependent ERP effects were evident in both tests, but the effects onset earlier and offset later in the exclusion test. The findings suggest that differential processing of retrieval cues, and hence the adoption of differential retrieval orientations, varies according to the specificity of the retrieval goal.

Modulation of retrieval processing reflects accuracy of emotional source memory

There is considerable evidence that encoding and consolidation of memory are modulated by emotion, but the retrieval of emotional memories is not well characterized. Here we manipulated the emotional context with which affectively neutral stimuli were associated during encoding, allowing us to examine neural activity associated with retrieval of emotional memories without confounding the emotional attributes of cue items and the retrieved context. Using a source memory procedure we were also able to compare how retrieval processing was modulated when the emotional encoding context was recollected or not. An interaction between emotional encoding context and accuracy of source memory revealed that successful retrieval of emotional context was associated with activity in left amygdala, and a left frontotemporal network including anterior insula, prefrontal cortex and cingulate. In contrast, when contextual retrieval was unsuccessful, items encoded in emotional contexts elicited enhanced activity in right amygdala and a right-lateralized network that included extrastriate visual areas. These findings indicate distinct effects of emotion on successful and unsuccessful retrieval of source information, including lateralization of amygdala responses.

Effects of Divided Attention on fMRI Correlates of Memory Encoding

Performing a secondary task concurrently with a study task has a detrimental effect on later memory for studied items. To investigate the mechanisms underlying this effect, the processing resources available for an incidental encoding task were varied by manipulating secondary task difficulty. fMRI data were acquired as volunteers (n = 16) made animacy decisions to visually presented study words while concurrently performing either an easy or a hard auditory monitoring task. “Subsequent memory effects”-greater activity at study for words later remembered versus words later forgotten-were identified in the left ventral inferior frontal gyrus and the left anterior hippocampus. These effects did not vary according to whether the encoding task was performed concurrently with the easy or the hard secondary task. However, as secondary task difficulty increased, study-item activity declined and auditory-item activity increased in dorsolateral prefrontal and superior parietal regions that have been implicated in the support of executive and control functions. The findings suggest that dividing attention during encoding influences the probability of engaging the encoding operations that support later episodic memory, but does not alter the nature of the operations themselves. The findings further suggest that the probability of engaging these encoding operations depends on the level of general processing resources engaged in service of the study task.

Further dissociating the processes involved in recognition memory: an FMRI study

Based on an event-related potential study by Rugg et al. [Dissociation of the neural correlates of implicit and explicit memory. Nature, 392, 595-598, 1998], we attempted to isolate the hemodynamic correlates of recollection, familiarity, and implicit memory within a single verbal recognition memory task using event-related fMRI. Words were randomly cued for either deep or shallow processing, and then intermixed with new words for yes/no recognition. The number of studied words was such that, whereas most were recognized ("hits"), an appreciable number of shallow-studied words were not ("misses"). Comparison of deep hits versus shallow hits at test revealed activations in regions including the left inferior parietal gyrus. Comparison of shallow hits versus shallow misses revealed activations in regions including the bilateral intraparietal sulci, the left posterior middle frontal gyrus, and the left frontopolar cortex. Comparison of hits versus correct rejections revealed a relative deactivation in an anterior left medial-temporal region (most likely the perirhinal cortex). Comparison of shallow misses versus correct rejections did not reveal response decreases in any regions expected on the basis of previous imaging studies of priming. Given these and previous data, we associate the left inferior parietal activation with recollection, the left anterior medial-temporal deactivation with familiarity, and the intraparietal and prefrontal responses with target detection. The absence of differences between shallow misses and correct rejections means that the hemodynamic correlates of implicit memory remain unclear.

Impairment of specific episodic memory processes by sub-psychotic doses of ketamine: the effects of levels of processing at encoding and of the subsequent retrieval task

RATIONALE

The precise nature of the impact of the N-methyl-D-aspartate antagonist, ketamine, upon human episodic memory, has yet to be elucidated fully.

OBJECTIVES

This study sought to assess the effects of ketamine on the sub-processes facilitating memory encoding and retrieval.

METHODS

We evaluated the effects of the drug on a series of memory performance measures depending upon whether it was administered at the encoding or retrieval stage and on the nature of the encoding task used. Twelve healthy volunteers participated in a double-blind, placebo-controlled, randomized, within-subjects study. Intravenous infusions of placebo, 50 ng/ml ketamine or 100 ng/ml ketamine were administered. We investigated the effects of ketamine on three key aspects of episodic memory: encoding vs retrieval processes, source memory, and depth of processing. Data were analysed using both multinomial modelling and standard measures of item discrimination and response bias.

RESULTS

Deleterious effects of ketamine on episodic memory were primarily attributable to its effects on encoding, rather than retrieval processes. Recognition memory was impaired for items encoded at an intermediate level of processing, but preserved for shallowly and deeply encoded items. Increased source guessing bias was also observed when encoding took place under ketamine.

CONCLUSIONS

The effects of ketamine upon episodic memory seem, therefore, to predominate at encoding. Furthermore, our results are also consistent with a specific impairment of encoding processes that result in subsequent recollective, as opposed to familiarity-based, retrieval. The observed effects are compatible with memory deficits seen in schizophrenia and thus provide some support for the ketamine model of the disease.

Electrophysiological Dissociation of Picture Versus Word Encoding: The Distinctiveness Heuristic as a Retrieval Orientation

Event-related potentials (ERPs) were used to investigate the neural processes underlying the distinctiveness heuristic— a response mode in which participants expect to remember vivid details of an experience and make recognition decisions based on this metacognitive expectation. One group of participants studied pictures and auditory words; another group studied visual and auditory words. Studied and novel items were presented at test as words only, with all novel items repeating after varying lags. ERP differences were seen between the word and picture groups for both studied and novel items. For the novel items, ERP differences were largest in frontal and central midline electrodes. In separate analyses, the picture group showed the greatest ERP differences between item types in a parietally based component from 550 to 1000 msec, whereas the word group showed the greatest differences in a frontally based component from 1000 to 2000 msec. The authors suggest that the distinctiveness heuristic is a retrieval orientation that facilitates reliance upon recollection to differentiate between item types. Although the picture group can use this heuristic and its retrieval orientation on the basis of recollection, the word group must engage additional postretrieval processes to distinguish between item types, reflecting the use of a different retrieval orientation.

An empirical Bayesian solution to the source reconstruction problem in EEG

Distributed linear solutions of the EEG source localisation problem are used routinely. In contrast to discrete dipole equivalent models, distributed linear solutions do not assume a fixed number of active sources and rest on a discretised fully 3D representation of the electrical activity of the brain. The ensuing inverse problem is underdetermined and constraints or priors are required to ensure the uniqueness of the solution. In a Bayesian framework, the conditional expectation of the source distribution, given the data, is attained by carefully balancing the minimisation of the residuals induced by noise and the improbability of the estimates as determined by their priors. This balance is specified by hyperparameters that control the relative importance of fitting and conforming to various constraints. Here we formulate the conventional "Weighted Minimum Norm" (WMN) solution in terms of hierarchical linear models. An "Expectation-Maximisation" (EM) algorithm is used to obtain a "Restricted Maximum Likelihood" (ReML) estimate of the hyperparameters, before estimating the "Maximum a Posteriori" solution itself. This procedure can be considered a generalisation of previous work that encompasses multiple constraints. Our approach was compared with the "classic" WMN and Maximum Smoothness solutions, using a simplified 2D source model with synthetic noisy data. The ReML solution was assessed with four types of source location priors: no priors, accurate priors, inaccurate priors, and both accurate and inaccurate priors. The ReML approach proved useful as: (1) The regularisation (or influence of the a priori source covariance) increased as the noise level increased. (2) The localisation error (LE) was negligible when accurate location priors were used. (3) When accurate and inaccurate location priors were used simultaneously, the solution was not influenced by the inaccurate priors. The ReML solution was then applied to real somatosensory-evoked responses to illustrate the application in an empirical setting.

Content-specificity of the neural correlates of recollection

It is widely assumed that episodic retrieval (recollection) involves reinstatement of cortical activity engaged during the processing of an episode when it was initially experienced. It follows from this assumption that the cortical correlates of recollection should differ with the content of what is recollected, and that retrieval of different content should be associated with activity in functionally distinct cortical regions. The present experiment investigated these predictions. Subjects (N=17) studied a mixed list of words and pictures and were then presented with a test list comprised of words only. Test items were studied words, the names of studied pictures, and unstudied (new) words. Functional magnetic resonance images were acquired while the subjects made Remember/Know/New judgments to these test words. Independent of study material, studied items endorsed as Remembered elicited greater activity than correctly classified unstudied items in several regions, including left frontal, left lateral parietal, and posterior cingulate cortex. In addition, Remembered items elicited greater activity in the right hippocampus and parahippocampal gyrus than items accorded Know judgments, replicating previous findings. Analysis of content-specific effects demonstrated a regional double-dissociation within left fusiform cortex; recollected words elicited greater activity than recollected pictures in lateral fusiform, whereas the reverse effect was evident in an anterior fusiform region. The lateral and anterior fusiform areas correspond closely to areas held to be functionally specialized for the processing of visual words and pictures, respectively. Thus, the current findings support the cortical reinstatement hypothesis of episodic retrieval.

An event-related potential study of two kinds of source judgment errors

The neural correlates of source judgment errors for confusable and nonconfusable source-item pairings were investigated. At study, subjects were presented with a series of lists of word pairs. Word pairs belonging to the same list were formed by pairing one of two associated words with different associates of an unstudied theme word (e.g., ship-frost, captain-chilly, ship-freeze, captain-frigid, etc., in one list; wife-pane, husband-glass, wife-curtain, husband-sill, etc., in another list). At test, subjects discriminated 'Old pairs' (e.g., ship-frost) from 'Intra' rearranged pairs (e.g., ship-chilly), 'Inter' rearranged pairs (e.g., ship-pane), and 'Old-New' pairs (e.g., ship-bulb). Event-related potentials (ERPs) were recorded for each class of test item. Similar proportions of 'yes' responses to Old and Intra rearranged pairs were observed, but the false alarm rate for Inter rearranged pairs was markedly lower. ERPs elicited by correctly classified Old pairs and false alarms to Intra rearranged pairs were indistinguishable and exhibited 'left parietal' and 'right frontal' effects, characteristic of recollection-based recognition. ERPs for false alarms to Inter rearranged pairs did not show these effects. It is concluded that source judgment errors for confusable source-item pairings are mediated by the same processes that support correct source judgments. Such errors reflect recollection of gist information which is nondiagnostic with respect to source.

Neural Correlates of Retrieval Orientation: Effects of Study–Test Similarity

ERPs elicited by correctly classified unstudied items in tests of yes/no recognition memory were used to investigate the neural correlates of retrieval cue processing. Items in Experiment 1 consisted of pictures and their corresponding names, allowing study and test material to be factorially crossed in four separate study–test cycles. The ERPs elicited by unstudied pictures and words were, in each case, more negative-going when the study material belonged to the alternative rather than the same class of items. These findings demonstrate that previously reported ERP “retrieval orientation effects” depend on differences in similarity between study and test items, and not on the form of the sought for material. In Experiments 2a and 2b, study materials were auditory words and pictures, and the test items were visual words. In both experiments, ERPs elicited by unstudied test words were more negative-going when pictures rather than auditory words were the study material. Thus, ERP retrieval orientation effects do not depend on the employment of a copy cue condition. It is proposed that the effects reflect differences in the processing necessary to maximize over lap between cue and memory representations.

The effects of age on the neural correlates of successful episodic retrieval: An ERP study

The neural correlates of successful episodic retrieval (recollection), as reflected in event-related potentials (ERPs), were investigated in young (ca 20 years; n = 18) and older (ca 70 years; n = 16) healthy individuals. Subjects classified a series of pictures according to whether each item was new or had been encountered at study in the context of an animacy or a size judgment task. By manipulating the number of times items were presented for study, subsets of test items were formed for which source accuracy did not differ according to age. Relative to ERPs elicited by unstudied pictures, ERPs elicited by items attracting equivalent levels of source accuracy showed marked age-related differences. Those from younger subjects demonstrated the positive-going left parietal and right frontal old/new effects described in several previous studies of source memory. By contrast, analogous ERPs from older subjects contained a large left-lateralized negative effect that overshadowed the positive-going effects evident in the young. No age-related differences in either parietal or frontal ERP old/new effects were detected at electrode sites overlying the right hemisphere. It is possible that the age-related ERP differences observed in this task primarily reflect the use of different kinds of information as a basis for source judgments.

Event-Related Potential Correlates of the Retrieval of Emotional and Nonemotional Context

In two experiments, we examined event-related potentials (ERPs) elicited in an old/new recognition memory test by emotionally neutral visual objects that, at encoding, had been associated with neutrally, negatively, or positively valenced background contexts. In Experiment 2, subjects also judged the context in which the item had been studied. In Experiment 1, “left parietal” old/new ERP effects were elicited by correctly recognized items. Items encoded in emotional contexts, but not those studied in neutral contexts, elicited additional effects early in the recording epoch over lateral temporal scalp and, later, over left temporo-frontal scalp. In Experiment 2, “left parietal” and “right frontal” ERP effects were elicited by recognized items that attracted correct source judgments. Additional effects, an early lateral temporal positivity and a late-onset, left-sided positivity, were elicited by items studied in emotionally valenced contexts and attracting correct source judgments. Together, the findings indicate that retrieval processing is influenced by the emotional valence of the context in which an item is encoded, regardless of whether contextual information is task relevant.

fMRI correlates of the episodic retrieval of emotional contexts

Functional neuroimaging studies reveal differences in neural correlates of the retrieval of emotional and nonemotional memories. In the present experiment, encoding of emotionally neutral pictures in association with positively, neutrally or negatively valenced background contexts led to differential modulation of neural activity elicited in a subsequent recognition memory test for these pictures. Recognition of stimuli previously studied in emotional compared to neutral contexts elicited enhanced activity in structures previously implicated in episodic memory, including the parahippocampal cortex, hippocampus and prefrontal cortex. In addition, there was engagement of structures linked more specifically to emotional processing, including the amygdala, orbitofrontal cortex and anterior cingulate cortex. These emotion-related effects displayed both valence-independent and valence-specific components. We discuss the findings in terms of current models of emotional memory retrieval.

Remembrance of Odors Past

Episodic memory is often imbued with multisensory richness, such that the recall of an event can be endowed with the sights, sounds, and smells of its prior occurrence. While hippocampus and related medial temporal structures are implicated in episodic memory retrieval, the participation of sensory-specific cortex in representing the qualities of an episode is less well established. We combined functional magnetic resonance imaging (fMRI) with a cross-modal paradigm, where objects were presented with odors during memory encoding. We then examined the effect of odor context on neural responses at retrieval when these same objects were presented alone. Primary olfactory (piriform) cortex, as well as anterior hippocampus, was activated during the successful retrieval of old (compared to new) objects. Our findings indicate that sensory features of the original engram are preserved in unimodal olfactory cortex. We suggest that reactivation of memory traces distributed across modality-specific brain areas underpins the sensory qualities of episodic memories.

The effect of repetition lag on electrophysiological and haemodynamic correlates of visual object priming

The modulation of repetition effects by the lag between first and second presentations of a visual object during a speeded semantic judgment task was examined using both scalp event-related potentials (ERPs) and event-related functional magnetic resonance imaging (efMRI). Four levels of lag were used within a single session, from zero to one, to tens of intervening stimuli, and which allowed partial separation of the effects of interference from the effects of time. Reaction times (RTs) showed that the magnitude of repetition priming decreased as lag increased. The ERP data showed two distinct effects of repetition, one between 150 and 300 ms post stimulus and another between 400 and 600 ms. The magnitude of both effects, particularly the earlier one, decreased as lag increased. The fMRI data showed a decrease in the haemodynamic response associated with repetition in several inferior occipitotemporal regions, the magnitude of which also typically decreased as lag increased. In general, and contrary to expectations, lag appeared to have mainly quantitative effects on the three types of dependent variable: there was little evidence for qualitative differences in the neural correlates of repetition effects at different lags.

Effects of age on retrieval cue processing as revealed by ERPs

The electrophysiological correlates of retrieval cue processing were investigated in healthy young (18-30 years) and older (63-75 years) subjects (n = 16 per group). Retrieval orientation--the differential processing of cues according to the form of the sought-for information--and retrieval difficulty were manipulated in a factorial design. In separate study-test cycles, subjects studied either words or pictures, and performed a yes/no recognition memory task with words as the test items. ERPs elicited by correctly classified new words differed markedly according to study material in the young subjects, replicating previous findings. In the older subjects, this effect was smaller than in the young, and had a later onset and earlier offset. The scalp topography of the effect was however statistically indistinguishable in the two groups. These age-related ERP differences were unmodulated by task difficulty, and remained reliable when recognition performance was matched across the groups. By contrast, the magnitude and timing of ERP difficulty effects were unaffected by age. The findings suggest that older subjects are less able than young individuals to vary their processing of retrieval cues in response to different retrieval demands.

Probability effects on the neural correlates of retrieval success: an fMRI study

Event-related fMRI was employed to investigate the influence of the relative probability of old and new test items on the neural correlates of recognition memory. Twelve subjects undertook three study-test cycles, each consisting of an identical study phase in which a series of words was encoded in an incidental task, followed by a test phase in which yes/no recognition judgments were made to a mixture of studied (old) and unstudied (new) words. The ratio of old to new words differed in each test phase, and was either 25:75, 50:50, or 75:25. In lateral inferior and medial parietal cortex, and the posterior cingulate, greater activity was elicited by correctly classified old than new items independently of old:new ratio. By contrast, in other regions, including anterior, dorsolateral, and ventrolateral prefrontal cortex, differences in the activity elicited by old and new items varied according to old:new ratio, demonstrating in some cases a complete crossover interaction. The results suggest that differential activity elicited by old and new test items is likely to support successful recognition in only a subset of the regions identified in previous studies as exhibiting such differences. In other regions, most notably prefrontal cortex, differences in the activity elicited by old and new items appear to reflect processes that are contingent upon, rather than in support of, successful recognition.

The impact of change in stimulus format on the electrophysiological indices of recognition

The present study investigated the impact of changes in stimulus format between study and test on the event-related potential (ERP) correlates of recognition. To this end subjects studied the names and pictures of common objects. At retrieval, subjects were presented with old items for which the presentational format had changed (from picture to name or vice versa), old items that were shown in the same format as at study, and new items. ERPs revealed three temporally, spatially and functionally dissociable memory-related effects: an early bilateral frontal effect, which was sensitive to the perceptual similarity between study and test stimulus; a left temporo-parietal effect, which was sensitive to the type of stimulus that was encoded; and a late frontal effect, which was largest over right electrode sites and appeared to be sensitive to the type of test stimulus. The results provide further evidence for a functional dissociation between the early bilateral frontal and the later temporo-parietal old/new effect, suggesting an interpretation in terms of processes contributing to a perceptually-driven familiarity or novelty assessment and recollection, respectively.

Strategic influences on recollection in the exclusion task: Electrophysiological evidence

One assumption underlying the use of the exclusion task as part of the process dissociation procedure is that studied items are successfully excluded only when they are recollected. The present study employed event-related potentials (ERPs) to demonstrate that successful exclusion does not necessarily require recollection. In two experiments, the study tasks for to-be-excluded items were identical, but the tasks employed with target items differed, giving better memory for these items in Experiment 1 than in Experiment 2. Successfully excluded items elicited the ERP signature for recollection--the left parietal old/new effect--in Experiment 2 only. These findings indicate that the subjects adopted different retrieval strategies in the two experiments. It is suggested that they made more use of source information about to-be-excluded items in the second experiment than in the first.

Late frontal brain potentials distinguish true and false recognition

Brain potentials associated with true and false recognition were recorded using a paradigm consisting of categorized color photographs. Two ERP components were identified. A parietal component was most positive for both true and false recognition, less positive for rejection of lures, and least positive for rejection of novel items. A later frontal component was more positive for false recognition, rejection of lures, and misses than for true recognition and rejection of novel items. The authors suggest that the parietal component may reflect the extent to which test items engender recollection of the gist representation of the study list, while the late frontal component may reflect the engagement of effortful post-retrieval processes.

Retrieval Orientation and the Control of Recollection

Event-related potentials (ERPs) were employed to investigate whether recognition test items are processed differently according to whether they are used to probe memory for previously studied words or pictures. In each of two study-test blocks, subjects encoded a mixed list of words and pictures, and then performed a recognition memory task with words as the test items. In one block, the requirement was to respond positively to test items corresponding to studied words, and to reject both new items and items corresponding to the studied pictures. In the other block, positive responses were made to test items corresponding to pictures, and items corresponding to words were classified along with the new items. ERPs elicited during the test phase by correctly classified new items differed according to whether words or pictures were the sought-for modality. This finding was interpreted as a neural correlate of the different retrieval orientations adopted when searching memory for words versus pictures. Relative to new items, correctly classified items studied in both target modalities elicited robust, positive-going “old/new” effects. When pictures were targets, test items corresponding to studied words also elicited large effects. By contrast, when words were targets, old/ new effects were absent for the items corresponding to studied pictures. These findings were interpreted as evidence that, in some circumstances, adoption of an appropriate retrieval orientation permits retrieval cues to be employed with a high degree of specificity.

Human recognition memory: a cognitive neuroscience perspective

For many years the cognitive processes underlying recognition memory have been the subject of considerable interest in experimental psychology. To account for a broad range of behavioral findings, psychologists have put forward a variety of 'dual-process' models, all of which propose that recognition memory is supported by two forms of memory - familiarity and recollection - that differ in their speed of operation and the specificity of the retrieved information. More recently, the dual-process framework has been extended to encompass findings from studies investigating the neural basis of recognition memory. Results from neuropsychological, ERP and functional neuroimaging studies can be accommodated within the framework, and suggest that familiarity and recollection are supported by distinct neural mechanisms.

Electrophysiological and haemodynamic correlates of face perception, recognition and priming

Face perception, recognition and priming were examined with event-related functional magnetic resonance imaging (fMRI) and scalp event-related potentials (ERPs). Face perception was associated with haemodynamic increases in regions including bilateral fusiform and right superior temporal cortices, and a right posterior negativity (N170), most likely generated in the superior temporal region. Face recognition was associated with haemodynamic increases in fusiform, medial frontal and orbitofrontal cortices, and with a frontocentral positivity from 550 ms poststimulus. Face repetition was associated with a positivity from 400 to 600 ms and behavioural priming. Repetition of familiar faces was also associated with earlier onset of the ERP familiarity effect, and haemodynamic decreases in fusiform cortex. These data support a multi-component model of face-processing, with priming arising from more than one stage.

Repetition effects elicited by objects and their contexts: an fMRI study

Event-related fMRI responses were recorded during a recognition memory test for previously studied visual objects. Some studied objects were superimposed on the same context (landscape scenes) as at study, some were superimposed on a different studied context, and some were paired with new contexts. Unstudied objects were paired with either a studied or a new context. Relative to all other stimulus classes, test stimuli where both components were unstudied elicited enhanced responses in lateral and ventral extrastriate visual cortex. This effect, which is analogous to a previously described electrophysiological result obtained with the same experimental procedure, had the same magnitude regardless of whether a test item was composed of one or two studied components, or whether a single studied component was task relevant or task irrelevant. The findings point to the existence of repetition-sensitive neural mechanisms that operate in a non-linear manner.

Neural correlates of retrieval processing in the prefrontal cortex during recognition and exclusion tasks

Event-related fMRI was employed to contrast the neural activity elicited in prefrontal cortex during recognition memory and exclusion tests. The study phases preceding each memory test were identical, involving the presentation of study items (visually presented words) in one of two study contexts. For the recognition test subjects were required to respond positively to all old items regardless of study context, and to respond negatively to new items. For the exclusion task, positive responses were required to old items presented in one of the study contexts only; negative responses were required both to unstudied items and studied items from the alternative context (non-targets). No prefrontal region demonstrated greater activity for new items in the exclusion task. Thus, there was no evidence that retrieval cues were processed differently according to the specificity of the sought-for information. In several regions, most notably bilateral anterior prefrontal cortex, activity was greater for old than for new items regardless of task. Activity in right dorsolateral prefrontal cortex was also greater for old than for new items; these effects however were larger in the exclusion task. The findings are consistent with previous reports that activity in anterior prefrontal cortex elicited by recognition retrieval cues is sensitive to retrieval success, and extend these findings to the exclusion task. The findings for the right dorsolateral cortex add further weight to the proposal that this region supports post-retrieval monitoring of retrieved information.

Neural response suppression, haemodynamic repetition effects, and behavioural priming

Repeated stimulus processing is often associated with a reduction in neural activity, as measured by single-cell recording or by haemodynamic imaging techniques like PET and fMRI. These reductions are sometimes linked to the behavioural phenomenon of priming. In this article, we discuss issues relevant to theories that attempt to relate these phenomena, concentrating in particular on the interpretative limitations of current imaging techniques.

Probability effects on event-related potential correlates of recognition memory

A common finding in event-related potential (ERP) studies of recognition memory is that recognised items elicit greater positivity at parietal electrode sites than new items (the 'left parietal old/new effect'). Parietal positivity (the P300 or P3b) is also elicited in detection tasks with no memory demands by items of low probability of occurrence and high 'target value'. It has been argued that correctly recognised items are typically associated with lower probability and higher target value than new items, raising the question of the extent to which the old/new effect receives a contribution from, or interacts with, P300 activity. The present study explored this issue by comparing ERPs associated with correctly classified old and new items across three different ratios of old to new items: 25:75, 50:50 and 75:25. The left parietal old/new effect was not influenced by this manipulation in the latency range in which it is conventionally measured. Probability did influence the parietal ERPs to correctly recognised items post-800 ms; the scalp distribution of this probability effect was however qualitatively distinct from that of the preceding old/new effect. The left parietal old/new effect appears to be a relatively pure reflection of episodic retrieval, uncontaminated by the non-mnemonic factors of probability and target value.

Age effects on the neural correlates of successful memory encoding

Event-related functional MRI (fMRI) was used to investigate the neural correlates of memory encoding as a function of age. While fMRI data were obtained, 14 younger (mean age 21 years) and 14 older subjects (mean age 68 years) made animacy decisions about words. Recognition memory for these words was tested at two delays such that older subjects' performance at the short delay was comparable to that of the young subjects at the long delay. This allowed age-associated changes in the neural correlates of encoding to be dissociated from the correlates of differential recognition performance. Activity in left inferior prefrontal cortex and the left hippocampal formation was greater for subsequently recognized words in both age groups, consistent with the findings of previous studies in young adults. In the prefrontal cortex, these 'subsequent memory effects' were, however, left-lateralized in the younger group but bilateral in the older subjects. In addition, for the younger group only, greater activity for remembered words was observed in anterior inferior temporal cortex, as were reversed effects ('subsequent forgetting' effects) in anterior prefrontal regions. The data indicate that older subjects engage much of the same neural circuitry as younger subjects when encoding new memories. However, the findings also point to age-related differences in both prefrontal and temporal activity during successful episodic encoding.