Neural manifestations of memory with and without awareness

Early response activation in repetition priming: an LRP study

According to recent interpretations of repetition priming, response codes are automatically bound to a stimulus and retrieved during successive presentations of the stimulus, hence, affecting its current processing. Despite a solid corpus of behavioural evidence in line with this interpretation, electrophysiological studies have reported contrasting results regarding the nature and the timing of response code retrieval. The present experiment aims to establish at which stage of information processing decision and action codes are retrieved in repetition priming. To this end, the lateralized readiness potential (LRP) was analysed for primed faces to monitor motor cortex activity related to response preparation. Congruent and incongruent responses were obtained by having identical or reversed tasks between study and test. Primed stimuli presented LRP activations with opposite polarities for the two congruency conditions in the time-window 250-300 ms, indicating response-related motor cortex activity resulting from the retrieval of correct and incorrect decision/action codes for congruent and incongruent trials, respectively. This result indicates that decision and action codes bound to a primed stimulus are retrieved at early stages of stimulus processing and that these codes are transmitted to the motor cortex.

Repetition and ERPs during emotional scene processing: A selective review

A set of studies are reviewed that investigate the effects of repetition during scene perception on event-related potentials, elucidating perceptual, memory and emotional processes. Repetition suppression was consistently found for the amplitude of early frontal N2 and posterior P2 components, which was greatly enhanced for massed, compared to distributed, repetition. Both repetition suppression and enhancement of the amplitude of a centro-parietal positive potential (LPP) were found in specific contexts. Suppression was reliably found following a massive number of repetitions of few items, whereas enhancement is found when repetitions are spaced; enhancement was apparent both during simple free viewing as well as on an explicit recognition test. Regardless of repetition, an enhanced LPP was always found for emotional, compared to neutral, scenes. Taken together, the data suggest that different effects of massed and distributed repetitions on specific ERP components index perceptual priming, habituation, and spontaneous episodic retrieval.

Electrical Signals of Memory and of the Awareness of Remembering

Learning factual information and accurately remembering specific experiences from the past are central to human intellectual and social life. These extraordinary abilities require computations on diverse sorts of information represented in the brain. Networks of neurons in the cerebral cortex are specialized for analyzing and representing such information, whereas the storage of facts and events within these networks depends fundamentally on linking multiple representational fragments together. This cross-cortical linking function is disrupted in patients with amnesia. Electrical measures of the brain in action, obtained while people perform feats of memory in laboratory settings, have been used to investigate the storage and retrieval of facts and episodes. Electrical signals associated with specific aspects of memory processing have been identified through research that constitutes part of a larger scientific endeavor aimed at understanding memory, the subjective experience of remembering that can accompany retrieval, and disorders of memory that can result from brain damage.

Functional differences between statistical learning with and without explicit training

Humans are capable of rapidly extracting regularities from environmental input, a process known as statistical learning. This type of learning typically occurs automatically, through passive exposure to environmental input. The presumed function of statistical learning is to optimize processing, allowing the brain to more accurately predict and prepare for incoming input. In this study, we ask whether the function of statistical learning may be enhanced through supplementary explicit training, in which underlying regularities are explicitly taught rather than simply abstracted through exposure. Learners were randomly assigned either to an explicit group or an implicit group. All learners were exposed to a continuous stream of repeating nonsense words. Prior to this implicit training, learners in the explicit group received supplementary explicit training on the nonsense words. Statistical learning was assessed through a speeded reaction-time (RT) task, which measured the extent to which learners used acquired statistical knowledge to optimize online processing. Both RTs and brain potentials revealed significant differences in online processing as a function of training condition. RTs showed a crossover interaction; responses in the explicit group were faster to predictable targets and marginally slower to less predictable targets relative to responses in the implicit group. P300 potentials to predictable targets were larger in the explicit group than in the implicit group, suggesting greater recruitment of controlled, effortful processes. Taken together, these results suggest that information abstracted through passive exposure during statistical learning may be processed more automatically and with less effort than information that is acquired explicitly.

Conscious and unconscious memory systems

The idea that memory is not a single mental faculty has a long and interesting history but became a topic of experimental and biologic inquiry only in the mid-20th century. It is now clear that there are different kinds of memory, which are supported by different brain systems. One major distinction can be drawn between working memory and long-term memory. Long-term memory can be separated into declarative (explicit) memory and a collection of nondeclarative (implicit) forms of memory that include habits, skills, priming, and simple forms of conditioning. These memory systems depend variously on the hippocampus and related structures in the parahippocampal gyrus, as well as on the amygdala, the striatum, cerebellum, and the neocortex. This work recounts the discovery of declarative and nondeclarative memory and then describes the nature of declarative memory, working memory, nondeclarative memory, and the relationship between memory systems.

The temporal dynamics of visual object priming

Priming reflects an important means of learning that is mediated by implicit memory. Importantly, priming occurs for previously viewed objects (item-specific priming) and their category relatives (category-wide priming). Two distinct neural mechanisms are known to mediate priming, including the sharpening of a neural object representation and the retrieval of stimulus-response mappings. Here, we investigated whether the relationship between these neural mechanisms could help explain why item-specific priming generates faster responses than category-wide priming. Participants studied pictures of everyday objects, and then performed a difficult picture identification task while we recorded event-related potentials (ERP). The identification task gradually revealed random line segments of previously viewed items (Studied), category exemplars of previously viewed items (Exemplar), and items that were not previously viewed (Unstudied). Studied items were identified sooner than Unstudied items, showing evidence of item-specific priming, and importantly Exemplar items were also identified sooner than Unstudied items, showing evidence of category-wide priming. Early activity showed sustained neural suppression of parietal activity for both types of priming. However, these neural suppression effects may have stemmed from distinct processes because while category-wide neural suppression was correlated with priming behavior, item-specific neural suppression was not. Late activity, examined with response-locked ERPs, showed additional processes related to item-specific priming including neural suppression in occipital areas and parietal activity that was correlated with behavior. Together, we conclude that item-specific and category-wide priming are mediated by separate, parallel neural mechanisms in the context of the current paradigm. Temporal differences in behavior are determined by the timecourses of these distinct processes.

Relationships between priming and subsequent recognition memory

A discrepancy exists among previous studies regarding whether priming and subsequent recognition memory are positively or negatively correlated. We consider that the difference in recognition memory measures used in these studies accounts for the discrepancy. To examine this, we introduced three different recognition measures and reexamined the relationship between priming and subsequent recognition. Participants learned stimulus words in the first encoding block while performing an abstract/concrete decision task. In the second encoding block, a priming test was conducted, followed by a surprise recognition memory test. Results showed that the hit rate and hit rate (pHit)-false-alarm rate (pFA) positively correlated with priming. However, the difference between hit rates for the twice- and once-encoded stimuli, which can reflect the representations acquired at the second exposure in particular, did not significantly correlate with priming. These results suggest that priming and subsequent recognition relate positively because of the common representations acquired at the initial encoding. Furthermore, the present results are consistent with a previous study that failed to reproduce the negative correlation between priming and subsequent recognition.

How and where: theory-of-mind in the brain

•

Neuroscience has the potential to address accounts of theory-of-mind acquisition.

•

Review of the research on the neural basis of theory-of-mind in adults and children.

•

Future research directions include microgenetic and training fMRI studies.

Theory of mind (ToM) is a core topic in both social neuroscience and developmental psychology, yet theory and data from each field have only minimally constrained thinking in the other. The two fields might be fruitfully integrated, however, if social neuroscientists sought evidence directly relevant to current accounts of ToM development: modularity, simulation, executive, and theory theory accounts. Here we extend the distinct predictions made by each theory to the neural level, describe neuroimaging evidence that in principle would be relevant to testing each account, and discuss such evidence where it exists. We propose that it would be mutually beneficial for both fields if ToM neuroimaging studies focused more on integrating developmental accounts of ToM acquisition with neuroimaging approaches, and suggest ways this might be achieved.

Neural representation of face familiarity in an awake chimpanzee

Evaluating the familiarity of faces is critical for social animals as it is the basis of individual recognition. In the present study, we examined how face familiarity is reflected in neural activities in our closest living relative, the chimpanzee. Skin-surface event-related brain potentials (ERPs) were measured while a fully awake chimpanzee observed photographs of familiar and unfamiliar chimpanzee faces (Experiment 1) and human faces (Experiment 2). The ERPs evoked by chimpanzee faces differentiated unfamiliar individuals from familiar ones around midline areas centered on vertex sites at approximately 200 ms after the stimulus onset. In addition, the ERP response to the image of the subject's own face did not significantly diverge from those evoked by familiar chimpanzees, suggesting that the subject's brain at a minimum remembered the image of her own face. The ERPs evoked by human faces were not influenced by the familiarity of target individuals. These results indicate that chimpanzee neural representations are more sensitive to the familiarity of conspecific than allospecific faces.

Repetition and brain potentials when recognizing natural scenes: task and emotion differences

Repetition has long been known to facilitate memory performance, but its effects on event-related potentials (ERPs), measured as an index of recognition memory, are less well characterized. In Experiment 1, effects of both massed and distributed repetition on old-new ERPs were assessed during an immediate recognition test that followed incidental encoding of natural scenes that also varied in emotionality. Distributed repetition at encoding enhanced both memory performance and the amplitude of an old-new ERP difference over centro-parietal sensors. To assess whether these repetition effects reflect encoding or retrieval differences, the recognition task was replaced with passive viewing of old and new pictures in Experiment 2. In the absence of an explicit recognition task, ERPs were completely unaffected by repetition at encoding, and only emotional pictures prompted a modestly enhanced old-new difference. Taken together, the data suggest that repetition facilitates retrieval processes and that, in the absence of an explicit recognition task, differences in old-new ERPs are only apparent for affective cues.

Electrophysiological distinctions between recognition memory with and without awareness

The influence of implicit memory representations on explicit recognition may help to explain cases of accurate recognition decisions made with high uncertainty. During a recognition task, implicit memory may enhance the fluency of a test item, biasing decision processes to endorse it as "old". This model may help explain recognition-without-identification, a remarkable phenomenon in which participants make highly accurate recognition decisions despite the inability to identify the test item. The current study investigated whether recognition-without-identification for pictures elicits a similar pattern of neural activity as other types of accurate recognition decisions made with uncertainty. Further, this study also examined whether recognition-without-identification for pictures could be attained by the use of perceptual and conceptual information from memory. To accomplish this, participants studied pictures and then performed a recognition task under difficult viewing conditions while event-related potentials (ERPs) were recorded. Behavioral results showed that recognition was highly accurate even when test items could not be identified, demonstrating recognition-without-identification. The behavioral performance also indicated that recognition-without-identification was mediated by both perceptual and conceptual information, independently of one another. The ERP results showed dramatically different memory related activity during the early 300 to 500ms epoch for identified items that were studied compared to unidentified items that were studied. Similar to previous work highlighting accurate recognition without retrieval awareness, test items that were not identified, but correctly endorsed as "old," elicited a negative posterior old/new effect (i.e., N300). In contrast, test items that were identified and correctly endorsed as "old," elicited the classic positive frontal old/new effect (i.e., FN400). Importantly, both of these effects were elicited under conditions when participants used perceptual information to make recognition decisions. Conceptual information elicited very different ERPs than perceptual information, showing that the informational wealth of pictures can evoke multiple routes to recognition even without awareness of memory retrieval. These results are discussed within the context of current theories regarding the N300 and the FN400.

Errorless and errorful learning of face-name associations: an electrophysiological study

The advantage of errorless learning over errorful learning is associated with the avoidance of errors during learning. Errorful learning challenges the executive control system as erroneous items compete with correct items during retrieval. In an event-related potential (ERP) study, face-name associations learned in errorless or errorful mode were contrasted during retrieval. Learning mode was manipulated by the number of distracters. This modulation resulted in best performances after errorless learning followed by medium and high conflict errorful learning but lost its advantage over time. Within stimulus-locked ERPs, the N250 and the N400f components were associated with successful retrieval. The N250 was also driven by learning mode. Within response-locked ERPs, the error-related negativity (ERN) was modulated by correctness. The error-positivity (Pe) to erroneous responses was modulated by learning mode. The study reveals an initial advantage of errorless over errorful learning, which diminishes over time. The neurocognitive findings are discussed in light of conflict and error-likelihood models.

More than a feeling: Pervasive influences of memory without awareness of retrieval

The subjective experiences of recollection and familiarity have featured prominently in the search for neurocognitive mechanisms of memory. However, these two explicit expressions of memory, which involve conscious awareness of memory retrieval, are distinct from an entire category of implicit expressions of memory that do not entail such awareness. This review summarizes recent evidence showing that neurocognitive processing related to implicit memory can powerfully influence the behavioral and neural measures typically associated with explicit memory. Although there are striking distinctions between the neurocognitive processing responsible for implicit versus explicit memory, tests designed to measure only explicit memory nonetheless often capture implicit memory processing as well. In particular, the evidence described here suggests that investigations of familiarity memory are prone to the accidental capture of implicit memory processing. These findings have considerable implications for neurocognitive accounts of memory, as they suggest that many neural and behavioral measures often accepted as signals of explicit memory instead reflect the distinct operation of implicit memory mechanisms that are only sometimes related to explicit memory expressions. Proper identification of the explicit and implicit mechanisms for memory is vital to understanding the normal operation of memory, in addition to the disrupted memory capabilities associated with many neurological disorders and mental illnesses. We suggest that future progress requires utilizing neural, behavioral, and subjective evidence to dissociate implicit and explicit memory processing so as to better understand their distinct mechanisms as well as their potential relationships. When searching for the neurocognitive mechanisms of memory, it is important to keep in mind that memory involves more than a feeling.

Implicit recognition based on lateralized perceptual fluency

In some circumstances, accurate recognition of repeated images in an explicit memory test is driven by implicit memory. We propose that this “implicit recognition” results from perceptual fluency that influences responding without awareness of memory retrieval. Here we examined whether recognition would vary if images appeared in the same or different visual hemifield during learning and testing. Kaleidoscope images were briefly presented left or right of fixation during divided-attention encoding. Presentation in the same visual hemifield at test produced higher recognition accuracy than presentation in the opposite visual hemifield, but only for guess responses. These correct guesses likely reflect a contribution from implicit recognition, given that when the stimulated visual hemifield was the same at study and test, recognition accuracy was higher for guess responses than for responses with any level of confidence. The dramatic difference in guessing accuracy as a function of lateralized perceptual overlap between study and test suggests that implicit recognition arises from memory storage in visual cortical networks that mediate repetition-induced fluency increments.

Implicit and explicit mechanisms of word learning in a narrative context: an event-related potential study

The vast majority of word meanings are learned simply by extracting them from context rather than by rote memorization or explicit instruction. Although this skill is remarkable, little is known about the brain mechanisms involved. In the present study, ERPs were recorded as participants read stories in which pseudowords were presented multiple times, embedded in consistent, meaningful contexts (referred to as meaning condition, M+) or inconsistent, meaningless contexts (M-). Word learning was then assessed implicitly using a lexical decision task and explicitly through recall and recognition tasks. Overall, during story reading, M- words elicited a larger N400 than M+ words, suggesting that participants were better able to semantically integrate M+ words than M- words throughout the story. In addition, M+ words whose meanings were subsequently correctly recognized and recalled elicited a more positive ERP in a later time window compared with M+ words whose meanings were incorrectly remembered, consistent with the idea that the late positive component is an index of encoding processes. In the lexical decision task, no behavioral or electrophysiological evidence for implicit priming was found for M+ words. In contrast, during the explicit recognition task, M+ words showed a robust N400 effect. The N400 effect was dependent upon recognition performance, such that only correctly recognized M+ words elicited an N400. This pattern of results provides evidence that the explicit representations of word meanings can develop rapidly, whereas implicit representations may require more extensive exposure or more time to emerge.

Time to go our separate ways: opposite effects of study duration on priming and recognition reveal distinct neural substrates

Amnesic patients have difficulties recognizing when stimuli are repeated, even though their responses to stimuli can change as a function of repetition in indirect tests of memory – a pattern known as priming without recognition. Likewise, experimental manipulations can impair recognition in healthy individuals while leaving priming relatively unaffected, and priming and recognition have been associated with distinct neural correlates in these circumstances. Does this evidence necessarily indicate that priming and recognition rely on distinct brain systems? An alternative explanation is that recognition is merely more sensitive to amnestic insults and experimental manipulations than is priming, and that both priming and recognition are produced by a single brain system. If so, then experimental manipulations would tend to drive priming and recognition in the same direction, albeit to a greater extent for one versus the other in some circumstances. We found evidence to the contrary – that manipulating study duration has opposite effects on priming versus recognition. Studying objects for one-quarter second led to worse recognition than studying objects for 2 s, whereas the opposite was true for priming (greater for one-quarter-second study than two-second study). Furthermore, distinct electrophysiological repetition effects were associated with priming versus recognition. We therefore conclude that study duration had opposite effects on priming and recognition, and on the engagement of implicit versus explicit memory systems. These findings call into question single-process accounts of priming and recognition, and substantiate previous behavioral, neuropsychological, and neuroimaging dissociations between implicit and explicit memory.

Distinct frontoparietal networks set the stage for later perceptual identification priming and episodic recognition memory

Recent imaging evidence suggests that a network of brain regions including the medial temporal lobe, ventrolateral prefrontal cortex, and dorsal posterior parietal cortex supports the successful encoding of long-term memories. Other areas, like the ventral posterior parietal and dorsolateral prefrontal cortices, have been associated with encoding failure rather than success. In line with the transfer-appropriate processing view, we hypothesized that distinct neural networks predict successful encoding depending on whether the later memory test draws primarily on perceptual or conceptual memory representations. Following an encoding phase, memory was assessed in a combined incidental perceptual identification and intentional recognition memory test. We found that during encoding, activation in ventral posterior parietal and dorsolateral prefrontal cortex predicted successful perceptual identification priming, whereas activation in ventrolateral prefrontal and dorsal posterior parietal cortex predicted successful recognition memory. Extending recent theories of attention to memory, the results suggest that ventral parietal regions support stimulus-driven attention to perceptual item features, forming memories accessed by later perceptual memory tests, whereas dorsal parietal regions support attention to meaningful item features, forming memories accessed by later conceptual memory tests.

What makes recognition without awareness appear to be elusive? Strategic factors that influence the accuracy of guesses

Various factors could conceivably promote the accuracy of guesses during a recognition test. Two that we identified in previous studies are forced-choice testing format and high perceptual similarity between the repeat target and novel foil. In restricted circumstances, the relative perceptual fluency of the target can be compared with that of the foil and used as a reliable cue to guide accurate responses that occur without explicit retrieval--a phenomenon we referred to as "implicit recognition." In this issue, Jeneson and colleagues report a failure to replicate accurate guesses and also a tendency on the part of subjects to hazard guesses infrequently, even though testing circumstances were very similar to those that we used. To resolve this discrepancy, we developed a simple manipulation to encourage either guessing or confident responding. Encouraging guessing increased both the prevalence of guesses and the accuracy of guesses in a recognition test, relative to when confident responding was encouraged. When guessing was encouraged, guesses were highly accurate (as in our previous demonstrations of implicit recognition), whereas when confident responding was encouraged, guesses were at chance levels (as in Jeneson and colleagues' data). In light of a substantial literature showing high accuracy despite low confidence in certain circumstances, we infer that both the prevalence and accuracy of guessing can be influenced by whether subjects adopt guessing-friendly strategies. Our findings thus help to further characterize conditions likely to promote implicit recognition based on perceptual fluency.

Some-or-none recollection: Evidence from item and source memory

Dual-process theory hypothesizes that recognition memory depends on 2 distinguishable memory signals. Recollection reflects conscious recovery of detailed information about the learning episode. Familiarity reflects a memory signal that is not accompanied by a vivid conscious experience but nonetheless enables participants to distinguish recently experienced probe items from novel ones. This dual-process explanation of recognition memory has gained wide acceptance among cognitive neuroscientists and some cognitive psychologists. Nonetheless, its difficulty in providing a quantitatively satisfactory description of performance has precluded a consensus not only regarding the theoretical structure of recognition memory but also about how to best measure recognition accuracy. In 2 experiments we show that neither the standard formulation of dual-process signal detection (DPSD) theory nor a widely used single-process model called the unequal-variance signal-detection (UVSD) model provides a satisfactory explanation of recognition memory across different types of stimuli (words and travel scenes). In the variable-recollection dual-process (VRDP) model, recollection fails for some old probe items, as in standard formulations of DPSD, but gives rise to a continuous distribution of memory strengths when it succeeds. The VRDP can approximate both the DPSD and UVSD. In both experiments it provides a consistently superior fit across materials to the superset of the DPSD and UVSD. The VRDP offers a simple explanation of the form of conjoint item-source judgments, something neither the DPSD nor UVSD accomplishes. The success of the VRDP supports the core assumptions of dual-process theory by providing an excellent quantitative description of recognition performance across materials and response criteria.

Real-time neural signals of perceptual priming with unfamiliar geometric shapes

Perceptual priming is a type of item-specific implicit memory that is distinct from explicit memory. Neural signals of the processing responsible for perceptual priming can be difficult to isolate due to concurrent conceptual processing and explicit recognition. We successfully identified neural correlates of perceptual priming by using minimally meaningful, difficult-to-recognize, kaleidoscope images. Human participants were required to quickly indicate the number of colors present in each stimulus, and priming was shown by faster and more accurate visual discriminations for repeated compared with initial presentations. Electroencephalographic responses linked with this differential perceptual fluency were identified as negative potentials 100-300 ms poststimulus onset. Furthermore, different potentials recorded during initial presentations were indicative of perceptual learning, in that their amplitude predicted the magnitude of later priming. These electrophysiological findings show that the degree of perceptual learning engaged upon first encountering a novel visual stimulus predicts the degree of perceptual fluency experienced when the stimulus is processed a second time. It is thus possible to isolate multiple neural processing stages relevant to perceptual priming by using real-time measures of relevant neurophysiological activity in conjunction with experimental circumstances that limit the contaminating influences of other neurocognitive events.

Investigating the Awareness of Remembering

There is a marked lack of consensus concerning the best way to learn how conscious experiences arise. In this article, we advocate for scientific approaches that attempt to bring together four types of phenomena and their corresponding theoretical accounts: behavioral acts, cognitive events, neural events, and subjective experience. We propose that the key challenge is to comprehensively specify the relationships among these four facets of the problem of understanding consciousness without excluding any facet. Although other perspectives on consciousness can also be informative, combining these four perspectives could lead to significant progress in explaining a conscious experience such as remembering. We summarize some relevant findings from cognitive neuroscience investigations of the conscious experience of memory retrieval and of memory behaviors that transpire in the absence of the awareness of remembering. These examples illustrate suitable scientific strategies for making progress in understanding consciousness by developing and testing theories that connect the behavioral expression of recall and recognition, the requisite cognitive transactions, the neural events that make remembering possible, and the awareness of remembering.

An electrophysiological signature of unconscious recognition memory

Contradicting the common assumption that accurate recognition reflects explicit-memory processing, we describe evidence for recognition lacking two hallmark explicit-memory features: awareness of memory retrieval and facilitation by attentive encoding. Kaleidoscope images were encoded in conjunction with an attentional diversion and subsequently recognized more accurately than those encoded without diversion. Confidence in recognition was superior following attentive encoding, though recognition was remarkably accurate when people claimed to be unaware of memory retrieval. This “implicit recognition” was associated with frontal-occipital negative brain potentials at 200-400 ms post-stimulus-onset, which were spatially and temporally distinct from positive brain potentials corresponding to explicit recollection and familiarity. This dissociation between behavioral and electrophysiological characteristics of “implicit recognition” versus explicit recognition indicates that a neurocognitive mechanism with properties similar to those that produce implicit memory can be operative in standard recognition tests. People can accurately discriminate repeat stimuli from new stimuli without necessarily knowing it.

Memory systems do not divide on consciousness: Reinterpreting memory in terms of activation and binding

There is a popular hypothesis that performance on implicit and explicit memory tasks reflects 2 distinct memory systems. Explicit memory is said to store those experiences that can be consciously recollected, and implicit memory is said to store experiences and affect subsequent behavior but to be unavailable to conscious awareness. Although this division based on awareness is a useful taxonomy for memory tasks, the authors review the evidence that the unconscious character of implicit memory does not necessitate that it be treated as a separate system of human memory. They also argue that some implicit and explicit memory tasks share the same memory representations and that the important distinction is whether the task (implicit or explicit) requires the formation of a new association. The authors review and critique dissociations from the behavioral, amnesia, and neuroimaging literatures that have been advanced in support of separate explicit and implicit memory systems by highlighting contradictory evidence and by illustrating how the data can be accounted for using a simple computational memory model that assumes the same memory representation for those disparate tasks.

Brain substrates of implicit and explicit memory: the importance of concurrently acquired neural signals of both memory types

A comprehensive understanding of human memory requires cognitive and neural descriptions of memory processes along with a conception of how memory processing drives behavioral responses and subjective experiences. One serious challenge to this endeavor is that an individual memory process is typically operative within a mix of other contemporaneous memory processes. This challenge is particularly disquieting in the context of implicit memory, which, unlike explicit memory, transpires without the subject necessarily being aware of memory retrieval. Neural correlates of implicit memory and neural correlates of explicit memory are often investigated in different experiments using very different memory tests and procedures. This strategy poses difficulties for elucidating the interactions between the two types of memory process that may result in explicit remembering, and for determining the extent to which certain neural processing events uniquely contribute to only one type of memory. We review recent studies that have succeeded in separately assessing neural correlates of both implicit memory and explicit memory within the same paradigm using event-related brain potentials (ERPs) and functional magnetic resonance imaging (fMRI), with an emphasis on studies from our laboratory. The strategies we describe provide a methodological framework for achieving valid assessments of memory processing, and the findings support an emerging conceptualization of the distinct neurocognitive events responsible for implicit and explicit memory.

Distinct neural mechanisms for repetition effects of visual objects

Repetition of visually common objects was examined in relation to prior intentional learning and memory status using a delayed match-to-sample task in humans. Both response time and two temporally separate event-related potential (ERP) components indexed repetition. The early repetition effect ( approximately 200-550 ms) evoked more ERP responses for repeated visual objects, and was diminished by prior intentional learning (old/new) or being maintained in working memory (targets/distracters). In contrast, the late repetition effect (after approximately 550 ms) evoked reduced ERP activation for repeated items, and was not affected by prior learning or working memory status. Our source localization results indicate that the late and posterior repetition effect in visual cortex is consistent with repetition suppression results reported in monkey physiology and human fMRI studies. Meanwhile, the early and anterior repetition effect, in temporal pole and frontal cortices, is modulated by explicit memory mechanisms.

Modes of memory: early electrophysiological markers of repetition suppression and recognition enhancement predict behavioral performance

Different forms of perceptual memory have opposite physiological effects. Whereas repetition priming often leads to suppression of brain responses, explicit recognition has been found to enhance brain activity. We investigated effects of repetition priming and recognition memory on early gamma-band responses. In a study phase, participants performed a visual discrimination task with task-irrelevant item repetitions. Stimulus repetition suppressed early evoked gamma responses in participants with strong behavioral repetition effects. In a test phase, participants discriminated old from new items. Evoked and induced gamma activity was enhanced for old items. Effects were stronger in participants with better recognition performance. The results demonstrate a modulation of earliest stages of visual information processing by different memory systems, which is dependent on retrieval intention and predicts individual behavioral performance.

Wechsler Memory Scale Revised Edition: neural correlates of the visual paired associates subtest adapted for fMRI

Memory deficits in neurological and psychiatric patients are evaluated by neuropsychological tests such as the Wechsler Memory Scale Revised Edition (WMS-R). Neuropsychological data from patients with circumscribed lesions point to single elements of the underlying neural network but fail to identify its whole extent. We report the fMRI adaptation of a subtest of the WMS-R, the Visual Paired Associates. Fifteen healthy, right-handed male volunteers were studied using a 1.5T MRI scanner. The encoding of the combination between a shape and a colour, the assessment of the retrieval of this combination immediately after encoding took place, and the underlying network employed during retrieval a second time after approximately 25 min were investigated. The results show a fronto-parieto-occipital network with left frontal accentuation for encoding and a fronto-parieto-occipital network for immediate and delayed retrieval. Noteworthy is the specific role of the thalamus. During immediate retrieval, the thalamus showed significant bilateral activation; during delayed retrieval, there was no significant activation. The thalami are part of an extended hippocampal-diencephalic system which is critical for efficient encoding and normal retrieval of new episodic information. We describe the probability of thalamocortical connections during retrieval based on the Thalamus Connectivity Atlas. The cerebellum showed significant activation in all conditions; its part in higher cognitive functions such as memory was thereby confirmed.

Neural correlates of conceptual implicit memory and their contamination of putative neural correlates of explicit memory

During episodic recognition tests, meaningful stimuli such as words can engender both conscious retrieval (explicit memory) and facilitated access to meaning that is distinct from the awareness of remembering (conceptual implicit memory). Neuroimaging investigations of one type of memory are frequently subject to the confounding influence of the other type of memory, thus posing a serious impediment to theoretical advances in this area. We used minimalist visual shapes (squiggles) to attempt to overcome this problem. Subjective ratings of squiggle meaningfulness varied idiosyncratically, and behavioral indications of conceptual implicit memory were evident only for stimuli given higher ratings. These effects did not result from perceptual-based fluency or from explicit remembering. Distinct event-related brain potentials were associated with conceptual implicit memory and with explicit memory by virtue of contrasts based on meaningfulness ratings and memory judgments, respectively. Frontal potentials from 300 to 500 msec after the onset of repeated squiggles varied systematically with perceived meaningfulness. Explicit memory was held constant in this contrast, so these potentials were taken as neural correlates of conceptual implicit memory. Such potentials can contaminate putative neural correlates of explicit memory, in that they are frequently attributed to the expression of explicit memory known as familiarity. These findings provide the first neural dissociation of these two memory phenomena during recognition testing and underscore the necessity of taking both types of memory into account in order to obtain valid neural correlates of specific memory functions.

Neural systems for recognition of familiar faces

Immediate access to information about people that we encounter is an essential requirement for effective social interactions. In this manuscript we briefly review our work and work of others on familiar face recognition and propose a modified version of our model of neural systems for face perception with a special emphasis on processes associated with recognition of familiar faces. We argue that visual appearance is only one component of successful recognition of familiar individuals. Other fundamental aspects include the retrieval of "person knowledge" - the representation of the personal traits, intentions, and outlook of someone we know - and the emotional response we experience when seeing a familiar individual. Specifically, we hypothesize that the "theory of mind" areas, that have been implicated in social and cognitive functions other than face perception, play an essential role in the spontaneous activation of person knowledge associated with the recognition of familiar individuals. The amygdala and the insula, structures that are involved in the representation of emotion, also are part of the distributed network of areas that are modulated by familiarity, reflecting the role of emotion in face recognition.

Do I know you? Insights into memory for faces from brain potentials

The recognition of faces is central to human social interaction. Recordings of event-related potentials (ERPs) from the brain can shed light on the various processes that occur when a face is recognized and when knowledge related to a specific person is retrieved. ERP contrasts between processing familiar and processing novel faces offer a gateway into investigations of semantic memory for familiar persons. In particular, activity of face recognition units and semantic information units--memory representations of faces and person-related knowledge, respectively--can be indexed by specific ERPs. These potentials thus provide valuable tools for studying the cognitive and neurobiological architecture of person recognition. ERPs have also been found useful for investigating other types of memory for faces. Specifically, important insights have been derived from the study of a category of memory phenomena known as priming. Priming can be revealed in special tests when face recognition is facilitated based on prior experience. Describing the neural processes associated with memory for faces is an exciting focus of research, and future results from this line of inquiry promise to provide further knowledge about face recognition and the various types of memory that can be provoked by a human face.

Frontoparietal network involved in successful retrieval from episodic memory. Spatial and temporal analyses using fMRI and ERP

The neural basis for successful recognition of previously studied items, referred to as "retrieval success," has been investigated using either neuroimaging or brain potentials; however, few studies have used both modalities. Our study combined event-related functional magnetic resonance imaging (fMRI) and event-related potential (ERP) in separate groups of subjects. The neural responses were measured while the subjects performed an old/new recognition task with pictures that had been previously studied in either a deep- or shallow-encoding condition. The fMRI experiment showed that among the frontoparietal regions involved in retrieval success, the inferior frontal gyrus and intraparietal sulcus were crucial to conscious recollection because the activity of these regions was influenced by the depth of memory at encoding. The activity of the right parietal region in response to a repeated item was modulated by the repetition lag, indicating that this area would be critical to familiarity-based judgment. The results of structural equation modeling revealed that the functional connectivity among the regions in the left hemisphere was more significant than that in the right hemisphere. The results of the ERP experiment and independent component analysis paralleled those of the fMRI experiment and demonstrated that the repeated item produced an earlier peak than the hit item by approximately 50 ms.

Linking Implicit and Explicit Memory: Common Encoding Factors and Shared Representations

Dissociations between implicit and explicit memory have featured prominently in theories of human memory. However, similarities between the two forms of memory have been less studied. One open question concerns whether implicit and explicit memory share encoding resources. To explore this question, we employed a subsequent memory design in which several novel scenes were repeated once during an fMRI session and explicit memory for the scenes was unexpectedly tested afterward. Subsequently remembered scenes produced more behavioral priming and neural attenuation-two conventional measures of implicit memory-than did subsequently forgotten scenes. Moreover, brain-behavior correlations between these two implicit measures were mediated by subsequent memory. Finally, tonic activity, possibly reflecting the natural time course of attention, was predictive of subsequent memory. These results suggest that implicit and explicit memory are subject to the same encoding factors and can rely on similar perceptual processes and representations.

Dissociation of face-selective cortical responses by attention

We studied attentional modulation of cortical processing of faces and houses with functional MRI and magnetoencephalography (MEG). MEG detected an early, transient face-selective response. Directing attention to houses in "double-exposure" pictures of superimposed faces and houses strongly suppressed the characteristic, face-selective functional MRI response in the fusiform gyrus. By contrast, attention had no effect on the M170, the early, face-selective response detected with MEG. Late (>190 ms) category-related MEG responses elicited by faces and houses, however, were strongly modulated by attention. These results indicate that hemodynamic and electrophysiological measures of face-selective cortical processing complement each other. The hemodynamic signals reflect primarily late responses that can be modulated by feedback connections. By contrast, the early, face-specific M170 that was not modulated by attention likely reflects a rapid, feed-forward phase of face-selective processing.

Neural correlates of perceptual contributions to nondeclarative memory for faces

Face priming is a nondeclarative memory phenomenon that can be observed when recognition is facilitated for a recently encountered face. This data-driven form of priming is distinct from conceptually driven priming. Moreover, it includes two dissociable components, the facilitated access to pre-existing representations and facilitation in perceptual processing of faces. In the present study, we measured neural correlates of perceptual contributions to face priming with event-related brain potentials. Faces appeared two times (separated by 7-17 s), while participants discriminated familiar from unfamiliar faces. Half of the initial face stimuli were inverted, thereby disrupting perceptual face processing and making possible an assessment of perceptual contributions to face priming. Whereas none of the brain waves previously linked to perceptual processing of faces showed indications of priming, such effects were observed between 200 and 600 ms at left occipito-parieto-temporal recording sites. This electrical activity was present for both unfamiliar and familiar faces. The scalp topography of this effect was consistent with sources within the temporal and occipital cortices of the left hemisphere (based on a LORETA source localization). These findings suggest that priming of perceptual face processing is subserved by prolonged neural activity from 200 to 600 ms primarily in the left hemisphere. We propose that this priming reflects facilitated selection based on second-order relations among facial features.

Retrieval attempts transiently interfere with concurrent encoding of episodic memories but not vice versa

In the rodent hippocampus, different phases of each theta activity cycle may be devoted to encoding and retrieval processes. These cycles of approximately 3-8 Hz would allow equal processing time for each state and also provide temporal segregation to minimize their mutual interference. We show here that, by controlling the presentation asynchrony between verbal encoding and retrieval cues, theta-resolution (<100 ms) interference-free shifts between functional states are not expressed in hippocampally dependent, human "episodic" memory. Instead, retrieval attempts selectively and transiently interfere, for approximately 450 ms, with the encoding of ongoing experiences. Analyses of scalp event-related potentials confirmed that the functional state of the brain during retrieval is largely unperturbed by concurrent encoding and also suggested that encoding impairments may last until a neocortical phase of retrieval can begin. The findings reveal the dynamic properties of interdependent encoding and retrieval functions that contribute to episodic memory in vivo and, moreover, show that, in humans, this form of memory does not operate with either the equality, or the rapidity, intrinsic to the theta model of rodent hippocampal function.

Feature binding in perceptual priming and in episodic object recognition: evidence from event-related brain potentials

It is argued that explicit remembering is based on so-called episodic tokens binding together all perceptual features of a visual object. In episodic recognition, these features are collectively reactivated. In support of this view, it has been shown that changing sensory features of a stimulus from study to test decreases subject's performance in an episodic recognition task, even though the changed features are irrelevant for the recognition judgment. On the other hand, repetition priming is unaffected by such manipulations of perceptual specificity. Implicit memory performance is therefore thought to depend on structural representations, so-called types, comprising only invariant perceptual features, but no exemplar-specific details. Event-related potentials (ERPs) in our study revealed electrophysiological evidence for the differential involvement of these perceptual memory traces in explicit and implicit memory tasks. Participants attended either a living-nonliving task or an episodic recognition task with visually presented objects. During test both groups of participants processed new objects and old objects, which were repeated either identically or in a mirror-reversed version. In the implicit task ERPs showed an occipitoparietal repetition effect, which was the same for identically repeated items and mirror reversals. In contrast, in the explicit task an early mid-frontal old/new effect for identical but not for mirror-reversed old objects was observed indicating involuntary access to perceptual information during episodic retrieval. A later portion of the old/new effect solely differentiated both types of old items from new ones.

Neural correlates of intentional and incidental recognition of famous faces

Event-related potentials (ERPs) were used to study the relationship between intentional and incidental recognition of famous faces. Intentional and incidental recognition were operationally defined as repeated presentations of targets and nontargets within a modified Sternberg task. These repetitions elicited temporally and topographically distinct ERP modulations. A repetition effect around 300 ms (ERE/N250r) and a preceding modulation did not differ between intentional and incidental recognition, whereas a following repetition effect (LRE/N400) around 500 ms showed differences between incidental and intentional recognition. These results show that during the first few hundred milliseconds intentional and incidental face recognition relate to similar processing, indicating that familiar faces are recognized even when their identification is not required.

Event-Related Potential Correlates of Long-Term Memory for Briefly Presented Faces

Electrophysiological studies have investigated the nature of face recognition in a variety of paradigms; some have contrasted famous and novel faces in explicit memory paradigms, others have repeated faces to examine implicit memory/ priming. If the general finding that implicit memory can last for up to several months also holds for novel faces, a reliable measure of it could have practical application for eyewitness testimony, given that explicit measures of eyewitness memory have at times proven fallible. The current study aimed to determine whether indirect behavioral and electrophysiological measures might yield reliable estimates of face memory over longer intervals than have typically been obtained with priming manipulations. Participants were shown 192 faces and then tested for recognition at four test delays ranging from immediately up to 1 week later. Three event-related brain potential components (e.g., N250r, N400f, and LPC) varied with memory measures although only the N250r varied regardless of explicit recognition, that is, with both repetition and recognition.

Correlates of implicit memory for words and faces in event-related brain potentials

Prior research has suggested an ERP correlate of implicit memory for words consisting of a centro-parietal positivity around 400 ms. We attempted (1) to replicate this ERP modulation in a different task, involving only trials with correct responses, and (2) to compare the findings to the domain of faces. Two experiments were conducted with a modified Sternberg task, in which both targets and nontargets were presented repeatedly. In Experiment 1, positive ERP differences between repeated and new nontargets were observed, which were domain-specific in topography and, for words, replicated the previously reported findings. In Experiment 2, the amplitude of the modulation for words, but not for faces, was unaffected by a variation of the level of processing during encoding, supporting the implicitness of the processes underlying the ERP modulation to nontarget words.