Using state-trace analysis to dissociate the functions of the human hippocampus and perirhinal cortex in recognition memory

Recognition memory: The probe, the returned signal, and the decision

In an attempt to better understand recognition memory we look at how three approaches (dual processing, signal detection, and global matching) have addressed the probe, the returned signal and the decision in four recognition paradigms. These are single-item recognition (including the remember/know paradigm), recognition in relational context, associative recognition, and source monitoring. The contrast, with regards to the double-miss rate (the probability of recognizing neither item in intact and rearranged pairs) and the effect of the oldness of the other member of the test pair, between identifying the old words in test pairs (the relational context paradigm) and first identifying the intact test pairs and then identifying the old words (adding associative recognition to the relational context paradigm) suggests that the retrieval of associative information in the relational context paradigm is unintentional, unlike the retrieval of associative information in associative recognition. It also seems possible that the information that is spontaneously retrieved in single-item recognition, possibly including the remember/know paradigm, is also unintentional, unlike the retrieval of information in source monitoring. Probable differences between intentional and unintentional retrieval, together with the pattern of effects with regards to the double-miss rate and the effect of the other member of the test pair, are used to evaluate the three approaches. Our conclusion is that all three approaches have something valid to say about recognition, but none is equally applicable across all four paradigms.

Chinese character unitization enhances recollection-based associative recognition: Evidence from fMRI

Previous research has suggested that familiarity can enhance associative memory after unitization, but the cognitive mechanisms underlying unitization remain debated. To explore the neural mechanisms of associative memory after unitization in the absence of semantic relations, we used Chinese characters as stimuli and recorded participants' blood oxygen level-dependent signals during recognition. Behavioral results showed that after Chinese character unitization, not only the associative performance of recognition (Pr, hit rate minus false alarm rate) and general Pr but also the hit rate and correct rejection rate increased. Neuroimaging results revealed activation of the hippocampus and parahippocampal gyrus during associative recognition in both the unitized and the non-unitized condition, and hippocampal activation increased after unitization. However, activation of the perirhinal cortex was not observed in either condition. These findings, in contrast to those from previous studies on unitization, suggest that Chinese character unitization enhances recollection-based, rather than familiarity-based, associative recognition. This suggests that the encoding of semantic relations during unitization is critical for subsequent familiarity-based associative recognition.

Functional Specialization of the Medial Temporal Lobes in Human Recognition Memory: Dissociating Effects of Hippocampal versus Parahippocampal Damage

A central debate in the systems neuroscience of memory concerns whether different medial temporal lobe (MTL) structures support different processes in recognition memory. Using two recognition memory paradigms, we tested a rare patient (MH) with a perirhinal lesion that appeared to spare the hippocampus. Consistent with a similar previous case, MH showed impaired familiarity and preserved recollection. When compared with patients with hippocampal lesions appearing to spare perirhinal cortex, MH showed greater impairment on familiarity and less on recollection. Nevertheless, the hippocampal patients also showed impaired familiarity compared with healthy controls. However, when replacing this traditional categorization of patients with analyses relating memory performance to continuous measures of damage across patients, hippocampal volume uniquely predicted recollection, whereas parahippocampal, rather than perirhinal, volume uniquely predicted familiarity. We consider whether the familiarity impairment in MH and our patients with hippocampal lesions arises from "subthreshold" damage to parahippocampal cortex (PHC). Our data provide the most compelling neuropsychological support yet for dual-process models of recognition memory, whereby recollection and familiarity depend on different MTL structures, and may support a role for PHC in familiarity. Our study highlights the value of supplementing single-case studies with examinations of continuous brain-behavior relationships across larger patient groups.

Longitudinal Differences in Human Hippocampal Connectivity During Episodic Memory Processing

The question of longitudinal hippocampal functional specialization is critical to human episodic memory because an accurate understanding of this phenomenon would impact theories of mnemonic function and entail practical consequences for the clinical management of patients undergoing temporal lobe surgery. The implementation of the robotically assisted stereo electroencephalography technique for seizure mapping has provided our group with the opportunity to obtain recordings simultaneously from the anterior and posterior human hippocampus, allowing us to create an unparalleled data set of human subjects with simultaneous anterior and posterior hippocampal recordings along with several cortical regions. Using these data, we address several key questions governing functional hippocampal connectivity in human memory. First, we ask whether functional networks during episodic memory encoding and retrieval are significantly different for the anterior versus posterior hippocampus (PH). We also examine how connections differ across the 2-5 Hz versus 4-9 Hz theta frequency ranges, directly addressing the relative contribution of each of these separate bands in hippocampal-cortical interactions. While we report some overlapping connections, we observe evidence of distinct anterior versus posterior hippocampal networks during memory encoding related to frontal and parietal connectivity as well as hemispheric differences in aggregate connectivity. We frame these findings in light of the proposed AT/PM memory systems. We also observe distinct encoding versus retrieval connectivity patterns between anterior and posterior hippocampal networks, we find that overall connectivity is greater for the PH in the right hemisphere, and further that these networks significantly differ in terms of frontal and parietal connectivity. We place these findings in the context of existing theoretical treatments of human memory systems, especially the proposed AT/PM system. During memory retrieval, we observe significant differences between slow-theta (2-5 Hz) and fast-theta (4-9 Hz) connectivity between the cortex and hippocampus. Finally, we test how these distinct theta frequency oscillations propagate within the hippocampus, using phase slope index to estimate the direction slow-theta and fast-theta oscillations travel during encoding and retrieval. We uncover evidence that 2-5 Hz oscillations travel in the posterior-to-anterior direction, while 5-9 Hz oscillations travel from anterior-to-posterior. Taken together, our findings describe mnemonically relevant functional connectivity differences along the longitudinal axis of the human hippocampus that will inform interpretation of models of hippocampal function that seek to integrate rodent and human data.

Familiarity impairments after anterior temporal-lobe resection with hippocampal sparing: Lessons learned from case NB

We review evidence from an extensive single case study in an individual (NB) who underwent a rare left-sided anterior temporal-lobe resection with sparing of the hippocampus. Our study aimed to determine whether memory functions of perirhinal cortex, which was largely removed in the resection, can be impaired against a background of preserved hippocampus-dependent memory processing. This research was guided by the proposal that item-based familiarity assessment relies on contributions of perirhinal cortex, and that the hippocampus plays a unique role in the relational binding of items to episodic contexts, which is critical for recollection. Seven sets of findings have emerged from our research on NB (synthesized from five primary research articles), and from follow-up work in other patients: (i) Familiarity impairments can be selective and be revealed with multiple methods; (ii) selective familiarity and selective recollection impairments can be double dissociated; (iii) selective familiarity impairments show material specificity; (iv) selective familiarity impairments extend to assessment of cumulative lifetime experience; (v) selective familiarity impairments are sensitive to degree of feature overlap between object concepts; (vi) selective familiarity impairments are associated with preserved task-related fMRI signals in the hippocampus; (vii) selective familiarity impairments can be observed in other lesion cases. Despite our main focus on the dual-process framework, we also discuss implications for the functional organization of the medial temporal lobes in broader terms. We argue that our findings shed light on this organization even if the functional specialization of different medial temporal structures is ultimately not fully captured with reference to the cognitive distinction between familiarity and recollection.

Modulation of Item and Source Memory by Auditory Beat Stimulation: A Pilot Study With Intracranial EEG

Auditory beat stimulation is an upcoming technique for non-invasive brain stimulation. Its influence on mediotemporal regions and memory processes has not yet been thoroughly investigated. A recent study suggests that auditory beats are able to alter intracranial EEG (iEEG) power and phase synchronization. 5 Hz binaural beat stimulation increased temporo-lateral phase synchronization, while 5 Hz monaural beat stimulation decreased mediotemporal synchronization. Based on the relevance of phase synchronization for memory operations, we hypothesized that 5 Hz binaural beat stimulation enhances, while 5 Hz monaural beat stimulation decreases long-term memory performance. We analyzed data from presurgical epilepsy patients with implanted depth electrodes in the hippocampus and rhinal cortex. 5 Hz monaural and binaural beat vs. control stimulation was applied while patients performed an associative learning task involving item and source recognition. We evaluated behavioral effects for item (hits minus false alarms) and source memory (correct minus incorrect) and the impact of auditory beats on iEEG power, rhinal-hippocampal phase synchronization and inter-trial phase locking. A three-way repeated measures ANOVA (encoding/retrieval, item/source, monaural/binaural/control) revealed a main effect of stimulation (p = 0.03) and a linear effect in the expected direction: binaural > control > monaural (p = 0.036). Both monaural and binaural stimulation were associated with increased phase locking of 5 Hz oscillations within rhinal cortex. These phase locking increases, however, corresponded to reverse phase shifts. Our data suggest that binaural vs. monaural 5 Hz stimulation increases vs. decreases long-term memory performance. These behavioral effects appear to be related to reverse phase shifts within rhinal cortex.

Human Episodic Memory Retrieval Is Accompanied by a Neural Contiguity Effect

Cognitive psychologists have long hypothesized that experiences are encoded in a temporal context that changes gradually over time. When an episodic memory is retrieved, the state of context is recovered-a jump back in time. We recorded from single units in the medial temporal lobe of epilepsy patients performing an item recognition task. The population vector changed gradually over minutes during presentation of the list. When a probe from the list was remembered with high confidence, the population vector reinstated the temporal context of the original presentation of that probe during study, a neural contiguity effect that provides a possible mechanism for behavioral contiguity effects. This pattern was only observed for well remembered probes; old probes that were not well remembered showed an anti-contiguity effect. These results constitute the first direct evidence that recovery of an episodic memory in humans is associated with retrieval of a gradually changing state of temporal context, a neural "jump back in time" that parallels the act of remembering.SIGNIFICANCE STATEMENT Episodic memory is the ability to relive a specific experience from one's life. For decades, researchers have hypothesized that, unlike other forms of memory that can be described as simple associations between stimuli, episodic memory depends on the recovery of a neural representation of spatiotemporal context. During study of a sequence of stimuli, the brain state of epilepsy patients changed slowly over at least a minute. When the participant remembered a particular event from the list, this gradually changing state was recovered. This provides direct confirmation of the prediction from computational models of episodic memory. The resolution of this point means that the study of episodic memory can focus on the mechanisms by which this representation of spatiotemporal context is maintained and sometimes recovered.

Neural Oscillations and a Nascent Corticohippocampal Theory of Reference

The ability to use words to refer to the world is vital to the communicative power of human language. In particular, the anaphoric use of words to refer to previously mentioned concepts (antecedents) allows dialogue to be coherent and meaningful. Psycholinguistic theory posits that anaphor comprehension involves reactivating a memory representation of the antecedent. Whereas this implies the involvement of recognition memory or the mnemonic subroutines by which people distinguish old from new, the neural processes for reference resolution are largely unknown. Here, we report time–frequency analysis of four EEG experiments to reveal the increased coupling of functional neural systems associated with referentially coherent expressions compared with referentially problematic expressions. Despite varying in modality, language, and type of referential expression, all experiments showed larger gamma-band power for referentially coherent expressions compared with referentially problematic expressions. Beamformer analysis in high-density Experiment 4 localized the gamma-band increase to posterior parietal cortex around 400–600 msec after anaphor onset and to frontotemporal cortex around 500–1000 msec. We argue that the observed gamma-band power increases reflect successful referential binding and resolution, which links incoming information to antecedents through an interaction between the brain's recognition memory networks and frontotemporal language network. We integrate these findings with previous results from patient and neuroimaging studies, and we outline a nascent corticohippocampal theory of reference.

The Electrophysiological Signature of Remember-Know Is Confounded with Memory Strength and Cannot Be Interpreted as Evidence for Dual-process Theory of Recognition

The quantity and nature of the processes underlying recognition memory remains an open question. A majority of behavioral, neuropsychological, and brain studies have suggested that recognition memory is supported by two dissociable processes: recollection and familiarity. It has been conversely argued, however, that recollection and familiarity map onto a single continuum of mnemonic strength and hence that recognition memory is mediated by a single process. Previous electrophysiological studies found marked dissociations between recollection and familiarity, which have been widely held as corroborating the dual-process account. However, it remains unknown whether a strength interpretation can likewise apply for these findings. Here we describe an ERP study, using a modified remember-know (RK) procedure, which allowed us to control for mnemonic strength. We find that ERPs of high and low mnemonic strength mimicked the electrophysiological distinction between R and K responses, in a lateral positive component (LPC), 500-1000 msec poststimulus onset. Critically, when contrasting strength with RK experience, by comparing weak R to strong K responses, the electrophysiological signal mapped onto strength, not onto subjective RK experience. Invoking the LPC as support for dual-process accounts may, therefore, be amiss.

Comparing single- and dual-process models of memory development

This experiment examined single-process and dual-process accounts of the development of visual recognition memory. The participants, 6-7-year-olds, 9-10-year-olds and adults, were presented with a list of pictures which they encoded under shallow or deep conditions. They then made recognition and confidence judgments about a list containing old and new items. We replicated the main trends reported by Ghetti and Angelini () in that recognition hit rates increased from 6 to 9 years of age, with larger age changes following deep than shallow encoding. Formal versions of the dual-process high threshold signal detection model and several single-process models (equal variance signal detection, unequal variance signal detection, mixture signal detection) were fit to the developmental data. The unequal variance and mixture signal detection models gave a better account of the data than either of the other models. A state-trace analysis found evidence for only one underlying memory process across the age range tested. These results suggest that single-process memory models based on memory strength are a viable alternative to dual-process models for explaining memory development.

Hippocampal pattern completion is linked to gamma power increases and alpha power decreases during recollection

How do we retrieve vivid memories upon encountering a simple cue? Computational models suggest that this feat is accomplished by pattern completion processes involving the hippocampus. However, empirical evidence for hippocampal pattern completion and its underlying mechanisms has remained elusive. Here, we recorded direct intracranial EEG as human participants performed an associative memory task. For each study (encoding) and test (retrieval) event, we derived time-frequency resolved representational patterns in the hippocampus and compared the extent of pattern reinstatement for different mnemonic outcomes. Results show that successful associative recognition (AR) yields enhanced event-specific reinstatement of encoding patterns compared to non-associative item recognition (IR). Moreover, we found that gamma power (50–90 Hz) increases – in conjunction with alpha power (8–12 Hz) decreases not only distinguish AR from IR, but also correlate with the level of hippocampal reinstatement. These results link single-shot hippocampal pattern completion to episodic recollection and reveal how oscillatory dynamics in the gamma and alpha bands orchestrate these mnemonic processes.

DOI:http://dx.doi.org/10.7554/eLife.17397.001

Advances in the behavioural testing and network imaging of rodent recognition memory

Research into object recognition memory has been galvanised by the introduction of spontaneous preference tests for rodents. The standard task, however, contains a number of inherent shortcomings that reduce its power. Particular issues include the problem that individual trials are time consuming, so limiting the total number of trials in any condition. In addition, the spontaneous nature of the behaviour and the variability between test objects add unwanted noise. To combat these issues, the 'bow-tie maze' was introduced. Although still based on the spontaneous preference of novel over familiar stimuli, the ability to give multiple trials within a session without handling the rodents, as well as using the same objects as both novel and familiar samples on different trials, overcomes key limitations in the standard task. Giving multiple trials within a single session also creates new opportunities for functional imaging of object recognition memory. A series of studies are described that examine the expression of the immediate-early gene, c-fos. Object recognition memory is associated with increases in perirhinal cortex and area Te2 c-fos activity. When rats explore novel objects the pathway from the perirhinal cortex to lateral entorhinal cortex, and then to the dentate gyrus and CA3, is engaged. In contrast, when familiar objects are explored the pathway from the perirhinal cortex to lateral entorhinal cortex, and then to CA1, takes precedence. The switch to the perforant pathway (novel stimuli) from the temporoammonic pathway (familiar stimuli) may assist the enhanced associative learning promoted by novel stimuli.

Brain imaging, forward inference, and theories of reasoning

This review focuses on the issue of how neuroimaging studies address theoretical accounts of reasoning, through the lens of the method of forward inference (Henson, 2005, 2006). After theories of deductive and inductive reasoning are briefly presented, the method of forward inference for distinguishing between psychological theories based on brain imaging evidence is critically reviewed. Brain imaging studies of reasoning, comparing deductive and inductive arguments, comparing meaningful versus non-meaningful material, investigating hemispheric localization, and comparing conditional and relational arguments, are assessed in light of the method of forward inference. Finally, conclusions are drawn with regard to future research opportunities.

Neurocomputational account of memory and perception: Thresholded and graded signals in the hippocampus

Recent evidence suggests that the hippocampus, a region critical for long-term memory, also supports certain forms of high-level visual perception. A seemingly paradoxical finding is that, unlike the thresholded hippocampal signals associated with memory, the hippocampus produces graded, strength-based signals in perception. This article tests a neurocomputational model of the hippocampus, based on the complementary learning systems framework, to determine if the same model can account for both memory and perception, and whether it produces the appropriate thresholded and strength-based signals in these two types of tasks. The simulations showed that the hippocampus, and most prominently the CA1 subfield, produced graded signals when required to discriminate between highly similar stimuli in a perception task, but generated thresholded patterns of activity in recognition memory. A threshold was observed in recognition memory because pattern completion occurred for only some trials and completely failed to occur for others; conversely, in perception, pattern completion always occurred because of the high degree of item similarity. These results offer a neurocomputational account of the distinct hippocampal signals associated with perception and memory, and are broadly consistent with proposals that CA1 functions as a comparator of expected versus perceived events. We conclude that the hippocampal computations required for high-level perceptual discrimination are congruous with current neurocomputational models that account for recognition memory, and fit neatly into a broader description of the role of the hippocampus for the processing of complex relational information.

Intracranial recordings and human memory

Recent work involving intracranial recording during human memory performance provides superb spatiotemporal resolution on mnemonic processes. These data demonstrate that the cortical regions identified in neuroimaging studies of memory fall into temporally distinct networks and the hippocampal theta activity reported in animal memory literature also plays a central role in human memory. Memory is linked to activity at multiple interacting frequencies, ranging from 1 to 500Hz. High-frequency responses and coupling between different frequencies suggest that frontal cortex activity is critical to human memory processes, as well as a potential key role for the thalamus in neocortical oscillations. Future research will inform unresolved questions in the neuroscience of human memory and guide creation of stimulation protocols to facilitate function in the damaged brain.

A novel approach to an old problem: analysis of systematic errors in two models of recognition memory

For more than a decade, the high threshold dual process (HTDP) model has served as a guide for studying the functional neuroanatomy of recognition memory. The HTDP model's utility has been that it provides quantitative estimates of recollection and familiarity, two processes thought to support recognition ability. Important support for the model has been the observation that it fits experimental data well. The continuous dual process (CDP) model also fits experimental data well. However, this model does not provide quantitative estimates of recollection and familiarity, making it less immediately useful for illuminating the functional neuroanatomy of recognition memory. These two models are incompatible and cannot both be correct, and an alternative method of model comparison is needed. We tested for systematic errors in each model's ability to fit recognition memory data from four independent data sets from three different laboratories. Across participants and across data sets, the HTDP model (but not the CDP model) exhibited systematic error. In addition, the pattern of errors exhibited by the HTDP model was predicted by the CDP model. We conclude that the CDP model provides a better account of recognition memory than the HTDP model.

The hippocampus, time, and memory across scales

A wealth of experimental studies with animals have offered insights about how neural networks within the hippocampus support the temporal organization of memories. These studies have revealed the existence of "time cells" that encode moments in time, much as the well-known "place cells" map locations in space. Another line of work inspired by human behavioral studies suggests that episodic memories are mediated by a state of temporal context that changes gradually over long time scales, up to at least a few thousand seconds. In this view, the "mental time travel" hypothesized to support the experience of episodic memory corresponds to a "jump back in time" in which a previous state of temporal context is recovered. We suggest that these 2 sets of findings could be different facets of a representation of temporal history that maintains a record at the last few thousand seconds of experience. The ability to represent long time scales comes at the cost of discarding precise information about when a stimulus was experienced--this uncertainty becomes greater for events further in the past. We review recent computational work that describes a mechanism that could construct such a scale-invariant representation. Taken as a whole, this suggests the hippocampus plays its role in multiple aspects of cognition by representing events embedded in a general spatiotemporal context. The representation of internal time can be useful across nonhippocampal memory systems.