Is what goes in what comes out? Encoding and retrieval event-related potentials together determine memory outcome

Observing memory encoding while it unfolds: Functional interpretation and current debates regarding ERP subsequent memory effects

Our ability to remember the past depends on neural processes set in train in the moment an event is experienced. These processes can be studied by segregating brain activity according to whether an event is later remembered or forgotten. The present review integrates a large number of studies examining this differential brain activity, labeled subsequent memory effect (SME), with the ERP technique, into a functional organization and discusses routes for further research. Based on the reviewed literature, we suggest that memory encoding is implemented by multiple processes, typically reflected in three functionally different subcomponents of the ERP SME elicited by study stimuli, which presumably interact with preparatory SME activity preceding the to be encoded event. We argue that ERPs are a valuable method in the SME paradigm because they have a sufficiently high temporal resolution to disclose the subcomponents of encoding-related brain activity. Implications of the proposed functional organization for future studies using the SME procedure in basic and applied settings will be discussed.

Individual differences in behavioral and electrophysiological signatures of familiarity- and recollection-based recognition memory

Our everyday memories can vary in terms of accuracy and phenomenology. According to one theoretical account, these differences hinge on whether the memories contain information about both an item itself as well as associated details (remember) versus those that are devoid of these associated contextual details (familiar). This distinction has been supported by computational modeling of behavior, studies in patients, and neuroimaging work including differences both in electrophysiological and functional magnetic resonance imaging. At present, however, little evidence has emerged to suggest that neurophysiological measures track individual differences in estimates of recollection and familiarity. Here, we conducted electrophysiological recordings of brain activity during a recognition memory task designed to differentiate between behavioral indices of recollection and familiarity. Non-parametric cluster-based permutation analyses revealed associations between electrophysiological signatures of familiarity and recollection with their respective behavioral estimates. These results support the idea that recollection and familiarity are distinct phenomena and is the first, to our knowledge, to identify distinct electrophysiological signatures that track individual differences in these processes.

Predicting memory from study-related brain activity

For both basic and applied reasons, an important goal is to identify brain activity present while people study materials that enable us to predict whether they will remember those materials. We show that this is possible with the conventional event-related potential “subsequent-memory-effect” signals as well as with machine learning classifiers, but only to a small degree. This is in line with behavioral research, which supports many determinants of memory apart from the cognitive processes during study.

Across time and space: spatial-temporal binding under stress

Successful episodic memory requires binding of event details across spatial and temporal gaps. The neural processes underlying mnemonic binding, however, are not fully understood. Moreover, although acute stress is known to modulate memory, if and how stress changes mnemonic integration across time and space is unknown. To elucidate these issues, we exposed participants to a stressor or a control manipulation shortly before they completed, while electroencephalography was recorded, an encoding task that systematically varied the demands for spatial and temporal integration. Associative memory was tested 24 h later. While early event-related potentials, including the P300 and Late Positive Component, distinguished different levels of spatiotemporal discontinuity, only later Slow Waves were linked to subsequent remembering. Furthermore, theta oscillations were specifically associated with successful mnemonic binding. Although acute stress per se left mnemonic integration largely unaffected, autonomic activity facilitated object memory and glucocorticoids enhanced detail memory, indicative for mnemonic integration. At the neural level, stress amplified the effects of spatiotemporal discontinuity on early information processing. Together, our results indicate that temporal and spatial gaps recruit early neural processes, providing attentional resources. The actual binding success, however, appears to depend on later processes as well as theta power and may be shaped by major stress response systems.

Rhythmic Activity and Individual Variability in Recognition Memory: Theta Oscillations Correlate with Performance whereas Alpha Oscillations Correlate with ERPs

During study trials of a recognition memory task, alpha (∼10 Hz) oscillations decrease, and concurrently, theta (4–8 Hz) oscillations increase when later memory is successful versus unsuccessful (subsequent memory effect). Likewise, at test, reduced alpha and increased theta activity are associated with successful memory (retrieval success effect). Here we take an individual-differences approach to test three hypotheses about theta and alpha oscillations in verbal, old/new recognition, measuring the difference in oscillations between hit trials and miss trials. First, we test the hypothesis that theta and alpha oscillations have a moderately mutually exclusive relationship; but no support for this hypothesis was found. Second, we test the hypothesis that theta oscillations explain not only memory effects within participants, but also individual differences. Supporting this prediction, durations of theta (but not alpha) oscillations at study and at test correlated significantly with d′ across participants. Third, we test the hypothesis that theta and alpha oscillations reflect familiarity and recollection processes by comparing oscillation measures to ERPs that are implicated in familiarity and recollection. The alpha-oscillation effects correlated with some ERP measures, but inversely, suggesting that the actions of alpha oscillations on memory processes are distinct from the roles of familiarity- and recollection-linked ERP signals. The theta-oscillation measures, despite differentiating hits from misses, did not correlate with any ERP measure; thus, theta oscillations may reflect elaborative processes not tapped by recollection-related ERPs. Our findings are consistent with alpha oscillations reflecting visual inattention, which can modulate memory, and with theta oscillations supporting recognition memory in ways that complement the most commonly studied ERPs.

ERPs Differentially Reflect Automatic and Deliberate Processing of the Functional Manipulability of Objects

It is known that the functional properties of an object can interact with perceptual, cognitive, and motor processes. Previously we have found that a between-subjects manipulation of judgment instructions resulted in different manipulability-related memory biases in an incidental memory test. To better understand this effect we recorded electroencephalography (EEG) while participants made judgments about images of objects that were either high or low in functional manipulability (e.g., hammer vs. ladder). Using a between-subjects design, participants judged whether they had seen the object recently (Personal Experience), or could manipulate the object using their hand (Functionality). We focused on the P300 and slow-wave event-related potentials (ERPs) as reflections of attentional allocation. In both groups, we observed higher P300 and slow wave amplitudes for high-manipulability objects at electrodes Pz and C3. As P300 is thought to reflect bottom-up attentional processes, this may suggest that the processing of high-manipulability objects recruited more attentional resources. Additionally, the P300 effect was greater in the Functionality group. A more complex pattern was observed at electrode C3 during slow wave: processing the high-manipulability objects in the Functionality instruction evoked a more positive slow wave than in the other three conditions, likely related to motor simulation processes. These data provide neural evidence that effects of manipulability on stimulus processing are further mediated by automatic vs. deliberate motor-related processing.

Hearing subject's own name induces the late positive component of event-related potential and beta power suppression

The neuronal response to hearing a subject's own name (SON) has been often investigated using event-related potential (ERP) or time-frequency analysis, but seldom by a combination of these methods. Using this combination of approaches would allow the relationship between memory processes engaged by SON and the neuronal responses to be studied in more detail. Thus, the present study used both ERP and time-frequency analysis to investigate memory process for SON by comparing the responses to SON and to unfamiliar names. Specifically, the SON condition was compared with two control conditions: repeated unfamiliar names and singly presented unfamiliar names. This experimental design allowed us to determine the differences in memory processes between hearing one's own name and hearing unrelated but repeatedly heard names. ERP analysis showed that SON elicited a late positive component in parietal areas, while unfamiliar names elicited no positivity. Beta power suppression was observed in response to SON at 0.4-0.6s after stimulus onset at right central sites, but not in response to unfamiliar names. These results are indicative of an involvement of episodic memory processes on hearing SON, which corresponds to the recognition of one's own name. Further, the ERP results suggest the presence of a "new" stimulus recognition process that is activated by singly presented unfamiliar names but not by repeated unfamiliar names.