Old-new ERP effects and remote memories: the late parietal effect is absent as recollection fails whereas the early mid-frontal effect persists as familiarity is retained

Consolidation improves the learning of new meanings for known words but not necessarily their integration into semantic memory

Consolidation is essential to the integration of novel words into the mental lexicon; however, its role in learning new meanings for known words remains unclear. This old-form-new-meaning learning is very common, as when one learns that "skate" is also a type of fish in addition to its familiar roller- or ice-skating meaning. To address consolidation effects for new meanings, we compared the behavioral and ERP measures on new and original meanings tested 24 hours after learning with words tested immediately after learning. Semantic judgments of both new and original meanings benefitted from the study-test interval. However, N400 amplitudes on studied words-indicators of meaning access from semantic memory-were unaffected by learning or consolidation. These results suggest that while sleep benefits memory for new meanings, the new meanings do not become integrated into the mental lexicon within that period. Instead, episodic retrieval remains functional in accessing new meanings even after 24 hours.

Fronto-parietal single-trial brain connectivity benefits successful memory recognition

Successful recognition has been known to produce distinct patterns of neural activity. Many studies have used spectral power or event-related potentials of single recognition-specific regions as classification features. However, this does not accurately reflect the mechanisms behind recognition, in that recognition requires multiple brain regions to work together. Hence, classification accuracy of subsequent memory performance could be improved by using functional connectivity within memory-related brain networks instead of using local brain activity as classifiers. In this study, we examined electroencephalography (EEG) signals while performing a word recognition memory task. Recorded EEG signals were collected using a 32-channel cap. Connectivity measures related to the left hemispheric fronto-parietal connectivity (P3 and F3) were found to contribute to the accurate recognition of previously studied memory items. Classification of subsequent memory outcome using connectivity features revealed that the classifier with support vector machine achieved the highest classification accuracy of 86.79 ± 5.93% (mean ± standard deviation) by using theta (3-8 Hz) connectivity during successful recognition trials. The results strongly suggest that highly accurate classification of subsequent memory outcome can be achieved by using single-trial functional connectivity.

Are involuntary autobiographical memory and déjà vu natural products of memory retrieval?

Involuntary autobiographical memories (IAMs) and déjà vu are phenomena that occur spontaneously in daily life. IAMs are recollections of the personal past, whereas déjà vu is defined as an experience in which the person feels familiarity at the same time as knowing that the familiarity is false. We present and discuss the idea that both IAMs and déjà vu can be explained as natural phenomena resulting from memory processing and, importantly, are both based on the same memory retrieval processes. Briefly, we hypothesise that both can be described as "involuntary" or spontaneous cognitions, where IAMs deliver content and déjà vu delivers only the feeling of retrieval. We map out the similarities and differences between the two, making a theoretical and neuroscientific account for their integration into models of memory retrieval and how the autobiographical memory literature can explain these quirks of daily life and unusual but meaningful phenomena. We explain the emergence of the déjà vu phenomenon by relating it to well-known mechanisms of autobiographical memory retrieval, concluding that IAMs and déjà vu lie on a continuum.

Forgetting Details in Visual Long-Term Memory: Decay or Interference?

Two main explanations for memory loss have been proposed. On the one hand, decay theories consider that over time memory fades away. On the other hand, interference theories sustain that when similar memories are encoded, they become more prone to confusion. The interference is greater as the degree of similarity between memories increases, and as the number of similar traces increases too. To reduce interference, the pattern separation process allows the brain to separate similar memories and build detailed memory representations that are less easily confused. Nonetheless, with time, we tend to remember more general aspects of experiences, which also affects our ability to discriminate. We present the results of one experiment in which brain activity was recorded by EEG while two groups of healthy participants performed a visual memory discrimination task. This task assesses the ability to differentiate new but similar information from previously learned information and thus avoid interference. Unlike previous studies, we used a paradigm that was specifically designed to assess the impact of the number of items (2 or 6) of each category stored in memory, as well as the time elapsed after the study phase (20 min or 24 h), on recognition memory for objects. Behaviorally, our results suggest that mnemonic discrimination is not modulated by the passage of time, but by the number of stored events. ERP results show a reduced amplitude in posterior regions between 500 and 700 ms when comparing short and long delays. We also observe a more positive activity in a centro-posterior region in the 500–700 ms window at retrieval when participants store more items. Interestingly, amplitudes for old hits and similar false alarms were greater than amplitudes for correctly rejected new items between 500 and 700 ms. This finding indicates that a recollection-based process operates in both true and false recognition. We also found that the waveforms for correct rejections of similar lures and the waveforms for correct rejections of new items were comparable.

An event-related potential study of the testing effect: Electrophysiological evidence for context-dependent processes changing throughout repeated practice

The testing effect refers to a special form of performance improvement following practice. Specifically, repeated retrieval attempts improve long-term memory. In the present study we examined the underlying mechanisms of the testing effect as a function of time by investigating the electrophysiological correlates of repeated retrieval practice. We additionally investigated the ERP waveforms of the repeated practice phase as a function of the accuracy on the final test in a "difference due to memory" (Dm) analysis. We found a parietally distributed, increased positive amplitude between 500-700 ms, and a more positive parietal wave between 700 and 1000 ms in the later relative to the early phases of retrieval practice. We found parietal Dm effects in the same two time windows in the retrieval practice condition with a more positive amplitude predicting retrieval success on the final test. We interpret the earlier waveform as a component associated with episodic recollection and the later ERP as a component related to post-retrieval evaluation processes. Our results demonstrate the important role of these retrieval-related processes in the facilitating effect of retrieval practice on later retrieval, and show that the involvement of these processes changes throughout practice.

The ERP correlates of self-knowledge in ageing

Self-knowledge is a type of personal semantic knowledge that concerns one's self-image and personal identity. It has most often been operationalized as the summary of one's personality traits ("I am a stubborn person"). Interestingly, recent studies have revealed that the neural correlates of self-knowledge can be dissociated from those of general semantic and episodic memory in young adults. However, studies of "dedifferentiation" or loss of distinctiveness of neural representations in ageing suggest that the neural correlates of self-knowledge might be less distinct from those of semantic and episodic memory in older adults. We investigated this question in an event-related potential (ERP) study with 28 young and 26 older adults while they categorised personality traits for their self-relevance (self-knowledge conditions), and their relevance to certain groups of people (general semantic condition). Participants then performed a recognition test for previously seen traits (episodic condition). The amplitude of the late positive component (LPC), associated with episodic recollection processes, differentiated the self-knowledge, general semantic, and episodic conditions in young adults, but not in older adults. However, in older adults, participants with higher composite episodic memory scores had more differentiated LPC amplitudes across experimental conditions. Moreover, consistent with the fact that age-related neural dedifferentiation may be material and region specific, in both age groups some differences between memory types were observed for the N400 component, associated with semantic processing. Taken together, these findings suggest that declarative memory subtypes are less distinct in ageing, but that the amount of differentiation varies with episodic memory function.

Sleep's short-term memory preservation and long-term affect depotentiation effect in emotional memory consolidation: Behavioral and EEG evidence

STUDY OBJECTIVES

Sleep plays a pivotal role in the off-line processing of emotional memory. However, much remains unknown for its immediate vs. long-term influences. We employed behavioral and electrophysiological measures to investigate the short- and long-term impacts of sleep vs. sleep deprivation on emotional memory.

METHODS

Fifty-nine participants incidentally learned 60 negative and 60 neutral pictures in the evening and were randomly assigned to either sleep or sleep deprivation conditions. We measured memory recognition and subjective affective ratings in 12- and 60-hour post-encoding tests, with EEGs in the delayed test.

RESULTS

In a 12-hour post-encoding test, compared to sleep deprivation, sleep equally preserved both negative and neutral memory, and their affective tones. In the 60-hour post-encoding test, negative and neutral memories declined significantly in the sleep group, with attenuated emotional responses to negative memories over time. Furthermore, two groups showed spatial-temporally distinguishable ERPs at delayed test: while both groups showed the old-new frontal negativity (300-500 ms, FN400), sleep-deprived participants additionally showed an old-new parietal, Late Positive Component effect (600-1000 ms, LPC). Multivariate whole-brain ERPs analyses further suggested that sleep prioritized neural representation of emotion over memory processing, while they were less distinguishable in the sleep deprivation group.

CONCLUSIONS

These data suggested that sleep's impact on emotional memory and affective responses is time-dependent: sleep preserved memories and affective tones in the short term, while ameliorating affective tones in the long term. Univariate and multivariate EEG analyses revealed different neurocognitive processing of remote, emotional memories between sleep and sleep deprivation groups.

Not Just a Pot: Visual Episodic Memory in Cannabis Users and Polydrug Cannabis Users: ROC and ERP Preliminary Investigation

Background While research has consistently identified an association between long-term cannabis use and memory impairments, few studies have examined this relationship in a polydrug context (i.e., when combining cannabis with other substances). Aims: In this preliminary study, we used event-related potentials to examine the recognition process in a visual episodic memory task in cannabis users (CU) and cannabis polydrug users (PU). We hypothesized that CU and PU will have both-behavioral and psychophysiological-indicators of memory processes affected, compared to matched non-using controls with the PU expressing more severe changes. Methods 29 non-using controls (CG), 24 CU and 27 PU were enrolled into the study. All participants completed a visual learning recognition task while brain electrical activity was recorded. Event-related potentials were calculated for familiar (old) and new images from a signal recorded during a subsequent recognition test. We used receiver operating characteristic curves for behavioral data analysis. Results The groups did not differ in memory performance based on receiver operating characteristic method in accuracy and discriminability indicators nor mean reaction times for old/new images. The frontal old/new effect expected from prior research was observed for all participants, while a parietal old/new effect was not observed. While, the significant differences in the late parietal component (LPC) amplitude was observed between CG and PU but not between CG and CU nor CU and PU. Linear regression analysis was used to examine the mean amplitude of the LPC component as a predictor of memory performance accuracy indicator. LPC amplitude predicts recognition accuracy only in the CG. Conclusion The results showed alterations in recognition memory processing in CU and PU groups compared to CG, which were not manifested on the behavioral level, and were the most prominent in cannabis polydrug users. We interpret it as a manifestation of the cumulative effect of multiple drug usage in the PU group.

A behavioural and ERP investigation of the wearable camera photo review in autobiographical memory

Wearable camera photo review has successfully been used to enhance memory, yet very little is known about the underlying mechanisms. Here, the sequential presentation of wearable camera photos - a key feature of wearable camera photo review - is examined using behavioural and EEG measures. Twelve female participants were taken on a walking tour, stopping at a series of predefined targets, while wearing a camera that captured photographs automatically. A sequence of four photos leading to these targets was selected (∼ 200 trials) and together with control photos, these were used in a recognition task one week later. Participants' recognition performance improved with the sequence of photos (measured in hit rates, correct rejections, & sensitivity), revealing for the first time, a positive effect of sequence of photos in wearable camera photo review. This has important implications for understanding the sequential and cumulative effects of cues on episodic remembering. An old-new ERP effect was also observed over visual regions for hits vs. correct rejections, highlighting the importance of visual processing not only for perception but also for the location of activated memory representations.

Face Validity of Remembering and Knowing: Empirical Consensus and Disagreement Between Participants and Researchers

Ever since Endel Tulving first distinguished between episodic and semantic memory, the remember/know paradigm has become a standard means of probing the phenomenology of participants’ memorial experiences by memory researchers, neuropsychologists, neuroscientists, and others. However, this paradigm has not been without its problems and has been used to capture many different phenomenological experiences, including retrieval from episodic versus semantic memory, recollection versus familiarity, strength of memory traces, and so on. We first conducted a systematic review of its uses across the literature and then examined how memory experts, other cognitive psychology experts, experts in other areas of psychology, and lay participants (Amazon Mechanical Turk workers) define what it means when one says “I remember” and “I know.” From coding their open-ended responses using a number of theory-bound dimensions, it seems that lay participants do not see eye to eye with memory experts in terms of associating “I remember” responses with recollection and “I know” responses with familiarity. However, there is general consensus with Tulving’s original distinction, linking remembering with memory for events and knowing with semantic memory. Recommendations and implications across fields are discussed.

Electrocortical indices of subjectively perceived confidence in episodic memory

Electrophysiological studies on recognition memory have identified several brain signals that are associated with subjective perceived confidence. However, the extent these brain signals reflect a generic process and are independent of the type of information recognized remains an open question. To address this issue, twenty-seven healthy volunteers performed an episodic memory task while their electro-encephalogram (EEG) was recorded. Participants encoded a set of abstract pictures, and subsequently rated their confidence on recognition decisions. Similar to results reported in previous studies using concrete words, we found retrieval-related theta power, FN400 and late positive component (LPC) effects. In contrast to previous studies using verbal material, a subsequent memory effect for encoding-related evoked theta power, sensitive to subjectively perceived memory confidence, was observed. Our findings suggest that brain signals that are associated with subjectively perceived confidence reflect specific encoding, but generic retrieval processes.

Behavioral and neural evidence of enhanced long-term memory for untrustworthy faces

In daily life, we automatically form impressions of other individuals on basis of subtle facial features that convey trustworthiness. Because these face-based judgements influence current and future social interactions, we investigated how perceived trustworthiness of faces affects long-term memory using event-related potentials (ERPs). In the current study, participants incidentally viewed 60 neutral faces differing in trustworthiness, and one week later, performed a surprise recognition memory task, in which the same old faces were presented intermixed with novel ones. We found that after one week untrustworthy faces were better recognized than trustworthy faces and that untrustworthy faces prompted early (350–550 ms) enhanced frontal ERP old/new differences (larger positivity for correctly remembered old faces, compared to novel ones) during recognition. Our findings point toward an enhanced long-lasting, likely familiarity-based, memory for untrustworthy faces. Even when trust judgments about a person do not necessarily need to be accurate, a fast access to memories predicting potential harm may be important to guide social behaviour in daily life.

Rapid Brain Responses to Familiar vs. Unfamiliar Music - an EEG and Pupillometry study

Human listeners exhibit marked sensitivity to familiar music, perhaps most readily revealed by popular “name that tune” games, in which listeners often succeed in recognizing a familiar song based on extremely brief presentation. In this work, we used electroencephalography (EEG) and pupillometry to reveal the temporal signatures of the brain processes that allow differentiation between a familiar, well liked, and unfamiliar piece of music. In contrast to previous work, which has quantified gradual changes in pupil diameter (the so-called “pupil dilation response”), here we focus on the occurrence of pupil dilation events. This approach is substantially more sensitive in the temporal domain and allowed us to tap early activity with the putative salience network. Participants (N = 10) passively listened to snippets (750 ms) of a familiar, personally relevant and, an acoustically matched, unfamiliar song, presented in random order. A group of control participants (N = 12), who were unfamiliar with all of the songs, was also tested. We reveal a rapid differentiation between snippets from familiar and unfamiliar songs: Pupil responses showed greater dilation rate to familiar music from 100–300 ms post-stimulus-onset, consistent with a faster activation of the autonomic salience network. Brain responses measured with EEG showed a later differentiation between familiar and unfamiliar music from 350 ms post onset. Remarkably, the cluster pattern identified in the EEG response is very similar to that commonly found in the classic old/new memory retrieval paradigms, suggesting that the recognition of brief, randomly presented, music snippets, draws on similar processes.

Tracking Your Mind's Eye during Recollection: Decoding the Long-Term Recall of Short Audiovisual Clips

Unlike familiarity, recollection involves the ability to reconstruct mentally previous events that results in a strong sense of reliving. According to the reinstatement hypothesis, this specific feature emerges from the reactivation of cortical patterns involved during information exposure. Over time, the retrieval of specific details becomes more difficult, and memories become increasingly supported by familiarity judgments. The multiple trace theory (MTT) explains the gradual loss of episodic details by a transformation in the memory representation, a view that is not shared by the standard consolidation model. In this study, we tested the MTT in light of the reinstatement hypothesis. The temporal dynamics of mental imagery from long-term memory were investigated and tracked over the passage of time. Participant EEG activity was recorded during the recall of short audiovisual clips that had been watched 3 weeks, 1 day, or a few hours beforehand. The recall of the audiovisual clips was assessed using a Remember/Know/New procedure, and snapshots of clips were used as recall cues. The decoding matrices obtained from the multivariate pattern analyses revealed sustained patterns that occurred at long latencies (>500 msec poststimulus onset) that faded away over the retention intervals and that emerged from the same neural processes. Overall, our data provide further evidence toward the MTT and give new insights into the exploration of our "mind's eye."

Self-initiated learning reveals memory performance and electrophysiological differences between younger, older and older adults with relative memory impairment

Older adults display difficulties in encoding and retrieval of information, resulting in poorer memory. This may be due to an inability of older adults to engage elaborative encoding strategies during learning. This study examined behavioural and electrophysiological effects of explicit cues to self-initiate learning during encoding and subsequent recognition of words in younger adults (YA), older control adults (OA) and older adults with relative memory impairment (OD). The task was a variation of the old/new paradigm, some study items were preceded by a cue to learn the word (L) while others by a do not learn cue (X). Behaviourally, YA outperformed OA and OD on the recognition task, with no significant difference between OA and OD. Event-related potentials at encoding revealed enhanced early visual processing (70-140 ms) for L- versus X-words in young and old. Only YA exhibited a greater late posterior positivity (LPP; 200-500 ms) for all words during encoding perhaps reflecting superior encoding strategy. During recognition, only YA differentiated L- versus X-words with enhanced frontal P200 (150-250 ms) suggesting impaired early word selection for retrieval in older groups; however, OD had enhanced P200 activity compared to OA during L-word retrieval. The LPP (250-500 ms) was reduced in amplitude for L-words compared to both X- and new words. However, YA showed greater LPP amplitude for all words compared to OA. For older groups, we observed reduced left parietal hemispheric asymmetry apparent in YA during encoding and recognition, especially for OD. Findings are interpreted in the light of models of compensation and dedifferentiation associated with age-related changes in memory function.

The electrophysiology of subjectively perceived memory confidence in relation to recollection and familiarity

Subjectively perceived confidence is critically involved in distinguishing recollection from familiarity in episodic memory retrieval. However, the extent to which recollection and familiarity share similar electrophysiological processes associated with subjectively perceived memory confidence remains an open question. In addition, the role of memory encoding in subjectively perceived confidence during retrieval has not yet been investigated. To address these issues, an EEG study was performed in thirty healthy volunteers. During a memory task, participants encoded a subset of words while rating the words on pleasantness. Memory recognition and subjectively perceived confidence concerning these 'old' and additional 'new' words was tested. Results showed that during retrieval, correctly classifying an old item with high subjectively perceived confidence was associated with a parietal ERP and parietal theta power, while frontal theta activity was related to high-confident novelty processing. During the memory encoding phase, a parietal ERP and frontal theta oscillations were related to subsequent subjectively perceived memory confidence. Our findings provide the first evidence that subjectively perceived memory confidence is associated with distinct electrophysiological correlates during both memory encoding and retrieval.

Single-Trial EEG Analysis Predicts Memory Retrieval and Reveals Source-Dependent Differences

We used pattern classifiers to extract features related to recognition memory retrieval from the temporal information in single-trial electroencephalography (EEG) data during attempted memory retrieval. Two-class classification was conducted on correctly remembered trials with accurate context (or source) judgments vs. correctly rejected trials. The average accuracy for datasets recorded in a single session was 61% while the average accuracy for datasets recorded in two separate sessions was 56%. To further understand the basis of the classifier’s performance, two other pattern classifiers were trained on different pairs of behavioral conditions. The first of these was designed to use information related to remembering the item and the second to use information related to remembering the contextual information (or source) about the item. Mollison and Curran (2012) had earlier shown that subjects’ familiarity judgments contributed to improved memory of spatial contextual information but not of extrinsic associated color information. These behavioral results were similarly reflected in the event-related potential (ERP) known as the FN400 (an early frontal effect relating to familiarity) which revealed differences between correct and incorrect context memories in the spatial but not color conditions. In our analyses we show that a classifier designed to distinguish between correct and incorrect context memories, more strongly involves early activity (400–500 ms) over the frontal channels for the location distinctions, than for the extrinsic color associations. In contrast, the classifier designed to classify memory for the item (without memory for the context), had more frontal channel involvement for the color associated experiments than for the spatial experiments. Taken together these results argue that location may be bound more tightly with the item than an extrinsic color association. The multivariate classification approach also showed that trial-by-trial variation in EEG corresponding to these ERP components were predictive of subjects’ behavioral responses. Additionally, the multivariate classification approach enabled analysis of error conditions that did not have sufficient trials for standard ERP analyses. These results suggested that false alarms were primarily attributable to item memory (as opposed to memory of associated context), as commonly predicted, but with little previous corroborating EEG evidence.

Late Positive Component Event-related Potential Amplitude Predicts Long-term Classroom-based Learning

It is difficult to predict whether newly learned information will be retrievable in the future. A biomarker of long-lasting learning, capable of predicting an individual's future ability to retrieve a particular memory, could positively influence teaching and educational methods. ERPs were investigated as a potential biomarker of long-lasting learning. Prior ERP studies have supported a dual-process model of recognition memory that categorizes recollection and familiarity as distinct memorial processes with distinct ERP correlates. The late positive component is thought to underlie conscious recollection and the frontal N400 signal is thought to reflect familiarity [Yonelinas, A. P. Components of episodic memory: The contribution of recollection and familiarity. Philosophical Transactions of the Royal Society of London, Series B, Biological Sciences, 356, 1363-1374, 2001]. Here we show that the magnitude of the late positive component, soon after initial learning, is predictive of subsequent recollection of anatomical terms among medical students 6 months later.

Aerobic Exercise During Encoding Impairs Hippocampus-Dependent Memory

We investigated how aerobic exercise during encoding affects hippocampus-dependent memory through a source memory task that assessed hippocampus-independent familiarity and hippocampus-dependent recollection processes. Using a within-participants design, young adult participants performed a memory-encoding task while performing a cycling exercise or being seated. The subsequent retrieval phase was conducted while sitting on a chair. We assessed behavioral and event-related brain potential measures of familiarity and recollection processes during the retrieval phase. Results indicated that source accuracy was lower for encoding with exercise than for encoding in the resting condition. Event-related brain potential measures indicated that the parietal old/new effect, which has been linked to recollection processing, was observed in the exercise condition, whereas it was absent in the rest condition, which is indicative of exercise-induced hippocampal activation. These findings suggest that aerobic exercise during encoding impairs hippocampus-dependent memory, which may be attributed to inefficient source encoding during aerobic exercise.

How Negative Social Bias Affects Memory for Faces: An Electrical Neuroimaging Study

During social interactions, we make inferences about people’s personal characteristics based on their appearance. These inferences form a potential prejudice that can positively or negatively bias our interaction with them. Not much is known about the effects of negative bias on face perception and the ability to recognize people faces. This ability was investigated by recording event-related potentials (ERPs) from 128 sites in 16 volunteers. In the first session (encoding), they viewed 200 faces associated with a short fictional story that described anecdotal positive or negative characteristics about each person. In the second session (recognition), they underwent an old/new memory test, in which they had to distinguish 100 new faces from the previously shown faces. ERP data relative to the encoding phase showed a larger anterior negativity in response to negatively (vs. positively) biased faces, indicating an additional processing of faces with unpleasant social traits. In the recognition task, ERPs recorded in response to new faces elicited a larger FN400 than to old faces, and to positive than negative faces. Additionally, old faces elicited a larger Old-New parietal response than new faces, in the form of an enlarged late positive (LPC) component. An inverse solution SwLORETA (450–550 ms) indicated that remembering old faces was associated with the activation of right superior frontal gyrus (SFG), left medial temporal gyrus, and right fusiform gyrus. Only negatively connoted faces strongly activated the limbic and parahippocampal areas and the left SFG. A dissociation was found between familiarity (modulated by negative bias) and recollection (distinguishing old from new faces).