The effect of intention to learn novel, environmental sounds on the novelty P3 and old/new recognition memory

Observing memory encoding while it unfolds: Functional interpretation and current debates regarding ERP subsequent memory effects

Our ability to remember the past depends on neural processes set in train in the moment an event is experienced. These processes can be studied by segregating brain activity according to whether an event is later remembered or forgotten. The present review integrates a large number of studies examining this differential brain activity, labeled subsequent memory effect (SME), with the ERP technique, into a functional organization and discusses routes for further research. Based on the reviewed literature, we suggest that memory encoding is implemented by multiple processes, typically reflected in three functionally different subcomponents of the ERP SME elicited by study stimuli, which presumably interact with preparatory SME activity preceding the to be encoded event. We argue that ERPs are a valuable method in the SME paradigm because they have a sufficiently high temporal resolution to disclose the subcomponents of encoding-related brain activity. Implications of the proposed functional organization for future studies using the SME procedure in basic and applied settings will be discussed.

Meaningful Versus Meaningless Sounds and Words

The current study assessed memory performance for perceptually similar environmental sounds and speech-based material after short and long delays. In two studies, we demonstrated a similar pattern of memory performance for sounds and words in short-term memory, yet in long-term memory, the performance patterns differed. Experiment 1 examined the effects of two different types of sounds: meaningful (MFUL) and meaningless (MLESS), whereas Experiment 2 assessed memory performance for words and nonwords. We utilized a modified version of the classical Deese-Roediger-McDermott (Deese, 1959; Roediger & McDermott, 1995) procedure and adjusted it to test the effects of acoustic similarities between auditorily presented stimuli. Our findings revealed no difference in memory performance between MFUL and MLESS sounds, and between words and nonwords after short delays. However, following long delays, greater reliance on meaning was noticed for MFUL sounds than MLESS sounds, while performance for linguistic material did not differ between words and nonwords. Importantly, participants' memory performance for words and nonwords was accompanied by a more lenient response strategy. The results are discussed in terms of perceptual and semantic similarities between MLESS and MFUL sounds, as well as between words and nonwords.

Voices to remember: Comparing neural signatures of intentional and non-intentional voice learning and recognition

Recent electrophysiological evidence suggests a rapid acquisition of novel speaker representations during intentional voice learning. We investigated effects of learning intention on voice recognition, using a variant of the directed forgetting paradigm. In an old/new recognition task following voice learning, we compared performance and event-related brain potentials (ERPs) for studied voices, half of which had been prompted to be remembered (TBR) or forgotten (TBF). Furthermore, to assess incidental encoding of episodic information, participants indicated for each recognized test voice the ear of presentation during study. During study, TBR voices elicited more positive ERPs than TBF voices (from ∼250 ms), possibly reflecting deeper voice encoding. In parallel, subsequent recognition performance was higher for TBR than for TBF voices. Importantly, above-chance recognition for both learning conditions nevertheless suggested a degree of non-intentional voice learning. In a surprise episodic memory test for voice location, above-chance performance was observed for TBR voices only, suggesting that episodic memory for ear of presentation depended on intentional voice encoding. At test, a left posterior ERP OLD/NEW effect for both TBR and TBF voices (from ∼500 ms) reflected recognition of studied voices under both encoding conditions. By contrast, a right frontal ERP OLD/NEW effect for TBF voices only (from ∼800 ms) possibly reflected additional elaborative retrieval processes. Overall, we show that ERPs are sensitive 1) to strategic voice encoding during study (from ∼250 ms), and 2) to voice recognition at test (from ∼500 ms), with the specific pattern of ERP OLD/NEW effects partly depending on previous encoding intention.

Orienting and memory to unexpected and/or unfamiliar visual events in children and adults

For children, new experiences occur very often, and learning to differentiate between old and new events is a fundamental process necessary for appropriate reactions to stimuli. Thus the present study is concerned with maturation of brain responses to repeated novel events. We examined the effect of repetition of familiar (meaningful) and unfamiliar (meaningless) symbols on the event-related-potentials (ERPs) recorded during novelty oddball and recognition memory tasks from children, adolescents and young adults. During the novelty oddball task, repetition of the familiar symbols elicited a reduction in the novelty P3 in the ERPs of all age groups, while repetition of the unfamiliar symbols elicited a reduction in novelty P3 amplitude only in children. As expected, recognition memory performance improved with age and was better for familiar than unfamiliar symbols. For all age groups, ERPs to correctly recognized familiar old symbols elicited a larger positivity than ERPs to correctly identified new symbols, indicating a reliable memory effect. However, ERPs to unfamiliar old and new symbols did not differ in adults and adolescents but did differ in children. The data suggest that children process familiar visual symbols in a similar fashion to that of adults, and that children process unfamiliar symbols differently from adults.

Partners under Pressure: Examining the Consistency of True and False Alibi Statements

How to discriminate between honest and deceptive alibi statements holds great legal importance. We examined this issue from the perspective of group deception. Our goals were to (a) compare the consistency between the statements of guilty and innocent suspects and those of their respective alibi witnesses, and (b) to examine the moderating role of object-salience on the level of consistency between their statements. Pairs of truth-tellers provided honest testimonies. Pairs of liars were divided into perpetrators and alibi witnesses. Statements of lying pairs were considerably more consistent than the statements of truth-telling pairs. In addition, both truth-tellers and liars showed lower levels of within-group consistency when recalling less salient details about an event. However, truth-tellers' consistency levels were considerably more affected by salience than were liars' consistency levels. These findings contribute to deception theory and have important implications for the real-life task of distinguishing between true and false alibi statements. Copyright © 2017 John Wiley & Sons, Ltd.

Paying attention to my voice or yours: An ERP study with words

Self-related stimuli-such as one's own face or name-seem to be processed differently from non-self stimuli and to involve greater attentional resources, as indexed by larger amplitude of the P3 event-related potential (ERP) component. Nonetheless, the differential processing of self-related vs. non-self information using voice stimuli is still poorly understood. The present study investigated the electrophysiological correlates of processing self-generated vs. non-self voice stimuli, when they are in the focus of attention. ERP data were recorded from twenty right-handed healthy males during an oddball task comprising pre-recorded self-generated (SGV) and non-self (NSV) voice stimuli. Both voices were used as standard and deviant stimuli in distinct experimental blocks. SGV was found to elicit more negative N2 and more positive P3 in comparison with NSV. No association was found between ERP data and voice acoustic properties. These findings demonstrated an earlier and later attentional bias to self-generated relative to non-self voice stimuli. They suggest that one's own voice representation may have a greater affective salience than an unfamiliar voice, confirming the modulatory role of salience on P3.

Sometimes we have to intentionally focus on the details: Incidental encoding and perceptual change decrease recognition memory performance and the ERP correlate of recollection

Prior studies suggest that memory retrieval is based on two independent processes: Recollection and familiarity. Here, we investigated the role of incidental and intentional encoding, and specifically whether perceptual changes between study and test affects behavioral and electrophysiological correlates of both retrieval processes. During retrieval, participants distinguished between identical and changed exemplars as well as novel distractors. Following incidental encoding, participants had difficulty identifying changed exemplars; item and feature recognition increased after intentional encoding, in particular for changed exemplars. Reflecting this increase in memory performance, the ERP correlate of recollection was larger after intentional encoding and for identical item repetitions, whereas the ERP correlate for familiarity was largely unaffected. Pre-response old/new effects corresponding to later aspects of recollection (700-1000 ms relative to stimulus onset) were larger in response-compared to stimulus-locked averages, but also of similar magnitude for identical and changed exemplars. These results corroborate previous findings suggesting that the electrophysiological signature of recollection is modulated as a function of memory performance. The role of task characteristics and material retrieved from memory for modulations in familiarity-based retrieval processes is discussed.

ERP and pupil responses to deviance in an oddball paradigm

We investigated the relationship between, and functional significance of, P300, novelty P3, and the pupil dilation response (PDR). Subjects categorized stimuli including (a) words of a frequent category, (b) words of an infrequent category (14%), and (c) pictures of the frequent category ("novels"; 14%). The P300 and novelty P3 were uncorrelated with the PDR and differed in their response to experimental manipulation. Therefore, although the three physiological responses often co-occur, they appear to each manifest a distinct function: The PDR may be more closely linked to aspects of behavioral responding than the event-related potentials. Within participants, P300 and PDR latencies accounted for unique portions of the reaction time variance, and amplitudes of all three responses were larger for stimuli recalled on a subsequent test, compared to not recalled. We discuss the possibility that all three responses reflect norepinephric input from the locus coeruleus.

Associative Recognition Processes Are Modulated by Modality Relations

Although memory of episodic associations is generally considered to be recollective in nature, it has been suggested that when stimuli are experienced as a unit, familiarity-related processes might contribute to their subsequent associative recognition. Furthermore, intradomain associations are believed to be unitized more readily than interdomain associations. To assess these claims, we tested associative recognition following two types of pair associate learning. In the unimodal task, stimulus pairs were pictures of common objects, whereas in the cross-modal task, stimulus pairs consisted of an object picture and an unrelated environmental sound. At test, participants discriminated intact from recombined pairs while ERPs were recorded. In the unimodal task only, associative recognition was accompanied by a robust frontal deflection reminiscent of a component commonly interpreted as related to familiarity processes. In contrast, ERP correlates of associative recognition observed at more posterior sites, akin to a component that has been related to recollection, were apparent in both tasks. These findings indicate that retrieval of unimodal associations can be supported by familiarity-related processes that are dissociable from recollective processes required for the retrieval of cross-modal associations.

The component structure of event-related potentials in the p300 speller paradigm

We investigated the componential structure of event-related potentials elicited while participants use the P300 BCI. Six healthy participants "typed" all characters in a 6 × 6 matrix twice in a random sequence. A principal component analysis indicated that in addition to the P300, target flashes elicited an earlier frontal positivity, possibly a Novelty P3. The amplitudes of both P300 and the Novelty P3 varied with the matrix row in which the target character was located. However, the P300 elicited by row flashes was largest for targets in the lower part of the matrix, whereas the Novelty P3 elicited by column flashes was largest in the top part. Classification accuracy using stepwise linear discriminant analysis mirrored the pattern in the Novelty P3 (an accuracy difference of 0.1 between rows 1 and 6). When separate classifiers were generated to rely solely on the P300 or solely on the Novelty P3, the latter function led to higher accuracy (a mean accuracy difference of about 0.2 between classifiers). A possible explanation is that some nontarget flashes elicit a P300, leading to lower selection accuracy of the respective classifier. In an additional set of data from six different participants we replicated the ERP structure of the initial analyses and characterized the spatial distributions more closely by using a dense electrode array. Overall, our findings provide new insights in the componential structure of ERPs elicited in the P300 speller paradigm and have important implications for optimizing the speller's selection accuracy.

The component structure of ERP subsequent memory effects in the Von Restorff paradigm and the word frequency effect in recall

We examined the degree to which ERP components elicited by items that are isolated from their context, either by their font size ("size isolates") or by their frequency of usage, are correlated with subsequent immediate recall. Study lists contained (a) 15 words including a size isolate, (b) 14 high frequency (HF) words with one low frequency word ("LF isolate"), or (c) 14 LF words with one HF word. We used spatiotemporal PCA to quantify ERP components. We replicated previously reported P300 subsequent memory effects for size isolates and found additional correlations with recall in the novelty P3, a right lateralized positivity, and a left lateralized slow wave that was distinct from the slow wave correlated with recall for nonisolates. LF isolates also showed evidence of a P300 subsequent memory effect and also elicited the left lateralized subsequent memory effect, supporting a role of distinctiveness in word frequency effects in recall.

Visual novel stimuli in an ERP novelty oddball paradigm: effects of familiarity on repetition and recognition memory

The orienting response, the brain's reaction to novel and/or out of context familiar events, is reflected by the novelty P3 of the ERP. Contextually novel events also engender high rates of recognition memory. We examined, under incidental and intentional conditions, the effects of visual symbol familiarity on the novelty P3 recorded during an oddball task and on the parietal episodic memory (EM) effect, an index of recollection. Repetition of familiar, but not unfamiliar, symbols elicited a reduction in the novelty P3. Better recognition performance for the familiar symbols was associated with a robust parietal EM effect, which was absent for the unfamiliar symbols in the incidental task. These data demonstrate that processing of novel events depends on expectation and whether stimuli have preexisting representations in long-term semantic memory.

Cortical EEG correlates of successful memory encoding: implications for lifespan comparisons

In the course of their lives, individuals experience a myriad of events. Some of them leave stable traces, and others fade away quickly. Recent advances in functional imaging methods allow researchers to contrast neuronal patterns of remembered against not remembered events at initial encoding. Research on young adults using functional magnetic resonance imaging (fMRI), intracranial, and standard electroencephalographic (EEG) recordings has identified differences between remembered and not remembered items in patterns of medio-temporal and prefrontal brain activity. However, little is known about the ways in which such neuronal patterns of successful encoding evolve across the lifespan as a function of maturation, senescence, and the accumulation of experience. Here, we first review empirical evidence on neuronal correlates of successful memory from middle childhood to old age. Based on the observation that associative and strategic components of episodic memory seem to follow different age gradients, we propose a conceptual framework for predicting age changes in neuronal patterns of successful encoding.

Electrophysiological correlates of forming memories for faces, names, and face-name associations

The ability to put a name to a face is a vital aspect of human interaction, but many people find this extremely difficult, especially after being introduced to someone for the first time. Creating enduring associations between arbitrary stimuli in this manner is also a prime example of what patients with amnesia find most difficult. To help develop a better understanding of this type of memory, we sought to obtain measures of the neural events responsible for successfully forming a new face-name association. We used event-related potentials (ERPs) extracted from high-density scalp EEG recordings in order to compare (1) memory for faces, (2) memory for names, and (3) memory for face-name associations. Each visual face appeared simultaneously with a unique spoken name. Signals observed 200-800 ms after the onset of face-name pairs predicted subsequent memory for faces, names, or face-name associations. Difference potentials observed as a function of subsequent memory performance were not identical for these three memory tests, nor were potentials predicting associative memory equivalent to the sum of potentials predicting item memory, suggesting that different neural events at the time of encoding are relevant for these distinct aspects of remembering people.

The old switcheroo: when target environmental sounds elicit a novelty P3

OBJECTIVE

Novel environmental sounds that are task-irrelevant in the novelty oddball paradigm elicit the novelty P3 or P3a with a fronto-central scalp distribution, while pure tone task-relevant stimuli elicit a P3 with a posterior topography (P3b). To determine whether stimulus nature or its function in the task modulates scalp topography, the role of the two types of stimuli during the novelty oddball task was reversed.

METHODS

Brain electrical activity was recorded while 12 young adults listened to frequent tones, infrequent tones, and infrequent environmental sounds. Subjects were not informed about the infrequent tones, but were instructed to press a reaction time (RT) button when they heard the infrequent environmental sounds.

RESULTS

Despite the "novelty" nature of the tones, they were associated with a posterior scalp distribution typical of the P3b. Similarly, despite the "target" nature of the environmental sounds, they were associated with a fronto-central scalp topography typical of the P3a.

CONCLUSIONS

These data suggest that the elicitation of a novelty P3 depends not only on task demands but also on the physical nature of the stimulus.

SIGNIFICANCE

The brain's orienting response is modulated by the contextual environment as well as the physical properties of the eliciting stimulus.

Observing the transformation of experience into memory

The ability to remember one's past depends on neural processing set in motion at the moment each event is experienced. Memory formation can be observed by segregating neural responses according to whether or not each event is recalled or recognized on a subsequent memory test. Subsequent memory analyses have been performed with various neural measures, including brain potentials extracted from intracranial and extracranial electroencephalographic recordings, and hemodynamic responses from functional magnetic resonance imaging. Neural responses can predict which events, and which aspects of those events, will be subsequently remembered or forgotten, thereby elucidating the neurocognitive processes that establish durable episodic memories.

On the relationship of P3a and the Novelty-P3

Deviant stimuli give rise to a late positive ERP component with latencies from 250 to 400 ms. Target deviants elicit a P300 with maximum amplitude over parieto-central recording sites while the 'P300' elicited by deviant nontarget stimuli occurs somewhat earlier and shows a more frontally-oriented scalp distribution. Two varieties of frontal P300s have been described, elicited either by rare stimuli (target or nontarget) presented in a two-stimulus oddball task (P3a) or by infrequent, unrecognizable stimuli presented in the context of a three-stimulus oddball task (Novelty-P3). The Novelty-P3 has been observed in a number of subsequent studies; the P3a has not been extensively studied and both its significance and existence have been called into question. The present report describes a replication of two prototypical studies with 'frontal' P3s observed in each context. Application of factor analysis to the two sets of ERP waveforms does not support a distinction between these two components.

An ERD mapping study of the neurocognitive processes involved in the perceptual and semantic analysis of environmental sounds and words

The aim of this paper was to investigate and compare the EEG mechanisms underlying the perceptual and semantic processes involved in environmental and language sounds perception by manipulating the degree of identification of sounds and using the ERD (event-related desynchronization) method in healthy subjects. Four types of stimuli were analyzed: meaningful environmental sounds, meaningless sounds, words and non-words. We report many similarities in the ERDs and ERSs (event-related synchronizations) patterns among all stimuli, with: (i) similar time-course of ERDs and ERSs between meaningful environmental sounds and words, and between meaningless sounds and non-words; (ii) similar topography of the maximal ERDs for meaningful environmental sounds, words and non-words; and (iii) same right posterior ERSs for all four stimuli. However, differences were also observed: (i) in time-course, with earlier ERSs for meaningless than meaningful stimuli, whether environmental or verbal; and (ii) in topography, with ERDs predominating in left and right hemisphere channels for meaningful and meaningless environmental sounds, respectively; (iii) ERSs predominating in the left temporal channel for non-words and in the left posterior and right frontal channels for meaningless sounds. The results of this study suggest that meaningful stimuli involve greater and longer-lasting semantic processes than meaningless stimuli, while the occurrence of ERSs for the latter points to the possible involvement of an inhibitory processing of semantic representations. Finally, the findings concerning the comparison between verbal and non verbal stimuli suggest the involvement of left-lateralized phonological and semantic processes for the former, and more distributed neurocognitive processes in both hemispheres for the latter although with predominant left laterality for their semantic processing.

An event-related potential study of encoding in young and older adults

Event-related brain potentials (ERPs) were recorded from young (M age=25) and older (M age=71) adults during the study phase of a recognition memory paradigm. Participants studied two temporally distinct lists of sentences (each containing two unassociated nouns). During recognition testing, in response to the nouns, participants made old/new, followed by remember (context)/know (familiarity) and temporal source (i.e., list) judgments. To assess age-related differences in encoding, the ERPs recorded during study were averaged as a function of the correctness of the judgment of old in conjunction with subsequent temporal (list correct/incorrect) and subsequent remember and know judgments, i.e., subsequent memory or Dm effects were computed. Both young and old showed robust Dm activity regardless of whether the subsequent temporal source judgment was correct or incorrect. Although both young and old produced robust Dm effects for study items subsequently associated with a remember judgment, only the older participants showed a reliable Dm effect associated with study trials that were subsequently associated with a know judgment. This pattern of results suggests that older adults did not differentially encode items that would be subsequently retrieved with context from those that would be retrieved without such attributes.

Functional asymmetry of human prefrontal cortex: encoding and retrieval of verbally and nonverbally coded information

There are several views about the organization of memory functions in the human prefrontal cortex. One view assumes a process-specific brain lateralization according to different memory subprocesses, that is, encoding and retrieval. An alternative view emphasizes content-specific lateralization of brain systems involved in memory processes. This study addresses this apparent inconsistency between process- and content-specific lateralization of brain activity by investigating the effects of verbal and nonverbal encoding on prefrontal activations during encoding and retrieval of environmental novel sounds using fMRI. An intentional memory task was applied in which subjects were required either to judge the sounds' loudness (nonverbal encoding task) or to indicate whether or not a sound can be verbally described (verbal encoding task). Retrieval processes were examined in a subsequent yes/no recognition test. In the study phase the right posterior dorsolateral prefrontal cortex (PFC) was activated in both tasks. During verbal encoding additional activation of the left dorsolateral PFC was obtained. Retrieval-related fMRI activity varied as a function of encoding task: For the nonverbal task we detected an activation focus in the right posterior dorsolateral PFC whereas an activation in the left dorsolateral PFC was observed for the verbal task. These findings indicate that the right dorsolateral PFC is engaged in encoding of auditory information irrespective of encoding task. The lateralization of PFC activity during retrieval was shown to depend on the availability of verbal codes, with left hemispheric involvement for verbally and right hemispheric activation for nonverbally coded information.