Electrophysiological signals associated with fluency of different levels of processing reveal multiple contributions to recognition memory

The late positive event-related potential component is time locked to the decision in recognition memory tasks

Two event-related potential (ERP) components are commonly observed in recognition memory tasks: the Frontal Negativity (FN400) and the Late Positive Component (LPC). These components are widely interpreted as neural correlates of familiarity and recollection, respectively. However, the interpretation of LPC effects is complicated by inconsistent results regarding the timing of ERP amplitude differences. There are also mixed findings regarding how LPC amplitudes covary with decision confidence. Critically, LPC effects have almost always been measured using fixed time windows relative to memory probe stimulus onset, yet it has not been determined whether LPC effects are time locked to the stimulus or the recognition memory decision. To investigate this, we analysed a large (n = 132) existing dataset recorded during recognition memory tasks with old/new decisions followed by post-decisional confidence ratings. We used ERP deconvolution to disentangle contributions to LPC effects (defined as differences between hits and correct rejections) that were time locked to either the stimulus or the vocal old/new response. We identified a left-lateralised parietal LPC effect that was time locked to the vocal response rather than probe stimulus onset. We also isolated a response-locked, midline parietal ERP correlate of confidence that influenced measures of LPC amplitudes at left parietal electrodes. Our findings demonstrate that, contrary to widespread assumptions, the LPC effect is time locked to the recognition memory decision and is best measured using response-locked ERPs. By extension, differences in response time distributions across conditions of interest may lead to substantial measurement biases when analysing stimulus-locked ERPs. Our findings highlight important confounding factors that further complicate the interpretation of existing stimulus-locked LPC effects as neural correlates of recollection. We recommend that future studies adopt our analytic approach to better isolate LPC effects and their sensitivity to manipulations in recognition memory tasks.

Separating the role of perceptual and conceptual fluency on masked word priming using event-related potentials

Masked word repetition increases "old" responses on an episodic recognition test (Jacoby & Whitehouse, 1989). This effect is commonly attributed to perceptual fluency; that is, unconscious perception of the prime speeds reading of the target and this fluency leads to elevated familiarity. Two experiments directly tested the claim that perceptual fluency is responsible for word priming effects. Experiment 1 held prime-target meaning constant and altered the physical characteristics of match primes (e.g., "RIGHT" primes "RIGHT") by including both lowercase (e.g, "right") and mixed case primes (e.g., "rIgHt"). If word priming effects are due to perceptual fluency, then lowering the perceptual overlap between the prime and target should decrease or eliminate word priming effects. Instead, all three conditions showed robust priming effects in the behavioral and ERP (i.e., N400) measures. Experiment 2 equated the prime-target perceptual features and lowered the conceptual overlap by using orthographically similar nonwords as primes (e.g., "JIGHT" primes "RIGHT"). Removing prime-target conceptual overlap eliminated behavioral evidence of priming and N400 ERP differences correlated with priming. The evidence suggests that word priming effects on episodic recognition memory are more likely a product of conceptual fluency than perceptual fluency.

An ERP measure of non-conscious memory reveals dissociable implicit processes in human recognition using an open-source automated analytic pipeline

Non-conscious processing of human memory has traditionally been difficult to objectively measure and thus understand. A prior study on a group of hippocampal amnesia (N = 3) patients and healthy controls (N = 6) used a novel procedure for capturing neural correlates of implicit memory using event-related potentials (ERPs): old and new items were equated for varying levels of memory awareness, with ERP differences observed from 400 to 800 ms in bilateral parietal regions that were hippocampal-dependent. The current investigation sought to address the limitations of that study by increasing the sample of healthy subjects (N = 54), applying new controls for construct validity, and developing an improved, open-source tool for automated analysis of the procedure used for equating levels of memory awareness. Results faithfully reproduced prior ERP findings of parietal effects that a series of systematic control analyses validated were not contributed to nor contaminated by explicit memory. Implicit memory effects extended from 600 to 1000 ms, localized to right parietal sites. These ERP effects were found to be behaviorally relevant and specific in predicting implicit memory response times, and were topographically dissociable from other traditional ERP measures of implicit memory (miss vs. correct rejections) that instead occurred in left parietal regions. Results suggest first that equating for reported awareness of memory strength is a valid, powerful new method for revealing neural correlates of non-conscious human memory, and second, behavioral correlations suggest that these implicit effects reflect a pure form of priming, whereas misses represent fluency leading to the subjective experience of familiarity.

Differentiation of the Contribution of Familiarity and Recollection to the Old/New Effects in Associative Recognition: Insight from Semantic Relation

Previous research has revealed two different old/new effects, the early mid-frontal old/new effect (a.k.a., FN400) and the late parietal old/new effect (a.k.a., LPC), which relate to familiarity and recollection processes, respectively. Although associative recognition is thought to be more based on recollection, recent studies have confirmed that familiarity can make a great contribution when the items of a pair are unitized. However, it remains unclear whether the old/new effects are sensitive to the nature of different semantic relations. The current ERP (event-related potentials) study aimed to address this, where picture pairs of thematic, taxonomic, and unrelated relations served as stimuli and participants were required to discriminate the pair type: intact, rearranged, “old + new”, or new. We confirmed both FN400 and LPC. Our findings, by comparing the occurrence and the amplitudes of these two components, implicate that the neural activity of associative recognition is sensitive to the semantic relation of stimuli and depends more on stimulus properties, that the familiarity of a single item can impact the neural activities in discriminating associative pairs, and that the interval length between encoding and test modulates the familiarity of unrelated pairs. In addition, the dissociation between FN400 and LPC reinforces the dual-process models.

Event-Related Potential (ERP) evidence for fluency and disfluency effects on recognition memory

Masked priming is used in recognition memory studies to alter fluency and create familiarity. Primes are flashed briefly before target words that are considered for a recognition judgment. Matching primes are hypothesized to produce greater familiarity by increasing the perceptual fluency of the target word. Experiment 1 tested this claim by contrasting match primes (i.e., "RIGHT" primes "RIGHT"), semantic primes (e.g., "LEFT" primes "RIGHT"), and orthographically similar (OS) primes (e.g., "SIGHT" primes "RIGHT") while recording event-related potentials (ERPs). Relative to match primes, OS primes elicited fewer "old" responses and more negative ERPs during the interval associated with familiarity (300-500 ms). This result was replicated when control primes consisting of unrelated words (Experiment 2) or symbols (Experiment 3) were inserted into the sequence. The behavioral and ERP evidence suggest that word primes are perceived as a unit and the prime word activation will affect target fluency and recognition judgments. When the prime matches the target, fluency is increased and more familiarity experiences are created. When the primes are words that do not match the target, fluency is decreased (disfluency) and fewer familiarity experiences result. This evidence suggests that the effects of disfluency on recognition should be carefully considered.

Motor fluency makes it possible to integrate the components of the trace in memory and facilitates its re-construction

The aim of this work was to test the hypothesis that motor fluency should help the integration of the components of the trace and therefore its re-construction. In the encoding phase of each of the three experiments we conducted, a word to be remembered appeared colored in blue or purple. Participants had to read these words aloud and, at the same time, execute a gesture in their ipsilateral (fluent gesture) or contralateral space (non-fluent gesture), according to the color of the word. The aim of the first experiment was to show that the words associated with a fluent gesture during the encoding phase were more easily recognized than those associated with a non-fluent gesture. The results obtained supported the hypothesis. In the second experiment, our objective was to show that the fluency of a gesture performed during encoding in order to associate a word with a color can facilitate the integration of the word with its color. Here again, the results obtained supported the hypothesis. While in Experiment 2 we tested the effect of motor fluency during encoding on word-color integration, the objective of Experiment 3 was to show that motor fluency was integrated in the word-color trace and contributed to the re-construction of the trace. The results obtained supported the hypothesis. Taken together, these findings lead us to believe that traces are not only traces of the processes that gave rise to them, but also traces of the way in which the processes took place.

How Processing Fluency Contributes to the Old/New Effects of Familiarity and Recollection: Evidence From the Remember/Know Paradigm

Previous investigations have demonstrated FN400 and LPC, 2 event-related potential old/new effects that respectively reflect familiarity- and recollection-based processes in memory. However, it is unclear whether these effects are susceptible to processing fluency, particularly different types of processing fluency. To address this issue, applying a masked priming paradigm, we conducted an event-related potential experiment by manipulating semantic relations between the prime and the target as identical (reflecting perceptual fluency), thematically and taxonomically related (referring to conceptual fluency), and unrelated. A remember/know (R/K) judgment task in the test phase was used to distinguish familiarity- and recollection-based processes. Behaviorally, both task performance and response speed were modulated by the variables of priming condition, item type, and response type. All 4 priming conditions elicited significant FN400 and LPC. Compared with the K response, the R response was more relevant to the recollection-based processes reflected by LPC. Both FN400 and LPC were modulated by whether there was a response of R, K, or new. The former was susceptible only to conceptual fluency, and the latter was sensitive to both perceptual fluency and conceptual fluency, which offered telling evidence for the dual process model. Considerations for future investigations are proposed. See supplemental materials here: https://www.press.uillinois.edu/journals/ajp/media/evidence_in_remember_know_paradigm/

Recallable but not recognizable: The influence of semantic priming in recall paradigms

When people can successfully recall a studied word, they should be able to recognize it as having been studied. In cued-recall paradigms, however, participants sometimes correctly recall words in the presence of strong semantic cues but then fail to recognize those words as actually having been studied. Although the conditions necessary to produce this unusual effect are known, the underlying neural correlates have not been investigated. Across five experiments, involving both behavioral and electrophysiological methods (EEG), we investigated the cognitive and neural processes that underlie recognition failures. Experiments 1 and 2 showed behaviorally that assuming that recalled items can be recognized in cued-recall paradigms is a flawed assumption, because recognition failures occur in the presence of cues, regardless of whether those failures are measured. With event-related potentials (ERPs), Experiments 3 and 4 revealed that successfully recalled words that are recognized are driven by recollection at recall and then by a combination of recollection and familiarity at ensuing recognition. In contrast, recognition failures did not show that memory signature and may instead be driven by semantic priming at recall and followed at recognition stages by negative-going ERP effects consistent with implicit processes, such as repetition fluency. These results demonstrate that recall - long-characterized as predominantly reflecting recollection-based processing in episodic memory - may at times also be served by a confluence of implicit cognitive processes.

Electrophysiological correlates of the perceptual fluency effect on recognition memory in different fluency contexts

The present study used event-related potentials (ERPs) to investigate the contribution of perceptual fluency to recognition memory in different fluency contexts. In a recognition memory test with a modified remember-know paradigm, we employed conceptually impoverished items (kaleidoscope images) as stimuli and manipulated the perceptual fluency of recognition test cues through masked repetition priming. There were two fluency context conditions. In the random fluency context (RC) condition, primed and unprimed trials were randomly inter-mixed. In the blocked fluency context (BC) condition, primed and unprimed trials were grouped into blocks. Behavioral results showed that priming elevated the incidence of remember hits and the accuracy of remember judgements in the RC condition; no such effects were evident in the BC condition. In addition, priming effects on reaction times were found only for remember hit responses in the RC condition. The ERP results revealed an early100-200 ms effect related to masked repetition priming, which took the form of greater positivity for primed than unprimed trials. This effect was modulated neither by fluency context or response type. The present findings suggest that perceptual fluency induced by masked repetition priming affects recollection-related memory judgments in a specific fluency context and indicate that relative, rather absolute, fluency plays a critical role in influencing recognition memory judgments.

Priming recognition memory test cues: No evidence for an attributional basis of recollection

We argue that while the proposed memory model by Bastin et al. can explain familiarity-based memory judgements through the interaction of a core representation system and an attribution system, recollection-based memory judgements are not based on non-mnemonic signals being attributed to memory.

Neurophysiological evidence for the retrieval practice effect under emotional context

Testing has been demonstrated to enhance memory retention compared to restudy, which is known as the retrieval practice effect. Although much evidence has shown that emotional arousal has an impact on memory retention, little is known about how emotional arousal would influence the retrieval practice effect. To answer this question, the current study used emotional pictures as a context to induce the emotional arousal for restudy or retrieval practice. A Remember/Know paradigm was used in the final test with EEG recordings to examine how the impact of emotional arousal on retrieval practice effect would be reflected in familiarity or recollection. Behavioral results showed that the remembrance was enhanced by the retrieval practice compared to the restudy under both neutral and emotional contexts. Consistently, a parietal old/new effect from 500 to 800 ms was only found for the retrieval practice but not for the restudy condition under both neutral and emotional contexts. These findings indicated that retrieval practice could enhance later recollection when compared to restudy irrespective of emotional or neutral contexts.

The role of emotion arousal in the retrieval practice effect

Many studies have shown that practicing retrieval produces better memory retention compared to restudy. Though previous literature has provided valuable insights about the retrieval practice effect, it is still unclear how emotion arousal influences the retrieval practice effect, and whether the effect would be manifested in recollection or familiarity processes. To answer these questions, in the current study, negative and neutral words were used as stimuli and participants were asked to perform a recognition test or restudy the words after initial study. At the end of the experiment, a final recognition test with involving the remember-know paradigm was shown. Behavioral data were collected with EEG recorded throughout the experiment. The behavioral retrieval practice effect was only found for the neutral but not the negative words. Consistently, significant ERP differences between the restudy and retrieval practice conditions were only found for neutral, but not negative items, which was a component from 700 to 900 ms at left-posterior electrode cluster. Moreover, we found that the effects of emotion arousal on the retrieval practice effect were mainly reflected in the recollection process. These findings provide behavioral and neural evidence that emotion arousal can influence the retrieval practice effect.

The effect of conceptual priming on subsequent familiarity: Behavioral and electrophysiological evidence

Previous studies on the neural mechanisms of how priming influences subsequent recognition memory have mainly focused on repetition priming, whereas the neural mechanisms of how conceptual priming affects subsequent recognition memory is still not clear. The present study investigated the electrophysiological correlates of how conceptual priming influences subsequent recognition memory. The behavioral results showed that conceptual priming only affected subsequent familiarity. The ERP results showed that conceptual priming was associated with reduced N400, and that the N400 conceptual priming effect predicted the behavioral effect of conceptual priming on subsequent familiarity. These results indicated that conceptual priming could influence subsequent familiarity by facilitating semantic processing in the encoding phase.

The neural mechanism of fluency-based memory illusions: the role of fluency context

Recognition memory judgments can be influenced by a variety of signals including fluency. Here, we investigated whether the neural correlates of memory illusions (i.e., misattribution of fluency to prior study) can be modulated by fluency context. Using a masked priming/recognition memory paradigm, we found memory illusions for low confidence decisions. When fluency varied randomly across trials, we found reductions in perirhinal cortex (PrC) activity for primed trials, as well as a (pre)cuneus-PrC (BA 35) connectivity. When the fluency context was unchanging, there was increased PrC activity for primed trials, with the (pre)cuneus showing greater connectivity with PrC (BA 36). Thus, our results tentatively suggest two neural mechanisms via which fluency can lead to memory illusions.

The temporal dynamics of perceptual and conceptual fluency on recognition memory

Recognition memory can be driven by both perceptual and conceptual fluency, but when and to what extent they contribute to recognition memory remains an open question. The present study used event-related potentials (ERPs) to investigate the neural correlates of perceptual and conceptual fluency, when they gave rise to recognition. We manipulated the perceptual and conceptual fluency of retrieval cues in the recognition test independently to obtain the effects of different types of fluency. Behavioral results showed that perceptual fluency selectively affected K hits, while conceptual fluency affected R hits and K false alarms. In addition, conceptual fluency facilitated the response times of R hits. The ERP results showed that perceptual fluency effect appeared at 100-200 ms and conceptual fluency effect appeared at 300-500 ms. The parietal LPC peaked earlier for conceptually primed trials compared to unprimed trials. These results suggest that perceptual and conceptual fluency had different effects on recognition judgments, and these two types of fluency can be delineated by distinct ERP correlates. The current finding indicates that unconscious memory processes can support recognition and have provided insights into the underlying mechanism involved in recognition memory.