Expectations alter recognition and event-related potentials (ERPs)

Electrophysiological analysis of signal detection outcomes emphasizes the role of decisional factors in recognition memory

Introduction

Event-related potential (ERP) studies have identified two time windows associated with recognition memory and interpreted them as reflecting two processes: familiarity and recollection. However, using relatively simple stimuli and achieving high recognition rates, most studies focused on hits and correct rejections. This leaves out some information (misses and false alarms) that according to Signal Detection Theory (SDT) is necessary to understand signal processing.

Methods

We used a difficult visual recognition task with colored pictures of different categories to obtain enough of the four possible SDT outcomes and analyzed them with modern ERP methods.

Results

Non-parametric analysis of these outcomes identified a single time window (470 to 670 ms) which reflected activity within fronto-central and posterior-left clusters of electrodes, indicating differential processing. The posterior-left cluster significantly distinguished all STD outcomes. The fronto-central cluster only distinguished ERPs according to the subject's response: yes vs. no. Additionally, only electrophysiological activity within the posterior-left cluster correlated with the discrimination index (d').

Discussion

We show that when all SDT outcomes are examined, ERPs of recognition memory reflect a single-time window that may reveal a bottom-up factor discriminating the history of items (i.e. memory strength), as well as a top-down factor indicating participants' decision.

Brain Activity is Influenced by How High Dimensional Data are Represented: An EEG Study of Scatterplot Diagnostic (Scagnostics) Measures

Visualization and visual analytic tools amplify one's perception of data, facilitating deeper and faster insights that can improve decision making. For multidimensional data sets, one of the most common approaches of visualization methods is to map the data into lower dimensions. Scatterplot matrices (SPLOM) are often used to visualize bivariate relationships between combinations of variables in a multidimensional dataset. However, the number of scatterplots increases quadratically with respect to the number of variables. For high dimensional data, the corresponding enormous number of scatterplots makes data exploration overwhelmingly complex, thereby hindering the usefulness of SPLOM in human decision making processes. One approach to address this difficulty utilizes Graph-theoretic Scatterplot Diagnostic (Scagnostics) to automatically extract a subset of scatterplots with salient features and of manageable size with the hope that the data will be sufficient for improving human decisions. In this paper, we use Electroencephalogram (EEG) to observe brain activity while participants make decisions informed by scatterplots created using different visual measures. We focused on 4 categories of Scagnostics measures: Clumpy, Monotonic, Striated, and Stringy. Our findings demonstrate that by adjusting the level of difficulty in discriminating between data sets based on the Scagnostics measures, different parts of the brain are activated: easier visual discrimination choices involve brain activity mostly in visual sensory cortices located in the occipital lobe, while more difficult discrimination choices tend to recruit more parietal and frontal regions as they are known to be involved in resolving ambiguities. Our results imply that patterns of neural activity are predictive markers of which specific Scagnostics measures most assist human decision making based on visual stimuli such as ours.

Does Expecting Matter? The Impact of Experimentally Established Expectations on Subsequent Memory Retrieval of Emotional Words

Previous studies have confirmed that different degrees of expectation, including the bipolarity of the expected and unexpected, as well as an intermediate level (no expectation), can affect memory. However, only a few investigations have manipulated expectation through experimentally established schema, with no consideration of how expectation impacts both item and source memory. Furthermore, stimulus emotionality may also impact memory. Therefore, we conducted a study to investigate the effects of three levels of expectation on item and source memory while considering the impact of stimulus emotionality. The experiment began with a phase dedicated to learning the rules. In the subsequent study phase, negative and neutral words were manipulated as expected, no expectation, and unexpected, based on these rules. This was followed by tasks focused on item and source memory. The study found that there was a "U-shape" relationship between expectation and item memory. Additionally, the study revealed the distinct impacts of expectation on item and source memory. When it came to item memory, both expected and unexpected words were better remembered than those with no expectations. In source memory, expected words showed memory inferiority for expectation-irrelevant source information, but an advantage for expectation-relevant source information. Stimulus emotionality modulated the effect of expectation on both item and source memory. Our findings provide behavioral evidence for the schema-linked interactions between medial prefrontal and medial temporal regions (SLIMM) theory, which proposes that congruent and incongruent events enhance memory through different brain regions. The different patterns between item and source memory also support dual-process models. Moreover, we speculate that processing events with varying levels of emotionality may undermine the impact of expectation, as implied by other neural investigations.

The default-interventionist model underlies premise typicality weakening the premise diversity effect during category-based induction: Event-related potentials evidence

The diversity effect during category-based induction (CBI) means that the more diverse the evidence, the higher will be the conclusion's inductive strength. However, it is influenced by the premise typicality. Three competitive cognitive processing models account for this influence: (1) The pre-emptive conflict resolution model assumes that only premise typicality activates; (2) the parallel-competitive model assumes that premise typicality and diversity activate in parallel; and (3) the default-interventionist model assumes that a default response of premise diversity first activates and is subsequently followed by premise typicality, or premise typicality activates first, followed by premise diversity. The timing of premise typicality affecting the diversity effect during CBI was measured using event-related potentials to determine which cognitive model best explains this influence. Similar to previous studies, non-diverse premise inductive tasks involving two typical premise categories were compared with diverse premise inductive tasks involving a typical and an atypical category. The results showed that non-diverse conditions had higher "correct" response proportions, greater inductive strength, higher "definitely" response proportions, and shorter reaction times than diverse conditions, showing that premise typicality weakens the diversity effect. Moreover, the diverse premises elicited larger P2, smaller FN400, and greater frontal post-N400-positivity amplitudes than non-diverse premises, suggesting that premise diversity was facilitated during a relatively early time window and revised by premise typicality in a later window. These results support the default-interventionist in nature during thinking and reasoning.

Standardized database of 400 complex abstract fractals

In experimental settings, characteristics of presented stimuli influence cognitive processes. Knowledge about stimulus features is important to manipulate or control the influence of stimuli. To date, there are a lack of standardized data incorporating such information for complex abstract stimuli. Thus, we provide norms for a database of 400 abstract and complex stimuli. Grey-scaled fractals were rated by 512 participants on the stimulus features of abstractness, animacy, verbalizability, complexity, familiarity, favorableness, and memorability. Moreover, 111 participants labeled the fractals, enabling us to calculate indices of naming agreement and modal names. Overall, the results confirmed high abstractness and low verbalizability of the provided stimuli. To establish external validation for selected stimulus features, we evaluated (a) classifier probability of a deep neural network labeling the fractals, negatively correlated with ratings of abstractness and positively with verbalizability and naming agreement; (b) data compression rate of fractal image files, positively correlated with the rating of complexity; and (c) performance of 212 participants in a recognition-memory task, positively correlated with the rating of memorability. The present work fills the gap of a standardized database for abstract stimuli and provides a database with valid norms for abstract and complex stimuli based on ratings and external validation measures. This database can be used to control and manipulate these stimulus features in experimental settings using abstract stimuli. Such a database is essential in experimental research using abstract stimuli for instance to control for verbal influence and strategy or to control for novelty and familiarity.

The effect of test query on recognition event-related potentials (ERPs)

The influence of question framing (i.e., [was the item] "old?" or "new?") on recognition memory and event-related potentials (ERPs) was investigated. Words were encoded using a shallow task to create a weak memory trace that was more susceptible to test question framing effects. Participants made yes/no judgments on two, counterbalanced tests. One test focused on old items ("old?"), whereas the other test focused on new items ("new?"). The behavioral evidence suggested that the weak memory traces led to more familiarity-based recognition judgments with a concentrated effect on decision criterion. There were some small ERP changes on the FN400 or LPC consistent with the criterion changes, but the test query did not directly alter these ERP components. Instead, the test query altered a late old/new ERP difference similar to the "right frontal old/new effect" reported in source monitoring ERP studies. When the query was "new?", old items elicited more positive ERPs, whereas there was no old/new difference when the query was "old?". The results suggest that the query framing induces memory biases that occur late in the stream of processing. More generally, the results indicate that decision criterion must be accounted for when interpreting physiological correlates of recognition memory.

Distinct FN400/N400 memory effects for perceptually fluent and disfluent words

Recognition memory studies have shown that increased perceptual fluency results in more "old" responses and, presumably, increases familiarity. However, the exact neural mechanisms of these effects remain unresolved. We conducted two ERP experiments in which participants encoded words and performed a recognition test where fluency was manipulated by changing clarity of test words (half of them were clear or blurry). In the more demanding Experiment 1, we found a reversed effect of fluency on recognition (more hits for blurry words), which was accompanied by larger N400 and LPC old/new effects for blurry words. For high confidence responses, the topography of N400 shifted towards frontal electrodes (the FN400 for blurry words). In the less demanding Experiment 2, no behavioral differences between clear and blurry words were observed. However, there was a discrepancy in the ERP results, with the frontal FN400 for blurry words and the parietal N400 for clear words, suggesting that distinct neural pathways can support familiarity-based recognition for clear and blurry items. In both experiments, early perceptual fluency ERP effects were also observed. The results indicate that both semantic processing and familiarity can be enhanced by perceptual fluency and contribute to recognition judgments, depending on the interpretations of fluency.

Context influences the FN400 recognition event-related potential

Recognition of studied items often elicit more positive event-related potentials (ERPs) than unstudied items at mid-frontal electrodes about 300-500 ms (i.e., the FN400). The debate over the psychological processes associated with the FN400 has led to two competing hypotheses. One hypothesis is that the FN400 reflects familiarity, whereas another hypothesis is that it reflects conceptual implicit memory (i.e., conceptual fluency). The present experiment tested these hypotheses by presenting meaningless images that lack familiarity and conceptual fluency, off-brand products that lack pre-experimental familiarity, and name-brand products that have both pre-experimental familiarity and conceptual fluency. ERPs were recorded during judgments of lifetime and recent recognition. During both forms of recognition, ERPs in the FN400 window were greater for meaningless images than name- or off-brand products. Because this evidence is difficult to reconcile with either the familiarity or conceptual fluency hypotheses, the results are interpreted within a broader theoretical framework that includes top-down psychological (i.e., context) influences on the FN400.

Sensitivity of Reality Monitoring to Fluency: Evidence from Behavioral Performance and Event-Related Potential (ERP) Old/New Effects

Background

Item memory and source memory are differently processed with both behavioral and event-related potential (ERP) evidence. Reality monitoring, a specific type of source memory, which refers to the ability to differentiate external sources from internal sources, has been drawing much attention. Among factors that have an impact on reality monitoring, fluency has not been well-studied. Therefore, the current study aimed to investigate whether fluency could affect reality monitoring, through observations on both behavioral performance and electrophysiological patterns.

Material/Methods

Adopting ERP techniques, participants were required either to watch the presentation of a name/picture pair, or to imagine a picture for each displayed name, once (low fluency) or twice (high fluency). Later they completed a reality monitoring task of identifying names as perceived, imagined, or novel items. Behavioral performance was measured, and ERP waveforms were recorded.

Results

Behaviorally, high fluency items were faster and more accurately attributed to the sources than low fluency items. ERP waveforms revealed that late positive component (LPC) occurred for all 4 types of items, while imagined items of low fluency did not record a robust FN400 or late frontal old/new effect.

Conclusions

As results revealed, the factor of fluency does influence reality monitoring in terms of accuracy and responding speed. Meanwhile, for imagined items of low fluency, the absence of FN400 and frontal old/new effect also suggests the sensitivity of reality monitoring to fluency, because these representatives of familiarity-based processing and post-retrieval monitoring are inevitably involved in the process of differentiating internal source from external source.