Repetition and brain potentials when recognizing natural scenes: task and emotion differences

Neural Processing of Repeated Emotional Scenes in Schizophrenia, Schizoaffective Disorder, and Bipolar Disorder

Impaired emotional processing and cognitive functioning are common in schizophrenia, schizoaffective disorder, and bipolar disorders, causing significant socioemotional disability. While a large body of research demonstrates abnormal cognition/emotion interactions in these disorders, previous studies investigating abnormalities in the emotional scene response using event-related potentials (ERPs) have yielded mixed findings, and few studies compare findings across psychiatric diagnoses. The current study investigates the effects of emotion and repetition on ERPs in a large, well-characterized sample of participants with schizophrenia-bipolar syndromes. Two ERP components that are modulated by emotional content and scene repetition, the early posterior negativity (EPN) and late positive potential (LPP), were recorded in healthy controls and participants with schizophrenia, schizoaffective disorder, bipolar disorder with psychosis, and bipolar disorder without psychosis. Effects of emotion and repetition were compared across groups. Results displayed significant but small effects in schizophrenia and schizoaffective disorder, with diminished EPN amplitudes to neutral and novel scenes, reduced LPP amplitudes to emotional scenes, and attenuated effects of scene repetition. Despite significant findings, small effect sizes indicate that emotional scene processing is predominantly intact in these disorders. Multivariate analyses indicate that these mild ERP abnormalities are related to cognition, psychosocial functioning, and psychosis severity. This relationship suggests that impaired cognition, rather than diagnosis or mood disturbance, may underlie disrupted neural scene processing in schizophrenia-bipolar syndromes.

Spatiotemporal Dynamics of Affective and Semantic Valence Among Women

As an important dimension of emotional assessment, valence can refer to affective valence reflecting an emotional response, or semantic valence reflecting knowledge about the nature of a stimulus. A previous study has used repeated exposure to separate these two similar cognitive processes. Here, for the first time, we compared the spatiotemporal dynamics of the affective and semantic modes of valence by combining event-related potentials with repeated exposure. Forty-seven female participants were assigned to the feeling-focused and semantic-focused groups and thereafter repeatedly viewed the pictures selected for the study. Self-report behavioral results showed that post-test scores were significantly lower than pre-test scores in the feeling-focused group, while the differences between the two tests were not significant in the semantic-focused group. At the neural level, N2 amplitudes decreased and early late positive potential amplitudes increased in both groups, suggesting that the participants perceived the repeated pictures more fluently and retrieved the traces of the stimulus spontaneously regardless of the valence they judged. However, the late positive potential amplitudes in anterior areas and the activity of the middle frontal gyrus were attenuated in the feeling-focused group; however, this component in posterior areas and the activity of the precentral gyrus were increased in the semantic-focused group. Therefore, the processes of affective and semantic valence are similar in the early stages of image perception and retrieval, while in the later stage of valence judgment, these processes show different brain activation patterns. The results provide electrophysiological evidence for the differences in psychological processes when judging the two modes of valence.

Different Influences of Negative and Neutral Emotional Interference on Working Memory in Trait Anxiety

To examine the interaction of working memory (WM) type with emotional interference in trait anxiety, event-related potentials were measured in a combined WM and emotional task. Participants completed a delayed matching-to-sample task of WM, and emotional pictures were presented during the maintenance interval. The results indicated that negative affect interfered with spatial WM; task-related changes in amplitude were observed in the late positive potential (LPP) and slow waves in both the high and low anxiety groups. We also found an interaction among WM type, emotion, and trait anxiety such that participants with high levels of trait anxiety showed an opposite neural response to verbal and spatial WM tasks compared with individuals with low trait anxiety during the sustained brain activity involved in processing negative or neutral pictures in the delay phase. Our results increase our understanding of the influence of emotions on recognition and the vulnerability of those with trait anxiety to emotional stimuli.

Time will tell: Object categorization and emotional engagement during processing of degraded natural scenes

The aim of the present study was to examine the relationship between object categorization in natural scenes and the engagement of cortico-limbic appetitive and defensive systems (emotional engagement) by manipulating both the bottom-up information and the top-down context. Concerning the bottom-up information, we manipulated the computational load by scrambling the phase of the spatial frequency spectrum, and asked participants to classify natural scenes as containing an animal or a person. The role of the top-down context was assessed by comparing an incremental condition, in which pictures were progressively revealed, to a condition in which no probabilistic relationship existed between each stimulus and the following one. In two experiments, the categorization and response to emotional and neutral scenes were similarly modulated by the computational load. The Late Positive Potential (LPP) was affected by the emotional content of the scenes, and by categorization accuracy. When the phase of the spatial frequency spectrum was scrambled by a large amount (>58%), chance categorization resulted, and affective LPP modulation was eliminated. With less degraded scenes, categorization accuracy was higher (.82 in Experiment 1, .86 in Experiment 2) and affective modulation of the LPP was observed at a late window (>800 ms), indicating that it is possible to delay the time of engagement of the motivational systems which are responsible for the LPP affective modulation. The present data strongly support the view that semantic analysis of visual scenes, operationalized here as object categorization, is a necessary condition for emotional engagement at the electrocortical level (LPP).

Attentional conditions differentially affect early, intermediate and late neural responses to fearful and neutral faces

The processing of fearful facial expressions is prioritized by the human brain. This priority is maintained across various information processing stages as evident in early, intermediate and late components of event-related potentials (ERPs). However, emotional modulations are inconsistently reported for these different processing stages. In this pre-registered study, we investigated how feature-based attention differentially affects ERPs to fearful and neutral faces in 40 participants. The tasks required the participants to discriminate either the orientation of lines overlaid onto the face, the sex of the face or the face's emotional expression, increasing attention to emotion-related features. We found main effects of emotion for the N170, early posterior negativity (EPN) and late positive potential (LPP). While N170 emotional modulations were task-independent, interactions of emotion and task were observed for the EPN and LPP. While EPN emotion effects were found in the sex and emotion tasks, the LPP emotion effect was mainly driven by the emotion task. This study shows that early responses to fearful faces are task-independent (N170) and likely based on low-level and configural information while during later processing stages, attention to the face (EPN) or-more specifically-to the face's emotional expression (LPP) is crucial for reliable amplified processing of emotional faces.

Enhanced spontaneous retrieval of cues from emotional events: An ERP study

Recent evidence points to enhanced episodic memory retrieval not only for emotional items but also for neutral information encoded in emotional contexts. However, prior research only tested instructed explicit recognition, and hence here we investigated whether memory retrieval is also heightened for cues from emotional contexts when retrieval is not explicitly probed. During the first session of a two-session experiment, neutral objects were presented on different background scenes varying in emotional and neutral contents. One week later, objects were presented again (with no background) intermixed with novel objects. In both sessions, participants were instructed to attentively watch the stimuli (free viewing procedure), and during the second session, ERPs were also collected to measure the ERP Old/New effect, an electrophysiological correlate of episodic memory retrieval. Analyses were performed using cluster-based permutation tests in order to identify reliable spatio-temporal ERP differences. Based on this approach, old relative to new objects, were associated with larger ERP positivity in an early (364-744 ms) and late time window (760-1148 ms) over distinct central electrode clusters. Interestingly, significant late ERP Old/New differences were only observed for objects previously encoded with emotional, but not neutral scenes (504 to 1144 ms). Because these ERP differences were observed in a non-instructed retrieval context, our results indicate that long-term, spontaneous retrieval for neutral objects, is particularly heightened if encoded within emotionally salient contextual information. These findings may assist in understanding mechanisms underlying spontaneous retrieval of emotional associates and the utility of ERPs to study maladaptive involuntary memories in trauma- and stress-related disorders.

Effects of Directed Attention on Subsequent Processing of Emotions: Increased Attention to Unpleasant Pictures Occurs in the Late Positive Potential

Directed attention is a fundamental mental resource for voluntarily managing the focus and direction of cognitive resources. The present study investigated how processing of unpleasant and neutral images is affected by emotion and previous directed attention. The results showed that there was enhanced early posterior negativity, anterior N2, and parietal late positive potential (LPP) in response to unpleasant pictures compared to neutral pictures. Furthermore, attention history (i.e., whether stimuli were previously attended to) modulated the amplitudes of the anterior N2 and parietal LPP. Most notably, an interaction between attention history and emotion was found in the LPP: pictures with an 'attended history' evoked larger LPP amplitudes than pictures with an 'unattended history,' but this effect was only significant for unpleasant pictures (not for neutral pictures). These results suggest that directed attention to affective pictures facilitates subsequent neural processing of these pictures, and that this effect was amplified by unpleasant emotions experienced in the LPP. The current findings provide further empirical evidence of a two-stage model of emotion-attention interaction.

Neural activation and memory for natural scenes: Explicit and spontaneous retrieval

Stimulus repetition elicits either enhancement or suppression in neural activity, and a recent fMRI meta-analysis of repetition effects for visual stimuli (Kim, 2017) reported cross-stimulus repetition enhancement in medial and lateral parietal cortex, as well as regions of prefrontal, temporal, and posterior cingulate cortex. Repetition enhancement was assessed here for repeated and novel scenes presented in the context of either an explicit episodic recognition task or an implicit judgment task, in order to study the role of spontaneous retrieval of episodic memories. Regardless of whether episodic memory was explicitly probed or not, repetition enhancement was found in medial posterior parietal (precuneus/cuneus), lateral parietal cortex (angular gyrus), as well as in medial prefrontal cortex (frontopolar), which did not differ by task. Enhancement effects in the posterior cingulate cortex were significantly larger during explicit compared to implicit task, primarily due to a lack of functional activity for new scenes. Taken together, the data are consistent with an interpretation that medial and (ventral) lateral parietal cortex are associated with spontaneous episodic retrieval, whereas posterior cingulate cortical regions may reflect task or decision processes.

Emotional Picture Perception: Repetition Effects in Free-Viewing and during an Explicit Categorization Task

Several studies have found that, despite a decrease in the overall amplitude of the late positive potential (LPP) with repeated presentation of the same picture, emotional stimuli continue to elicit a larger LPP than neutral ones. These findings seem to support the hypothesis that the affective modulation of the LPP reflects a mandatory process and does not rely on stimulus novelty. However, in these studies participants were asked to merely look at the pictures, without carrying out any additional task (free-viewing), making picture emotionality the most salient aspect of the stimulus, despite its repetition. The current study aimed to examine the impact of an explicit categorization task on the emotional processing of repeated pictures. To this purpose, ERPs to novel and repeated pictures were measured during free-viewing as well as during an explicit categorization task, where the emotional content of the pictures was task-irrelevant. The within-subject comparison between the free-viewing and task context revealed that the overall LPP habituated more rapidly in the free-viewing condition, but, more importantly, the LPP affective modulation was unaffected by task requirements during both novel and repeated presentations. These results suggest that the affective modulation of the LPP reflects an automatic engagement of cortico-limbic motivational systems, which continues to take place regardless of stimulus novelty and task context.

Assessing Hedonic Bias in Emotional Scene Memory

Abstract. Across studies, memory for emotional events has shown a positivity bias, a negativity bias, and/or an arousal bias, and different types of memory biases have been reported in patients diagnosed with anxiety and mood disorders. Here, we investigated hedonic bias in memory for emotionally evocative scenes in a large sample (n = 625) of healthy young adults, in order to provide normative data on effects of pleasure, arousal, and content on immediate free recall that could facilitate future clinical investigations. Participants first viewed and rated a set of 60 pictures, followed by an unexpected memory test. Across participants, memory data was obtained for 360 different pictures, which served as the unit of analysis. There was neither a systematic positivity nor negativity bias in free recall of emotionally arousing scenes. Rather, memory was enhanced for scenes rated as highly arousing, whether pleasant or unpleasant, with those depicting romantic/sexual love and death/violence remembered equally well, and significantly better than other hedonic contents. Gender differences were not strong. Taken together, these data provide a basic science foundation for assessing hedonic bias in clinical populations.

Binding neutral information to emotional contexts: Brain dynamics of long-term recognition memory

There is abundant evidence in memory research that emotional stimuli are better remembered than neutral stimuli. However, effects of an emotionally charged context on memory for associated neutral elements is also important, particularly in trauma and stress-related disorders, where strong memories are often activated by neutral cues due to their emotional associations. In the present study, we used event-related potentials (ERPs) to investigate long-term recognition memory (1-week delay) for neutral objects that had been paired with emotionally arousing or neutral scenes during encoding. Context effects were clearly evident in the ERPs: An early frontal ERP old/new difference (300-500 ms) was enhanced for objects encoded in unpleasant compared to pleasant and neutral contexts; and a late central-parietal old/new difference (400-700 ms) was observed for objects paired with both pleasant and unpleasant contexts but not for items paired with neutral backgrounds. Interestingly, objects encoded in emotional contexts (and novel objects) also prompted an enhanced frontal early (180-220 ms) positivity compared to objects paired with neutral scenes indicating early perceptual significance. The present data suggest that emotional--particularly unpleasant--backgrounds strengthen memory for items encountered within these contexts and engage automatic and explicit recognition processes. These results could help in understanding binding mechanisms involved in the activation of trauma-related memories by neutral cues.

Benefits and Costs of Context Reinstatement in Episodic Memory: An ERP Study

This study investigated context-dependent episodic memory retrieval. An influential idea in the memory literature is that performance benefits when the retrieval context overlaps with the original encoding context. However, such memory facilitation may not be driven by the encoding-retrieval overlap per se but by the presence of diagnostic features in the reinstated context that discriminate the target episode from competing episodes. To test this prediction, the encoding-retrieval overlap and the diagnostic value of the context were manipulated in a novel associative recognition memory task. Participants were asked to memorize word pairs presented together with diagnostic (unique) and nondiagnostic (shared) background scenes. At test, participants recognized the word pairs in the presence and absence of the previously encoded contexts. Behavioral data show facilitated memory performance in the presence of the original context but, importantly, only when the context was diagnostic of the target episode. The electrophysiological data reveal an early anterior ERP encoding-retrieval overlap effect that tracks the cost associated with having nondiagnostic contexts present at retrieval, that is, shared by multiple previous episodes, and a later posterior encoding-retrieval overlap effect that reflects facilitated access to the target episode during retrieval in diagnostic contexts. Taken together, our results underscore the importance of the diagnostic value of the context and suggest that context-dependent episodic memory effects are multiple determined.

Repetition and ERPs during emotional scene processing: A selective review

A set of studies are reviewed that investigate the effects of repetition during scene perception on event-related potentials, elucidating perceptual, memory and emotional processes. Repetition suppression was consistently found for the amplitude of early frontal N2 and posterior P2 components, which was greatly enhanced for massed, compared to distributed, repetition. Both repetition suppression and enhancement of the amplitude of a centro-parietal positive potential (LPP) were found in specific contexts. Suppression was reliably found following a massive number of repetitions of few items, whereas enhancement is found when repetitions are spaced; enhancement was apparent both during simple free viewing as well as on an explicit recognition test. Regardless of repetition, an enhanced LPP was always found for emotional, compared to neutral, scenes. Taken together, the data suggest that different effects of massed and distributed repetitions on specific ERP components index perceptual priming, habituation, and spontaneous episodic retrieval.

Neural mechanisms of the spacing effect in episodic memory: A parallel EEG and fMRI study

Although behavioral studies have consistently reported the spacing effect in learning, its cognitive and neural mechanisms are still not clearly elucidated. According to the storage/retrieval strength framework proposed by Bjork (1999; Bjork & Bjork, 1992), which was built on the study-phase retrieval hypothesis and the deficient processing hypothesis, the spacing effect is achieved by reducing memomtary retrieval strength during subsequent repetitions and thus enhancing storage strength. The present study tested this hypothesis with parallel fMRI and EEG. Participants were asked to study 180 words that were repeated three times, with half of the words having an inter-repetition-lag of 1-3 words (i.e., massed learning) and the other half an inter-repetition-lag of 25-35 words (i.e., spaced learning). An unexpected recognition test was administered 24 h after learning. Consistent with Bjork's hypothesis, the EEG data suggested that spaced learning was associated with weaker retrieval strength, as indicated by a reduced familiarity effect in frontal N400. Meanwhile, spaced learning effectively enhanced the encoding process and thus led to stronger storage strength, as indicated by greater fMRI responses during learning in brain regions whose activities were associated with subsequent memory. Interestingly, no direct association was found between repetition priming and episodic memory. These results furthered our understanding of the neural mechanisms underlying the spacing effect.

Massed and distributed repetition of natural scenes: Brain potentials and oscillatory activity

Neural measures of repetition can result in either repetition suppression or enhancement effects, with enhancement sometimes interpreted as indicating episodic retrieval, rather than stimulus habituation. Here, we manipulated whether repetitions were massed (consecutive) or distributed (intermixed) and measured event-related potentials and oscillatory activity, investigating the question of whether there is evidence of "spontaneous" episodic retrieval for distributed, but not massed, repetition. Results showed that distributed repetition uniquely prompted a significant centroparietal old-new effect as well as enhanced theta, compared to either novel presentations or massed repetitions, consistent with a hypothesis of spontaneous retrieval. Massed repetition, on the other hand, prompted repetition suppression and reduction of the N2/P2. Taken together, the data suggest that distributed repetition may facilitate later memory performance because it spontaneously retrieves prior representations.

Remembering the object you fear: brain potentials during recognition of spiders in spider-fearful individuals

In the present study we investigated long-term memory for unpleasant, neutral and spider pictures in 15 spider-fearful and 15 non-fearful control individuals using behavioral and electrophysiological measures. During the initial (incidental) encoding, pictures were passively viewed in three separate blocks and were subsequently rated for valence and arousal. A recognition memory task was performed one week later in which old and new unpleasant, neutral and spider pictures were presented. Replicating previous results, we found enhanced memory performance and higher confidence ratings for unpleasant when compared to neutral materials in both animal fearful individuals and controls. When compared to controls high animal fearful individuals also showed a tendency towards better memory accuracy and significantly higher confidence during recognition of spider pictures, suggesting that memory of objects prompting specific fear is also facilitated in fearful individuals. In line, spider-fearful but not control participants responded with larger ERP positivity for correctly recognized old when compared to correctly rejected new spider pictures, thus showing the same effects in the neural signature of emotional memory for feared objects that were already discovered for other emotional materials. The increased fear memory for phobic materials observed in the present study in spider-fearful individuals might result in an enhanced fear response and reinforce negative beliefs aggravating anxiety symptomatology and hindering recovery.

Crossmodal interactions during affective picture processing

"Natural" crossmodal correspondences, such as the spontaneous tendency to associate high pitches with high spatial locations, are often hypothesized to occur preattentively and independently of task instructions (top-down attention). Here, we investigate bottom-up attentional engagement by using emotional scenes that are known to naturally and reflexively engage attentional resources. We presented emotional (pleasant and unpleasant) or neutral pictures either below or above a fixation cross, while participants were required to discriminate between a high or a low pitch tone (experiment 1). Results showed that despite a robust crossmodal attentional capture of task-irrelevant emotional pictures, the general advantage in classifying the tones for congruent over incongruent visual-auditory stimuli was similar for emotional and neutral pictures. On the other hand, when picture position was task-relevant (experiment 2), task-irrelevant tones did not interact with pictures with regard to their combination of pitch and visual vertical spatial position, but instead they were effective in minimizing the interference effect of emotional picture processing on the ongoing task. These results provide constraints on our current understanding of natural crossmodal correspondences.

Encoding and reinstatement of threat: recognition potentials

On a recognition test, stimuli originally encoded in the context of shock threat show an enhanced late parietal positivity during later recognition compared to stimuli encoded during safety, particularly for emotionally arousing stimuli. The present study investigated whether this ERP old/new effect is further influenced when a threat context is reinstated during the recognition test. ERPs were measured in a yes-no recognition test for words rated high or low in emotional arousal that were encoded and recognized in the context of cues that signaled threat of shock or safety. Correct recognition of words encoded under threat, irrespective of reinstatement, was associated with an enhanced old-new ERP difference (500-700ms; centro-parietal), and this difference was only reliable for emotionally arousing words. Taken together, the data suggest that information processed in a stressful context are associated with better recollection on later recognition, an effect that was not modulated by reinstating the stressful context at retrieval.

Effects of pre-encoding stress on brain correlates associated with the long-term memory for emotional scenes

Recent animal and human research indicates that stress around the time of encoding enhances long-term memory for emotionally arousing events but neural evidence remains unclear. In the present study we used the ERP old/new effect to investigate brain dynamics underlying the long-term effects of acute pre-encoding stress on memory for emotional and neutral scenes. Participants were exposed either to the Socially Evaluated Cold Pressure Test (SECPT) or a warm water control procedure before viewing 30 unpleasant, 30 neutral and 30 pleasant pictures. Two weeks after encoding, recognition memory was tested using 90 old and 90 new pictures. Emotional pictures were better recognized than neutral pictures in both groups and related to an enhanced centro-parietal ERP old/new difference (400–800 ms) during recognition, which suggests better recollection. Most interestingly, pre-encoding stress exposure specifically increased the ERP old/new-effect for emotional (unpleasant) pictures, but not for neutral pictures. These enhanced ERP/old new differences for emotional (unpleasant) scenes were particularly pronounced for those participants who reported high levels of stress during the SECPT. The results suggest that acute pre-encoding stress specifically strengthens brain signals of emotional memories, substantiating a facilitating role of stress on memory for emotional scenes.