Reduced memory for the spatial and temporal context of unpleasant words

The influence of emotion on temporal context models

Temporal context models (TCMs) have been influential in understanding episodic memory and its neural underpinnings. Recently, TCMs have been extended to explain emotional memory effects, one of the most clinically important findings in the field of memory research. This review covers recent advances in hypotheses for the neural representation of spatiotemporal context through the lens of TCMs, including their ability to explain the influence of emotion on episodic and temporal memory. In recent years, simplifying assumptions of "classical" TCMs - with exponential trace decay and the mechanism by which temporal context is recovered - have become increasingly clear. The review also outlines how recent advances could be incorporated into a future TCM, beyond classical assumptions, to integrate emotional modulation.

Emotional state dynamics impacts temporal memory

Emotional fluctuations are ubiquitous in everyday life, but precisely how they sculpt the temporal organisation of memories remains unclear. Here, we designed a novel task - the Emotion Boundary Task - wherein participants viewed sequences of negative and neutral images surrounded by a colour border. We manipulated perceptual context (border colour), emotional-picture valence, as well as the direction of emotional-valence shifts (i.e., shifts from neutral-to-negative and negative-to-neutral events) to create events with a shared perceptual and/or emotional context. We measured memory for temporal order and temporal distances for images processed within and across events. Negative images processed within events were remembered as closer in time compared to neutral ones. In contrast, temporal distances were remembered as longer for images spanning neutral-to-negative shifts - suggesting temporal dilation in memory with the onset of a negative event following a previously-neutral state. The extent of negative-picture induced temporal dilation in memory correlated with dispositional negativity across individuals. Lastly, temporal order memory was enhanced for recently-presented negative (versus neutral) images. These findings suggest that emotional-state dynamics matters when considering emotion-temporal memory interactions: While persistent negative events may compress subjectively remembered time, dynamic shifts from neutral-to-negative events produce temporal dilation in memory, with implications for adaptive emotional functioning.

The relationship between environmentally induced emotion and memory for a naturalistic virtual experience

Emotional stimuli (e.g. words, images) are often remembered better than neutral stimuli. However, little is known about how memory is affected by an environmentally induced emotional state (without any overtly emotional occurrences) - the focus of this study. Participants were randomly assigned to discovery (n = 305) and replication (n = 306) subsamples and viewed a desktop virtual environment before rating their emotions and completing objective (i.e. item, temporal-order, duration) and subjective (e.g. vividness, sensory detail, coherence) memory measures. In both samples, a Partial Least Squares Correlation analysis showed that an emotional state characterised by high negative emotion (i.e. threat, fear, anxiety) and arousal was reliably associated with better memory in both objective (i.e. item) and subjective (i.e. vividness and sensory detail) domains. No reliable associations were observed for any temporal memory measures (objective or subjective). Thus, an environmentally induced state of negative emotion corresponds with enhanced memory for indices of episodic memory pertaining to "what" happened, but not necessarily "when" it happened.

Emotional state dynamics impacts temporal memory

Emotional fluctuations are ubiquitous in everyday life, but precisely how they sculpt the temporal organization of memories remains unclear. Here, we designed a novel task-the Emotion Boundary Task-wherein participants viewed sequences of negative and neutral images surrounded by a color border. We manipulated perceptual context (border color), emotional valence, as well as the direction of emotional-valence shifts (i.e., shifts from neutral-to-negative and negative-to-neutral events) to create encoding events comprised of image sequences with a shared perceptual and/or emotional context. We measured memory for temporal order and subjectively remembered temporal distances for images processed within and across events. Negative images processed within events were remembered as closer in time compared to neutral ones. In contrast, temporal distance was remembered as longer for images spanning neutral-to-negative shifts-suggesting temporal dilation in memory with the onset of a negative event following a previously-neutral state. The extent of this negative-picture induced temporal dilation in memory correlated with dispositional negativity across individuals. Lastly, temporal order memory was enhanced for recently presented negative (compared to neutral) images. These findings suggest that emotional-state dynamics matters when considering emotion-temporal memory interactions: While persistent negative events may compress subjectively remembered time, dynamic shifts from neutral to negative events produce temporal dilation in memory, which may be relevant for adaptive emotional functioning.

Emotional arousal lingers in time to bind discrete episodes in memory

Temporal stability and change in neutral contexts can transform continuous experiences into distinct and memorable events. However, less is known about how shifting emotional states influence these memory processes, despite ample evidence that emotion impacts non-temporal aspects of memory. Here, we examined if emotional stimuli influence temporal memory for recent event sequences. Participants encoded lists of neutral images while listening to auditory tones. At regular intervals within each list, participants heard emotional positive, negative, or neutral sounds, which served as "emotional event boundaries" that divided each sequence into discrete events. Temporal order memory was tested for neutral item pairs that either spanned an emotional sound or were encountered within the same auditory event. Encountering a highly arousing event boundary led to faster response times for items encoded within the next event. Critically, we found that highly arousing sounds had different effects on binding ongoing versus ensuing sequential representations in memory. Specifically, highly arousing sounds were significantly more likely to enhance temporal order memory for ensuing information compared to information that spanned those boundaries, especially for boundaries with negative valence. These findings suggest that within aversive emotional contexts, fluctuations in arousal help shape the temporal organisation of events in memory.

Emotional dissociations in temporal associations: opposing effects of arousal on memory for details surrounding unpleasant events

Research targeting emotion's impact on relational episodic memory has largely focused on spatial aspects, but less is known about emotion's impact on memory for an event's temporal associations. The present research investigated this topic. Participants viewed a series of interspersed negative and neutral images with instructions to create stories linking successive images. Later, participants performed a surprise memory test, which measured temporal associations between pairs of consecutive pictures where one picture was negative and one was neutral. Analyses focused on how the order of negative and neutral images during encoding influenced retrieval accuracy. Converging results from a discovery study (N = 72) and pre-registered replication study (N = 150) revealed a "forward-favouring" effect of emotion in temporal memory encoding: Participants encoded associations between negative stimuli and subsequent neutral stimuli more strongly than associations between negative stimuli and preceding neutral stimuli. This finding may reflect a novel trade-off regarding emotion's effects on memory and is relevant for understanding affective disorders, as key clinical symptoms can be conceptualised as maladaptive memory retrieval of temporal details.

Are multiple types of associative memory differently impacted by emotion?

The effect of emotion on associative memory is still an open question. Our aim was to test whether discrepant findings are due to differential impact of emotion on different types of associative memory or to differences in the way participants encoded stimuli across studies. We examined the effect of negative content on multiple forms of associative memory, using the same encoding task. Two registered experiments were conducted in parallel with random allocation of participants to experiments. Each experiment included 4 encoding blocks, in which participants read a neutral text comprised of 6 paragraphs, which were interleaved with neutral or negative images. Images were controlled for visual properties and semantic similarity. Memory tests included recognition memory, Remember/Know, order memory, temporal source memory and contextual memory. Analyses showed that emotion decreased contextual memory but not order memory or temporal source memory. We also found that temporal source memory and contextual memory were correlated. Recognition accuracy and subjective recollection were not impacted by emotion. In agreement with previous work, participants self-reported a reduced ability to integrate blocks containing negative images with paragraphs. In contrast to our hypothesis, results suggest that emotion does not impact all types of associative memory when stimuli are controlled.

Opposite effects of emotion and event segmentation on temporal order memory and object-context binding

Our daily lives unfold continuously, yet our memories are organised into distinct events, situated in a specific context of space and time, and chunked when this context changes (at event boundaries). Previous research showed that this process, termed event segmentation, enhances object-context binding but impairs temporal order memory. Physiologically, peaks in pupil dilation index event segmentation, similar to emotion-induced bursts of autonomic arousal. Emotional arousal also modulates object-context binding and temporal order memory. Yet, these two critical factors have not been systematically studied together. To address this gap, we ran a behavioural experiment using a paradigm validated to study event segmentation and extended it with emotion manipulation. During encoding, we sequentially presented greyscale objects embedded in coloured frames (colour changes defining events), with a neutral or aversive sound. During retrieval, we tested participants' memory of temporal order memory and object-colour binding. We found opposite effects of emotion and event segmentation on episodic memory. While event segmentation enhanced object-context binding, emotion impaired it. On the contrary, event segmentation impaired temporal order memory, but emotion enhanced it. These findings increase our understanding of episodic memory organisation in laboratory settings, and potentially in real life with perceptual changes and emotion fluctuations constantly interacting.

Dynamic emotional states shape the episodic structure of memory

Human emotions fluctuate over time. However, it is unclear how these shifting emotional states influence the organization of episodic memory. Here, we examine how emotion dynamics transform experiences into memorable events. Using custom musical pieces and a dynamic emotion-tracking tool to elicit and measure temporal fluctuations in felt valence and arousal, our results demonstrate that memory is organized around emotional states. While listening to music, fluctuations between different emotional valences bias temporal encoding process toward memory integration or separation. Whereas a large absolute or negative shift in valence helps segment memories into episodes, a positive emotional shift binds sequential representations together. Both discrete and dynamic shifts in music-evoked valence and arousal also enhance delayed item and temporal source memory for concurrent neutral items, signaling the beginning of new emotional events. These findings are in line with the idea that the rise and fall of emotions can sculpt unfolding experiences into memories of meaningful events.

Aesthetic experience enhances first-person spatial representation

Episodic autobiographical memories are characterized by a spatial context and an affective component. But how do affective and spatial aspects interact? Does affect modulate the way we encode the spatial context of events? We investigated how one element of affect, namely aesthetic liking, modulates memory for location, in three online experiments (n = 124, 79, and 80). Participants visited a professionally curated virtual art exhibition. They then relocated previously viewed artworks on the museum map and reported how much they liked them. Across all experiments, liking an artwork was associated with increased ability to recall the wall on which it was hung. The effect was not explained by viewing time and appeared to modulate recognition speed. The liking-wall memory effect remained when participants attended to abstractness, rather than liking, and when testing occurred 24 h after the museum visit. Liking also modulated memory for the room where a work of art was hung, but this effect primarily involved reduced room memory for disliked artworks. Further, the liking-wall memory effect remained after controlling for effects of room memory. Recalling the wall requires recalling one's facing direction, so our findings suggest that positive aesthetic experiences enhance first-person spatial representations. More generally, a first-person component of positive affect transfers to wider spatial representation and facilitates the encoding of locations in a subject-centered reference frame. Affect and spatial representations are therefore important, and linked, elements of sentience and subjectivity. Memories of aesthetic experiences are also spatial memories of how we encountered a work of art. This linkage may have implications for museum design.

A matter of time: how does emotion influence temporal aspects of remembering?

Spatiotemporal context is an intrinsic aspect of episodic memory. Although a large literature has demonstrated that emotion enhances episodic memory, less research has considered whether and how emotion affects memory for the timing of an experience, despite theoretical and practical importance. In this review, we bridge three heavily researched cognitive domains - memory, emotion, and time - by discussing findings from a burgeoning literature on their intersection. We identify and review two broad ways in which memory for time has been conceptualised in the emotional memory literature, namely (1) memory for relative aspects of event timing ("when" an event detail occurred), which includes studies of temporal-order and source memory; and (2) memory for the time that elapsed during an event ("how long"), which includes studies of retrospective duration estimation. Emerging trends demonstrate that although temporal-order memory can be impaired or enhanced by emotion depending on study demands, temporal source memory, instead, is usually enhanced. Studies of duration memory show that the remembered duration of negative experiences is dilated, but it is less clear how duration memory is affected for positive events. These findings are considered under the lens of broader emotional memory literature theories, and directions for future research are proposed.

Interactions of Emotion and Self-reference in Source Memory: An ERP Study

The way emotional information is encoded (e.g., deciding whether it is self-related or not) has been found to affect source memory. However, few studies have addressed how the emotional quality and self-referential properties of a stimulus interactively modulate brain responses during stimulus encoding and source memory recognition. In the current study, 22 participants completed five study-test cycles with negative, neutral, and positive words encoded in self-referential versus non-self-referential conditions, while event-related potentials of the electroencephalogram were recorded. An advantage of self-referential processing in source memory performance, reflected in increased recognition accuracy, was shown for neutral and positive words. At the electrophysiological level, self-referential words elicited increased amplitudes in later processing stages during encoding (700-1,200 ms) and were associated with the emergence of old/new effects in the 300-500 ms latency window linked to familiarity effects. In the 500-800 ms latency window, old/new effects emerged for all valence conditions except for negative words studied in the non-self-referential condition. Negative self-referential words also elicited a greater mobilization of post-retrieval monitoring processes, reflected in an enhanced mean amplitude in the 800-1,200 ms latency window. Together, the current findings suggest that valence and self-reference interactively modulate source memory. Specifically, negative self-related information is more likely to interfere with the recollection of source memory features.

Differential Effects of Valence and Encoding Strategy on Internal Source Memory and Judgments of Source: Exploring the Production and the Self-Reference Effect

Item memory studies show that emotional stimuli are associated with improved memory performance compared to neutral ones. However, emotion-related effects on source memory are less consistent. The current study probed how emotional valence and specific encoding conditions influence internal source memory performance and judgments of source (JOSs). In two independent experiments, participants were required to read silently/aloud (Experiment 1) or to perform self-reference/common judgments (Experiment 2) on a list of negative/neutral/positive words. They also performed immediate JOSs ratings for each word. The study phase was followed by a test phase in which participants performed old-new judgments. In Experiment 1, the production effect was replicated for item memory, but the effects of valence on item and source memory were not significant. In Experiment 2, self-referential processing effects on item and source memory differed as a function of valence. In both experiments, JOSs ratings were sensitive to valence and encoding conditions, although they were not predictive of objective memory performance. These findings demonstrate that the effects of valence on internal source memory and JOSs are modulated by encoding strategy. Thus, the way information is encoded can shed light on how emotion might enhance, impair or exert no influence on source memory.

NEVER forget: negative emotional valence enhances recapitulation

A hallmark feature of episodic memory is that of "mental time travel," whereby an individual feels they have returned to a prior moment in time. Cognitive and behavioral neuroscience methods have revealed a neurobiological counterpart: Successful retrieval often is associated with reactivation of a prior brain state. We review the emerging literature on memory reactivation and recapitulation, and we describe evidence for the effects of emotion on these processes. Based on this review, we propose a new model: Negative Emotional Valence Enhances Recapitulation (NEVER). This model diverges from existing models of emotional memory in three key ways. First, it underscores the effects of emotion during retrieval. Second, it stresses the importance of sensory processing to emotional memory. Third, it emphasizes how emotional valence - whether an event is negative or positive - affects the way that information is remembered. The model specifically proposes that, as compared to positive events, negative events both trigger increased encoding of sensory detail and elicit a closer resemblance between the sensory encoding signature and the sensory retrieval signature. The model also proposes that negative valence enhances the reactivation and storage of sensory details over offline periods, leading to a greater divergence between the sensory recapitulation of negative and positive memories over time. Importantly, the model proposes that these valence-based differences occur even when events are equated for arousal, thus rendering an exclusively arousal-based theory of emotional memory insufficient. We conclude by discussing implications of the model and suggesting directions for future research to test the tenets of the model.

Emotional Content and Source Memory for Language: Impairment in an Incidental Encoding Task

Research into the effects of emotion on source memory (i.e., memory for certain contextual details of a stimulus, such as its location, color, or temporal context) has yielded inconsistent findings. Mather and her co-workers tried to account for such inconsistencies by pointing out the relevance of the characteristics of the feature examined. Specifically, they distinguished between intrinsic and extrinsic features (Mather, 2007) and between goal-relevant and goal-irrelevant information (Mather and Sutherland, 2011). In the current study, we investigated source memory for language, which is an intrinsic feature or words. Catalan-Spanish bilinguals were tested in three experiments involving a recognition task in which they were asked about the language of presentation (Catalan or Spanish) of emotional and neutral words. In Experiments 1 and 2, source memory for negative and neutral words was assessed. In Experiment 1 participants performed an intentional encoding task in which language was a goal-relevant feature. In Experiment 2, they did an incidental encoding task in which language was also goal-relevant. Experiment 3 replicated Experiment 2 but negative words were replaced by positive words. The results showed an impairment in source memory for the language of presentation of emotional words when the encoding task was incidental, but not when it was intentional. Such impairment was observed with both negative words and positive words. The results are discussed in relation to the proposals of Mather and co-workers and point to the relevance of modulating factors, such as the intentional/incidental nature of encoding.

Recall dynamics reveal the retrieval of emotional context

Memory is often better for emotional rather than neutral stimuli. The benefit for emotional items could be the result of an associative mechanism whereby items are associated to a slowly updating context. Through this process, emotional features are integrated with context during study, and are reactivated during test. The presence of emotion in context would both provide a stronger retrieval cue, enhancing memory of emotional items, as well as lead to emotional clustering, whereby emotionally similar items are recalled consecutively. To measure whether associative mechanisms can explain the enhancement for emotional items, we conducted a free recall study in which most items were emotionally neutral to minimize effects of mood induction and to more closely reflect naturalistic settings. We found that emotional items were significantly more likely to be recalled than neutral items and that participants were more likely to transition between emotional items rather than between emotional and neutral items. Together, these results suggest that contextual encoding and retrieval mechanisms may drive the benefit for emotional items both within and outside the laboratory.

Emotional Verbal Learning Test: development and psychometric properties

Memory deficits are a common feature of neurological and psychiatric disorders. Measures designed to evaluate memory in clinical populations have distinguished between memory for verbal and visual information; however, few tests assess the recall and recognition of emotional information, despite evidence suggesting that brain regions are differentially involved in memory for emotional and neutral stimuli and that affective disturbances are common in psychiatric and neurological disorders. The present study reports the test development and psychometric properties of the Emotional Verbal Learning Test (EVLT), a new neuropsychological measure that allows for the examination of emotional learning and memory. Psychometric analyses indicated that the EVLT has good internal consistency and test-retest reliability, as well as discriminant validity, clinical utility, and sensitivity to mood-congruency effects. This new measure has potential to be a valuable research and a clinical tool in the assessment of emotional memory and learning in healthy individuals and persons with neuropsychiatric disorders.

Emotional reactivity and awareness of task performance in Alzheimer's disease

Lack of awareness about performance in tasks is a common feature of Alzheimer's disease. Nevertheless, clinical anecdotes have suggested that patients may show emotional or behavioural responses to the experience of failure despite reporting limited awareness, an aspect which has been little explored experimentally. The current study investigated emotional reactions to success or failure in tasks despite unawareness of performance in Alzheimer's disease. For this purpose, novel computerised tasks which expose participants to systematic success or failure were used in a group of Alzheimer's disease patients (n=23) and age-matched controls (n=21). Two experiments, the first with reaction time tasks and the second with memory tasks, were carried out, and in each experiment two parallel tasks were used, one in a success condition and one in a failure condition. Awareness of performance was measured comparing participant estimations of performance with actual performance. Emotional reactivity was assessed with a self-report questionnaire and rating of filmed facial expressions. In both experiments the results indicated that, relative to controls, Alzheimer's disease patients exhibited impaired awareness of performance, but comparable differential reactivity to failure relative to success tasks, both in terms of self-report and facial expressions. This suggests that affective valence of failure experience is processed despite unawareness of task performance, which might indicate implicit processing of information in neural pathways bypassing awareness.

Emotion, directed forgetting, and source memory

We investigated the role of emotion on item and source memory using the item method of directed forgetting (DF) paradigm. We predicted that emotion would produce source memory impairment because emotion would make it more difficult to distinguish between to-be-remembered (R items) and to-be-forgotten items (F items) by making memory strength of R and F items similar to each other. Participants were presented with negatively arousing, positively arousing, and neutral pictures. After each picture, they received an instruction to remember or forget the picture. At retrieval, participants were asked to recall both R and F items and indicate whether each item was an R or F item. Recall was higher for the negatively arousing than for the positively arousing or neutral pictures. Further, DF occurred for the positively arousing and neutral pictures, whereas DF was not significant for the negatively arousing pictures. More importantly, the negatively arousing pictures, particularly the ones with violent content, showed a higher tendency of producing misattribution errors than the other picture types, supporting the notion that negative emotion may produce source memory impairment, even though it is still not clear whether the impairment occurs at encoding or retrieval.