Valence modulates source memory for faces

Enhanced source memory for emotionally valenced sources: does an affective orienting task make the difference?

Previous research on whether source memory is enhanced for emotionally valenced sources yielded inconclusive results. To identify potential boundary conditions, we tested whether encoding instructions that promote affective versus different types of non-affective item-source-processing foster versus hamper source-valence effects. In both experiments, we used neutral words as items superimposed on emotional (positive & negative) or neutral pictures as sources. Source pictures were selected based on valence and arousal ratings collected in a pre-study such that only valence varied across sources. Source memory was measured via multinomial modelling. In Experiment 1, we applied an affective, item-focused orienting task (OT; i.e. word-pleasantness ratings) during item-source encoding and found enhanced source memory for emotionally valenced (positive & negative) compared to neutral sources. In Experiment 2, we systematically manipulated encoding instructions and again found enhanced source memory for emotionally valenced sources with an affective OT. No such effects occurred in the non-affective conditions, where participants were instructed to integrate item and source (item-source-fit judgments), to focus on the item (living-non-living judgments), or to encode the items only, respectively. With intentional item encoding, however, source memory was surprisingly better for positive than negative sources. We conclude that source-valence effects might unfold only under affective processing.

Multiple producible cues do not aid face-name memory: A reverse production effect

Are there effective mechanisms that can be used to remember someone's name? The production effect is a phenomenon that exemplifies memory's robust benefit for studied words or phrases that have been spoken out loud, as opposed to only hearing or seeing them. However, this robust effect has not yet been identified for face-name pairings. The present study seeks to examine the boundary conditions of the production effect in face-name pairings by incorporating the additional cue of valenced adjectives. Participants were presented with facial images and a sentence stating the name and a description of the individual. Sentences were learned in one of four ways: saying the sentence out loud, reading it silently, reading it while hearing it, or only listening to the sentence presented while viewing the face. Memory for the face, name, and adjective combinations were tested using various types of cues: face only (Experiment 1a), or face and name or adjective (Experiment 1b & Experiment 2). Results replicate the lack of a production effect for face-name memory, and instead support a reverse effect for such stimuli. These findings indicate the unique processing of faces and highlight boundary conditions of the production effect.

Better memory for emotional sources? A systematic evaluation of source valence and arousal in source memory

Emotion-enhanced memory (EEM) describes the robust memory advantage of emotional over non-emotional stimuli. While extensively investigated with emotional items, it is unclear whether the EEM effect extends to source memory for a neutral item's emotional context. In two pre-registered studies, we systematically manipulated source valence (positive, negative) between participants and source arousal (high, low, neutral-low) within participants. In Experiment 1 (lab study, N = 80), we used emotional sound sources and presented them together with neutral pictures as items. In Experiment 2 (online study, N = 172), we used emotional background pictures with superimposed neutral item words to similarly manipulate source emotionality. Multinomial model-based analysis showed no general effects of valence or arousal on source memory across both experiments. Source memory was impaired for the negative high-arousing source in Experiment 1 but this did not replicate in Experiment 2. Altogether, we conclude that there are no memory-enhancing effects of source emotionality (valence, arousal, or any specific combination thereof) on source memory, dissociating emotionality effects between source and item memory. Additionally, we propose that material-dependent influences carry more weight if the used emotional material is limited in number, as is the case in the standard source-monitoring paradigm employing few sources only.

A novel paradigm to assess storage of sources in memory: the source recognition test with reinstatement

The present research aimed to devise a test of source recognition that facilitates access to source information stored in memory. Therefore, we extended the standard source-monitoring paradigm, in which items are presented in a source-neutral manner during test, by a second, subsequent test with source reinstatement. In this second test, items (i.e., words) were presented with both study sources (i.e., two speakers) consecutively such that for originally studied words, one test presentation was the exact reinstatement of the original source. To validate our assumption that the test with reinstatement primarily assesses source storage, we manipulated source storage by varying encoding frequency between-participants (repetition vs. no repetition of each item-source-pair). Additionally, we varied source similarity between-participants (similar vs. dissimilar speakers). Data analyses (N = 146) based on multinomial and signal detection models showed a source memory enhancement in the second test with reinstatement compared to the first standard test, especially for similar sources. Additionally, repetition selectively benefited source memory in the second test, validating our interpretation of the second test as a measure for source storage. Altogether, our novel source recognition test offers a promising method for investigating various well-known source memory phenomena more comprehensively.

Remembering the bad ones: Does the source memory advantage for cheaters influence our later actions positively?

Previous research has demonstrated that people remember information that is (emotionally) incongruent to their expectations, but it has left open the question if this memory enhancement has also an influence on our later actions. We investigated this question in one pilot study and two experiments. In all studies, participants first interacted with trustworthy and untrustworthy looking partners in an investment game. Facial trustworthiness was manipulated to stimulate social expectations about the behaviour of the partners. In a later second investment game, participants played against old opponents from the first game and new opponents. Overall, willingness to cooperate in the second game was influenced by the formerly behaviour of the opponent. However, facial trustworthiness affected economic decisions, too. Furthermore, we analysed source memory data that indicated no differences in memory between cheaters and cooperators. Instead, source guessing was related to cooperation: The more participants guessed that an untrustworthy looking face belonged to a cheater, the less they cooperated with untrustworthy looking opponents. Interestingly, in Experiment 2, we found a positive correlation between old-new recognition and later cooperation. In sum, the results demonstrate that memory and guessing processes can influence later decisions. However, economic decisions are also heavily affected by other social expectations like facial trustworthiness.

Meaningful faces: Self-relevance of semantic context in an initial social encounter improves later face recognition

Self-relevant stimuli (i.e. meaningful/important to the observer and related to the self) are typically remembered better than other-relevant stimuli. However, whether a self-relevance memory benefit could be conferred to a novel neutral face, remains to be seen. Recent studies have shown that emotional responses to neutral faces can be altered by using a preceding sentence as context that varies in terms of self-relevance (self/other-relevant) and valence (positive/negative; e.g. "S/he thinks your comment is dumb/smart"). We adapted this paradigm to investigate whether the context conferred by the preceding sentence also impacts memorability of the subsequently presented face. Participants saw faces primed with contextual sentences and rated how aroused, and how positive or negative, the faces made them feel. Later incidental recognition accuracy for the faces was greater when these had been preceded by self-relevant compared to other-relevant sentences. Faces preceded by self-relevant contexts were also rated as more arousing. There was no impact of sentence valence on arousal ratings or on recognition memory for faces. Sentence self-relevance and valence interacted to affect participants' ratings of how positive or negative the faces made them feel during encoding, but did not interact to impact later recognition. Our results indicate that initial social encounters can have a lasting effect on one's memory of another person, producing an enhanced memory trace of that individual. We propose that the effect is driven by an arousal-based mechanism, elicited by faces perceived to be self-relevant.

Smiling enemies: Young children better recall mean individuals who smile

Remembering whether a person is cooperative is essential in social interactions. It has been shown that adults have better memory of a person who showed an incongruence between emotional expression and expected behavior (e.g., smiling while stealing). To examine whether children would show similar emotional incongruity effects, we examined 70 children aged 5 or 6 years. They obtained coins that could be exchanged later for rewards (stickers) by answering quiz questions. Then, they participated in the coin collection game where individual persons with smiling or angry expressions appeared one at a time on a computer monitor. These same individuals then either gave coins to or took coins away from the children, leading to congruent (smiling giver and angry taker) and incongruent (smiling taker and angry giver) conditions. After the game, children needed to choose between two faces to indicate which one previously appeared in the game. Participants recognized faces better under the incongruent conditions. In particular, the smiling taker was recognized significantly better than the angry taker, whereas no difference was observed for the smiling and angry givers. Evidently, 5- and 6-year-olds better remember individuals whose facial expression or appearance is incongruent with their expected behavior.

Exogenous attention and memory for faces following contextual behavioral immune system activation

The behavioral immune system (BIS) is characterized by affective, cognitive and behavioral processes that work in an articulated manner to prevent the occurrence of infections. Attention and memory evolved to enhance the organism's chances of survival and have been proposed to play an important role in the BIS. The present study investigated the effects of attention and memory for neutral faces after a contextual activation of the BIS. Participants were primed, by the use of film clips, either with infectious disease concerns or non-infectious disease concerns. They performed an exogenous attentional task involving the discrimination of target letters, with face stimuli presented as distractors, which was then followed by a surprise recognition task for the faces. The results showed that participants in the infectious disease condition were more accurate in the attentional task than participants in the control condition. No significant difference between groups was found in the response times during the attention task nor in memory performance. Overall, these results suggest that the BIS might be associated with a hypervigilant state towards cues in general and that BIS activation through this type of priming may not be sufficient to clearly activate mnemonic mechanisms.

Goal-relevant situations facilitate memory of neutral faces

Emotional situations are typically better remembered than neutral situations, but the psychological conditions and brain mechanisms underlying this effect remain debated. Stimulus valence and affective arousal have been suggested to explain the major role of emotional stimuli in memory facilitation. However, neither valence nor arousal are sufficient affective dimensions to explain the effect of memory facilitation. Several studies showed that negative and positive details are better remembered than neutral details. However, other studies showed that neutral information encoded and coupled with arousal did not result in a memory advantage compared with neutral information not coupled with arousal. Therefore, we suggest that the fundamental affective dimension responsible for memory facilitation is goal relevance. To test this hypothesis at behavioral and neural levels, we conducted a functional magnetic resonance imaging study and used neutral faces embedded in goal-relevant or goal-irrelevant daily life situations. At the behavioral level, we found that neutral faces encountered in goal-relevant situations were better remembered than those encountered in goal-irrelevant situations. To explain this effect, we studied neural activations involved in goal-relevant processing at encoding and in subsequent neutral face recognition. At encoding, activation of emotional brain regions (anterior cingulate, ventral striatum, ventral tegmental area, and substantia nigra) was greater for processing of goal-relevant situations than for processing of goal-irrelevant situations. At the recognition phase, despite the presentation of neutral faces, brain activation involved in social processing (superior temporal sulcus) to successfully remember identities was greater for previously encountered faces in goal-relevant than in goal-irrelevant situations.

Separating conditional and unconditional cooperation in a sequential Prisoner's Dilemma game

Most theories of social exchange distinguish between two different types of cooperation, depending on whether or not cooperation occurs conditional upon the partner’s previous behaviors. Here, we used a multinomial processing tree model to distinguish between positive and negative reciprocity and cooperation bias in a sequential Prisoner’s Dilemma game. In Experiments 1 and 2, the facial expressions of the partners were varied to manipulate cooperation bias. In Experiment 3, an extinction instruction was used to manipulate reciprocity. The results confirm that people show a stronger cooperation bias when interacting with smiling compared to angry-looking partners, supporting the notion that a smiling facial expression in comparison to an angry facial expression helps to construe a situation as cooperative rather than competitive. Reciprocity was enhanced for appearance-incongruent behaviors, but only when participants were encouraged to form expectations about the partners’ future behaviors. Negative reciprocity was not stronger than positive reciprocity, regardless of whether expectations were manipulated or not. Experiment 3 suggests that people are able to ignore previous episodes of cheating as well as previous episodes of cooperation if these turn out to be irrelevant for predicting a partner’s future behavior. The results provide important insights into the mechanisms of social cooperation.

How Negative Social Bias Affects Memory for Faces: An Electrical Neuroimaging Study

During social interactions, we make inferences about people’s personal characteristics based on their appearance. These inferences form a potential prejudice that can positively or negatively bias our interaction with them. Not much is known about the effects of negative bias on face perception and the ability to recognize people faces. This ability was investigated by recording event-related potentials (ERPs) from 128 sites in 16 volunteers. In the first session (encoding), they viewed 200 faces associated with a short fictional story that described anecdotal positive or negative characteristics about each person. In the second session (recognition), they underwent an old/new memory test, in which they had to distinguish 100 new faces from the previously shown faces. ERP data relative to the encoding phase showed a larger anterior negativity in response to negatively (vs. positively) biased faces, indicating an additional processing of faces with unpleasant social traits. In the recognition task, ERPs recorded in response to new faces elicited a larger FN400 than to old faces, and to positive than negative faces. Additionally, old faces elicited a larger Old-New parietal response than new faces, in the form of an enlarged late positive (LPC) component. An inverse solution SwLORETA (450–550 ms) indicated that remembering old faces was associated with the activation of right superior frontal gyrus (SFG), left medial temporal gyrus, and right fusiform gyrus. Only negatively connoted faces strongly activated the limbic and parahippocampal areas and the left SFG. A dissociation was found between familiarity (modulated by negative bias) and recollection (distinguishing old from new faces).

The infamous among us: Enhanced reputational memory for uncooperative ingroup members

People remember uncooperative individuals better than cooperative ones. We hypothesize that this is particularly true when uncooperative individuals belong to one's ingroup, as their behavior violates positive expectations. Two studies examined the effect of minimal group categorization on reputational memory of the social behavior of particular ingroup and outgroup members. We manipulated uncooperative behavior as the unfair sharing of resources with ingroup members (Study 1), or as descriptions of cheating (Study 2). Participants evaluated several uncooperative and cooperative (and neutral) ingroup and outgroup members. In a surprise memory test, they had to recognize target faces and recall their behavior. We disentangled face recognition, reputational memory, and guessing biases with multinomial models of source monitoring. The results show enhanced reputational memory for uncooperative ingroup members, but not uncooperative outgroup members. In contrast, guessing behavior indicated that participants assumed more ingroup cooperation than outgroup cooperation. Our findings integrate prior research on memory for uncooperative person behavior and person memory in group contexts. We suggest that the ability to remember the uncooperative amidst the supposedly cooperative ingroup could stabilize intragroup cooperation.

The effect of background music on episodic memory and autonomic responses: listening to emotionally touching music enhances facial memory capacity

The aim of this study was to investigate how background auditory processing can affect other perceptual and cognitive processes as a function of stimulus content, style and emotional nature. Previous studies have offered contrasting evidence, and it has been recently shown that listening to music negatively affected concurrent mental processing in the elderly but not in young adults. To further investigate this matter, the effect of listening to music vs. listening to the sound of rain or silence was examined by administering an old/new face memory task (involving 448 unknown faces) to a group of 54 non-musician university students. Heart rate and diastolic and systolic blood pressure were measured during an explicit face study session that was followed by a memory test. The results indicated that more efficient and faster recall of faces occurred under conditions of silence or when participants were listening to emotionally touching music. Whereas auditory background (e.g., rain or joyful music) interfered with memory encoding, listening to emotionally touching music improved memory and significantly increased heart rate. It is hypothesized that touching music is able to modify the visual perception of faces by binding facial properties with auditory and emotionally charged information (music), which may therefore result in deeper memory encoding.

How Adaptive Is Memory for Cheaters?

Evolutionary psychology posits that the human mind comprises highly specialized cognitive modules, including a module that is thought to facilitate social cooperation by allowing for the detection of cheaters. Consistent with assumptions implied by models of reciprocal altruism, our research has revealed enhanced source memory for faces of cheaters (i.e., memory for the context in which the faces of cheaters were encountered). However, this finding should not be uncritically interpreted as evidence of a specialized cheater-detection mechanism. Here, we review evidence suggesting that human memory may be better characterized by more general mechanisms. A preference to attend to, and remember, threatening and unusual information may ensure that processing resources are focused on relevant information in a wide variety of situations, and may therefore constitute a more adaptive mechanism for remembering social information than focusing exclusively on cheating would.

A memory advantage for untrustworthy faces

Inferences of others' social traits from their faces can influence how we think and behave towards them, but little is known about how perceptions of people's traits may affect downstream cognitions, such as memory. Here we explored the relationship between targets' perceived social traits and how well they were remembered following a single brief perception, focusing primarily on inferences of trustworthiness. In Study 1, participants encoded high-consensus trustworthy and untrustworthy faces, showing significantly better memory for the latter group. Study 2 compared memory for faces rated high and low on a series of traits (dominance, facial maturity, likeability, and trustworthiness), and found that untrustworthy and unlikeable faces were remembered best, with no differences for the other traits. Finally, Study 3 compared information about trustworthiness from facial appearance and from behavioral descriptions. Untrustworthy targets were remembered better than trustworthy targets both from behavior and faces, though the effects were significantly stronger for the latter. Faces perceived as untrustworthy therefore appear to be remembered better than faces perceived as trustworthy. Consistent with ecological theories of perception, cues to trustworthiness from facial appearance may thus guide who is remembered and who is forgotten at first impression.