Using facial emotional stimuli in visual search experiments: The arousal factor explains contradictory results

Context matters: task relevance shapes neural responses to emotional facial expressions

Recent research shows that emotional facial expressions impact behavioral responses only when their valence is relevant to the task. Under such conditions, threatening faces delay attentional disengagement, resulting in slower reaction times and increased omission errors compared to happy faces. To investigate the neural underpinnings of this phenomenon, we used functional magnetic resonance imaging to record the brain activity of 23 healthy participants while they completed two versions of the go/no-go task. In the emotion task (ET), participants responded to emotional expressions (fearful or happy faces) and refrained from responding to neutral faces. In the gender task (GT), the same images were displayed, but participants had to respond based on the posers' gender. Our results confirmed previous behavioral findings and revealed a network of brain regions (including the angular gyrus, the ventral precuneus, the left posterior cingulate cortex, the right anterior superior frontal gyrus, and two face-responsive regions) displaying distinct activation patterns for the same facial emotional expressions in the ET compared to the GT. We propose that this network integrates internal representations of task rules with sensory characteristics of facial expressions to evaluate emotional stimuli and exert top-down control, guiding goal-directed actions according to the context.

Investigating the impact of surgical masks on behavioral reactions to facial emotions in the COVID-19 era

Introduction

The widespread use of surgical masks during the COVID-19 pandemic has posed challenges in interpreting facial emotions. As the mouth is known to play a crucial role in decoding emotional expressions, its covering is likely to affect this process. Recent evidence suggests that facial expressions impact behavioral responses only when their emotional content is relevant to subjects' goals. Thus, this study investigates whether and how masked emotional faces alter such a phenomenon.

Methods

Forty participants completed two reaching versions of the Go/No-go task in a counterbalanced fashion. In the Emotional Discrimination Task (EDT), participants were required to respond to angry, fearful, or happy expressions by performing a reaching movement and withholding it when a neutral face was presented. In the Gender Discrimination Task (GDT), the same images were shown, but participants had to respond according to the poser's gender. The face stimuli were presented in two conditions: covered by a surgical mask (masked) or without any covering (unmasked).

Results

Consistent with previous studies, valence influenced behavioral control in the EDT but not in the GDT. Nevertheless, responses to facial emotions in the EDT exhibited significant differences between unmasked and masked conditions. In the former, angry expressions led to a slowdown in participants' responses. Conversely, in the masked condition, behavioral reactions were impacted by fearful and, to a greater extent, by happy expressions. Responses to fearful faces were slower, and those to happy faces exhibited increased variability in the masked condition compared to the unmasked condition. Furthermore, response accuracy to masked happy faces dramatically declined compared to the unmasked condition and other masked emotions.

Discussion

In sum, our findings indicate that surgical masks disrupt reactions to emotional expressions, leading people to react less accurately and with heightened variability to happy expressions, provided that the emotional dimension is relevant to people's goals.

The effect of emotional arousal on visual attentional performance: a systematic review

Although the arousal elicited by emotional stimuli, similarly to valence, is an integrative part of emotion theories, previous studies and reviews mostly focused on the valence of a stimulus and rarely investigated the role of arousal. Here, I systematically searched for articles that used visual attentional paradigms, manipulated emotional arousal by auditory or visual, task-relevant or task-irrelevant stimuli, measured behavioral responses, ocular behavior, or neural correlates. I found that task-relevant arousing stimuli draw and hold attention regardless of the modality. In contrast, task-irrelevant arousing stimuli impaired task performance. However, when the emotional content precedes the task or it is presented for a longer duration, arousal increased performance. Future directions on how research could address the remaining questions are discussed.

The angry versus happy recognition advantage: the role of emotional and physical properties

Facial emotional expressions are pivotal for social communication. Their fast and accurate recognition is crucial to promote adaptive responses to social demands, for the development of functional relationships, and for well-being. However, the literature has been inconsistent in showing differentiated recognition patterns for positive vs. negative facial expressions (e.g., happy and angry expressions, respectively), likely due to affective and perceptual factors. Accordingly, the present study explored differences in recognition performance between angry and happy faces, while specifically assessing the role of emotional intensity and global/regional low-level visual features. 98 participants categorized angry and happy faces morphed between neutral and emotional across 9 levels of expression intensity (10-90%). We observed a significantly higher recognition efficiency (higher accuracy and shorter response latencies) for angry compared to happy faces in lower levels of expression intensity, suggesting that our cognitive resources are biased to prioritize the recognition of potentially harmful stimuli, especially when briefly presented at an ambiguous stage of expression. Conversely, an advantage for happy faces was observed from the midpoint of expression intensity, regarding response speed. However, when compensating for the contribution of regional low-level properties of distinct facial key regions, the effect of emotion was maintained only for response accuracy. Altogether, these results shed new light on the processing of facial emotional stimuli, emphasizing the need to consider emotional intensity and regional low-level image properties in emotion recognition analysis.

Emotional Recognition Training Enhances Attention to Emotional Stimuli Among Male Juvenile Delinquents

Objective

Juvenile delinquents have deficits in emotional recognition that might play a critical role in the development of aggression. The present study aimed to investigate the effect of emotional recognition training and its consequences on emotional attention and aggression.

Methods

Seventy-three male juvenile delinquents were randomly assigned to two groups. One group was the modification group, which received eight days of training on an emotional recognition task. The purpose of the training was to modify interpretative biases in emotion recognition to encourage the perception of happiness over anger in ambiguous expressions. The other group was the waitlist group, which did not perform a task and continued with their usual programme. Before and after the training, participants completed the aggression questionnaire (AQ) and two behavioural tasks, including the emotional recognition task and a visual search task with happy and angry faces as targets.

Results

The modification group recognized more faces as happy after emotional recognition training than the waitlist group. Furthermore, the hostility in the modification group decreased significantly. Importantly, emotional recognition training further affected attention to emotional faces as participants responded faster in searching for happy and angry faces after training.

Conclusion

Emotional recognition training could modify juvenile delinquents' emotional recognition, enhance their visual attention to emotional faces and reduce hostility.

Positive and negative facial valence perception are modulated differently by eccentricity in the parafovea

Understanding whether people around us are in a good, bad or neutral mood can be critical to our behavior, both when looking directly at them or when they are in our peripheral visual field. However, facial expressions of emotions are often investigated at central visual field or at locations right or left of fixation. Here we assumed that perception of facial emotional valence (the emotion's pleasantness) changes with distance from central visual field (eccentricity) and that different emotions may be influenced differently by eccentricity. Participants (n = 58) judged the valence of emotional faces across the parafovea (≤ 4°, positive (happy), negative (fearful), or neutral)) while their eyes were being tracked. As expected, performance decreased with eccentricity. Positive valence perception was least affected by eccentricity (accuracy reduction of 10-19% at 4°) and negative the most (accuracy reduction of 35-38% at 4°), and this was not a result of speed-accuracy trade-off or response biases. Within-valence (but not across-valence) performance was associated across eccentricities suggesting perception of different valences is supported by different mechanisms. While our results may not generalize to all positive and negative emotions, they indicate that beyond-foveal investigations can reveal additional characteristics of the mechanisms that underlie facial expression processing and perception.

Social cognition training improves recognition of distinct facial emotions and decreases misattribution errors in healthy individuals

Facial emotion recognition is a key component of social cognition. Impaired facial emotion recognition is tied to poor psychological wellbeing and deficient social functioning. While previous research has demonstrated the potential for social cognition training to improve overall facial emotion recognition, questions remain regarding what aspects of emotion recognition improve. We report results from a randomized controlled trial that evaluates whether computerized social cognition training can improve recognition of distinct facial emotions in healthy participants. This investigation was designed to better understand the therapeutic potential of social cognition training for individuals with neuropsychiatric disorders. Fifty-five healthy adult participants were randomly assigned to an internet-based intervention during which they either completed social cognition training (SCT) or played control computer games (CON) for 10.5 h over 2-3 weeks. Facial emotion recognition was measured with the Penn ER-40, which was conducted before and after training. The following variables were collected and analyzed: facial emotion recognition accuracy for each emotion (i.e., anger, fear, happy, neutral (no emotional expression), and sad), reaction times for each emotion, and response error types (i.e., frequency of an emotion being chosen incorrectly, frequency of an emotion being missed, and frequency of an emotion being confused for another particular emotion). ANOVAs and t-tests were used to elucidate intervention effects both within and between groups. Results showed that the SCT group improved their accuracy for angry and neutral faces. They also improved their reaction times for neutral, fearful, and sad faces. Compared to the CON group, the SCT group had significantly faster reaction times to neutral faces after training. Lastly, the SCT group decreased their tendency to confuse angry faces for no emotional expression and to confuse no emotional expression for sad faces. In contrast, the CON group did not significantly improve their accuracy or reaction times on any emotional expression, and they did not improve their response error types. We conclude that social cognition training can improve recognition of distinct emotions in healthy participants and decrease response error patterns, suggesting it has the potential to improve impaired emotion recognition and social functioning in individuals with facial emotion recognition deficits.

Emotional body postures affect inhibitory control only when task-relevant

A classical theoretical frame to interpret motor reactions to emotional stimuli is that such stimuli, particularly those threat-related, are processed preferentially, i.e., they are capable of capturing and grabbing attention automatically. Research has recently challenged this view, showing that the task relevance of emotional stimuli is crucial to having a reliable behavioral effect. Such evidence indicated that emotional facial expressions do not automatically influence motor responses in healthy young adults, but they do so only when intrinsically pertinent to the ongoing subject's goals. Given the theoretical relevance of these findings, it is essential to assess their generalizability to different, socially relevant emotional stimuli such as emotional body postures. To address this issue, we compared the performance of 36 right-handed participants in two different versions of a Go/No-go task. In the Emotional Discrimination task, participants were required to withhold their responses at the display of emotional body postures (fearful or happy) and to move at the presentation of neutral postures. Differently, in the control task, the same images were shown, but participants had to respond according to the color of the actor/actress' t-shirt, disregarding the emotional content. Results showed that participants made more commission errors (instances in which they moved even though the No-go signal was presented) for happy than fearful body postures in the Emotional Discrimination task. However, this difference disappeared in the control task. Such evidence indicates that, like facial emotion, emotional body expressions do not influence motor control automatically, but only when they are task-relevant.

Eye movements reveal the contributions of early and late processes of enhancement and suppression to the guidance of visual search

In visual search attention can be directed towards items matching top-down goals, but this must compete with factors such as salience that can capture attention. However, under some circumstances it appears that attention can avoid known distractor features. Chang and Egeth (Psychological Science, 30 (12), 1724–1732, 2019) found that such inhibitory effects reflect a combination of distractor-feature suppression and target-feature enhancement. In the present study (N = 48), we extend these findings by revealing that suppression and enhancement effects guide overt attention. On search trials (75% of trials) participants searched for a diamond shape among several other shapes. On half of the search trials all objects were the same colour (e.g., green) and on the other half of the search trials one of the non-target shapes appeared in a different colour (e.g., red). On interleaved probe trials (25% of trials), subjects were presented with four ovals. One of the ovals was in either the colour of the target or the colour of the distractor from the search trials. The other three ovals were on neutral colours. Critically, we found that attention was overtly captured by target colours and avoided distractor colours when they were viewed in a background of neutral colours. In addition, we provided a time course of attentional control. Within visual search tasks we observed inhibition aiding early attentional effects, indexed by the time it took gaze to first reach the target, as well as later decision-making processes indexed by the time for a decision to be made once the target as found.

Individual differences in pupil dilation to others' emotional and neutral eyes with varying pupil sizes

Sensitivity to others' emotional signals is an important factor for social interaction. While many studies of emotional reactivity focus on facial emotional expressions, signals such as pupil dilation which can indicate arousal, may also affect observers. For example, observers' pupils dilate when viewing someone with dilated pupils, so-called pupillary contagion. Yet it is unclear how pupil size and emotional expression interact as signals. Further, examining individual differences in emotional reactivity to others can shed light on its mechanisms and potential outcomes. In the current study, adults' (N = 453) pupil size was assessed while they viewed images of the eye region of individuals varying in emotional expression (neutral, happy, sad, fearful, angry) and pupil size (large, medium, small). Participants showed pupillary contagion regardless of the emotional expression. Individual differences in demographics (gender, age, socioeconomic status) and psychosocial factors (anxiety, depression, sleep problems) were also examined, yet the only factor related to pupillary contagion was socioeconomic status, with higher socioeconomic status predicting less pupillary contagion for emotionally-neutral stimuli. The results suggest that while pupillary contagion is a robust phenomenon, it can vary meaningfully across individuals.

Negative and Positive Bias for Emotional Faces: Evidence from the Attention and Working Memory Paradigms

Visual attention and visual working memory (VWM) are two major cognitive functions in humans, and they have much in common. A growing body of research has investigated the effect of emotional information on visual attention and VWM. Interestingly, contradictory findings have supported both a negative bias and a positive bias toward emotional faces (e.g., angry faces or happy faces) in the attention and VWM fields. We found that the classical paradigms-that is, the visual search paradigm in attention and the change detection paradigm in VWM-are considerably similar. The settings of these paradigms could therefore be responsible for the contradictory results. In this paper, we compare previous controversial results from behavioral and neuroscience studies using these two paradigms. We suggest three possible contributing factors that have significant impacts on the contradictory conclusions regarding different emotional bias effects; these factors are stimulus choice, experimental setting, and cognitive process. We also propose new research directions and guidelines for future studies.

Subjectively different emotional schematic faces not automatically discriminated from the brain's bioelectrical responses

The present study investigates how the brain automatically discriminates emotional schematic faces, as indicated by the mismatch responses, and how reliable these brain responses are. Thirty-three healthy volunteers participated in the vMMN EEG experiment with four experimental sets differing from each other by the type of standard (object with scrambled face features) and the type of deviants (Angry, Happy and Neutral schematic faces) presented. Conscious subjective evaluations of valence, arousal and attention catching of the same stimuli showed clear differentiation of emotional expressions. Deviant faces elicited rather similar vMMN at frontal and occipital sites. Bayesian analyses suggest that vMMN does not differ between angry and happy faces. Neutral faces, however, did not yield statistically significant vMMN at occipital leads. Pearson's correlation and intra-class correlation analyses showed that the brain's reactions to the stimuli were highly stable within individuals across the experimental sets, whereas the mismatch responses were much more variable.

Threatening Facial Expressions Impact Goal-Directed Actions Only if Task-Relevant

Facial emotional expressions are a salient source of information for nonverbal social interactions. However, their impact on action planning and execution is highly controversial. In this vein, the effect of the two threatening facial expressions, i.e., angry and fearful faces, is still unclear. Frequently, fear and anger are used interchangeably as negative emotions. However, they convey different social signals. Unlike fear, anger indicates a direct threat toward the observer. To provide new evidence on this issue, we exploited a novel design based on two versions of a Go/No-go task. In the emotional version, healthy participants had to perform the same movement for pictures of fearful, angry, or happy faces and withhold it when neutral expressions were presented. The same pictures were shown in the control version, but participants had to move or suppress the movement, according to the actor’s gender. This experimental design allows us to test task relevance’s impact on emotional stimuli without conflating movement planning with target detection and task switching. We found that the emotional content of faces interferes with actions only when task-relevant, i.e., the effect of emotions is context-dependent. We also showed that angry faces qualitatively had the same effect as fearful faces, i.e., both negative emotions decreased response readiness with respect to happy expressions. However, anger has a much greater impact than fear, as it increases both the rates of mistakes and the time of movement execution. We interpreted these results, suggesting that participants have to exploit more cognitive resources to appraise threatening than positive facial expressions, and angry than fearful faces before acting.

More than meets the heart: systolic amplification of different emotional faces is task dependent

Interoceptive processes emanating from baroreceptor signals support emotional functioning. Previous research suggests a unique link to fear: fearful faces, presented in synchrony with systolic baroreceptor firing draw more attention and are rated as more intense than those presented at diastole. This study examines whether this effect is unique to fearful faces or can be observed in other emotional faces. Participants (n = 71) completed an emotional visual search task (VST) in which fearful, happy, disgust and sad faces were presented during systolic and diastolic phases of the cardiac cycle. Visual search accuracy and emotion detection accuracy and latency were recorded, followed by a subjective intensity task. A series of interactions between emotion and cardiac phase were observed. Visual search accuracy for happy and disgust faces was greater at systole than diastole; the opposite was found for fearful faces. Fearful and happy faces were perceived as more intense at systole. Previous research proposed that cardiac signalling has specific effects on the attention and intensity ratings for fearful faces. Results from the present tasks suggest these effects are more generalised and raise the possibility that interoceptive signals amplify emotional superiority effects dependent on the task employed.

Transcranial magnetic stimulation demonstrates a role for the ventrolateral prefrontal cortex in emotion perception

The lateral prefrontal cortex, a region with both structural and functional connectivity to the amygdala, has been consistently implicated in the downregulation of subcortical-generated emotional responses. Although previous work has demonstrated that the ventral lateral prefrontal cortex (vlPFC) is important to emotion processing, no study has interrupted vlPFC function in order to test is role in emotion perception. In the current study, we acutely disrupted vlPFC function in twenty healthy adult participants by administering sham stimulation and transcranial magnetic stimulation (TMS), in randomized order, during performance of an emotional perception task. During sham stimulation, participants demonstrated increased perceptual sensitivity for happy faces compared to angry faces. Disruption of the vlPFC eliminated this difference: in this condition, perceptual sensitivity did not differ between happy and angry faces. Reaction times and response bias did not differ between emotions or TMS conditions. This pattern of perceptual bias is consistent with effects observed in a wide range of affective disorders, in which vlPFC dysfunction has also been reported. This study provides insight into a possible mechanism through which the vlPFC may contribute to emotion perception.

Social anxiety changes the way we move-A social approach-avoidance task in a virtual reality CAVE system

Investigating approach-avoidance behavior regarding affective stimuli is important in broadening the understanding of one of the most common psychiatric disorders, social anxiety disorder. Many studies in this field rely on approach-avoidance tasks, which mainly assess hand movements, or interpersonal distance measures, which return inconsistent results and lack ecological validity. Therefore, the present study introduces a virtual reality task, looking at avoidance parameters (movement time and speed, distance to social stimulus, gaze behavior) during whole-body movements. These complex movements represent the most ecologically valid form of approach and avoidance behavior. These are at the core of complex and natural social behavior. With this newly developed task, the present study examined whether high socially anxious individuals differ in avoidance behavior when bypassing another person, here virtual humans with neutral and angry facial expressions. Results showed that virtual bystanders displaying angry facial expressions were generally avoided by all participants. In addition, high socially anxious participants generally displayed enhanced avoidance behavior towards virtual people, but no specifically exaggerated avoidance behavior towards virtual people with a negative facial expression. The newly developed virtual reality task proved to be an ecological valid tool for research on complex approach-avoidance behavior in social situations. The first results revealed that whole body approach-avoidance behavior relative to passive bystanders is modulated by their emotional facial expressions and that social anxiety generally amplifies such avoidance.

Autism Pathogenesis: The Superior Colliculus

After been exposed to the visual input, in the first year of life, the brain experiences subtle but massive changes apparently crucial for communicative/emotional and social human development. Its lack could be the explanation of the very high prevalence of autism in children with total congenital blindness. The present theory postulates that the superior colliculus is the key structure for such changes for several reasons: it dominates visual behavior during the first months of life; it is ready at birth for complex visual tasks; it has a significant influence on several hemispheric regions; it is the main brain hub that permanently integrates visual and non-visual, external and internal information (bottom-up and top-down respectively); and it owns the enigmatic ability to take non-conscious decisions about where to focus attention. It is also a sentinel that triggers the subcortical mechanisms which drive social motivation to follow faces from birth and to react automatically to emotional stimuli. Through indirect connections it also activates simultaneously several cortical structures necessary to develop social cognition and to accomplish the multiattentional task required for conscious social interaction in real life settings. Genetic or non-genetic prenatal or early postnatal factors could disrupt the SC functions resulting in autism. The timing of postnatal biological disruption matches the timing of clinical autism manifestations. Astonishing coincidences between etiologies, clinical manifestations, cognitive and pathogenic autism theories on one side and SC functions on the other are disclosed in this review. Although the visual system dependent of the SC is usually considered as accessory of the LGN canonical pathway, its imprinting gives the brain a qualitatively specific functions not supplied by any other brain structure.

Cross-cultural emotion recognition and evaluation of Radboud faces database with an Indian sample

Emotional databases are important tools to study emotion recognition and their effects on various cognitive processes. Since, well-standardized large-scale emotional expression database is not available in India, we evaluated Radboud faces database (RaFD)—a freely available database of emotional facial expressions of adult Caucasian models, for Indian sample. Using the pictures from RaFD, we investigated the similarity and differences in self-reported ratings on emotion recognition accuracy as well as parameters of valence, clarity, genuineness, intensity and arousal of emotional expression, by following the same rating procedure as used for the validation of RaFD. We also systematically evaluated the universality hypothesis of emotion perception by analyzing differences in accuracy and ratings for different emotional parameters across Indian and Dutch participants. As the original Radboud database lacked arousal rating, we added this as a emotional parameter along with all other parameters. The results show that the overall accuracy of emotional expression recognition by Indian participants was high and very similar to the ratings from Dutch participants. However, there were significant cross-cultural differences in classification of emotion categories and their corresponding parameters. Indians rated certain expressions comparatively more genuine, higher in valence, and less intense in comparison to original Radboud ratings. The misclassifications/ confusion for specific emotional categories differed across the two cultures indicating subtle but significant differences between the cultures. In addition to understanding the nature of facial emotion recognition, this study also evaluates and enables the use of RaFD within Indian population.

Affect-Driven Attention Biases as Animal Welfare Indicators: Review and Methods

Attention bias describes the differential allocation of attention towards one stimulus compared to others. In humans, this bias can be mediated by the observer's affective state and is implicated in the onset and maintenance of affective disorders such as anxiety. Affect-driven attention biases (ADABs) have also been identified in a few other species. Here, we review the literature on ADABs in animals and discuss their utility as welfare indicators. Despite a limited research effort, several studies have found that negative affective states modulate attention to negative (i.e., threatening) cues. ADABs influenced by positive-valence states have also been documented in animals. We discuss methods for measuring ADAB and conclude that looking time, dot-probe, and emotional spatial cueing paradigms are particularly promising. Research is needed to test them with a wider range of species, investigate attentional scope as an indicator of affect, and explore the possible causative role of attention biases in determining animal wellbeing. Finally, we argue that ADABs might not be best-utilized as indicators of general valence, but instead to reveal specific emotions, motivations, aversions, and preferences. Paying attention to the human literature could facilitate these advances.

Count on arousal: introducing a new method for investigating the effects of emotional valence and arousal on visual search performance

There is a large body of research, indicating that threatening stimuli with evolutionary history are prioritised in visual processing. It has been proposed that all threatening stimuli are prioritised, irrespective of evolutionary age, but it was argued that the method used to produce the results was not suitable for investigating the phenomenon. We present a new visual search task and provide evidence that it is an appropriate tool for future research. In Experiment 1, we investigated how the influence of emotional stimuli on visual search performance varies with valence (negative, positive, and neutral) and arousal (medium and high). Negative valence found to have a greater impact. Furthermore, our results underscore the importance of controlling for arousal. Experiment 2 confirmed these findings and also revealed that negative valence decreases performance by diverting attention away from the task, but arousal can compensate for this by increasing attentional capacity. This mechanism does not seem to be affected by the evolutionary history of the stimulus. In Experiment 3, we reproduced these results using a touchscreen monitor and controlling for variance in low-level visual features. We claim that these results support the notion of preferential processing of threatening cues, regardless of evolutionary origin. However, the level of threat, i.e., how arousing the cue is, has to be taken into account to explain the findings.

Sex differences in social cognition: The case of face processing

Several studies have demonstrated that women show a greater interest for social information and empathic attitude than men. This article reviews studies on sex differences in the brain, with particular reference to how males and females process faces and facial expressions, social interactions, pain of others, infant faces, faces in things (pareidolia phenomenon), opposite-sex faces, humans vs. landscapes, incongruent behavior, motor actions, biological motion, erotic pictures, and emotional information. Sex differences in oxytocin-based attachment response and emotional memory are also mentioned. In addition, we investigated how 400 different human faces were evaluated for arousal and valence dimensions by a group of healthy male and female University students. Stimuli were carefully balanced for sensory and perceptual characteristics, age, facial expression, and sex. As a whole, women judged all human faces as more positive and more arousing than men. Furthermore, they showed a preference for the faces of children and the elderly in the arousal evaluation. Regardless of face aesthetics, age, or facial expression, women rated human faces higher than men. The preference for opposite- vs. same-sex faces strongly interacted with facial age. Overall, both women and men exhibited differences in facial processing that could be interpreted in the light of evolutionary psychobiology. © 2016 Wiley Periodicals, Inc.

Emotion Induced Blindness Is More Sensitive to Changes in Arousal As Compared to Valence of the Emotional Distractor

Emotion Induced Blindness (EIB) refers to the impairment in the identification of a neutral target image that follows a threatening or fearful distractor image. It has been suggested that valence plays a significant role in driving the perceptual impairment in EIB. Recent findings from the literature suggest that arousal has a very important role in biasing early cognitive functions. Hence, in the present study, we systematically investigate the role of valence (Experiment 1) and arousal (Experiment 2) in determining the impairment in EIB. The results suggest that when valence is controlled for, the stimuli with higher arousal level lead to greater impairment in target detection. Moreover, under high arousal condition, both positive and negative stimuli lead to significantly greater impairment in target detection. Present study suggests that impairment in EIB is sensitive to the arousal component of the emotional image as compared to valence. The arousal biased competition account that explains the effect of arousal on cognitive processing can sufficiently explains the current results.

The Sustained Influence of an Error on Future Decision-Making

Post-error slowing (PES) is consistently observed in decision-making tasks after negative feedback. Yet, findings are inconclusive as to whether PES supports performance accuracy. We addressed the role of PES by employing drift diffusion modeling which enabled us to investigate latent processes of reaction times and accuracy on a large-scale dataset (>5,800 participants) of a visual search experiment with emotional face stimuli. In our experiment, post-error trials were characterized by both adaptive and non-adaptive decision processes. An adaptive increase in participants' response threshold was sustained over several trials post-error. Contrarily, an initial decrease in evidence accumulation rate, followed by an increase on the subsequent trials, indicates a momentary distraction of task-relevant attention and resulted in an initial accuracy drop. Higher values of decision threshold and evidence accumulation on the post-error trial were associated with higher accuracy on subsequent trials which further gives credence to these parameters' role in post-error adaptation. Finally, the evidence accumulation rate post-error decreased when the error trial presented angry faces, a finding suggesting that the post-error decision can be influenced by the error context. In conclusion, we demonstrate that error-related response adaptations are multi-component processes that change dynamically over several trials post-error.

The structural and functional correlates of the efficiency in fearful face detection

Human visual system is found to be much efficient in searching for a fearful face. Some individuals are more sensitive to this threat-related stimulus. However, we still know little about the neural correlates of such variability. In the current study, we exploited a visual search paradigm, and asked the subjects to search for a fearful face or a target gender. Every subject showed a shallower search function for fearful face search than face gender search, indicating a stable fearful face advantage. We then used voxel-based morphometry (VBM) analysis and correlated this advantage to the gray matter volume (GMV) of some presumably face related cortical areas. The result revealed that only the left fusiform gyrus showed a significant positive correlation. Next, we defined the left fusiform gyrus as the seed region and calculated its resting state functional connectivity to the whole brain. Correlations were also calculated between fearful face advantage and these connectivities. In this analysis, we found positive correlations in the inferior parietal lobe and the ventral medial prefrontal cortex. These results suggested that the anatomical structure of the left fusiform gyrus might determine the search efficiency of fearful face, and frontoparietal attention network involved in this process through top-down attentional modulation.

Fast Detector/First Responder: Interactions between the Superior Colliculus-Pulvinar Pathway and Stimuli Relevant to Primates

Primates are distinguished from other mammals by their heavy reliance on the visual sense, which occurred as a result of natural selection continually favoring those individuals whose visual systems were more responsive to challenges in the natural world. Here we describe two independent but also interrelated visual systems, one cortical and the other subcortical, both of which have been modified and expanded in primates for different functions. Available evidence suggests that while the cortical visual system mainly functions to give primates the ability to assess and adjust to fluid social and ecological environments, the subcortical visual system appears to function as a rapid detector and first responder when time is of the essence, i.e., when survival requires very quick action. We focus here on the subcortical visual system with a review of behavioral and neurophysiological evidence that demonstrates its sensitivity to particular, often emotionally charged, ecological and social stimuli, i.e., snakes and fearful and aggressive facial expressions in conspecifics. We also review the literature on subcortical involvement during another, less emotional, situation that requires rapid detection and response-visually guided reaching and grasping during locomotion-to further emphasize our argument that the subcortical visual system evolved as a rapid detector/first responder, a function that remains in place today. Finally, we argue that investigating deficits in this subcortical system may provide greater understanding of Parkinson's disease and Autism Spectrum disorders (ASD).

Reacting to Emotion: Anger Arrests and Happiness Helps

Using a new method of affect priming, we find that a face with an angry expression slows a participant's performance; that is, we find anger inferiority. Our task presents a participant with a sequence of 2 visual stimuli. The first stimulus (Sl) and the second stimulus (S2) represent anger or happiness. The S1 s were words, schematic faces, or gray-scale faces, and the S2s were gray-scale faces. Participants performed an affect congruency task, judging whether S1 and S2 represent the same emotion. With standard affective priming, using identical stimulus param- eters, superior performance is found when S1 and S2 represent the same affect. With our task, comparing the 2 stimuli results in anger inferiority. With both congruent and incongruent S1 and S2 the response times depend more strongly on the affect of S1 rather than that of S2. An angry S1 produced longer decision times and more errors than a happy S1.

From specificity to sensitivity: affective states modulate visual working memory for emotional expressive faces

Previous findings suggest that visual working memory (VWM) preferentially remembers angry looking faces. However, the meaning of facial actions is construed in relation to context. To date, there are no studies investigating the role of perceiver-based context when processing emotional cues in VWM. To explore the influence of affective context on VWM for faces, we conducted two experiments using both a VWM task for emotionally expressive faces and a mood induction procedure. Affective context was manipulated by unpleasant (Experiment 1) and pleasant (Experiment 2) IAPS pictures in order to induce an affect high in motivational intensity (defensive or appetitive, respectively) compared to a low arousal control condition. Results indicated specifically increased sensitivity of VWM for angry looking faces in the neutral condition. Enhanced VWM for angry faces was prevented by inducing affects of high motivational intensity. In both experiments, affective states led to a switch from specific enhancement of angry expressions in VWM to an equally sensitive representation of all emotional expressions. Our findings demonstrate that emotional expressions are of different behavioral relevance for the receiver depending on the affective context, supporting a functional organization of VWM along with flexible resource allocation. In VWM, stimulus processing adjusts to situational requirements and transitions from a specifically prioritizing default mode in predictable environments to a sensitive, hypervigilant mode in exposure to emotional events.

Appraising the role of visual threat in speeded detection and classification tasks

This research examines the speeded detection and, separately, classification of photographic images of animals. In the initial experiments each display contained various images of animals and, in the detection task, participants responded whether a display contained only images of birds or also included an oddball target image of a cat or dog. In the classification search task, a target was always present and participants classified this as an image of a cat or a dog. Half of the target images depicted the animal in a non-threatening state and the remaining half images depicted the animal in a threatening state. A complex pattern of effects emerged showing some evidence of more efficient detection of a threatening than non-threatening target. No corresponding pattern emerged in the data for the classification task. Next the tasks were repeated when the stimuli were more carefully matched in terms of general pose and salience of facial features. Now the effects in the detection task were reduced but more consistent than before. Threatening targets were more readily detected than non-threatening targets. In addition, non-threatening targets were more readily classified than threatening targets. The nature of these effects appears to reflect decisional/response mechanisms and not search processes. The performance benefit for the non-threatening images was replicated in a final classification task in which, on each trial, only a single peripheral image was presented. The results demonstrate that a number of different affective and perceptual factors can influence performance in speeded search tasks and these may well be confounded with the variation in threat content of the experimental stimuli. The evidence for the automatic detection of visual threat remains illusive.

Visual search for emotional expressions: Effect of stimulus set on anger and happiness superiority

Prior reports of preferential detection of emotional expressions in visual search have yielded inconsistent results, even for face stimuli that avoid obvious expression-related perceptual confounds. The current study investigated inconsistent reports of anger and happiness superiority effects using face stimuli drawn from the same database. Experiment 1 excluded procedural differences as a potential factor, replicating a happiness superiority effect in a procedure that previously yielded an anger superiority effect. Experiments 2a and 2b confirmed that image colour or poser gender did not account for prior inconsistent findings. Experiments 3a and 3b identified stimulus set as the critical variable, revealing happiness or anger superiority effects for two partially overlapping sets of face stimuli. The current results highlight the critical role of stimulus selection for the observation of happiness or anger superiority effects in visual search even for face stimuli that avoid obvious expression related perceptual confounds and are drawn from a single database.

Finding an emotional face in a crowd: emotional and perceptual stimulus factors influence visual search efficiency

In this article, we examine how emotional and perceptual stimulus factors influence visual search efficiency. In an initial task, we run a visual search task, using a large number of target/distractor emotion combinations. In two subsequent tasks, we then assess measures of perceptual (rated and computational distances) and emotional (rated valence, arousal and potency) stimulus properties. In a series of regression analyses, we then explore the degree to which target salience (the size of target/distractor dissimilarities) on these emotional and perceptual measures predict the outcome on search efficiency measures (response times and accuracy) from the visual search task. The results show that both emotional and perceptual stimulus salience contribute to visual search efficiency. The results show that among the emotional measures, salience on arousal measures was more influential than valence salience. The importance of the arousal factor may be a contributing factor to contradictory history of results within this field.

Adult age-differences in subjective impression of emotional faces are reflected in emotion-related attention and memory tasks

Although younger and older adults appear to attend to and remember emotional faces differently, less is known about age-related differences in the subjective emotional impression (arousal, potency, and valence) of emotional faces and how these differences, in turn, are reflected in age differences in various emotional tasks. In the current study, we used the same facial emotional stimuli (angry and happy faces) in four tasks: emotional rating, attention, categorical perception, and visual short-term memory (VSTM). The aim of this study was to investigate effects of age on the subjective emotional impression of angry and happy faces and to examine whether any age differences were mirrored in measures of emotional behavior (attention, categorical perception, and memory). In addition, regression analyses were used to further study impression-behavior associations. Forty younger adults (range 20-30 years) and thirty-nine older adults (range 65-75 years) participated in the experiment. The emotional rating task showed that older adults perceived less arousal, potency, and valence than younger adults and that the difference was more pronounced for angry than happy faces. Similarly, the results of the attention and memory tasks demonstrated interaction effects between emotion and age, and age differences on these measures were larger for angry than for happy faces. Regression analyses confirmed that in both age groups, higher potency ratings predicted both visual search and VSTM efficiency. Future studies should consider the possibility that age differences in the subjective emotional impression of facial emotional stimuli may explain age differences in attention to and memory of such stimuli.

Eye tracking the face in the crowd task: why are angry faces found more quickly?

Among a crowd of distractor faces, threatening or angry target faces are identified more quickly and accurately than are nonthreatening or happy target faces, a finding known as the “face in the crowd effect.” Two perceptual explanations of the effect have been proposed: (1) the “target orienting” hypothesis (i.e., threatening targets orient attention more quickly than do nonthreatening targets and (2) the “distractor processing” hypothesis (i.e., nonthreatening distractors paired with a threatening target are processed more efficiently than vice versa, leading to quicker detection of threatening targets). Using a task, with real faces and multiple identities, the current study replicated the face in the crowd effect and then, via eye tracking, found greater support for the target orienting hypothesis. Across both the classical search asymmetry paradigm (i.e., one happy target in a crowd of angry distractors vs. one angry target in a crowd of happy distractors) and the constant distractor paradigm (i.e., one happy target in a crowd of neutral distractors vs. one angry target in a crowd of neutral distractors), fewer distractors were fixated before first fixating angry targets relative to happy targets, with no difference in the processing efficiency of distractors. These results suggest that the face in the crowd effect on this task is supported to a greater degree by attentional patterns associated with properties of target rather those of the crowd.