Enhanced attention amplifies face adaptation

Altered mechanisms of adaptation in social anxiety: differences in adapting to positive versus negative emotional faces

Social anxiety is characterised by fear of negative evaluation and negative perceptual biases; however, the cognitive mechanisms underlying these negative biases are not well understood. We investigated a possible mechanism which could maintain negative biases: altered adaptation to emotional faces. Heightened sensitivity to negative emotions could result from weakened adaptation to negative emotions, strengthened adaptation to positive emotions, or both mechanisms. We measured adaptation from repeated exposure to either positive or negative emotional faces, in individuals high versus low in social anxiety. We quantified adaptation strength by calculating the point of subjective equality (PSE) before and after adaptation for each participant. We hypothesised: (1) weaker adaptation to angry vs happy faces in individuals high in social anxiety, (2) no difference in adaptation to angry vs happy faces in individuals low in social anxiety, and (3) no difference in adaptation to sad vs happy faces in individuals high in social anxiety. Our results revealed a weaker adaptation to angry compared to happy faces in individuals high in social anxiety (Experiment 1), with no such difference in individuals low in social anxiety (Experiment 1), and no difference in adaptation strength to sad vs happy faces in individuals high in social anxiety (Experiment 2).

Did you skip leg day? The neural mechanisms of muscle perception for body parts

While the neural mechanisms underpinning the perception of muscularity are poorly understood, recent progress has been made using the psychophysical technique of visual adaptation. Prolonged visual exposure to high (low) muscularity bodies causes subsequently viewed bodies to appear less (more) muscular, revealing a recalibration of the neural populations encoding muscularity. Here, we use visual adaptation to further elucidate the tuning properties of the neural processes underpinning muscle perception for the upper and lower halves of the body. Participants manipulated the apparent muscularity of upper and lower bodies until they appeared 'normal', prior to and following exposure to a series of top/bottom halves of bodies that were either high or low in muscularity. In Experiment 1, participants were adapted to isolated own-gender body halves from one of four conditions; increased (muscularity) upper (body half), increased lower, decreased upper, or decreased lower. Despite the presence of muscle aftereffects when the body halves the participants viewed and manipulated were congruent, there was only weak evidence of muscle aftereffect transfer between the upper and lower halves of the body. Aftereffects were significantly weaker when body halves were incongruent, implying minimal overlap in the neural mechanisms encoding muscularity for body half. Experiment 2 examined the generalisability of Experiment 1's findings in a more ecologically valid context using whole-body stimuli, producing a similar pattern of results as Experiment 1, but with no evidence of cross-adaptation. Taken together, the findings are most consistent with muscle-encoding neural populations that are body-half selective. As visual adaptation has been implicated in cases of body size and shape misperception, the present study furthers our current understanding of how these perceptual inaccuracies, particularly those involving muscularity, are developed, maintained, and may potentially be treated.

Adaptation and serial choice bias for low-level visual features are unaltered in autistic adolescents

Autism spectrum disorder (ASD), or autism, is characterized by social and non-social symptoms, including sensory hyper- and hyposensitivities. A suggestion has been put forward that some of these symptoms could be explained by differences in how sensory information is integrated with its context, including a lower tendency to leverage the past in the processing of new perceptual input. At least two history-dependent effects of opposite directions have been described in the visual perception literature: a repulsive adaptation effect, where perception of a stimulus is biased away from an adaptor stimulus, and an attractive serial choice bias, where perceptual choices are biased toward the previous choice. In this study, we investigated whether autistic participants differed in either bias from typically developing controls (TDs). Sixty-four adolescent participants (31 with ASD, 33 TDs) were asked to categorize oriented line stimuli in two tasks that were designed so that we would induce either adaptation or serial choice bias. Although our tasks successfully induced both biases, in comparing the two groups we found no differences in the magnitude of adaptation nor in the modulation of perceptual choices by the previous choice. In conclusion, we find no evidence of a decreased integration of the past in visual perception of low-level stimulus features in autistic adolescents.

Attention Modulates the Ensemble Coding of Facial Expressions

Ensemble coding and attention are two mechanisms utilized by our visual system to overcome the limitation of visual processing when confronted with the overwhelming visual information. Recent evidence in ensemble coding of size suggests that the attended items contributed more to the averaging. On the other hand, some new evidence also indicates that reduced attention jeopardies the perceptual averaging of stimuli. What is the relationship between attention and ensemble coding? To answer this question, in the current study, we tested whether an exogenous attentional cue would influence the reported mean emotion of a crowd. We showed participants a group of four faces with different emotions. Participants' attention was guided to the happiest or saddest face (attention conditions), or not to any specific face (baseline condition). The results supported the notion that the attention alters the ensemble perception of the facial expression by elevating the weight of that face in the ensemble representation. This opens the question for the neural mechanisms of ensemble coding and its connection to visual attention.

Are adaptation aftereffects for facial emotional expressions affected by prior knowledge about the emotion?

Accurate perception of the emotional signals conveyed by others is crucial for successful social interaction. Such perception is influenced not only by sensory input, but also by knowledge we have about the others' emotions. This study addresses the issue of whether knowing that the other's emotional state is congruent or incongruent with their displayed emotional expression ("genuine" and "fake", respectively) affects the neural mechanisms underpinning the perception of their facial emotional expressions. We used a visual adaptation paradigm to investigate this question in three experiments employing increasing adaptation durations. The adapting stimuli consisted of photographs of emotional facial expressions of joy and anger, purported to reflect (in-)congruency between felt and expressed emotion, displayed by professional actors. A Validity checking procedure ensured participants had the correct knowledge about the (in-)congruency. Significantly smaller adaptation aftereffects were obtained when participants knew that the displayed expression was incongruent with the felt emotion, following all tested adaptation periods. This study shows that knowledge relating to the congruency between felt and expressed emotion modulates face expression aftereffects. We argue that this reflects that the neural substrate responsible for the perception of facial expressions of emotion incorporates the presumed felt emotion underpinning the expression.

Implicit visuospatial attention shapes numerosity adaptation and perception

The perception of numerical quantities is susceptible to adaptation: after inspecting a numerous dot array for a few seconds a subsequent dot array is grossly underestimated. In a recent work we showed that the mere appearance of an additional numerically neutral stimulus significantly reduces the adaptation magnitude. Here we demonstrate that this reduction is likely due to a numerosity underestimation of the adaptor caused by a change of numerosity-related attentional resources deployed on the adapting stimulus. In Experiment 1 we replicated previous findings revealing a robust reduction of numerosity adaptation when an additional adaptor (even if neutral) was displayed. In Experiment 2 we used the method of magnitude estimation to demonstrate that numerosity is underestimated whenever a second task-irrelevant numerical stimulus appears on screen. Furthermore we demonstrated that the same experimental manipulations were not effective in modulating orientation adaptation magnitude as well as orientation estimation accuracy. Our results support the hypothesis of a tight relationship between numerosity perception and implicit visuospatial attention and corroborate the notion that numerosity adaptation depends on perceived rather than physical numerosity. However the lack of an effect of visuospatial attentional deployment for orientation perception suggests that attention might differently shape adaptation aftereffects for different features along the visual hierarchy.

Numerosity adaptation partly depends on the allocation of implicit numerosity-contingent visuo-spatial attention

Like other perceptual attributes, numerosity is susceptible to adaptation. Nevertheless, it has never been fully investigated whether adaptation to numerosity is fully perceptual in nature or if it stems from the mixed influence of perception and attention. In the present work, we addressed this point throughout three separate experiments aiming at investigating the potential role played by visuo-spatial attentional mechanisms in shaping numerosity perception and adaptation. In Experiments 1 and 2, we showed that the magnitude of numerosity adaptation can be strongly influenced by the distribution of numerosity-contingent visuo-spatial attentional resources during the adaptation period. Results from Experiment 1 revealed a robust reduction of adaptation magnitude whenever a second numerical stimulus was presented in a diametrically opposite location from that of the adaptor, despite this second adapter being neutral as matched in numerosity with the following stimulus displayed in that location. In Experiment 2, we showed that this reduction in adaptation did not occur in cases where the second stimulus was not numerical, suggesting that attentional resources specifically related to numerosity information accounts for the results of Experiment 1. Finally, in Experiment 3, we showed that uninformative visuo-spatial cues shape numerosity discrimination judgments both at baseline and during adaptation. Taken together, our results seem to indicate that visuo-spatial attention plays a relevant role in numerosity perception and that adaptation to numerosity is actively influenced by this cognitive process.

Working Memory Load Effects on the Tilt Aftereffect

Prolonged exposure to an oriented stimulus causes a subsequent test stimulus to be perceived as tilted in the opposite direction, a phenomenon referred to as the tilt aftereffect (TAE). Previous studies have demonstrated that high-level cognitive functions such as attention can modulate the TAE, which is generally well-known as a low-level perceptual process. However, it is unclear whether working memory load, another high-level cognitive function, could modulate the TAE. To address this issue, here we developed a new paradigm by combining a working memory load task with a TAE task. Participants firstly remembered a stream of digits (Experiment 1) or four color-shape conjunctions (Experiment 2) under high/low load conditions, and then recognized the probe stimuli (digits or a color-shape conjunction), which were presented at the center of an adapting grating. After the recognition task (i.e., the adaptation stage), participants performed an orientation judgment task to measure their TAEs. The result of Experiment 1, where the load stimuli were digits, showed that the magnitude of the TAEs were reduced under the condition of the high working memory load compared to that of the low working memory load. However, we failed to replicate the finding in Experiment 2, where the load stimuli were color-shape conjunctions. Together, our two experiments provided mixed evidence regarding the working memory load effects on the TAE and further replications are needed in future work.

A crowd of emotional voices influences the perception of emotional faces: Using adaptation, stimulus salience, and attention to probe audio-visual interactions for emotional stimuli

Correctly assessing the emotional state of others is a crucial part of social interaction. While facial expressions provide much information, faces are often not viewed in isolation, but occur with concurrent sounds, usually voices, which also provide information about the emotion being portrayed. Many studies have examined the crossmodal processing of faces and sounds, but results have been mixed, with different paradigms yielding different results. Using a psychophysical adaptation paradigm, we carried out a series of four experiments to determine whether there is a perceptual advantage when faces and voices match in emotion (congruent), versus when they do not match (incongruent). We presented a single face and a crowd of voices, a crowd of faces and a crowd of voices, a single face of reduced salience and a crowd of voices, and tested this last condition with and without attention directed to the emotion in the face. While we observed aftereffects in the hypothesized direction (adaptation to faces conveying positive emotion yielded negative, contrastive, perceptual aftereffects), we only found a congruent advantage (stronger adaptation effects) when faces were attended and of reduced salience, in line with the theory of inverse effectiveness.

The influence of the noradrenergic/stress system on perceptual biases for reward

Previous research has established a role for the norepinephrine (NE)/stress system in individual differences in biases to attend to reward or punishment. Outstanding questions concern its role in the flexibility with which such biases can be changed. The goal of this preregistered study was to examine the role of the NE/stress system in the degree to which biases can be trained along the axis of valence in the direction of reward. Participants genotyped for a common deletion variant of ADRA2b (linked to altered NE availability) experienced either an acute stress induction or a control procedure. Following stress induction, a "bias probe" task was presented before and after training. In the bias probe task, participants made forced choice judgments (happy or angry) on emotional faces with varying degrees of ambiguity. For bias training, participants viewed unambiguously angry faces in a task exploiting visual adaptation effects. The results revealed an overall shift from a slightly positive bias in categorizing faces pretraining to a more positive bias after training. Carriers of the deletion variant overall showed a more positive bias than did the noncarriers. Follow-up analyses showed that pretraining bias was a significant predictor of bias change, with those who showed a more negative bias preadaptation changing more in a positive direction. Critically, this effect was observed under control but not under stress conditions. These results suggest that the NE/stress system plays an important role in influencing trait-like biases as well as short-term changes in the tendency to perceive ambiguous stimuli as being more rewarding than threatening.

Adaptation to the Speed of Biological Motion in Autism

Autistic individuals often present atypicalities in adaptation-the continuous recalibration of perceptual systems driven by recent sensory experiences. Here, we examined such atypicalities in human biological motion. We used a dual-task paradigm, including a running-speed discrimination task ('comparing the speed of two running silhouettes') and a change-detection task ('detecting fixation-point shrinkages') assessing attention. We tested 19 school-age autistic and 19 age- and ability-matched typical participants, also recording eye-movements. The two groups presented comparable speed-discrimination abilities and, unexpectedly, comparable adaptation. Accuracy in the change-detection task and the scatter of eye-fixations around the fixation point were also similar across groups. Yet, the scatter of fixations reliably predicted the magnitude of adaptation, demonstrating the importance of controlling for attention in adaptation studies.

The Role of Temporal and Spatial Attention in Size Adaptation

One of the most important tasks for the visual system is to construct an internal representation of the spatial properties of objects, including their size. Size perception includes a combination of bottom-up (retinal inputs) and top-down (e.g., expectations) information, which makes the estimates of object size malleable and susceptible to numerous contextual cues. For example, it has been shown that size perception is prone to adaptation: brief previous presentations of larger or smaller adapting stimuli at the same region of space changes the perceived size of a subsequent test stimulus. Large adapting stimuli cause the test to appear smaller than its veridical size and vice versa. Here, we investigated whether size adaptation is susceptible to attentional modulation. First, we measured the magnitude of adaptation aftereffects for a size discrimination task. Then, we compared these aftereffects (on average 15–20%) with those measured while participants were engaged, during the adaptation phase, in one of the two highly demanding central visual tasks: Multiple Object Tracking (MOT) or Rapid Serial Visual Presentation (RSVP). Our results indicate that deploying visual attention away from the adapters did not significantly affect the distortions of perceived size induced by adaptation, with accuracy and precision in the discrimination task being almost identical in all experimental conditions. Taken together, these results suggest that visual attention does not play a key role in size adaptation, in line with the idea that this phenomenon can be accounted for by local gain control mechanisms within area V1.

Does repeatedly viewing overweight versus underweight images change perception of and satisfaction with own body size?

Body dissatisfaction is associated with subsequent eating disorders and weight gain. One-off exposure to bodies of different sizes changes perception of others' bodies, and perception of and satisfaction with own body size. The effect of repeated exposure to bodies of different sizes has not been assessed. We randomized women into three groups, and they spent 5 min twice a day for a week completing a one-back task using images of women modified to appear either under, over, or neither over- nor underweight. We tested the effects on their perception of their own and others' body size, and satisfaction with own size. Measures at follow-up were compared between groups, adjusted for baseline measurements. In 93 women aged 18-30 years, images of other women were perceived as larger following exposure to underweight women (and vice versa) (p < 0.001). There was no evidence for a difference in our primary outcome measure (visual analogue scale own size) or in satisfaction with own size. Avatar-constructed ideal (p = 0.03) and avatar-constructed perceived own body size (p = 0.007) both decreased following exposure to underweight women, possibly due to adaptation affecting how the avatar was perceived. Repeated exposure to different sized bodies changes perception of the size of others' bodies, but we did not find evidence that it changes perceived own size.

Muscle and fat aftereffects and the role of gender: Implications for body image disturbance

Body image disturbance - a cause of distress amongst the general population and those diagnosed with various disorders - is often attributed to the media's unrealistic depiction of ideal bodies. These ideals are strongly gendered, leading to pronounced fat concern amongst females, and a male preoccupation with muscularity. Recent research suggests that visual aftereffects may be fundamental to the misperception of body fat and muscle mass - the perceptual component of body image disturbance. This study sought to establish the influence of gender on these body aftereffects. Male and female observers were randomly assigned to one of four adaptation conditions (low-fat, high-fat, low-muscle, and high-muscle bodies) and were asked to adjust the apparent fat and muscle levels of male and female bodies to make them appear as 'normal' as possible both before adaptation and after adaptation. While neither the gender of observers nor of body stimuli had a direct effect, aftereffect magnitude was significantly larger when observers viewed own-gender (compared with other-gender) stimuli. This effect, which may be due to attentional factors, could have implications for the development of body image disturbance, given the preponderance of idealized own-gender bodies in media marketed to male and female consumers.

The Thin White Line: Adaptation Suggests a Common Neural Mechanism for Judgments of Asian and Caucasian Body Size

Visual adaptation has been proposed as a mechanism linking viewing images of thin women's bodies with body size and shape misperception (BSSM). Non-Caucasian populations appear less susceptible to BSSM, possibly because adaptation to thin Caucasian bodies in Western media may not fully transfer to own-race bodies. Experiment 1 used a cross-adaptation paradigm to examine the transfer of body size aftereffects across races. Large aftereffects were found in the predicted directions for all conditions. The strength of aftereffects was statistically equivalent when the race of test stimuli was congruent vs. incongruent with the race of adaptation stimuli, suggesting complete transfer of aftereffects across races. Experiment 2 used a contingent-adaptation paradigm, finding that simultaneous adaptation to wide Asian and narrow Caucasian women's bodies (or vice versa) results in no significant aftereffects for either congruent or incongruent conditions and statistically equivalent results for each. Equal and opposite adaptation effects may therefore transfer completely across races, canceling each other out. This suggests that body size is encoded by a race-general neural mechanism. Unexpectedly, Asian observers showed reduced body size aftereffects compared to Caucasian observers, regardless of the race of stimulus bodies, perhaps helping to explain why Asian populations appear less susceptible to BSSM.

Looking at the Figures: Visual Adaptation as a Mechanism for Body-Size and -Shape Misperception

Many individuals experience body-size and -shape misperception (BSSM). Body-size overestimation is associated with body dissatisfaction, anxiety, depression, and the development of eating disorders in individuals who desire to be thinner. Similar symptoms have been noted for those who underestimate their muscularity. Conversely, individuals with high body mass indices (BMI) who underestimate their adiposity may not recognize the risks of or seek help for obesity-related medical issues. Although social scientists have examined whether media representations of idealized bodies contribute to the overestimation of fat or underestimation of muscle, other scientists suggest that increases in the prevalence of obesity could explain body-fat underestimation as a form of renormalization. However, these disparate approaches have not advanced our understanding of the perceptual underpinnings of BSSM. Recently, a new unifying account of BSSM has emerged that is based on the long-established phenomenon of visual adaptation, employing psychophysical measurements of perceived size and shape following exposure to "extreme" body stimuli. By inducing BSSM in the laboratory as an aftereffect, this technique is rapidly advancing our understanding of the underlying mental representation of human bodies. This nascent approach provides insight into real-world BSSM and may inform the development of therapeutic and public-health interventions designed to address such perceptual errors.

Seeing a Face in a Crowd of Emotional Voices: Changes in Perception and Cortisol in Response to Emotional Information across the Senses

One source of information we glean from everyday experience, which guides social interaction, is assessing the emotional state of others. Emotional state can be expressed through several modalities: body posture or movements, body odor, touch, facial expression, or the intonation in a voice. Much research has examined emotional processing within one sensory modality or the transfer of emotional processing from one modality to another. Yet, less is known regarding interactions across different modalities when perceiving emotions, despite our common experience of seeing emotion in a face while hearing the corresponding emotion in a voice. Our study examined if visual and auditory emotions of matched valence (congruent) conferred stronger perceptual and physiological effects compared to visual and auditory emotions of unmatched valence (incongruent). We quantified how exposure to emotional faces and/or voices altered perception using psychophysics and how it altered a physiological proxy for stress or arousal using salivary cortisol. While we found no significant advantage of congruent over incongruent emotions, we found that changes in cortisol were associated with perceptual changes. Following exposure to negative emotional content, larger decreases in cortisol, indicative of less stress, correlated with more positive perceptual after-effects, indicative of stronger biases to see neutral faces as happier.

Experimental manipulation of visual attention affects body size adaptation but not body dissatisfaction

OBJECTIVE

Prolonged exposure to large/small bodies causes aftereffects in perceived body size. Outside the laboratory, individuals repeatedly exposed to small (large) bodies tend to over- (under-) estimate their size and exhibit increased (decreased) body dissatisfaction. Why, among individuals exposed to approximately equivalent distributions of body sizes, only some develop body size and shape misperception and/or body dissatisfaction is not yet fully understood.

METHOD

We exposed 61 women to high and low adiposity bodies simultaneously, instructing half to attend to high, and half to low adiposity bodies.

RESULTS

Participants in the high adiposity attention condition's perception of "normal" body size significantly increased in adiposity, and vice versa.

DISCUSSION

This suggests that visual attention moderates body size aftereffects. Interventions encouraging visual attention to more realistic ranges of bodies may therefore reduce body misperception. No change in body dissatisfaction was found, suggesting that changes in the perceptual component (misperception) may not necessarily affect the attitudinal component (dissatisfaction) of body image distortion.

Effects of exposure to bodies of different sizes on perception of and satisfaction with own body size: two randomized studies

Body dissatisfaction is prevalent among women and associated with subsequent obesity and eating disorders. Exposure to images of bodies of different sizes has been suggested to change the perception of 'normal' body size in others. We tested whether exposure to different-sized (otherwise identical) bodies changes perception of own and others' body size, satisfaction with body size and amount of chocolate consumed. In Study 1, 90 18-25-year-old women with normal BMI were randomized into one of three groups to complete a 15 min two-back task using photographs of women either of 'normal weight' (Body Mass Index (BMI) 22-23 kg m-2), or altered to appear either under- or over-weight. Study 2 was identical except the 96 participants had high baseline body dissatisfaction and were followed up after 24 h. We also conducted a mega-analysis combining both studies. Participants rated size of others' bodies, own size, and satisfaction with size pre- and post-task. Post-task ratings were compared between groups, adjusting for pre-task ratings. Participants exposed to over- or normal-weight images subsequently perceived others' bodies as smaller, in comparison to those shown underweight bodies (p < 0.001). They also perceived their own bodies as smaller (Study 1, p = 0.073; Study 2, p = 0.018; mega-analysis, p = 0.001), and felt more satisfied with their size (Study 1, p = 0.046; Study 2, p = 0.004; mega-analysis, p = 0.006). There were no differences in chocolate consumption. This study suggests that a move towards using images of women with a BMI in the healthy range in the media may help to reduce body dissatisfaction, and the associated risk of eating disorders.

Attention Gates the Selective Encoding of Duration

The abundance of temporal information in our environment calls for the effective selection and utilization of temporal information that is relevant for our behavior. Here we investigated whether visual attention gates the selective encoding of relevant duration information when multiple sources of duration information are present. We probed the encoding of duration by using a duration-adaptation paradigm. Participants adapted to two concurrently presented streams of stimuli with different durations, while detecting oddballs in one of the streams. We measured the resulting duration after-effect (DAE) and found that the DAE reflects stronger relative adaptation to attended durations, compared to unattended durations. Additionally, we demonstrate that unattended durations do not contribute to the measured DAE. These results suggest that attention plays a crucial role in the selective encoding of duration: attended durations are encoded, while encoding of unattended durations is either weak or absent.

Visual attention mediates the relationship between body satisfaction and susceptibility to the body size adaptation effect

Body size misperception–the belief that one is larger or smaller than reality–affects a large and growing segment of the population. Recently, studies have shown that exposure to extreme body stimuli results in a shift in the point of subjective normality, suggesting that visual adaptation may be a mechanism by which body size misperception occurs. Yet, despite being exposed to a similar set of bodies, some individuals within a given geographical area will develop body size misperception and others will not. The reason for these individual difference is currently unknown. One possible explanation stems from the observation that women with lower levels of body satisfaction have been found to pay more attention to images of thin bodies. However, while attention has been shown to enhance visual adaptation effects in low (e.g. rotational and linear motion) and high level stimuli (e.g., facial gender), it is not known whether this effect exists in visual adaptation to body size. Here, we test the hypothesis that there is an indirect effect of body satisfaction on the direction and magnitude of the body fat adaptation effect, mediated via visual attention (i.e., selectively attending to images of thin over fat bodies or vice versa). Significant mediation effects were found in both men and women, suggesting that observers’ level of body satisfaction may influence selective visual attention to thin or fat bodies, which in turn influences the magnitude and direction of visual adaptation to body size. This may provide a potential mechanism by which some individuals develop body size misperception–a risk factor for eating disorders, compulsive exercise behaviour and steroid abuse–while others do not.

Intensity dependence in high-level facial expression adaptation aftereffect

Perception of a facial expression can be altered or biased by a prolonged viewing of other facial expressions, known as the facial expression adaptation aftereffect (FEAA). Recent studies using antiexpressions have demonstrated a monotonic relation between the magnitude of the FEAA and adaptor extremity, suggesting that facial expressions are opponent coded and represented continuously from one expression to its antiexpression. However, it is unclear whether the opponent-coding scheme can account for the FEAA between two facial expressions. In the current study, we demonstrated that the magnitude of the FEAA between two facial expressions increased monotonically as a function of the intensity of adapting facial expressions, consistent with the predictions based on the opponent-coding model. Further, the monotonic increase in the FEAA occurred even when the intensity of an adapting face was too weak for its expression to be recognized. These results together suggest that multiple facial expressions are encoded and represented by balanced activity of neural populations tuned to different facial expressions.

No Effect of Featural Attention on Body Size Aftereffects

Prolonged exposure to images of narrow bodies has been shown to induce a perceptual aftereffect, such that observers' point of subjective normality (PSN) for bodies shifts toward narrower bodies. The converse effect is shown for adaptation to wide bodies. In low-level stimuli, object attention (attention directed to the object) and spatial attention (attention directed to the location of the object) have been shown to increase the magnitude of visual aftereffects, while object-based attention enhances the adaptation effect in faces. It is not known whether featural attention (attention directed to a specific aspect of the object) affects the magnitude of adaptation effects in body stimuli. Here, we manipulate the attention of Caucasian observers to different featural information in body images, by asking them to rate the fatness or sex typicality of male and female bodies manipulated to appear fatter or thinner than average. PSNs for body fatness were taken at baseline and after adaptation, and a change in PSN (ΔPSN) was calculated. A body size adaptation effect was found, with observers who viewed fat bodies showing an increased PSN, and those exposed to thin bodies showing a reduced PSN. However, manipulations of featural attention to body fatness or sex typicality produced equivalent results, suggesting that featural attention may not affect the strength of the body size aftereffect.

Interdependent Mechanisms for Processing Gender and Emotion: The Special Status of Angry Male Faces

While some models of how various attributes of a face are processed have posited that face features, invariant physical cues such as gender or ethnicity as well as variant social cues such as emotion, may be processed independently (e.g., Bruce and Young, 1986), other models suggest a more distributed representation and interdependent processing (e.g., Haxby et al., 2000). Here, we use a contingent adaptation paradigm to investigate if mechanisms for processing the gender and emotion of a face are interdependent and symmetric across the happy–angry emotional continuum and regardless of the gender of the face. We simultaneously adapted participants to angry female faces and happy male faces (Experiment 1) or to happy female faces and angry male faces (Experiment 2). In Experiment 1, we found evidence for contingent adaptation, with simultaneous aftereffects in opposite directions: male faces were biased toward angry while female faces were biased toward happy. Interestingly, in the complementary Experiment 2, we did not find evidence for contingent adaptation, with both male and female faces biased toward angry. Our results highlight that evidence for contingent adaptation and the underlying interdependent face processing mechanisms that would allow for contingent adaptation may only be evident for certain combinations of face features. Such limits may be especially important in the case of social cues given how maladaptive it may be to stop responding to threatening information, with male angry faces considered to be the most threatening. The underlying neuronal mechanisms that could account for such asymmetric effects in contingent adaptation remain to be elucidated.

Attending to Race (or Gender) Does Not Increase Race (or Gender) Aftereffects

Recent research has shown that attention can influence the strength of face aftereffects. For example, attending to changes in facial features increases the strength of identity and figural aftereffects relative to passive viewing (Rhodes et al., 2011). Here, we ask whether attending to a specific social dimension of a face (such as race or gender) influences the strength of face aftereffects along that dimension. Across three experiments, participants completed many single-shot face adaptation trials. In each trial, participants observed a computer-generated adapting face for 5 s while instructed to focus on either the race or gender of that adapting face. Adapting faces were either Asian and female or Caucasian and male. In Experiment 1, all trials included an intermediate question (IQ) following each adaptation period, soliciting a rating of the adapting face on the attended dimension (e.g., race). In Experiment 2, only half of the trials included this IQ, and in Experiment 3 only a quarter of the trials did. In all three experiments, participants were subsequently presented with a race- and gender-neutral face and asked to rate it on either the attended dimension (e.g., race, attention-congruent trials) or the unattended dimension (e.g., gender, attention-incongruent trials) using a seven-point scale. Overall, participants showed significant aftereffects in all conditions, manifesting as (i) higher Asian ratings of the neutral faces following Caucasian vs. Asian adapting faces and (ii) higher female ratings of neutral faces following male vs. female adapting faces. Intriguingly, although reaction times were shorter during attention-congruent vs. attention-incongruent trials, aftereffects were not stronger along attention-congruent than attention-incongruent dimensions. Our results suggest that attending to a facial dimension such as race or gender does not result in increased adaptation to that dimension.

Facial Expression Aftereffect Revealed by Adaption to Emotion-Invisible Dynamic Bubbled Faces

Visual adaptation is a powerful tool to probe the short-term plasticity of the visual system. Adapting to local features such as the oriented lines can distort our judgment of subsequently presented lines, the tilt aftereffect. The tilt aftereffect is believed to be processed at the low-level of the visual cortex, such as V1. Adaptation to faces, on the other hand, can produce significant aftereffects in high-level traits such as identity, expression, and ethnicity. However, whether face adaptation necessitate awareness of face features is debatable. In the current study, we investigated whether facial expression aftereffects (FEAE) can be generated by partially visible faces. We first generated partially visible faces using the bubbles technique, in which the face was seen through randomly positioned circular apertures, and selected the bubbled faces for which the subjects were unable to identify happy or sad expressions. When the subjects adapted to static displays of these partial faces, no significant FEAE was found. However, when the subjects adapted to a dynamic video display of a series of different partial faces, a significant FEAE was observed. In both conditions, subjects could not identify facial expression in the individual adapting faces. These results suggest that our visual system is able to integrate unrecognizable partial faces over a short period of time and that the integrated percept affects our judgment on subsequently presented faces. We conclude that FEAE can be generated by partial face with little facial expression cues, implying that our cognitive system fills-in the missing parts during adaptation, or the subcortical structures are activated by the bubbled faces without conscious recognition of emotion during adaptation.

Deciding on race: a diffusion model analysis of race-categorisation

It has long been known that a person's race can affect their decisions about people of another race; an observation that clearly taps into some deep societal issues. However, in order to behave differently in response to someone else's race, you must first categorise that person as other-race. The current study investigates the process of race-categorisation. Two groups of participants, Asian and Caucasian, rapidly classified facial images that varied from strongly Asian, through racially intermediate, to strongly Caucasian. In agreement with previous findings, there was a difference in category boundary between the two groups. Asian participants more frequently judged intermediate images as Caucasian and vice versa. We fitted a decision model, the Ratcliff diffusion model, to our two choice reaction time data. This model provides an account of the processes thought to underlie binary choice decisions. Within its architecture it has two components that could reasonably lead to a difference in race category boundary, these being evidence accumulation rate and a priori bias. The latter is the expectation or prior belief that a participant brings to the task, whilst the former indexes sensitivity to race-dependent perceptual cues. Whilst we find no good evidence for a difference in a priori bias between our two groups, we do find evidence for a difference in evidence accumulation rate. Our Asian participants were more sensitive to Caucasian cues within the images than were our Caucasian participants (and vice versa). These results support the idea that differences in perceptual sensitivity to race-defining visual characteristics drive differences in race categorisation. We propose that our findings fit with a wider view in which perceptual adaptation plays a central role in the visual processing of own and other race.

Atypicalities in perceptual adaptation in autism do not extend to perceptual causality

A recent study showed that adaptation to causal events (collisions) in adults caused subsequent events to be less likely perceived as causal. In this study, we examined if a similar negative adaptation effect for perceptual causality occurs in children, both typically developing and with autism. Previous studies have reported diminished adaptation for face identity, facial configuration and gaze direction in children with autism. To test whether diminished adaptive coding extends beyond high-level social stimuli (such as faces) and could be a general property of autistic perception, we developed a child-friendly paradigm for adaptation of perceptual causality. We compared the performance of 22 children with autism with 22 typically developing children, individually matched on age and ability (IQ scores). We found significant and equally robust adaptation aftereffects for perceptual causality in both groups. There were also no differences between the two groups in their attention, as revealed by reaction times and accuracy in a change-detection task. These findings suggest that adaptation to perceptual causality in autism is largely similar to typical development and, further, that diminished adaptive coding might not be a general characteristic of autism at low levels of the perceptual hierarchy, constraining existing theories of adaptation in autism.

Norm-based coding of facial identity in adults with autism spectrum disorder

It is unclear whether reported deficits in face processing in individuals with autism spectrum disorders (ASD) can be explained by deficits in perceptual face coding mechanisms. In the current study, we examined whether adults with ASD showed evidence of norm-based opponent coding of facial identity, a perceptual process underlying the recognition of facial identity in typical adults. We began with an original face and an averaged face and then created an anti-face that differed from the averaged face in the opposite direction from the original face by a small amount (near adaptor) or a large amount (far adaptor). To test for norm-based coding, we adapted participants on different trials to the near versus far adaptor, then asked them to judge the identity of the averaged face. We varied the size of the test and adapting faces in order to reduce any contribution of low-level adaptation. Consistent with the predictions of norm-based coding, high functioning adults with ASD (n = 27) and matched typical participants (n = 28) showed identity aftereffects that were larger for the far than near adaptor. Unlike results with children with ASD, the strength of the aftereffects were similar in the two groups. This is the first study to demonstrate norm-based coding of facial identity in adults with ASD.

Reduced adaptability, but no fundamental disruption, of norm-based face-coding mechanisms in cognitively able children and adolescents with autism

Faces are adaptively coded relative to visual norms that are updated by experience. This coding is compromised in autism and the broader autism phenotype, suggesting that atypical adaptive coding of faces may be an endophenotype for autism. Here we investigate the nature of this atypicality, asking whether adaptive face-coding mechanisms are fundamentally altered, or simply less responsive to experience, in autism. We measured adaptive coding, using face identity aftereffects, in cognitively able children and adolescents with autism and neurotypical age- and ability-matched participants. We asked whether these aftereffects increase with adaptor identity strength as in neurotypical populations, or whether they show a different pattern indicating a more fundamental alteration in face-coding mechanisms. As expected, face identity aftereffects were reduced in the autism group, but they nevertheless increased with adaptor strength, like those of our neurotypical participants, consistent with norm-based coding of face identity. Moreover, their aftereffects correlated positively with face recognition ability, consistent with an intact functional role for adaptive coding in face recognition ability. We conclude that adaptive norm-based face-coding mechanisms are basically intact in autism, but are less readily calibrated by experience.

Face identity aftereffects increase monotonically with adaptor extremity over, but not beyond, the range of natural faces

Face identity aftereffects have been used to test theories of the neural coding underlying expert face recognition. Previous studies reported larger aftereffects for adaptors that are morphed further from the average face than for adaptors closer to the average, which appeared to support opponent coding along face-identity dimensions. However, only two levels were tested and it is not clear where they were located relative to the range of naturally occurring faces. This range is of interest given the functional need of the visual system both to produce good discrimination of real everyday faces and to process novel kinds of faces that we may encounter. Here, Experiment 1 establishes the boundary of faces judged as being able to occur in everyday life. Experiment 2 then shows that aftereffects increase with adaptor extremity up to this natural-range boundary, drop significantly immediately outside the boundary, and then remain stable with no drop towards zero even for highly distorted adaptors far beyond the boundary. Computational modelling shows that this unexpected pattern cannot be explained either by a simple opponent or by a classic multichannel model. However, its qualitative features can be captured either by a combination of opponent and multichannel coding (raising the possibility that not all identity-related face dimensions are opponent coded), or by a 3-pool model containing two S-shaped-response channels and a central bell-shaped channel around the average face (raising the possibility of unexpected similarities with coding of eye and head direction).

Reduced face aftereffects in autism are not due to poor attention

This study aimed to determine why face identity aftereffects are diminished in children with autism, relative to typical children. To address the possibility that reduced face aftereffects might reflect reduced attention to adapting stimuli, we investigated the consequence of controlling attention to adapting faces during a face identity aftereffect task in children with autism and typical children. We also included a size-change between adaptation and test stimuli to determine whether the reduced aftereffects reflect atypical adaptation to low- or higher-level stimulus properties. Results indicated that when attention was controlled and directed towards adapting stimuli, face identity aftereffects in children with autism were significantly reduced relative to typical children. This finding challenges the notion that atypicalities in the quality and/or quantity of children's attention during adaptation might account for group differences previously observed in this paradigm. Additionally, evidence of diminished face identity aftereffects despite a stimulus size change supports an adaptive processing atypicality in autism that extends beyond low-level, retinotopically coded stimulus properties. These findings support the notion that diminished face aftereffects in autism reflect atypicalities in adaptive norm-based coding, which could also contribute to face processing difficulties in this group.

Autistic traits are linked to reduced adaptive coding of face identity and selectively poorer face recognition in men but not women

Our ability to discriminate and recognize thousands of faces despite their similarity as visual patterns relies on adaptive, norm-based, coding mechanisms that are continuously updated by experience. Reduced adaptive coding of face identity has been proposed as a neurocognitive endophenotype for autism, because it is found in autism and in relatives of individuals with autism. Autistic traits can also extend continuously into the general population, raising the possibility that reduced adaptive coding of face identity may be more generally associated with autistic traits. In the present study, we investigated whether adaptive coding of face identity decreases as autistic traits increase in an undergraduate population. Adaptive coding was measured using face identity aftereffects, and autistic traits were measured using the Autism-Spectrum Quotient (AQ) and its subscales. We also measured face and car recognition ability to determine whether autistic traits are selectively related to face recognition difficulties. We found that men who scored higher on levels of autistic traits related to social interaction had reduced adaptive coding of face identity. This result is consistent with the idea that atypical adaptive face-coding mechanisms are an endophenotype for autism. Autistic traits were also linked with face-selective recognition difficulties in men. However, there were some unexpected sex differences. In women, autistic traits were linked positively, rather than negatively, with adaptive coding of identity, and were unrelated to face-selective recognition difficulties. These sex differences indicate that autistic traits can have different neurocognitive correlates in men and women and raise the intriguing possibility that endophenotypes of autism can differ in males and females.

Increasing recognition of happiness in ambiguous facial expressions reduces anger and aggressive behavior

The ability to identify emotion in other people is critical to social functioning. In a series of experiments, we explored the relationship between recognition of emotion in ambiguous facial expressions and aggressive thoughts and behavior, both in healthy adults and in adolescent youth at high risk of criminal offending and delinquency. We show that it is possible to experimentally modify biases in emotion recognition to encourage the perception of happiness over anger in ambiguous expressions. This change in perception results in a decrease in self-reported anger and aggression in healthy adults and high-risk youth, respectively, and also in independently rated aggressive behavior in high-risk youth. We obtained similar effects on mood using two different techniques to modify biases in emotion perception (feedback-based training and visual adaptation). These studies provide strong evidence that emotion processing plays a causal role in anger and the maintenance of aggressive behavior.

Atypical updating of face representations with experience in children with autism

Face identity aftereffects are significantly diminished in children with autism relative to typical children, which may reflect reduced perceptual updating with experience. Here, we investigated whether this atypicality also extends to non-face stimulus categories, which might signal a pervasive visual processing difference in individuals with autism. We used a figural aftereffect task to measure directly perceptual updating following exposure to distorted upright faces, inverted faces and cars, in typical children and children with autism. A size-change between study and test stimuli limited the likelihood that any processing atypicalities reflected group differences in adaptation to low-level features of the stimuli. Results indicated that, relative to typical children, figural aftereffects for upright faces, but not inverted faces or cars, were significantly attenuated in children with autism. Moreover, the group difference was amplified when we isolated the 'face-selective' component of the aftereffect, by partialling out the mid-level shape adaptation common to upright and inverted face stimuli. Notably, the aftereffects of typical children were disproportionately larger for upright faces than for inverted faces and cars, but the magnitude of aftereffects of autistic children was not similarly modulated according to stimulus category. These findings are inconsistent with a pervasive adaptive coding atypicality relative to typical children, and suggest that reduced perceptual updating may constitute a high-level, and possibly face-selective, visual processing difference in children with autism.

Face aftereffects predict individual differences in face recognition ability

Face aftereffects are widely studied on the assumption that they provide a useful tool for investigating face-space coding of identity. However, a long-standing issue concerns the extent to which face aftereffects originate in face-level processes as opposed to earlier stages of visual processing. For example, some recent studies failed to find atypical face aftereffects in individuals with clinically poor face recognition. We show that in individuals within the normal range of face recognition abilities, there is an association between face memory ability and a figural face aftereffect that is argued to reflect the steepness of broadband-opponent neural response functions in underlying face-space. We further show that this correlation arises from face-level processing, by reporting results of tests of nonface memory and nonface aftereffects. We conclude that face aftereffects can tap high-level face-space, and that face-space coding differs in quality between individuals and contributes to face recognition ability.

Ignored faces produce figural face aftereffects

Following adaptation to faces with contracted (or expanded) internal features, faces previously perceived as normal appear distorted in the opposite direction. This figural face aftereffect suggests face-coding mechanisms adapt to changes in the spatial relations of features and/or the global structure of faces. Here, we investigated whether the figural aftereffect requires spatial attention. Participants ignored a distorted adapting face and performed a highly demanding letter-count task. Before and after adaptation, participants rated the normality of morphed distorted faces ranging from 50% contracted through undistorted to 50% expanded. A robust aftereffect was observed. These results suggest that the figural face aftereffect can occur in the absence of spatial attention, even when the attentional demands of the relevant task are high.

Cross-category adaptation: objects produce gender adaptation in the perception of faces

Adaptation aftereffects have been found for low-level visual features such as colour, motion and shape perception, as well as higher-level features such as gender, race and identity in domains such as faces and biological motion. It is not yet clear if adaptation effects in humans extend beyond this set of higher order features. The aim of this study was to investigate whether objects highly associated with one gender, e.g. high heels for females or electric shavers for males can modulate gender perception of a face. In two separate experiments, we adapted subjects to a series of objects highly associated with one gender and subsequently asked participants to judge the gender of an ambiguous face. Results showed that participants are more likely to perceive an ambiguous face as male after being exposed to objects highly associated to females and vice versa. A gender adaptation aftereffect was obtained despite the adaptor and test stimuli being from different global categories (objects and faces respectively). These findings show that our perception of gender from faces is highly affected by our environment and recent experience. This suggests two possible mechanisms: (a) that perception of the gender associated with an object shares at least some brain areas with those responsible for gender perception of faces and (b) adaptation to gender, which is a high-level concept, can modulate brain areas that are involved in facial gender perception through top-down processes.