Interaction between facial expression and color

Association between the three-dimensional facial shape and its color in a boundary group of young to middle-aged Asian women

Visual cues strongly influence an individual's self-esteem and have fundamental sociopsychological functions. The color and shape of the face are important information for visual cues and are hypothesized to be correlated with each other. However, few studies have examined these relationships. Thus, this study determined the association between color and shape of the face. For this purpose, we evaluated Chinese women in their 30s and 40s (n = 166). Three-dimensional (3D) image-capture devices that provide shape morphology along with standardized photographs (color information) were used to obtain 3D images of women. The coordinates and red‒green-blue color data on the 3D images were utilized to perform principal component (PC) analysis, and shape and color PCs were generated. A canonical variate analysis was then conducted to check for significant correlations between the shape and color PCs. As a result, 6 significant correlations were found (p < 0.05). In detail, in addition to the physical correlations (i.e., steric faces or faces with protrusion of the cheek showed greater shadows, retrognathism was related to a shadow under the lower lip and vice versa), biological correlations (fatty faces showed greater redness and remarkable marionette lines; faces with age-related sagging showed greater darkness, possibly related to cumulative ultraviolet radiation exposure of the skin; and robust mandibles and supraorbital ridges were related to thick eyebrows) were found. This insight can aid both medical and cosmetic practitioners in comprehending the intricate details conveyed by facial features, thereby facilitating more comprehensive diagnosis and treatment planning, including makeup.

Facial expressions affect the memory of facial colors

Facial color influences the perception of facial expressions, and emotional expressions bias how facial color is remembered. However, it remains unclear whether facial expressions affect daily facial color memory. The memory color effect demonstrates that knowledge about typical colors affects the perception of the actual color of given objects. To investigate the effect of facial color memory, we examined whether the memory color effect for faces varies depending on facial expression. We calculated the subjective achromatic point of the facial expression image stimulus and compared the degree to which it was shifted from the actual achromatic point between facial expression conditions. We hypothesized that if the memory of facial color is influenced by the facial expression color (e.g., anger is a warm color, fear is a cold color), then the subjective achromatic point would vary with facial expression. In Experiment 1, we recruited 13 participants who adjusted the color of facial expression stimuli (anger, neutral, and fear) and a banana stimulus to be achromatic. No significant differences in the subjective achromatic point between facial expressions were observed. Subsequently, we conducted Experiment 2 with 23 participants because Experiment 1 did not account for the sensitivity to color changes on the face; humans perceive greater color differences in faces than in non-faces. Participants selected which facial color they believed the expression stimulus appeared to be, choosing one of two options provided to them. The results indicated that the subjective achromatic points of anger and fear faces significantly shifted toward the opposite color direction compared with neutral faces in the brief presentation condition. This research suggests that the memory color of faces differs depending on facial expressions and supports the idea that the perception of emotional expressions can bias facial color memory.

Wearable and interactive multicolored photochromic fiber display

Endowing flexible and adaptable fiber devices with light-emitting capabilities has the potential to revolutionize the current design philosophy of intelligent, wearable interactive devices. However, significant challenges remain in developing fiber devices when it comes to achieving uniform and customizable light effects while utilizing lightweight hardware. Here, we introduce a mass-produced, wearable, and interactive photochromic fiber that provides uniform multicolored light control. We designed independent waveguides inside the fiber to maintain total internal reflection of light as it traverses the fiber. The impact of excessive light leakage on the overall illuminance can be reduced by utilizing the saturable absorption effect of fluorescent materials to ensure light emission uniformity along the transmission direction. In addition, we coupled various fluorescent composite materials inside the fiber to achieve artificially controllable spectral radiation of multiple color systems in a single fiber. We prepared fibers on mass-produced kilometer-long using the thermal drawing method. The fibers can be directly integrated into daily wearable devices or clothing in various patterns and combined with other signal input components to control and display patterns as needed. This work provides a new perspective and inspiration to the existing field of fiber display interaction, paving the way for future human-machine integration.

Reactivity of observers' facial skin blood flow depending on others' facial expressions and blushing

Facial skin blood flow (SkBF) has attracted attention as an autonomic indicator because it influences facial colour, which informs others of emotional states, and facial temperature related to social anxiety. Previous studies have examined the facial SkBF in people experiencing emotions; however, facial SkBF changes in the observers of emotions are poorly understood. Our study clarified facial SkBF changes related to observing others' emotions by comparing the changes with other physiological indices. Thirty healthy participants (24 females; mean age: 22.17) observed six types of facial expressions (neutral, angry, and embarrassed expressions with and without facial blushing) and rated the emotional intensity of the other person. We measured their facial SkBF, finger SkBF, and cardiac RR interval as they made their observations. Facial SkBF generally decreased in relation to observing emotional faces (angry and embarrassed faces) and significantly decreased for angry expressions with blushing. None of the participants noticed blushing of facial stimuli. For the RR interval and finger SkBF, there was no variation depending on the observed facial expressions, although there was a general increase related to observation. These results indicated that facial SkBF is sensitive and reactive to emotional faces-especially angry faces with blushing- compared with other autonomic indices. The facial SkBF changes were not related to either RR interval changes or the intensity rating, suggesting that facial SkBF changes may be caused by vasoconstriction and have potential functions for our emotions. The decrease in facial SkBF may have a role in calming observers by preventing them from adopting the same emotional state as a person with intense anger. These findings clarify daily facial SkBF fluctuations and their relationship with our emotional processing in interpersonal situations.

The effect of facial colour on implicit facial expressions

Humans recognise reddish-coloured faces as angry. However, does facial colour also affect "implicit" facial expression perception of which humans are not explicitly aware? In this study, we investigated the effects of facial colour on implicit facial expression perception. The experimental stimuli were "hybrid faces", in which the low-frequency component of the neutral facial expression image was replaced with the low-frequency component of the facial expression image of happiness or anger. In Experiment 1, we confirmed that the hybrid face stimuli were perceived as neutral and, therefore, supported implicit facial expression perception. In Experiment 2, the hybrid face stimuli were adjusted to natural and reddish facial colours, and their friendliness ratings were compared. The results showed that the expression of happiness was rated as more friendly than the expression of anger. In addition, the expression of happiness was rated as friendlier when the low-frequency happy component was red, but the friendliness rating of the expression of anger did not change when it was presented in red. In Experiment 3, we affirmed the implicit facial expression perception even in reddish colours. These results suggest that facial colour modulates the perception of implicit facial expressions in hybrid facial stimuli.

Using Computer Vision to Track Facial Color Changes and Predict Heart Rate

The current technological advances have pushed the quantification of exercise intensity to new era of physical exercise sciences. Monitoring physical exercise is essential in the process of planning, applying, and controlling loads for performance optimization and health. A lot of research studies applied various statistical approaches to estimate various physiological indices, to our knowledge, no studies found to investigate the relationship of facial color changes and increased exercise intensity. The aim of this study was to develop a non-contact method based on computer vision to determine the heart rate and, ultimately, the exercise intensity. The method was based on analyzing facial color changes during exercise by using RGB, HSV, YCbCr, Lab, and YUV color models. Nine university students participated in the study (mean age = 26.88 ± 6.01 years, mean weight = 72.56 ± 14.27 kg, mean height = 172.88 ± 12.04 cm, six males and three females, and all white Caucasian). The data analyses were carried out separately for each participant (personalized model) as well as all the participants at a time (universal model). The multiple auto regressions, and a multiple polynomial regression model were designed to predict maximum heart rate percentage (maxHR%) from each color models. The results were analyzed and evaluated using Root Mean Square Error (RMSE), F-values, and R-square. The multiple polynomial regression using all participants exhibits the best accuracy with RMSE of 6.75 (R-square = 0.78). Exercise prescription and monitoring can benefit from the use of these methods, for example, to optimize the process of online monitoring, without having the need to use any other instrumentation.

Examining the Impact of Human Face Stimulus on Shape-Contrast Effects during a Brief Presentation

Shape-contrast effects have been introduced to the investigations into face perception with the aim of exploring face adaptation in the context of norm-based coding. Research has indicated that shape-contrast effects occur even for shapes as complex as the human face. However, whether the complexity of face stimuli alters the magnitude of shape-contrast effects needs to be examined. In this study, emoticons and realistic human faces were used with the original white circle as the test stimuli. The results revealed that the shape-contrast effect was dependent on the stimulus. However, there was no significant difference between the shape-contrast effect evoked by upright faces and that evoked by inverted ones. This suggests that the face stimuli influenced the strength of the shape-contrast effect: the mechanism of this effect involved multiple stages of the visual system related to luminance and complexity, rather than the holistic face perception.

Color Affects Recognition of Emoticon Expressions

In computer-mediated communication, emoticons are conventionally rendered in yellow. Previous studies demonstrated that colors evoke certain affective meanings, and face color modulates perceived emotion. We investigated whether color variation affects the recognition of emoticon expressions. Japanese participants were presented with emoticons depicting four basic emotions (Happy, Sad, Angry, Surprised) and a Neutral expression, each rendered in eight colors. Four conditions (E1-E4) were employed in the lab-based experiment; E5, with an additional participant sample, was an online replication of the critical E4. In E1, colored emoticons were categorized in a 5AFC task. In E2-E5, stimulus affective meaning was assessed using visual scales with anchors corresponding to each emotion. The conditions varied in stimulus arrays: E2: light gray emoticons; E3: colored circles; E4 and E5: colored emoticons. The affective meaning of Angry and Sad emoticons was found to be stronger when conferred in warm and cool colors, respectively, the pattern highly consistent between E4 and E5. The affective meaning of colored emoticons is regressed to that of achromatic expression counterparts and decontextualized color. The findings provide evidence that affective congruency of the emoticon expression and the color it is rendered in facilitates recognition of the depicted emotion, augmenting the conveyed emotional message.

Color Tuning of Face-Selective Neurons in Macaque Inferior Temporal Cortex

What role does color play in the neural representation of complex shapes? We approached the question by measuring color responses of face-selective neurons, using fMRI-guided microelectrode recording of the middle and anterior face patches of inferior temporal cortex (IT) in rhesus macaques. Face-selective cells responded weakly to pure color (equiluminant) photographs of faces. But many of the cells nonetheless showed a bias for warm colors when assessed using images that preserved the luminance contrast relationships of the original photographs. This bias was also found for non-face-selective neurons. Fourier analysis uncovered two components: the first harmonic, accounting for most of the tuning, was biased toward reddish colors, corresponding to the L>M pole of the L-M cardinal axis. The second harmonic showed a bias for modulation between blue and yellow colors axis, corresponding to the S-cone axis. To test what role face-selective cells play in behavior, we related the information content of the neural population with the distribution of face colors. The analyses show that face-selective cells are not optimally tuned to discriminate face colors, but are consistent with the idea that face-selective cells contribute selectively to processing the green-red contrast of faces. The research supports the hypothesis that color-specific information related to the discrimination of objects, including faces, is handled by neural circuits that are independent of shape-selective cortex, as captured by the multistage parallel processing framework of IT (Lafer-Sousa and Conway, 2013).

Sensory disruption and sensory inequities in the Anthropocene

Anthropogenic disruptions to animal sensory ecology are as old as our species. But what about the effect on human sensory ecology? Human sensory dysfunction is increasing globally at great economic and health costs (mental, physical, and social). Contemporary sensory problems are directly tied to human behavioral changes and activity as well as anthropogenic pollution. The evolutionary sensory ecology and anthropogenic disruptions to three human senses (vision, audition, olfaction) are examined along with the economic and health costs of functionally reduced senses and demographic risk factors contributing to impairment. The primary goals of the paper are (a) to sew an evolutionary and ecological thread through clinical narratives on sensory dysfunction that highlights the impact of the built environment on the senses, and (b) to highlight structural, demographic, and environmental injustices that create sensory inequities in risk and that promote health disparities.

The Sensory and Perceptual Scaffolding of Absorption, Inner Speech, and Self in Psychosis

This study examines the interconnectedness between absorption, inner speech, self, and psychopathology. Absorption involves an intense focus and immersion in mental imagery, sensory/perceptual stimuli, or vivid imagination that involves decreased self-awareness and alterations in consciousness. In psychosis, the dissolution and permeability in the demarcation between self and one's sensory experiences and perceptions, and also between self-other and/or inter-object boundaries alter one's sense of self. Thus, as the individual integrates these changes new "meaning making" or understanding evolves as part of an ongoing inner dialogue and dialogue with others. This study consisted of 117 participants: 81 participants with psychosis and 36 controls. We first conducted a bivariate correlation to elucidate the relationship between absorption and inner speech. We next conducted hierarchical multiple regressions to examine the effect of absorption and inner speech to predict psychopathology. Lastly, we conducted a network analysis and applied extended Bayesian Information Criterion to select the best model. We showed that in both the control and psychosis group dialogic and emotional/motivational types of inner speech were strongly associated with absorption subscales, apart from the aesthetic subscale in the control group which was not significant, while in psychosis, condensed inner speech was uniquely associated with increased imaginative involvement. In psychosis, we also demonstrated that altered consciousness, dialogic, and emotional/motivational inner speech all predicted positive symptoms. In terms of network associations, imaginative involvement was the most central, influential, and most highly predictive node in the model from which all other nodes related to inner speech and psychopathology are connected. This study shows a strong interrelatedness between absorption, inner speech and psychosis thus identifying potentially fertile ground for future research and directions, particularly in the exploration into the underlying construct of imaginative involvement in psychotic symptoms.

Working Memory Maintenance Modulates Serial Dependence Effects of Perceived Emotional Expression

The stability of face perception is vital in interpersonal interactions. Recent studies have revealed the mechanism of the stability in the perception of stable attributes of faces (such as facial identity) by serial dependence, a phenomenon in which perception of current stimuli is pulled toward recently viewed stimuli. However, whether serial dependence of perceived emotional expression (a changeable attribute of faces) exists remains controversial, and its exact nature has not been examined yet. To address these issues, we used the methods of constant stimuli and two-interval forced choice tasks in three psychophysical experiments. Participants compared two successive facial expressions selected from a continuum with 50 morphed faces ranging from sad to happy. Experiment 1a and 1b showed that a perceived facial expression pulled toward previously seen facial expressions (i.e., a significant serial dependence effect), independent of response instructions. Furthermore, a stronger serial dependence effect was found when the first facial expression was retained in working memory for a longer delay duration (Experiment 2), and yet a weaker serial dependence effect was observed when a longer delay between decision and response was performed (Experiment 3). These findings indicate that serial dependence facilitates the stability of facial expression perception and is modulated by working memory representations.

Red color facilitates the detection of facial anger - But how much?

The color red seems to be consistently associated with the concept of anger. Beyond semantic associations, it has been suggested that the color red enhances our ability to perceive anger in faces. However, previous studies often lack proper color control or the results are confounded by the presence of several emotions. Moreover, the magnitude of the (potential) effect of red has not been quantified. To address these caveats, we quantified the effect of facial color and background color on anger with psychometric functions measured with the method-of-constant-stimuli while facial hue or surround hue was varied in CIELAB color space. Stimulus sequences were generated by morphing between neutral and angry faces. For the facial color, the average chromaticity of the faces was shifted by ΔE 12/20 in red, yellow, green and blue directions. For the background color, the hue was either neutral or saturated red, green or blue. Both facial redness and surround redness enhanced perceived anger slightly, by 3–4 morph-%. Other colors did not affect perceived anger. As the magnitude of the enhancement is generally small and the effect is robust only in a small subset of the participants, we question the practical significance of red in anger recognition.

Effects of Face and Background Color on Facial Expression Perception

Detecting others' emotional states from their faces is an essential component of successful social interaction. However, the ability to perceive emotional expressions is reported to be modulated by a number of factors. We have previously found that facial color modulates the judgment of facial expression, while another study has shown that background color plays a modulatory role. Therefore, in this study, we directly compared the effects of face and background color on facial expression judgment within a single experiment. Fear-to-anger morphed faces were presented in face and background color conditions. Our results showed that judgments of facial expressions was influenced by both face and background color. However, facial color effects were significantly greater than background color effects, although the color saturation of faces was lower compared to background colors. These results suggest that facial color is intimately related to the judgment of facial expression, over and above the influence of simple color.

Alexithymia Is Related to the Need for More Emotional Intensity to Identify Static Fearful Facial Expressions

Individuals with high levels of alexithymia, a personality trait marked by difficulties in identifying and describing feelings and an externally oriented style of thinking, appear to require more time to accurately recognize intense emotional facial expressions (EFEs). However, in everyday life, EFEs are displayed at different levels of intensity and individuals with high alexithymia may also need more emotional intensity to identify EFEs. Nevertheless, the impact of alexithymia on the identification of EFEs, which vary in emotional intensity, has largely been neglected. To address this, two experiments were conducted in which participants with low (LA) and high (HA) levels of alexithymia were assessed in their ability to identify static (Experiment 1) and dynamic (Experiment 2) morphed faces ranging from neutral to intense EFEs. Results showed that HA needed more emotional intensity than LA to identify static fearful – but not happy or disgusted – faces. On the contrary, no evidence was found that alexithymia affected the identification of dynamic EFEs. These results extend current literature suggesting that alexithymia is related to the need for more perceptual information to identify static fearful EFEs.