Eye movements are functional during face learning

Specified functions of the first two fixations in face recognition: Sampling the general-to-specific facial information

Visual perception is enacted and constrained by the constantly moving eyes. Although it is well known that the first two fixations are crucial for face recognition, the function of each fixation remains unspecified. Here we demonstrate a central-to-divergent pattern of the two fixations and specify their functions: Fix I clustered along the nose bridge to cover the broad facial information; Fix II diverged to eyes, nostrils, and lips to get the local information. Fix II correlated more than Fix I with the differentiating information between faces and contributed more to recognition responses. While face categories can be significantly discriminated by Fix II's but not Fix I's patterns alone, the combined patterns of the two yield better discrimination. Our results suggest a functional division and collaboration of the two fixations in sampling the general-to-specific facial information and add to understanding visual perception as an active process undertaken by structural motor programs.

Eye movement differences when recognising and learning moving and static faces

Seeing a face in motion can help subsequent face recognition. Several explanations have been proposed for this "motion advantage," but other factors that might play a role have received less attention. For example, facial movement might enhance recognition by attracting attention to the internal facial features, thereby facilitating identification. However, there is no direct evidence that motion increases attention to regions of the face that facilitate identification (i.e., internal features) compared with static faces. We tested this hypothesis by recording participants' eye movements while they completed the famous face recognition (Experiment 1, N = 32), and face-learning (Experiment 2, N = 60, Experiment 3, N = 68) tasks, with presentation style manipulated (moving or static). Across all three experiments, a motion advantage was found, and participants directed a higher proportion of fixations to the internal features (i.e., eyes, nose, and mouth) of moving faces versus static. Conversely, the proportion of fixations to the internal non-feature area (i.e., cheeks, forehead, chin) and external area (Experiment 3) was significantly reduced for moving compared with static faces (all ps < .05). Results suggest that during both familiar and unfamiliar face recognition, facial motion is associated with increased attention to internal facial features, but only during familiar face recognition is the magnitude of the motion advantage significantly related functionally to the proportion of fixations directed to the internal features.

Insights into the relationship between eye movements and personality traits in restricted visual fields

Previous studies have suggested behavioral patterns, such as visual attention and eye movements, relate to individual personality traits. However, these studies mainly focused on free visual tasks, and the impact of visual field restriction remains inadequately understood. The primary objective of this study is to elucidate the patterns of conscious eye movements induced by visual field restriction and to examine how these patterns relate to individual personality traits. Building on previous research, we aim to gain new insights through two behavioral experiments, unraveling the intricate relationship between visual behaviors and individual personality traits. As a result, both Experiment 1 and Experiment 2 revealed differences in eye movements during free observation and visual field restriction. Particularly, simulation results based on the analyzed data showed clear distinctions in eye movements between free observation and visual field restriction conditions. This suggests that eye movements during free observation involve a mixture of conscious and unconscious eye movements. Furthermore, we observed significant correlations between conscious eye movements and personality traits, with more pronounced effects in the visual field restriction condition used in Experiment 2 compared to Experiment 1. These analytical findings provide a novel perspective on human cognitive processes through visual perception.

Recognizing and Looking at Masked Emotional Faces in Alexithymia

Alexithymia is a clinically relevant personality construct characterized by difficulties identifying and communicating one's emotions and externally oriented thinking. Alexithymia has been found to be related to poor emotion decoding and diminished attention to the eyes. The present eye tracking study investigated whether high levels of alexithymia are related to impairments in recognizing emotions in masked faces and reduced attentional preference for the eyes. An emotion recognition task with happy, fearful, disgusted, and neutral faces with face masks was administered to high-alexithymic and non-alexithymic individuals. Hit rates, latencies of correct responses, and fixation duration on eyes and face mask were analyzed as a function of group and sex. Alexithymia had no effects on accuracy and speed of emotion recognition. However, alexithymic men showed less attentional preference for the eyes relative to the mask than non-alexithymic men, which was due to their increased attention to face masks. No fixation duration differences were observed between alexithymic and non-alexithymic women. Our data indicate that high levels of alexithymia might not have adverse effects on the efficiency of emotion recognition from faces wearing masks. Future research on gaze behavior during facial emotion recognition in high alexithymia should consider sex as a moderating variable.

Does culture moderate the encoding and recognition of negative cues? Evidence from an eye-tracking study

Cross-cultural research has elucidated many important differences between people from Western European and East Asian cultural backgrounds regarding how each group encodes and consolidates the contents of complex visual stimuli. While Western European groups typically demonstrate a perceptual bias towards centralised information, East Asian groups favour a perceptual bias towards background information. However, this research has largely focused on the perception of neutral cues and thus questions remain regarding cultural group differences in both the perception and recognition of negative, emotionally significant cues. The present study therefore compared Western European (n = 42) and East Asian (n = 40) participants on a free-viewing task and a subsequent memory task utilising negative and neutral social cues. Attentional deployment to the centralised versus background components of negative and neutral social cues was indexed via eye-tracking, and memory was assessed with a cued-recognition task two days later. While both groups demonstrated an attentional bias towards the centralised components of the neutral cues, only the Western European group demonstrated this bias in the case of the negative cues. There were no significant differences observed between Western European and East Asian groups in terms of memory accuracy, although the Western European group was unexpectedly less sensitive to the centralised components of the negative cues. These findings suggest that culture modulates low-level attentional deployment to negative information, however not higher-level recognition after a temporal interval. This paper is, to our knowledge, the first to concurrently consider the effect of culture on both attentional outcomes and memory for both negative and neutral cues.

Distinct eye movement patterns to complex scenes in Alzheimer's disease and Lewy body disease

Background

Alzheimer's disease (AD) and Lewy body disease (LBD), the two most common causes of neurodegenerative dementia with similar clinical manifestations, both show impaired visual attention and altered eye movements. However, prior studies have used structured tasks or restricted stimuli, limiting the insights into how eye movements alter and differ between AD and LBD in daily life.

Objective

We aimed to comprehensively characterize eye movements of AD and LBD patients on naturalistic complex scenes with broad categories of objects, which would provide a context closer to real-world free viewing, and to identify disease-specific patterns of altered eye movements.

Methods

We collected spontaneous viewing behaviors to 200 naturalistic complex scenes from patients with AD or LBD at the prodromal or dementia stage, as well as matched control participants. We then investigated eye movement patterns using a computational visual attention model with high-level image features of object properties and semantic information.

Results

Compared with matched controls, we identified two disease-specific altered patterns of eye movements: diminished visual exploration, which differentially correlates with cognitive impairment in AD and with motor impairment in LBD; and reduced gaze allocation to objects, attributed to a weaker attention bias toward high-level image features in AD and attributed to a greater image-center bias in LBD.

Conclusion

Our findings may help differentiate AD and LBD patients and comprehend their real-world visual behaviors to mitigate the widespread impact of impaired visual attention on daily activities.

Common structure of saccades and microsaccades in visual perception

We obtain large amounts of external information through our eyes, a process often considered analogous to picture mapping onto a camera lens. However, our eyes are never as still as a camera lens, with saccades occurring between fixations and microsaccades occurring within a fixation. Although saccades are agreed to be functional for information sampling in visual perception, it remains unknown if microsaccades have a similar function when eye movement is restricted. Here, we demonstrated that saccades and microsaccades share common spatiotemporal structures in viewing visual objects. Twenty-seven adults viewed faces and houses in free-viewing and fixation-controlled conditions. Both saccades and microsaccades showed distinctive spatiotemporal patterns between face and house viewing that could be discriminated by pattern classifications. The classifications based on saccades and microsaccades could also be mutually generalized. Importantly, individuals who showed more distinctive saccadic patterns between faces and houses also showed more distinctive microsaccadic patterns. Moreover, saccades and microsaccades showed a higher structure similarity for face viewing than house viewing and a common orienting preference for the eye region over the mouth region. These findings suggested a common oculomotor program that is used to optimize information sampling during visual object perception.

Depressive symptoms and visual attention to others' eyes in healthy individuals

BACKGROUND

Eye contact is a fundamental part of social interaction. In clinical studies, it has been observed that patients suffering from depression make less eye contact during interviews than healthy individuals, which could be a factor contributing to their social functioning impairments. Similarly, results from mood induction studies with healthy persons indicate that attention to the eyes diminishes as a function of sad mood. The present screen-based eye-tracking study examined whether depressive symptoms in healthy individuals are associated with reduced visual attention to other persons' direct gaze during free viewing.

METHODS

Gaze behavior of 44 individuals with depressive symptoms and 49 individuals with no depressive symptoms was analyzed in a free viewing task. Grouping was based on the Beck Depression Inventory using the cut-off proposed by Hautzinger et al. (2006). Participants saw pairs of faces with direct gaze showing emotional or neutral expressions. One-half of the face pairs was shown without face masks, whereas the other half was presented with face masks. Participants' dwell times and first fixation durations were analyzed.

RESULTS

In case of unmasked facial expressions, participants with depressive symptoms looked shorter at the eyes compared to individuals without symptoms across all expression conditions. No group difference in first fixation duration on the eyes of masked and unmasked faces was observed. Individuals with depressive symptoms dwelled longer on the mouth region of unmasked faces. For masked faces, no significant group differences in dwell time on the eyes were found. Moreover, when specifically examining dwell time on the eyes of faces with an emotional expression there were also no significant differences between groups. Overall, participants gazed significantly longer at the eyes in masked compared to unmasked faces.

CONCLUSIONS

For faces without mask, our results suggest that depressiveness in healthy individuals goes along with less visual attention to other persons' eyes but not with less visual attention to others' faces. When factors come into play that generally amplify the attention directed to the eyes such as face masks or emotions then no relationship between depressiveness and visual attention to the eyes can be established.

More Than Meets the Eyes: Bringing Attention to the Eyes Increases First Impressions of Warmth and Competence

The present research examined how face masks alter first impressions of warmth and competence for different racial groups. Participants were randomly assigned to view photographs of White, Black, and Asian targets with or without masks. Across four separate studies (total N = 1,012), masked targets were rated significantly higher in warmth and competence compared with unmasked targets, regardless of their race. However, Asian targets benefited the least from being seen masked compared with Black or White targets. Studies 3 and 4 demonstrate how the positive effect of masks is likely due to these clothing garments re-directing attention toward the eyes of the wearer. Participants viewing faces cropped to the eyes (Study 3), or instructed to gaze into the eyes of faces (Study 4), rated these targets similarly to masked targets, and higher than unmasked targets. Neither political affiliation, belief in mask effectiveness, nor explicit racial prejudice moderated any hypothesized effects.

Neuromodulator Assessment and Treatment for the Upper Face: An Update

Neuromodulator treatment of the upper face has been extensively studied and serves as an excellent tool to enhance facial appearance, non-verbal communication, and social functioning. Optimal outcomes are best achieved when health care providers take an individualized approach, based on knowledge of structural and functional anatomy, thorough facial assessment, and customized injection techniques and patterns.

Are older adults susceptible to visual distraction when targets and distractors are spatially separated?

Older adults show preserved memory for previously distracting information due to reduced inhibitory control. In some previous studies, targets and distractors overlap both temporally and spatially. We investigated whether age differences in attentional orienting and disengagement affect recognition memory when targets and distractors are spatially separated at encoding. In Experiments 1 and 2, eye movements were recorded while participants completed an incidental encoding task under covert (i.e., restricted viewing) and overt (i.e., free-viewing) conditions, respectively. The encoding task consisted of pairs of target and distractor item-color stimuli presented in separate visual hemifields. Prior to stimulus onset, a central cue indicated the location of the upcoming target. Participants were subsequently tested on their recognition of the items, their location, and the associated color. In Experiment 3, targets were validly cued on 75% of the encoding trials; on invalid trials, participants had to disengage their attention from the distractor and reorient to the target. Associative memory for colors was reduced among older adults across all experiments, though their location memory was only reduced in Experiment 1. In Experiment 2, older and younger adults directed a similar proportion of fixations toward targets and distractors. Explicit recognition of distractors did not differ between age groups in any of the experiments. However, older adults were slower to correctly recognize distractors than false alarm to novel items in Experiment 2, suggesting some implicit memory for distraction. Together, these results demonstrate that older adults may only be vulnerable to encoding visual distraction when viewing behavior is unconstrained.

Holistic and featural processing's link to face recognition varies by individual and task

While it is generally accepted that holistic processing facilitates face recognition, recent studies suggest that poor recognition might also arise from imprecise perception of local features in the face. This study aimed to examine to what extent holistic and featural processing relates to individual differences in face recognition ability (FRA), during face learning (Experiment 1) and face recognition (Experiment 2). Participants performed two tasks: (1) The "Cambridge Face Memory Test-Chinese" which measured participants' FRAs, and (2) an "old/new recognition memory test" encompassing whole faces (preserving holistic and featural processing) and faces revealed through a dynamic aperture (impairing holistic processing but preserving featural processing). Our results showed that participants recognised faces more accurately in conditions when holistic information was preserved, than when it is impaired. We also show that the better use of holistic processing during face learning and face recognition was associated with better FRAs. However, enhanced featural processing during recognition, but not during learning, was related to better FRAs. Together, our findings demonstrate that good face recognition depends on distinct roles played by holistic and featural processing at different stages of face recognition.

Effects of internally directed cognition on smooth pursuit eye movements: A systematic examination of perceptual decoupling

Eye behavior differs between internally and externally directed cognition and thus is indicative of an internal versus external attention focus. Recent work implicated perceptual decoupling (i.e., eye behavior becoming less determined by the sensory environment) as one of the key mechanisms involved in these attention-related eye movement differences. However, it is not yet understood how perceptual decoupling depends on the characteristics of the internal task. Therefore, we systematically examined effects of varying internal task demands on smooth pursuit eye movements. Specifically, we evaluated effects of the internal workload (control vs. low vs. high) and of internal task (arithmetic vs. visuospatial). The results of multilevel modelling showed that effects of perceptual decoupling were stronger for higher workload, and more pronounced for the visuospatial modality. Effects also followed a characteristic time-course relative to internal operations. The findings provide further support of the perceptual decoupling mechanism by showing that it is sensitive to the degree of interference between external and internal information.

Face masks are less effective than sunglasses in masking face identity

The effect of covering faces on face identification is recently garnering interest amid the COVID-19 pandemic. Here, we investigated how face identification performance was affected by two types of face disguise: sunglasses and face masks. Observers studied a series of faces; then judged whether a series of test faces, comprising studied and novel faces, had been studied before or not. Face stimuli were presented either without coverings (full faces), wearing sunglasses covering the upper region (eyes, eyebrows), or wearing surgical masks covering the lower region (nose, mouth, chin). We found that sunglasses led to larger reductions in sensitivity (d') to face identity than face masks did, while both disguises increased the tendency to report faces as studied before, a bias that was absent for full faces. In addition, faces disguised during either study or test only (i.e. study disguised faces, test with full faces; and vice versa) led to further reductions in sensitivity from both studying and testing with disguised faces, suggesting that congruence between study and test is crucial for memory retrieval. These findings implied that the upper region of the face, including the eye-region features, is more diagnostic for holistic face-identity processing than the lower face region.

Holistic processing and visual characteristics of regulated and spontaneous expressions

The rapid and efficient recognition of facial expressions is crucial for adaptive behaviors, and holistic processing is one of the critical processing methods to achieve this adaptation. Therefore, this study integrated the effects and attentional characteristics of the authenticity of facial expressions on holistic processing. The results show that both regulated and spontaneous expressions were processed holistically. However, the spontaneous expression details did not indicate typical holistic processing, with the congruency effect observed equally for aligned and misaligned conditions. No significant difference between the two expressions was observed in terms of reaction times and eye movement characteristics (i.e., total fixation duration, fixation counts, and first fixation duration). These findings suggest that holistic processing strategies differ between the two expressions. Nevertheless, the difference was not reflected in attentional engagement.

Eyes don't lie: Eye movements differ during covert and overt autobiographical recall

In everyday life, autobiographical memories are revisited silently (i.e., covert recall) or shared with others (i.e., overt recall), yet most research regarding eye movements and autobiographical recall has focused on overt recall. With that in mind, the aim of the current study was to evaluate eye movements during the retrieval of autobiographical memories (with a focus on emotion), recollected during covert and overt recall. Forty-three participants recalled personal memories out loud and silently, while wearing eye-tracking glasses, and rated these memories in terms of mental imagery and emotional intensity. Analyses showed fewer and longer fixations, fewer and shorter saccades, and fewer blinks during covert recall compared with overt recall. Participants perceived more mental images and had a more intense emotional experience during covert recall. These results are discussed considering cognitive load theories and the various functions of autobiographical recall. We theorize that fewer and longer fixations during covert recall may be due to more intense mental imagery. This study enriches the field of research on eye movements and autobiographical memory by addressing how we retrieve memories silently, a common activity of everyday life. More broadly, our results contribute to building objective tools to measure autobiographical memory, alongside already existing subjective scales.

The Unique Cost of Human Eye Gaze in Cognitive Control: Being Human-Specific and Body-Related?

This study investigated the eye gaze cost in cognitive control and whether it is human-specific and body-related. In Experiment 1, we explored whether there was a cost of human eye gaze in cognitive control and extended it by focusing on the role of emotion in the cost. Stroop effect was found to be larger in eye-gaze condition than vertical grating condition, and to be comparable across positive, negative, and neutral trials. In Experiment 2, we explored whether the eye gaze cost in cognitive control was limited to human eyes. No larger Stroop effect was found in feline eye-gaze condition, neither the modulating role of emotion. In Experiment 3, we explored whether the mouth could elicit a cost in Stroop effect. Stroop effect was not significantly larger in mouth condition compared to vertical grating condition, nor across positive, negative, and neutral conditions. The results suggest that: (1) There is a robust cost of eye gaze in cognitive control; (2) Such eye-gaze cost was specific to human eyes but not to animal eyes; (3) Only human eyes could have such eye-gaze costs but not human mouth. This study supported the notion that presentation of social cues, such as human eyes, could influence attentional processing, and provided preliminary evidence that the human eye plays an important role in cognitive processing.

Age Effects in Emotional Memory and Associated Eye Movements

Mnemonic enhanced memory has been observed for negative events. Here, we investigate its association with spatiotemporal attention, consolidation, and age. An ingenious method to study visual attention for emotional stimuli is eye tracking. Twenty young adults and twenty-one older adults encoded stimuli depicting neutral faces, angry faces, and houses while eye movements were recorded. The encoding phase was followed by an immediate and delayed (48 h) recognition assessment. Linear mixed model analyses of recognition performance with group, emotion, and their interaction as fixed effects revealed increased performance for angry compared to neutral faces in the young adults group only. Furthermore, young adults showed enhanced memory for angry faces compared to older adults. This effect was associated with a shorter fixation duration for angry faces compared to neutral faces in the older adults group. Furthermore, the results revealed that total fixation duration was a strong predictor for face memory performance.

Positive and negative facial valence perception are modulated differently by eccentricity in the parafovea

Understanding whether people around us are in a good, bad or neutral mood can be critical to our behavior, both when looking directly at them or when they are in our peripheral visual field. However, facial expressions of emotions are often investigated at central visual field or at locations right or left of fixation. Here we assumed that perception of facial emotional valence (the emotion's pleasantness) changes with distance from central visual field (eccentricity) and that different emotions may be influenced differently by eccentricity. Participants (n = 58) judged the valence of emotional faces across the parafovea (≤ 4°, positive (happy), negative (fearful), or neutral)) while their eyes were being tracked. As expected, performance decreased with eccentricity. Positive valence perception was least affected by eccentricity (accuracy reduction of 10-19% at 4°) and negative the most (accuracy reduction of 35-38% at 4°), and this was not a result of speed-accuracy trade-off or response biases. Within-valence (but not across-valence) performance was associated across eccentricities suggesting perception of different valences is supported by different mechanisms. While our results may not generalize to all positive and negative emotions, they indicate that beyond-foveal investigations can reveal additional characteristics of the mechanisms that underlie facial expression processing and perception.

The extent and specificity of visual exploration determines the formation of recollected memories in complex scenes

Our visual memories of complex scenes often appear as robust, detailed records of the past. Several studies have demonstrated that active exploration with eye movements improves recognition memory for scenes, but it is unclear whether this improvement is due to stronger feelings of familiarity or more detailed recollection. We related the extent and specificity of fixation patterns at encoding and retrieval to different recognition decisions in an incidental memory paradigm. After incidental encoding of 240 real-world scene photographs, participants (N = 44) answered a surprise memory test by reporting whether an image was new, remembered (indicating recollection), or just known to be old (indicating familiarity). To assess the specificity of their visual memories, we devised a novel report procedure in which participants selected the scene region that they specifically recollected, that appeared most familiar, or that was particularly new to them. At encoding, when considering the entire scene,subsequently recollected compared to familiar or forgotten scenes showed a larger number of fixations that were more broadly distributed, suggesting that more extensive visual exploration determines stronger and more detailed memories. However, when considering only the memory-relevant image areas, fixations were more dense and more clustered for subsequently recollected compared to subsequently familiar scenes. At retrieval, the extent of visual exploration was more restricted for recollected compared to new or forgotten scenes, with a smaller number of fixations. Importantly, fixation density and clustering was greater in memory-relevant areas for recollected versus familiar or falsely recognized images. Our findings suggest that more extensive visual exploration across the entire scene, with a subset of more focal and dense fixations in specific image areas, leads to increased potential for recollecting specific image aspects.

The role of discriminability in face perception: Interference processing of expression, gender, and gaze

Eye gaze plays a fundamental role in social interaction and facial recognition. However, interference processing between gaze and other facial variants (e.g., expression) and invariant information (e.g., gender) remains controversial and unclear, especially the role of facial information discriminability in interference. A Garner paradigm was used to conduct two experiments. This paradigm allows simultaneous investigation of the mutual influence of two kinds of facial information in one experiment. In Experiment 1, we manipulated facial expression discriminability and investigated its role in interference processing of gaze and facial expression. The results show that individuals were unable to ignore expression when classifying gaze with both high and low discriminability but could ignore gaze when classifying expression with high discriminability only. In Experiment 2, we manipulated gender discriminability and investigated its function in interference processing of gaze and gender. Participants were unable to ignore gender when classifying gaze with both high and low discriminability but could ignore gaze when classifying gender with low discriminability only. The results indicate that gaze categorization is affected by facial expression and gender regardless of facial information discriminability, whereas interference of gaze on facial expression and gender depends on the degree of discriminability. The present study provides evidence that the processing of gaze and other variant and invariant information is interdependent.

Impact of similarity on recognition of faces of Black and White targets

One reason for the persistence of racial inequality may be anticipated dissimilarity with racial outgroups. In the present research, we explored the impact of perceived similarity with White and Black targets on facial identity recognition accuracy. In two studies, participants first completed an ostensible personality survey. Next, in a Learning Phase, Black and White faces were presented on one of three background colours. Participants were led to believe that these colours indicated similarities between them and the target person in the image. Specifically, they were informed that the background colours were associated with the extent to which responses by the target person on the personality survey and their own responses overlapped. In actual fact, faces were randomly assigned to colour. In both studies, non-Black participants (Experiment 1) and White participants (Experiment 2) showed better recognition of White than Black faces. More importantly in the present context, a positive linear effect of similarity was found in both studies, with better recognition of increasingly similar Black and White targets. The independent effects for race of target and similarity, with no interaction, indicated that participants responded to Black and White faces according to category membership as well as on an interpersonal level related to similarity with specific targets. Together these findings suggest that while perceived similarity may enhance identity recognition accuracy for Black and White faces, it may not reduce differences in facial memory for these racial categories.

Own Race Eye-Gaze Bias for All Emotional Faces but Accuracy Bias Only for Sad Expressions

Own race faces tend to be recognized more accurately than those of other less familiar races, however, findings to date have been inconclusive. The present study aimed to determine whether Chinese exhibit different recognition accuracy and eye gaze patterns for Asian (own-race) and White (other-race) facial expressions (neutral, happiness, sadness, anger, disgust, fear). A total of 89 healthy Chinese adults viewed Asian and White facial expressions while undergoing eye-tracking and were subsequently required to identify expressions and rate their intensity and effect on arousal. Results revealed that subjects recognized sad expressions in Asian faces better than in White ones. On the other hand, recognition accuracy was higher for White neutral, happy, fearful, and disgusted expressions although this may have been due to subjects more often misclassifying these Asian expressions as sadness. Moreover, subjects viewed the eyes of emotional expressions longer in Asian compared to White faces and the nose of sad ones, especially during the late phase of presentation, whereas pupil sizes, indicative of cognitive load and arousal, were smaller. Eye-gaze patterns were not, however, associated with recognition accuracy. Overall, findings demonstrate an own-race bias in Chinese for identifying sad expressions and more generally across emotional expressions in terms of viewing the eye region of emotional faces for longer and with reduced pupil size. Interestingly, subjects were significantly more likely to miss-identify Asian faces as sad resulting in an apparent other-race bias for recognizing neutral, happy, fearful, and disgusted expressions.

Understanding Everyday Events: Predictive-Looking Errors Drive Memory Updating

Memory-guided predictions can improve event comprehension by guiding attention and the eyes to the location where an actor is about to perform an action. But when events change, viewers may experience predictive-looking errors and need to update their memories. In two experiments (Ns = 38 and 98), we examined the consequences of mnemonic predictive-looking errors for comprehending and remembering event changes. University students watched movies of everyday activities with actions that were repeated exactly and actions that were repeated with changed features-for example, an actor reached for a paper towel on one occasion and a dish towel on the next. Memory guidance led to predictive-looking errors that were associated with better memory for subsequently changed event features. These results indicate that retrieving recent event features can guide predictions during unfolding events and that error signals derived from mismatches between mnemonic predictions and actual events contribute to new learning.

Impact of mask use on face recognition: an eye-tracking study

We examined how mask use affects performance and eye movements in face recognition and whether strategy change reflected in eye movements is associated with performance change. Eighty-eight participants performed face recognition with masked faces either during learning only, during recognition only, or during both learning and recognition. As compared with the baseline condition where faces were unmasked during both learning and recognition, participants had impaired performance in all three scenarios, with larger impairment when mask conditions during learning and recognition did not match. When recognizing unmasked faces, whether the faces were learned with or without a mask on did not change eye movement behavior. Nevertheless, when recognizing unmasked faces that were learned with a mask on, participants who adopted more eyes-focused patterns had less performance impairment as compared with the baseline condition. When recognizing masked faces, participants had more eyes-focused patterns and more consistent gaze transition behavior than recognizing unmasked faces regardless of whether the faces were learned with or without a mask on. Nevertheless, when recognizing masked faces that were learned without a mask, participants whose gaze transition behavior was more consistent had less performance impairment as compared with the baseline condition. Thus, although eye movements during recognition were mainly driven by the mask condition during recognition but not that during learning, those who adjusted their strategy according to the mask condition difference between learning and recognition had better performance. This finding has important implications for identifying populations vulnerable to the impact of mask use and potential remedial strategies.

The impact of aging and repetition on eye movements and recognition memory

The modulation of gaze fixations on neural activity in the hippocampus, a region critical for memory, has been shown to be weaker in older adults compared to younger adults. However, as such research has relied on indirect measures of memory, it remains unclear whether the relationship between visual exploration and direct measures of memory is similarly disrupted in aging. The current study tested older and younger adults on a face memory eye-tracking task previously used by our group that showed that recognition memory for faces presented across variable, but not fixed, viewpoints relies on a hippocampal-dependent binding function. Here, we examined how aging influences eye movement measures that reveal the amount (cumulative sampling) and extent (distribution of gaze fixations) of visual exploration. We also examined how aging influences direct (subsequent conscious recognition) and indirect (eye movement repetition effect) expressions of memory. No age differences were found in direct recognition regardless of facial viewpoint. However, the eye movement measures revealed key group differences. Compared to younger adults, older adults exhibited more cumulative sampling, a different distribution of fixations, and a larger repetition effect. Moreover, there was a positive relationship between cumulative sampling and direct recognition in younger adults, but not older adults. Neither age group showed a relationship between the repetition effect and direct recognition. Thus, despite similar direct recognition, age-related differences were observed in visual exploration and in an indirect eye-movement memory measure, suggesting that the two groups may acquire, retain, and use different facial information to guide recognition.

The Anatomy behind Eyebrow Positioning: A Clinical Guide Based on Current Anatomic Concepts

BACKGROUND

The position of the eyebrow is known to reflect emotional status and to provide a plethora of nonverbal information. Although the eyebrow has no direct attachment to underlying bone, it is subject to the interplay between the various periorbital muscles, which when acting together, permit important nonverbal cues to be conveyed. Understanding the balance and interplay between these muscles is of crucial importance when targeting the periorbital area with neuromodulators. The authors' aims were to summarize current anatomic and clinical knowledge so as to provide a foundation that physicians can rely on to improve and increase the predictability of patient outcomes when treating the periorbital region with neuromodulators for aesthetic purposes.

METHODS

This narrative review is based on the anatomic and clinical experience of the authors dissecting and treating the periorbital region with specific focus on the glabella and the forehead.

RESULTS

This narrative review covers (1) a brief description of the relevant periorbital muscle anatomy, (2) an analysis of each muscle's contribution to various facial expressions, and (3) an anatomic and physiologic simulation of the muscular effects of specific neuromodulator injection sites.

CONCLUSION

By understanding functional anatomy of the periorbital muscles and combining this knowledge with individualized assessment and treatment planning, it is possible to achieve aesthetically pleasing, predictable, and reproducible treatment outcomes that positively impact perception of nonverbal cues when administering neuromodulators.

Eye Size Affects Cuteness in Different Facial Expressions and Ages

Researchers have suggested that infants exhibiting baby schema are considered cute. These similar studies have mainly focused on changes in overall baby schema facial features. However, whether a change in only eye size affects the perception of cuteness across different facial expressions and ages has not been explicitly evaluated until now. In the present study, a paired comparison method and 7-point scale were used to investigate the effects of eye size on perceived cuteness across facial expressions (positive, neutral, and negative) and ages (adults and infants). The results show that stimuli with large eyes were perceived to be cuter than both unmanipulated eyes and small eyes across all facial expressions and age groups. This suggests not only that the effect of baby schema on cuteness is based on changes in a set of features but also that eye size as an individual feature can affect the perception of cuteness.

Working memory and active sampling of the environment: Medial temporal contributions

Working memory (WM) refers to the ability to maintain and actively process information-either derived from perception or long-term memory (LTM)-for intelligent thought and action. This chapter focuses on the contributions of the temporal lobe, particularly medial temporal lobe (MTL) to WM. First, neuropsychological evidence for the involvement of MTL in WM maintenance is reviewed, arguing for a crucial role in the case of retaining complex relational bindings between memorized features. Next, MTL contributions at the level of neural mechanisms are covered-with a focus on WM encoding and maintenance, including interactions with ventral temporal cortex. Among WM use processes, we focus on active sampling of environmental information, a key input source to capacity-limited WM. MTL contributions to the bidirectional relationship between active sampling and memory are highlighted-WM control of active sampling and sampling as a way of selecting input to WM. Memory-based sampling studies relying on scene and object inspection, visual-based exploration behavior (e.g., vicarious behavior), and memory-guided visual search are reviewed. The conclusion is that MTL serves an important function in the selection of information from perception and transfer from LTM to capacity-limited WM.

Data-driven analysis of gaze patterns in face perception: Methodological and clinical contributions

Gaze patterns during face perception have been shown to relate to psychiatric symptoms. Standard analysis of gaze behavior includes calculating fixations within arbitrarily predetermined areas of interest. In contrast to this approach, we present an objective, data-driven method for the analysis of gaze patterns and their relation to diagnostic test scores. This method was applied to data acquired in an adult sample (N = 111) of psychiatry outpatients while they freely looked at images of human faces. Dimensional symptom scores of autism, attention deficit, and depression were collected. A linear regression model based on Principal Component Analysis coefficients computed for each participant was used to model symptom scores. We found that specific components of gaze patterns predicted autistic traits as well as depression symptoms. Gaze patterns shifted away from the eyes with increasing autism traits, a well-known effect. Additionally, the model revealed a lateralization component, with a reduction of the left visual field bias increasing with both autistic traits and depression symptoms independently. Taken together, our model provides a data-driven alternative for gaze data analysis, which can be applied to dimensionally-, rather than categorically-defined clinical subgroups within a variety of contexts. Methodological and clinical contribution of this approach are discussed.

Human face and gaze perception is highly context specific and involves bottom-up and top-down neural processing

This review summarizes human perception and processing of face and gaze signals. Face and gaze signals are important means of non-verbal social communication. The review highlights that: (1) some evidence is available suggesting that the perception and processing of facial information starts in the prenatal period; (2) the perception and processing of face identity, expression and gaze direction is highly context specific, the effect of race and culture being a case in point. Culture affects by means of experiential shaping and social categorization the way in which information on face and gaze is collected and perceived; (3) face and gaze processing occurs in the so-called 'social brain'. Accumulating evidence suggests that the processing of facial identity, facial emotional expression and gaze involves two parallel and interacting pathways: a fast and crude subcortical route and a slower cortical pathway. The flow of information is bi-directional and includes bottom-up and top-down processing. The cortical networks particularly include the fusiform gyrus, superior temporal sulcus (STS), intraparietal sulcus, temporoparietal junction and medial prefrontal cortex.

Visual scanpath training to emotional faces following severe traumatic brain injury: A single case design

The visual scanpath to emotional facial expressions was recorded in BR, a 35-year-old male with chronic severe traumatic brain injury (TBI), both before and after he underwent intervention. The novel intervention paradigm combined visual scanpath training with verbal feedback and was implemented over a 3-month period using a single case design (AB) with one follow up session. At baseline BR's scanpath was restricted, characterised by gaze allocation primarily to salient facial features on the right side of the face stimulus. Following intervention his visual scanpath became more lateralised, although he continued to demonstrate an attentional bias to the right side of the face stimulus. This study is the first to demonstrate change in both the pattern and the position of the visual scanpath to emotional faces following intervention in a person with chronic severe TBI. In addition, these findings extend upon our previous work to suggest that modification of the visual scanpath through targeted facial feature training can support improved facial recognition performance in a person with severe TBI.

Naïve and Experienced Honeybee Foragers Learn Normally Configured Flowers More Easily Than Non-configured or Highly Contrasted Flowers

Angiosperms have evolved to attract and/or deter specific pollinators. Flowers provide signals and cues such as scent, colour, size, pattern, and shape, which allow certain pollinators to more easily find and visit the same type of flower. Over evolutionary time, bees and angiosperms have co-evolved resulting in flowers being more attractive to bee vision and preferences, and allowing bees to recognise specific flower traits to make decisions on where to forage. Here we tested whether bees are instinctively tuned to process flower shape by training both flower-experienced and flower-naïve honeybee foragers to discriminate between pictures of two different flower species when images were either normally configured flowers or flowers which were scrambled in terms of spatial configuration. We also tested whether increasing picture contrast, to make flower features more salient, would improve or impair performance. We used four flower conditions: (i) normally configured greyscale flower pictures, (ii) scrambled flower configurations, (iii) high contrast normally configured flowers, and (iv) asymmetrically scrambled flowers. While all flower pictures contained very similar spatial information, both experienced and naïve bees were better able to learn to discriminate between normally configured flowers than between any of the modified versions. Our results suggest that a specialisation in flower recognition in bees is due to a combination of hard-wired neural circuitry and experience-dependent factors.

Impact of perceived interpersonal similarity on attention to the eyes of same-race and other-race faces

One reason for the persistence of racial discrimination may be anticipated dissimilarity with racial outgroup members that prevent meaningful interactions. In the present research, we investigated whether perceived similarity would impact the processing of same-race and other-race faces. Specifically, in two experiments, we varied the extent to which White participants were ostensibly similar to targets via bogus feedback on a personality test. With an eye tracker, we measured the effect of this manipulation on attention to the eyes, a critical region for person perception and face memory. In Experiment 1, we monitored the impact of perceived interpersonal similarity on White participants’ attention to the eyes of same-race White targets. In Experiment 2, we replicated this procedure, but White participants were presented with either same-race White targets or other-race Black targets in a between-subjects design. The pattern of results in both experiments indicated a positive linear effect of similarity—greater perceived similarity between participants and targets predicted more attention to the eyes of White and Black faces. The implications of these findings related to top-down effects of perceived similarity for our understanding of basic processes in face perception, as well as intergroup relations, are discussed.

Overestimation of eye size: People see themselves with bigger eyes in a holistic approach

A face contains crucial information for identification; moreover, face recognition is superior to other types of recognition. Notably, one's own face is recognized better than other familiar faces. However, it is unclear whether one's own face, especially one's own internal facial features, is represented more accurately than other faces. Here, we investigated how one's own internal facial features were represented. We conducted a psychological experiment in which the participants were required to adjust eye size to the real size in photos of their own or well-known celebrities' faces. To investigate why individuals' own and celebrity facial representations were different, two types of photos were prepared, with and without external features. It was found that the accuracy of eye size for one's own face was better than that for celebrities' faces in the condition without external features, in which holistic processing was less involved than in the condition with external features. This implies that the eye size of one's own face was represented more accurately than that of other familiar faces when external features were removed. Moreover, the accuracy of the eye size of one's own face in the condition with external features was worse than that in the condition without external features; the adjusted eye size in the condition with external features was larger than that in the condition without external features. In contrast, for celebrities' faces, there was no significant difference between the conditions with and without external features. The adjusted eye sizes in all conditions were overestimated compared to real eye sizes. Previous research indicated that eye size was adjusted to a larger size when evaluating as more attractive, in which the evaluation is related to holistic processing. Based on this perspective, it could be that one's own face was represented as more attractive in the condition with external features in the current study. Taken together, the results indicated that the representation of own eye size, which is an internal facial feature, was affected by the visibility of the external features.

Social Perception of Facial Feminization Surgery Outcomes: Does Gender Identity Alter Gaze?

BACKGROUND

The evaluation of gender-affirming facial feminization surgery (FFS) outcomes can be highly subjective, which has resulted in a limited understanding of the social perception of favorable gender and aesthetic facial appearance following FFS. Eye-tracking technology has introduced an objective measure of viewer subconscious gaze.

OBJECTIVES

The aim of this study was to use eye-tracking technology to measure attention and perception of surgery-naive cisgender female and feminized transgender faces, based on viewer gender identity.

METHODS

Thirty-two participants (18 cisgender and 14 transgender) were enrolled and shown 5 photographs each of surgery-naive cisgender female and feminized transgender faces. Gaze was captured with a Tobii Pro X2-60 eye-tracking device (Tobii, Stockholm, Sweden) and participants rated the gender and aesthetic appearance of each face on Likert-type scales.

RESULTS

Total image gaze fixation time did not differ by participant gender identity (6.00 vs 6.04 seconds, P = 0.889); however, transgender participants spent more time evaluating the forehead/brow, buccal/mandibular regions, and chin (P < 0.001). Multivariate regression analysis showed significant associations between viewer gender identity, age, race, and education, and the time spent evaluating gender salient facial features. Feminized faces were rated as more masculine with poorer aesthetic appearance than surgery-naive cisgender female faces; however, there was no significant difference in the distribution of gender appearance ratings assigned to each photograph by cisgender and transgender participants.

CONCLUSIONS

These results demonstrate that gender identity influences subconscious attention and gaze on female faces. Nevertheless, differences in gaze distribution did not correspond to subjective rated gender appearance for either surgery-naive cisgender female or feminized transgender faces, further illustrating the complexity of evaluating social perception of favorable FFS outcomes.

Automatic gaze to the nose region cannot be inhibited during observation of facial expression in Eastern observers

Humans can extract a great deal of information about others very quickly. This is partly because the face automatically captures observers' attention. Specifically, the eyes can attract overt attention. Although it has been reported that not only the eyes but also the nose can capture initial oculomotor movement in Eastern observers, its generalizability remains unknown. In this study, we applied the "don't look" paradigm wherein participants are asked not to fixate on a specific facial region (i.e., eyes, nose, and mouth) during an emotion recognition task with upright (Experiment 1) and inverted (Experiment 2) faces. In both experiments, we found that participants were less able to inhibit the initial part of their fixations to the nose, which can be interpreted as the nose automatically capturing attention. Along with previous studies, our overt attention tends to be attracted by a part of the face, which is the nose region in Easterner observers.

Neural Correlates of Subsequent Memory-Related Gaze Reinstatement

Mounting evidence linking gaze reinstatement-the recapitulation of encoding-related gaze patterns during retrieval-to behavioral measures of memory suggests that eye movements play an important role in mnemonic processing. Yet, the nature of the gaze scanpath, including its informational content and neural correlates, has remained in question. In this study, we examined eye movement and neural data from a recognition memory task to further elucidate the behavioral and neural bases of functional gaze reinstatement. Consistent with previous work, gaze reinstatement during retrieval of freely viewed scene images was greater than chance and predictive of recognition memory performance. Gaze reinstatement was also associated with viewing of informationally salient image regions at encoding, suggesting that scanpaths may encode and contain high-level scene content. At the brain level, gaze reinstatement was predicted by encoding-related activity in the occipital pole and BG, neural regions associated with visual processing and oculomotor control. Finally, cross-voxel brain pattern similarity analysis revealed overlapping subsequent memory and subsequent gaze reinstatement modulation effects in the parahippocampal place area and hippocampus, in addition to the occipital pole and BG. Together, these findings suggest that encoding-related activity in brain regions associated with scene processing, oculomotor control, and memory supports the formation, and subsequent recapitulation, of functional scanpaths. More broadly, these findings lend support to scanpath theory's assertion that eye movements both encode, and are themselves embedded in, mnemonic representations.

How Does Wearing a Facecover Influence the Eye Movement Pattern in Times of COVID-19?

Background

Since the emergence of the COVID-19 pandemic facecovers have become a common sight. The effect of facecovers on the gaze when looking at faces has not been assessed yet.

Objective

The aim of the present study is to investigate a potential difference in eye movement pattern in observes which are exposed to images showing a face without and with facecover to identify if there is truly a change of gaze when identifying (masked) facial features.

Materials and Methods

The eye movement of a total of 64 study participants (28 males and 36 females) with a mean age of 31.84±9.0 years was analyzed in this cross-sectional observational study. Eye movement analysis was conducted based on positional changes of eye features within an x- and y- coordinate system while two images (face without/with facecover) were displayed for 8 seconds.

Results

The results of this study revealed that the sequence of focussing on facial regions was not altered when wearing a facecover and followed the sequence: perioral, nose, periorbital. Wearing a facecover significantly increased the time of focussing on the periorbital region and increased also the number of repeated eye fixations during the interval of visual stimulus presentation. No statistically significant differences were observed between male and female participants in their eye movement pattern across all investigated variables with p > 0.433.

Conclusion

Aesthetic practitioners could utilized the presented data and develop marketing and treatment strategies which majorly target the periorbital area understanding the altered eye movement pattern in times of COVID-19.

Does face-selective cortex show a left visual field bias for centrally-viewed faces?

The left half of a centrally-viewed face contributes more strongly to recognition performance than the right. This left visual field (LVF) advantage is typically attributed to an untested assumption that face-selective cortex in the right hemisphere (RH) exhibits a contralateral bias, even for centrally-viewed faces. We tested the validity of this assumption using a behavioral measure of the LVF advantage and an fMRI experiment that measured laterality of face-selective cortex and neural contralateral bias. In the behavioral experiment, participants performed a chimeric face-matching task (Harrison and Strother, 2019). In the fMRI experiment, participants viewed chimeric faces comprised of face halves that either repeated or changed simultaneously in both hemifields, or repeated in one hemifield and changed in the other. This enabled us to measure lateralization of fMRI face-repetition suppression and hemifield-specific half-face sensitivity in face-selective cortex. We found that LVF bias in the fusiform face area (FFA) and right-lateralization of the FFA for changing versus repeated faces were both positively correlated with a behavioral measure of the LVF advantage for upright (but not inverted) faces. Results from regression analyses showed that LVF bias in the right FFA and FFA laterality make separable contributions to the prediction of our behavioral measure of the LVF bias for upright faces. Our results confirm a ubiquitous but previously untested assumption that RH superiority combined with contralateral bias in face-selective cortex explains the LVF advantage in face recognition. Specifically, our results show that neural LVF bias in the right FFA is sufficient to explain the relationship between FFA laterality and the perceptual LVF bias for centrally-viewed faces.

(Eye-) Tracking the Other-Race Effect: Comparison of Eye Movements During Encoding and Recognition of Ingroup Faces With Proximal and Distant Outgroup Faces

People experience difficulties recognizing faces of ethnic outgroups, known as the other-race effect. The present eye-tracking study investigates if this effect is related to differences in visual attention to ingroup and outgroup faces. We measured gaze fixations to specific facial features and overall eye-movement activity level during an old/new recognition task comparing ingroup faces with proximal and distal ethnic outgroup faces. Recognition was best for ingroup faces and decreased gradually for proximal and distal outgroup faces. Participants attended more to the eyes of ingroup faces than outgroup faces, but this effect was unrelated to recognition performance. Ingroup-outgroup differences in eye-movement activity level did not emerge during the study phase, but during the recognition phase, with ingroup-outgroup differences varying as a function of recognition accuracy and old/new effects. Overall, ingroup-outgroup effects on recognition performance and eye movements were more pronounced for recognition of new items, emphasizing the role of retrieval processes.

A consensus-based elastic matching algorithm for mapping recall fixations onto encoding fixations in the looking-at-nothing paradigm

We present an algorithmic method for aligning recall fixations with encoding fixations, to be used in looking-at-nothing paradigms that either record recall eye movements during silence or want to speed up data analysis with recordings of recall data during speech. The algorithm utilizes a novel consensus-based elastic matching algorithm to estimate which encoding fixations correspond to later recall fixations. This is not a scanpath comparison method, as fixation sequence order is ignored and only position configurations are used. The algorithm has three internal parameters and is reasonable stable over a wide range of parameter values. We then evaluate the performance of our algorithm by investigating whether the recalled objects identified by the algorithm correspond with independent assessments of what objects in the image are marked as subjectively important. Our results show that the mapped recall fixations align well with important regions of the images. This result is exemplified in four groups of use cases: to investigate the roles of low-level visual features, faces, signs and text, and people of different sizes, in recall of encoded scenes. The plots from these examples corroborate the finding that the algorithm aligns recall fixations with the most likely important regions in the images. Examples also illustrate how the algorithm can differentiate between image objects that have been fixated during silent recall vs those objects that have not been visually attended, even though they were fixated during encoding.

Do portrait artists have enhanced face processing abilities? Evidence from hidden Markov modeling of eye movements

Recent research has suggested the importance of part-based information in face recognition in addition to global, whole-face information. Nevertheless, face drawing experience was reported to enhance selective attention to the eyes but did not improve face recognition performance, leading to speculations about limited plasticity in adult face recognition. Here we examined the mechanism underlying the limited advantage of face drawing experience in face recognition through the Eye Movement analysis with Hidden Markov Models (EMHMM) approach. We found that portrait artists showed more eyes-focused eye movement patterns and outperformed novices in face matching, and participants' drawing rating was correlated with both eye movement pattern and performance. In contrast, portrait artists did not outperform novices and did not differ from novices in eye movement pattern in either the face recognition or part-whole tasks, although the eyes-focused pattern was associated with better recognition performance and longer response times in the whole condition relative to the part condition. Interestingly, in contrast to the face recognition and part-whole tasks, participants' performance in face matching was predicted by their drawing rating but not eye movement pattern. These results suggested that artists' advantage in face processing is specific to tasks similar to their drawing experience such as face matching, and may be related to their better ability in extracting identity-invariant information between two faces rather than more eyes-focused eye movement patterns.

A Unique Visual Attention Profile Associated With the FMR1 Premutation

Atypical visual attention patterns have been observed among carriers of the fragile X mental retardation gene (FMR1) premutation (PM), with some similarities to visual attention patterns observed in autism spectrum disorder (ASD) and among clinically unaffected relatives of individuals with ASD. Patterns of visual attention could constitute biomarkers that can help to inform the neurocognitive profile of the PM, and that potentially span diagnostic boundaries. This study examined patterns of eye movement across an array of fixation measurements from three distinct eye-tracking tasks in order to investigate potentially overlapping profiles of visual attention among PM carriers, ASD parents, and parent controls. Logistic regression analyses were conducted to examine whether variables constituting a PM-specific looking profile were able to effectively predict group membership. Participants included 65PM female carriers, 188 ASD parents, and 84 parent controls. Analyses of fixations across the eye-tracking tasks, and their corresponding areas of interest, revealed a distinct visual attention pattern in carriers of the FMR1 PM, characterized by increased fixations on the mouth when viewing faces, more intense focus on bodies in socially complex scenes, and decreased fixations on salient characters and faces while narrating a wordless picture book. This set of variables was able to successfully differentiate individuals with the PM from controls (Sensitivity = 0.76, Specificity = 0.85, Accuracy = 0.77) as well as from ASD parents (Sensitivity = 0.70, Specificity = 0.80, Accuracy = 0.72), but did not show a strong distinction between ASD parents and controls (Accuracy = 0.62), indicating that this set of variables comprises a profile that is unique to PM carriers. Regarding predictive power, fixations toward the mouth when viewing faces was able to differentiate PM carriers from both ASD parents and controls, whereas fixations toward other social stimuli did not differentiate PM carriers from ASD parents, highlighting some overlap in visual attention patterns that could point toward shared neurobiological mechanisms. Results demonstrate a profile of visual attention that appears strongly associated with the FMR1 PM in women, and may constitute a meaningful biomarker.