Age-related deficits in face recognition are related to underlying changes in scanning behavior

Effects of age on behavioural and eye gaze on Theory of Mind using movie for social cognition

Evidence has shown that older adults have lower accuracy in Theory of Mind (ToM) tasks compared with young adults, but we are still unclear whether the difficulty in decoding mental states in older adults stems from not looking at the critical areas, and more so from the ageing Asian population. Most ToM studies use static images or short vignettes to measure ToM but these stimuli are dissimilar to everyday social interactions. We investigated this question using a dynamic task that measured both accuracy and error types, and examined the links between accuracy and error types to eye gaze fixation at critical areas (e.g., eyes, mouth, body). A total of 82 participants (38 older, 44 young adults) completed the Movie for the Assessment of Social Cognition (MASC) task on the eye tracker. Results showed that older adults had a lower overall accuracy with more errors in the ipo-ToM (under-mentalising) and no-ToM (lack of mentalisation) conditions compared with young adults. We analysed the eye gaze data using principal components analysis and found that increasing age and looking less at the face were related to lower MASC accuracy in our participants. Our findings suggest that ageing deficits in ToM are linked to a visual attention deficit specific to the perception of socially relevant nonverbal cues.

Scene construction in healthy aging - Exploring the interplay between task complexity and oculomotor behaviour

Mounting evidence indicates a close correspondence between episodic memory, mental imagery, and oculomotor behaviour. It remains unclear, however, how oculomotor variables support endogenously driven forms of mental imagery and how this relationship changes across the adult lifespan. In this study we investigated age-related changes in oculomotor signatures during scene construction and explored how task complexity impacts these processes. Younger and cognitively healthy older participants completed a guided scene construction paradigm where scene complexity was manipulated according to the number of elements to be sequentially integrated. We recorded participants' eye movements and collected subjective ratings regarding their phenomenological experience. Overall, older adults rated their constructions as more vivid and more spatially integrated, while also generating more fixations and saccades relative to the younger group, specifically on control trials. Analyses of participants' total scan paths revealed that, in the early stages of scene construction, oculomotor behaviour changed as a function of task complexity within each group. Following the introduction of a second stimulus, older but not younger adults showed a significant decrease in the production of eye movements. Whether this shift in oculomotor behaviour serves a compensatory function to bolster task performance represents an important question for future research.

Age Effects in Emotional Memory and Associated Eye Movements

Mnemonic enhanced memory has been observed for negative events. Here, we investigate its association with spatiotemporal attention, consolidation, and age. An ingenious method to study visual attention for emotional stimuli is eye tracking. Twenty young adults and twenty-one older adults encoded stimuli depicting neutral faces, angry faces, and houses while eye movements were recorded. The encoding phase was followed by an immediate and delayed (48 h) recognition assessment. Linear mixed model analyses of recognition performance with group, emotion, and their interaction as fixed effects revealed increased performance for angry compared to neutral faces in the young adults group only. Furthermore, young adults showed enhanced memory for angry faces compared to older adults. This effect was associated with a shorter fixation duration for angry faces compared to neutral faces in the older adults group. Furthermore, the results revealed that total fixation duration was a strong predictor for face memory performance.

The role of discriminability in face perception: Interference processing of expression, gender, and gaze

Eye gaze plays a fundamental role in social interaction and facial recognition. However, interference processing between gaze and other facial variants (e.g., expression) and invariant information (e.g., gender) remains controversial and unclear, especially the role of facial information discriminability in interference. A Garner paradigm was used to conduct two experiments. This paradigm allows simultaneous investigation of the mutual influence of two kinds of facial information in one experiment. In Experiment 1, we manipulated facial expression discriminability and investigated its role in interference processing of gaze and facial expression. The results show that individuals were unable to ignore expression when classifying gaze with both high and low discriminability but could ignore gaze when classifying expression with high discriminability only. In Experiment 2, we manipulated gender discriminability and investigated its function in interference processing of gaze and gender. Participants were unable to ignore gender when classifying gaze with both high and low discriminability but could ignore gaze when classifying gender with low discriminability only. The results indicate that gaze categorization is affected by facial expression and gender regardless of facial information discriminability, whereas interference of gaze on facial expression and gender depends on the degree of discriminability. The present study provides evidence that the processing of gaze and other variant and invariant information is interdependent.

Healthy aging impairs face discrimination ability

Face images enable individual identities to be discriminated from one another. We aimed to quantify age-related changes in different aspects of face identity discrimination. Face discrimination sensitivity was measured with a memory-free "odd-one-out" task. Five age groups (N = 15) of healthy adults with normal vision were tested: 20, 50-59, 60-69, 70-79, and 80-89. Sensitivity was measured for full-face images (all features visible), external features (head-shape, hairline), internal features (nose, mouth, eyes, and eyebrows) and closed-contour shapes (control object). Sensitivity to full-faces continuously declined by approximately 13% per decade, after 50 years of age. When age-related differences in visual acuity were controlled, the effect of age on face discrimination sensitivity remained. Sensitivity to face features also deteriorated with age. Although the effect for external features was similar to full-faces, the rate of decline was considerably steeper (approximately 3.7 times) for internal, relative to external, features. In contrast, there was no effect of age on sensitivity to shapes. All age groups demonstrated the same overall pattern of sensitivity to different types of face information. Healthy aging was associated with a continuous decline in sensitivity to both full-faces and face features, although encoding of internal features was disproportionately impaired. This age-related deficit was independent of differences in low-level vision. That sensitivity to shapes was unaffected by age suggests these results cannot be explained by general cognitive decline or lower-level visual deficits. Instead, healthy aging is associated with a specific decline in the mechanisms that underlie face discrimination.

Older adults have difficulty decoding emotions from the eyes, whereas easterners have difficulty decoding emotion from the mouth

Older adults and Easterners have worse emotion recognition (than young adults and Westerners, respectively), but the question of why remains unanswered. Older adults look less at eyes, whereas Easterners look less at mouths, raising the possibility that compelling older adults to look at eyes, and Easterners to look at mouths, might improve recognition. We did this by comparing emotion recognition in 108 young adults and 109 older adults from New Zealand and Singapore in the (a) eyes on their own (b) mouth on its own or (c) full face. Older adults were worse than young adults on 4/6 emotions with the Eyes Only stimuli, but only 1/6 emotions with the Mouth Only stimuli. In contrast, Easterners were worse than Westerners on 6/6 emotions for Mouth Only and Full Face stimuli, but were equal on all six emotions for Eyes Only stimuli. These results provide a substantial leap forward because they point to the precise difficulty for older adults and Easterners. Older adults have more consistent difficulty identifying individual emotions in the eyes compared to the mouth, likely due to declining brain functioning, whereas Easterners have more consistent difficulty identifying emotions from the mouth than the eyes, likely due to inexperience inferring mouth information.

The impact of aging and repetition on eye movements and recognition memory

The modulation of gaze fixations on neural activity in the hippocampus, a region critical for memory, has been shown to be weaker in older adults compared to younger adults. However, as such research has relied on indirect measures of memory, it remains unclear whether the relationship between visual exploration and direct measures of memory is similarly disrupted in aging. The current study tested older and younger adults on a face memory eye-tracking task previously used by our group that showed that recognition memory for faces presented across variable, but not fixed, viewpoints relies on a hippocampal-dependent binding function. Here, we examined how aging influences eye movement measures that reveal the amount (cumulative sampling) and extent (distribution of gaze fixations) of visual exploration. We also examined how aging influences direct (subsequent conscious recognition) and indirect (eye movement repetition effect) expressions of memory. No age differences were found in direct recognition regardless of facial viewpoint. However, the eye movement measures revealed key group differences. Compared to younger adults, older adults exhibited more cumulative sampling, a different distribution of fixations, and a larger repetition effect. Moreover, there was a positive relationship between cumulative sampling and direct recognition in younger adults, but not older adults. Neither age group showed a relationship between the repetition effect and direct recognition. Thus, despite similar direct recognition, age-related differences were observed in visual exploration and in an indirect eye-movement memory measure, suggesting that the two groups may acquire, retain, and use different facial information to guide recognition.

Neural Correlates of Subsequent Memory-Related Gaze Reinstatement

Mounting evidence linking gaze reinstatement-the recapitulation of encoding-related gaze patterns during retrieval-to behavioral measures of memory suggests that eye movements play an important role in mnemonic processing. Yet, the nature of the gaze scanpath, including its informational content and neural correlates, has remained in question. In this study, we examined eye movement and neural data from a recognition memory task to further elucidate the behavioral and neural bases of functional gaze reinstatement. Consistent with previous work, gaze reinstatement during retrieval of freely viewed scene images was greater than chance and predictive of recognition memory performance. Gaze reinstatement was also associated with viewing of informationally salient image regions at encoding, suggesting that scanpaths may encode and contain high-level scene content. At the brain level, gaze reinstatement was predicted by encoding-related activity in the occipital pole and BG, neural regions associated with visual processing and oculomotor control. Finally, cross-voxel brain pattern similarity analysis revealed overlapping subsequent memory and subsequent gaze reinstatement modulation effects in the parahippocampal place area and hippocampus, in addition to the occipital pole and BG. Together, these findings suggest that encoding-related activity in brain regions associated with scene processing, oculomotor control, and memory supports the formation, and subsequent recapitulation, of functional scanpaths. More broadly, these findings lend support to scanpath theory's assertion that eye movements both encode, and are themselves embedded in, mnemonic representations.

Encoding and retrieval eye movements mediate age differences in pattern completion

Older adults often mistake new information as 'old', yet the mechanisms underlying this response bias remain unclear. Typically, false alarms by older adults are thought to reflect pattern completion - the retrieval of a previously encoded stimulus in response to partial input. However, other work suggests that age-related retrieval errors can be accounted for by deficient encoding processes. In the present study, we used eye movement monitoring to quantify age-related changes in behavioral pattern completion as a function of eye movements during both encoding and partially cued retrieval. Consistent with an age-related encoding deficit, older adults executed more gaze fixations and more similar eye movements across repeated image presentations than younger adults, and such effects were predictive of subsequent recognition memory. Analysis of eye movements at retrieval further indicated that in response to partial lure cues, older adults reactivated the similar studied image, indexed by the similarity between encoding and retrieval gaze patterns, and did so more than younger adults. Critically, reactivation of encoded image content via eye movements was associated with lure false alarms in older adults, providing direct evidence for a pattern completion bias. Together, these findings suggest that age-related changes in both encoding and retrieval processes, indexed by eye movements, underlie older adults' increased vulnerability to memory errors.

Asymmetric contextual effects in age perception

Perception is context dependent. For example, the perceived orientation of a bar changes depending on the presence of oriented bars around it. Contextual effects have also been demonstrated for more complex judgements, such as facial attractiveness or expression, although it remains unclear how these contextual facial effects depend on the types of faces surrounding the target face. To examine this, we measured the perceived age (a quantifiable measure) of a target face in the presence of differently aged faces in the surround. Using a unique database of standardized passport photos, participants were asked to estimate the age of a target face which was viewed either on its own or surrounded by two different identity flanker faces. The flanker faces were either both younger or both older than the target face, with different age offsets between flankers and targets of ±5, ±10, ±15, ±20 years. We find that when a target face is surrounded by younger faces, it systematically appears younger than when viewed on its own, and when it is surrounded by older faces, it systematically appears older than when viewed on its own. Surprisingly, we find that the magnitude of the flanker effects on perceived age of the target is asymmetric with younger flankers having a greater influence than older flankers, a result that may reflect the participants' own-age bias, since all participants were young. This result holds irrespective of gender or race of the faces and is consistent with averaging.

Emotion Recognition Using Eye-Tracking: Taxonomy, Review and Current Challenges

The ability to detect users' emotions for the purpose of emotion engineering is currently one of the main endeavors of machine learning in affective computing. Among the more common approaches to emotion detection are methods that rely on electroencephalography (EEG), facial image processing and speech inflections. Although eye-tracking is fast in becoming one of the most commonly used sensor modalities in affective computing, it is still a relatively new approach for emotion detection, especially when it is used exclusively. In this survey paper, we present a review on emotion recognition using eye-tracking technology, including a brief introductory background on emotion modeling, eye-tracking devices and approaches, emotion stimulation methods, the emotional-relevant features extractable from eye-tracking data, and most importantly, a categorical summary and taxonomy of the current literature which relates to emotion recognition using eye-tracking. This review concludes with a discussion on the current open research problems and prospective future research directions that will be beneficial for expanding the body of knowledge in emotion detection using eye-tracking as the primary sensor modality.

What eye movements reveal about strategy encoding of words in younger and older adults

The main goal of this study was to explore the organizational strategies used by younger and older adults when encoding words, using eye-tracking. Participants had to learn a set of organizable words and then a set of non-organizable words, each presented on a single display. Participants were then asked to recall the words of each set in the order in which they came to their mind. Hence, the participants' encoding strategies revealed by eye-tracking could be directly related to their subsequent memory performance. The results confirmed the detrimental impact of aging on memory and the weaker use of organizational strategies by older adults during the recall phase. The eye-tracking data showed that when they encode the words, older adults do not look at them for as long as younger adults, probably because of slower eye movements. They also revealed that compared to younger adults, older adults were much less able to adapt their word scanning strategy according to whether the words to encode were organizable or not. Finally, the relationships that were found between the recall scores and the eye-tracking data suggest that the eye movement pattern at learning can predict how people will recall the words.

Social categorization modulates own-age bias in face recognition and ERP correlates of face processing

The aim of the present study was to further understanding of how social categorization influences face recognition. According to the categorization-individuation model, face recognition can either be biased toward categorization or individuation. We hypothesized that the face recognition bias associated with a social category (e.g., the own-age bias) would be larger when faces were initially categorized according to that category. To examine this hypothesis, young adults (N = 63) completed a face recognition task after either making age or sex judgments while encoding child and adult faces. Young adults showed the own-age and own-sex biases in face recognition. Consistent with our hypothesis, the magnitude of the own-age bias in face recognition was larger when individuals made age, rather than sex, judgments at encoding. To probe the mechanisms underlying this effect, we examined ERP responses to child and adult faces across the social categorization conditions. Neither the P1 nor the N170 ERP components were modulated by the social categorization task or the social category membership of the face. However, the P2, which is associated with second-order configural processing, was larger to adult faces than child faces only in the age categorization condition. The N250, which is associated with individuation, was larger (i.e., more negative) to adult than child faces and during age categorization than sex categorization. These results are interpreted within the context of the categorization-individuation model and current research on biases in face recognition.

The intersection between the oculomotor and hippocampal memory systems: empirical developments and clinical implications

Decades of cognitive neuroscience research has shown that where we look is intimately connected to what we remember. In this article, we review findings from human and nonhuman animals, using behavioral, neuropsychological, neuroimaging, and computational modeling methods, to show that the oculomotor and hippocampal memory systems interact in a reciprocal manner, on a moment-to-moment basis, mediated by a vast structural and functional network. Visual exploration serves to efficiently gather information from the environment for the purpose of creating new memories, updating existing memories, and reconstructing the rich, vivid details from memory. Conversely, memory increases the efficiency of visual exploration. We call for models of oculomotor control to consider the influence of the hippocampal memory system on the cognitive control of eye movements, and for models of hippocampal and broader medial temporal lobe function to consider the influence of the oculomotor system on the development and expression of memory. We describe eye movement-based applications for the detection of neurodegeneration and delivery of therapeutic interventions for mental health disorders for which the hippocampus is implicated and memory dysfunctions are at the forefront.

No effect of age on emotion recognition after accounting for cognitive factors and depression

A decline in emotion recognition ability across the lifespan has been well documented. However, whether age predicts emotion recognition difficulties after accounting for potentially confounding factors which covary with age remains unclear. Although previous research suggested that age-related decline in emotion recognition ability may be partly a consequence of cognitive (fluid intelligence, processing speed) and affective (e.g., depression) factors, recent theories highlight a potential role for alexithymia (difficulty identifying and describing one’s emotions) and interoception (perception of the body’s internal state). This study therefore aimed to examine the recognition of anger and disgust across the adult lifespan in a group of 140 20–90-year-olds to see whether an effect of age would remain after controlling for a number of cognitive and affective factors potentially impacted by age. In addition, using an identity recognition control task, the study aimed to determine whether the factors accounting for the effects of age on emotion discrimination also contribute towards generalised face processing difficulties. Results revealed that discrimination of disgust and anger across the lifespan was predicted by processing speed and fluid intelligence, and negatively by depression. No effect of age was found after these factors were accounted for. Importantly, these effects were specific to emotion discrimination; only crystallised intelligence accounted for unique variance in identity discrimination. Contrary to expectations, although interoception and alexithymia were correlated with emotion discrimination abilities, these factors did not explain unique variance after accounting for other variables.

Eye-movement patterns in face recognition are associated with cognitive decline in older adults

The Hidden Markov Modeling approach for eye-movement data analysis is able to quantitatively assess differences and similarities among individual patterns. Here we applied this approach to examine the relationships between eye-movement patterns in face recognition and age-related cognitive decline. We found that significantly more older than young adults adopted "holistic" patterns, in which most eye fixations landed around the face center, as opposed to "analytic" patterns, in which eye movements switched among the two eyes and the face center. Participants showing analytic patterns had better performance than those with holistic patterns regardless of age. Interestingly, older adults with lower cognitive status (as assessed by the Montreal Cognitive Assessment), particularly in executive and visual attention functioning (as assessed by Tower of London and Trail Making Tests) were associated with a higher likelihood of holistic patterns. This result suggests the possibility of using eye movements as an easily deployable screening assessment for cognitive decline in older adults.

Exploring emotional expression recognition in aging adults using the Moving Window Technique

Adult aging is associated with difficulties in recognizing negative facial expressions such as fear and anger. However, happiness and disgust recognition is generally found to be less affected. Eye-tracking studies indicate that the diagnostic features of fearful and angry faces are situated in the upper regions of the face (the eyes), and for happy and disgusted faces in the lower regions (nose and mouth). These studies also indicate age-differences in visual scanning behavior, suggesting a role for attention in emotion recognition deficits in older adults. However, because facial features can be processed extrafoveally, and expression recognition occurs rapidly, eye-tracking has been questioned as a measure of attention during emotion recognition. In this study, the Moving Window Technique (MWT) was used as an alternative to the conventional eye-tracking technology. By restricting the visual field to a moveable window, this technique provides a more direct measure of attention. We found a strong bias to explore the mouth across both age groups. Relative to young adults, older adults focused less on the left eye, and marginally more on the mouth and nose. Despite these different exploration patterns, older adults were most impaired in recognition accuracy for disgusted expressions. Correlation analysis revealed that among older adults, more mouth exploration was associated with faster recognition of both disgusted and happy expressions. As a whole, these findings suggest that in aging there are both attentional differences and perceptual deficits contributing to less accurate emotion recognition.

Own-Age Bias and Positivity Effects in Facial Recognition

Background/Study Context - In the current study, we evaluated two age-related differences in recognition memory: the own-age bias, wherein older and younger adults best recognize those of their own age group, and an age-related positivity effect, wherein older adults recall positive emotional information better than negative information relative to younger adults. We sought to extend previous research that jointly investigated these variables in recognition memory. Methods - Younger (age 18 - 27) and older (age 62 - 80) adults completed an incidental encoding task on a sequence of 50 positive, negative, or neutrally valenced images of older and younger adult faces. After a distractor task, participants made forced-choice recognition judgments and rated their decision confidence for images that were repeated with the same or a different emotional expression, and for novel, previously unseen faces. Results - Older and younger adults' recognition discriminability did not differ significantly between age groups. Notably, the data indicated an own-age bias in young adults, but not in older adults, and both age groups' recognition accuracy was greatest for faces that had originally been shown with a positive emotional expression. Conclusion - To our knowledge, this research is the first to demonstrate an own-age recognition bias in younger adults for emotional faces. Although our predictions of a differential impact by emotional faces on recognition of same and other-age faces were not supported, we identify a number of factors that contextualize these findings in the recent literature.

Classification images characterize age-related deficits in face discrimination

Face perception is impaired in older adults, but the cause of this decline is not well understood. We examined this issue by measuring Classification Images (CIs) in a face discrimination task in younger and older adults. Faces were presented in static, white visual noise, and face contrast was varied with a staircase to maintain an accuracy rate of ≈71%. The noise fields were used to construct a CI using the method described by Nagai et al. (2013) and each observer's CI was cross-correlated with the visual template of a linear ideal discriminator to obtain an estimate of the absolute efficiency of visual processing. Face discrimination thresholds were lower in younger than older adults. Like Sekuler, Gaspar, Gold, and Bennett (2004), we found that CIs from younger adults contained structure near the eyes and brows, suggesting that those observers consistently relied on information conveyed by pixels in those regions of the stimulus. CIs obtained from older adults were noticeably different: CIs from only two older adults exhibited structure near the eye/brow regions, and CIs from the remaining older observers showed no obvious structure. Nevertheless, face discrimination thresholds in both groups were strongly and similarly correlated with the cross-correlation between the CI and the ideal template, suggesting that despite older observers' lack of consistent structure, the CI method is sensitive to between-subject differences in older observers' perceptual strategy.

Age-related changes in the relationship between visual exploration and hippocampal activity

Deciphering the mechanisms underlying age-related memory declines remains an important goal in cognitive neuroscience. Recently, we observed that visual sampling behavior predicted activity within the hippocampus, a region critical for memory. In younger adults, increases in the number of gaze fixations were associated with increases in hippocampal activity (Liu et al., 2017). This finding suggests a close coupling between the oculomotor and memory system. However, the extent to which this coupling is altered with aging has not been investigated. In this study, we gave older adults the same face processing task used in Liu et al. (2017) and compared their visual exploration behavior and neural activation in the hippocampus and the fusiform face area (FFA) to those of younger adults. Compared to younger adults, older adults showed an increase in visual exploration as indexed by the number of gaze fixations. However, the relationship between visual exploration and neural responses in the hippocampus and FFA was weaker than that of younger adults. Older adults also showed weaker responses to novel faces and a smaller repetition suppression effect in the hippocampus and FFA compared to younger adults. All together, this study provides novel evidence that the capacity to bind visually sampled information, in real-time, into coherent representations along the ventral visual stream and the medial temporal lobe declines with aging.

The relationship between visual search and categorization of own- and other-age faces

Young adult participants are faster to detect young adult faces in crowds of infant and child faces than vice versa. These findings have been interpreted as evidence for more efficient attentional capture by own-age than other-age faces, but could alternatively reflect faster rejection of other-age than own-age distractors, consistent with the previously reported other-age categorization advantage: faster categorization of other-age than own-age faces. Participants searched for own-age faces in other-age backgrounds or vice versa. Extending the finding to different other-age groups, young adult participants were faster to detect young adult faces in both early adolescent (Experiment 1) and older adult backgrounds (Experiment 2). To investigate whether the own-age detection advantage could be explained by faster categorization and rejection of other-age background faces, participants in experiments 3 and 4 also completed an age categorization task. Relatively faster categorization of other-age faces was related to relatively faster search through other-age backgrounds on target absent trials but not target present trials. These results confirm that other-age faces are more quickly categorized and searched through and that categorization and search processes are related; however, this correlational approach could not confirm or reject the contribution of background face processing to the own-age detection advantage.

What's good for the goose is not good for the gander: Age and gender differences in scanning emotion faces

Objectives

Research indicates that older adults' (≥60 years) emotion recognition is worse than that of young adults, young and older men's emotion recognition is worse than that of young and older women (respectively), older adults' looking at mouths compared with eyes is greater than that of young adults. Nevertheless, previous research has not compared older men's and women's looking at emotion faces so the present study had two aims: (a) to examine whether the tendency to look at mouths is stronger amongst older men compared with older women and (b) to examine whether men's mouth looking correlates with better emotion recognition.

Method

We examined the emotion recognition abilities and spontaneous gaze patterns of young (n = 60) and older (n = 58) males and females as they labelled emotion faces.

Results

Older men spontaneously looked more to mouths than older women, and older men's looking at mouths correlated with their emotion recognition, whereas women's looking at eyes correlated with their emotion recognition.

Discussion

The findings are discussed in relation to a growing body of research suggesting both age and gender differences in response to emotional stimuli and the differential efficacy of mouth and eyes looking for men and women.

Gaze Behavior Consistency among Older and Younger Adults When Looking at Emotional Faces

The identification of non-verbal emotional signals, and especially of facial expressions, is essential for successful social communication among humans. Previous research has reported an age-related decline in facial emotion identification, and argued for socio-emotional or aging-brain model explanations. However, more perceptual differences in the gaze strategies that accompany facial emotional processing with advancing age have been under-explored yet. In this study, 22 young (22.2 years) and 22 older (70.4 years) adults were instructed to look at basic facial expressions while their gaze movements were recorded by an eye-tracker. Participants were then asked to identify each emotion, and the unbiased hit rate was applied as performance measure. Gaze data were first analyzed using traditional measures of fixations over two preferential regions of the face (upper and lower areas) for each emotion. Then, to better capture core gaze changes with advancing age, spatio-temporal gaze behaviors were deeper examined using data-driven analysis (dimension reduction, clustering). Results first confirmed that older adults performed worse than younger adults at identifying facial expressions, except for "joy" and "disgust," and this was accompanied by a gaze preference toward the lower-face. Interestingly, this phenomenon was maintained during the whole time course of stimulus presentation. More importantly, trials corresponding to older adults were more tightly clustered, suggesting that the gaze behavior patterns of older adults are more consistent than those of younger adults. This study demonstrates that, confronted to emotional faces, younger and older adults do not prioritize or ignore the same facial areas. Older adults mainly adopted a focused-gaze strategy, consisting in focusing only on the lower part of the face throughout the whole stimuli display time. This consistency may constitute a robust and distinctive "social signature" of emotional identification in aging. Younger adults, however, were more dispersed in terms of gaze behavior and used a more exploratory-gaze strategy, consisting in repeatedly visiting both facial areas.

Learning to recognize younger faces at an older age

OBJECTIVES

Processing of horizontal face cues has been shown to be an important element in face recognition of adults aged up to 30 years. In contrast, horizontally aligned facial features do not appear to contribute to older adults' (60-75 years) recognition in a similar way. To this end, we investigated potential learning effects on the ability to recognize faces based on horizontal features. Previous research suggests face recognition based on all face information experiences an accelerated decline after the age of 70. However, recognition based only on horizontal face information has not yet been studied in old age (75+ years of age). Thus, we investigated whether older adults (aged up to as well as starting at 75 years) can learn to recognize faces based on horizontal face cues alone.

METHOD

One younger and two older adult groups (20-30, 60-75, and 75+ years) were familiarized with a high and a low amount of previously unfamiliar faces-some containing all face cues and others containing only horizontal face cues (reduced information). Subsequently, all groups received a recognition test.

RESULTS

Repeated learning increased natural face recognition for all three age groups when all face cues were available. However, increases in face recognition were only observed for younger adults when horizontal face cued were only available.

DISCUSSION

The importance of horizontally aligned spatial frequencies for recognizing human faces is lessened before the age of 60 (and plateaus thereon), whereas recognition of stimuli containing all face cues is still capable of improvement.

The relationship between eye movements and subsequent recognition: Evidence from individual differences and amnesia

There is consistent agreement regarding the positive relationship between cumulative eye movement sampling and subsequent recognition, but the role of the hippocampus in this sampling behavior is currently unknown. It is also unclear whether the eye movement repetition effect, i.e., fewer fixations to repeated, compared to novel, stimuli, depends on explicit recognition and/or an intact hippocampal system. We investigated the relationship between cumulative sampling, the eye movement repetition effect, subsequent memory, and the hippocampal system. Eye movements were monitored in a developmental amnesic case (H.C.), whose hippocampal system is compromised, and in a group of typically developing participants while they studied single faces across multiple blocks. The faces were studied from the same viewpoint or different viewpoints and were subsequently tested with the same or different viewpoint. Our previous work suggested that hippocampal representations support explicit recognition for information that changes viewpoint across repetitions (Olsen et al., 2015). Here, examination of eye movements during encoding indicated that greater cumulative sampling was associated with better memory among controls. Increased sampling, however, was not associated with better explicit memory in H.C., suggesting that increased sampling only improves memory when the hippocampal system is intact. The magnitude of the repetition effect was not correlated with cumulative sampling, nor was it related reliably to subsequent recognition. These findings indicate that eye movements collect information that can be used to strengthen memory representations that are later available for conscious remembering, whereas eye movement repetition effects reflect a processing change due to experience that does not necessarily reflect a memory representation that is available for conscious appraisal. Lastly, H.C. demonstrated a repetition effect for fixed viewpoint faces but not for variable viewpoint faces, which suggests that repetition effects are differentially supported by neocortical and hippocampal systems, depending upon the representational nature of the underlying memory trace.

The Role of External Features in Face Recognition with Central Vision Loss

PURPOSE

We evaluated how the performance of recognizing familiar face images depends on the internal (eyebrows, eyes, nose, mouth) and external face features (chin, outline of face, hairline) in individuals with central vision loss.

METHODS

In experiment 1, we measured eye movements for four observers with central vision loss to determine whether they fixated more often on the internal or the external features of face images while attempting to recognize the images. We then measured the accuracy for recognizing face images that contained only the internal, only the external, or both internal and external features (experiment 2) and for hybrid images where the internal and external features came from two different source images (experiment 3) for five observers with central vision loss and four age-matched control observers.

RESULTS

When recognizing familiar face images, approximately 40% of the fixations of observers with central vision loss was centered on the external features of faces. The recognition accuracy was higher for images containing only external features (66.8 ± 3.3% correct) than for images containing only internal features (35.8 ± 15.0%), a finding contradicting that of control observers. For hybrid face images, observers with central vision loss responded more accurately to the external features (50.4 ± 17.8%) than to the internal features (9.3 ± 4.9%), whereas control observers did not show the same bias toward responding to the external features.

CONCLUSIONS

Contrary to people with normal vision who rely more on the internal features of face images for recognizing familiar faces, individuals with central vision loss show a higher dependence on using external features of face images.

Children view own-age faces qualitatively differently to other-age faces

Like most own-group biases in face recognition, the own-age bias (OAB) is thought to be based either on perceptual expertise or socio-cognitive motivational mechanisms [Wolff, N., Kemter, K., Schweinberger, S. R., & Wiese, H. (2013). What drives social in-group biases in face recognition memory? ERP evidence from the own-gender bias. Social Cognitive and Affective Neuroscience. doi:10.1093/scan/nst024]. The present study employed a recognition paradigm with eye-tracking in order to assess whether participants actively viewed faces of their own-age differently to that of other-age faces. The results indicated a significant OAB (superior recognition for own-age relative to other-age faces), provided that they were upright, indicative of expertise being employed for the recognition of own-age faces. However, the eye-tracking results indicate that viewing other-age faces was qualitatively different to the viewing of own-age faces, with more nose fixations for other-age faces. These results are interpreted as supporting the socio-cognitive model of the OAB.

Visual scanning behavior is related to recognition performance for own- and other-age faces

It is well-established that our recognition ability is enhanced for faces belonging to familiar categories, such as own-race faces and own-age faces. Recent evidence suggests that, for race, the recognition bias is also accompanied by different visual scanning strategies for own- compared to other-race faces. Here, we tested the hypothesis that these differences in visual scanning patterns extend also to the comparison between own and other-age faces and contribute to the own-age recognition advantage. Participants (young adults with limited experience with infants) were tested in an old/new recognition memory task where they encoded and subsequently recognized a series of adult and infant faces while their eye movements were recorded. Consistent with findings on the other-race bias, we found evidence of an own-age bias in recognition which was accompanied by differential scanning patterns, and consequently differential encoding strategies, for own-compared to other-age faces. Gaze patterns for own-age faces involved a more dynamic sampling of the internal features and longer viewing time on the eye region compared to the other regions of the face. This latter strategy was extensively employed during learning (vs. recognition) and was positively correlated to discriminability. These results suggest that deeply encoding the eye region is functional for recognition and that the own-age bias is evident not only in differential recognition performance, but also in the employment of different sampling strategies found to be effective for accurate recognition.

The Facial Expressive Action Stimulus Test. A test battery for the assessment of face memory, face and object perception, configuration processing, and facial expression recognition

There are many ways to assess face perception skills. In this study, we describe a novel task battery FEAST (Facial Expressive Action Stimulus Test) developed to test recognition of identity and expressions of human faces as well as stimulus control categories. The FEAST consists of a neutral and emotional face memory task, a face and shoe identity matching task, a face and house part-to-whole matching task, and a human and animal facial expression matching task. The identity and part-to-whole matching tasks contain both upright and inverted conditions. The results provide reference data of a healthy sample of controls in two age groups for future users of the FEAST.

Age-Related Response Bias in the Decoding of Sad Facial Expressions

Recent studies have found that age is negatively associated with the accuracy of decoding emotional facial expressions; this effect of age was found for actors as well as for raters. Given that motivational differences and stereotypes may bias the attribution of emotion, the aim of the present study was to explore whether these age effects are due to response bias, that is, the unbalanced use of response categories. Thirty younger raters (19-30 years) and thirty older raters (65-81 years) viewed video clips of younger and older actors representing the same age ranges, and decoded their facial expressions. We computed both raw hit rates and bias-corrected hit rates to assess the influence of potential age-related response bias on decoding accuracy. Whereas raw hit rates indicated significant effects of both the actors' and the raters' ages on decoding accuracy for sadness, these age effects were no longer significant when response bias was corrected. Our results suggest that age effects on the accuracy of decoding facial expressions may be due, at least in part, to age-related response bias.

The Affective Neuroscience of Aging

Although aging is associated with clear declines in physical and cognitive processes, emotional functioning fares relatively well. Consistent with this behavioral profile, two core emotional brain regions, the amygdala and ventromedial prefrontal cortex, show little structural and functional decline in aging, compared with other regions. However, emotional processes depend on interacting systems of neurotransmitters and brain regions that go beyond these structures. This review examines how age-related brain changes influence processes such as attending to and remembering emotional stimuli, regulating emotion, and recognizing emotional expressions, as well as empathy, risk taking, impulsivity, behavior change, and attentional focus.

Selectivity of Face Perception to Horizontal Information over Lifespan (from 6 to 74 Year Old)

Face recognition in young human adults preferentially relies on the processing of horizontally-oriented visual information. We addressed whether the horizontal tuning of face perception is modulated by the extensive experience humans acquire with faces over the lifespan, or whether it reflects an invariable processing bias for this visual category. We tested 296 subjects aged from 6 to 74 years in a face matching task. Stimuli were upright and inverted faces filtered to preserve information in the horizontal or vertical orientation, or both (HV) ranges. The reliance on face-specific processing was inferred based on the face inversion effect (FIE). FIE size increased linearly until young adulthood in the horizontal but not the vertical orientation range of face information. These findings indicate that the protracted specialization of the face processing system relies on the extensive experience humans acquire at encoding the horizontal information conveyed by upright faces.

On the particular vulnerability of face recognition to aging: a review of three hypotheses

Age-related face recognition deficits are characterized by high false alarms to unfamiliar faces, are not as pronounced for other complex stimuli, and are only partially related to general age-related impairments in cognition. This paper reviews some of the underlying processes likely to be implicated in theses deficits by focusing on areas where contradictions abound as a means to highlight avenues for future research. Research pertaining to the three following hypotheses is presented: (i) perceptual deterioration, (ii) encoding of configural information, and (iii) difficulties in recollecting contextual information. The evidence surveyed provides support for the idea that all three factors are likely to contribute, under certain conditions, to the deficits in face recognition seen in older adults. We discuss how these different factors might interact in the context of a generic framework of the different stages implicated in face recognition. Several suggestions for future investigations are outlined.

The role of relational binding in item memory: evidence from face recognition in a case of developmental amnesia

Current theories state that the hippocampus is responsible for the formation of memory representations regarding relations, whereas extrahippocampal cortical regions support representations for single items. However, findings of impaired item memory in hippocampal amnesics suggest a more nuanced role for the hippocampus in item memory. The hippocampus may be necessary when the item elements need to be bound within and across episodes to form a lasting representation that can be used flexibly. The current investigation was designed to test this hypothesis in face recognition. H.C., an individual who developed with a compromised hippocampal system, and control participants incidentally studied individual faces that either varied in presentation viewpoint across study repetitions or remained in a fixed viewpoint across the study repetitions. Eye movements were recorded during encoding and participants then completed a surprise recognition memory test. H.C. demonstrated altered face viewing during encoding. Although the overall number of fixations made by H.C. was not significantly different from that of controls, the distribution of her viewing was primarily directed to the eye region. Critically, H.C. was significantly impaired in her ability to subsequently recognize faces studied from variable viewpoints, but demonstrated spared performance in recognizing faces she encoded from a fixed viewpoint, implicating a relationship between eye movement behavior in the service of a hippocampal binding function. These findings suggest that a compromised hippocampal system disrupts the ability to bind item features within and across study repetitions, ultimately disrupting recognition when it requires access to flexible relational representations.

The impact of beliefs about face recognition ability on memory retrieval processes in young and older adults

This study examined whether beliefs about face recognition ability differentially influence memory retrieval in older compared to young adults. Participants evaluated their ability to recognise faces and were also given information about their ability to perceive and recognise faces. The information was ostensibly based on an objective measure of their ability, but in actuality, participants had been randomly assigned the information they received (high ability, low ability or no information control). Following this information, face recognition accuracy for a set of previously studied faces was measured using a remember-know memory paradigm. Older adults rated their ability to recognise faces as poorer compared to young adults. Additionally, negative information about face recognition ability improved only older adults' ability to recognise a previously seen face. Older adults were also found to engage in more familiarity than item-specific processing than young adults, but information about their face recognition ability did not affect face processing style. The role that older adults' memory beliefs have in the meta-cognitive strategies they employ is discussed.

The own-age face recognition bias is task dependent

The own-age bias (OAB) in face recognition (more accurate recognition of own-age than other-age faces) is robust among young adults but not older adults. We investigated the OAB under two different task conditions. In Experiment 1 young and older adults (who reported more recent experience with own than other-age faces) completed a match-to-sample task with young and older adult faces; only young adults showed an OAB. In Experiment 2 young and older adults completed an identity detection task in which we manipulated the identity strength of target and distracter identities by morphing each face with an average face in 20% steps. Accuracy increased with identity strength and facial age influenced older adults' (but not younger adults') strategy, but there was no evidence of an OAB. Collectively, these results suggest that the OAB depends on task demands and may be absent when searching for one identity.

Recognition of facial emotions and identity in patients with mesial temporal lobe and idiopathic generalized epilepsy: an eye-tracking study

PURPOSE

To describe visual scanning pattern for facial identity recognition (FIR) and emotion recognition (FER) in patients with idiopathic generalized (IGE) and mesial temporal lobe epilepsy (MTLE). Secondary endpoint was to correlate the results with cognitive function.

METHODS

Benton Facial Recognition Test (BFRT) and Ekman&Friesen series were performed for FIR and FER respectively in 23 controls, 20 IGE and 19 MTLE patients. Eye movements were recorded by a Hi-Speed eye-tracker system. Neuropsychological tools explored cognitive function.

RESULTS

Correct FIR rate was 78% in controls, 70.7% in IGE and 67.4% (p=0.009) in MTLE patients. FER hits reached 82.7% in controls, 74.3% in IGE (p=0.006) and 73.4% in MTLE (p=0.002) groups. IGE patients failed in disgust (p=0.005) and MTLE ones in fear (p=0.009) and disgust (p=0.03). FER correlated with neuropsychological scores, particularly verbal fluency (r=0.542, p<0.001). Eye-tracking revealed that controls scanned faces more diffusely than IGE and MTLE patients for FIR, who tended to top facial areas. A longer scanning of the top facial area was found in the three groups for FER. Gap between top and bottom facial region fixation time decreased in MTLE patients, with more but shorter fixations in bottom facial region. However, none of these findings were statistically significant.

CONCLUSION

FIR was impaired in MTLE patients, and FER in both IGE and MTLE, particularly for fear and disgust. Although not statistically significant, those with impaired FER tended to perform more diffuse eye-tracking over the faces and have cognitive dysfunction.

Facial age affects emotional expression decoding

Facial expressions convey important information on emotional states of our interaction partners. However, in interactions between younger and older adults, there is evidence for a reduced ability to accurately decode emotional facial expressions. Previous studies have often followed up this phenomenon by examining the effect of the observers' age. However, decoding emotional faces is also likely to be influenced by stimulus features, and age-related changes in the face such as wrinkles and folds may render facial expressions of older adults harder to decode. In this paper, we review theoretical frameworks and empirical findings on age effects on decoding emotional expressions, with an emphasis on age-of-face effects. We conclude that the age of the face plays an important role for facial expression decoding. Lower expressivity, age-related changes in the face, less elaborated emotion schemas for older faces, negative attitudes toward older adults, and different visual scan patterns and neural processing of older than younger faces may lower decoding accuracy for older faces. Furthermore, age-related stereotypes and age-related changes in the face may bias the attribution of specific emotions such as sadness to older faces.

The neuroscience of face processing and identification in eyewitnesses and offenders

Humans are experts in face perception. We are better able to distinguish between the differences of faces and their components than between any other kind of objects. Several studies investigating the underlying neural networks provided evidence for deviated face processing in criminal individuals, although results are often confounded by accompanying mental or addiction disorders. On the other hand, face processing in non-criminal healthy persons can be of high juridical interest in cases of witnessing a felony and afterward identifying a culprit. Memory and therefore recognition of a person can be affected by many parameters and thus become distorted. But also face processing itself is modulated by different factors like facial characteristics, degree of familiarity, and emotional relation. These factors make the comparison of different cases, as well as the transfer of laboratory results to real live settings very challenging. Several neuroimaging studies have been published in recent years and some progress was made connecting certain brain activation patterns with the correct recognition of an individual. However, there is still a long way to go before brain imaging can make a reliable contribution to court procedures.

Reverse correlating trustworthy faces in young and older adults

Little is known about how older persons determine if someone deserves their trust or not based on their facial appearance, a process referred to as “facial trustworthiness.”In the past few years, Todorov and colleagues have argued that, in young adults, trustworthiness judgments are an extension of emotional judgments, and therefore, that trust judgments are made based on a continuum between anger and happiness (Todorov, 2008; Engell et al., 2010). Evidence from the literature on emotion processing suggest that older adults tend to be less efficient than younger adults in the recognition of negative facial expressions (Calder et al., 2003; Firestone et al., 2007; Ruffman et al., 2008; Chaby and Narme, 2009). Based on Todorov';s theory and the fact that older adults seem to be less efficient than younger adults in identifying emotional expressions, one could expect that older individuals would have different representations of trustworthy faces and that they would use different cues than younger adults in order to make such judgments. We verified this hypothesis using a variation of Mangini and Biederman's (2004) reverse correlation method in order to test and compare classification images resulting from trustworthiness (in the context of money investment), from happiness, and from anger judgments in two groups of participants: young adults and older healthy adults. Our results show that for elderly participants, both happy and angry representations are correlated with trustworthiness judgments. However, in young adults, trustworthiness judgments are mainly correlated with happiness representations. These results suggest that young and older adults differ in their way of judging trustworthiness.

Oxytocin and socioemotional aging: Current knowledge and future trends

The oxytocin (OT) system is involved in various aspects of social cognition and prosocial behavior. Specifically, OT has been examined in the context of social memory, emotion recognition, cooperation, trust, empathy, and bonding, and-though evidence is somewhat mixed-intranasal OT appears to benefit aspects of socioemotional functioning. However, most of the extant data on aging and OT is from animal research and human OT research has focused largely on young adults. As such, though we know that various socioemotional capacities change with age, we know little about whether age-related changes in the OT system may underlie age-related differences in socioemotional functioning. In this review, we take a genetic-neuro-behavioral approach and evaluate current evidence on age-related changes in the OT system as well as the putative effects of these alterations on age-related socioemotional functioning. Looking forward, we identify informational gaps and propose an Age-Related Genetic, Neurobiological, Sociobehavioral Model of Oxytocin (AGeNeS-OT model) which may structure and inform investigations into aging-related genetic, neural, and sociocognitive processes related to OT. As an exemplar of the use of the model, we report exploratory data suggesting differences in socioemotional processing associated with genetic variation in the oxytocin receptor gene (OXTR) in samples of young and older adults. Information gained from this arena has translational potential in depression, social stress, and anxiety-all of which have high relevance in aging-and may contribute to reducing social isolation and improving well-being of individuals across the lifespan.

Age-related differences in the distractor previewing effect with schematic faces of emotions

Young and older adults searched for a unique face in a set of three schematic faces and identified a secondary feature of the target. The faces could be negative, positive, or neutral. Young adults were slower and less accurate in searching for a negative face among neutral faces when they had previewed a display of negative faces than when they had previewed neutral faces, indicating an emotional distractor previewing effect (DPE), but this effect was eliminated with inverted faces. The DPE is an index of inter-trial inhibition to keep attention away from previewed, non-target information. Older adults also showed such an emotional DPE, but it was present with both upright and inverted faces. These results show that, in general, both young and old participants are sensitive to trial history, yet the different patterns of results suggest that these two groups remember and use different types of perceptual information when searching through emotional faces.

Individual differences in eye movements during face identification reflect observer-specific optimal points of fixation

In general, humans tend to first look just below the eyes when identifying another person. Does everybody look at the same place on a face during identification, and, if not, does this variability in fixation behavior lead to functional consequences? In two conditions, observers had their free eye movements recorded while they performed a face-identification task. In another condition, the same observers identified faces while their gaze was restricted to specific locations on each face. We found substantial differences, which persisted over time, in where individuals chose to first move their eyes. Observers' systematic departure from a canonical, theoretically optimal fixation point did not correlate with performance degradation. Instead, each individual's looking preference corresponded to an idiosyncratic performance-maximizing point of fixation: Those who looked lower on the face performed better when forced to fixate the lower part of the face. The results suggest an observer-specific synergy between the face-recognition and eye movement systems that optimizes face-identification performance.