Unique morphology of the human eye

Multimodal Language Processing in Human Communication

The natural ecology of human language is face-to-face interaction comprising the exchange of a plethora of multimodal signals. Trying to understand the psycholinguistic processing of language in its natural niche raises new issues, first and foremost the binding of multiple, temporally offset signals under tight time constraints posed by a turn-taking system. This might be expected to overload and slow our cognitive system, but the reverse is in fact the case. We propose cognitive mechanisms that may explain this phenomenon and call for a multimodal, situated psycholinguistic framework to unravel the full complexities of human language processing.

Eye Contact Is a Two-Way Street: Arousal Is Elicited by the Sending and Receiving of Eye Gaze Information

Research shows that arousal is significantly enhanced while participants make eye contact with a live person compared to viewing a picture of direct or averted gaze. Recent research has pointed toward the potential for social interaction as a possible driving force behind the arousal enhancement. That is, eye gaze is not only a signal perceived but also a signal sent out in order to communicate with others. This study aimed to test this by having dyads engage in eye contact and averted gaze naturally, while wearing sunglasses, and while blindfolded; such that the gaze signals were clear, degraded, and blocked, respectively. Autonomic nervous system arousal was measured via skin conductance response and level. The results showed that dyads exhibited the highest degree of arousal (increased skin conductance) while making eye contact (send/receive) compared to send-only or receive-only gaze trials; however, this was only the case if eye contact was clear. Once gaze information became degraded (by sunglasses or blindfold), arousal significantly decreased and was no longer modulated by the sending and receiving of gaze. Therefore, the arousal enhancement observed during eye contact is not only caused by receiving gaze signals (the focus of previous research) and should be more accurately attributed to the subtle interplay between sending and receiving gaze signals.

Mental attribution is not sufficient or necessary to trigger attentional orienting to gaze

Attention can be shifted in the direction that another person is looking, but the role played by an observer's mental attribution to the looker is controversial. And whether mental attribution to the looker is sufficient to trigger an attention shift is unknown. The current study introduces a novel paradigm to investigate this latter issue. An actor is presented on video turning his head to the left or right before a target appears, randomly, at the gazed-at or non-gazed at location. Time to detect the target is measured. The standard finding is that target detection is more efficient at the gazed-at than the nongazed-at location, indicating that attention is shifted to the gazed-at location. Critically, in the current study, an actor is wearing two identical masks - one covering his face and the other the back of his head. Thus, after the head turn, participants are presented with the profile of two faces, one looking left and one looking right. For a gaze cuing effect to emerge, participants must attribute a mental state to the actor - as looking through one mask and not the other. Over the course of four experiments we report that when mental attribution is necessary, a shift in social attention does not occur (i.e., mental attribution is not sufficient to produce a social attention effect); and when mental attribution is not necessary, a shift in social attention does occur. Thus, mental attribution is neither sufficient nor necessary for the occurrence of an involuntary shift in social attention. The present findings constrain future models of social attention that wish to link gaze cuing to mental attribution.

Implicit model of other people's visual attention as an invisible, force-carrying beam projecting from the eyes

Much of how people process other social agents is hidden under the surface of awareness. Here we report that people automatically and unconsciously treat other people’s eyes as if beams of force-carrying energy emanate from them, gently pushing on objects in the world. The findings show how the human brain constructs surprising, rich, and at the same time schematized models of other people’s internal processes such as visual attention.

As a part of social cognition, people automatically construct rich models of other people’s vision. Here we show that when people judge the mechanical forces acting on an object, their judgments are biased by another person gazing at the object. The bias is consistent with an implicit perception that gaze adds a gentle force, pushing on the object. The bias was present even though the participants were not explicitly aware of it and claimed that they did not believe in an extramission view of vision (a common folk view of vision in which the eyes emit an invisible energy). A similar result was not obtained on control trials when participants saw a blindfolded face turned toward the object, or a face with open eyes turned away from the object. The findings suggest that people automatically and implicitly generate a model of other people’s vision that uses the simplifying construct of beams coming out of the eyes. This implicit model of active gaze may be a hidden, yet fundamental, part of the rich process of social cognition, contributing to how we perceive visual agency. It may also help explain the extraordinary cultural persistence of the extramission myth of vision.

Task Dependent Effects of Head Orientation on Perceived Gaze Direction

The perception of gaze direction involves the integration of a number of sensory cues exterior to the eye-region. The orientation of the head is one such cue, which has an overall repulsive effect on the perceived direction of gaze. However, in a recent experiment, we found the measured effect of head orientation on perceived gaze direction differed within subjects, depending on whether a single- or two-interval task design was employed. This suggests a potential difference in the way the orientation of the head is integrated into the perception of gaze direction across tasks. Four experiments were conducted to investigate this difference. The first two experiments showed that the difference was not the result of some interaction between stimuli in the two-interval task, but rather, a difference between the types of judgment being made across tasks, where observers were making a directional (left/right) judgment in the single-interval task, and a non-directional (direct/indirect gaze) judgment in the two-interval task. A third experiment showed that this difference does not arise from observers utilizing a non-directional cue to direct gaze (the circularity of the pupil/iris) in making their non-directional judgments. The fourth experiment showed no substantial differences in the duration of evidence accumulation and processing between judgments, suggesting that observers are not integrating different sensory information across tasks. Together these experiments show that the sensory information from head orientation is flexibly weighted in the perception of gaze direction, and that the purpose of the observer, in sampling gaze information, can influence the consequent perception of gaze direction.

Coordination between binocular field and spontaneous self-motion specifies the efficiency of planarians' photo-response orientation behavior

Eyes show remarkable diversity in morphology among creatures. However, little is known about how morphological traits of eyes affect behaviors. Here, we investigate the mechanisms responsible for the establishment of efficient photo-response orientation behavior using the planarian Dugesia japonica as a model. Our behavioral assays reveal the functional angle of the visual field and show that the binocular field formed by paired eyes in D. japonica has an impact on the accurate recognition of the direction of a light source. Furthermore, we find that the binocular field in coordination with spontaneous wigwag self-motion of the head specifies the efficiency of photo-responsive evasive behavior in planarians. Our findings suggest that the linkage between the architecture of the sensory organs and spontaneous self-motion is a platform that serves for efficient and adaptive outcomes of planarian and potentially other animal behaviors.

Yoshitaro Akiyama et al. report the use of innovative behavioral assays in planarian flatworms to investigate the mechanism by which they efficiently respond to light. They find that binocular vision and spontaneous self-motion are key factors for accurately detecting the direction of a light source.

Humans do not perceive conspecifics with a greater exposed sclera as more trustworthy: a preliminary cross-ethnic study of the function of the overexposed human sclera

Understanding the adaptive function of the unique morphology of the human eye, in particular its overexposed white sclera, may have profound implications for the fields of evolutionary behavioural science, and specifically the areas of human interaction and social cognition. Existing hypotheses, such as the cooperative eye hypothesis, have attracted a lot of attention but remain untested. Here, we: (i) analysed variation in the visible sclera size in humans from different ethnic backgrounds and (ii) examined whether intraspecific variation of exposed sclera size is related to trust. We used 596 facial photographs of men and women, assessed for perceived trustworthiness, from four different self-declared racial backgrounds. The size of the exposed sclera was measured as the ratio between the width of the exposed eyeball and the diameter of the iris (sclera size index, SSI). The SSI did not differ in the four examined races and was sexually monomorphic except for Whites, where males had a larger SSI than females. In general, the association between the SSI and trustworthiness was statistically insignificant. An inverted U-shaped link was found only in White women, yet the strength of the effect of interaction between sex and race was very small. Our results did not provide evidence for the link between exposed sclera size and trustworthiness. We conclude that further investigation is necessary in order to properly assess the hypotheses relating to the socially relevant functions of overexposed sclera.

One versus two eyes makes a difference! Early face perception is modulated by featural fixation and feature context

The N170 event-related potential component is an early marker of face perception that is particularly sensitive to isolated eye regions and to eye fixations within a face. Here, this eye sensitivity was tested further by measuring the N170 to isolated facial features and to the same features fixated within a face, using a gaze-contingent procedure. The neural response to single isolated eyes and eye regions (two eyes) was also compared. Pixel intensity and contrast were controlled at the global (image) and local (featural) levels. Consistent with previous findings, larger N170 amplitudes were elicited when the left or right eye was fixated within a face, compared to the mouth or nose, demonstrating that the N170 eye sensitivity reflects higher-order perceptual processes and not merely low-level perceptual effects. The N170 was also largest and most delayed for isolated features, compared to equivalent fixations within a face. Specifically, mouth fixation yielded the largest amplitude difference, and nose fixation yielded the largest latency difference between these two contexts, suggesting the N170 may reflect a complex interplay between holistic and featural processes. Critically, eye regions elicited consistently larger and shorter N170 responses compared to single eyes, with enhanced responses for contralateral eye content, irrespective of eye or nasion fixation. These results confirm the importance of the eyes in early face perception, and provide novel evidence of an increased sensitivity to the presence of two symmetric eyes compared to only one eye, consistent with a neural eye region detector rather than an eye detector per se.

Affective Eye Contact: An Integrative Review

In recent years, many studies have shown that perceiving other individuals' direct gaze has robust effects on various attentional and cognitive processes. However, considerably less attention has been devoted to investigating the affective effects triggered by eye contact. This article reviews research concerning the effects of others' gaze direction on observers' affective responses. The review focuses on studies in which affective reactions have been investigated in well-controlled laboratory experiments, and in which contextual factors possibly influencing perceivers' affects have been controlled. Two important themes emerged from this review. First, explicit affective evaluations of seeing another's direct versus averted gaze have resulted in rather inconsistent findings; some studies report more positive subjective feelings to direct compared to averted gaze, whereas others report the opposite pattern. These contradictory findings may be related, for example, to differences between studies in terms of the capability of direct-gaze stimuli to elicit feelings of self-involvement. Second, studies relying on various implicit measures have reported more consistent results; they indicate that direct gaze increases affective arousal, and more importantly, that eye contact automatically evokes a positively valenced affective reaction. Based on the review, possible psychological mechanisms for the positive affective reactions elicited by eye contact are described.

Two types of social grooming methods depending on the trade-off between the number and strength of social relationships

Humans use various social bonding methods known as social grooming, e.g. face to face communication, greetings, phone and social networking sites (SNS). SNS have drastically decreased time and distance constraints of social grooming. In this paper, I show that two types of social grooming (elaborate social grooming and lightweight social grooming) were discovered in a model constructed by 13 communication datasets including face to face, SNS and Chacma baboons. The separation of social grooming methods is caused by a difference in the trade-off between the number and strength of social relationships. The trade-off of elaborate social grooming is weaker than the trade-off of lightweight social grooming. On the other hand, the time and effort of elaborate methods are higher than those of lightweight methods. Additionally, my model connects social grooming behaviour and social relationship forms with these trade-offs. By analysing the model, I show that individuals tend to use elaborate social grooming to reinforce a few close relationships (e.g. face to face and Chacma baboons). By contrast, people tend to use lightweight social grooming to maintain many weak relationships (e.g. SNS). Humans with lightweight methods who live in significantly complex societies use various types of social grooming to effectively construct social relationships.

Pupil mimicry promotes trust through the theory-of-mind network

The human eye can provide powerful insights into the emotions and intentions of others; however, how pupillary changes influence observers' behavior remains largely unknown. The present fMRI-pupillometry study revealed that when the pupils of interacting partners synchronously dilate, trust is promoted, which suggests that pupil mimicry affiliates people. Here we provide evidence that pupil mimicry modulates trust decisions through the activation of the theory-of-mind network (precuneus, temporo-parietal junction, superior temporal sulcus, and medial prefrontal cortex). This network was recruited during pupil-dilation mimicry compared with interactions without mimicry or compared with pupil-constriction mimicry. Furthermore, the level of theory-of-mind engagement was proportional to individual's susceptibility to pupil-dilation mimicry. These data reveal a fundamental mechanism by which an individual's pupils trigger neurophysiological responses within an observer: when interacting partners synchronously dilate their pupils, humans come to feel reflections of the inner states of others, which fosters trust formation.

The Role of the Pupil, Corneal Reflex, and Iris in Determining the Perceived Direction of Gaze

In specially constructed movies depicting moving eyes, the pupils, irises, and corneal reflexes moved independently and sometimes in opposite directions. We found that the moving pupils or the corneal reflex, not the moving irises, determined the perceived direction of gaze (online Movie 1). When the pupils and irises moved in opposite directions, the one with the higher Michelson contrast determined the perceived direction of gaze (online Movie 2).

Evaluating Amazon's Mechanical Turk for psychological research on the symbolic control of attention

The use of online crowdsourcing services like Amazon's Mechanical Turk (AMT) as a method of collecting behavioral data online has become increasingly popular in recent years. A growing body of contemporary research has empirically validated the use of AMT as a tool in psychological research by replicating a wide range of well-established effects that have been previously reported in controlled laboratory studies. However, the potential for AMT to be used to conduct spatial cuing experiments has yet to be investigated in depth. Spatial cuing tasks are typically very basic in terms of their stimulus complexity and experimental testing procedures, thus making them ideal for remote testing online that requires minimal task instruction. Studies employing the spatial cuing paradigm are typically aimed at unveiling novel facets of the symbolic control of attention, which occurs whenever observers orient their attention through space in accordance with the meaning of a spatial cue. Ultimately, the present study empirically validated the use of AMT to study the symbolic control of attention by successfully replicating four hallmark effects reported throughout the visual attention literature: the left/right advantage, cue type effect, cued axis effect, and cued endpoint effect. Various recommendations for future endeavors using AMT as a means of remotely collecting behavioral data online are also provided. In sum, the present study provides a crucial first step toward establishing a novel tool for conducting psychological research that can be used to expedite not only our own scientific contributions, but also those of our colleagues.

Early and late cortical responses to directly gazing faces are task dependent

Gender categorisation of human faces is facilitated when gaze is directed toward the observer (i.e., a direct gaze), compared with situations where gaze is averted or the eyes are closed (Macrae, Hood, Milne, Rowe, & Mason, Psychological Science, 13(5), 460-464, 2002). However, the temporal dynamics underlying this phenomenon remain to some extent unknown. Here, we used electroencephalography (EEG) to assess the neural correlates of this effect, focusing on the event-related potential (ERP) components known to be sensitive to gaze perception (i.e., P1, N170, and P3b). We first replicated the seminal findings of Macrae et al. (2002, Experiment 1) regarding facilitated gender discrimination, and subsequently measured the underlying neural responses. Our data revealed an early preferential processing of direct gaze as compared with averted gaze and closed eyes at the P1, which reverberated at the P3b (Experiment 2). Critically, using the same material, we failed to reproduce these effects when gender categorisation was not required (Experiment 3). Taken together, our data confirm that direct gaze enhances the early P1, as well as later cortical responses to face processing, although the effect appears to be task dependent.

Social Contact Enhances Bodily Self-Awareness

Human self-awareness is arguably the most important and revealing question of modern sciences. Converging theoretical perspectives link self-awareness and social abilities in human beings. In particular, mutual engagement during social interactions-or social contact-would boost self-awareness. Yet, empirical evidence for this effect is scarce. We recently showed that the perception of eye contact induces enhanced bodily self-awareness. Here, we aimed at extending these findings by testing the influence of social contact in auditory and tactile modalities, in order to demonstrate that social contact enhances bodily self-awareness irrespective of sensory modality. In a first experiment, participants were exposed to hearing their own first name (as compared to another unfamiliar name and noise). In a second experiment, human touch (as compared to brush touch and no-touch) was used as the social contact cue. In both experiments, participants demonstrated more accurate rating of their bodily reactions in response to emotional pictures following the social contact condition-a proxy of bodily self-awareness. Further analyses indicated that the effect of social contact was comparable across tactile, auditory and visual modalities. These results provide the first direct empirical evidence in support of the essential social nature of human self-awareness.

The "Social Gaze Space": A Taxonomy for Gaze-Based Communication in Triadic Interactions

Humans substantially rely on non-verbal cues in their communication and interaction with others. The eyes represent a “simultaneous input-output device”: While we observe others and obtain information about their mental states (including feelings, thoughts, and intentions-to-act), our gaze simultaneously provides information about our own attention and inner experiences. This substantiates its pivotal role for the coordination of communication. The communicative and coordinative capacities – and their phylogenetic and ontogenetic impacts – become fully apparent in triadic interactions constituted in its simplest form by two persons and an object. Technological advances have sparked renewed interest in social gaze and provide new methodological approaches. Here we introduce the ‘Social Gaze Space’ as a new conceptual framework for the systematic study of gaze behavior during social information processing. It covers all possible categorical states, namely ‘partner-oriented,’ ‘object-oriented,’ ‘introspective,’ ‘initiating joint attention,’ and ‘responding joint attention.’ Different combinations of these states explain several interpersonal phenomena. We argue that this taxonomy distinguishes the most relevant interactional states along their distinctive features, and will showcase the implications for prominent social gaze phenomena. The taxonomy allows to identify research desiderates that have been neglected so far. We argue for a systematic investigation of these phenomena and discuss some related methodological issues.

Pupil-mimicry conditions trust in partners: moderation by oxytocin and group membership

Across species, oxytocin, an evolutionarily ancient neuropeptide, facilitates social communication by attuning individuals to conspecifics' social signals, fostering trust and bonding. The eyes have an important signalling function; and humans use their salient and communicative eyes to intentionally and unintentionally send social signals to others, by contracting the muscles around their eyes and pupils. In our earlier research, we observed that interaction partners with dilating pupils are trusted more than partners with constricting pupils. But over and beyond this effect, we found that the pupil sizes of partners synchronize and that when pupils synchronously dilate, trust is further boosted. Critically, this linkage between mimicry and trust was bound to interactions between ingroup members. The current study investigates whether these findings are modulated by oxytocin and sex of participant and partner. Using incentivized trust games with partners from ingroup and outgroup whose pupils dilated, remained static or constricted, this study replicates our earlier findings. It further reveals that (i) male participants withhold trust from partners with constricting pupils and extend trust to partners with dilating pupils, especially when given oxytocin rather than placebo; (ii) female participants trust partners with dilating pupils most, but this effect is blunted under oxytocin; (iii) under oxytocin rather than placebo, pupil dilation mimicry is weaker and pupil constriction mimicry stronger; and (iv) the link between pupil constriction mimicry and distrust observed under placebo disappears under oxytocin. We suggest that pupil-contingent trust is parochial and evolved in social species in and because of group life.

Evolution of iris colour in relation to cavity nesting and parental care in passerine birds

Strong selection pressures are known to act on animal coloration. Although many animals vary in eye colour, virtually no research has investigated the functional significance of these colour traits. Passeriformes have a range of iris colours, making them an ideal system to investigate how and why iris colour has evolved. Using phylogenetic comparative methods, we tested the hypothesis that conspicuous iris colour in passerine birds evolved in response to (a) coordination of offspring care and (b) cavity nesting, two traits thought to be involved in intra-specific gaze sensitivity. We found that iris colour and cooperative offspring care by two or more individuals evolved independently, suggesting that bright eyes are not important for coordinating parental care through eye gaze. Furthermore, we found that evolution between iris colour and nesting behaviour did occur in a dependent manner, but contrary to predictions, transitions to coloured eyes were not more frequent in cavity nesters than non-cavity nesters. Instead, our results indicate that selection away from having bright eyes was much stronger in non-cavity nesters than cavity nesters, perhaps because conspicuous eye coloration in species not concealed within a cavity would be more visible to predators.

The Eyes as Windows Into Other Minds

Eyes have been shown to play a key role during human social interactions. However, to date, no comprehensive cross-discipline model has provided a framework that can account for uniquely human responses to eye cues. In this review, I present a framework that brings together work on the phylogenetic, ontogenetic, and neural bases of perceiving and responding to eyes. Specifically, I argue for a two-process model: a first process that ensures privileged attention to information encoded in the eyes and is important for the detection of other minds and a second process that permits the decoding of information contained in the eyes concerning another person's emotional and mental states. To some degree, these processes are unique to humans, emerge during different times in infant development, can be mapped onto distinct but interconnected brain regions, and likely serve critical functions in facilitating cooperative interactions in humans. I also present evidence to show that oxytocin is a key modulator of sensitive responding to eye cues. Viewing eyes as windows into other minds can therefore be considered a hallmark feature of human social functioning deeply rooted in our biology.

The development and flexibility of gaze alternations in bonobos and chimpanzees

Infants' early gaze alternations are one of their first steps towards a sophisticated understanding of the social world. This ability, to gaze alternate between an object of interest and another individual also attending to that object, has been considered foundational to the development of many complex social-cognitive abilities, such as theory of mind and language. However, to understand the evolution of these abilities, it is important to identify whether and how gaze alternations are used and develop in our closest living relatives, bonobos (Pan paniscus) and chimpanzees (Pan troglodytes). Here, we evaluated the development of gaze alternations in a large, developmental sample of bonobos (N = 17) and chimpanzees (N = 35). To assess the flexibility of ape gaze alternations, we tested whether they produced gaze alternations when requesting food from a human who was either visually attentive or visually inattentive. Similarly to human infants, both bonobos and chimpanzees produced gaze alternations, and did so more frequently when a human communicative partner was visually attentive. However, unlike humans, who gaze alternate frequently from early in development, chimpanzees did not begin to gaze alternate frequently until adulthood. Bonobos produced very few gaze alternations, regardless of age. Thus, it may be the early emergence of gaze alternations, as opposed gaze alternations themselves, that is derived in the human lineage. The distinctively early emergence of gaze alternations in humans may be a critical underpinning for the development of complex human social-cognitive abilities.

Schematic eye-gaze cues influence infants' object encoding dependent on their contrast polarity

We examined infants’ sensitivity to eye-gaze direction and its influence on object processing in 4-month-old infants by manipulating low-level properties of gaze cues. Infants were presented with two kinds of stimuli that either did or did not cue novel objects. The movement of a schematic image of two eyes (two black circles each moving on a white oval background) led to an enhanced processing of the cued object. A cue with reversed polarity (two white circles each moving on a black oval background) elicited distinctly weaker effects. Results highlight infants’ specific sensitivity to isolated eye gaze which furthermore facilitates object encoding. It is suggested that this sensitivity relies on the typical perceptual pattern of eyes, the black pupil on a white sclera.

Power Moves Beyond Complementarity: A Staring Look Elicits Avoidance in Low Power Perceivers and Approach in High Power Perceivers

Sustained, direct eye-gaze-staring-is a powerful cue that elicits strong responses in many primate and nonprimate species. The present research examined whether fleeting experiences of high and low power alter individuals' spontaneous responses to the staring gaze of an onlooker. We report two experimental studies showing that sustained, direct gaze elicits spontaneous avoidance tendencies in low power perceivers and spontaneous approach tendencies in high power perceivers. These effects emerged during interactions with different targets and when power was manipulated between-individuals (Study 1) and within-individuals (Study 2), thus attesting to a high degree of flexibility in perceivers' reactions to gaze cues. Together, the present findings indicate that power can break the cycle of complementarity in individuals' spontaneous responding: Low power perceivers complement and move away from, and high power perceivers reciprocate and move toward, staring onlookers.

Perceived Object Trajectory Is Influenced by Others' Tracking Movements

In social interactions, it is highly salient to us where other people are looking. The ability to recover this information is critical to typical social development, helping us to coordinate our attention and behavior with others and understand their intentions and mental states [1-3]. The depth and direction in which another individual is fixating are specified jointly by their head position, eye deviation, and binocular vergence [4, 5]. It is hereto unknown, however, whether this dynamic visual information about others' focus of attention affects how we ourselves see the world. Here we show that the perceived depth and movement of physical objects in our environment are influenced by others' tracking behavior. This effect occurred even in the presence of conflicting size cues to object location and generalized to the context of apparent motion displays [6] and judgments about causal interactions between moving objects [7]. Perceived object trajectory was modulated primarily by the object-level motion of the tracking agent (e.g., the head), with less-pronounced effects of eye motion and low-level motion. Interestingly, comparable perceptual effects were induced by non-face objects that displayed similar tracking behavior, indicating a mechanism of distal coupling between the motion of the target and an appropriately moving inducer. These results demonstrate that social information can have a fundamental effect on our vision, such that the visual reality constructed in each brain is determined in part by what others see.

Reading What the Mind Thinks From How the Eye Sees

Human eyes convey a remarkable variety of complex social and emotional information. However, it is unknown which physical eye features convey mental states and how that came about. In the current experiments, we tested the hypothesis that the receiver's perception of mental states is grounded in expressive eye appearance that serves an optical function for the sender. Specifically, opposing features of eye widening versus eye narrowing that regulate sensitivity versus discrimination not only conveyed their associated basic emotions (e.g., fear vs. disgust, respectively) but also conveyed opposing clusters of complex mental states that communicate sensitivity versus discrimination (e.g., awe vs. suspicion). This sensitivity-discrimination dimension accounted for the majority of variance in perceived mental states (61.7%). Further, these eye features remained diagnostic of these complex mental states even in the context of competing information from the lower face. These results demonstrate that how humans read complex mental states may be derived from a basic optical principle of how people see.

A bias-minimising measure of the influence of head orientation on perceived gaze direction

The orientation of the head is an important cue for gaze direction, and its role has been explained in a dual route model. The model incorporates both an attractive and a repulsive effect of head orientation, which act to support accurate gaze perception across large changes in natural stimuli. However, in all previous studies of which we are aware, measurements of the influence of head orientation on perceived gaze direction were obtained using a single-interval methodology, which may have been affected by response bias. Here we compare the single-interval methodology with a two-interval (bias-minimising) design. We find that although measures obtained using the two-interval design showed a stronger attractive effect of head orientation than previous studies, the influence of head orientation on perceived gaze direction still represents a genuine perceptual effect. Measurements obtained using the two-interval design were also shown to be more stable across sessions one week apart. These findings suggest the two-interval design should be used in future experiments, especially if comparing groups who may systematically differ in their biases, such as patients with schizophrenia or autism.

Observing Third-Party Attentional Relationships Affects Infants' Gaze Following: An Eye-Tracking Study

Not only responding to direct social actions toward themselves, infants also pay attention to relevant information from third-party interactions. However, it is unclear whether and how infants recognize the structure of these interactions. The current study aimed to investigate how infants' observation of third-party attentional relationships influence their subsequent gaze following. Nine-month-old, 1-year-old, and 1.5-year-old infants (N = 72, 37 girls) observed video clips in which a female actor gazed at one of two toys after she and her partner either silently faced each other (face-to-face condition) or looked in opposite directions (back-to-back condition). An eye tracker was used to record the infants' looking behavior (e.g., looking time, looking frequency). The analyses revealed that younger infants followed the actor's gaze toward the target object in both conditions, but this was not the case for the 1.5-year-old infants in the back-to-back condition. Furthermore, we found that infants' gaze following could be negatively predicted by their expectation of the partner's response to the actor's head turn (i.e., they shift their gaze toward the partner immediately after they realize that the actor's head will turn). These findings suggested that the sensitivity to the difference in knowledge and attentional states in the second year of human life could be extended to third-party interactions, even without any direct involvement in the situation. Additionally, a spontaneous concern with the epistemic gap between self and other, as well as between others, develops by this age. These processes might be considered part of the fundamental basis for human communication.

New perspectives in gaze sensitivity research

Attending to where others are looking is thought to be of great adaptive benefit for animals when avoiding predators and interacting with group members. Many animals have been reported to respond to the gaze of others, by co-orienting their gaze with group members (gaze following) and/or responding fearfully to the gaze of predators or competitors (i.e., gaze aversion). Much of the literature has focused on the cognitive underpinnings of gaze sensitivity, namely whether animals have an understanding of the attention and visual perspectives in others. Yet there remain several unanswered questions regarding how animals learn to follow or avoid gaze and how experience may influence their behavioral responses. Many studies on the ontogeny of gaze sensitivity have shed light on how and when gaze abilities emerge and change across development, indicating the necessity to explore gaze sensitivity when animals are exposed to additional information from their environment as adults. Gaze aversion may be dependent upon experience and proximity to different predator types, other cues of predation risk, and the salience of gaze cues. Gaze following in the context of information transfer within social groups may also be dependent upon experience with group-members; therefore we propose novel means to explore the degree to which animals respond to gaze in a flexible manner, namely by inhibiting or enhancing gaze following responses. We hope this review will stimulate gaze sensitivity research to expand beyond the narrow scope of investigating underlying cognitive mechanisms, and to explore how gaze cues may function to communicate information other than attention.

Do Facial Movements Express Emotions or Communicate Motives?

This article addresses the debate between emotion-expression and motive-communication approaches to facial movements, focusing on Ekman's (1972) and Fridlund's (1994) contrasting models and their historical antecedents. Available evidence suggests that the presence of others either reduces or increases facial responses, depending on the quality and strength of the emotional manipulation and on the nature of the relationship between interactants. Although both display rules and social motives provide viable explanations of audience “inhibition ” effects, some audience facilitation effects are less easily accommodated within an emotion-expression perspective. In particular emotion is not a sufficient condition for a corresponding “expression,” even discounting explicit regulation, and, apparently, “spontaneous ”facial movements may be facilitated by the presence of others. Further, there is no direct evidence that any particular facial movement provides an unambiguous expression of a specific emotion. However, information communicated by facial movements is not necessarily extrinsic to emotion. Facial movements not only transmit emotion-relevant information but also contribute to ongoing processes of emotional action in accordance with pragmatic theories.

Not everything is blue or brown: Quantification of ocular coloration in psychological research beyond dichotomous categorizations

The notion that phenomenologically observable differences in the human eye are correlated with behavioral tendencies (other than gaze-following) has been addressed poorly in the psychological literature. Most notably, the proposed correlations are based on an arbitrary categorization in discrete categories of the continuous variability across various traits that could be contributing to individual eye morphologies. We review the relevant literature and assume a view of human eyes as sign stimuli, identifying the relative contrast between the iridal and scleral areas as the main contributor to the strength of the signal. Based on this view, we present a new method for the precise quantification of the relative luminosity of the iris (RLI) and briefly discuss its potential applications in psychological research.

Configural Processing in the Perception of Eye-Gaze Direction

Traditional accounts of gaze perception emphasise the geometric or configural cues present in the eye; the position of the iris in relation to the corner of the eye, for example. This kind of geometric account has been supported, in part, by findings that gaze judgments are impaired in faces rotated through 180 degrees, a manipulation known to disrupt the processing of relations between facial elements. However, studies involving this manipulation have confounded inversion of the face context with inversion of the eye region. The effects of inversion might therefore have been caused by a disruption of the computation of gaze direction from the eye region itself and/or a disruption of the influence that face context might exert on gaze processing. In the experiment reported here we independently manipulated eye orientation and the orientation of the face context, and measured participants' sensitivity to gaze direction. Performance was severely affected by inversion of the eyes, regardless of the orientation of the face, whereas face inversion had no significant effect on gaze sensitivity. Previous reports of a face-inversion effect on gaze perception can therefore be attributed to inversion of the eye region itself which, we suggest, disrupts some form of configural or relational processing that is normally involved in the computation of eye-gaze direction.

Early Left Parietal Activity Elicited by Direct Gaze: A High-Density EEG Study

Gaze is one of the most important cues for human communication and social interaction. In particular, gaze contact is the most primary form of social contact and it is thought to capture attention. A very early-differentiated brain response to direct versus averted gaze has been hypothesized. Here, we used high-density electroencephalography to test this hypothesis. Topographical analysis allowed us to uncover a very early topographic modulation (40-80 ms) of event-related responses to faces with direct as compared to averted gaze. This modulation was obtained only in the condition where intact broadband faces-as opposed to high-pass or low-pas filtered faces-were presented. Source estimation indicated that this early modulation involved the posterior parietal region, encompassing the left precuneus and inferior parietal lobule. This supports the idea that it reflected an early orienting response to direct versus averted gaze. Accordingly, in a follow-up behavioural experiment, we found faster response times to the direct gaze than to the averted gaze broadband faces. In addition, classical evoked potential analysis showed that the N170 peak amplitude was larger for averted gaze than for direct gaze. Taken together, these results suggest that direct gaze may be detected at a very early processing stage, involving a parallel route to the ventral occipito-temporal route of face perceptual analysis.

Survival of the Friendliest: Homo sapiens Evolved via Selection for Prosociality

The challenge of studying human cognitive evolution is identifying unique features of our intelligence while explaining the processes by which they arose. Comparisons with nonhuman apes point to our early-emerging cooperative-communicative abilities as crucial to the evolution of all forms of human cultural cognition, including language. The human self-domestication hypothesis proposes that these early-emerging social skills evolved when natural selection favored increased in-group prosociality over aggression in late human evolution. As a by-product of this selection, humans are predicted to show traits of the domestication syndrome observed in other domestic animals. In reviewing comparative, developmental, neurobiological, and paleoanthropological research, compelling evidence emerges for the predicted relationship between unique human mentalizing abilities, tolerance, and the domestication syndrome in humans. This synthesis includes a review of the first a priori test of the self-domestication hypothesis as well as predictions for future tests.

A neuroimaging point of view on the diversity of social cognition: evidence for extended influence of experience- and emotion-related factors on face processing

Faces are key social stimuli that convey a wealth of information essential for person perception and adaptive interpersonal behaviour. Studies in the domain of cognitive, affective, and social neuroscience have put in light that the processing of faces recruits specific visual regions and activates a distributed set of brain regions related to attentional, emotional, social, and memory processes associated with the perception of faces and the extraction of the numerous information attached to them. Studies using neuroimaging techniques such as functional magnetic resonance imaging (fMRI) have allowed localizing these brain regions and characterizing their functional properties. Magnetoencephalography (MEG) and electroencephalography (EEG) techniques are complementary to fMRI in that they offer a unique insight into the temporal dynamics of mental processes. In this article, I review the contribution of neuroimaging techniques to the knowledge on face processing and person perception with the aim of putting in light the extended influence of experience-related factors, particularly in relation with emotions, on the face processing system. Although the face processing network has evolved under evolutionary selection pressure related to sociality-related needs and is therefore highly conserved throughout the human species, neuroimaging studies put in light both the extension and the flexibility of the brain network involved in face processing. MEG and EEG allow in particular to reveal that the human brain integrates emotion- and experience-related information from the earliest stage of face processing. Altogether, this emphasizes the diversity of social cognitive processes associated with face perception.

Effects of Facial Symmetry and Gaze Direction on Perception of Social Attributes: A Study in Experimental Art History

This article explores the possibility of testing hypotheses about art production in the past by collecting data in the present. We call this enterprise "experimental art history". Why did medieval artists prefer to paint Christ with his face directed towards the beholder, while profane faces were noticeably more often painted in different degrees of profile? Is a preference for frontal faces motivated by deeper evolutionary and biological considerations? Head and gaze direction is a significant factor for detecting the intentions of others, and accurate detection of gaze direction depends on strong contrast between a dark iris and a bright sclera, a combination that is only found in humans among the primates. One uniquely human capacity is language acquisition, where the detection of shared or joint attention, for example through detection of gaze direction, contributes significantly to the ease of acquisition. The perceived face and gaze direction is also related to fundamental emotional reactions such as fear, aggression, empathy and sympathy. The fast-track modulator model presents a related fast and unconscious subcortical route that involves many central brain areas. Activity in this pathway mediates the affective valence of the stimulus. In particular, different sub-regions of the amygdala show specific activation as response to gaze direction, head orientation and the valence of facial expression. We present three experiments on the effects of face orientation and gaze direction on the judgments of social attributes. We observed that frontal faces with direct gaze were more highly associated with positive adjectives. Does this help to associate positive values to the Holy Face in a Western context? The formal result indicates that the Holy Face is perceived more positively than profiles with both direct and averted gaze. Two control studies, using a Brazilian and a Dutch database of photographs, showed a similar but weaker effect with a larger contrast between the gaze directions for profiles. Our findings indicate that many factors affect the impression of a face, and that eye contact in combination with face direction reinforce the general impression of portraits, rather than determine it.

Monkeys head-gaze following is fast, precise and not fully suppressible

Human eye-gaze is a powerful stimulus, drawing the observer's attention to places and objects of interest to someone else ('eye-gaze following'). The largely homogeneous eyes of monkeys, compromising the assessment of eye-gaze by conspecifics from larger distances, explain the absence of comparable eye-gaze following in these animals. Yet, monkeys are able to use peer head orientation to shift attention ('head-gaze following'). How similar are monkeys' head-gaze and human eye-gaze following? To address this question, we trained rhesus monkeys to make saccades to targets, either identified by the head-gaze of demonstrator monkeys or, alternatively, identified by learned associations between the demonstrators' facial identities and the targets (gaze versus identity following). In a variant of this task that occurred at random, the instruction to follow head-gaze or identity was replaced in the course of a trial by the new rule to detect a change of luminance of one of the saccade targets. Although this change-of-rule rendered the demonstrator portraits irrelevant, they nevertheless influenced performance, reflecting a precise redistribution of spatial attention. The specific features depended on whether the initial rule was head-gaze or identity following: head-gaze caused an insuppressible shift of attention to the target gazed at by the demonstrator, whereas identity matching prompted much later shifts of attention, however, only if the initial rule had been identity following. Furthermore, shifts of attention prompted by head-gaze were spatially precise. Automaticity and swiftness, spatial precision and limited executive control characterizing monkeys' head-gaze following are key features of human eye-gaze following. This similarity supports the notion that both may rely on the same conserved neural circuitry.

Embodied Perception and the Economy of Action

Perception informs people about the opportunities for action and their associated costs. To this end, explicit awareness of spatial layout varies not only with relevant optical and ocular-motor variables, but also as a function of the costs associated with performing intended actions. Although explicit awareness is mutable in this respect, visually guided actions directed at the immediate environment are not. When the metabolic costs associated with walking an extent increase—perhaps because one is wearing a heavy backpack—hills appear steeper and distances to targets appear greater. When one is standing on a high balcony, the apparent distance to the ground is correlated with one's fear of falling. Perceiving spatial layout combines the geometry of the world with behavioral goals and the costs associated with achieving these goals.

Attention, Researchers! It Is Time to Take a Look at the Real World

Theories of attention, too often generated from artificial laboratory experiments, may have limited validity when attention in the natural world is considered. For instance, for more than two decades, conceptualizations of “reflexive” and “volitional” shifts of spatial attention have been grounded in methodologies that do not recognize or utilize the basic fact that people routinely use the eyes of other people as rich and complex attentional cues. This fact was confirmed by our novel discovery that eyes will trigger a reflexive shift of attention even when they are presented centrally and are known to be spatially nonpredictive. This exploration of real-world attention also led to our finding that, contrary to popular wisdom, arrows, like eyes, are capable of producing reflexive shifts of attention—a discovery that brings into question much of the existing attention research. We argue that research needs to be grounded in the real world and not in experimental paradigms. It is time for cognitive psychology to reaffirm the difficult task of studying attention in a manner that has relevance to real-life situations.

The Human Face as a Dynamic Tool for Social Communication

As a highly social species, humans frequently exchange social information to support almost all facets of life. One of the richest and most powerful tools in social communication is the face, from which observers can quickly and easily make a number of inferences - about identity, gender, sex, age, race, ethnicity, sexual orientation, physical health, attractiveness, emotional state, personality traits, pain or physical pleasure, deception, and even social status. With the advent of the digital economy, increasing globalization and cultural integration, understanding precisely which face information supports social communication and which produces misunderstanding is central to the evolving needs of modern society (for example, in the design of socially interactive digital avatars and companion robots). Doing so is challenging, however, because the face can be thought of as comprising a high-dimensional, dynamic information space, and this impacts cognitive science and neuroimaging, and their broader applications in the digital economy. New opportunities to address this challenge are arising from the development of new methods and technologies, coupled with the emergence of a modern scientific culture that embraces cross-disciplinary approaches. Here, we briefly review one such approach that combines state-of-the-art computer graphics, psychophysics and vision science, cultural psychology and social cognition, and highlight the main knowledge advances it has generated. In the light of current developments, we provide a vision of the future directions in the field of human facial communication within and across cultures.