The influence of emotional facial expressions on gaze-following in grouped and solitary pedestrians

Effects of emotional content on social inhibition of gaze in live social and non-social situations

In real-life interactions, it is crucial that humans adequately respond to others' emotional expressions. Emotion perception so far has mainly been studied in highly controlled laboratory tasks. However, recent research suggests that attention and gaze behaviour significantly differ between watching a person on a controlled laboratory screen compared to in real world interactions. Therefore, the current study aimed to investigate effects of emotional expression on participants' gaze in social and non-social situations. We compared looking behaviour towards a confederate showing positive, neutral or negative facial expressions between live social and non-social waiting room situations. Participants looked more often and longer to the confederate on the screen, than when physically present in the room. Expressions displayed by the confederate and individual traits (social anxiety and autistic traits) of participants did not reliably relate to gaze behaviour. Indications of covert attention also occurred more often and longer during the non-social, than during the social condition. Findings indicate that social norm is a strong factor modulating gaze behaviour in social contexts. PROTOCOL REGISTRATION: The stage 1 protocol for this Registered Report was accepted in principle on September 13, 2021. The protocol, as accepted by the journal, can be found at: https://doi.org/10.6084/m9.figshare.16628290 .

Standing out from the crowd: Both cue numerosity and social information affect attention in multi-agent contexts

Groups of people offer abundant opportunities for social interactions. We used a two-phase task to investigate how social cue numerosity and social information about an individual affected attentional allocation in such multi-agent settings. The learning phase was a standard gaze-cuing procedure in which a stimulus face could be either uninformative or informative about the upcoming target. The test phase was a group-cuing procedure in which the stimulus faces from the learning phase were presented in groups of three. The target could either be cued by the group minority (i.e., one face) or majority (i.e., two faces) or by uninformative or informative stimulus faces. Results showed an effect of cue numerosity, whereby responses were faster to targets cued by the group majority than the group minority. However, responses to targets cued by informative identities included in the group minority were as fast as responses to targets cued by the group majority. Thus, previously learned social information about an individual was able to offset the general enhancement of cue numerosity, revealing a complex interplay between cue numerosity and social information in guiding attention in multi-agent settings.

Collective rule-breaking

Rules form an important part of our everyday lives. Here we explore the role of social influence in rule-breaking. In particular, we identify some of the cognitive mechanisms underlying rule-breaking and propose approaches for how they can be scaled up to the level of groups or crowds to better understand the emergence of collective rule-breaking. Social contagion plays an important role in such processes and different dynamics such as linear or rapid nonlinear spreading can have important consequences for interventions in rule-breaking. A closer integration of cognitive psychology, microsociology and mathematical modelling will be key to a deeper understanding of collective rule-breaking to turn this field of research into a predictive science.

The role of cognitive load in modulating social looking: a mobile eye tracking study

The effect of cognitive load on social attention was examined across three experiments in a live pedestrian passing scenario (Experiments 1 and 2) and with the same scenario presented as a video (Experiment 3). In all three experiments, the load was manipulated using an auditory 2-back task. While the participant was wearing a mobile eye-tracker, the participant's fixation behavior toward a confederate was recorded and analyzed based on temporal proximity from the confederate (near or far) and the specific regions of the confederate being observed (i.e., head or body). In Experiment 1 we demonstrated an effect of cognitive load such that there was a lower proportion of fixations and time spent fixating toward the confederate in the load condition. A similar pattern of results was found in Experiment 2 when a within-subject design was used. In Experiment 3, which employed a less authentic social situation (i.e., video), a similar effect of cognitive load was observed. Collectively, these results suggest attentional resources play a central role in social attentional behaviors in both authentic (real-world) and less authentic (video recorded) situations.

Task-related gaze control in human crowd navigation

Human crowds provide an interesting case for research on the perception of people. In this study, we investigate how visual information is acquired for (1) navigating human crowds and (2) seeking out social affordances in crowds by studying gaze behavior during human crowd navigation under different task instructions. Observers (n = 11) wore head-mounted eye-tracking glasses and walked two rounds through hallways containing walking crowds (n = 38) and static objects. For round one, observers were instructed to avoid collisions. For round two, observers furthermore had to indicate with a button press whether oncoming people made eye contact. Task performance (walking speed, absence of collisions) was similar across rounds. Fixation durations indicated that heads, bodies, objects, and walls maintained gaze comparably long. Only crowds in the distance maintained gaze relatively longer. We find no compelling evidence that human bodies and heads hold one's gaze more than objects while navigating crowds. When eye contact was assessed, heads were fixated more often and for a total longer duration, which came at the cost of looking at bodies. We conclude that gaze behavior in crowd navigation is task-dependent, and that not every fixation is strictly necessary for navigating crowds. When explicitly tasked with seeking out potential social affordances, gaze is modulated as a result. We discuss our findings in the light of current theories and models of gaze behavior. Furthermore, we show that in a head-mounted eye-tracking study, a large degree of experimental control can be maintained while many degrees of freedom on the side of the observer remain.

Socially Communicative Eye Contact and Gender Affect Memory

Because of their value as a socially communicative cue, researchers have strived to understand how the gaze of other people influences a variety of cognitive processes. Recent work in social attention suggests that the use of images of people in laboratory studies, as a substitute for real people, may not effectively test socially communicative aspects of eye gaze. As attention affects many other cognitive processes, it is likely that social attention between real individuals could also affect other cognitive processes, such as memory. However, from previous work alone, it is unclear whether, and if so how, socially communicative eye gaze affects memory. The present studies test the assumption that socially communicative aspects of eye gaze may impact memory by manipulating the eye gaze of a live speaker in the context of a traditional recognition paradigm used frequently in the laboratory. A female (Experiment 1) or male (Experiment 2) investigator read words aloud and varied whether eye contact was, or was not, made with a participant. With both female and male investigators, eye contact improved word recognition only for female participants and hindered word recognition in male participants. When a female investigator prolonged their eye contact (Experiment 3) to provide a longer opportunity to both observe and process the investigator's eye gaze, the results replicated the findings from Experiments 1 and 2. The findings from Experiments 1-3 suggest that females interpret and use the investigator's eye gaze differently than males. When key aspects from the previous experiments were replicated in a noncommunicative situation (i.e., when a video of a speaker is used instead of a live speaker; Experiment 4), the memory effects observed previously in response to eye gaze were eliminated. Together, these studies suggest that it is the socially communicative aspects of eye gaze from a real person that influence memory. The findings reveal the importance of using social cues that are communicative in nature (e.g., real people) when studying the relationship between social attention and memory.

Interpersonal Affordances and Social Dynamics in Collaborative Immersive Virtual Environments: Passing Together Through Apertures

An essential question in understanding how to develop and build collaborative immersive virtual environments (IVEs) is recognizing how people perform actions together. Many actions in the real world require that people act without prior planning, and these actions are executed quite successfully. In this paper, we study the common action of two people passing through an aperture together in both the real world (Experiment 1) and in a distributed, collaborative IVE (Experiment 2). The aperture's width is varied from too narrow to be passable to so wide as to be easily passable by both participants together simultaneously. We do this in the real world for all possible gender-based pairings. In virtual reality, however, there is potential for the gender of the participant and the gender of the self-avatar to be different. We also investigate the joint action for all possible gender-based pairings in the distributed IVE. Results indicated that, in the real world, social dynamics between gendered pairings emerged; male-male pairings refused to concede to one another until absolutely necessary while other pairings did not. Male-female pairings were most likely to provide ample space to one another during passage. These behaviors seemed not to appear in the IVE, and avatar gender across all pairings generated no significant behavioral differences. In addition, participants tended to require wider gaps to allow for passage in the IVE. These findings establish base knowledge of social dynamics and affordance behaviors within multi-user IVEs.

Traveling Groups Stick Together: How Collective Directional Movement Influences Social Cohesion

We tested the hypothesis that the social act of moving through space with others-collective directional movement-is associated with greater levels of group cohesion compared to static activities. We asked participants to imagine participating in activities as part of a same-sex group and found that imagining going on a journey is associated with higher levels of expected cohesion compared to imagining attending a meeting (Study 1) or an event (Study 2). Study 3 replicates the main effect using different manipulations and finds that it persists regardless of whether the imagined group were friends or strangers. Two further studies employed real-world tasks and show that the effect is not a consequence of goal ascription (Study 4) or synchrony/exertion (Study 5). We argue that the link between this activity and cohesion is a consequence of its ubiquity in social ecologies and the interdependence and shared common fate of those engaged in it.

How attention gates social interactions

Social interactions are at the core of social life. However, humans selectively choose their exchange partners and do not engage in all available opportunities for social encounters. In this review, we argue that attentional systems play an important role in guiding the selection of social interactions. Supported by both classic and emerging literature, we identify and characterize the three core processes-perception, interpretation, and evaluation-that interact with attentional systems to modulate selective responses to social environments. Perceptual processes facilitate attentional prioritization of social cues. Interpretative processes link attention with understanding of cues' social meanings and agents' mental states. Evaluative processes determine the perceived value of the source of social information. The interplay between attention and these three routes of processing places attention in a powerful role to manage the selection of the vast amount of social information that individuals encounter on a daily basis and, in turn, gate the selection of social interactions.

Perceiving crowd attention: Gaze following in human crowds with conflicting cues

People automatically redirect their visual attention by following others' gaze orientation, a phenomenon called "gaze following." This is an evolutionarily generated socio-cognitive process that provides people with information about their environments. Often, however, people in crowds can have rather different gaze orientations. This study investigated how gaze following occurs in situations with many conflicting gazes. In two experiments, we modified the gaze cueing paradigm to use a crowd rather than a single individual. Specifically, participants were presented with a group of human avatars with differing gaze orientations, and the target appeared randomly on the left or right side of a display. We found that (a) when a marked difference existed in the number of avatars with divergent gaze orientations, participants automatically followed the majority's gaze orientation, and (b) the strongest gaze cue effect occurred when all gazes shared the same orientation, with the response superiority of the majority's oriented location monotonically diminishing with the number of gazes with divergent orientations. These findings suggested that the majority rule plays a role in gaze following behavior when individuals are confronted with conflicting multigaze scenes, and that an increasing subgroup size appears to enlarge the strength of the gaze cueing effect.

Where Is Your Attention? Assessing Individual Instances of Covert Attentional Orienting in Response to Gaze and Arrow Cues

Humans spontaneously follow where others are looking. However, recent investigations suggest such gaze-following behavior during natural interactions occurs relatively infrequently, only in about a third of available instances. Here we investigated if a similar frequency of orienting is also found in laboratory tasks that measure covert attentional orienting using manual responses. To do so, in two experiments, we analyzed responses from a classic gaze cuing task, with arrow cues serving as control stimuli. We reasoned that the proportions of attentional benefits and costs, defined as responses falling outside of 1 standard deviation of the average performance for the neutral condition, would provide a good approximation of individual instances of attentional shifts. We found that although benefits and costs occurred in less than half of trials, benefits emerged on a greater proportion of validly cued relative to invalidly cued trials. This pattern of data held across two different measures of neutral performance, as assessed by Experiments 1 and 2, as well as across the two cue types. These results suggest that similarly to gaze-following in naturalistic settings, covert orienting within the cuing task also appears to occur relatively infrequently.

Influence of Coactors on Saccadic and Manual Responses

Two experiments were conducted to investigate the effects of coaction on saccadic and manual responses. Participants performed the experiments either in a solitary condition or in a group of coactors who performed the same tasks at the same time. In Experiment 1, participants completed a pro- and antisaccade task where they were required to make saccades towards (prosaccades) or away (antisaccades) from a peripheral visual stimulus. In Experiment 2, participants performed a visual discrimination task that required both making a saccade towards a peripheral stimulus and making a manual response in reaction to the stimulus’s orientation. The results showed that performance of stimulus-driven responses was independent of the social context, while volitionally controlled responses were delayed by the presence of coactors. These findings are in line with studies assessing the effect of attentional load on saccadic control during dual-task paradigms. In particular, antisaccades – but not prosaccades – were influenced by the type of social context. Additionally, the number of coactors present in the group had a moderating effect on both saccadic and manual responses. The results support an attentional view of social influences.