Effects of Reinforcement Learning on Gaze Following of Gaze and Head Direction in Early Infancy: An Interactive Eye-Tracking Study

Action value calculations in social context from infancy

Infants adaptively modulate their social behaviours, such as gaze-following, to social context. We propose that such modulations are based on infants' social decision-making, to achieve the most valuable outcome. We propose an 'action value calculator model', which formulates the cognitive mechanisms underlying, and the development of, the decision-making process during interactions.

Physiological arousal explains infant gaze following in various social contexts

Gaze following (GF) is fundamental to central aspects of human sociocognitive development, such as acquiring language and cultural learning. Studies have shown that infant GF is not a simple reflexive orientation to an adult's eye movement. By contrast, infants adaptively modulate GF behaviour depending on the social context. However, arguably, the neurophysiological mechanisms underlying contextual modulation of GF remain somewhat unexplored. In this study, we tested the proposition about whether the contextual modulation of infant GF is mediated by the infant's heart rate (HR), which indicates the infant's physiological arousal. Forty-one 6- to 9-month-old infants participated in this study, and infants observed either a reliable face, which looked towards the location of an object, or an unreliable face, which looked away from the location of an object. Thereafter, the infants watched a video of the same model making eye contact or not making any ostensive signals, before shifting their gaze towards one of the two objects. We revealed that reliability and eye contact acted independently to increase HR, which then fully mediates the effects of these social cues on the frequency of GF. Results suggest that each social cue independently enhances physiological arousal, which then accumulatively predicts the likelihood of infant GF behaviour.

Physiological arousal explains infant gaze following in various social contexts

Gaze following (GF) is fundamental to central aspects of human sociocognitive development, such as acquiring language and cultural learning. Studies have shown that infant GF is not a simple reflexive orientation to an adult's eye movement. By contrast, infants adaptively modulate GF behaviour depending on the social context. However, arguably, the neurophysiological mechanisms underlying contextual modulation of GF remain somewhat unexplored. In this study, we tested the proposition about whether the contextual modulation of infant GF is mediated by the infant's heart rate (HR), which indicates the infant's physiological arousal. Forty-one 6- to 9-month-old infants participated in this study, and infants observed either a reliable face, which looked towards the location of an object, or an unreliable face, which looked away from the location of an object. Thereafter, the infants watched a video of the same model making eye contact or not making any ostensive signals, before shifting their gaze towards one of the two objects. We revealed that reliability and eye contact acted independently to increase HR, which then fully mediates the effects of these social cues on the frequency of GF. Results suggest that each social cue independently enhances physiological arousal, which then accumulatively predicts the likelihood of infant GF behaviour.

When it pays off to take a look: Infants learn to follow an object's motion with their gaze-Especially if it features eyes

Social cues and instrumental learning are two aspects potentially fostering early gaze following. We systematically investigated the influence of social features (schematic eyes vs. reverse-contrast eyes) and gaze-contingent reinforcement (elicited vs. not elicited) on 4-month-olds' learning to attend to gaze-cued objects. In 4 experiments, we tested infants' (N = 74) gaze following of a turning block with schematic or reverse-contrast eyes. In Experiments 1 and 2, infants could elicit an attractive animation in a training phase via interactive eye tracking by following the turning of the block. Experiments 3 and 4 were yoked controls without contingent reinforcement. Infants did not spontaneously follow the motion of the block. Four-month-olds always followed the block after training when it featured schematic eyes. When the block featured reverse-contrast eyes, the training phase only affected infants' looking behavior without reinforcement. While speaking to a certain degree of plasticity, findings stress the importance of eyes for guiding infants' attention.

Infants Learn to Follow Gaze in Stages: Evidence Confirming a Robotic Prediction

Gaze following is an early-emerging skill in infancy argued to be fundamental to joint attention and later language development. However, how gaze following emerges is a topic of great debate. Representational theories assume that in order to follow adults’ gaze, infants must have a rich sensitivity to adults’ communicative intention from birth. In contrast, learning-based theories hold that infants may learn to gaze follow based on low-level social reinforcement, without the need to understand others’ mental states. Nagai et al. (2006) successfully taught a robot to gaze follow through social reinforcement and found that the robot learned in stages: first in the horizontal plane, and later in the vertical plane—a prediction that does not follow from representational theories. In the current study, we tested this prediction in an eye-tracking paradigm. Six-month-olds did not follow gaze in either the horizontal or vertical plane, whereas 12-month-olds and 18-month-olds only followed gaze in the horizontal plane. These results confirm the core prediction of the robot model, suggesting that children may also learn to gaze follow through social reinforcement coupled with a structured learning environment.

Comparing Online Webcam- and Laboratory-Based Eye-Tracking for the Assessment of Infants' Audio-Visual Synchrony Perception

Online data collection with infants raises special opportunities and challenges for developmental research. One of the most prevalent methods in infancy research is eye-tracking, which has been widely applied in laboratory settings to assess cognitive development. Technological advances now allow conducting eye-tracking online with various populations, including infants. However, the accuracy and reliability of online infant eye-tracking remain to be comprehensively evaluated. No research to date has directly compared webcam-based and in-lab eye-tracking data from infants, similarly to data from adults. The present study provides a direct comparison of in-lab and webcam-based eye-tracking data from infants who completed an identical looking time paradigm in two different settings (in the laboratory or online at home). We assessed 4-6-month-old infants (n = 38) in an eye-tracking task that measured the detection of audio-visual asynchrony. Webcam-based and in-lab eye-tracking data were compared on eye-tracking and video data quality, infants' viewing behavior, and experimental effects. Results revealed no differences between the in-lab and online setting in the frequency of technical issues and participant attrition rates. Video data quality was comparable between settings in terms of completeness and brightness, despite lower frame rate and resolution online. Eye-tracking data quality was higher in the laboratory than online, except in case of relative sample loss. Gaze data quantity recorded by eye-tracking was significantly lower than by video in both settings. In valid trials, eye-tracking and video data captured infants' viewing behavior uniformly, irrespective of setting. Despite the common challenges of infant eye-tracking across experimental settings, our results point toward the necessity to further improve the precision of online eye-tracking with infants. Taken together, online eye-tracking is a promising tool to assess infants' gaze behavior but requires careful data quality control. The demographic composition of both samples differed from the generic population on caregiver education: our samples comprised caregivers with higher-than-average education levels, challenging the notion that online studies will per se reach more diverse populations.