Using pupil dilation, eye-blink rate, and the value of mother to investigate reward learning mechanisms in infancy

Now it's your turn!: Eye blink rate in a Jenga task modulated by interaction of task wait times, effortful control, and internalizing behaviors

Dopamine is a versatile neurotransmitter with implications in many domains, including anxiety and effortful control. Where high levels of effortful control are often regarded as adaptive, other work suggests that high levels of effortful control may be a risk factor for anxiety. Dopamine signaling may be key in understanding these relations. Eye blink rate is a non-invasive proxy metric of midbrain dopamine activity. However, much work with eye blink rate has been constrained to screen-based tasks which lack in ecological validity. We tested whether changes in eye blink rate during a naturalistic effortful control task differ as a function of parent-reported effortful control and internalizing behaviors. Children played a Jenga-like game with an experimenter, but for each trial the experimenter took an increasingly long time to take their turn. Blinks-per-second were computed during each wait period. Multilevel modeling examined the relation between duration of wait period, effortful control, and internalizing behaviors on eye blink rate. We found a significant 3-way interaction between effortful control, internalizing behaviors, and duration of the wait period. Probing this interaction revealed that for children with low reported internalizing behaviors (-1 SD) and high reported effortful control (+1 SD), eye blink rate significantly decreased as they waited longer to take their turn. These findings index task-related changes in midbrain dopamine activity in relation to naturalistic task demands, and that these changes may vary as a function of individual differences in effortful control and internalizing behaviors. We discuss possible top-down mechanisms that may underlie these differences.

Blink-Related Oscillations Provide Naturalistic Assessments of Brain Function and Cognitive Workload within Complex Real-World Multitasking Environments

BACKGROUND

There is a significant need to monitor human cognitive performance in complex environments, with one example being pilot performance. However, existing assessments largely focus on subjective experiences (e.g., questionnaires) and the evaluation of behavior (e.g., aircraft handling) as surrogates for cognition or utilize brainwave measures which require artificial setups (e.g., simultaneous auditory stimuli) that intrude on the primary tasks. Blink-related oscillations (BROs) are a recently discovered neural phenomenon associated with spontaneous blinking that can be captured without artificial setups and are also modulated by cognitive loading and the external sensory environment-making them ideal for brain function assessment within complex operational settings.

METHODS

Electroencephalography (EEG) data were recorded from eight adult participants (five F, M = 21.1 years) while they completed the Multi-Attribute Task Battery under three different cognitive loading conditions. BRO responses in time and frequency domains were derived from the EEG data, and comparisons of BRO responses across cognitive loading conditions were undertaken. Simultaneously, assessments of blink behavior were also undertaken.

RESULTS

Blink behavior assessments revealed decreasing blink rate with increasing cognitive load (p < 0.001). Prototypical BRO responses were successfully captured in all participants (p < 0.001). BRO responses reflected differences in task-induced cognitive loading in both time and frequency domains (p < 0.05). Additionally, reduced pre-blink theta band desynchronization with increasing cognitive load was also observed (p < 0.05).

CONCLUSION

This study confirms the ability of BRO responses to capture cognitive loading effects as well as preparatory pre-blink cognitive processes in anticipation of the upcoming blink during a complex multitasking situation. These successful results suggest that blink-related neural processing could be a potential avenue for cognitive state evaluation in operational settings-both specialized environments such as cockpits, space exploration, military units, etc. and everyday situations such as driving, athletics, human-machine interactions, etc.-where human cognition needs to be seamlessly monitored and optimized.

Seven-months-old infants show increased arousal to static emotion body expressions: Evidence from pupil dilation

Human body postures provide perceptual cues that can be used to discriminate and recognize emotions. It was previously found that 7-months-olds' fixation patterns discriminated fear from other emotion body expressions but it is not clear whether they also process the emotional content of those expressions. The emotional content of visual stimuli can increase arousal level resulting in pupil dilations. To provide evidence that infants also process the emotional content of expressions, we analyzed variations in pupil in response to emotion stimuli. Forty-eight 7-months-old infants viewed adult body postures expressing anger, fear, happiness and neutral expressions, while their pupil size was measured. There was a significant emotion effect between 1040 and 1640 ms after image onset, when fear elicited larger pupil dilations than neutral expressions. A similar trend was found for anger expressions. Our results suggest that infants have increased arousal to negative-valence body expressions. Thus, in combination with previous fixation results, the pupil data show that infants as young as 7-months can perceptually discriminate static body expressions and process the emotional content of those expressions. The results extend information about infant processing of emotion expressions conveyed through other means (e.g., faces).

Action value calculations in social context from infancy

Infants adaptively modulate their social behaviours, such as gaze-following, to social context. We propose that such modulations are based on infants' social decision-making, to achieve the most valuable outcome. We propose an 'action value calculator model', which formulates the cognitive mechanisms underlying, and the development of, the decision-making process during interactions.

Sensitive caregiving and reward responsivity: A novel mechanism linking parenting and executive functions development in early childhood

Sensitive caregiving is an essential aspect of positive parenting that influences executive functions development, but the mechanisms underlying this association are less clear. Using data from the Family Life Project, a large prospective longitudinal sample of 1292 families residing in rural, predominately low-income communities, the current study examined whether sensitive caregiving impacts executive functions development by shaping behavioral reward processing systems in early postnatal life. Results indicated that higher levels of sensitive caregiving during infancy were associated with heightened reward responsivity at age 4, which in turn predicted superior executive functions ability at age 5. Notably, children's reward responsivity partially mediated the relationship between sensitive caregiving in infancy and executive functions ability at school entry. These findings add to prior work on early experience and children's executive functions and highlight caregiver scaffolding of developing reward processing systems as a potential foundational mechanism for supporting adaptive behavior and self-regulation across the lifespan.

Evaluating the Distinction between Cool and Hot Executive Function during Childhood

This article assesses the cool-hot executive function (EF) framework during childhood. First, conceptual analyses suggest that cool EF (cEF) is generally distinguished from hot EF (hEF). Second, both EFs can be loaded into different factors using confirmatory factor analyses. Third, the cognitive complexity of EF is similar across cEF tasks, and the cognitive complexity of cEF is similar to hEF tasks. Finally, neuroimaging analysis suggests that children activate the lateral prefrontal regions during all EF tasks. Taken together, we propose that the cool-hot framework is a useful, though not definitive way of characterizing differences in EF.

Social reward anticipation in infants as revealed by event-related potentials

Infants engage in gaze interaction from the early stage of life. Emerging studies suggest that infants may expect social reward of shared attention before looking to the same object with another person. However, it was unknown about the neural responses during the anticipation of social rewards before shared attention in infants. We tested infants' reward anticipations in the gaze cueing situation measured by event-related potentials in the social association learning task. Six- to ten-month-old infants (N = 20) repeatedly observed that a female predictively looked toward the animation position (valid condition) or another female looking away from the animation (invalid condition). It was posited that infants could learn associations between female faces and the event of shared attention. The results showed that the stimulus preceding negativity which reflects reward anticipation before the animation presentation was elicited in the second half of the learning phases in the valid condition. Additionally, after the presentation of the face, N290 was greater in the second half of the learning phase than in the first half in the valid condition. These results suggest that infants can anticipate social reward from gaze cues, and learning the gaze cueing validity may affect not only reward anticipation but face perception.

Tonic and phasic effects of reward on the pupil: implications for locus coeruleus function

The locus coeruleus (LC), a nucleus in the pons of the brainstem, plays a significant role in attention and cognitive control. Here, we use an adapted auditory oddball paradigm and measured the pupil dilation response, to provide a marker of LC activity in humans. In Experiment 1, we show event-related pupil responses to rare auditory events which were further elevated by task relevant. In Experiment 2, by asking participants to silently count the number of oddballs, we demonstrated that the task-relevance elevation was not a result of the generation or execution of the manual response. In Experiment 3, we observed two separate effects of reward on the pupil response. First, we found an overall increase in pupil area in the high compared to the low-reward blocks: a sustained effect reminiscent of the tonic changes that occur in LC. Second, we found elevated event-related pupil responses to behaviourally relevant stimuli in the high-reward condition compared with the low-reward condition, consistent with phasic changes in LC in response to a stimulus. These results highlight the complexity of the relationship between the pupil response and reward, and the inferred role of LC in both top-down and bottom-up cognitive control.

The empathic personality profile: Using personality characteristics to reveal genetic, environmental, and developmental patterns of adolescents' empathy

How do genetic and environmental processes affect empathy during early adolescence? This study illumined this question by examining the etiology of empathy with the etiology of other personality characteristics. Israeli twin adolescents rated their empathy and personality at ages 11 (N=1176) and 13 (N=821) (733 families, 51.4% females). Parents rated adolescents' emotional empathy. Adolescents performed an emotion recognition task, indicating cognitive empathy. Using a cross-validated statistical learning algorithm, this study found emotional and cognitive 'empathic personality profiles', which describe and predict self-reported empathy from nuanced Big-Five personality characteristics, or 'nuances' (i.e., individual items). These profiles predicted empathy moderately (R² =.17-.24) and were stable and robust, within each age and between ages. They also predicted empathy in a new sample of older non-twin adolescents (N=96) and were validated against non-self-report empathy measures. Both emotional and cognitive empathy were predicted by nuances representing positive attitudes toward others, trust, forgiveness, and openness to experiences. Emotional empathy was also predicted by nuances representing anxiousness and negative reactivity. Twin analyses revealed overlapping genetic and environmental influences on empathy and the empathic personality profiles and overlapping environmental influences on empathy-personality change. This study demonstrates how addressing the complexity of individuals' personalities can inform adolescents' empathy development.

Psychological Impact and Influence of Animation on Viewer’s Visual Attention and Cognition: A Systematic Literature Review, Open Challenges, and Future Research Directions

Animation is an excellent method to associate with the audience in a fun and innovative manner. In recent span, animation has been employed in various fields to enhance knowledge, marketing, advertisement, and age groups from infants to adults. The present communication expounds the systematic review on the impact created by animation on the viewer’s visual attention. For this review, a database such as Google Scholar, ScienceDirect, Taylor & Francis, and IEEE Xplore were pursued for publications on the impact of animation on viewer’s visual attention from January 2015 to December 2021. The search results showcased 175 titles with 114 full articles, out of which 35 were related to viewers’ visual attention towards animation. These reviewed studies comprised of physical outcome ( $n=9$ ), psychological outcome ( $n=15$ ), and cognitive outcome ( $n=11$ ) from which the attention-related factors, physical effects, and cognitive effects of animation were assessed. The animation has influenced the viewer’s visual attention through the integration of the different stimuli and the highly organized presentation. Furthermore, the animation has also aided the viewer in attaining greater conceptual understanding, thereby facilitating their cognitive response. As a result, the animation was found to be helpful in enhancing learning skills, food marketing, and teaching strategy. Furthermore, the drawbacks and future recommendations of the studies were elaborated. In addition, challenges and open issues faced during the studies were discussed. Finally, the priority areas in animation identified for promising future directions to visualize large pool data, provide smart communication, and design 3D modeling structures were highlighted.

Physiological arousal explains infant gaze following in various social contexts

Gaze following (GF) is fundamental to central aspects of human sociocognitive development, such as acquiring language and cultural learning. Studies have shown that infant GF is not a simple reflexive orientation to an adult's eye movement. By contrast, infants adaptively modulate GF behaviour depending on the social context. However, arguably, the neurophysiological mechanisms underlying contextual modulation of GF remain somewhat unexplored. In this study, we tested the proposition about whether the contextual modulation of infant GF is mediated by the infant's heart rate (HR), which indicates the infant's physiological arousal. Forty-one 6- to 9-month-old infants participated in this study, and infants observed either a reliable face, which looked towards the location of an object, or an unreliable face, which looked away from the location of an object. Thereafter, the infants watched a video of the same model making eye contact or not making any ostensive signals, before shifting their gaze towards one of the two objects. We revealed that reliability and eye contact acted independently to increase HR, which then fully mediates the effects of these social cues on the frequency of GF. Results suggest that each social cue independently enhances physiological arousal, which then accumulatively predicts the likelihood of infant GF behaviour.

Physiological arousal explains infant gaze following in various social contexts

Gaze following (GF) is fundamental to central aspects of human sociocognitive development, such as acquiring language and cultural learning. Studies have shown that infant GF is not a simple reflexive orientation to an adult's eye movement. By contrast, infants adaptively modulate GF behaviour depending on the social context. However, arguably, the neurophysiological mechanisms underlying contextual modulation of GF remain somewhat unexplored. In this study, we tested the proposition about whether the contextual modulation of infant GF is mediated by the infant's heart rate (HR), which indicates the infant's physiological arousal. Forty-one 6- to 9-month-old infants participated in this study, and infants observed either a reliable face, which looked towards the location of an object, or an unreliable face, which looked away from the location of an object. Thereafter, the infants watched a video of the same model making eye contact or not making any ostensive signals, before shifting their gaze towards one of the two objects. We revealed that reliability and eye contact acted independently to increase HR, which then fully mediates the effects of these social cues on the frequency of GF. Results suggest that each social cue independently enhances physiological arousal, which then accumulatively predicts the likelihood of infant GF behaviour.

Pupil dilation predicts modulation of direct gaze on action value calculations

Perceiving direct gaze facilitates social cognition and behaviour. We hypothesized that direct gaze modulates decision-making, particularly calculations of action values. To test our hypothesis, we used the reinforcement learning paradigm in situations with or without direct gaze. Forty adults were recruited and participated in pupil size measurements and a two-armed bandit task. The task was conducted with 70% and 30% reward probabilities for each option. During the task, a female showing the Direct Gaze (DG) or Closed Eyes (CE) condition was presented from the start of each trial. The results showed that behavioural bias to choices with 70% reward probability increased more in the DG condition than in the CE condition and the expected reward value. This bias to choices with 70% reward in the DG condition was predicted by pupil dilation to DG. These results suggest that participants over-evaluated the expected reward value in the DG condition, and this DG effect may be related to subjective expectations of rewarding events indexed by pupil dilations. It is considered that perceiving direct gaze is a driver of reward expectations that modulate action value calculations and then cognitive processing and behaviours are facilitated.

Ocular measures during associative learning predict recall accuracy

The ability to form associations between stimuli and commit those associations to memory is a cornerstone of human cognition. Dopamine and noradrenaline are critical neuromodulators implicated in a range of cognitive functions, including learning and memory. Eye blink rate (EBR) and pupil diameter have been shown to index dopaminergic and noradrenergic activity. Here, we examined how these ocular measures relate to accuracy in a paired-associate learning task where participants (N = 73) learned consistent object-location associations over eight trials consisting of pre-trial fixation, encoding, delay, and retrieval epochs. In order to examine how within-subject changes and between-subject changes in ocular metrics related to accuracy, we mean centered individual metric values on each trial based on within-person and across-subject means for each epoch. Within-participant variation in EBR was positively related to accuracy in both encoding and delay epochs: faster EBR within the individual predicted better retrieval. Differences in EBR across participants was negatively related to accuracy in the encoding epoch and in early trials of the pre-trial fixation: faster EBR, relative to other subjects, predicted poorer retrieval. Visual scanning behavior in pre-trial fixation and delay epochs was also positively related to accuracy in early trials: more scanning predicted better retrieval. We found no relationship between pupil diameter and accuracy. These results provide novel evidence supporting the utility of ocular metrics in illuminating cognitive and neurobiological mechanisms of paired-associate learning.

Anticipation to Social and Nonsocial Dynamic Cues in Preschool-Age Children

The ability to learn from expectations is foundational to social and nonsocial learning in children. However, we know little about the brain basis of reward expectation in development. Here, 3- to 4-year-olds (N = 26) were shown a passive associative learning paradigm with dynamic stimuli. Anticipation for reward-related stimuli was measured via the stimulus preceding negativity (SPN). To our knowledge, this is the first study to measure an SPN in children younger than age 6. Our findings reveal distinct anticipatory neural signatures for social versus nonsocial stimuli, consistent with previous research in older children. This study suggests an SPN can be elicited in preschoolers and is larger for social than nonsocial stimuli.

All contexts are not created equal: Social stimuli win the competition for organizing reinforcement learning in 9-month-old infants

Previous work has shown that infants as young as 8 months of age can use certain features of the environment, such as the shape or color of visual stimuli, as cues to organize simple inputs into hierarchical rule structures, a robust form of reinforcement learning that supports generalization of prior learning to new contexts. However, especially in cluttered naturalistic environments, there are an abundance of potential cues that can be used to structure learning into hierarchical rule structures. It is unclear how infants determine what features constitute a higher-order context to organize inputs into hierarchical rule structures. Here, we examine whether 9-month-old infants are biased to use social stimuli, relative to non-social stimuli, as a higher-order context to organize learning of simple visuospatial inputs into hierarchical rule sets. Infants were presented with four face/color-target location pairings, which could be learned most simply as individual associations. Alternatively, infants could use the faces or colorful backgrounds as a higher-order context to organize the inputs into simpler color-location or face-location rules, respectively. Infants were then given a generalization test designed to probe how they learned the initial pairings. The results indicated that infants appeared to use the faces as a higher-order context to organize simpler color-location rules, which then supported generalization of learning to new face contexts. These findings provide new evidence that infants are biased to organize reinforcement learning around social stimuli.

Effects of Reinforcement Learning on Gaze Following of Gaze and Head Direction in Early Infancy: An Interactive Eye-Tracking Study

The current four experiments investigated gaze following behavior in response to gaze and head turns in 4-month-olds and how reinforcement learning influences this behavior (N = 99). Using interactive eye tracking, infants' gaze elicited an animation whenever infants followed a person's head or gaze orientation (Experiment 1.1, 2.1 and 2.2) or looked at the opposite side (Experiment 1.2). Infants spontaneously followed the direction of a turning head with and without simultaneously shifted gaze direction (Cohen's d: 0.93-1.05) but not the direction of isolated gaze shifts. We only found a weak effect of reinforcement on gaze following in one of the four experiments. Results will be discussed with regard to the impact of reinforcement on the maintenance of already existing gaze following behavior.

Adaptive rule learning of event sequences during the A-not-B task in 9-month-old infants

Prior work indicates that infants can use social information to organize simple audiovisual inputs into predictable rules by 8 months of age. However, it is unclear whether infants can use social information to organize more complex events into predictable rules that can be used to guide motor action. To examine these issues, we tested 9-month-old infants using a modified version of an A-not-B task, in which hiding event sequences were paired with different experimenters, who could be used to organize the events into rules that guide action. We predicted that infants' reaching accuracy would be better when the experimenter changes when the toy's hiding location changes, relative to when the experimenter stays the same, as this should cue a novel rule used to guide action. Experiments 1 and 2 validated this prediction. Experiment 3 showed that reaching accuracy was better when the toy's hiding location switched but was consistent with the rule associated with the experimenter, relative to when the toy's hiding location repeated but was inconsistent with the rule associated with the experimenter. These data suggest that infants can use the identities of experimenters to organize events into predictable rules that guide action in the A-not-B task.

Prepronociceptin-Expressing Neurons in the Extended Amygdala Encode and Promote Rapid Arousal Responses to Motivationally Salient Stimuli

Motivational states consist of cognitive, emotional, and physiological components controlled by multiple brain regions. An integral component of this neural circuitry is the bed nucleus of the stria terminalis (BNST). Here, we identify that neurons within BNST that express the gene prepronociceptin (Pnoc^BNST) modulate rapid changes in physiological arousal that occur upon exposure to motivationally salient stimuli. Using in vivo two-photon calcium imaging, we find that Pnoc^BNST neuronal responses directly correspond with rapid increases in pupillary size when mice are exposed to aversive and rewarding odors. Furthermore, optogenetic activation of these neurons increases pupillary size and anxiety-like behaviors but does not induce approach, avoidance, or locomotion. These findings suggest that excitatory responses in Pnoc^BNST neurons encode rapid arousal responses that modulate anxiety states. Further histological, electrophysiological, and single-cell RNA sequencing data reveal that Pnoc^BNST neurons are composed of genetically and anatomically identifiable subpopulations that may differentially tune rapid arousal responses to motivational stimuli.

Learning Process of Gaze Following: Computational Modeling Based on Reinforcement Learning

Many studies have explored factors which influence gaze-following behavior of young infants. However, the results of empirical studies were inconsistent, and the mechanism underlying the contextual modulation of gaze following remains unclear. In order to provide valuable insight into the mechanisms underlying gaze following, we conducted computational modeling using Q-learning algorithm and simulated the learning process of infant gaze following to suggest a feasible model. In Experiment 1, we simulated how communicative cues and infant internal states affect the learning process of gaze following. The simulation indicated that the model in which communicative cues enhance infant internal states is the most feasible to explain the infant learning process. In Experiment 2, we simulated how individual differences in motivation for communication affect the learning process. The results showed that low motivation for communication can delay the learning process and decrease the frequency of gaze following. These simulations suggest that communicative cues may enhance infants' internal states and promote the development of gaze following. Also, initial social motivation may affect the learning process of social behaviors in the long term.