Single point motion kinematics convey emotional signals in children and adults

This study investigates whether humans recognize different emotions conveyed only by the kinematics of a single moving geometrical shape and how this competence unfolds during development, from childhood to adulthood. To this aim, animations in which a shape moved according to happy, fearful, or neutral cartoons were shown, in a forced-choice paradigm, to 7- and 10-year-old children and adults. Accuracy and response times were recorded, and the movement of the mouse while the participants selected a response was tracked. Results showed that 10-year-old children and adults recognize happiness and fear when conveyed solely by different kinematics, with an advantage for fearful stimuli. Fearful stimuli were also accurately identified at 7-year-olds, together with neutral stimuli, while, at this age, the accuracy for happiness was not significantly different than chance. Overall, results demonstrates that emotions can be identified by a single point motion alone during both childhood and adulthood. Moreover, motion contributes in various measures to the comprehension of emotions, with fear recognized earlier in development and more readily even later on, when all emotions are accurately labeled.

A neurophysiological signature of dynamic emotion recognition associated with social communication skills and cortical gamma-aminobutyric acid levels in children

Introduction

Emotion recognition is a core feature of social perception. In particular, perception of dynamic facial emotional expressions is a major feature of the third visual pathway. However, the classical N170 visual evoked signal does not provide a pure correlate of such processing. Indeed, independent component analysis has demonstrated that the N170 component is already active at the time of the P100, and is therefore distorted by early components. Here we implemented, a dynamic face emotional paradigm to isolate a more pure face expression selective N170. We searched for a neural correlate of perception of dynamic facial emotional expressions, by starting with a face baseline from which a facial expression evolved. This allowed for a specific facial expression contrast signal which we aimed to relate with social communication abilities and cortical gamma-aminobutyric acid (GABA) levels.

Methods

We recorded event-related potentials (ERPs) and Magnetic Resonance (MRS) measures in 35 typically developing (TD) children, (10-16 years) sex-matched, during emotion recognition of an avatar morphing/unmorphing from neutral to happy/sad expressions. This task allowed for the elimination of the contribution low-level visual components, in particular the P100, by morphing baseline isoluminant neutral faces into specific expressions, isolating dynamic emotion recognition. Therefore, it was possible to isolate a dynamic face sensitive N170 devoid of interactions with earlier components.

Results

We found delayed N170 and P300, with a hysteresis type of dependence on stimulus trajectory (morphing/unmorphing), with hemispheric lateralization. The delayed N170 is generated by an extrastriate source, which can be related to the third visual pathway specialized in biological motion processing. GABA levels in visual cortex were related with N170 amplitude and latency and predictive of worse social communication performance (SCQ scores). N170 latencies reflected delayed processing speed of emotional expressions and related to worse social communication scores.

Discussion

In sum, we found a specific N170 electrophysiological signature of dynamic face processing related to social communication abilities and cortical GABA levels. These findings have potential clinical significance supporting the hypothesis of a spectrum of social communication abilities and the identification of a specific face-expression sensitive N170 which can potentially be used in the development of diagnostic and intervention tools.

You can't play with us: First-person ostracism affects infants' behavioral reactivity

Ostracism negatively affects fundamental psychological needs, induces physiological and behavioral changes, and modulates the processing of social information in adults. Yet little is known about children and preverbal infants' responses to first-person experiences of ostracism. The current study aimed to explore the efficacy of a triadic ball-tossing game in manipulating social inclusion and ostracism with 13-month-old infants (N = 84; 44% males; mostly White; tested from 2019 to 2022) by developing an observational coding system. Infants' behaviors were recorded while participating in a ball-tossing game where they were either included or ostracized from the game. Ostracized, but not included, infants showed an increase in negative emotionality and involvement behaviors, thus suggesting that behavioral responses to being ostracized emerge early in life.

Neural signatures to prosocial and antisocial interactions in young infants

Preverbal infants appear to be more attracted by prosocial characters and events, as typically assessed using preferential looking times and manual choice. However, infants' neural correlates of observed prosocial and antisocial interactions are still scarce. Here, we familiarized 5-month-old (N = 24) infants with a prosocial and antisocial scene (i.e., a character either helping or hindering) and infants' Event-Related Potentials (ERP) were recorded in response to the presentation of short video clips of the prosocial and antisocial interaction. On a neural level, results revealed that infants could discriminate between helping and hindering events at an early stage of processing, as shown by a larger N290 response to the former compared to the latter. Further, while the Nc - typically indexing attentional processes - was larger for antisocial over prosocial events, the LPP, indexing cognitive evaluation of the stimuli, was larger for prosocial over antisocial actions. Finally, infants' higher scores on the effortful control temperamental subscale were related to infants' increased N290 neural sensitivity to antisocial scenes. Together, these findings provide new evidence of the time course of infants' ERP responses during the observation of helping and hindering interactions, which involves both attentional and socially relevant processes.

Ostracism modulates children's recognition of emotional facial expressions

Ostracism has been shown to induce considerable physiological, behavioral and cognitive changes in adults. Previous research demonstrated its effects on children's cognitive and behavioral abilities, but less is known about its impact on their capacity to recognize subtle variations in social cues. The present study aimed at investigating whether social manipulations of inclusion and ostracism modulate emotion recognition abilities in children, and whether this modulation varies across childhood. To do so, 5- and 10-year-old children participated in a computer-based ball tossing game called Cyberball during which they were either included or ostracized. Then, they completed a facial emotion recognition task in which they were required to identify neutral facial expressions, or varying levels of intensity of angry and fearful facial expressions. Results indicated lower misidentification rates for children who were previously ostracized as compared to children who were previously included, both at 5 and 10 years of age. Moreover, when looking at children's accuracy and sensitivity to facial expressions, 5-year-olds' decoding abilities were affected by the social manipulation, while no difference between included and ostracized participants was observed for 10-year-olds. In particular, included and ostracized 10-year-old children as well as ostracized 5-year-olds showed higher accuracy and sensitivity for expressions of fear as compared to anger, while no such difference was observed for included 5-year-olds. Overall, the current study presents evidence that Cyberball-induced inclusion and ostracism modulate children's recognition of emotional faces.

Signatures of emotional face processing measured by event-related potentials in 7-month-old infants

The ability to distinguish facial emotions emerges in infancy. Although this ability has been shown to emerge between 5 and 7 months of age, the literature is less clear regarding the extent to which neural correlates of perception and attention play a role in processing of specific emotions. This study's main goal was to examine this question among infants. To this end, we presented angry, fearful, and happy faces to 7-month-old infants (N = 107, 51% female) while recording event-related brain potentials. The perceptual N290 component showed a heightened response for fearful and happy relative to angry faces. Attentional processing, indexed by the P400, showed some evidence of a heightened response for fearful relative to happy and angry faces. We did not observe robust differences by emotion in the negative central (Nc) component, although trends were consistent with previous work suggesting a heightened response to negatively valenced expressions. Results suggest that perceptual (N290) and attentional (P400) processing is sensitive to emotions in faces, but these processes do not provide evidence for a fear-specific bias across components.

A neural marker of rapid discrimination of facial expression in 3.5- and 7-month-old infants

Infants’ ability to discriminate facial expressions has been widely explored, but little is known about the rapid and automatic ability to discriminate a given expression against many others in a single experiment. Here we investigated the development of facial expression discrimination in infancy with fast periodic visual stimulation coupled with scalp electroencephalography (EEG). EEG was recorded in eighteen 3.5- and eighteen 7-month-old infants presented with a female face expressing disgust, happiness, or a neutral emotion (in different stimulation sequences) at a base stimulation frequency of 6 Hz. Pictures of the same individual expressing other emotions (either anger, disgust, fear, happiness, sadness, or neutrality, randomly and excluding the expression presented at the base frequency) were introduced every six stimuli (at 1 Hz). Frequency-domain analysis revealed an objective (i.e., at the predefined 1-Hz frequency and harmonics) expression-change brain response in both 3.5- and 7-month-olds, indicating the visual discrimination of various expressions from disgust, happiness and neutrality from these early ages. At 3.5 months, the responses to the discrimination from disgust and happiness expressions were located mainly on medial occipital sites, whereas a more lateral topography was found for the response to the discrimination from neutrality, suggesting that expression discrimination from an emotionally neutral face relies on distinct visual cues than discrimination from a disgust or happy face. Finally, expression discrimination from happiness was associated with a reduced activity over posterior areas and an additional response over central frontal scalp regions at 7 months as compared to 3.5 months. This result suggests developmental changes in the processing of happiness expressions as compared to negative/neutral ones within this age range.

Preschoolers’ Sensitivity to Negative and Positive Emotional Facial Expressions: An ERP Study

The study examined processing differences for facial expressions (happy, angry, or neutral) and their repetition with early (P1, N170) and late (P3) event-related potentials (ERPs) in young children (N = 33). EEG was recorded while children observed sequentially presented pairs of facial expressions, which were either the same (repeated trials) or differed in their emotion (novel trials). We also correlated ERP amplitude differences with parental and child measures of socio-emotional competence (emotion recognition, empathy). P1 amplitudes were increased for angry and happy as compared to neutral expressions. We also detected larger P3 amplitudes for angry expressions as compared to happy or neutral expressions. Repetition effects were evident at early and late processing stages marked by reduced P1 amplitudes for repeated vs. novel happy expressions, but enhanced P3 amplitudes for repeated vs. novel facial expressions. N170 amplitudes were neither modulated by facial expressions nor their repetition. None of the repetition effects were associated with measures of socio-emotional competence. Taken together, negative facial expressions led to increased neural activations in early and later processing stages, indicative of enhanced saliency to potential threating stimuli in young children. Processing of repeated facial expression seem to be differential for early and late neural stages: Reduced activation was detected at early neural processing stages particularly for happy faces, indicative of effective processing for an emotion, which is most familiar within this age range. Contrary to our hypothesis, enhanced activity for repeated vs. novel expression independent of a particular emotion were detected at later processing stages, which may be linked to the creation of new memory traces. Early and late repetition effects are discussed in light of developmental and perceptual differences as well as task-specific load.

The Relationship between Crawling and Emotion Discrimination in 9- to 10-Month-Old Infants

The present study examined whether infants’ crawling experience is related to their sensitivity to fearful emotional expressions. Twenty-nine 9- to 10-month-old infants were tested in a preferential looking task, in which they were presented with different pairs of animated faces on a screen displaying a 100% happy facial expression and morphed facial expressions containing varying degrees of fear and happiness. Regardless of their crawling experiences, all infants looked longer at more fearful faces. Additionally, infants with at least 6 weeks of crawling experience needed lower levels of fearfulness in the morphs in order to detect a change from a happy to a fearful face compared to those with less crawling experience. Thus, the crawling experience seems to increase infants’ sensitivity to fearfulness in faces.

Sequential learning of emotional faces is statistical at 12 months of age

Infants are capable of extracting statistical regularities from continuous streams of elements, which helps them structuring their surrounding environment. The current study examines 12-month-olds' capacity to extract statistical information from a sequence of emotional faces. Using a familiarization procedure, infants were presented with videos of two actresses expressing the same facial emotion, and subsequently turning toward or away from each other. Videos displayed different emotions (i.e., anger, happiness, fear, sadness, surprise, amusement, disgust, and exasperation) and were organized sequentially, so that the transitional probabilities between videos were highly predictable in some cases, and less predictable in others. At test, infants discriminated highly predictable from low predictable transitional probabilities, suggesting that they extracted statistical regularities from the sequence of emotional faces. However, when examining the looking toward and the looking away conditions separately, infants showed evidence of statistical learning in the looking toward condition only. Together, these findings suggest that 12-month-old infants rely on statistical learning to segment a continuous sequence of emotional faces, although this ability can be modulated by the nature of the stimuli. The contribution of statistical learning to structure infants' social environment is discussed.

Decoding functional brain networks through graph measures in infancy: The case of emotional faces

Graph measures represent an optimal way to investigate neural networks' organization, yet their application is still limited in developmental samples. To uncover the organization of 7-month-old infants' functional brain networks during an emotional perception task, we combined a decoding technique (i.e., Principal Component Regression) to graph metrics computation. Nodes' Within Module Degree Z Score (WMDZ) was computed as a measure of modular organization, and we decoded networks' functional organizations across EEG alpha and theta bands in response to static and dynamic facial expressions of emotions. We found that infants' brain topological activity differentiates between static and dynamic emotional faces due to the involvement of visual streams and sensorimotor areas, as often observed in adults. Moreover, network invariances point toward an already present rudimental network structure tuned to face processing already at 7-months of age. Overall, our results affirm the fruitfulness of the application of graph measures in developmental samples, due to their flexibility and the wealth of information they provide over infants' networks functional organization.

Measuring the temporal dynamics of inter-personal neural entrainment in continuous child-adult EEG hyperscanning data

Current approaches to analysing EEG hyperscanning data in the developmental literature typically consider interpersonal entrainment between interacting physiological systems as a time-invariant property. This approach obscures crucial information about how entrainment between interacting systems is established and maintained over time. Here, we describe methods, and present computational algorithms, that will allow researchers to address this gap in the literature. We focus on how two different approaches to measuring entrainment, namely concurrent (e.g., power correlations, phase locking) and sequential (e.g., Granger causality) measures, can be applied to three aspects of the brain signal: amplitude, power, and phase. We guide the reader through worked examples using simulated data on how to leverage these methods to measure changes in interbrain entrainment. For each, we aim to provide a detailed explanation of the interpretation and application of these analyses when studying neural entrainment during early social interactions.

Utility of Linear Mixed Effects Models for Event-Related Potential Research with Infants and Children

Event-related potentials (ERPs) are advantageous for investigating cognitive development. However, their application in infants/children is challenging given children’s difficulty in sitting through the multiple trials required in an ERP task. Thus, a large problem in developmental ERP research is high subject exclusion due to too few analyzable trials. Common analytic approaches (that involve averaging trials within subjects and excluding subjects with too few trials, as in ANOVA and linear regression) work around this problem, but do not mitigate it. Moreover, these practices can lead to inaccuracies in measuring neural signals. The greater the subject exclusion, the more problematic inaccuracies can be. We review recent developmental ERP studies to illustrate the prevalence of these issues. Critically, we demonstrate an alternative approach to ERP analysis—linear mixed effects (LME) modeling—which offers unique utility in developmental ERP research. We demonstrate with simulated and real ERP data from preschool children that commonly employed ANOVAs yield biased results that become more biased as subject exclusion increases. In contrast, LME models yield accurate, unbiased results even when subjects have low trial-counts, and are better able to detect real condition differences. We include tutorials and example code to facilitate LME analyses in future ERP research.

•

Linear Mixed Effects models (LMEs) have advantages for event-related potential analyses.

•

For infant/child ERPs especially, LME is superior to traditional ANOVA models.

•

In simulated ERP data, ANOVAs returned biased results, but LME was unbiased.

•

In real, child ERP data, LME detected condition differences where ANOVA did not.

•

Tutorial and sample codes given to guide use of LMEs in future research.

Differential beta desynchronisation responses to dynamic emotional facial expressions are attenuated in higher trait anxiety and autism

Daily life demands that we differentiate between a multitude of emotional facial expressions (EFEs). The mirror neuron system (MNS) is becoming increasingly implicated as a neural network involved with understanding emotional body expressions. However, the specificity of the MNS's involvement in emotion recognition has remained largely unexplored. This study investigated whether six basic dynamic EFEs (anger, disgust, fear, happiness, sadness, and surprise) would be differentiated through event-related desynchronisation (ERD) of sensorimotor alpha and beta oscillatory activity, which indexes sensorimotor MNS activity. We found that beta ERD differentiated happy, fearful, and sad dynamic EFEs at the central region of interest, but not at occipital regions. Happy EFEs elicited significantly greater central beta ERD relative to fearful and sad EFEs within 800 - 2,000 ms after EFE onset. These differences were source-localised to the primary somatosensory cortex, which suggests they are likely to reflect differential sensorimotor simulation rather than differential attentional engagement. Furthermore, individuals with higher trait anxiety showed less beta ERD differentiation between happy and sad faces. Similarly, individuals with higher trait autism showed less beta ERD differentiation between happy and fearful faces. These findings suggest that the differential simulation of specific affective states is attenuated in individuals with higher trait anxiety and autism. In summary, the MNS appears to support the skills needed for emotion processing in daily life, which may be influenced by certain individual differences. This provides novel evidence for the notion that simulation-based emotional skills may underlie the emotional difficulties that accompany affective disorders, such as anxiety.

Early social adversity modulates the relation between attention biases and socioemotional behaviour in juvenile macaques

Affect-biased attention may play a fundamental role in early socioemotional development, but factors influencing its emergence and associations with typical versus pathological outcomes remain unclear. Here, we adopted a nonhuman primate model of early social adversity (ESA) to: (1) establish whether juvenile, pre-adolescent macaques demonstrate attention biases to both threatening and reward-related dynamic facial gestures; (2) examine the effects of early social experience on such biases; and (3) investigate how this relation may be linked to socioemotional behaviour. Two groups of juvenile macaques (ESA exposed and non-ESA exposed) were presented with pairs of dynamic facial gestures comprising two conditions: neutral-threat and neutral-lipsmacking. Attention biases to threat and lipsmacking were calculated as the proportion of gaze to the affective versus neutral gesture. Measures of anxiety and social engagement were also acquired from videos of the subjects in their everyday social environment. Results revealed that while both groups demonstrated an attention bias towards threatening facial gestures, a greater bias linked to anxiety was demonstrated by the ESA group only. Only the non-ESA group demonstrated a significant attention bias towards lipsmacking, and the degree of this positive bias was related to duration and frequency of social engagement in this group. These findings offer important insights into the effects of early social experience on affect-biased attention and related socioemotional behaviour in nonhuman primates, and demonstrate the utility of this model for future investigations into the neural and learning mechanisms underlying this relationship across development.

Sensorimotor Activity and Network Connectivity to Dynamic and Static Emotional Faces in 7-Month-Old Infants

The present study investigated whether, as in adults, 7-month-old infants’ sensorimotor brain areas are recruited in response to the observation of emotional facial expressions. Activity of the sensorimotor cortex, as indexed by µ rhythm suppression, was recorded using electroencephalography (EEG) while infants observed neutral, angry, and happy facial expressions either in a static (N = 19) or dynamic (N = 19) condition. Graph theory analysis was used to investigate to which extent neural activity was functionally localized in specific cortical areas. Happy facial expressions elicited greater sensorimotor activation compared to angry faces in the dynamic experimental condition, while no difference was found between the three expressions in the static condition. Results also revealed that happy but not angry nor neutral expressions elicited a significant right-lateralized activation in the dynamic condition. Furthermore, dynamic emotional faces generated more efficient processing as they elicited higher global efficiency and lower networks’ diameter compared to static faces. Overall, current results suggest that, contrarily to neutral and angry faces, happy expressions elicit sensorimotor activity at 7 months and dynamic emotional faces are more efficiently processed by functional brain networks. Finally, current data provide evidence of the existence of a right-lateralized activity for the processing of happy facial expressions.

Infants are sensitive to cultural differences in emotions at 11 months

A myriad of emotion perception studies has shown infants' ability to discriminate different emotional categories, yet there has been little investigation of infants' perception of cultural differences in emotions. Hence little is known about the extent to which culture-specific emotion information is recognised in the beginning of life. Caucasian Australian infants of 10-12 months participated in a visual-paired comparison task where their preferential looking patterns to three types of infant-directed emotions (anger, happiness, surprise) from two different cultures (Australian, Japanese) were examined. Differences in racial appearances were controlled. Infants exhibited preferential looking to Japanese over Caucasian Australian mothers' angry and surprised expressions, whereas no difference was observed in trials involving East-Asian Australian mothers. In addition, infants preferred Caucasian Australian mothers' happy expressions. These findings suggest that 11-month-olds are sensitive to cultural differences in spontaneous infant-directed emotional expressions when they are combined with a difference in racial appearance.

Neural sensitivity to trustworthiness cues from realistic face images is associated with temperament: An electrophysiological study with 6-month-old infants

Discriminating facial cues to trustworthiness is a fundamental social skill whose developmental origins are still debated. Prior investigations used computer-generated faces, which might fail to reflect infants' face processing expertise. Here, Event-Related Potentials (ERPs) were recorded in Caucasian adults (N = 20, 7 males, M age = 25.25 years) and 6-month-old infants (N = 21, 10 males) in response to variations in trustworthiness intensity expressed by morphed images of realistic female faces associated with explicit trustworthiness judgments (Study 1). Preferential looking behavior in response to the same faces was also investigated in infants (N = 27, 11 males) (Study 2). ERP results showed that both age groups distinguished subtle stimulus differences, and that interindividual variability in neural sensitivity to these differences were associated with infants' temperament. No signs of stimulus differentiation emerged from infants' looking behavior. These findings contribute to the understanding of the developmental origins of human sensitivity to social cues from faces by extending prior evidence to more ecological stimuli and by unraveling the mediating role of temperament.

Emotional facial expressions affect visual rule learning in 7- to 8-month-old infants

Rule learning (RL) is an implicit learning mechanism that allows infants to detect and generalize rule-like repetition-based patterns (such as ABB and ABA) from a sequence of elements. Increasing evidence shows that RL operates both in the auditory and the visual domain and is modulated by the perceptual expertise with the to-be-learned stimuli. Yet, whether infants' ability to detect a high-order rule from a sequence of stimuli is affected by affective information remains a largely unexplored issue. Using a visual habituation paradigm, we investigated whether the presence of emotional expressions with a positive and a negative value (i.e., happiness and anger) modulates 7- to 8-month-old infants' ability to learn a rule-like pattern from a sequence of faces of different identities. Results demonstrate that emotional facial expressions (either positive and negative) modulate infants' visual RL mechanism, even though positive and negative facial expressions affect infants' RL in a different manner: while anger disrupts infants' ability to learn the rule-like pattern from a face sequence, in the presence of a happy face infants show a familiarity preference, thus maintaining their learning ability. These findings show that emotional expressions exert an influence on infants' RL abilities, contributing to the investigation on how emotion and cognition interact in face processing during infancy.

Individual Differences in Infants' Temperament Affect Face Processing

Infants show an advantage in processing female and familiar race faces, but the effect sizes are often small, suggesting individual differences in their discrimination abilities. This research assessed whether differences in 6-10-month-olds' temperament (surgency and orienting) predicted how they scanned individual faces varying in race and gender during familiarization and whether and how long it took them to locate the face during a visual search task. This study also examined whether infants viewing faces posing pleasant relative to neutral expressions would facilitate their discrimination of male and unfamiliar race faces. Results showed that infants' surgency on its own or in conjunction with their orienting regularly interacted with facial characteristics to predict their scanning and location of faces. Furthermore, infants' scanning patterns (dwell times and internal-external fixation shifts) correlated with their ability and time to locate a familiarized face. Moreover, infants who viewed faces with pleasant expressions showed better discrimination of unfamiliar race and male faces compared with infants who viewed neutral faces. Including temperament in the analyses consistently demonstrated its significance for understanding infant face processing. Findings suggest that positive interactions with other-race individuals and men might reduce processing disadvantages for those face types. Locating familiar adults in a timely manner is a crucial skill for infants to develop and these data elucidate factors influencing this ability.

Binding actions and emotions in the infant's brain

The first year represents an exceptional time of development during which important social skills emerge, like action and emotion understanding. However, to date, no study explored the neural underpinnings of infants' ability to bind emotion- to action-related information. To assess this issue, we measured EEG activity while 6-month-old infants observed the same action performed by an actress displaying three different emotional expressions (happiness, anger and neutral). Results have shown that actions embedded in an emotional context (happiness and anger) elicited larger early negativity at parieto-occipital sites compared to a neutral context. This finding suggests that already at 6 months of age, infants use information coming from facial expressions to detect the saliency and relevance of others' actions.

Face-sensitive brain responses in the first year of life

Cortical areas in the ventral visual pathway become selectively tuned towards the processing of faces compared to non-face stimuli beginning around 3 months of age and continuing over the first year. Studies using event-related potentials in the EEG (ERPs) have found an ERP component, the N290, that displays specificity for human faces. Other components, such as the P1, P400, and Nc have been studied to a lesser degree in their responsiveness to human faces. However, little is known about the systematic changes in the neural responses to faces during the first year of life, and the localization of these responses in infants' brain. We examined ERP responses to pictures of faces and objects in infants from 4.5 months through 12 months in a cross-sectional study. We investigated the activity of all the components reported to be involved in infant face processing, with particular interest to their amplitude variation and cortical localization. We identified neural regions responsible for the component through the application of cortical source localization methods. We found larger P1 and N290 responses to faces than objects, and these components were localized in the lingual and middle/posterior fusiform gyri, respectively. The amplitude of the P400 was not differentially sensitive to faces over objects. The Nc component was different for faces and objects, was influenced by the infant's attentional state, and localized in medial-anterior brain areas. The implications of these results are discussed in the identification of developmental ERP precursors to face processing.