Categorization of objects and faces in the infant brain and its sensitivity to maternal odor: further evidence for the role of intersensory congruency in perceptual development

Olfactory facilitation of visual categorization in the 4-month-old brain depends on visual demand

To navigate their environment, infants rely on intersensory facilitation when unisensory perceptual demand is high, a principle known as inverse effectiveness. Given that this principle was mainly documented in the context of audiovisual stimulations, here we aim to determine whether it applies to olfactory-to-visual facilitation. We build on previous evidence that the mother's body odor facilitates face categorization in the 4-month-old brain, and investigate whether this effect depends on visual demand. Scalp electroencephalogram (EEG) was recorded in two groups of 4-month-old infants while they watched 6-Hz streams of visual stimuli with faces displayed every 6th stimulus to tag a face-selective response at 1 Hz. We used variable natural stimuli in one group (Nat Group), while stimuli were simplified in the other group (Simp Group) to reduce perceptual categorization demand. During visual stimulation, infants were alternatively exposed to their mother's versus a baseline odor. For both groups, we found an occipito-temporal face-selective response, but with a larger amplitude for the simplified stimuli, reflecting less demanding visual categorization. Importantly, the mother's body odor enhances the response to natural, but not to simplified, face stimuli, indicating that maternal odor improves face categorization when it is most demanding for the 4-month-old brain. Overall, this study demonstrates that the inverse effectiveness of intersensory facilitation applies to the sense of smell during early perceptual development. RESEARCH HIGHLIGHTS: Intersensory facilitation is a function of unisensory perceptual demand in infants (inverse effectiveness). This inverse relation between multisensory and unisensory perception has been mainly documented using audiovisual stimulations. Here we show that olfactory-to-visual facilitation depends on visual demand in 4-month-old infants. The inverse effectiveness of intersensory facilitation during early perceptual development applies to the sense of smell.

Olfactory-to-visual facilitation in the infant brain declines gradually from 4 to 12 months

During infancy, intersensory facilitation declines gradually as unisensory perception develops. However, this trade-off was mainly investigated using audiovisual stimulations. Here, fifty 4- to 12-month-old infants (26 females, predominately White) were tested in 2017-2020 to determine whether the facilitating effect of their mother's body odor on neural face categorization, as previously observed at 4 months, decreases with age. In a baseline odor context, the results revealed a face-selective electroencephalographic response that increases and changes qualitatively between 4 and 12 months, marking improved face categorization. At the same time, the benefit of adding maternal odor fades with age (R2 = .31), indicating an inverse relation with the amplitude of the visual response, and generalizing to olfactory-visual interactions previous evidence from the audiovisual domain.

Voice categorization in the four-month-old human brain

Voices are the most relevant social sounds for humans and therefore have crucial adaptive value in development. Neuroimaging studies in adults have demonstrated the existence of regions in the superior temporal sulcus that respond preferentially to voices. Yet, whether voices represent a functionally specific category in the young infant's mind is largely unknown. We developed a highly sensitive paradigm relying on fast periodic auditory stimulation (FPAS) combined with scalp electroencephalography (EEG) to demonstrate that the infant brain implements a reliable preferential response to voices early in life. Twenty-three 4-month-old infants listened to sequences containing non-vocal sounds from different categories presented at 3.33 Hz, with highly heterogeneous vocal sounds appearing every third stimulus (1.11 Hz). We were able to isolate a voice-selective response over temporal regions, and individual voice-selective responses were found in most infants within only a few minutes of stimulation. This selective response was significantly reduced for the same frequency-scrambled sounds, indicating that voice selectivity is not simply driven by the envelope and the spectral content of the sounds. Such a robust selective response to voices as early as 4 months of age suggests that the infant brain is endowed with the ability to rapidly develop a functional selectivity to this socially relevant category of sounds.

Rhythmic visual stimulation as a window into early brain development: A systematic review

Rhythmic visual stimulation (RVS), the periodic presentation of visual stimuli to elicit a rhythmic brain response, is increasingly applied to reveal insights into early neurocognitive development. Our systematic review identified 69 studies applying RVS in 0- to 6-year-olds. RVS has long been used to study the development of the visual system and applications have more recently been expanded to uncover higher cognitive functions in the developing brain, including overt and covert attention, face and object perception, numeral cognition, and predictive processing. These insights are owed to the unique benefits of RVS, such as the targeted frequency and stimulus-specific neural responses, as well as a remarkable signal-to-noise ratio. Yet, neural mechanisms underlying the RVS response are still poorly understood. We discuss critical challenges and avenues for future research, and the unique potentials the method holds. With this review, we provide a resource for researchers interested in the breadth of developmental RVS research and hope to inspire the future use of this cutting-edge method in developmental cognitive neuroscience.

Past, Present, and Future of Human Chemical Communication Research

Although chemical signaling is an essential mode of communication in most vertebrates, it has long been viewed as having negligible effects in humans. However, a growing body of evidence shows that the sense of smell affects human behavior in social contexts ranging from affiliation and parenting to disease avoidance and social threat. This article aims to (a) introduce research on human chemical communication in the historical context of the behavioral sciences; (b) provide a balanced overview of recent advances that describe individual differences in the emission of semiochemicals and the neural mechanisms underpinning their perception, that together demonstrate communicative function; and (c) propose directions for future research toward unraveling the molecular principles involved and understanding the variability in the generation, transmission, and reception of chemical signals in increasingly ecologically valid conditions. Achieving these goals will enable us to address some important societal challenges but are within reach only with the aid of genuinely interdisciplinary approaches.

Frequency tagging with infants: The visual oddball paradigm

Combining frequency tagging with electroencephalography (EEG) provides excellent opportunities for developmental research and is increasingly employed as a powerful tool in cognitive neuroscience within the last decade. In particular, the visual oddball paradigm has been employed to elucidate face and object categorization and intermodal influences on visual perception. Still, EEG research with infants poses special challenges that require consideration and adaptations of analyses. These challenges include limits to attentional capacity, variation in looking times, and presence of artefacts in the EEG signal. Moreover, potential differences between age-groups must be carefully evaluated. This manuscript evaluates challenges theoretically and empirically by (1) a systematic review of frequency tagging studies employing the oddball paradigm and (2) combining and re-analyzing data from seven-month-old infants (N = 124, 59 females) collected in a categorization task with artifical, unfamiliar stimuli. Specifically, different criteria for sequence retention and selection of harmonics, the influence of bins considered for baseline correction and the relation between fast periodic visual stimulation (FPVS) responses and looking time are analyzed. Overall, evidence indicates that analysis decisions should be tailored based on age-group to optimally capture the observed signal. Recommendations for infant frequency tagging studies are developed to aid researchers in selecting appropriate stimulation and analysis strategies in future work.

A neural marker of rapid discrimination of facial expression in 3.5- and 7-month-old infants

Infants’ ability to discriminate facial expressions has been widely explored, but little is known about the rapid and automatic ability to discriminate a given expression against many others in a single experiment. Here we investigated the development of facial expression discrimination in infancy with fast periodic visual stimulation coupled with scalp electroencephalography (EEG). EEG was recorded in eighteen 3.5- and eighteen 7-month-old infants presented with a female face expressing disgust, happiness, or a neutral emotion (in different stimulation sequences) at a base stimulation frequency of 6 Hz. Pictures of the same individual expressing other emotions (either anger, disgust, fear, happiness, sadness, or neutrality, randomly and excluding the expression presented at the base frequency) were introduced every six stimuli (at 1 Hz). Frequency-domain analysis revealed an objective (i.e., at the predefined 1-Hz frequency and harmonics) expression-change brain response in both 3.5- and 7-month-olds, indicating the visual discrimination of various expressions from disgust, happiness and neutrality from these early ages. At 3.5 months, the responses to the discrimination from disgust and happiness expressions were located mainly on medial occipital sites, whereas a more lateral topography was found for the response to the discrimination from neutrality, suggesting that expression discrimination from an emotionally neutral face relies on distinct visual cues than discrimination from a disgust or happy face. Finally, expression discrimination from happiness was associated with a reduced activity over posterior areas and an additional response over central frontal scalp regions at 7 months as compared to 3.5 months. This result suggests developmental changes in the processing of happiness expressions as compared to negative/neutral ones within this age range.

Smell what you hardly see: Odors assist visual categorization in the human brain

Visual categorization is the brain ability to rapidly and automatically respond to a certain category of inputs. Whether category-selective neural responses are purely visual or can be influenced by other sensory modalities remains unclear. Here, we test whether odors modulate visual categorization, expecting that odors facilitate the neural categorization of congruent visual objects, especially when the visual category is ambiguous. Scalp electroencephalogram (EEG) was recorded while natural images depicting various objects were displayed in rapid 12-Hz streams (i.e., 12 images / second) and variable exemplars of a target category (either human faces, cars, or facelike objects in dedicated sequences) were interleaved every 9^th stimulus to tag category-selective responses at 12/9 = 1.33 Hz in the EEG frequency spectrum. During visual stimulation, participants (N = 26) were implicitly exposed to odor contexts (either body, gasoline or baseline odors) and performed an orthogonal cross-detection task. We identify clear category-selective responses to every category over the occipito-temporal cortex, with the largest response for human faces and the lowest for facelike objects. Critically, body odor boosts the response to the ambiguous facelike objects (i.e., either perceived as nonface objects or faces) over the right hemisphere, especially for participants reporting their presence post-stimulation. By contrast, odors do not significantly modulate other category-selective responses, nor the general visual response recorded at 12 Hz, revealing a specific influence on the categorization of congruent ambiguous stimuli. Overall, these findings support the view that the brain actively uses cues from the different senses to readily categorize visual inputs, and that olfaction, which has long been considered as poorly functional in humans, is well placed to disambiguate visual information.

Is human face recognition lateralized to the right hemisphere due to neural competition with left-lateralized visual word recognition? A critical review

The right hemispheric lateralization of face recognition, which is well documented and appears to be specific to the human species, remains a scientific mystery. According to a long-standing view, the evolution of language, which is typically substantiated in the left hemisphere, competes with the cortical space in that hemisphere available for visuospatial processes, including face recognition. Over the last decade, a specific hypothesis derived from this view according to which neural competition in the left ventral occipito-temporal cortex with selective representations of letter strings causes right hemispheric lateralization of face recognition, has generated considerable interest and research in the scientific community. Here, a systematic review of studies performed in various populations (infants, children, literate and illiterate adults, left-handed adults) and methodologies (behavior, lesion studies, (intra)electroencephalography, neuroimaging) offers little if any support for this reading lateralized neural competition hypothesis. Specifically, right-lateralized face-selective neural activity already emerges at a few months of age, well before reading acquisition. Moreover, consistent evidence of face recognition performance and its right hemispheric lateralization being modulated by literacy level during development or at adulthood is lacking. Given the absence of solid alternative hypotheses and the key role of neural competition in the sensory-motor cortices for selectivity of representations, learning, and plasticity, a revised language-related neural competition hypothesis for the right hemispheric lateralization of face recognition should be further explored in future research, albeit with substantial conceptual clarification and advances in methodological rigor.

Olfaction in the Multisensory Processing of Faces: A Narrative Review of the Influence of Human Body Odors

A recent body of research has emerged regarding the interactions between olfaction and other sensory channels to process social information. The current review examines the influence of body odors on face perception, a core component of human social cognition. First, we review studies reporting how body odors interact with the perception of invariant facial information (i.e., identity, sex, attractiveness, trustworthiness, and dominance). Although we mainly focus on the influence of body odors based on axillary odor, we also review findings about specific steroids present in axillary sweat (i.e., androstenone, androstenol, androstadienone, and estratetraenol). We next survey the literature showing body odor influences on the perception of transient face properties, notably in discussing the role of body odors in facilitating or hindering the perception of emotional facial expression, in relation to competing frameworks of emotions. Finally, we discuss the developmental origins of these olfaction-to-vision influences, as an emerging literature indicates that odor cues strongly influence face perception in infants. Body odors with a high social relevance such as the odor emanating from the mother have a widespread influence on various aspects of face perception in infancy, including categorization of faces among other objects, face scanning behavior, or facial expression perception. We conclude by suggesting that the weight of olfaction might be especially strong in infancy, shaping social perception, especially in slow-maturing senses such as vision, and that this early tutoring function of olfaction spans all developmental stages to disambiguate a complex social environment by conveying key information for social interactions until adulthood.

The scent of attraction and the smell of success: crossmodal influences on person perception

In recent decades, there has been an explosion of research into the crossmodal influence of olfactory cues on multisensory person perception. Numerous peer-reviewed studies have documented that a variety of olfactory stimuli, from ambient malodours through to fine fragrances, and even a range of chemosensory body odours can influence everything from a perceiver's judgments of another person's attractiveness, age, affect, health/disease status, and even elements of their personality. The crossmodal and multisensory contributions to such effects are reviewed and the limitations/peculiarities of the research that have been published to date are highlighted. At the same time, however, it is important to note that the presence of scent (and/or the absence of malodour) can also influence people's (i.e., a perceiver's) self-confidence which may, in turn, affect how attractive they appear to others. Several potential cognitive mechanisms have been put forward to try and explain such crossmodal/multisensory influences, and some of the neural substrates underpinning these effects have now been characterized. At the end of this narrative review, a number of the potential (and actual) applications for, and implications of, such crossmodal/multisensory phenomena involving olfaction are outlined briefly.

Odor-driven face-like categorization in the human infant brain

Understanding how the young infant brain starts to categorize the flurry of ambiguous sensory inputs coming in from its complex environment is of primary scientific interest. Here, we test the hypothesis that senses other than vision play a key role in initiating complex visual categorizations in 20 4-mo-old infants exposed either to a baseline odor or to their mother's odor while their electroencephalogram (EEG) is recorded. Various natural images of objects are presented at a 6-Hz rate (six images/second), with face-like object configurations of the same object categories (i.e., eliciting face pareidolia in adults) interleaved every sixth stimulus (i.e., 1 Hz). In the baseline odor context, a weak neural categorization response to face-like stimuli appears at 1 Hz in the EEG frequency spectrum over bilateral occipitotemporal regions. Critically, this face-like-selective response is magnified and becomes right lateralized in the presence of maternal body odor. This reveals that nonvisual cues systematically associated with human faces in the infant's experience shape the interpretation of face-like configurations as faces in the right hemisphere, dominant for face categorization. At the individual level, this intersensory influence is particularly effective when there is no trace of face-like categorization in the baseline odor context. These observations provide evidence for the early tuning of face-(like)-selective activity from multisensory inputs in the developing brain, suggesting that perceptual development integrates information across the senses for efficient category acquisition, with early maturing systems such as olfaction driving the acquisition of categories in later-developing systems such as vision.

Odor-evoked hedonic contexts influence the discrimination of facial expressions in the human brain

The influence of odor valence on expressive-face perception remains unclear. Here, three "valenced" odor contexts (pleasant, unpleasant, control) were diffused while scalp electroencephalogram (EEG) was recorded in 18 participants presented with expressive faces alternating at a 6-Hz rate. One facial expression (happiness, disgust or neutrality) repeatedly arose every 6 face pictures to isolate its discrimination from other expressions at 1 Hz and harmonics in the EEG spectrum. The amplitude of the brain response to neutrality was larger in the pleasant vs. control odor context, and fewer electrodes responded in the unpleasant odor context. The number of responding electrodes was reduced for disgust in both odor contexts. The response to happiness was unchanged between odor conditions. Overall, these observations suggest that valenced odors influence the neural discrimination of facial expressions depending on both face and odor hedonic valence, especially for the emotionally ambiguous neutral expression.