The decline of cross-species intersensory perception in human infants

Perceptual narrowing: retrospect and prospect

Research is reviewed demonstrating perceptual narrowing across a variety of domains. Research is also reviewed showing that the temporal window of perceptual narrowing can be extended and, in some cases, perceptual narrowing can be reversed. Research is also reviewed highlighting the neurophysiological correlates of perceptual narrowing as well as some of the individual neurophysiological differences associated with perceptual narrowing. Various methodological issues associated with perceptual narrowing are also discussed. The broader purpose of this paper, however, is to argue that the term perceptual narrowing fails to capture the dynamic nature of this perceptual process. Finally, it is argued that just as other concepts associated with experience and development are refined and modified as new evidence emerges, likewise we need to evaluate and refine how we conceptualize perceptual narrowing.

Audio-tactile integration in congenitally and late deaf cochlear implant users

Several studies conducted in mammals and humans have shown that multisensory processing may be impaired following congenital sensory loss and in particular if no experience is achieved within specific early developmental time windows known as sensitive periods. In this study we investigated whether basic multisensory abilities are impaired in hearing-restored individuals with deafness acquired at different stages of development. To this aim, we tested congenitally and late deaf cochlear implant (CI) recipients, age-matched with two groups of hearing controls, on an audio-tactile redundancy paradigm, in which reaction times to unimodal and crossmodal redundant signals were measured. Our results showed that both congenitally and late deaf CI recipients were able to integrate audio-tactile stimuli, suggesting that congenital and acquired deafness does not prevent the development and recovery of basic multisensory processing. However, we found that congenitally deaf CI recipients had a lower multisensory gain compared to their matched controls, which may be explained by their faster responses to tactile stimuli. We discuss this finding in the context of reorganisation of the sensory systems following sensory loss and the possibility that these changes cannot be “rewired” through auditory reafferentation.

Infant perception of audio-visual speech synchrony in familiar and unfamiliar fluent speech

We investigated the effects of linguistic experience and language familiarity on the perception of audio-visual (A-V) synchrony in fluent speech. In Experiment 1, we tested a group of monolingual Spanish- and Catalan-learning 8-month-old infants to a video clip of a person speaking Spanish. Following habituation to the audiovisually synchronous video, infants saw and heard desynchronized clips of the same video where the audio stream now preceded the video stream by 366, 500, or 666 ms. In Experiment 2, monolingual Catalan and Spanish infants were tested with a video clip of a person speaking English. Results indicated that in both experiments, infants detected a 666 and a 500 ms asynchrony. That is, their responsiveness to A-V synchrony was the same regardless of their specific linguistic experience or familiarity with the tested language. Compared to previous results from infant studies with isolated audiovisual syllables, these results show that infants are more sensitive to A-V temporal relations inherent in fluent speech. Furthermore, the absence of a language familiarity effect on the detection of A-V speech asynchrony at eight months of age is consistent with the broad perceptual tuning usually observed in infant response to linguistic input at this age.

Cross-modal matching of audio-visual German and French fluent speech in infancy

The present study examined when and how the ability to cross-modally match audio-visual fluent speech develops in 4.5-, 6- and 12-month-old German-learning infants. In Experiment 1, 4.5- and 6-month-old infants' audio-visual matching ability of native (German) and non-native (French) fluent speech was assessed by presenting auditory and visual speech information sequentially, that is, in the absence of temporal synchrony cues. The results showed that 4.5-month-old infants were capable of matching native as well as non-native audio and visual speech stimuli, whereas 6-month-olds perceived the audio-visual correspondence of native language stimuli only. This suggests that intersensory matching narrows for fluent speech between 4.5 and 6 months of age. In Experiment 2, auditory and visual speech information was presented simultaneously, therefore, providing temporal synchrony cues. Here, 6-month-olds were found to match native as well as non-native speech indicating facilitation of temporal synchrony cues on the intersensory perception of non-native fluent speech. Intriguingly, despite the fact that audio and visual stimuli cohered temporally, 12-month-olds matched the non-native language only. Results were discussed with regard to multisensory perceptual narrowing during the first year of life.

Early experience and multisensory perceptual narrowing

Perceptual narrowing reflects the effects of early experience and contributes in key ways to perceptual and cognitive development. Previous studies have found that unisensory perceptual sensitivity in young infants is broadly tuned such that they can discriminate native as well as non-native sensory inputs but that it is more narrowly tuned in older infants such that they only respond to native inputs. Recently, my coworkers and I discovered that multisensory perceptual sensitivity narrows as well. The present article reviews this new evidence in the general context of multisensory perceptual development and the effects of early experience. Together, the evidence on unisensory and multisensory narrowing shows that early experience shapes the emergence of perceptual specialization and expertise.

Perceptual specialization and configural face processing in infancy

Adults' face processing expertise includes sensitivity to second-order configural information (spatial relations among features such as distance between eyes). Prior research indicates that infants process this information in female faces. In the current experiments, 9-month-olds discriminated spacing changes in upright human male and monkey faces but not in inverted faces. However, they failed to process matching changes in upright house stimuli. A similar pattern of performance was exhibited by 5-month-olds. Thus, 5- and 9-month-olds exhibited specialization by processing configural information in upright primate faces but not in houses or inverted faces. This finding suggests that, even early in life, infants treat faces in a special manner by responding to changes in configural information more readily in faces than in non-face stimuli. However, previously reported differences in infants' processing of human versus monkey faces at 9 months of age (but not at younger ages), which have been associated with perceptual narrowing, were not evident in the current study. Thus, perceptual narrowing is not absolute in the sense of loss of the ability to process information from other species' faces at older ages.

Theta brain rhythms index perceptual narrowing in infant speech perception

The development of speech perception shows a dramatic transition between infancy and adulthood. Between 6 and 12 months, infants' initial ability to discriminate all phonetic units across the world's languages narrows-native discrimination increases while non-native discrimination shows a steep decline. We used magnetoencephalography (MEG) to examine whether brain oscillations in the theta band (4-8 Hz), reflecting increases in attention and cognitive effort, would provide a neural measure of the perceptual narrowing phenomenon in speech. Using an oddball paradigm, we varied speech stimuli in two dimensions, stimulus frequency (frequent vs. infrequent) and language (native vs. non-native speech syllables) and tested 6-month-old infants, 12-month-old infants, and adults. We hypothesized that 6-month-old infants would show increased relative theta power (RTP) for frequent syllables, regardless of their status as native or non-native syllables, reflecting young infants' attention and cognitive effort in response to highly frequent stimuli ("statistical learning"). In adults, we hypothesized increased RTP for non-native stimuli, regardless of their presentation frequency, reflecting increased cognitive effort for non-native phonetic categories. The 12-month-old infants were expected to show a pattern in transition, but one more similar to adults than to 6-month-old infants. The MEG brain rhythm results supported these hypotheses. We suggest that perceptual narrowing in speech perception is governed by an implicit learning process. This learning process involves an implicit shift in attention from frequent events (infants) to learned categories (adults). Theta brain oscillatory activity may provide an index of perceptual narrowing beyond speech, and would offer a test of whether the early speech learning process is governed by domain-general or domain-specific processes.

Plasticity after perceptual narrowing for voice perception: reinstating the ability to discriminate monkeys by their voices at 12 months of age

Differentiating individuals by their voice is an important social skill for infants to acquire. In a previous study, we demonstrated that the ability to discriminate individuals by voice follows a pattern of perceptual narrowing (Friendly et al., 2013). Specifically, we found that the ability to discriminate between two foreign-species (rhesus monkey) voices decreased significantly between 6 and 12 months of age. Also during this period, there was a trend for the ability to discriminate human voices to increase. Here we investigate the extent to which plasticity remains at 12 months, after perceptual narrowing has occurred. We found that 12-month-olds who received 2 weeks of monkey-voice training were significantly better at discriminating between rhesus monkey voices than untrained 12-month-olds. Furthermore, discrimination was reinstated to a level slightly better than that of untrained 6-month-olds, suggesting that voice-processing abilities remain considerably plastic at the end of the first year.

The development of face perception in infancy: intersensory interference and unimodal visual facilitation

Although research has demonstrated impressive face perception skills of young infants, little attention has focused on conditions that enhance versus impair infant face perception. The present studies tested the prediction, generated from the intersensory redundancy hypothesis (IRH), that face discrimination, which relies on detection of visual featural information, would be impaired in the context of intersensory redundancy provided by audiovisual speech and enhanced in the absence of intersensory redundancy (unimodal visual and asynchronous audiovisual speech) in early development. Later in development, following improvements in attention, faces should be discriminated in both redundant audiovisual and nonredundant stimulation. Results supported these predictions. Two-month-old infants discriminated a novel face in unimodal visual and asynchronous audiovisual speech but not in synchronous audiovisual speech. By 3 months, face discrimination was evident even during synchronous audiovisual speech. These findings indicate that infant face perception is enhanced and emerges developmentally earlier following unimodal visual than synchronous audiovisual exposure and that intersensory redundancy generated by naturalistic audiovisual speech can interfere with face processing.

Multisensory vocal communication in primates and the evolution of rhythmic speech

The integration of the visual and auditory modalities during human speech perception is the default mode of speech processing. That is, visual speech perception is not a capacity that is "piggybacked" on to auditory-only speech perception. Visual information from the mouth and other parts of the face is used by all perceivers to enhance auditory speech. This integration is ubiquitous and automatic and is similar across all individuals across all cultures. The two modalities seem to be integrated even at the earliest stages of human cognitive development. If multisensory speech is the default mode of perception, then this should be reflected in the evolution of vocal communication. The purpose of this review is to describe the data that reveal that human speech is not uniquely multisensory. In fact, the default mode of communication is multisensory in nonhuman primates as well but perhaps emerging with a different developmental trajectory. Speech production, however, exhibits a unique bimodal rhythmic structure in that both the acoustic output and the movements of the mouth are rhythmic and tightly correlated. This structure is absent in most monkey vocalizations. One hypothesis is that the bimodal speech rhythm may have evolved through the rhythmic facial expressions of ancestral primates, as indicated by mounting comparative evidence focusing on the lip-smacking gesture.

Six-month-old infants match other-race faces with a non-native language

Early in life, infants possess an effective face-processing system which becomes specialized according to the faces present in the environment. Infants are also exposed to the voices and sounds of caregivers. Previous studies have found that face–voice associations become progressively more tuned to the types of association most prevalent in the environment. The present study investigated whether 6-month-old infants associate own-race faces with their native language and faces from a different race with a non-native language. Infants were presented with pictures of own- and other-race faces simultaneously, with a native or non-native language in a habituation paradigm. Results indicate that 6-month-olds are able to match other-race faces to a non-native language.

Neural correlates of perceptual narrowing in cross-species face-voice matching

Integrating the multisensory features of talking faces is critical to learning and extracting coherent meaning from social signals. While we know much about the development of these capacities at the behavioral level, we know very little about the underlying neural processes. One prominent behavioral milestone of these capacities is the perceptual narrowing of face-voice matching, whereby young infants match faces and voices across species, but older infants do not. In the present study, we provide neurophysiological evidence for developmental decline in cross-species face-voice matching. We measured event-related brain potentials (ERPs) while 4- and 8-month-old infants watched and listened to congruent and incongruent audio-visual presentations of monkey vocalizations and humans mimicking monkey vocalizations. The ERP results indicated that younger infants distinguished between the congruent and the incongruent faces and voices regardless of species, whereas in older infants, the sensitivity to multisensory congruency was limited to the human face and voice. Furthermore, with development, visual and frontal brain processes and their functional connectivity became more sensitive to the congruence of human faces and voices relative to monkey faces and voices. Our data show the neural correlates of perceptual narrowing in face-voice matching and support the notion that postnatal experience with species identity is associated with neural changes in multisensory processing (Lewkowicz & Ghazanfar, 2009).

Brief daily exposures to Asian females reverses perceptual narrowing for Asian faces in Caucasian infants

Perceptual narrowing in the visual, auditory, and multisensory domains has its developmental origins during infancy. The current study shows that experimentally induced experience can reverse the effects of perceptual narrowing on infants' visual recognition memory of other-race faces. Caucasian 8- to 10-month-olds who could not discriminate between novel and familiarized Asian faces at the beginning of testing were given brief daily experience with Asian female faces in the experimental condition and Caucasian female faces in the control condition. At the end of 3 weeks, only infants who received daily experience with Asian females showed above-chance recognition of novel Asian female and male faces. Furthermore, infants in the experimental condition showed greater efficiency in learning novel Asian females compared with infants in the control condition. Thus, visual experience with a novel stimulus category can reverse the effects of perceptual narrowing during infancy via improved stimulus recognition and encoding.

Infants deploy selective attention to the mouth of a talking face when learning speech

The mechanisms underlying the acquisition of speech-production ability in human infancy are not well understood. We tracked 4-12-mo-old English-learning infants' and adults' eye gaze while they watched and listened to a female reciting a monologue either in their native (English) or nonnative (Spanish) language. We found that infants shifted their attention from the eyes to the mouth between 4 and 8 mo of age regardless of language and then began a shift back to the eyes at 12 mo in response to native but not nonnative speech. We posit that the first shift enables infants to gain access to redundant audiovisual speech cues that enable them to learn their native speech forms and that the second shift reflects growing native-language expertise that frees them to shift attention to the eyes to gain access to social cues. On this account, 12-mo-old infants do not shift attention to the eyes when exposed to nonnative speech because increasing native-language expertise and perceptual narrowing make it more difficult to process nonnative speech and require them to continue to access redundant audiovisual cues. Overall, the current findings demonstrate that the development of speech production capacity relies on changes in selective audiovisual attention and that this depends critically on early experience.

Modulation of cross-frequency coupling by novel and repeated stimuli in the primate ventrolateral prefrontal cortex

Adaptive behavior depends on an animal’s ability to ignore uninformative stimuli, such as repeated presentations of the same stimulus, and, instead, detect informative, novel stimuli in its environment. The primate prefrontal cortex (PFC) is known to play a central role in this ability. However, the neural mechanisms underlying the ability to differentiate between repeated and novel stimuli are not clear. We hypothesized that the coupling between different frequency bands of the local field potential (LFP) underlies the PFC’s role in differentiating between repeated and novel stimuli. Specifically, we hypothesized that whereas the presentation of a novel-stimulus induces strong cross-frequency coupling, repeated presentations of the same stimulus attenuates this coupling. To test this hypothesis, we recorded LFPs from the ventrolateral PFC (vPFC) of rhesus monkeys while they listened to a novel vocalization and repeated presentations of the same vocalization. We found that the cross-frequency coupling between the gamma-band amplitude and theta-band phase of the LFP was modulated by repeated presentations of a stimulus. During the first (novel) presentation of a stimulus, gamma-band activity was modulated by the theta-band phase. However, with repeated presentations of the same stimulus, this cross-frequency coupling was attenuated. These results suggest that cross-frequency coupling may play a role in the neural computations that underlie the differentiation between novel and repeated stimuli in the vPFC.

The development of the uncanny valley in infants

When adults view very realistic humanoid robots or computer avatars they often exhibit an aversion to them. This phenomenon, known as the "uncanny valley," is assumed to be evolutionary in origin, perhaps tapping into modules for disgust or attractiveness that detect violations of our normal expectations regarding social signals. Here, we test an alternative hypothesis that the uncanny valley is developmental in origin and, thus, that specific early experience with real human faces leads to its eventual emergence. To test this idea, we measured visual preferences in response to all possible pairs of a human face, realistic avatar face, and an unrealistic avatar face in groups of 6-, 8-, 10-, and 12-month-old infants. Consistent with the developmental hypothesis, we found that the uncanny valley effect emerges at 12 months of age suggesting that perceptual experience with real human faces is critical to its emergence.

Infants' knowledge of their own species

Recognition of individuals at first sight is important for social species and can be achieved by attending to facial or body information. Previous research suggests that infants possess a perceptual template for evolutionarily relevant stimuli, which may include humans, dangerous animals (e.g. snakes), but not non-dangerous animals. To be effective, such a mechanism should result in a systematic preference for attending to humans over non-dangerous animals. Using a preferential looking paradigm, the present studies investigated the nature of infants' early representation of humans. We show that 3.5- and six-month-old infants attend more to human beings than non-human primates (a gorilla or monkey) which are examplars of non-dangerous animals. This occurred when infants were presented with head or body information in isolation, as well as when both are presented simultaneously. This early preference for humans by 3.5 months of age suggests that there is a basic representation for humans, which includes both head and/or body information. However, neonates demonstrated a preference only for human faces over non-human primate faces, not for humans over non-human primates when the stimuli were presented with both head and body simultaneously. The results show that although neonates display a preference for human faces over others, preference for the human body only develops later, in the first few months of life. This suggests that infants have acquired some knowledge about the human body at 3.5 months of age that may have developed from their privileged experience with other humans in the first few months of life, rather than an innate ability to detect humans in their entirety.

Neural and Developmental Bases of the Ability to Recognize Social Signals of Emotions

Humans in diverse cultures develop a capacity to recognize and share others’ emotional states. In this article, studies in adult and developmental populations are reviewed and synthesized to build a framework for understanding the neural bases and development of emotion recognition. It is proposed that foundations for the development of emotion recognition are provided by an experience-expectant neural circuitry that emerges early in life, biases infants to attend to biologically salient information, and is refined and specialized through experience for processing species-typical signals of emotions. It is also discussed how genetic variations and experiences during sensitive periods of development can affect the developmental process and give rise to subtle individual differences in emotion recognition.

Spontaneous voice-face identity matching by rhesus monkeys for familiar conspecifics and humans

Recognition of a particular individual occurs when we reactivate links between current perceptual inputs and the previously formed representation of that person. This recognition can be achieved by identifying, separately or simultaneously, distinct elements such as the face, silhouette, or voice as belonging to one individual. In humans, those different cues are linked into one complex conceptual representation of individual identity. Here we tested whether rhesus macaques (Macaca mulatta) also have a cognitive representation of identity by evaluating whether they exhibit cross-modal individual recognition. Further, we assessed individual recognition of familiar conspecifics and familiar humans. In a free preferential looking time paradigm, we found that, for both species, monkeys spontaneously matched the faces of known individuals to their voices. This finding demonstrates that rhesus macaques possess a cross-modal cognitive representation of individuals that extends from conspecifics to humans, revealing the adaptive potential of identity recognition for individuals of socioecological relevance.

The Biological Implausibility of the Nature-Nurture Dichotomy & What It Means for the Study of Infancy

Since the time of the Greeks, philosophers and scientists have wondered about the origins of structure and function. Plato proposed that the origins of structure and function lie in the organism's nature whereas Aristotle proposed that they lie in its nurture. This nature/nurture dichotomy and the emphasis on the origins question has had a powerful effect on our thinking about development right into modern times. Despite this, empirical findings from various branches of developmental science have made a compelling case that the nature/nurture dichotomy is biologically implausible and, thus, that a search for developmental origins must be replaced by research into developmental processes. This change in focus recognizes that development is an immensely complex, dynamic, embedded, interdependent, and probabilistic process and, therefore, renders simplistic questions such as whether a particular behavioral capacity is innate or acquired scientifically uninteresting.

Atypical perceptual narrowing in prematurely born infants is associated with compromised language acquisition at 2 years of age

Background

Early auditory experiences are a prerequisite for speech and language acquisition. In healthy children, phoneme discrimination abilities improve for native and degrade for unfamiliar, socially irrelevant phoneme contrasts between 6 and 12 months of age as the brain tunes itself to, and specializes in the native spoken language. This process is known as perceptual narrowing, and has been found to predict normal native language acquisition. Prematurely born infants are known to be at an elevated risk for later language problems, but it remains unclear whether these problems relate to early perceptual narrowing. To address this question, we investigated early neurophysiological phoneme discrimination abilities and later language skills in prematurely born infants and in healthy, full-term infants.

Results

Our follow-up study shows for the first time that perceptual narrowing for non-native phoneme contrasts found in the healthy controls at 12 months was not observed in very prematurely born infants. An electric mismatch response of the brain indicated that whereas full-term infants gradually lost their ability to discriminate non-native phonemes from 6 to 12 months of age, prematurely born infants kept on this ability. Language performance tested at the age of 2 years showed a significant delay in the prematurely born group. Moreover, those infants who did not become specialized in native phonemes at the age of one year, performed worse in the communicative language test (MacArthur Communicative Development Inventories) at the age of two years. Thus, decline in sensitivity to non-native phonemes served as a predictor for further language development.

Conclusion

Our data suggest that detrimental effects of prematurity on language skills are based on the low degree of specialization to native language early in development. Moreover, delayed or atypical perceptual narrowing was associated with slower language acquisition. The results hence suggest that language problems related to prematurity may partially originate already from this early tuning stage of language acquisition.

Five-month-old infants' identification of the sources of vocalizations

Humans speak, monkeys grunt, and ducks quack. How do we come to know which vocalizations animals produce? Here we explore this question by asking whether young infants expect humans, but not other animals, to produce speech, and further, whether infants have similarly restricted expectations about the sources of vocalizations produced by other species. Five-month-old infants matched speech, but not human nonspeech vocalizations, specifically to humans, looking longer at static human faces when human speech was played than when either rhesus monkey or duck calls were played. They also matched monkey calls to monkey faces, looking longer at static rhesus monkey faces when rhesus monkey calls were played than when either human speech or duck calls were played. However, infants failed to match duck vocalizations to duck faces, even though infants likely have more experience with ducks than monkeys. Results show that by 5 months of age, human infants generate expectations about the sources of some vocalizations, mapping human faces to speech and rhesus faces to rhesus calls. Infants' matching capacity does not appear to be based on a simple associative mechanism or restricted to their specific experiences. We discuss these findings in terms of how infants may achieve such competence, as well as its specificity and relevance to acquiring language.

Monkey visual behavior falls into the uncanny valley

Very realistic human-looking robots or computer avatars tend to elicit negative feelings in human observers. This phenomenon is known as the "uncanny valley" response. It is hypothesized that this uncanny feeling is because the realistic synthetic characters elicit the concept of "human," but fail to live up to it. That is, this failure generates feelings of unease due to character traits falling outside the expected spectrum of everyday social experience. These unsettling emotions are thought to have an evolutionary origin, but tests of this hypothesis have not been forthcoming. To bridge this gap, we presented monkeys with unrealistic and realistic synthetic monkey faces, as well as real monkey faces, and measured whether they preferred looking at one type versus the others (using looking time as a measure of preference). To our surprise, monkey visual behavior fell into the uncanny valley: They looked longer at real faces and unrealistic synthetic faces than at realistic synthetic faces.

Perceptual training narrows the temporal window of multisensory binding

The brain's ability to bind incoming auditory and visual stimuli depends critically on the temporal structure of this information. Specifically, there exists a temporal window of audiovisual integration within which stimuli are highly likely to be bound together and perceived as part of the same environmental event. Several studies have described the temporal bounds of this window, but few have investigated its malleability. Here, the plasticity in the size of this temporal window was investigated using a perceptual learning paradigm in which participants were given feedback during a two-alternative forced choice (2-AFC) audiovisual simultaneity judgment task. Training resulted in a marked (i.e., approximately 40%) narrowing in the size of the window. To rule out the possibility that this narrowing was the result of changes in cognitive biases, a second experiment using a two-interval forced choice (2-IFC) paradigm was undertaken during which participants were instructed to identify a simultaneously presented audiovisual pair presented within one of two intervals. The 2-IFC paradigm resulted in a narrowing that was similar in both degree and dynamics to that using the 2-AFC approach. Together, these results illustrate that different methods of multisensory perceptual training can result in substantial alterations in the circuits underlying the perception of audiovisual simultaneity. These findings suggest a high degree of flexibility in multisensory temporal processing and have important implications for interventional strategies that may be used to ameliorate clinical conditions (e.g., autism, dyslexia) in which multisensory temporal function may be impaired.

Narrowing of intersensory speech perception in infancy

The conventional view is that perceptual/cognitive development is an incremental process of acquisition. Several striking findings have revealed, however, that the sensitivity to non-native languages, faces, vocalizations, and music that is present early in life declines as infants acquire experience with native perceptual inputs. In the language domain, the decline in sensitivity is reflected in a process of perceptual narrowing that is thought to play a critical role during the acquisition of a native-language phonological system. Here, we provide evidence that such a decline also occurs in infant response to multisensory speech. We found that infant intersensory response to a non-native phonetic contrast narrows between 6 and 11 months of age, suggesting that the perceptual system becomes increasingly more tuned to key native-language audiovisual correspondences. Our findings lend support to the notion that perceptual narrowing is a domain-general as well as a pan-sensory developmental process.

The origin of biases in face perception

Experience with certain types of faces during the first year of development defines which types of faces are more efficiently recognized later in life. In work described here, we found that infants who learned to recognize six monkey faces individually (i.e., each face was individually labeled) over a 3-month period maintained the ability to discriminate monkey faces. However, infants who learned these same six faces categorically (i.e., all faces were labeled "monkey") or were simply exposed to these faces (i.e., faces were not labeled) showed a decline in the ability to discriminate monkey faces. These results suggest that experience individuating faces from 6 to 9 months of age, via labeling, critically shapes the perceptual representation that is responsible for later recognition and discrimination of faces.

Heterochrony and cross-species intersensory matching by infant vervet monkeys

BACKGROUND

Understanding the evolutionary origins of a phenotype requires understanding the relationship between ontogenetic and phylogenetic processes. Human infants have been shown to undergo a process of perceptual narrowing during their first year of life, whereby their intersensory ability to match the faces and voices of another species declines as they get older. We investigated the evolutionary origins of this behavioral phenotype by examining whether or not this developmental process occurs in non-human primates as well.

METHODOLOGY/PRINCIPAL FINDINGS

We tested the ability of infant vervet monkeys (Cercopithecus aethiops), ranging in age from 23 to 65 weeks, to match the faces and voices of another non-human primate species (the rhesus monkey, Macaca mulatta). Even though the vervets had no prior exposure to rhesus monkey faces and vocalizations, our findings show that infant vervets can, in fact, recognize the correspondence between rhesus monkey faces and voices (but indicate that they do so by looking at the non-matching face for a greater proportion of overall looking time), and can do so well beyond the age of perceptual narrowing in human infants. Our results further suggest that the pattern of matching by vervet monkeys is influenced by the emotional saliency of the Face+Voice combination. That is, although they looked at the non-matching screen for Face+Voice combinations, they switched to looking at the matching screen when the Voice was replaced with a complex tone of equal duration. Furthermore, an analysis of pupillary responses revealed that their pupils showed greater dilation when looking at the matching natural face/voice combination versus the face/tone combination.

CONCLUSIONS/SIGNIFICANCE

Because the infant vervets in the current study exhibited cross-species intersensory matching far later in development than do human infants, our findings suggest either that intersensory perceptual narrowing does not occur in Old World monkeys or that it occurs later in development. We argue that these findings reflect the faster rate of neural development in monkeys relative to humans and the resulting differential interaction of this factor with the effects of early experience.

Tuning the developing brain to social signals of emotions

Humans in different cultures develop a similar capacity to recognize the emotional signals of diverse facial expressions. This capacity is mediated by a brain network that involves emotion-related brain circuits and higher-level visual-representation areas. Recent studies suggest that the key components of this network begin to emerge early in life. The studies also suggest that initial biases in emotion-related brain circuits and the early coupling of these circuits and cortical perceptual areas provide a foundation for a rapid acquisition of representations of those facial features that denote specific emotions.

Different neural frequency bands integrate faces and voices differently in the superior temporal sulcus

The integration of auditory and visual information is required for the default mode of speech-face-to-face communication. As revealed by functional magnetic resonance imaging and electrophysiological studies, the regions in and around the superior temporal sulcus (STS) are implicated in this process. To provide greater insights into the network-level dynamics of the STS during audiovisual integration, we used a macaque model system to analyze the different frequency bands of local field potential (LFP) responses to the auditory and visual components of vocalizations. These vocalizations (like human speech) have a natural time delay between the onset of visible mouth movements and the onset of the voice (the "time-to-voice" or TTV). We show that the LFP responses to faces and voices elicit distinct bands of activity in the theta (4-8 Hz), alpha (8-14 Hz), and gamma (>40 Hz) frequency ranges. Along with single neuron responses, the gamma band activity was greater for face stimuli than voice stimuli. Surprisingly, the opposite was true for the low-frequency bands-auditory responses were of a greater magnitude. Furthermore, gamma band responses in STS were sustained for dynamic faces but not so for voices (the opposite is true for auditory cortex). These data suggest that visual and auditory stimuli are processed in fundamentally different ways in the STS. Finally, we show that the three bands integrate faces and voices differently: theta band activity showed weak multisensory behavior regardless of TTV, the alpha band activity was enhanced for calls with short TTVs but showed little integration for longer TTVs, and finally, the gamma band activity was consistently enhanced for all TTVs. These data demonstrate that LFP activity from the STS can be segregated into distinct frequency bands which integrate audiovisual communication signals in an independent manner. These different bands may reflect different spatial scales of network processing during face-to-face communication.

Sound enhances detection of visual target during infancy: a study using illusory contours

In adults, a salient tone embedded in a sequence of nonsalient tones improves detection of a synchronously and briefly presented visual target in a rapid, visually distracting sequence. This phenomenon indicates that perception from one sensory modality can be influenced by another one even when the latter modality provides no information about the judged property itself. However, no study has revealed the age-related development of this kind of cross-modal enhancement. Here we tested the effect of concurrent and unique sounds on detection of illusory contours during infancy. We used a preferential looking technique to investigate whether audio-visual enhancement of the detection of illusory contours could be observed at 5, 6, and 7 months of age. A significant enhancement, induced by sound, of the preference for illusory contours was observed only in the 7-month-olds. These results suggest that audio-visual enhancement in visual target detection emerges at 7 months of age.