The acquisition of speech categories: Beyond perceptual narrowing, beyond unsupervised learning and beyond infancy

An early achievement in language is carving a variable acoustic space into categories. The canonical story is that infants accomplish this by the second year, when only unsupervised learning is plausible. I challenge this view, synthesizing five lines of developmental, phonetic and computational work. First, unsupervised learning may be insufficient given the statistics of speech (including infant-directed). Second, evidence that infants "have" speech categories rests on tenuous methodological assumptions. Third, the fact that the ecology of the learning environment is unsupervised does not rule out more powerful error driven learning mechanisms. Fourth, several implicit supervisory signals are available to older infants. Finally, development is protracted through adolescence, enabling richer avenues for development. Infancy may be a time of organizing the auditory space, but true categorization only arises via complex developmental cascades later in life. This has implications for critical periods, second language acquisition, and our basic framing of speech perception.

Bilingualism Affects Infant Cognition: Insights From New and Open Data

Bilingualism has been hypothesized to shape cognitive abilities across the lifespan. Here, we examined the replicability of a seminal study that showed monolingual-bilingual differences in infancy (Kovács & Mehler, 2009a) by collecting new data from 7-month-olds and 20-month-olds and reanalyzing three open datasets from 7- to 9-month-olds (D'Souza et al., 2020; Kalashnikova et al., 2020, 2021). Infants from all studies (N = 222) were tested in an anticipatory eye-tracking paradigm, where they learned to use a cue to anticipate a reward presented on one side of a screen during Training, and the opposite side at Test. To correctly anticipate the reward at Test, infants had to update their previously learned behavior. Across four out of five studies, a fine-grained analysis of infants' anticipations showed that bilinguals were better able to update the previously learned response at Test, which could be related to bilinguals' weaker initial learning during Training. However, in one study of 7-month-olds, we observed the opposite pattern: bilinguals performed better during Training, and monolinguals performed better at Test. These results show that bilingualism affects how infants process information during learning. We also highlight the potential of open science to advance our understanding of language development.

Small-range numerical representations of linguistic sounds in 9- to 10-month-old infants

Coordinated studies provide evidence that very young infants, like human adults and nonhuman animals, readily discriminate small and large number of visual displays on the basis of numerical information. This capacity has been considerably less studied in the auditory modality. Surprisingly, the available studies yielded mixed evidence concerning whether numerical representations of auditory items in the small number range (1 to 3) are present early in human development. Specifically, while newborns discriminate 2- from 3-syllable sequences, older infants at 6 and 9 months of age fail to differentiate 2 from 3 tones. This study tested the hypothesis that infants can represent small sets more precisely when listening to ecologically relevant linguistic sounds. The aim was to probe 9- to 10-month-olds' (N = 74) ability to represent sound sets in a working memory test. In experiments 1 and 2, infants successfully discriminated 2- and 3-syllable sequences on the basis of their numerosity, when continuous variables, such as individual item duration, inter-stimulus duration, pitch, intensity, and total duration, were controlled for. In experiment 3, however, infants failed to discriminate 3- from 4-syllable sequences under similar conditions. Finally, in experiment 4, infants were tested on their ability to distinguish 2 and 3 tone sequences. The results showed no evidence that infants discriminated these non-linguistic stimuli. These findings indicate that, by means of linguistic sounds, infants can access a numerical system that yields precise auditory representations in the small number range.

European Portuguese-Learning Infants Look Longer at Iambic Stress: New Data on Language Specificity in Early Stress Perception

The ability to perceive lexical stress patterns has been shown to develop in language-specific ways. However, previous studies have examined this ability in languages that are either clearly stress-based (favoring the development of a preference for trochaic stress, like English and German) or syllable-based (favoring the development of no stress preferences, like French, Spanish, and Catalan) and/or where the frequency distributions of stress patterns provide clear data for a predominant pattern (like English and Hebrew). European Portuguese (EP) is a different type of language, which presents conflicting sets of cues related to rhythm, frequency, and stress correlates that challenge existing accounts of early stress perception. Using an anticipatory eye movement (AEM) paradigm implemented with eye-tracking, EP-learning infants at 5-6 months demonstrated sensitivity to the trochaic/iambic stress contrast, with evidence of asymmetrical perception or preference for iambic stress. These results are not predicted by the rhythmic account of developing stress perception, and suggest that the language-particular phonological patterns impacting the frequency of trochaic and iambic stress, beyond lexical words with two or more syllables, together with the prosodic correlates of stress, drive the early acquisition of lexical stress. Our findings provide the first evidence of sensitivity to stress patterns in the presence of segmental variability by 5-6 months, and highlight the importance of testing developing stress perception in languages with diverse combinations of rhythmic, phonological, and phonetic properties.

Using head-mounted eye-trackers to study sensory-motor dynamics of coordinated attention

In this chapter, we introduce recent research using head-mounted eye-trackers to record sensory-motor behaviors at a high resolution and examine parent-child interactions at a micro-level. We focus on one important research topic in early social and cognitive development: how young children and their parents coordinate their visual attention in social interactions. We start by introducing head-mounted eye-tracking and recent studies conducted using this method. We then present two sets of novel analysis techniques that examine how manual actions of parents and children with and without hearing loss contribute to their attention coordination. In the first set of analyses, we investigated different pathways parents and children used to coordinate their visual attention in toy play. After that, we used Sankey diagrams to represent the temporal dynamics of parents' and children's manual actions prior to and during coordinated attention. These two sets of analyses allowed us to explore how participants' sensory-motor behaviors contribute to the establishment and maintenance of coordinated attention. More generally, head-mounted eye-tracking allows us to ask new questions and conduct new analyses that were not previously possible. With this new sensing technology, the results here highlight the importance of understanding early social interaction from a multimodal, embodied view.

Development of Binaural Sensitivity: Eye Gaze as a Measure of Real-time Processing

Children localize sounds using binaural cues when navigating everyday auditory environments. While sensitivity to binaural cues reaches maturity by 8-10 years of age, large individual variability has been observed in the just-noticeable-difference (JND) thresholds for interaural time difference (ITD) among children in this age range. To understand the development of binaural sensitivity beyond JND thresholds, the "looking-while-listening" paradigm was adapted in this study to reveal the real-time decision-making behavior during ITD processing. Children ages 8-14 years with normal hearing (NH) and a group of young NH adults were tested. This novel paradigm combined eye gaze tracking with behavioral psychoacoustics to estimate ITD JNDs in a two-alternative forced-choice discrimination task. Results from simultaneous eye gaze recordings during ITD processing suggested that children had adult-like ITD JNDs, but they demonstrated immature decision-making strategies. While the time course of arriving at the initial fixation and final decision in providing a judgment of the ITD direction was similar, children exhibited more uncertainty than adults during decision-making. Specifically, children made more fixation changes, particularly when tested using small ITD magnitudes, between the target and non-target response options prior to finalizing a judgment. These findings suggest that, while children may exhibit adult-like sensitivity to ITDs, their eye gaze behavior reveals that the processing of this binaural cue is still developing through late childhood.

Two-year-olds succeed at MIT: Multiple identity tracking in 20- and 25-month-old infants

Infants' ability to remember objects and their locations emerges during the first year of life. However, not much is known about infants' ability to track objects' identities in a dynamic environment. Here, we tailored the delayed match retrieval eye-tracking paradigm to study infants' ability to track two object identities during occlusion-an infant version of multiple identity tracking (MIT). Delayed match retrieval uses virtual "cards" as stimuli that are first shown face up, exposing to-be-remembered information, and then turned face down, occluding it. Here, cards were subject to movement during the face-down occlusion period. We used complex non-nameable objects as card faces to discourage verbal rehearsal. In three experiments (N = 110), we compared infants' ability to track object identities when two previously exposed cards were static (Experiment 1), were moved into new positions along the same trajectory (Experiment 2), or were moved along different trajectories (Experiment 3) while face down. We found that 20-month-olds could remember two object identities when static; however, it was not until 25 months of age that infants could track when movement was introduced. Our results show that the ability to track multiple identities in visual working memory is present by 25 months.

Temporal dynamics and uncertainty in binaural hearing revealed by anticipatory eye movements

Accurate perception of binaural cues is essential for left-right sound localization. Much literature focuses on threshold measures of perceptual acuity and accuracy. This study focused on supra-threshold perception using an anticipatory eye movement (AEM) paradigm designed to capture subtle aspects of perception that might not emerge in behavioral-motor responses, such as the accumulation of certainty, and rapid revisions in decision-making. Participants heard interaural timing differences (ITDs) or interaural level differences in correlated or uncorrelated narrowband noises, respectively. A cartoon ball moved behind an occluder and then emerged from the left or right side, consistent with the binaural cue. Participants anticipated the correct answer (before it appeared) by looking where the ball would emerge. Results showed quicker and more steadfast gaze fixations for stimuli with larger cue magnitudes. More difficult stimuli elicited a wider distribution of saccade times and greater number of corrective saccades before final judgment, implying perceptual uncertainty or competition. Cue levels above threshold elicited some wrong-way saccades that were quickly corrected. Saccades to ITDs were earlier and more reliable for low-frequency noises. The AEM paradigm reveals the time course of uncertainty and changes in perceptual decision-making for supra-threshold binaural stimuli even when behavioral responses are consistently correct.

Seeing behind the surface: communicative demonstration boosts category disambiguation in 12-month-olds

In their first years, infants acquire an incredible amount of information regarding the objects present in their environment. While often it is not clear what specific information should be prioritized in encoding from the many characteristics of an object, different types of object representations facilitate different types of generalizations. We tested the hypotheses that 1-year-old infants distinctively represent familiar objects as exemplars of their kind, and that ostensive communication plays a role in determining kind membership for ambiguous objects. In the training phase of our experiment, infants were exposed to movies displaying an agent sorting objects from two categories (cups and plates) into two locations (left or right). Afterwards, different groups of infants saw either an ostensive or a non-ostensive demonstration performed by the agent, revealing that a new object that looked like a plate can be transformed into a cup. A third group of infants experienced no demonstration regarding the new object. During test, infants were presented with the ambiguous object in the plate format, and we measured generalization by coding anticipatory looks to the plate or the cup side. While infants looked equally often towards the two sides when the demonstration was non-ostensive, and more often to the plate side when there was no demonstration, they performed more anticipatory eye movements to the cup side when the demonstration was ostensive. Thus, ostensive demonstration likely highlighted the hidden dispositional properties of the target object as kind-relevant, guiding infants' categorization of the foldable cup as a cup, despite it looking like a plate. These results suggest that infants likely encode familiar objects as exemplars of their kind and that ostensive communication can play a crucial role in disambiguating what kind an object belongs to, even when this requires disregarding salient surface features.

Endogenous temporal attention in the absence of stimulus-driven cues emerges in the second year of life

Anticipating both where and when an object will appear is a critical ability for adaptation. Research in the temporal domain in adults indicate that dissociable mechanisms relate to endogenous attention driven by the properties of the stimulus themselves (e.g. rhythmic, sequential, or trajectory cues) and driven by symbolic cues. In infancy, we know that the capacity to endogenously orient attention progressively develops through infancy. However, the above-mentioned distinction has not yet been explored since previous studies involved stimulus-driven cues. The current study tested 12- and 15-month-olds in an adaptation of the anticipatory eye movement procedure to determine whether infants were able to anticipate a specific location and temporal interval predicted only by symbolic pre-cues. In the absence of stimulus-driven cues, results show that only 15-month-olds could show anticipatory behavior based on the temporal information provided by the symbolic cues. Distinguishing stimulus-driven expectations from those driven by symbolic cues allowed dissecting more clearly the developmental progression of temporal endogenous attention.

Investigating Thematic Roles through Implicit Learning: Evidence from Light Verb Constructions

The syntactic structure of a sentence is usually a strong predictor of its meaning: Each argument noun phrase (i.e., Subject and Object) should map onto exactly one thematic role (i.e., Agent and Patient, respectively). Some constructions, however, are exceptions to this pattern. This paper investigates how the syntactic structure of an utterance contributes to its construal, using ditransitive English light verb constructions, such as "Nils gave a hug to his brother," as an example of such mismatches: Hugging is a two-role event, but the ditransitive syntactic structure suggests a three-role event. Data from an eye-tracking experiment and behavioral categorization data reveal that listeners learn to categorize sentences according to the number of thematic roles they convey, independent of their syntax. Light verb constructions, however, seem to form a category of their own, in which the syntactic structure leads listeners down an initial incorrect assignment of thematic roles, from which they only partly recover. These results suggest an automatic influence of syntactic argument structure on semantic interpretation and event construal, even in highly frequent constructions.

Decreased attention to object size information in scale errors performers

Young children sometimes make serious attempts to perform impossible actions on miniature objects as if they were full-size objects. The existing explanations of these curious action errors assume (but never explicitly tested) children's decreased attention to object size information. This study investigated the attention to object size information in scale errors performers. Two groups of children aged 18-25 months (N=52) and 48-60 months (N=23) were tested in two consecutive tasks: an action task that replicated the original scale errors elicitation situation, and a looking task that involved watching on a computer screen actions performed with adequate to inadequate size object. Our key finding - that children performing scale errors in the action task subsequently pay less attention to size changes than non-scale errors performers in the looking task - suggests that the origins of scale errors in childhood operate already at the perceptual level, and not at the action level.

Infants' Looking to Surprising Events: When Eye-Tracking Reveals More than Looking Time

Research on infants' reasoning abilities often rely on looking times, which are longer to surprising and unexpected visual scenes compared to unsurprising and expected ones. Few researchers have examined more precise visual scanning patterns in these scenes, and so, here, we recorded 8- to 11-month-olds' gaze with an eye tracker as we presented a sampling event whose outcome was either surprising, neutral, or unsurprising: A red (or yellow) ball was drawn from one of three visible containers populated 0%, 50%, or 100% with identically colored balls. When measuring looking time to the whole scene, infants were insensitive to the likelihood of the sampling event, replicating failures in similar paradigms. Nevertheless, a new analysis of visual scanning showed that infants did spend more time fixating specific areas-of-interest as a function of the event likelihood. The drawn ball and its associated container attracted more looking than the other containers in the 0% condition, but this pattern was weaker in the 50% condition, and even less strong in the 100% condition. Results suggest that measuring where infants look may be more sensitive than simply how much looking there is to the whole scene. The advantages of eye tracking measures over traditional looking measures are discussed.

Delayed Match Retrieval: a novel anticipation-based visual working memory paradigm

We tested 8- and 10-month-old infants' visual working memory (VWM) for object-location bindings - what is where - with a novel paradigm, Delayed Match Retrieval, that measured infants' anticipatory gaze responses (using a Tobii T120 eye tracker). In an inversion of Delayed-Match-to-Sample tasks and with inspiration from the game Memory, in test trials, three face-down virtual 'cards' were presented. Two flipped over sequentially (revealing, e.g. a swirl pattern and then a star), and then flipped back face-down. Next, the third card was flipped to reveal a match (e.g. a star) to one of the previously seen, now face-down cards. If infants looked to the location where the (now face-down) matching card had been shown, this was coded as a correct response. To encourage anticipatory looks, infants subsequently received a reward (a brief, engaging animation) presented at that location. Ten-month-old infants performed significantly above chance, showing that their VWM could hold object-location information for the two cards. Overall, 8-month-olds' performance was at chance, but they showed a robust learning trend. These results corroborate previous findings (Kaldy & Leslie, 2005; Oakes, Ross-Sheehy & Luck, 2006) and point to rapid development of VWM for object-location bindings. However, compared to previous paradigms that measure passive gaze responses to novelty, this paradigm presents a more challenging, ecologically relevant test of VWM, as it measures the ability to make online predictions and actively localize objects based on VWM. In addition, this paradigm can be readily scaled up to test toddlers or older children without significant modification.

Naming influences 9-month-olds' identification of discrete categories along a perceptual continuum

A growing body of evidence documents that naming guides 9-month-old infants as they organize their visual experiences into categories. In particular, this evidence reveals that naming highlights categories when these are visually distinct. Here we advance this work in by introducing an anticipatory looking design to assess how naming influences infants' categorization of objects that vary along a perceptual continuum. We introduced 9-month-old infants (n = 48) to continua of novel creature-like objects. During the learning phase, infants had an opportunity to observe that objects from one end of the perceptual continuum moved to the left and objects from the other end moved to the right. What varied was how the objects were named. Infants in theone-name condition heard the same novel noun applied to all objects along the continuum; those in the two-name condition heard one name for objects from one end of the continuum and a second name for objects at the other end. At test, all infants viewed new objects from the same continuum. At issue was whether infants would anticipate the side to which the test objects would move and whether their expectations varied as a function of naming condition. Infants in the one-name condition formed a single overarching category and therefore searched for new test objects at either location; those in the two-name condition discerned two categories and therefore correctly anticipated the likely location of the test objects, whether these were close to the poles or to the center of the continuum. This provides the first evidence that by 9 months, naming supports both the number of categories infants impose along a perceptual continuum and the clarity of the category boundaries.

Preschoolers, adolescents, and adults visually anticipate an agent's efficient action; but only after having observed it frequently

The present study examined the contribution of efficiency reasoning and statistical learning on visual action anticipation in preschool children, adolescents, and adults. To this end, Experiment 1 assessed proactive eye movements of 5-year-old children, 15-year-old adolescents, and adults, who observed an agent stating the intent to reach a goal as quickly as possible. Subsequently the agent could four times either take a short, hence efficient, or long, hence inefficient, path to get to the goal. The results showed that in the first trial participants in none of the age groups predicted above chance level that the agent would produce the efficient action. Instead, we observed an age-dependent increase in action predictions in the subsequent repeated presentation of the same action. Experiment 2 ruled out that participants’ nonconsideration of the efficient path was due to a lack of understanding of the agent's action goal. Moreover, it demonstrated that 5-year-old children do predict that the agent will act efficiently when verbally reasoning about his future action. Overall, the study supports the view that rapid learning from frequency information guides visual action anticipations.

What infants know about the unsaid: Phonological categorization in the absence of auditory input

Acquiring a lexicon constitutes an essential step in early language development. From an early age on, infants store words with well-specified phonological representations, and they can spontaneously activate these representations on the basis of visual information only (Mani & Plunkett, 2010a, 2011). To what extent can infants inspect and categorize phonological representations in the absence of auditory input? The present study focuses on words that infants comprehend but do not attempt to pronounce yet, and introduces a novel methodology based on anticipatory eye-movements. In two experiments, 21-month-old French-learning infants were silently presented with images of familiar objects whose labels they comprehended but did not pronounce yet. We tested whether they could activate the phonological representation of these labels and categorize them based on their length. Infants' performance exceeded chance when the target words were mono- and trisyllabic, but not when they were mono- and disyllabic. Thus, even in the absence of auditory input infants can activate the phonological representation of words they do not pronounce yet, and use this representation to perform a categorization based on word length, provided the length difference is substantial.

The development of voicing categories: a quantitative review of over 40 years of infant speech perception research

Most research on infant speech categories has relied on measures of discrimination. Such work often employs categorical perception as a linking hypothesis to enable inferences about categorization on the basis of discrimination measures. However, a large number of studies with adults challenge the utility of categorical perception in describing adult speech perception, and this in turn calls into question how to interpret measures of infant speech discrimination. We propose here a parallel channels model of discrimination (built on Pisoni and Tash Perception & Psychophysics, 15(2), 285-290, 1974), which posits that both a noncategorical or veridical encoding of speech cues and category representations can simultaneously contribute to discrimination. This can thus produce categorical perception effects without positing any warping of the acoustic signal, but it also reframes how we think about infant discrimination and development. We test this model by conducting a quantitative review of 20 studies examining infants' discrimination of voice onset time contrasts. This review suggests that within-category discrimination is surprisingly prevalent even in classic studies and that, averaging across studies, discrimination is related to continuous acoustic distance. It also identifies several methodological factors that may mask our ability to see this. Finally, it suggests that infant discrimination may improve over development, contrary to commonly held notion of perceptual narrowing. These results are discussed in terms of theories of speech development that may require such continuous sensitivity.

Learning Stimulus-Location Associations in 8- and 11-Month-Old Infants: Multimodal versus Unimodal Information

Research on the influence of multimodal information on infants' learning is inconclusive. While one line of research finds that multimodal input has a negative effect on learning, another finds positive effects. The present study aims to shed some new light on this discussion by studying the influence of multimodal information and accompanying stimulus complexity on the learning process. We assessed the influence of multimodal input on the trial-by-trial learning of 8- and 11-month-old infants. Using an anticipatory eye movement paradigm, we measured how infants learn to anticipate the correct stimulus-location associations when exposed to visual-only, auditory-only (unimodal), or auditory and visual (multimodal) information. Our results show that infants in both the multimodal and visual-only conditions learned the stimulus-location associations. Although infants in the visual-only condition appeared to learn in fewer trials, infants in the multimodal condition showed better anticipating behavior: as a group, they had a higher chance of anticipating correctly on more consecutive trials than infants in the visual-only condition. These findings suggest that effects of multimodal information on infant learning operate chiefly through effects on infants' attention.

Experience with malleable objects influences shape-based object individuation by infants

Infants' ability to accurately represent and later recognize previously viewed objects, and conversely, to discriminate novel objects from those previously seen improves remarkably over the first two years of life. During this time, infants acquire extensive experience viewing and manipulating objects and these experiences influence their physical reasoning. Here we posited that infants' observations of object feature stability (rigid versus malleable) can influence the use of those features to individuate two successively viewed objects. We showed 8.5-month-olds a series of objects that could or could not change shape, then assessed their use of shape as a basis for object individuation. Infants who explored rigid objects later used shape differences to individuate objects; however, infants who explored malleable objects did not. This outcome suggests that the latter infants did not take into account shape differences during the physical reasoning task and provides further evidence that infants' attention to object features can be readily modified based on recent experiences.

Infants track word forms in early word-object associations

A central component of language development is word learning. One characterization of this process is that language learners discover objects and then look for word forms to associate with these objects (Mcnamara, 1984; Smith, 2000). Another possibility is that word forms themselves are also important, such that once learned, hearing a familiar word form will lead young word learners to look for an object to associate with it (Juscyzk, 1997). This research investigates the relative weighing of word forms and objects in early word-object associations using the anticipatory eye-movement paradigm (AEM; McMurray & Aslin, 2004). Eighteen-month-old infants and adults were taught novel word-object associations and then tested on ambiguous stimuli that pitted word forms and objects against each other. Results revealed a change in weighing of these components across development. For 18-month-old infants, word forms weighed more in early word-object associative learning, while for adults, objects were more salient. Our results suggest that infants preferentially use word forms to guide the process of word-object association.

Probabilistic cue combination: less is more

Learning about the structure of the world requires learning probabilistic relationships: rules in which cues do not predict outcomes with certainty. However, in some cases, the ability to track probabilistic relationships is a handicap, leading adults to perform non-normatively in prediction tasks. For example, in the dilution effect, predictions made from the combination of two cues of different strengths are less accurate than those made from the stronger cue alone. Here we show that dilution is an adult problem; 11-month-old infants combine strong and weak predictors normatively. These results extend and add support for the less is more hypothesis: limited cognitive resources can lead children to represent probabilistic information differently from adults, and this difference in representation can have important downstream consequences for prediction.

The origins and structure of quantitative concepts

"Number" is the single most influential quantitative dimension in modern human society. It is our preferred dimension for keeping track of almost everything, including distance, weight, time, temperature, and value. How did "number" become psychologically affiliated with all of these different quantitative dimensions? Humans and other animals process a broad range of quantitative information across many psychophysical dimensions and sensory modalities. The fact that adults can rapidly translate one dimension (e.g., loudness) into any other (e.g., handgrip pressure) has been long established by psychophysics research (Stevens, 1975 ). Recent literature has attempted to account for the development of the computational and neural mechanisms that underlie interactions between quantitative dimensions. We review evidence that there are fundamental cognitive and neural relations among different quantitative dimensions (number, size, time, pitch, loudness, and brightness). Then, drawing on theoretical frameworks that explain phenomena from cross-modal perception, we outline some possible conceptualizations for how different quantitative dimensions could come to be related over both ontogenetic and phylogenetic time scales.

Using a single feature to discriminate and form categories: the interaction between color, form and exemplar number

There is relatively little work that has focused on how infants use a single feature to discriminate objects or flexibly group objects together. Existing research suggests that the ease with which infants learn form and color discriminations is not equal. However, which of these dimensions is easier when discriminating between objects is still unclear. The studies in this paper tested how infants used these two dimensions under varying levels of diversity in a discrimination task. Combining traditional analyses with latent-states Markov-modeling, infant learning in these studies was characterized by a bend of overt behavior and attentional processes. Infants were able to learn both a color and form-based discrimination, but only generalized the form distinction to new stimuli. When presented with diversity on the irrelevant dimension, infants in the form condition learned quickly. However, infants in the color-condition did not show signs that they learned the distinction. The results show that infants could use both dimensions to distinguish between objects, but that form-based distinctions were easier and more likely to be generalized to new objects.

The acquisition of phonetic categories in bilingual infants: new data from an anticipatory eye movement paradigm

Contrasting results have been reported regarding the phonetic acquisition of bilinguals. A lack of discrimination has been observed for certain native contrasts in 8-month-old Catalan-Spanish bilingual infants (Bosch & Sebastián-Gallés, 2003a), though not in French-English bilingual infants (Burns, Yoshida, Hill & Werker, 2007; Sundara, Polka & Molnar, 2008). At present, the data for Catalan-Spanish bilinguals constitute an exception in the early language acquisition literature. This study contributes new findings that show that Catalan-Spanish bilingual infants do not lose the capacity to discriminate native contrasts. We used an adaptation of the anticipatory eye movement paradigm (AEM; McMurray & Aslin, 2004) to explore this question. In two experiments we tested the ability of infants from Catalan and Spanish monolingual families and from Catalan-Spanish bilingual families to discriminate a Spanish-Catalan common and a Catalan-specific vowel contrast. Results from both experiments revealed that Catalan-Spanish bilingual infants showed the same discrimination abilities as those shown by their monolingual peers, even in a phonetic contrast that had not been discriminated in previous studies. Our results demonstrate that discrimination can be observed in 8-month-old bilingual infants when tested with a measure not based on recovery of attention. The high ratio of cognates in Spanish and Catalan may underlie the reason why bilinguals failed to discriminate the native vowels when tested with the familiarization-preference procedure but succeeded with the AEM paradigm.

Visual Sequence Learning in Infancy: Domain-General and Domain-Specific Associations with Language

Research suggests that non-linguistic sequence learning abilities are an important contributor to language development (Conway, Bauernschmidt, Huang, & Pisoni, 2010). The current study investigated visual sequence learning as a possible predictor of vocabulary development in infants. Fifty-eight 8.5-month-old infants were presented with a three-location spatiotemporal sequence of multi-colored geometric shapes. Early language skills were assessed using the MacArthur-Bates CDI. Analyses of children's reaction times to the stimuli suggest that the extent to which infants demonstrated learning was significantly correlated with their vocabulary comprehension at the time of test and with their gestural comprehension abilities 5 months later. These findings suggest that visual sequence learning may have both domain-general and domain-specific associations with language learning.

Infants in control: rapid anticipation of action outcomes in a gaze-contingent paradigm

Infants' poor motor abilities limit their interaction with their environment and render studying infant cognition notoriously difficult. Exceptions are eye movements, which reach high accuracy early, but generally do not allow manipulation of the physical environment. In this study, real-time eye tracking is used to put 6- and 8-month-old infants in direct control of their visual surroundings to study the fundamental problem of discovery of agency, i.e. the ability to infer that certain sensory events are caused by one's own actions. We demonstrate that infants quickly learn to perform eye movements to trigger the appearance of new stimuli and that they anticipate the consequences of their actions in as few as 3 trials. Our findings show that infants can rapidly discover new ways of controlling their environment. We suggest that gaze-contingent paradigms offer effective new ways for studying many aspects of infant learning and cognition in an interactive fashion and provide new opportunities for behavioral training and treatment in infants.

Infant eyes: A window on cognitive development

Eye-trackers suitable for use with infants are now marketed by several commercial vendors. As eye-trackers become more prevalent in infancy research, there is the potential for users to be unaware of dangers lurking "under the hood" if they assume the eye-tracker introduces no errors in measuring infants' gaze. Moreover, the influx of voluminous datasets from eye-trackers requires users to think hard about what they are measuring and what these measures mean for making inferences about underlying cognitive processes. The present commentary highlights these concerns, both technical and interpretive, and reviews the five articles that comprise this Special Issue.

Visual Data Mining: An Exploratory Approach to Analyzing Temporal Patterns of Eye Movements

Infant eye movements are an important behavioral resource to understand early human development and learning. But the complexity and amount of gaze data recorded from state-of-the-art eye-tracking systems also pose a challenge: how does one make sense of such dense data? Toward this goal, this article describes an interactive approach based on integrating top-down domain knowledge with bottom-up information visualization and visual data mining. The key idea behind this method is to leverage the computational power of the human visual system. Thus, we propose an approach in which scientists iteratively examine and identify underlying patterns through data visualization and link those discovered patterns with top-down knowledge/hypotheses. Combining bottom-up data visualization with top-down human theoretical knowledge through visual data mining is an effective and efficient way to make discoveries from gaze data. We first provide an overview of the underlying principles of this new approach of human-in-the-loop knowledge discovery and then show several examples illustrating how this interactive exploratory approach can lead to new findings.

Consonants and vowels: different roles in early language acquisition

Language acquisition involves both acquiring a set of words (i.e. the lexicon) and learning the rules that combine them to form sentences (i.e. syntax). Here, we show that consonants are mainly involved in word processing, whereas vowels are favored for extracting and generalizing structural relations. We demonstrate that such a division of labor between consonants and vowels plays a role in language acquisition. In two very similar experimental paradigms, we show that 12-month-old infants rely more on the consonantal tier when identifying words (Experiment 1), but are better at extracting and generalizing repetition-based srtuctures over the vocalic tier (Experiment 2). These results indicate that infants are able to exploit the functional differences between consonants and vowels at an age when they start acquiring the lexicon, and suggest that basic speech categories are assigned to different learning mechanisms that sustain early language acquisition.

A Critical Test of Temporal and Spatial Accuracy of the Tobii T60XL Eye Tracker

Infant eye tracking is becoming increasingly popular for its presumed precision relative to traditional looking time paradigms and potential to yield new insights into developmental processes. However, there is strong reason to suspect that the temporal and spatial resolution of popular eye tracking systems is not entirely accurate, potentially compromising any data from an infant eye tracking experiment. Moreover, "best practices" for infant eye tracking, such as knowing which software tool enhances experimental flexibility, remain to be determined. The present investigation was designed to evaluate the temporal and spatial accuracy of data from the Tobii T60XL eye tracker through the use of visual latency and spatial accuracy tasks involving adults and infants. Systematic delays and drifts were revealed in oculomotor response times, and the system's spatial accuracy was observed to deviate somewhat in excess of the manufacturer's estimates; the experimental flexibility of the system appears dependent on the chosen software.

SMART-T: a system for novel fully automated anticipatory eye-tracking paradigms

Anticipatory eye movements (AEMs) are a natural and implicit measure of cognitive processing and have been successfully used to document such important cognitive capacities as learning, categorization, and generalization, especially in infancy (McMurray & Aslin, Infancy, 6, 203-229, 2004). Here, we describe an improved AEM paradigm to automatically assess online learning on a trial-by-trial basis, by analyzing eye gaze data in each intertrial interval of a training phase. Different measures of learning can be evaluated simultaneously. We describe the implementation of a system for designing and running a variety of such AEM paradigms. Additionally, this system is capable of a wider variety of gaze-contingent paradigms, as well as implementations of standard noncontingent paradigms. Our system, Smart-T (System for Monitoring Anticipations in Real Time with the Tobii), is a set of MATLAB scripts with a graphical front end, written using the Psychophysics Toolbox. The system gathers eye gaze data using the commercially available Tobii eye-trackers via a MATLAB module, Talk2Tobii. We report a pilot study showing that Smart-T can detect 6-month-old infants' learning of simple predictive patterns involving the disappearance and reappearance of multimodal stimuli.

Mapping emotion category boundaries using a visual expectation paradigm

Past research showing categorical perception of emotional facial expressions has relied on identification and discrimination tasks that require an explicit response via keypress. Here we report a new paradigm for investigating the category boundary of emotional facial expressions that, instead, relies on an implicit response--eye direction. Participants were trained to expect a target stimulus on a particular side of the monitor, predicted by an emotional expression on a face image. An eye-tracker then recorded eye movements of participants as they viewed novel intermediate facial-expression stimuli. Anticipatory eye movement was taken as evidence of categorisation. Results from two experiments suggest that this implicit method can be used to determine category boundaries, and that the boundaries found with this method are similar to those found with the keypress response.

Near-infrared spectroscopy: a report from the McDonnell infant methodology consortium

Near-infrared spectroscopy (NIRS) is a new and increasingly widespread brain imaging technique, particularly suitable for young infants. The laboratories of the McDonnell Consortium have contributed to the technological development and research applications of this technique for nearly a decade. The present paper provides a general introduction to the technique as well as a detailed report of the methodological innovations developed by the Consortium. The basic principles of NIRS and some of the existing developmental studies are reviewed. Issues concerning technological improvements, parameter optimization, possible experimental designs and data analysis techniques are discussed and illustrated by novel empirical data.

Infants' representations of three-dimensional occluded objects

Infants' ability to represent objects has received significant attention from the developmental research community. With the advent of eye-tracking technology, detailed analysis of infants' looking patterns during object occlusion have revealed much about the nature of infants' representations. The current study continues this research by analyzing infants' looking patterns in a novel manner and by comparing infants' looking at a simple display in which a single three-dimensional (3D) object moves along a continuous trajectory to a more complex display in which two 3D objects undergo trajectories that are interrupted behind an occluder. Six-month-old infants saw an occlusion sequence in which a ball moved along a linear path, disappeared behind a rectangular screen, and then a ball (ball-ball event) or a box (ball-box event) emerged at the other edge. An eye-tracking system recorded infants' eye-movements during the event sequence. Results from examination of infants' attention to the occluder indicate that during the occlusion interval infants looked longer to the side of the occluder behind which the moving occluded object was located, shifting gaze from one side of the occluder to the other as the object(s) moved behind the screen. Furthermore, when events included two objects, infants attended to the spatiotemporal coordinates of the objects longer than when a single object was involved. These results provide clear evidence that infants' visual tracking is different in response to a one-object display than to a two-object display. Furthermore, this finding suggests that infants may require more focused attention to the hidden position of objects in more complex multiple-object displays and provides additional evidence that infants represent the spatial location of moving occluded objects.

Flexible Learning of Multiple Speech Structures in Bilingual Infants

Children acquire their native language according to a well-defined time frame. Surprisingly, although children raised in bilingual environments have to learn roughly twice as much about language as their monolingual peers, the speed of acquisition is comparable in monolinguals and bilinguals. Here, we show that preverbal 12-month-old bilingual infants have become more flexible at learning speech structures than monolinguals. When given the opportunity to simultaneously learn two different regularities, bilingual infants learned both, whereas monolinguals learned only one of them. Hence, bilinguals may acquire two languages in the time in which monolinguals acquire one because they quickly become more flexible learners.

How infants view natural scenes gathered from a head-mounted camera

The role of early visual experience in human infant development has been inferred primarily by studies of visual deprivation (e.g., cataracts). Another approach, described here, is to provide a detailed description of the visual input gathered by normal infants in their natural environment. Recently, several labs have begun the laborious process of obtaining video images from a head-mounted camera to provide an infant's eye-view of their visual world. Preliminary findings from one such study are reviewed and discussed in the context of the power and limitations of this approach for revealing important insights about the role of early visual experience, as well as the broader implications for studies of cognitive, language, and social development.

Cognitive gains in 7-month-old bilingual infants

Children exposed to bilingual input typically learn 2 languages without obvious difficulties. However, it is unclear how preverbal infants cope with the inconsistent input and how bilingualism affects early development. In 3 eye-tracking studies we show that 7-month-old infants, raised with 2 languages from birth, display improved cognitive control abilities compared with matched monolinguals. Whereas both monolinguals and bilinguals learned to respond to a speech or visual cue to anticipate a reward on one side of a screen, only bilinguals succeeded in redirecting their anticipatory looks when the cue began signaling the reward on the opposite side. Bilingual infants rapidly suppressed their looks to the first location and learned the new response. These findings show that processing representations from 2 languages leads to a domain-general enhancement of the cognitive control system well before the onset of speech.