The role of visual representations in college students' understanding of mathematical notation

Developing understanding of fractions involves connections between nonsymbolic visual representations and symbolic representations. Initially, teachers introduce fraction concepts with visual representations before moving to symbolic representations. Once the focus is shifted to symbolic representations, the connections between visual representations and symbolic notation are considered to be less useful, and students are rarely asked to connect symbolic notation back to visual representations. In 2 experiments, we ask whether visual representations affect understanding of symbolic notation for adults who understand symbolic notation. In a conceptual fraction comparison task (e.g., Which is larger, 5 / a or 8 / a?), participants were given comparisons paired with accurate, helpful visual representations, misleading visual representations, or no visual representations. The results show that even college students perform significantly better when accurate visuals are provided over misleading or no visuals. Further, eye-tracking data suggest that these visual representations may affect performance even when only briefly looked at. Implications for theories of fraction understanding and education are discussed.

Discrimination of Possible and Impossible Objects in Infancy

Adults can use pictorial depth cues to infer three-dimensional structure in two-dimensional depictions of objects. The age at which infants respond to the same kinds of visual information has not been determined, and theories about the underlying developmental mechanisms remain controversial. In this study, we used a visual habituation/novelty-preference procedure to assess the ability of 4-month-old infants to discriminate between two-dimensional depictions of structurally possible and impossible objects. Results indicate that young infants are sensitive to junction structures and interposition cues associated with pictorial depth and can detect inconsistent relationships among these cues that render an object impossible. Our results provide important insights into the development of mechanisms for processing pictorial depth cues that allow adults to extract three-dimensional structure from pictures of objects.

Many faces, one rule: the role of perceptual expertise in infants' sequential rule learning

Rule learning is a mechanism that allows infants to recognize and generalize rule-like patterns, such as ABB or ABA. Although infants are better at learning rules from speech vs. non-speech, rule learning can be applied also to frequently experienced visual stimuli, suggesting that perceptual expertise with material to be learned is critical in enhancing rule learning abilities. Yet infants' rule learning has never been investigated using one of the most commonly experienced visual stimulus category available in infants' environment, i.e., faces. Here, we investigate 7-month-olds' ability to extract rule-like patterns from sequences composed of upright faces and compared their results to those of infants who viewed inverted faces, which presumably are encountered far less frequently than upright faces. Infants were habituated with face triads in either an ABA or ABB condition followed by a test phase with ABA and ABB triads composed of faces that differed from those showed during habituation. When upright faces were used, infants generalized the pattern presented during habituation to include the new face identities showed during testing, but when inverted faces were presented, infants failed to extract the rule. This finding supports the idea that perceptual expertise can modulate 7-month-olds' abilities to detect rule-like patterns.

Gendered race: are infants' face preferences guided by intersectionality of sex and race?

People occupy multiple social categories simultaneously (e.g., a White female), and this complex intersectionality affects fundamental aspects of social perception. Here, we examined the possibility that infant face processing may be susceptible to effects of intersectionality of sex and race. Three- and 10-month-old infants were shown a series of computer-generated face pairs (5 s each) that differed according to sex (Female or Male) or race (Asian, Black, or White). All possible combinations of face pairs were tested, and preferences were recorded with an eye tracker. Infants showed preferences for more feminine faces only when they were White, but we found no evidence that White or Asian faces were preferred even though they are relatively more feminized. These findings challenge the notions that infants’ social categories are processed independently of one another and that infants’ preferences for sex or race can be explained from mere exposure.

Category generalization in a new context: the role of visual attention

Infants and children have difficulty categorizing objects in new contexts. However, learning in both same and varied contexts can help young word learners overcome contextual learning difficulties. We examined the relation between infants' visual attention to the category member and background context during learning and their ability to generalize a new category member in a new context. Of particular interest is how this relation is affected by learning in various contextual conditions. Infants (16-20 months; n=48) were presented with eight novel noun categories in one of three contextual conditions (same context, varied context, or a combination of same and varied contexts), and tested for their generalization ability in a new context. Context was defined as the colored and patterned fabric upon which the object was presented. Results suggest that visual attention during learning is associated with category generalization ability in a new context only for infants whose learning took place in a combination of same and varied background contexts. The results are discussed in terms of the mechanisms by which context affects generalization.

Hepatic arterial spin labelling MRI: an initial evaluation in mice

The development of strategies to combat hepatic disease and augment tissue regeneration has created a need for methods to assess regional liver function. Liver perfusion imaging has the potential to fulfil this need, across a range of hepatic diseases, alongside the assessment of therapeutic response. In this study, the feasibility of hepatic arterial spin labelling (HASL) was assessed for the first time in mice at 9.4 T, its variability and repeatability were evaluated, and it was applied to a model of colorectal liver metastasis. Data were acquired using flow-sensitive alternating inversion recovery-arterial spin labelling (FAIR-ASL) with a Look-Locker readout, and analysed using retrospective respiratory gating and a T1 -based quantification. This study shows that preclinical HASL is feasible and exhibits good repeatability and reproducibility. Mean estimated liver perfusion was 2.2 ± 0.8 mL/g/min (mean ± standard error, n = 10), which agrees well with previous measurements using invasive approaches. Estimates of the variation gave a within-session coefficient of variation (CVWS) of 7%, a between-session coefficient of variation (CVBS) of 9% and a between-animal coefficient of variation (CVA) of 15%. The within-session Bland-Altman repeatability coefficient (RCWS) was 18% and the between-session repeatability coefficient (RCBS) was 29%. Finally, the HASL method was applied to a mouse model of liver metastasis, in which significantly lower mean perfusion (1.1 ± 0.5 mL/g/min, n = 6) was measured within the tumours, as seen by fluorescence histology. These data indicate that precise and accurate liver perfusion estimates can be achieved using ASL techniques, and provide a platform for future studies investigating hepatic perfusion in mouse models of disease.

Does bilingual experience affect early visual perceptual development?

Visual attention and perception develop rapidly during the first few months after birth, and these behaviors are critical components in the development of language and cognitive abilities. Here we ask how early bilingual experiences might lead to differences in visual attention and perception. Experiments 1–3 investigated the looking behavior of monolingual and bilingual infants when presented with social (Experiment 1), mixed (Experiment 2), or non-social (Experiment 3) stimuli. In each of these experiments, infants' dwell times (DT) and number of fixations to areas of interest (AOIs) were analyzed, giving a sense of where the infants looked. To examine how the infants looked at the stimuli in a more global sense, Experiment 4 combined and analyzed the saccade data collected in Experiments 1–3. There were no significant differences between monolingual and bilingual infants' DTs, AOI fixations, or saccade characteristics (specifically, frequency, and amplitude) in any of the experiments. These results suggest that monolingual and bilingual infants process their visual environments similarly, supporting the idea that the substantial cognitive differences between monolinguals and bilinguals in early childhood are more related to active vocabulary production than perception of the environment.

Learning Stimulus-Location Associations in 8- and 11-Month-Old Infants: Multimodal versus Unimodal Information

Research on the influence of multimodal information on infants' learning is inconclusive. While one line of research finds that multimodal input has a negative effect on learning, another finds positive effects. The present study aims to shed some new light on this discussion by studying the influence of multimodal information and accompanying stimulus complexity on the learning process. We assessed the influence of multimodal input on the trial-by-trial learning of 8- and 11-month-old infants. Using an anticipatory eye movement paradigm, we measured how infants learn to anticipate the correct stimulus-location associations when exposed to visual-only, auditory-only (unimodal), or auditory and visual (multimodal) information. Our results show that infants in both the multimodal and visual-only conditions learned the stimulus-location associations. Although infants in the visual-only condition appeared to learn in fewer trials, infants in the multimodal condition showed better anticipating behavior: as a group, they had a higher chance of anticipating correctly on more consecutive trials than infants in the visual-only condition. These findings suggest that effects of multimodal information on infant learning operate chiefly through effects on infants' attention.

Detecting 'infant-directedness' in face and voice

Five- and 3-month-old infants' perception of infant-directed (ID) faces and the role of speech in perceiving faces were examined. Infants' eye movements were recorded as they viewed a series of two side-by-side talking faces, one infant-directed and one adult-directed (AD), while listening to ID speech, AD speech, or in silence. Infants showed consistently greater dwell time on ID faces vs. AD faces, and this ID face preference was consistent across all three sound conditions. ID speech resulted in higher looking overall, but it did not increase looking at the ID face per se. Together, these findings demonstrate that infants' preferences for ID speech extend to ID faces.

Prediction-learning in infants as a mechanism for gaze control during object exploration

We are pursuing the hypothesis that visual exploration and learning in young infants is achieved by producing gaze-sample sequences that are sequentially predictable. Our recent analysis of infants' gaze patterns during image free-viewing (Schlesinger and Amso, 2013) provides support for this idea. In particular, this work demonstrates that infants' gaze samples are more easily learnable than those produced by adults, as well as those produced by three artificial-observer models. In the current study, we extend these findings to a well-studied object-perception task, by investigating 3-month-olds' gaze patterns as they view a moving, partially occluded object. We first use infants' gaze data from this task to produce a set of corresponding center-of-gaze (COG) sequences. Next, we generate two simulated sets of COG samples, from image-saliency and random-gaze models, respectively. Finally, we generate learnability estimates for the three sets of COG samples by presenting each as a training set to an SRN. There are two key findings. First, as predicted, infants' COG samples from the occluded-object task are learned by a pool of simple recurrent networks faster than the samples produced by the yoked, artificial-observer models. Second, we also find that resetting activity in the recurrent layer increases the network's prediction errors, which further implicates the presence of temporal structure in infants' COG sequences. We conclude by relating our findings to the role of image-saliency and prediction-learning during the development of object perception.

Electrophysiological evidence of heterogeneity in visual statistical learning in young children with ASD

Statistical learning is characterized by detection of regularities in one's environment without an awareness or intention to learn, and it may play a critical role in language and social behavior. Accordingly, in this study we investigated the electrophysiological correlates of visual statistical learning in young children with autism spectrum disorder (ASD) using an event-related potential shape learning paradigm, and we examined the relation between visual statistical learning and cognitive function. Compared to typically developing (TD) controls, the ASD group as a whole showed reduced evidence of learning as defined by N1 (early visual discrimination) and P300 (attention to novelty) components. Upon further analysis, in the ASD group there was a positive correlation between N1 amplitude difference and non-verbal IQ, and a positive correlation between P300 amplitude difference and adaptive social function. Children with ASD and a high non-verbal IQ and high adaptive social function demonstrated a distinctive pattern of learning. This is the first study to identify electrophysiological markers of visual statistical learning in children with ASD. Through this work we have demonstrated heterogeneity in statistical learning in ASD that maps onto non-verbal cognition and adaptive social function.

Visual search and attention to faces during early infancy

Newborn babies look preferentially at faces and face-like displays, yet over the course of their first year much changes about both the way infants process visual stimuli and how they allocate their attention to the social world. Despite this initial preference for faces in restricted contexts, the amount that infants look at faces increases considerably during the first year. Is this development related to changes in attentional orienting abilities? We explored this possibility by showing 3-, 6-, and 9-month-olds engaging animated and live-action videos of social stimuli and also measuring their visual search performance with both moving and static search displays. Replicating previous findings, looking at faces increased with age; in addition, the amount of looking at faces was strongly related to the youngest infants' performance in visual search. These results suggest that infants' attentional abilities may be an important factor in facilitating their social attention early in development.

Atypical gaze following in autism: a comparison of three potential mechanisms

In order to evaluate the following potential mechanisms underlying atypical gaze following in autism, impaired reflexive gaze following, difficulty integrating gaze and affect, or reduced understanding of the referential significance of gaze, we administered three paradigms to young children with autism (N = 21) and chronological (N = 21) and nonverbal mental age (N = 21) matched controls. Children with autism exhibited impaired reflexive gaze following. The absence of evidence of integration of gaze and affect, regardless of diagnosis, indicates ineffective measurement of this construct. Reduced gaze following was apparent among children with autism during eye-tracking and in-person assessments. Word learning from gaze cues was better explained by developmental level than autism. Thus, gaze following may traverse an atypical, rather than just delayed, trajectory in autism.

Sex-related preferences for real and doll faces versus real and toy objects in young infants and adults

Findings of previous studies demonstrate sex-related preferences for toys in 6-month-old infants; boys prefer nonsocial or mechanical toys such as cars, whereas girls prefer social toys such as dolls. Here, we explored the innate versus learned nature of this sex-related preferences using multiple pictures of doll and real faces (of men and women) as well as pictures of toy and real objects (cars and stoves). In total, 48 4- and 5-month-old infants (24 girls and 24 boys) and 48 young adults (24 women and 24 men) saw six trials of all relevant pairs of faces and objects, with each trial containing a different exemplar of a stimulus type. The infant results showed no sex-related preferences; infants preferred faces of men and women regardless of whether they were real or doll faces. Similarly, adults did not show sex-related preferences for social versus nonsocial stimuli, but unlike infants they preferred faces of the opposite sex over objects. These results challenge claims of an innate basis for sex-related preferences for toy real stimuli and suggest that sex-related preferences result from maturational and social development that continues into adulthood.

Attentional capture by social stimuli in young infants

We investigated the possibility that a range of social stimuli capture the attention of 6-month-old infants when in competition with other non-face objects. Infants viewed a series of six-item arrays in which one target item was a face, body part, or animal as their eye movements were recorded. Stimulus arrays were also processed for relative salience of each item in terms of color, luminance, and amount of contour. Targets were rarely the most visually salient items in the arrays, yet infants' first looks toward all three target types were above chance, and dwell times for targets exceeded other stimulus types. Girls looked longer at faces than did boys, but there were no sex differences for other stimuli. These results are interpreted in a context of learning to discriminate between different classes of animate stimuli, perhaps in line with affordances for social interaction, and origins of sex differences in social attention.

Development of Three-Dimensional Completion of Complex Objects

Three-dimensional (3D) object completion, the ability to perceive the backs of objects seen from a single viewpoint, emerges at around 6 months of age. Yet, only relatively simple 3D objects have been used in assessing its development. The present study examined infants' 3D object completion when presented with more complex stimuli. Infants (N = 48) were habituated to an "L"-shaped object shown from a limited viewpoint; then they were tested with volumetrically complete (solid) and incomplete (hollow) versions of the object. Four-month-olds and 6-month-old girls had no preference for either display. Six-month-old boys and both sexes at 9.5 months of age showed a novelty preference for the incomplete object. A control group (N = 48), only shown the test displays, had no spontaneous preference. Perceptual completion of complex 3D objects requires infants to integrate multiple, local object features and thus may tax their nascent attentional skills. Infants might use mental rotation to supplement performance, giving an advantage to young boys. Examining the development of perceptual completion of more complex 3D objects reveals distinct mechanisms for the acquisition and refinement of 3D object completion in infancy.

Memory constraints on infants' cross-situational statistical learning

Infants are able to map linguistic labels to referents in the world by tracking co-occurrence probabilities across learning events, a behavior often termed cross-situational statistical learning. This study builds upon existing research by examining infants' developing ability to aggregate and retrieve word-referent pairings over time. 16- and 20-month-old infants (N=32) were presented with a cross-situational statistical learning task in which half of the object-label pairings were presented in immediate succession (massed) and half were distributed across time (interleaved). Results revealed striking developmental differences in word mapping performance; infants in both age groups were able to learn pairings presented in immediate succession, but only 20-month-old infants were able to correctly infer pairings distributed over time. This work reveals significant constraints on infants' ability to aggregate and retrieve object-label pairings across time and challenges theories of cross-situational statistical learning that rest on retrieval processes as successful and automatic.

Do young infants prefer an infant-directed face or a happy face?

Infants’ visual preference for infant-directed (ID) faces over adult-directed (AD) faces was examined in two experiments that introduced controls for emotion. Infants’ eye movements were recorded as they viewed a series of side-by-side dynamic faces. When emotion was held constant, 6-month-old infants showed no preference for ID faces over AD faces, but a second group of infants looked significantly longer at AD faces conveying happy emotion over sad ID faces conveying sad emotion. Together, these findings suggest that infants’ visual preference for ID faces is mediated, at least in part, by the presence of happy emotion. The relations between happy emotion and ID faces are discussed.

Infants' perception of chasing

Two significant questions in cognitive and developmental science are first, whether objects and events are selected for attention based on their features (featural processing) or the configuration of their features (configural processing), and second, how these modes of processing develop. These questions have been addressed in part with experiments focused on infants' perception of faces, human body shapes, and biological motion of individual agents. Here, we investigate 4- and 10-month-old infants' (N=192) attention to social motions, specifically to chasing-a ubiquitous, ancient, and fitness-relevant mode of interaction. We constructed computer-generated animations of chasing that had three properties: acceleration, high turning rates, and attraction ("heat-seeking"). In the first experiment we showed chasing side-by-side with a control display of inanimate, billiard-ball-like motions. Infants strongly preferred attending to chasing. In the next three studies, we systematically investigated the effect of each property in turn (acceleration, turning, and attraction) by showing a display of that property side-by-side with the control display. Infants preferentially attended to acceleration, and to attraction, but not to turning. If infants preferred chasing for its configuration, then the sum of the effect sizes of individual properties should be smaller than their combined effects. That is not what we found: instead, on three measures of visual behavior, the summed effects of individual properties equaled (or exceeded) that of chasing. Moreover, although attraction drew little attention and turning no attention at all, acceleration drew (nearly) as much attention as chasing. Our results thus provide evidence that infants preferred chasing because of its features, not its configuration.

Statistical learning across development: flexible yet constrained

Much research in the past two decades has documented infants' and adults' ability to extract statistical regularities from auditory input. Importantly, recent research has extended these findings to the visual domain, demonstrating learners' sensitivity to statistical patterns within visual arrays and sequences of shapes. In this review we discuss both auditory and visual statistical learning to elucidate both the generality of and constraints on statistical learning. The review first outlines the major findings of the statistical learning literature with infants, followed by discussion of statistical learning across domains, modalities, and development. The second part of this review considers constraints on statistical learning. The discussion focuses on two categories of constraint: constraints on the types of input over which statistical learning operates and constraints based on the state of the learner. The review concludes with a discussion of possible mechanisms underlying statistical learning.

Oculomotor Exploration of Impossible Figures in Early Infancy

Previous studies with young infants revealed that young infants can distinguish between displays of possible or impossible figures, which may require detection of inconsistent depth relations among local line junctions that disrupt global object configurations. Here, we used an eye-tracking paradigm to record eye movements in young infants during an object discrimination task with matched pairs of possible and impossible figures. Our goal was to identify differential patterns of oculomotor activity as infants viewed pictures of possible and impossible objects. We predicted that infants would actively attend to specific pictorial depth cues that denote shape (e.g., T-junctions), and in the context of an impossible figure that they would fixate to a greater extent in anomalous regions of the display relative to other parts. By the age of 4 months, infants fixated reliably longer overall on displays of impossible vs. possible cubes, specifically within the critical region where the incompatible lines and irreconcilable depth relations were located, implying an early capacity for selective attention to critical line junction information and integration of local depth cues necessary to perceive object coherence.

Simulating the role of visual selective attention during the development of perceptual completion

We recently proposed a multi-channel, image-filtering model for simulating the development of visual selective attention in young infants (Schlesinger, Amso & Johnson, 2007). The model not only captures the performance of 3-month-olds on a visual search task, but also implicates two cortical regions that may play a role in the development of visual selective attention. In the current simulation study, we used the same model to simulate 3-month-olds' performance on a second measure, the perceptual unity task. Two parameters in the model - corresponding to areas in the occipital and parietal cortices - were systematically varied while the gaze patterns produced by the model were recorded and subsequently analyzed. Three key findings emerged from the simulation study. First, the model successfully replicated the performance of 3-month-olds on the unity perception task. Second, the model also helps to explain the improved performance of 2-month-olds when the size of the occluder in the unity perception task is reduced. Third, in contrast to our previous simulation results, variation in only one of the two cortical regions simulated (i.e. recurrent activity in posterior parietal cortex) resulted in a performance pattern that matched 3-month-olds. These findings provide additional support for our hypothesis that the development of perceptual completion in early infancy is promoted by progressive improvements in visual selective attention and oculomotor skill.