Sensitivity to auditory-tactile colocation in early infancy

Keeping up with ourselves: Multimodal processes underlying body ownership across the lifespan

The sense of a bodily self is thought to depend on adaptive weighting and integration of bodily afferents and prior beliefs. While the physical body changes in shape, size, and functionality across the lifespan, the sense of body ownership remains relatively stable. Yet, little is known about how multimodal integration underlying such sense of ownership is altered in ontogenetic periods of substantial physical changes. We aimed to study this link for the motor and the tactile domain in a mixed-realty paradigm where participants ranging from 7 to 80 years old saw their own body with temporally mismatching multimodal signals. Participants were either stroked on their hand or moved it, while they saw it in multiple trials with different visual delays. For each trial, they judged the visuo-motor/tactile synchrony and rated the sense of ownership for the seen hand. Visual dependence and proprioceptive acuity were additionally assessed. The results show that across the lifespan body ownership decreases with increasing temporal multisensory mismatch, both in the tactile and the motor domain. We found an increased sense of ownership with increasing age independent of delay and modality. Delay sensitivity during multisensory conflicts was not consistently related to age. No effects of age were found on visual dependence or proprioceptive accuracy. The results are at least partly in line with an enhanced weighting of top-down and a reduced weighting of bottom-up signals for the momentary sense of bodily self with increasing age.

Perception of visual and audiovisual trajectories toward and away from the body in the first postnatal year

Perceiving motion in depth is important in everyday life, especially motion in relation to the body. Visual and auditory cues inform us about motion in space when presented in isolation from each other, but the most comprehensive information is obtained through the combination of both of these cues. We traced the development of infants' ability to discriminate between visual motion trajectories across peripersonal space and to match these with auditory cues specifying the same peripersonal motion. We measured 5-month-old (n = 20) and 9-month-old (n = 20) infants' visual preferences for visual motion toward or away from their body (presented simultaneously and side by side) across three conditions: (a) visual displays presented alone, (b) paired with a sound increasing in intensity, and (c) paired with a sound decreasing in intensity. Both groups preferred approaching motion in the visual-only condition. When the visual displays were paired with a sound increasing in intensity, neither group showed a visual preference. When a sound decreasing in intensity was played instead, the 5-month-olds preferred the receding (spatiotemporally congruent) visual stimulus, whereas the 9-month-olds preferred the approaching (spatiotemporally incongruent) visual stimulus. We speculate that in the approaching sound condition, the behavioral salience of the sound could have led infants to focus on the auditory information alone, in order to prepare a motor response, and to neglect the visual stimuli. In the receding sound condition, instead, the difference in response patterns in the two groups may have been driven by infants' emerging motor abilities and their developing predictive processing mechanisms supporting and influencing each other.

Visual objects approaching the body modulate subsequent somatosensory processing at 4 months of age

We asked whether, in the first year of life, the infant brain can support the dynamic crossmodal interactions between vision and somatosensation that are required to represent peripersonal space. Infants aged 4 (n = 20, 9 female) and 8 (n = 20, 10 female) months were presented with a visual object that moved towards their body or receded away from it. This was presented in the bottom half of the screen and not fixated upon by the infants, who were instead focusing on an attention getter at the top of the screen. The visual moving object then disappeared and was followed by a vibrotactile stimulus occurring later in time and in a different location in space (on their hands). The 4-month-olds' somatosensory evoked potentials (SEPs) were enhanced when tactile stimuli were preceded by unattended approaching visual motion, demonstrating that the dynamic visual-somatosensory cortical interactions underpinning representations of the body and peripersonal space begin early in the first year of life. Within the 8-month-olds' sample, SEPs were increasingly enhanced by (unexpected) tactile stimuli following receding visual motion as age in days increased, demonstrating changes in the neural underpinnings of the representations of peripersonal space across the first year of life.

Cortical signatures of visual body representation develop in human infancy

Human infants cannot report their experiences, limiting what we can learn about their bodily awareness. However, visual cortical responses to the body, linked to visual awareness and selective attention in adults, can be easily measured in infants and provide a promising marker of bodily awareness in early life. We presented 4- and 8-month-old infants with a flickering (7.5 Hz) video of a hand being stroked and recorded steady-state visual evoked potentials (SSVEPs). In half of the trials, the infants also received tactile stroking synchronously with visual stroking. The 8-month-old, but not the 4-month-old infants, showed a significant enhancement of SSVEP responses when they received tactile stimulation concurrent with the visually observed stroking. Follow-up experiments showed that this enhancement did not occur when the visual hand was presented in an incompatible posture with the infant's own body or when the visual stimulus was a body-irrelevant video. Our findings provide a novel insight into the development of bodily self-awareness in the first year of life.

Clinical assessment of the TechArm system on visually impaired and blind children during uni- and multi-sensory perception tasks

We developed the TechArm system as a novel technological tool intended for visual rehabilitation settings. The system is designed to provide a quantitative assessment of the stage of development of perceptual and functional skills that are normally vision-dependent, and to be integrated in customized training protocols. Indeed, the system can provide uni- and multisensory stimulation, allowing visually impaired people to train their capability of correctly interpreting non-visual cues from the environment. Importantly, the TechArm is suitable to be used by very young children, when the rehabilitative potential is maximal. In the present work, we validated the TechArm system on a pediatric population of low-vision, blind, and sighted children. In particular, four TechArm units were used to deliver uni- (audio or tactile) or multi-sensory stimulation (audio-tactile) on the participant's arm, and subject was asked to evaluate the number of active units. Results showed no significant difference among groups (normal or impaired vision). Overall, we observed the best performance in tactile condition, while auditory accuracy was around chance level. Also, we found that the audio-tactile condition is better than the audio condition alone, suggesting that multisensory stimulation is beneficial when perceptual accuracy and precision are low. Interestingly, we observed that for low-vision children the accuracy in audio condition improved proportionally to the severity of the visual impairment. Our findings confirmed the TechArm system's effectiveness in assessing perceptual competencies in sighted and visually impaired children, and its potential to be used to develop personalized rehabilitation programs for people with visual and sensory impairments.

Multisensory spatial perception in visually impaired infants

Congenitally blind infants are not only deprived of visual input but also of visual influences on the intact senses. The important role that vision plays in the early development of multisensory spatial perception1, 2, 3, 4, 5, 6, 7 (e.g., in crossmodal calibration8, 9, 10 and in the formation of multisensory spatial representations of the body and the world^1,2) raises the possibility that impairments in spatial perception are at the heart of the wide range of difficulties that visually impaired infants show across spatial,8, 9, 10, 11, 12 motor,13, 14, 15, 16, 17 and social domains.^8,18,19 But investigations of early development are needed to clarify how visually impaired infants’ spatial hearing and touch support their emerging ability to make sense of their body and the outside world. We compared sighted (S) and severely visually impaired (SVI) infants’ responses to auditory and tactile stimuli presented on their hands. No statistically reliable differences in the direction or latency of responses to auditory stimuli emerged, but significant group differences emerged in responses to tactile and audiotactile stimuli. The visually impaired infants showed attenuated audiotactile spatial integration and interference, weighted more tactile than auditory cues when the two were presented in conflict, and showed a more limited influence of representations of the external layout of the body on tactile spatial perception.²⁰ These findings uncover a distinct phenotype of multisensory spatial perception in early postnatal visual deprivation. Importantly, evidence of audiotactile spatial integration in visually impaired infants, albeit to a lesser degree than in sighted infants, signals the potential of multisensory rehabilitation methods in early development.

Video abstract

•

Visually impaired infants have a distinct phenotype of audiotactile perception

•

Infants with severe visual impairment (SVI) place more weight on tactile locations

•

SVI infants show attenuated audiotactile spatial integration and interference

•

SVI infants do not show an influence of body representations on tactile space

Exploring developmental changes in infant anticipation and perceptual processing: EEG responses to tactile stimulation

There is an increasing interest in alpha-range rhythms in the electroencephalogram (EEG) in relation to perceptual and attentional processes. The infant mu rhythm has been extensively studied in the context of linkages between action observation and action production in infancy, but less is known about the mu rhythm in relation to cross-modal processes involving somatosensation. We investigated differences in mu responses to cued vibrotactile stimulation of the hand in two age groups of infants: From 6 to 7 months and 13 to 14 months. We were also interested in anticipatory neural responses in the alpha frequency range prior to tactile stimulation. Tactile stimulation of infants' left or right hand was preceded by an audiovisual cue signaling which hand would be stimulated. In response to the tactile stimulus, infants demonstrated significant mu desynchronization over the central areas contralateral to the hand stimulated, with higher mu peak frequency and greater contralateral mu desynchronization for older infants. Prior to the tactile stimulus, both age groups showed significant bilateral alpha desynchronization over frontocentral sites, which may be indicative of generalized anticipation of an upcoming stimulus. The findings highlight the potential of examining the sensorimotor mu rhythm in the context of infant attentional development.

Sensitivity to Visual-Tactile Colocation on the Body Prior to Skilled Reaching in Early Infancy

Two experiments examined perceptual colocation of visual and tactile stimuli in young infants. Experiment 1 compared 4- (n = 15) and 6-month-old (n = 12) infants' visual preferences for visual-tactile stimulus pairs presented across the same or different feet. The 4- and 6-month-olds showed, respectively, preferences for colocated and noncolocated conditions, demonstrating sensitivity to visual-tactile colocation on their feet. This extends previous findings of visual-tactile perceptual colocation on the hands in older infants. Control conditions excluded the possibility that both 6- (Experiment 1), and 4-month-olds (Experiment 2, n = 12) perceived colocation on the basis of an undifferentiated supramodal coding of spatial distance between stimuli. Bimodal perception of visual-tactile colocation is available by 4 months of age, that is, prior to the development of skilled reaching.

Neonatal Multisensory Processing in Preterm and Term Infants Predicts Sensory Reactivity and Internalizing Tendencies in Early Childhood

Multisensory processes include the capacity to combine information from the different senses, often improving stimulus representations and behavior. The extent to which multisensory processes are an innate capacity or instead require experience with environmental stimuli remains debated. We addressed this knowledge gap by studying multisensory processes in prematurely born and full-term infants. We recorded 128-channel event-related potentials (ERPs) from a cohort of 55 full-term and 61 preterm neonates (at an equivalent gestational age) in response to auditory, somatosensory, and combined auditory-somatosensory multisensory stimuli. Data were analyzed within an electrical neuroimaging framework, involving unsupervised topographic clustering of the ERP data. Multisensory processing in full-term infants was characterized by a simple linear summation of responses to auditory and somatosensory stimuli alone, which furthermore shared common ERP topographic features. We refer to the ERP topography observed in full-term infants as "typical infantile processing" (TIP). In stark contrast, preterm infants exhibited non-linear responses and topographies less-often characterized by TIP; there were distinct patterns of ERP topographies to multisensory and summed unisensory conditions. We further observed that the better TIP characterized an infant's ERPs, independently of prematurity, the more typical was the score on the Infant/Toddler Sensory Profile (ITSP) at 12 months of age and the less likely was the child to the show internalizing tendencies at 24 months of age. Collectively, these results highlight striking differences in the brain's responses to multisensory stimuli in children born prematurely; differences that relate to later sensory and internalizing functions.

The Developing Bodily Self: How Posture Constrains Body Representation in Childhood

Adults' body representation is constrained by multisensory information and knowledge of the body such as its possible postures. This study (N = 180) tested for similar constraints in children. Using the rubber hand illusion with adults and 6- to 7-year olds, we measured proprioceptive drift (an index of hand localization) and ratings of felt hand ownership. The fake hand was either congruent or incongruent with the participant's own. Across ages, congruency of posture and visual-tactile congruency yielded greater drift toward the fake hand. Ownership ratings were higher with congruent visual-tactile information, but unaffected by posture. Posture constrains body representation similarly in children and adults, suggesting that children have sensitive, robust mechanisms for maintaining a sense of bodily self.