Merging familiar and new senses to perceive and act in space

Our experience of the world seems to unfold seamlessly in a unitary 3D space. For this to be possible, the brain has to merge many disparate cognitive representations and sensory inputs. How does it do so? I discuss work on two key combination problems: coordinating multiple frames of reference (e.g. egocentric and allocentric), and coordinating multiple sensory signals (e.g. visual and proprioceptive). I focus on two populations whose spatial processing we can observe at a crucial stage of being configured and optimised: children, whose spatial abilities are still developing significantly, and naïve adults learning new spatial skills, such as sensing distance using auditory cues. The work uses a model-based approach to compare participants’ behaviour with the predictions of alternative information processing models. This lets us see when and how—during development, and with experience—the perceptual-cognitive computations underpinning our experiences in space change. I discuss progress on understanding the limits of effective spatial computation for perception and action, and how lessons from the developing spatial cognitive system can inform approaches to augmenting human abilities with new sensory signals provided by technology.

Different neural processes underlie visual speech perception in school-age children and adults: An event-related potentials study

The ability to use visual speech cues does not fully develop until late adolescence. The cognitive and neural processes underlying this slow maturation are not yet understood. We examined electrophysiological responses of younger (8-9 years) and older (11-12 years) children as well as adults elicited by visually perceived articulations in an audiovisual word matching task and related them to the amount of benefit gained during a speech-in-noise (SIN) perception task when seeing the talker's face. On each trial, participants first heard a word and, after a short pause, saw a speaker silently articulate a word. In half of the trials the articulated word matched the auditory word (congruent trials), whereas in the other half it did not (incongruent trials). In all three age groups, incongruent articulations elicited the N400 component and congruent articulations elicited the late positive complex (LPC). Groups did not differ in the mean amplitude of N400. The mean amplitude of LPC was larger in younger children compared with older children and adults. Importantly, the relationship between event-related potential measures and SIN performance varied by group. In 8- and 9-year-olds, neither component was predictive of SIN gain. The LPC amplitude predicted the SIN gain in older children but not in adults. Conversely, the N400 amplitude predicted the SIN gain in adults. We argue that although all groups were able to detect correspondences between auditory and visual word onsets at the phonemic/syllabic level, only adults could use this information for lexical access.

Multisensory factors in postural control: Varieties of visual and haptic effects

Background Previous work on balance control in children and adults highlights the importance of multisensory information. Work in this vein has examined two principal input sources - the role of visual and haptic information on balance. Recent work has explored the impact of a different form of haptic input - object holding - on balance in young infants. Research question This experiment examined the impact of simultaneous visual input and haptic input on balance in children and adults, employing two novel forms of haptic input. Methods Static balance was measured in 3-5 year olds, 7-9 year olds, and young adults, in the presence of all possible combinations of manipulated visual input (eyes open, eyes closed) and haptic input (no touch, object hold, touch an unstable support, touch a stable support). Results Analysis of postural stability (mean velocity) indicated that stability was influenced by visual input, haptic input, and age group. For visual input stability increased in eyes open versus eyes closed conditions. For haptic input, stability systematically increased with increasing levels of fixed haptic input (e.g., no touch, object hold, unstable touch, stable touch). Stability also increased as a function of increasing age group. There were no interactions between the factors. Significance The finding that the two novel forms of haptic input - object hold and touch with an unstable support surface - increased stability relative to no touch input, but not as much as touch with a stable support, indicates that children use haptic information in a self-referential fashion for controlling posture. The failure to observe any interactions between visual and haptic inputs with age suggests that multisensory processing is generally additive across development, and has implications for the occurrence of sensory weighting across developmental epochs.

Cortical signatures of vicarious tactile experience in four-month-old infants

The human brain recruits similar brain regions when a state is experienced (e.g., touch, pain, actions) and when that state is passively observed in other individuals. In adults, seeing other people being touched activates similar brain areas as when we experience touch ourselves. Here we show that already by four months of age, cortical responses to tactile stimulation are modulated by visual information specifying another person being touched. We recorded somatosensory evoked potentials (SEPs) in 4-month-old infants while they were presented with brief vibrotactile stimuli to the hands. At the same time that the tactile stimuli were presented the infants observed another person's hand being touched by a soft paintbrush or approached by the paintbrush which then touched the surface next to their hand. A prominent positive peak in SEPs contralateral to the site of tactile stimulation around 130 ms after the tactile stimulus onset was of a significantly larger amplitude for the "Surface" trials than for the "Hand" trials. These findings indicate that, even at four months of age, somatosensory cortex is not only involved in the personal experience of touch but can also be vicariously recruited by seeing other people being touched.

The Development of Tactile Perception

Touch is the first of our senses to develop, providing us with the sensory scaffold on which we come to perceive our own bodies and our sense of self. Touch also provides us with direct access to the external world of physical objects, via haptic exploration. Furthermore, a recent area of interest in tactile research across studies of developing children and adults is its social function, mediating interpersonal bonding. Although there are a range of demonstrations of early competence with touch, particularly in the domain of haptics, the review presented here indicates that many of the tactile perceptual skills that we take for granted as adults (e.g., perceiving touches in the external world as well as on the body) take some time to develop in the first months of postnatal life, likely as a result of an extended process of connection with other sense modalities which provide new kinds of information from birth (e.g., vision and audition). Here, we argue that because touch is of such fundamental importance across a wide range of social and cognitive domains, it should be placed much more centrally in the study of early perceptual development than it currently is.

Tactile localization performance in children with developmental coordination disorder (DCD) corresponds to their motor skill and not their cognitive ability

When localizing touches to the hands, typically developing children and adults show a "crossed hands effect" whereby identifying which hand received a tactile stimulus is less accurate when the hands are crossed than uncrossed. This demonstrates the use of an external frame of reference for locating touches to one's own body. Given that studies indicate that developmental vision plays a role in the emergence of external representations of touch, and reliance on vision for representing the body during action is atypical in developmental coordination disorder (DCD), we investigated external spatial representations of touch in children with DCD using the "crossed hands effect". Nineteen children with DCD aged 7-11years completed a tactile localization task in which posture (uncrossed, crossed) and view (hands seen, unseen) were varied systematically. Their performance was compared to that of 35 typically developing controls (19 of a similar age and cognitive ability, and 16 of a younger age but similar fine motor ability). Like controls, the DCD group exhibited a crossed hands effect, whilst their overall tactile localization performance was weaker than their peers of similar age and cognitive ability, but in line with younger controls of similar motor ability. For children with movement difficulties, these findings indicate tactile localization impairments in relation to age expectations, but apparently typical use of an external reference frame for localizing touch.