Spatial auditory attention is modulated by tactile priming

The maturation of the P1m component in response to voice from infancy to 3 years of age: A longitudinal study in young children

INTRODUCTION

In the early development of human infants and toddlers, remarkable changes in brain cortical function for auditory processing have been reported. Knowing the maturational trajectory of auditory cortex responses to human voice in typically developing young children is crucial for identifying voice processing abnormalities in children at risk for neurodevelopmental disorders and language impairment. An early prominent positive component in the cerebral auditory response in newborns has been reported in previous electroencephalography and magnetoencephalography (MEG) studies. However, it is not clear whether this prominent component in infants less than 1 year of age corresponds to the auditory P1m component that has been reported in young children over 2 years of age.

METHODS

To test the hypothesis that the early prominent positive component in infants aged 0 years is an immature manifestation of P1m that we previously reported in children over 2 years of age, we performed a longitudinal MEG study that focused on this early component and examined the maturational changes over three years starting from age 0. Five infants participated in this 3-year longitudinal study.

RESULTS

This research revealed that the early prominent component in infants aged 3 month corresponded to the auditory P1m component in young children over 2 years old, which we had previously reported to be related to language development and/or autism spectrum disorders.

CONCLUSION

Our data revealed the development of the auditory-evoked field in the left and right hemispheres from 0- to 3-year-old children. These results contribute to the elucidation of the development of brain functions in infants.

Causal Inference for Cross-Modal Action Selection: A Computational Study in a Decision Making Framework

Animals try to make sense of sensory information from multiple modalities by categorizing them into perceptions of individual or multiple external objects or internal concepts. For example, the brain constructs sensory, spatial representations of the locations of visual and auditory stimuli in the visual and auditory cortices based on retinal and cochlear stimulations. Currently, it is not known how the brain compares the temporal and spatial features of these sensory representations to decide whether they originate from the same or separate sources in space. Here, we propose a computational model of how the brain might solve such a task. We reduce the visual and auditory information to time-varying, finite-dimensional signals. We introduce controlled, leaky integrators as working memory that retains the sensory information for the limited time-course of task implementation. We propose our model within an evidence-based, decision-making framework, where the alternative plan units are saliency maps of space. A spatiotemporal similarity measure, computed directly from the unimodal signals, is suggested as the criterion to infer common or separate causes. We provide simulations that (1) validate our model against behavioral, experimental results in tasks where the participants were asked to report common or separate causes for cross-modal stimuli presented with arbitrary spatial and temporal disparities. (2) Predict the behavior in novel experiments where stimuli have different combinations of spatial, temporal, and reliability features. (3) Illustrate the dynamics of the proposed internal system. These results confirm our spatiotemporal similarity measure as a viable criterion for causal inference, and our decision-making framework as a viable mechanism for target selection, which may be used by the brain in cross-modal situations. Further, we suggest that a similar approach can be extended to other cognitive problems where working memory is a limiting factor, such as target selection among higher numbers of stimuli and selections among other modality combinations.

Emotional valence and spatial congruency differentially modulate crossmodal processing: an fMRI study

Salient exogenous stimuli modulate attentional processes and lead to attention shifts-even across modalities and at a pre-attentive level. Stimulus properties such as hemispheric laterality and emotional valence influence processing, but their specific interaction in audio-visual attention paradigms remains ambiguous. We conducted an fMRI experiment to investigate the interaction of supramodal spatial congruency, emotional salience, and stimulus presentation side on neural processes of attention modulation. Emotionally neutral auditory deviants were presented in a dichotic listening oddball design. Simultaneously, visual target stimuli (schematic faces) were presented, which displayed either a negative or a positive emotion. These targets were presented in the left or in the right visual field and were either spatially congruent (valid) or incongruent (invalid) with the concurrent deviant auditory stimuli. According to our expectation we observed that deviant stimuli serve as attention-directing cues for visual target stimuli. Region-of-interest (ROI) analyses suggested differential effects of stimulus valence and spatial presentation on the hemodynamic response in bilateral auditory cortices. These results underline the importance of valence and presentation side for attention guidance by deviant sound events and may hint at a hemispheric specialization for valence and attention processing.

Effectively responding to tactile stimulation: do homologous cue and effector locations really matter?

We report a study designed to investigate the extent to which speeded behavioral responses following tactile stimulation are influenced by differences in neural conduction latencies at different body sites and/or by the characteristics of the compatibility between the cue and effector. The results showed that it may not be particularly desirable to present tactile cues (e.g., warning signals) to an interface operator's feet if a speeded foot response is required, for even though such an arrangement maximizes the set-level compatibility between the stimulus and the response, it turns out that response latencies are primarily determined by conduction latencies through the peripheral nervous system.

Tactile stimulation and hemispheric asymmetries modulate auditory perception and neural responses in primary auditory cortex

Although multisensory integration has been an important area of recent research, most studies focused on audiovisual integration. Importantly, however, the combination of audition and touch can guide our behavior as effectively which we studied here using psychophysics and functional magnetic resonance imaging (fMRI). We tested whether task-irrelevant tactile stimuli would enhance auditory detection, and whether hemispheric asymmetries would modulate these audiotactile benefits using lateralized sounds. Spatially aligned task-irrelevant tactile stimuli could occur either synchronously or asynchronously with the sounds. Auditory detection was enhanced by non-informative synchronous and asynchronous tactile stimuli, if presented on the left side. Elevated fMRI-signals to left-sided synchronous bimodal stimulation were found in primary auditory cortex (A1). Adjacent regions (planum temporale, PT) expressed enhanced BOLD-responses for synchronous and asynchronous left-sided bimodal conditions. Additional connectivity analyses seeded in right-hemispheric A1 and PT for both bimodal conditions showed enhanced connectivity with right-hemispheric thalamic, somatosensory and multisensory areas that scaled with subjects' performance. Our results indicate that functional asymmetries interact with audiotactile interplay which can be observed for left-lateralized stimulation in the right hemisphere. There, audiotactile interplay recruits a functional network of unisensory cortices, and the strength of these functional network connections is directly related to subjects' perceptual sensitivity.

Olfactory priming leads to faster sound localization

Cross-modal interactions between vision, audition and touch have been extensively studied in the last decade. However, our understanding of how the chemical senses interact with other sensory modalities remains relatively scarce. We performed a cued auditory localization paradigm in healthy young adults by measuring reaction times to monaural auditory stimuli after subjects had been cued by unilateral olfactory stimuli, mixed olfactory/trigeminal stimuli or somatosensory stimuli. As expected, all cuing conditions led to enhanced performances in auditory localization. Further, both odors led to significantly shorter reaction times when compared to the somatosensory stimuli. We did not observe any effect of side-congruency between the cues and the targets. These results suggest facilitative effects of odorous cues independent of a possible trigeminal component in the interaction between olfaction and audition.

Audiotactile interactions in front and rear space

The last few years have seen a growing interest in the assessment of audiotactile interactions in information processing in peripersonal space. In particular, these studies have focused on investigating peri-hand space [corrected] and, more recently, on the functional differences that have been demonstrated between the space close to front and back of the head (i.e., the peri-head space). In this review, the issue of how audiotactile interactions vary as a function of the region of space in which stimuli are presented (i.e., front vs. rear, peripersonal vs. extra-personal) will be described. We review evidence from both monkey and human studies. This evidence, providing insight into the differential attributes qualifying the frontal and the rear regions of space, sheds light on an until now neglected research topic and may help to contribute to the formulation of new rehabilitative approaches to disorders of spatial representation. A tentative explanation of the evolutionary reasons underlying these particular patterns of results, as well as suggestions for possible future developments, are also provided.

Tactile and visual distractors induce change blindness for tactile stimuli presented on the fingertips

Recent studies of change detection have revealed that people are surprisingly poor at detecting changes between two consecutively-presented scenes, when they are separated by a distractor that masks the transients typically associated with change. This failure, known as 'change blindness', has been reported within vision, audition, and touch. In the three experiments reported here, we investigated people's ability to detect the change between two patterns of tactile stimuli presented to their fingertips. The two to-be-compared patterns were presented either consecutively, separated by an empty interval or else by a tactile, visual, or auditory mask. Participants' performance was impaired when an empty interval was inserted between the two consecutively-presented patterns as compared with the consecutive stimulus presentation. Participants' performance was further impaired not only when a tactile mask was introduced between the two to-be-compared displays, but also when a visual mask was used instead. Interestingly, however, the addition of an auditory mask to an empty interval did not have any effect on participants' performance. These results are discussed in relation to the multisensory/amodal nature of spatial attention.

Auditory-somatosensory multisensory interactions in front and rear space

The information conveyed by our senses can be combined to facilitate perception and behaviour. One focus of recent research has been on the factors governing such facilitatory multisensory interactions. The spatial register of neuronal receptive fields (RFs) appears to be a prerequisite for multisensory enhancement. In terms of auditory-somatosensory (AS) interactions, facilitatory effects on simple reaction times and on brain responses have been demonstrated in caudo-medial auditory cortices, both when auditory and somatosensory stimuli are presented to the same spatial location and also when they are separated by 100 degrees in frontal space. One implication is that these brain regions contain large spatial RFs. The present study further investigated this possibility and, in particular, the question of whether AS interactions are restricted to frontal space, since recent research has revealed some fundamental differences between the sensory processing of stimuli in front and rear space. Twelve participants performed a simple reaction time task to auditory, somatosensory, or simultaneous auditory-somatosensory stimuli. The participants placed one of their arms in front of them and the other behind their backs. Loudspeakers were placed close to each hand. Thus, there were a total of eight stimulus conditions - four unisensory and four multisensory - including all possible combinations of posture and loudspeaker location. A significant facilitation of reaction times (RTs), exceeding that predicted by probability summation, was obtained following multisensory stimulation, irrespective of whether the stimuli were in spatial register or not. These results are interpreted in terms of the likely RF organization of previously identified auditory-somatosensory brain regions.

Adaptation to audiotactile asynchrony

Previous research has revealed the existence of perceptual mechanisms that compensate for slight temporal asynchronies between auditory and visual signals. We investigated whether temporal recalibration would also occur between auditory and tactile stimuli. Participants were exposed to streams of brief auditory and tactile stimuli presented in synchrony, or else with the auditory stimulus leading by 75ms. After the exposure phase, the participants made temporal order judgments regarding pairs of auditory and tactile events occurring at varying stimulus onset asynchronies. The results showed that the minimal interval necessary to correctly resolve audiotactile temporal order was larger after exposure to the desynchronized streams than after exposure to the synchronous streams. This suggests the existence of a mechanism to compensate for audiotactile asynchronies that results in a widening of the temporal window for multisensory integration.

Sequential audiovisual interactions during speech perception: A whole-head MEG study

Using whole-head magnetoencephalography (MEG), audiovisual (AV) interactions during speech perception (/ta/- and /pa/-syllables) were investigated in 20 subjects. Congruent AV events served as the 'standards' of an oddball design. The deviants encompassed incongruent /ta/-/pa/ configurations differing from the standards either in the acoustic or the visual domain. As an auditory non-speech control condition, the same video signals were synchronized with either one of two complex tones. As in natural speech, visual movement onset preceded acoustic signals by about 150 ms. First, the impact of visual information on auditorily evoked fields to non-speech sounds was determined. Larger facial movements (/pa/ versus /ta/) yielded enhanced early responses such as the M100 component, indicating, most presumably, anticipatory pre-activation of auditory cortex by visual motion cues. As a second step of analysis, mismatch fields (MMF) were calculated. Acoustic deviants elicited a typical MMF, peaking ca. 180 ms after stimulus onset, whereas visual deviants gave rise to later responses (220 ms) of a more posterior-medial source location. Finally, a late (275 ms), left-lateralized visually-induced MMF component, resembling the acoustic mismatch response, emerged during the speech condition, presumably reflecting phonetic/linguistic operations. There is mounting functional imaging evidence for an early impact of visual information on auditory cortical regions during speech perception. The present study suggests at least two successive AV interactions in association with syllable recognition tasks: early activation of auditory areas depending upon visual motion cues and a later speech-specific left-lateralized response mediated, conceivably, by backward-projections from multisensory areas.

Selective influences of cross-modal spatial-cues on preattentive auditory processing: a whole-head magnetoencephalography study

The processing streams of the various sensory modalities are known to interact within the central nervous system. These interactions differ depending on the level of stimulus representation and attention. The current study focused on cross-sensory influences on stimulus change detection during unattended auditory processing. We employed an oddball paradigm to assess cortical processing using whole-head magnetoencephalography (MEG) in 20 volunteers. While subjects performed distraction tasks of varying difficulties, auditory duration deviants were applied randomly to the left or the right ear preceded (200-400 ms) by oculomotor, static visual, or flow field co-stimulation at either side. Mismatch fields were recorded over both hemispheres. Changes in gaze direction and static visual stimuli elicited the most reliable enhancement of deviance detection at the same side (most prominent at the right auditory cortex). Under both conditions, the lateralized unattended and unpredictive pre-cues acted analogously to shifts in selective attention, but were not reduced by attentional load. Thus, the early cognitive representation of sounds seems to reflect automatic cross-modal interference. Preattentive multisensory integration may provide the neuronal basis for orienting reactions to objects in space and thus for voluntary control of selective attention.