Dependence of auditory spatial updating on vestibular, proprioceptive, and efference copy signals

Motor Strategies: The Role of Active Behavior in Spatial Hearing Research

When completing a task, the ability to implement behavioral strategies to solve it in an effective and cognitively less-demanding way is extremely adaptive for humans. This behavior makes it possible to accumulate evidence and test one's own predictions about the external world. In this work, starting from examples in the field of spatial hearing research, I analyze the importance of considering motor strategies in perceptual tasks, and I stress the urgent need to create ecological experimental settings, which are essential in allowing the implementation of such behaviors and in measuring them. In particular, I will consider head movements as an example of strategic behavior implemented to solve acoustic space-perception tasks.

Superior semicircular canal dehiscence and subsequent closure induces reversible impaired decision-making

Background

Vestibular loss and dysfunction has been associated with cognitive deficits, decreased spatial navigation, spatial memory, visuospatial ability, attention, executive function, and processing speed among others. Superior semicircular canal dehiscence (SSCD) is a vestibular-cochlear disorder in humans in which a pathological third mobile window of the otic capsule creates changes to the flow of sound pressure energy through the perilymph/endolymph. The primary symptoms include sound-induced dizziness/vertigo, inner ear conductive hearing loss, autophony, headaches, and visual problems; however, individuals also experience measurable deficits in basic decision-making, short-term memory, concentration, spatial cognition, and depression. These suggest central mechanisms of impairment are associated with vestibular disorders; therefore, we directly tested this hypothesis using both an auditory and visual decision-making task of varying difficulty levels in our model of SSCD.

Methods

Adult Mongolian gerbils (n = 33) were trained on one of four versions of a Go-NoGo stimulus presentation rate discrimination task that included standard ("easy") or more difficult ("hard") auditory and visual stimuli. After 10 days of training, preoperative ABR and c+VEMP testing was followed by a surgical fenestration of the left superior semicircular canal. Animals with persistent circling or head tilt were excluded to minimize effects from acute vestibular injury. Testing recommenced at postoperative day 5 and continued through postoperative day 15 at which point final ABR and c+VEMP testing was carried out.

Results

Behavioral data (d-primes) were compared between preoperative performance (training day 8-10) and postoperative days 6-8 and 13-15. Behavioral performance was measured during the peak of SSCD induced ABR and c + VEMP impairment and the return towards baseline as the dehiscence began to resurface by osteoneogenesis. There were significant differences in behavioral performance (d-prime) and its behavioral components (Hits, Misses, False Alarms, and Correct Rejections). These changes were highly correlated with persistent deficits in c + VEMPs at the end of training (postoperative day 15). The controls demonstrated additional learning post procedure that was absent in the SSCD group.

Conclusion

These results suggest that aberrant asymmetric vestibular output results in decision-making impairments in these discrimination tasks and could be associated with the other cognitive impairments resulting from vestibular dysfunction.

Multisensory decisions from self to world

Classic Bayesian models of perceptual inference describe how an ideal observer would integrate 'unisensory' measurements (multisensory integration) and attribute sensory signals to their origin(s) (causal inference). However, in the brain, sensory signals are always received in the context of a multisensory bodily state-namely, in combination with other senses. Moreover, sensory signals from both interoceptive sensing of one's own body and exteroceptive sensing of the world are highly interdependent and never occur in isolation. Thus, the observer must fundamentally determine whether each sensory observation is from an external (versus internal, self-generated) source to even be considered for integration. Critically, solving this primary causal inference problem requires knowledge of multisensory and sensorimotor dependencies. Thus, multisensory processing is needed to separate sensory signals. These multisensory processes enable us to simultaneously form a sense of self and form distinct perceptual decisions about the external world. In this opinion paper, we review and discuss the similarities and distinctions between multisensory decisions underlying the sense of self and those directed at acquiring information about the world. We call attention to the fact that heterogeneous multisensory processes take place all along the neural hierarchy (even in forming 'unisensory' observations) and argue that more integration of these aspects, in theory and experiment, is required to obtain a more comprehensive understanding of multisensory brain function. This article is part of the theme issue 'Decision and control processes in multisensory perception'.

Predictive steering: integration of artificial motor signals in self-motion estimation

The brain's computations for active and passive self-motion estimation can be unified with a single model that optimally combines vestibular and visual signals with sensory predictions based on efference copies. It is unknown whether this theoretical framework also applies to the integration of artificial motor signals, such as those that occur when driving a car, or whether self-motion estimation in this situation relies on sole feedback control. Here, we examined if training humans to control a self-motion platform leads to the construction of an accurate internal model of the mapping between the steering movement and the vestibular reafference. Participants (n = 15) sat on a linear motion platform and actively controlled the platform's velocity using a steering wheel to translate their body to a memorized visual target (motion condition). We compared their steering behavior to that of participants (n = 15) who remained stationary and instead aligned a nonvisible line with the target (stationary condition). To probe learning, the gain between the steering wheel angle and the platform or line velocity changed abruptly twice during the experiment. These gain changes were virtually undetectable in the displacement error in the motion condition, whereas clear deviations were observed in the stationary condition, showing that participants in the motion condition made within-trial changes to their steering behavior. We conclude that vestibular feedback allows not only the online control of steering but also a rapid adaptation to the gain changes to update the brain's internal model of the mapping between the steering movement and the vestibular reafference.NEW & NOTEWORTHY Perception of self-motion is known to depend on the integration of sensory signals and, when the motion is self-generated, the predicted sensory reafference based on motor efference copies. Here we show, using a closed-loop steering experiment with a direct coupling between the steering movement and the vestibular self-motion feedback, that humans are also able to integrate artificial motor signals, like the motor signals that occur when driving a car.

Sound localization in patients with bilateral vestibulopathy

PURPOSE

The goal of this study was to evaluate if bilaterally (partially) absent vestibular function during static sound localization testing, would have a negative impact on sound localization skills. Therefore, this study compared horizontal static sound localization skills of normal-hearing patients with bilateral vestibulopathy (BV) and healthy controls.

METHODS

Thirteen normal-hearing patients with BV and thirteen age-matched healthy controls were included. Sound localization skills were tested using seven loudspeakers in a frontal semicircle, ranging from - 90° to + 90°. Sound location accuracy was analyzed using the root-mean-square error (RMSE) and the mean absolute error (MAE). To evaluate the severity of the BV symptoms, the following questionnaires were used: Dizziness Handicap Inventory (DHI), Oscillopsia severity questionnaire (OSQ), 12-item Spatial, Speech, and Qualities Questionnaire (SSQ12), and Health Utilities Index Mark 3 (HUI3).

RESULTS

The RMSE and MAE were significantly larger (worse) in the BV group than in the healthy control group, with respective median RMSE of 4.6° and 0°, and a median MAE of 0.7° and 0°. The subjective reporting of speech perception, spatial hearing, and quality of life only demonstrated a moderate correlation between DHI (positive correlation) and HUI total score (negative correlation), and localization scores.

CONCLUSION

Static sound localization skills of patients with BV were only mildly worse compared to healthy controls. However, this difference was very small and therefore most likely due to impaired cognitive function. The vestibular system does not seem to have a modulating role in sound localization during static conditions, and its impact is negligible in contrast to the impact of hearing impairment. Furthermore, the subjective reporting of speech perception, spatial hearing, and quality of life was not strongly correlated with localization scores.

Naturalistic neuroscience and virtual reality

Virtual reality (VR) is one of the techniques that became particularly popular in neuroscience over the past few decades. VR experiments feature a closed-loop between sensory stimulation and behavior. Participants interact with the stimuli and not just passively perceive them. Several senses can be stimulated at once, large-scale environments can be simulated as well as social interactions. All of this makes VR experiences more natural than those in traditional lab paradigms. Compared to the situation in field research, a VR simulation is highly controllable and reproducible, as required of a laboratory technique used in the search for neural correlates of perception and behavior. VR is therefore considered a middle ground between ecological validity and experimental control. In this review, I explore the potential of VR in eliciting naturalistic perception and behavior in humans and non-human animals. In this context, I give an overview of recent virtual reality approaches used in neuroscientific research.

Benefits of active listening during 3D sound localization

In everyday life, sound localization entails more than just the extraction and processing of auditory cues. When determining sound position in three dimensions, the brain also considers the available visual information (e.g., visual cues to sound position) and resolves perceptual ambiguities through active listening behavior (e.g., spontaneous head movements while listening). Here, we examined to what extent spontaneous head movements improve sound localization in 3D—azimuth, elevation, and depth—by comparing static vs. active listening postures. To this aim, we developed a novel approach to sound localization based on sounds delivered in the environment, brought into alignment thanks to a VR system. Our system proved effective for the delivery of sounds at predetermined and repeatable positions in 3D space, without imposing a physically constrained posture, and with minimal training. In addition, it allowed measuring participant behavior (hand, head and eye position) in real time. We report that active listening improved 3D sound localization, primarily by ameliorating accuracy and variability of responses in azimuth and elevation. The more participants made spontaneous head movements, the better was their 3D sound localization performance. Thus, we provide proof of concept of a novel approach to the study of spatial hearing, with potentials for clinical and industrial applications.

Central vestibular dysfunction: don't forget vestibular rehabilitation

INTRODUCTION

Vestibular rehabilitation (VR) is now a subject of active studies and has been shown to be effective for multiple vestibular disorders, peripheral or central. VR is a physical therapy that helps train the central nervous system to compensate for vestibular dysfunction. There is moderate to strong evidence that VR is safe and effective for the management of peripheral vestibular dysfunction. Nonetheless, the studies on how VR works on central vestibular dysfunction remains scanty.

AREAS COVERED

This article addressed the rehabilitation strategies and possible mechanisms, including how central vestibular function might improve upon rehabilitation. In addition, it provides some examples concerning the effect of VR on central vestibular dysfunction.

EXPERT OPINION

VR works on the vestibular system through repetition of specific physical exercises that activate central neuroplastic mechanisms to achieve adaptive compensation of the impaired functions. VR has become a mainstay in the management of patients with dizziness and balance dysfunction. Individualized VR programs are a safe and effective treatment option for a large percentage of patients with central vestibular disease reporting imbalance and dizziness. Exploration of various treatment strategies and possible mechanisms will help develop the best and personalized VR treatment for patients with central vestibular dysfunction.

Frequency-dependent integration of auditory and vestibular cues for self-motion perception

Recent evidence has shown that auditory information may be used to improve postural stability, spatial orientation, navigation, and gait, suggesting an auditory component of self-motion perception. To determine how auditory and other sensory cues integrate for self-motion perception, we measured motion perception during yaw rotations of the body and the auditory environment. Psychophysical thresholds in humans were measured over a range of frequencies (0.1-1.0 Hz) during self-rotation without spatial auditory stimuli, rotation of a sound source around a stationary listener, and self-rotation in the presence of an earth-fixed sound source. Unisensory perceptual thresholds and the combined multisensory thresholds were found to be frequency dependent. Auditory thresholds were better at lower frequencies, and vestibular thresholds were better at higher frequencies. Expressed in terms of peak angular velocity, multisensory vestibular and auditory thresholds ranged from 0.39°/s at 0.1 Hz to 0.95°/s at 1.0 Hz and were significantly better over low frequencies than either the auditory-only (0.54°/s to 2.42°/s at 0.1 and 1.0 Hz, respectively) or vestibular-only (2.00°/s to 0.75°/s at 0.1 and 1.0 Hz, respectively) unisensory conditions. Monaurally presented auditory cues were less effective than binaural cues in lowering multisensory thresholds. Frequency-independent thresholds were derived, assuming that vestibular thresholds depended on a weighted combination of velocity and acceleration cues, whereas auditory thresholds depended on displacement and velocity cues. These results elucidate fundamental mechanisms for the contribution of audition to balance and help explain previous findings, indicating its significance in tasks requiring self-orientation.NEW & NOTEWORTHY Auditory information can be integrated with visual, proprioceptive, and vestibular signals to improve balance, orientation, and gait, but this process is poorly understood. Here, we show that auditory cues significantly improve sensitivity to self-motion perception below 0.5 Hz, whereas vestibular cues contribute more at higher frequencies. Motion thresholds are determined by a weighted combination of displacement, velocity, and acceleration information. These findings may help understand and treat imbalance, particularly in people with sensory deficits.

Sensitivity to Visual Speed Modulation in Head-Mounted Displays Depends on Fixation

A primary cause of simulator sickness in head-mounted displays (HMDs) is conflict between the visual scene displayed to the user and the visual scene expected by the brain when the user's head is in motion. It is useful to measure perceptual sensitivity to visual speed modulation in HMDs because conditions that minimize this sensitivity may prove less likely to elicit simulator sickness. In prior research, we measured sensitivity to visual gain modulation during slow, passive, full-body yaw rotations and observed that sensitivity was reduced when subjects fixated a head-fixed target compared with when they fixated a scene-fixed target. In the current study, we investigated whether this pattern of results persists when (1) movements are faster, active head turns, and (2) visual stimuli are presented on an HMD rather than on a monitor. Subjects wore an Oculus Rift CV1 HMD and viewed a 3D scene of white points on a black background. On each trial, subjects moved their head from a central position to face a 15° eccentric target. During the head movement they fixated a point that was either head-fixed or scene-fixed, depending on condition. They then reported if the visual scene motion was too fast or too slow. Visual speed on subsequent trials was modulated according to a staircase procedure to find the speed increment that was just noticeable. Sensitivity to speed modulation during active head movement was reduced during head-fixed fixation, similar to what we observed during passive whole-body rotation. We conclude that fixation of a head-fixed target is an effective way to reduce sensitivity to visual speed modulation in HMDs, and may also be an effective strategy to reduce susceptibility to simulator sickness.

Multisensory activation of ventral cochlear nucleus D-stellate cells modulates dorsal cochlear nucleus principal cell spatial coding

KEY POINTS

Dorsal cochlear nucleus fusiform cells receive spectrally relevant auditory input for sound localization. Fusiform cells integrate auditory with other multisensory inputs. Here we elucidate how somatosensory and vestibular stimulation modify the fusiform cell spatial code through activation of an inhibitory interneuron: the ventral cochlear nucleus D-stellate cell. These results suggests that multisensory cues interact early in an ascending sensory pathway to serve an essential function.

ABSTRACT

In the cochlear nucleus (CN), the first central site for coding sound location, numerous multisensory projections and their modulatory effects have been reported. However, multisensory influences on sound location processing in the CN remain unknown. The principal output neurons of the dorsal CN, fusiform cells, encode spatial information through frequency-selective responses to direction-dependent spectral features. Here, single-unit recordings from the guinea pig CN revealed transient alterations by somatosensory and vestibular stimulation in fusiform cell spatial coding. Changes in fusiform cell spectral sensitivity correlated with multisensory modulation of ventral CN D-stellate cell responses, which provide direct, wideband inhibition to fusiform cells. These results suggest that multisensory inputs contribute to spatial coding in DCN fusiform cells via an inhibitory interneuron, the D-stellate cell. This early multisensory integration circuit likely confers important consequences on perceptual organization downstream.

Angle-Dependent Distortions in the Perceptual Topology of Acoustic Space

By moving sounds around the head and asking listeners to report which ones moved more, it was found that sound sources at the side of a listener must move at least twice as much as ones in front to be judged as moving the same amount. A relative expansion of space in the front and compression at the side has consequences for spatial perception of moving sounds by both static and moving listeners. An accompanying prediction that the apparent location of static sound sources ought to also be distorted agrees with previous work and suggests that this is a general perceptual phenomenon that is not limited to moving signals. A mathematical model that mimics the measured expansion of space can be used to successfully capture several previous findings in spatial auditory perception. The inverse of this function could be used alongside individualized head-related transfer functions and motion tracking to produce hyperstable virtual acoustic environments.

White Matter Connectivity of the Visual-Vestibular Cortex Examined by Diffusion-Weighted Imaging

The parieto-insular vestibular cortex (PIVC) and the posterior insular cortex (PIC) are key regions of the cortical vestibular network, both located in the midposterior section of the lateral sulcus. Little is known about the structural connectivity pattern of these areas. We used probabilistic fiber tracking based on diffusion-weighted magnetic resonance imaging (MRI) and compared the ipsilateral connectivity of PIVC and PIC. Seed areas for the tracking algorithm were identified in each brain by functional MRI activity during caloric and visual motion stimulation, respectively. Cortical track terminations were investigated by a surface-based approach. Both PIVC and PIC shared ipsilateral connections to the insular/lateral sulcus, superior temporal cortex, and inferior frontal gyrus. However, PIVC showed significantly more connections than PIC with the anterior insula and Heschl's gyrus in both hemispheres and with the precuneus, intraparietal sulcus, and posterior callosum of the right hemisphere. In contrast, PIC connectivity was more pronounced with the supramarginal gyrus and superior temporal sulcus. Subcortical tracks were examined by a region-of-interest-based approach, which was validated on cortico-thalamic motor tracts. Both PIVC and PIC were connected with lateral nuclei of the thalamus and the basal ganglia (primarily putamen). PIVC tracks but not PIC tracks showed a right-hemispheric lateralization in cortical and subcortical connectivity. Overall, these results suggest that human PIVC and PIC share cortical and even subcortical connections. Nevertheless, they also differ in their primary connectivity pattern: PIVC is linked with posterior parietal and inferior frontal cortex, whereas PIC is linked with superior temporal and inferior parietal cortex.