Sound-evoked vestibular stimulation affects the anticipation of gravity effects during visual self-motion

Interception of vertically approaching objects: temporal recruitment of the internal model of gravity and contribution of optical information

Introduction: Recent views posit that precise control of the interceptive timing can be achieved by combining on-line processing of visual information with predictions based on prior experience. Indeed, for interception of free-falling objects under gravity's effects, experimental evidence shows that time-to-contact predictions can be derived from an internal gravity representation in the vestibular cortex. However, whether the internal gravity model is fully engaged at the target motion outset or reinforced by visual motion processing at later stages of motion is not yet clear. Moreover, there is no conclusive evidence about the relative contribution of internalized gravity and optical information in determining the time-to-contact estimates. Methods: We sought to gain insight on this issue by asking 32 participants to intercept free falling objects approaching directly from above in virtual reality. Object motion had durations comprised between 800 and 1100 ms and it could be either congruent with gravity (1 g accelerated motion) or not (constant velocity or -1 g decelerated motion). We analyzed accuracy and precision of the interceptive responses, and fitted them to Bayesian regression models, which included predictors related to the recruitment of a priori gravity information at different times during the target motion, as well as based on available optical information. Results: Consistent with the use of internalized gravity information, interception accuracy and precision were significantly higher with 1 g motion. Moreover, Bayesian regression indicated that interceptive responses were predicted very closely by assuming engagement of the gravity prior 450 ms after the motion onset, and that adding a predictor related to on-line processing of optical information improved only slightly the model predictive power. Discussion: Thus, engagement of a priori gravity information depended critically on the processing of the first 450 ms of visual motion information, exerting a predominant influence on the interceptive timing, compared to continuously available optical information. Finally, these results may support a parallel processing scheme for the control of interceptive timing.

Noise and vestibular perception of passive self-motion

Noise defined as random disturbances is ubiquitous in both the external environment and the nervous system. Depending on the context, noise can degrade or improve information processing and performance. In all cases, it contributes to neural systems dynamics. We review some effects of various sources of noise on the neural processing of self-motion signals at different stages of the vestibular pathways and the resulting perceptual responses. Hair cells in the inner ear reduce the impact of noise by means of mechanical and neural filtering. Hair cells synapse on regular and irregular afferents. Variability of discharge (noise) is low in regular afferents and high in irregular units. The high variability of irregular units provides information about the envelope of naturalistic head motion stimuli. A subset of neurons in the vestibular nuclei and thalamus are optimally tuned to noisy motion stimuli that reproduce the statistics of naturalistic head movements. In the thalamus, variability of neural discharge increases with increasing motion amplitude but saturates at high amplitudes, accounting for behavioral violation of Weber's law. In general, the precision of individual vestibular neurons in encoding head motion is worse than the perceptual precision measured behaviorally. However, the global precision predicted by neural population codes matches the high behavioral precision. The latter is estimated by means of psychometric functions for detection or discrimination of whole-body displacements. Vestibular motion thresholds (inverse of precision) reflect the contribution of intrinsic and extrinsic noise to perception. Vestibular motion thresholds tend to deteriorate progressively after the age of 40 years, possibly due to oxidative stress resulting from high discharge rates and metabolic loads of vestibular afferents. In the elderly, vestibular thresholds correlate with postural stability: the higher the threshold, the greater is the postural imbalance and risk of falling. Experimental application of optimal levels of either galvanic noise or whole-body oscillations can ameliorate vestibular function with a mechanism reminiscent of stochastic resonance. Assessment of vestibular thresholds is diagnostic in several types of vestibulopathies, and vestibular stimulation might be useful in vestibular rehabilitation.

Watching the Effects of Gravity. Vestibular Cortex and the Neural Representation of "Visual" Gravity

Gravity is a physical constraint all terrestrial species have adapted to through evolution. Indeed, gravity effects are taken into account in many forms of interaction with the environment, from the seemingly simple task of maintaining balance to the complex motor skills performed by athletes and dancers. Graviceptors, primarily located in the vestibular otolith organs, feed the Central Nervous System with information related to the gravity acceleration vector. This information is integrated with signals from semicircular canals, vision, and proprioception in an ensemble of interconnected brain areas, including the vestibular nuclei, cerebellum, thalamus, insula, retroinsula, parietal operculum, and temporo-parietal junction, in the so-called vestibular network. Classical views consider this stage of multisensory integration as instrumental to sort out conflicting and/or ambiguous information from the incoming sensory signals. However, there is compelling evidence that it also contributes to an internal representation of gravity effects based on prior experience with the environment. This a priori knowledge could be engaged by various types of information, including sensory signals like the visual ones, which lack a direct correspondence with physical gravity. Indeed, the retinal accelerations elicited by gravitational motion in a visual scene are not invariant, but scale with viewing distance. Moreover, the "visual" gravity vector may not be aligned with physical gravity, as when we watch a scene on a tilted monitor or in weightlessness. This review will discuss experimental evidence from behavioral, neuroimaging (connectomics, fMRI, TMS), and patients' studies, supporting the idea that the internal model estimating the effects of gravity on visual objects is constructed by transforming the vestibular estimates of physical gravity, which are computed in the brainstem and cerebellum, into internalized estimates of virtual gravity, stored in the vestibular cortex. The integration of the internal model of gravity with visual and non-visual signals would take place at multiple levels in the cortex and might involve recurrent connections between early visual areas engaged in the analysis of spatio-temporal features of the visual stimuli and higher visual areas in temporo-parietal-insular regions.

The role of cortical areas hMT/V5+ and TPJ on the magnitude of representational momentum and representational gravity: a transcranial magnetic stimulation study

The perceived vanishing location of a moving target is systematically displaced forward, in the direction of motion-representational momentum-, and downward, in the direction of gravity-representational gravity. Despite a wealth of research on the factors that modulate these phenomena, little is known regarding their neurophysiological substrates. The present experiment aims to explore which role is played by cortical areas hMT/V5+, linked to the processing of visual motion, and TPJ, thought to support the functioning of an internal model of gravity, in modulating both effects. Participants were required to perform a standard spatial localization task while the activity of the right hMT/V5+ or TPJ sites was selectively disrupted with an offline continuous theta-burst stimulation (cTBS) protocol, interspersed with control blocks with no stimulation. Eye movements were recorded during all spatial localizations. Results revealed an increase in representational gravity contingent on the disruption of the activity of hMT/V5+ and, conversely, some evidence suggested a bigger representational momentum when TPJ was stimulated. Furthermore, stimulation of hMT/V5+ led to a decreased ocular overshoot and to a time-dependent downward drift of gaze location. These outcomes suggest that a reciprocal balance between perceived kinematics and anticipated dynamics might modulate these spatial localization responses, compatible with a push-pull mechanism.

Ocular tracking of occluded ballistic trajectories: Effects of visual context and of target law of motion

In tracking a moving target, the visual context may provide cues for an observer to interpret the causal nature of the target motion and extract features to which the visual system is weakly sensitive, such as target acceleration. This information could be critical when vision of the target is temporarily impeded, requiring visual motion extrapolation processes. Here we investigated how visual context influences ocular tracking of motion either congruent or not with natural gravity. To this end, 28 subjects tracked computer-simulated ballistic trajectories either perturbed in the descending segment with altered gravity effects (0g/2g) or retaining natural-like motion (1g). Shortly after the perturbation (550 ms), targets disappeared for either 450 or 650 ms and became visible again until landing. Target motion occurred with either quasi-realistic pictorial cues or a uniform background, presented in counterbalanced order. We analyzed saccadic and pursuit movements after 0g and 2g target-motion perturbations and for corresponding intervals of unperturbed 1g trajectories, as well as after corresponding occlusions. Moreover, we considered the eye-to-target distance at target reappearance. Tracking parameters differed significantly between scenarios: With a neutral background, eye movements did not depend consistently on target motion, whereas with pictorial background they showed significant dependence, denoting better tracking of accelerated targets. These results suggest that oculomotor control is tuned to realistic properties of the visual scene.

Body orientation contributes to modelling the effects of gravity for target interception in humans

KEY POINTS

It is known that interception of targets accelerated by gravity involves internal models coupled with visual signals. Non-visual signals related to head and body orientation relative to gravity may also contribute, although their role is poorly understood. In a novel experiment, we asked pitched observers to hit a virtual target approaching with an acceleration that was either coherent or incoherent with their pitch-tilt. Initially, the timing errors were large and independent of the coherence between target acceleration and observer's pitch. With practice, however, the timing errors became substantially smaller in the coherent conditions. The results show that information about head and body orientation can contribute to modelling the effects of gravity on a moving target. Orientation cues from vestibular and somatosensory signals might be integrated with visual signals in the vestibular cortex, where the internal model of gravity is assumed to be encoded.

ABSTRACT

Interception of moving targets relies on visual signals and internal models. Less is known about the additional contribution of non-visual cues about head and body orientation relative to gravity. We took advantage of Galileo's law of motion along an incline to demonstrate the effects of vestibular and somatosensory cues about head and body orientation on interception timing. Participants were asked to hit a ball rolling in a gutter towards the eyes, resulting in image expansion. The scene was presented in a head-mounted display, without any visual information about gravity direction. In separate blocks of trials participants were pitched backwards by 20° or 60°, whereas ball acceleration was randomized across trials so as to be compatible with rolling down a slope of 20° or 60°. Initially, the timing errors were large, independently of the coherence between ball acceleration and pitch angle, consistent with responses based exclusively on visual information because visual stimuli were identical at both tilts. At the end of the experiment, however, the timing errors were systematically smaller in the coherent conditions than the incoherent ones. Moreover, the responses were significantly (P = 0.007) earlier when participants were pitched by 60° than when they were pitched by 20°. Therefore, practice with the task led to incorporation of information about head and body orientation relative to gravity for response timing. Instead, posture did not affect response timing in a control experiment in which participants hit a static target in synchrony with the last of a predictable series of stationary audiovisual stimuli.

Brain responses to virtual reality visual motion stimulation are affected by neurotic personality traits in patients with persistent postural-perceptual dizziness

OBJECTIVE

Persistent postural perceptual dizziness (PPPD) is a common vestibular disorder of persistent dizziness and unsteadiness, exacerbated by upright posture, self-motion, and exposure to complex or moving visual stimuli. Previous functional magnetic resonance imaging (fMRI) studies found dysfunctional activity in the visual-vestibular cortices in patients with PPPD. Clinical studies showed that the anxiety-related personality traits of neuroticism and introversion may predispose individuals to PPPD. However, the effects of these traits on brain function in patients with PPPD versus healthy controls (HCs) have not been studied.

METHODS

To investigate potential differential effects of neuroticism and introversion on functioning of their visuo-vestibular networks, 15 patients with PPPD and 15 HCs matched for demographics and motion sickness susceptibility underwent fMRI during virtual reality simulation of a rollercoaster ride in vertical and horizontal directions.

RESULTS

Neuroticism positively correlated with activity in the inferior frontal gyrus (IFg), and enhanced connectivity between the IFg and occipital regions in patients with PPPD relative to HCs during vertical versus horizontal motion comparison.

CONCLUSIONS

In patients with PPPD, neuroticism increased the activity and connectivity of neural networks that mediate attention to visual motion cues during vertical motion. This mechanism may mediate visual control of balance in neurotic patients with PPPD.

Altered Insular and Occipital Responses to Simulated Vertical Self-Motion in Patients with Persistent Postural-Perceptual Dizziness

BACKGROUND

Persistent postural-perceptual dizziness (PPPD) is a common functional vestibular disorder characterized by persistent symptoms of non-vertiginous dizziness and unsteadiness that are exacerbated by upright posture, self-motion, and exposure to complex or moving visual stimuli. Recent physiologic and neuroimaging data suggest that greater reliance on visual cues for postural control (as opposed to vestibular cues-a phenomenon termed visual dependence) and dysfunction in central visuo-vestibular networks may be important pathophysiologic mechanisms underlying PPPD. Dysfunctions are thought to involve insular regions that encode recognition of the visual effects of motion in the gravitational field.

METHODS

We tested for altered activity in vestibular and visual cortices during self-motion simulation obtained via a visual virtual-reality rollercoaster stimulation using functional magnetic resonance imaging in 15 patients with PPPD and 15 healthy controls (HCs). We compared between groups differences in brain responses to simulated displacements in vertical vs horizontal directions and correlated the difference in directional responses with dizziness handicap in patients with PPPD.

RESULTS

HCs showed increased activity in the anterior bank of the central insular sulcus during vertical relative to horizontal motion, which was not seen in patients with PPPD. However, for the same comparison, dizziness handicap correlated positively with activity in the visual cortex (V1, V2, and V3) in patients with PPPD.

CONCLUSION

We provide novel insight into the pathophysiologic mechanisms underlying PPPD, including functional alterations in brain processes that affect balance control and reweighting of space-motion inputs to favor visual cues. For patients with PPPD, difficulties using visual data to discern the effects of gravity on self-motion may adversely affect balance control, particularly for individuals who simultaneously rely too heavily on visual stimuli. In addition, increased activity in the visual cortex, which correlated with severity of dizziness handicap, may be a neural correlate of visual dependence.

Differential contributions to the interception of occluded ballistic trajectories by the temporoparietal junction, area hMT/V5+, and the intraparietal cortex

The ability to catch objects when transiently occluded from view suggests their motion can be extrapolated. Intraparietal cortex (IPS) plays a major role in this process along with other brain structures, depending on the task. For example, interception of objects under Earth's gravity effects may depend on time-to-contact predictions derived from integration of visual signals processed by hMT/V5+ with a priori knowledge of gravity residing in the temporoparietal junction (TPJ). To investigate this issue further, we disrupted TPJ, hMT/V5+, and IPS activities with transcranial magnetic stimulation (TMS) while subjects intercepted computer-simulated projectile trajectories perturbed randomly with either hypo- or hypergravity effects. In experiment 1, trajectories were occluded either 750 or 1,250 ms before landing. Three subject groups underwent triple-pulse TMS (tpTMS, 3 pulses at 10 Hz) on one target area (TPJ | hMT/V5+ | IPS) and on the vertex (control site), timed at either trajectory perturbation or occlusion. In experiment 2, trajectories were entirely visible and participants received tpTMS on TPJ and hMT/V5+ with same timing as experiment 1 tpTMS of TPJ, hMT/V5+, and IPS affected differently the interceptive timing. TPJ stimulation affected preferentially responses to 1-g motion, hMT/V5+ all response types, and IPS stimulation induced opposite effects on 0-g and 2-g responses, being ineffective on 1-g responses. Only IPS stimulation was effective when applied after target disappearance, implying this area might elaborate memory representations of occluded target motion. Results are compatible with the idea that IPS, TPJ, and hMT/V5+ contribute to distinct aspects of visual motion extrapolation, perhaps through parallel processing.NEW & NOTEWORTHY Visual extrapolation represents a potential neural solution to afford motor interactions with the environment in the face of missing information. We investigated relative contributions by temporoparietal junction (TPJ), hMT/V5+, and intraparietal cortex (IPS), cortical areas potentially involved in these processes. Parallel organization of visual extrapolation processes emerged with respect to the target's motion causal nature: TPJ was primarily involved for visual motion congruent with gravity effects, IPS for arbitrary visual motion, whereas hMT/V5+ contributed at earlier processing stages.

Effects of visual motion consistent or inconsistent with gravity on postural sway

Vision plays an important role in postural control, and visual perception of the gravity-defined vertical helps maintaining upright stance. In addition, the influence of the gravity field on objects' motion is known to provide a reference for motor and non-motor behavior. However, the role of dynamic visual cues related to gravity in the control of postural balance has been little investigated. In order to understand whether visual cues about gravitational acceleration are relevant for postural control, we assessed the relation between postural sway and visual motion congruent or incongruent with gravity acceleration. Postural sway of 44 healthy volunteers was recorded by means of force platforms while they watched virtual targets moving in different directions and with different accelerations. Small but significant differences emerged in sway parameters with respect to the characteristics of target motion. Namely, for vertically accelerated targets, gravitational motion (GM) was associated with smaller oscillations of the center of pressure than anti-GM. The present findings support the hypothesis that not only static, but also dynamic visual cues about direction and magnitude of the gravitational field are relevant for balance control during upright stance.

Neuroticism modulates brain visuo-vestibular and anxiety systems during a virtual rollercoaster task

Different lines of research suggest that anxiety‐related personality traits may influence the visual and vestibular control of balance, although the brain mechanisms underlying this effect remain unclear. To our knowledge, this is the first functional magnetic resonance imaging (fMRI) study that investigates how individual differences in neuroticism and introversion, two key personality traits linked to anxiety, modulate brain regional responses and functional connectivity patterns during a fMRI task simulating self‐motion. Twenty‐four healthy individuals with variable levels of neuroticism and introversion underwent fMRI while performing a virtual reality rollercoaster task that included two main types of trials: (1) trials simulating downward or upward self‐motion (vertical motion), and (2) trials simulating self‐motion in horizontal planes (horizontal motion). Regional brain activity and functional connectivity patterns when comparing vertical versus horizontal motion trials were correlated with personality traits of the Five Factor Model (i.e., neuroticism, extraversion‐introversion, openness, agreeableness, and conscientiousness). When comparing vertical to horizontal motion trials, we found a positive correlation between neuroticism scores and regional activity in the left parieto‐insular vestibular cortex (PIVC). For the same contrast, increased functional connectivity between the left PIVC and right amygdala was also detected as a function of higher neuroticism scores. Together, these findings provide new evidence that individual differences in personality traits linked to anxiety are significantly associated with changes in the activity and functional connectivity patterns within visuo‐vestibular and anxiety‐related systems during simulated vertical self‐motion. Hum Brain Mapp 38:715–726, 2017. © 2016 The Authors Human Brain Mapping Published by Wiley Periodicals, Inc.

Visual gravity contributes to subjective first-person perspective

A fundamental component of conscious experience involves a first-person perspective (1PP), characterized by the experience of being a subject and of being directed at the world. Extending earlier work on multisensory perceptual mechanisms of 1PP, we here asked whether the experienced direction of the 1PP (i.e. the spatial direction of subjective experience of the world) depends on visual-tactile-vestibular conflicts, including the direction of gravity. Sixteen healthy subjects in supine position received visuo-tactile synchronous or asynchronous stroking to induce a full-body illusion. In the critical manipulation, we presented gravitational visual object motion directed toward or away from the participant’s body and thus congruent or incongruent with respect to the direction of vestibular and somatosensory gravitational cues. The results showed that multisensory gravitational conflict induced within-subject changes of the experienced direction of the 1PP that depended on the direction of visual gravitational cues. Participants experienced more often a downward direction of their 1PP (incongruent with respect to the participant’s physical body posture) when visual object motion was directed away rather than towards the participant’s body. These downward-directed 1PP experiences positively correlated with measures of elevated self-location. Together, these results show that visual gravitational cues contribute to the experienced direction of the 1PP, defining the subjective location and perspective from where humans experience to perceive the world.

Role of the Insula and Vestibular System in Patients with Chronic Subjective Dizziness: An fMRI Study Using Sound-Evoked Vestibular Stimulation

Chronic subjective dizziness (CSD) is a common vestibular disorder characterized by persistent non-vertiginous dizziness, unsteadiness, and heightened sensitivity to motion stimuli that may last for months to years after events that cause acute vestibular symptoms or disrupt balance. CSD is not associated with abnormalities of basic vestibular or oculomotor reflexes. Rather, it is thought to arise from persistent use of high-threat postural control strategies and greater reliance on visual cues for spatial orientation (i.e., visual dependence), long after triggering events resolve. Anxiety-related personality traits confer vulnerability to CSD. Anomalous interactions between the central vestibular system and neural structures related to anxiety may sustain it. Vestibular- and anxiety-related processes overlap in the brain, particularly in the insula and hippocampus. Alterations in activity and connectivity in these brain regions in response to vestibular stimuli may be the neural basis of CSD. We examined this hypothesis by comparing brain activity from 18 patients with CSD and 18 healthy controls measured by functional magnetic resonance imaging during loud short tone bursts, which are auditory stimuli that evoke robust vestibular responses. Relative to controls, patients with CSD showed reduced activations to sound-evoked vestibular stimulation in the parieto-insular vestibular cortex (PIVC) including the posterior insula, and in the anterior insula, inferior frontal gyrus, hippocampus, and anterior cingulate cortex. Patients with CSD also showed altered connectivity between the anterior insula and PIVC, anterior insula and middle occipital cortex, hippocampus and PIVC, and anterior cingulate cortex and PIVC. We conclude that reduced activation in PIVC, hippocampus, anterior insula, inferior frontal gyrus, and anterior cingulate cortex, as well as connectivity changes among these regions, may be linked to long-term vestibular symptoms in patients with CSD. Furthermore, altered connectivity between the anterior insula and middle occipital cortex may underlie the greater reliance on visual cues for spatial orientation in CSD patients relative to controls.