Anticipating the effects of visual gravity during simulated self-motion: estimates of time-to-passage along vertical and horizontal paths

Interception of vertically approaching objects: temporal recruitment of the internal model of gravity and contribution of optical information

Introduction: Recent views posit that precise control of the interceptive timing can be achieved by combining on-line processing of visual information with predictions based on prior experience. Indeed, for interception of free-falling objects under gravity's effects, experimental evidence shows that time-to-contact predictions can be derived from an internal gravity representation in the vestibular cortex. However, whether the internal gravity model is fully engaged at the target motion outset or reinforced by visual motion processing at later stages of motion is not yet clear. Moreover, there is no conclusive evidence about the relative contribution of internalized gravity and optical information in determining the time-to-contact estimates. Methods: We sought to gain insight on this issue by asking 32 participants to intercept free falling objects approaching directly from above in virtual reality. Object motion had durations comprised between 800 and 1100 ms and it could be either congruent with gravity (1 g accelerated motion) or not (constant velocity or -1 g decelerated motion). We analyzed accuracy and precision of the interceptive responses, and fitted them to Bayesian regression models, which included predictors related to the recruitment of a priori gravity information at different times during the target motion, as well as based on available optical information. Results: Consistent with the use of internalized gravity information, interception accuracy and precision were significantly higher with 1 g motion. Moreover, Bayesian regression indicated that interceptive responses were predicted very closely by assuming engagement of the gravity prior 450 ms after the motion onset, and that adding a predictor related to on-line processing of optical information improved only slightly the model predictive power. Discussion: Thus, engagement of a priori gravity information depended critically on the processing of the first 450 ms of visual motion information, exerting a predominant influence on the interceptive timing, compared to continuously available optical information. Finally, these results may support a parallel processing scheme for the control of interceptive timing.

Microgravity induces overconfidence in perceptual decision-making

Does gravity affect decision-making? This question comes into sharp focus as plans for interplanetary human space missions solidify. In the framework of Bayesian brain theories, gravity encapsulates a strong prior, anchoring agents to a reference frame via the vestibular system, informing their decisions and possibly their integration of uncertainty. What happens when such a strong prior is altered? We address this question using a self-motion estimation task in a space analog environment under conditions of altered gravity. Two participants were cast as remote drone operators orbiting Mars in a virtual reality environment on board a parabolic flight, where both hyper- and microgravity conditions were induced. From a first-person perspective, participants viewed a drone exiting a cave and had to first predict a collision and then provide a confidence estimate of their response. We evoked uncertainty in the task by manipulating the motion's trajectory angle. Post-decision subjective confidence reports were negatively predicted by stimulus uncertainty, as expected. Uncertainty alone did not impact overt behavioral responses (performance, choice) differentially across gravity conditions. However microgravity predicted higher subjective confidence, especially in interaction with stimulus uncertainty. These results suggest that variables relating to uncertainty affect decision-making distinctly in microgravity, highlighting the possible need for automatized, compensatory mechanisms when considering human factors in space research.

Watching the Effects of Gravity. Vestibular Cortex and the Neural Representation of "Visual" Gravity

Gravity is a physical constraint all terrestrial species have adapted to through evolution. Indeed, gravity effects are taken into account in many forms of interaction with the environment, from the seemingly simple task of maintaining balance to the complex motor skills performed by athletes and dancers. Graviceptors, primarily located in the vestibular otolith organs, feed the Central Nervous System with information related to the gravity acceleration vector. This information is integrated with signals from semicircular canals, vision, and proprioception in an ensemble of interconnected brain areas, including the vestibular nuclei, cerebellum, thalamus, insula, retroinsula, parietal operculum, and temporo-parietal junction, in the so-called vestibular network. Classical views consider this stage of multisensory integration as instrumental to sort out conflicting and/or ambiguous information from the incoming sensory signals. However, there is compelling evidence that it also contributes to an internal representation of gravity effects based on prior experience with the environment. This a priori knowledge could be engaged by various types of information, including sensory signals like the visual ones, which lack a direct correspondence with physical gravity. Indeed, the retinal accelerations elicited by gravitational motion in a visual scene are not invariant, but scale with viewing distance. Moreover, the "visual" gravity vector may not be aligned with physical gravity, as when we watch a scene on a tilted monitor or in weightlessness. This review will discuss experimental evidence from behavioral, neuroimaging (connectomics, fMRI, TMS), and patients' studies, supporting the idea that the internal model estimating the effects of gravity on visual objects is constructed by transforming the vestibular estimates of physical gravity, which are computed in the brainstem and cerebellum, into internalized estimates of virtual gravity, stored in the vestibular cortex. The integration of the internal model of gravity with visual and non-visual signals would take place at multiple levels in the cortex and might involve recurrent connections between early visual areas engaged in the analysis of spatio-temporal features of the visual stimuli and higher visual areas in temporo-parietal-insular regions.

Brain Correlates of Persistent Postural-Perceptual Dizziness: A Review of Neuroimaging Studies

Persistent postural-perceptual dizziness (PPPD), defined in 2017, is a vestibular disorder characterized by chronic dizziness that is exacerbated by upright posture and exposure to complex visual stimuli. This review focused on recent neuroimaging studies that explored the pathophysiological mechanisms underlying PPPD and three conditions that predated it. The emerging picture is that local activity and functional connectivity in multimodal vestibular cortical areas are decreased in PPPD, which is potentially related to structural abnormalities (e.g., reductions in cortical folding and grey-matter volume). Additionally, connectivity between the prefrontal cortex, which regulates attentional and emotional responses, and primary visual and motor regions appears to be increased in PPPD. These results complement physiological and psychological data identifying hypervigilant postural control and visual dependence in patients with PPPD, supporting the hypothesis that PPPD arises from shifts in interactions among visuo-vestibular, sensorimotor, and emotional networks that overweigh visual over vestibular inputs and increase the effects of anxiety-related mechanisms on locomotor control and spatial orientation.

A Bird's eye view from below: Activity in the temporo-parietal junction predicts from-above Necker Cube percepts

The temporo-parietal junction (TPJ) consistently emerges in other-regarding behavior, including tasks probing affective phenomena such as morality and empathy. Yet the TPJ is also recruited in processes with no affective or social component, such as visuo-spatial processing and mathematical cognition. We present serendipitous findings from a perceptual decision-making task on a bistable stimulus, the Necker Cube, performed in an MRI scanner. The stimulus in question is a transparent, wire-frame cube that evokes spontaneous switches in perception. Individuals can view the cube from below or from above, though a consistent bias is shown towards seeing the cube from above. We replicate this bias, finding participants spend more time in the from-above percept. However, in testing for BOLD differences between percept orientations, we found robust responses in bilateral TPJ for the from-above > from-below perceptual state. We speculate that this neural response comes from the sensory incongruence of viewing an object from above while lying supine in the scanner. We further speculate that the TPJ resolves this incongruence by facilitating an egocentric projection. Such a function would explain the TPJ's ubiquitous response to other-regarding, visuo-spatial and mathematical cognition, as all these phenomena demand an ability to ambulate through the coordinate space. Our findings suggest the TPJ may not play a specific role in social or moral components of other-regarding behavior, such as altruism, and further indirectly suggest that "pure", allocentric altruism may not correlate with the TPJ. Results further have implications on how the TPJ may be modulated by activities such as flight or drone operation. Finally, this study highlights the possible need for congruence between stimuli and body position in neuroimaging studies.

Brain responses to virtual reality visual motion stimulation are affected by neurotic personality traits in patients with persistent postural-perceptual dizziness

OBJECTIVE

Persistent postural perceptual dizziness (PPPD) is a common vestibular disorder of persistent dizziness and unsteadiness, exacerbated by upright posture, self-motion, and exposure to complex or moving visual stimuli. Previous functional magnetic resonance imaging (fMRI) studies found dysfunctional activity in the visual-vestibular cortices in patients with PPPD. Clinical studies showed that the anxiety-related personality traits of neuroticism and introversion may predispose individuals to PPPD. However, the effects of these traits on brain function in patients with PPPD versus healthy controls (HCs) have not been studied.

METHODS

To investigate potential differential effects of neuroticism and introversion on functioning of their visuo-vestibular networks, 15 patients with PPPD and 15 HCs matched for demographics and motion sickness susceptibility underwent fMRI during virtual reality simulation of a rollercoaster ride in vertical and horizontal directions.

RESULTS

Neuroticism positively correlated with activity in the inferior frontal gyrus (IFg), and enhanced connectivity between the IFg and occipital regions in patients with PPPD relative to HCs during vertical versus horizontal motion comparison.

CONCLUSIONS

In patients with PPPD, neuroticism increased the activity and connectivity of neural networks that mediate attention to visual motion cues during vertical motion. This mechanism may mediate visual control of balance in neurotic patients with PPPD.

Altered Insular and Occipital Responses to Simulated Vertical Self-Motion in Patients with Persistent Postural-Perceptual Dizziness

BACKGROUND

Persistent postural-perceptual dizziness (PPPD) is a common functional vestibular disorder characterized by persistent symptoms of non-vertiginous dizziness and unsteadiness that are exacerbated by upright posture, self-motion, and exposure to complex or moving visual stimuli. Recent physiologic and neuroimaging data suggest that greater reliance on visual cues for postural control (as opposed to vestibular cues-a phenomenon termed visual dependence) and dysfunction in central visuo-vestibular networks may be important pathophysiologic mechanisms underlying PPPD. Dysfunctions are thought to involve insular regions that encode recognition of the visual effects of motion in the gravitational field.

METHODS

We tested for altered activity in vestibular and visual cortices during self-motion simulation obtained via a visual virtual-reality rollercoaster stimulation using functional magnetic resonance imaging in 15 patients with PPPD and 15 healthy controls (HCs). We compared between groups differences in brain responses to simulated displacements in vertical vs horizontal directions and correlated the difference in directional responses with dizziness handicap in patients with PPPD.

RESULTS

HCs showed increased activity in the anterior bank of the central insular sulcus during vertical relative to horizontal motion, which was not seen in patients with PPPD. However, for the same comparison, dizziness handicap correlated positively with activity in the visual cortex (V1, V2, and V3) in patients with PPPD.

CONCLUSION

We provide novel insight into the pathophysiologic mechanisms underlying PPPD, including functional alterations in brain processes that affect balance control and reweighting of space-motion inputs to favor visual cues. For patients with PPPD, difficulties using visual data to discern the effects of gravity on self-motion may adversely affect balance control, particularly for individuals who simultaneously rely too heavily on visual stimuli. In addition, increased activity in the visual cortex, which correlated with severity of dizziness handicap, may be a neural correlate of visual dependence.

Effects of visual motion consistent or inconsistent with gravity on postural sway

Vision plays an important role in postural control, and visual perception of the gravity-defined vertical helps maintaining upright stance. In addition, the influence of the gravity field on objects' motion is known to provide a reference for motor and non-motor behavior. However, the role of dynamic visual cues related to gravity in the control of postural balance has been little investigated. In order to understand whether visual cues about gravitational acceleration are relevant for postural control, we assessed the relation between postural sway and visual motion congruent or incongruent with gravity acceleration. Postural sway of 44 healthy volunteers was recorded by means of force platforms while they watched virtual targets moving in different directions and with different accelerations. Small but significant differences emerged in sway parameters with respect to the characteristics of target motion. Namely, for vertically accelerated targets, gravitational motion (GM) was associated with smaller oscillations of the center of pressure than anti-GM. The present findings support the hypothesis that not only static, but also dynamic visual cues about direction and magnitude of the gravitational field are relevant for balance control during upright stance.

Neuroticism modulates brain visuo-vestibular and anxiety systems during a virtual rollercoaster task

Different lines of research suggest that anxiety‐related personality traits may influence the visual and vestibular control of balance, although the brain mechanisms underlying this effect remain unclear. To our knowledge, this is the first functional magnetic resonance imaging (fMRI) study that investigates how individual differences in neuroticism and introversion, two key personality traits linked to anxiety, modulate brain regional responses and functional connectivity patterns during a fMRI task simulating self‐motion. Twenty‐four healthy individuals with variable levels of neuroticism and introversion underwent fMRI while performing a virtual reality rollercoaster task that included two main types of trials: (1) trials simulating downward or upward self‐motion (vertical motion), and (2) trials simulating self‐motion in horizontal planes (horizontal motion). Regional brain activity and functional connectivity patterns when comparing vertical versus horizontal motion trials were correlated with personality traits of the Five Factor Model (i.e., neuroticism, extraversion‐introversion, openness, agreeableness, and conscientiousness). When comparing vertical to horizontal motion trials, we found a positive correlation between neuroticism scores and regional activity in the left parieto‐insular vestibular cortex (PIVC). For the same contrast, increased functional connectivity between the left PIVC and right amygdala was also detected as a function of higher neuroticism scores. Together, these findings provide new evidence that individual differences in personality traits linked to anxiety are significantly associated with changes in the activity and functional connectivity patterns within visuo‐vestibular and anxiety‐related systems during simulated vertical self‐motion. Hum Brain Mapp 38:715–726, 2017. © 2016 The Authors Human Brain Mapping Published by Wiley Periodicals, Inc.

Gravity in the Brain as a Reference for Space and Time Perception

Moving and interacting with the environment require a reference for orientation and a scale for calibration in space and time. There is a wide variety of environmental clues and calibrated frames at different locales, but the reference of gravity is ubiquitous on Earth. The pull of gravity on static objects provides a plummet which, together with the horizontal plane, defines a three-dimensional Cartesian frame for visual images. On the other hand, the gravitational acceleration of falling objects can provide a time-stamp on events, because the motion duration of an object accelerated by gravity over a given path is fixed. Indeed, since ancient times, man has been using plumb bobs for spatial surveying, and water clocks or pendulum clocks for time keeping. Here we review behavioral evidence in favor of the hypothesis that the brain is endowed with mechanisms that exploit the presence of gravity to estimate the spatial orientation and the passage of time. Several visual and non-visual (vestibular, haptic, visceral) cues are merged to estimate the orientation of the visual vertical. However, the relative weight of each cue is not fixed, but depends on the specific task. Next, we show that an internal model of the effects of gravity is combined with multisensory signals to time the interception of falling objects, to time the passage through spatial landmarks during virtual navigation, to assess the duration of a gravitational motion, and to judge the naturalness of periodic motion under gravity.

Familiar trajectories facilitate the interpretation of physical forces when intercepting a moving target

Familiarity with the visual environment affects our expectations about the objects in a scene, aiding in recognition and interaction. Here we tested whether the familiarity with the specific trajectory followed by a moving target facilitates the interpretation of the effects of underlying physical forces. Participants intercepted a target sliding down either an inclined plane or a tautochrone. Gravity accelerated the target by the same amount in both cases, but the inclined plane represented a familiar trajectory whereas the tautochrone was unfamiliar to the participants. In separate sessions, the gravity field was consistent with either natural gravity or artificial reversed gravity. Target motion was occluded from view over the last segment. We found that the responses in the session with unnatural forces were systematically delayed relative to those with natural forces, but only for the inclined plane. The time shift is consistent with a bias for natural gravity, in so far as it reflects an a priori expectation that a target not affected by natural forces will arrive later than one accelerated downwards by gravity. Instead, we did not find any significant time shift with unnatural forces in the case of the tautochrone. We argue that interception of a moving target relies on the integration of the high-level cue of trajectory familiarity with low-level cues related to target kinematics.

Multisensory integration and internal models for sensing gravity effects in primates

Gravity is crucial for spatial perception, postural equilibrium, and movement generation. The vestibular apparatus is the main sensory system involved in monitoring gravity. Hair cells in the vestibular maculae respond to gravitoinertial forces, but they cannot distinguish between linear accelerations and changes of head orientation relative to gravity. The brain deals with this sensory ambiguity (which can cause some lethal airplane accidents) by combining several cues with the otolith signals: angular velocity signals provided by the semicircular canals, proprioceptive signals from muscles and tendons, visceral signals related to gravity, and visual signals. In particular, vision provides both static and dynamic signals about body orientation relative to the vertical, but it poorly discriminates arbitrary accelerations of moving objects. However, we are able to visually detect the specific acceleration of gravity since early infancy. This ability depends on the fact that gravity effects are stored in brain regions which integrate visual, vestibular, and neck proprioceptive signals and combine this information with an internal model of gravity effects.