Gravity as a Strong Prior: Implications for Perception and Action

Realizing the gravity of the simulation: adaptation to simulated hypogravity leads to altered predictive control

Accurate predictive abilities are important for a wide variety of animal behaviors. Inherent to many of these predictions is an understanding of the physics that underlie the behavior. Humans are specifically attuned to the physics on Earth but can learn to move in other environments (e.g., the surface of the Moon). However, the adjustments made to their physics-based predictions in the face of altered gravity are not fully understood. The current study aimed to characterize the locomotor adaptation to a novel paradigm for simulated reduced gravity. We hypothesized that exposure to simulated hypogravity would result in updated predictions of gravity-based movement. Twenty participants took part in a protocol that had them perform vertically targeted countermovement jumps before (PRE), during, and after (POST) a physical simulation of hypogravity. Jumping in simulated hypogravity had different neuromechanics from the PRE condition, with reduced ground impulses (p ≤ .009) and muscle activity prior to the time of landing (i.e., preactivation; p ≤ .016). In the 1 g POST condition, muscle preactivation remained reduced (p ≤ .033) and was delayed (p ≤ .008) by up to 33% for most muscles of the triceps surae, reflecting an expectation of hypogravity. The aftereffects in muscle preactivation, along with little-to-no change in muscle dynamics during ground contact, point to a neuromechanical adaptation that affects predictive, feed-forward systems over feedback systems. As such, we conclude that the neural representation, or internal model, of gravity is updated after exposure to simulated hypogravity.

Resonance tuning of rhythmic movements is disrupted at short time scales: A centrifuge study

The human body exploits its neural mechanisms to optimize actions. Rhythmic movements are optimal when their frequency is close to the natural frequency of the system. In a pendulum, gravity modulates this spontaneous frequency. Participants unconsciously adjust their natural pace when cyclically moving the arm in altered gravity. However, the timescale of this adaptation is unexplored. Participants performed cyclic movements before, during, and after fast transitions between hypergravity levels (1g-3g and 3g-1g) induced by a human centrifuge. Movement periods were modulated with the average value of gravity during transitions. However, while participants increased movement pace on a cycle basis when gravity increased (1g-3g), they did not decrease pace when gravity decreased (3g-1g). We highlight asymmetric effects in the spontaneous adjustment of movement dynamics on short timescales, suggesting the involvement of cognitive factors, beyond standard dynamical models.

Role of the Cerebellum in the Construction of Functional and Geometrical Spaces

The perceptual and motor systems appear to have a set of movement primitives that exhibit certain geometric and kinematic invariances. Complex patterns and mental representations can be produced by (re)combining some simple motor elements in various ways using basic operations, transformations, and respecting a set of laws referred to as kinematic laws of motion. For example, point-to-point hand movements are characterized by straight hand paths with single-peaked-bell-shaped velocity profiles, whereas hand speed profiles for curved trajectories are often irregular and more variable, with speed valleys and inflections extrema occurring at the peak curvature. Curvature and speed are generically related by the 2/3 power law. Mathematically, such laws can be deduced from a combination of Euclidean, affine, and equi-affine geometries, whose neural correlates have been partially detected in various brain areas including the cerebellum and the basal ganglia. The cerebellum has been found to play an important role in the control of coordination, balance, posture, and timing over the past years. It is also assumed that the cerebellum computes forward internal models in relationship with specific cortical and subcortical brain regions but its motor relationship with the perceptual space is unclear. A renewed interest in the geometrical and spatial role of the cerebellum may enable a better understanding of its specific contribution to the action-perception loop and behavior's adaptation. In this sense, we complete this overview with an innovative theoretical framework that describes a possible implementation and selection by the cerebellum of geometries adhering to different mathematical laws.

A binary acceleration signal reduces overestimation in pedestrians' visual time-to-collision estimation for accelerating vehicles

When a pedestrian intends to cross the street, it is essential for safe mobility to correctly estimate the arrival time (time-to-collision, TTC) of an approaching vehicle. However, visual perception of acceleration is rather imprecise. Previous studies consistently showed that humans (mostly) disregard acceleration, but judge the TTC for an object as if it were traveling at constant speed (first-order estimation), which is associated with overestimated TTCs for positively accelerating objects. In a traffic context, such TTC overestimation could motivate pedestrians to cross in front of an approaching vehicle, although the time remaining is not sufficiently long. Can a simple acceleration signal help improve visual TTC estimation for accelerating objects? The present study investigated whether a signal that only indicates whether a vehicle is accelerating or not can remove the first-order pattern of overestimated TTCs. In a virtual reality simulation, 26 participants estimated the TTC of vehicles that approached with constant velocity or accelerated, from the perspective of a pedestrian at the curb. In half of the experimental blocks, a light band on the windshield illuminated whenever the vehicle accelerated but remained deactivated when the vehicle travelled at a constant speed. In the other blocks, the light band never illuminated, regardless of whether or not the vehicle accelerated. Participants were informed about the light band function in each block. Without acceleration signal, the estimated TTCs for the accelerating vehicles were consistent with an erroneous first-order approximation. In blocks with acceleration signal, participants substantially changed their estimation strategy, so that TTC overestimations for accelerating vehicles were reduced. Our data suggest that a binary acceleration signal helps pedestrians to effectively reduce the TTC overestimation for accelerating vehicles and could therefore increase pedestrian safety.

A visual bias for falling objects

Aristotle believed that objects fell at a constant velocity. However, Galileo Galilei showed that when an object falls, gravity causes it to accelerate. Regardless, Aristotle's claim raises the possibility that people's visual perception of falling motion might be biased away from acceleration towards constant velocity. We tested this idea by requiring participants to judge whether a ball moving in a simulated naturalistic setting appeared to accelerate or decelerate as a function of its motion direction and the amount of acceleration/deceleration. We found that the point of subjective constant velocity (PSCV) differed between up and down but not between left and right motion directions. The PSCV difference between up and down indicated that more acceleration was needed for a downward-falling object to appear at constant velocity than for an upward "falling" object. We found no significant differences in sensitivity to acceleration for the different motion directions. Generalized linear mixed modeling determined that participants relied predominantly on acceleration when making these judgments. Our results support the idea that Aristotle's belief may in part be due to a bias that reduces the perceived magnitude of acceleration for falling objects, a bias not revealed in previous studies of the perception of visual motion.

Interception of vertically approaching objects: temporal recruitment of the internal model of gravity and contribution of optical information

Introduction: Recent views posit that precise control of the interceptive timing can be achieved by combining on-line processing of visual information with predictions based on prior experience. Indeed, for interception of free-falling objects under gravity's effects, experimental evidence shows that time-to-contact predictions can be derived from an internal gravity representation in the vestibular cortex. However, whether the internal gravity model is fully engaged at the target motion outset or reinforced by visual motion processing at later stages of motion is not yet clear. Moreover, there is no conclusive evidence about the relative contribution of internalized gravity and optical information in determining the time-to-contact estimates. Methods: We sought to gain insight on this issue by asking 32 participants to intercept free falling objects approaching directly from above in virtual reality. Object motion had durations comprised between 800 and 1100 ms and it could be either congruent with gravity (1 g accelerated motion) or not (constant velocity or -1 g decelerated motion). We analyzed accuracy and precision of the interceptive responses, and fitted them to Bayesian regression models, which included predictors related to the recruitment of a priori gravity information at different times during the target motion, as well as based on available optical information. Results: Consistent with the use of internalized gravity information, interception accuracy and precision were significantly higher with 1 g motion. Moreover, Bayesian regression indicated that interceptive responses were predicted very closely by assuming engagement of the gravity prior 450 ms after the motion onset, and that adding a predictor related to on-line processing of optical information improved only slightly the model predictive power. Discussion: Thus, engagement of a priori gravity information depended critically on the processing of the first 450 ms of visual motion information, exerting a predominant influence on the interceptive timing, compared to continuously available optical information. Finally, these results may support a parallel processing scheme for the control of interceptive timing.

Neurocognitive Adaptations for Spatial Orientation and Navigation in Astronauts

Astronauts often face orientation challenges while on orbit, which can lead to operator errors in demanding spatial tasks. In this study, we investigated the impact of long-duration spaceflight on the neural processes supporting astronauts' spatial orientation skills. Using functional magnetic resonance imaging (fMRI), we collected data from 16 astronauts six months before and two weeks after their International Space Station (ISS) missions while performing a spatial orientation task that requires generating a mental representation of one's surroundings. During this task, astronauts exhibited a general reduction in neural activity evoked from spatial-processing brain regions after spaceflight. The neural activity evoked in the precuneus was most saliently reduced following spaceflight, along with less powerful effects observed in the angular gyrus and retrosplenial regions of the brain. Importantly, the reduction in precuneus activity we identified was not accounted for by changes in behavioral performance or changes in grey matter concentration. These findings overall show less engagement of explicitly spatial neurological processes at postflight, suggesting astronauts make use of complementary strategies to perform some spatial tasks as an adaptation to spaceflight. These preliminary findings highlight the need for developing countermeasures or procedures that minimize the detrimental effects of spaceflight on spatial cognition, especially in light of planned long-distance future missions.

Cognitive-perceptual traits associated with autism and schizotypy influence use of physics during predictive visual tracking

Schizophrenia and autism spectrum disorder (ASD) can disrupt cognition and consequently behaviour. Traits of ASD and the subclinical manifestation of schizophrenia called schizotypy have been studied in healthy populations with overlap found in trait profiles linking ASD social deficits to negative schizotypy and ASD attention to detail to positive schizotypy. Here, we probed the relationship between subtrait profiles, cognition and behaviour, using a predictive tracking task to measure individuals' eye movements under three gravity conditions. A total of 48 healthy participants tracked an on-screen projected ball under familiar gravity, inverted upward acceleration (against gravity) and horizontal gravity control conditions while eye movements were recorded and dynamic performance quantified. Participants completed ASD and schizotypy inventories generating highly correlated scores, r = 0.73. All tracked best under the gravity condition, producing anticipatory downward responses from stimulus onset which were delayed under upward inverted gravity. Tracking performance was not associated with overall ASD or schizotypy trait levels. Combining measures using principal components analysis (PCA), we decomposed the inventories into subtraits unveiling interesting patterns. Positive schizotypy was associated with ASD dimensions of rigidity, odd behaviour and face processing, which all linked to anticipatory tracking responses under inverted gravity. In contrast, negative schizotypy was associated with ASD dimensions of social interactions and rigidity and to early stimulus-driven tracking under gravity. There was also substantial nonspecific overlap between ASD and schizotypy dissociated from tracking. Our work links positive-odd traits with anticipatory tracking when physics rules are violated and negative-social traits with exploitation of physics laws of motion.

Mental Gravity: Depression as Spacetime Curvature of the Self, Mind, and Brain

The principle of mental gravity contends that the mind uses physical gravity as a mental model or simulacrum to express the relation between the inner self and the outer world in terms of "UP"-ness and "DOWN"-ness. The simulation of increased gravity characterises a continuum of mental gravity which states includes depression as the paradigmatic example of being down, low, heavy, and slow. The physics of gravity can also be used to model spacetime curvature in depression, particularly gravitational time dilation as a property of MG analogous to subjective time dilation (i.e., the slowing of temporal flow in conscious experience). The principle has profound implications for the Temporo-spatial Theory of Consciousness (TTC) with regard to temporo-spatial alignment that establishes a "world-brain relation" that is centred on embodiment and the socialisation of conscious states. The principle of mental gravity provides the TTC with a way to incorporate the structure of the world into the structure of the brain, conscious experience, and thought. In concert with other theories of cognitive and neurobiological spacetime, the TTC can also work towards the "common currency" approach that also potentially connects the TTC to predictive processing frameworks such as free energy, neuronal gauge theories, and active inference accounts of depression. It gives the up/down dimension of space, as defined by the gravitational field, a unique status that is connected to both our embodied interaction with the physical world, and also the inverse, reflective, emotional but still embodied experience of ourselves.

Trial-by-trial feedback fails to improve the consideration of acceleration in visual time-to-collision estimation

When judging the time-to-collision (TTC) of visually presented accelerating vehicles, untrained observers do not adequately account for acceleration (second-order information). Instead, their estimations only rely on vehicle distance and velocity (first-order information). As a result, they systemically overestimate the TTC for accelerating objects, which represents a potential risk for pedestrians in traffic situations because it might trigger unsafe road-crossing behavior. Can training help reduce these estimation errors? In this study, we tested whether training with trial-by-trial feedback about the signed deviation of the estimated from the actual TTC can improve TTC estimation accuracy for accelerating vehicles. Using a prediction-motion paradigm, we measured the estimated TTCs of twenty participants for constant-velocity and accelerated vehicle approaches, from a pedestrian's perspective in a VR traffic simulation. The experiment included three blocks, of which only the second block provided trial-by-trial feedback about the TTC estimation accuracy. Participants adjusted their estimations during and after the feedback, but they failed to differentiate between accelerated and constant-velocity approaches. Thus, the feedback did not help them account for acceleration. The results suggest that a safety training program based on trial-by-trial feedback is not a promising countermeasure against pedestrians' erroneous TTC estimation for accelerating objects.

Pharmacological and non-pharmacological countermeasures to Space Motion Sickness: a systematic review

Introduction

Space Motion Sickness (SMS) is a syndrome that affects around 70% of astronauts and includes symptoms of nausea, dizziness, fatigue, vertigo, headaches, vomiting, and cold sweating. Consequences range from discomfort to severe sensorimotor and cognitive incapacitation, which might cause potential problems for mission-critical tasks and astronauts and cosmonauts' well-being. Both pharmacological and non-pharmacological countermeasures have been proposed to mitigate SMS. However, their effectiveness has not been systematically evaluated. Here we present the first systematic review of published peer-reviewed research on the effectiveness of pharmacological and non-pharmacological countermeasures to SMS.

Methods

We performed a double-blind title and abstract screening using the online Rayyan collaboration tool for systematic reviews, followed by a full-text screening. Eventually, only 23 peer-reviewed studies underwent data extraction.

Results

Both pharmacological and non-pharmacological countermeasures can help mitigate SMS symptoms.

Discussion

No definitive recommendation can be given regarding the superiority of any particular countermeasure approach. Importantly, there is considerable heterogeneity in the published research methods, lack of a standardized assessment approach, and small sample sizes. To allow for consistent comparisons between SMS countermeasures in the future, standardized testing protocols for spaceflight and ground-based analogs are needed. We believe that the data should be made openly available, given the uniqueness of the environment in which it is collected.

Systematic review registration

https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42021244131.

Microgravity induces overconfidence in perceptual decision-making

Does gravity affect decision-making? This question comes into sharp focus as plans for interplanetary human space missions solidify. In the framework of Bayesian brain theories, gravity encapsulates a strong prior, anchoring agents to a reference frame via the vestibular system, informing their decisions and possibly their integration of uncertainty. What happens when such a strong prior is altered? We address this question using a self-motion estimation task in a space analog environment under conditions of altered gravity. Two participants were cast as remote drone operators orbiting Mars in a virtual reality environment on board a parabolic flight, where both hyper- and microgravity conditions were induced. From a first-person perspective, participants viewed a drone exiting a cave and had to first predict a collision and then provide a confidence estimate of their response. We evoked uncertainty in the task by manipulating the motion's trajectory angle. Post-decision subjective confidence reports were negatively predicted by stimulus uncertainty, as expected. Uncertainty alone did not impact overt behavioral responses (performance, choice) differentially across gravity conditions. However microgravity predicted higher subjective confidence, especially in interaction with stimulus uncertainty. These results suggest that variables relating to uncertainty affect decision-making distinctly in microgravity, highlighting the possible need for automatized, compensatory mechanisms when considering human factors in space research.

Perceiving animacy from kinematics: visual specification of life-likeness in simple geometric patterns

Since the seminal work of Heider and Simmel, and Michotte's research, many studies have shown that, under appropriate conditions, displays of simple geometric shapes elicit rich and vivid impressions of animacy and intentionality. The main purpose of this review is to emphasize the close relationship between kinematics and perceived animacy by showing which specific motion cues and spatiotemporal patterns automatically trigger visual perceptions of animacy and intentionality. The animacy phenomenon has been demonstrated to be rather fast, automatic, irresistible, and highly stimulus-driven. Moreover, there is growing evidence that animacy attributions, although usually associated with higher-level cognition and long-term memory, may reflect highly specialized visual processes that have evolved to support adaptive behaviors critical for survival. The hypothesis of a life-detector hardwired in the perceptual system is also supported by recent studies in early development and animal cognition, as well as by the issue of the "irresistibility" criterion, i.e., the persistence of animacy perception in adulthood even in the face of conflicting background knowledge. Finally, further support for the hypothesis that animacy is processed in the earliest stages of vision comes from recent experimental evidence on the interaction of animacy with other visual processes, such as visuomotor performance, visual memory, and speed estimation. Summarizing, the ability to detect animacy in all its nuances may be related to the visual system's sensitivity to those changes in kinematics - considered as a multifactorial relational system - that are associated with the presence of living beings, as opposed to the natural, inert behavior of physically constrained, form-invariant objects, or even mutually independent moving agents. This broad predisposition would allow the observer not only to identify the presence of animates and to distinguish them from inanimate, but also to quickly grasp their psychological, emotional, and social characteristics.

Motor invariants in action execution and perception

The nervous system is sensitive to statistical regularities of the external world and forms internal models of these regularities to predict environmental dynamics. Given the inherently social nature of human behavior, being capable of building reliable predictive models of others' actions may be essential for successful interaction. While social prediction might seem to be a daunting task, the study of human motor control has accumulated ample evidence that our movements follow a series of kinematic invariants, which can be used by observers to reduce their uncertainty during social exchanges. Here, we provide an overview of the most salient regularities that shape biological motion, examine the role of these invariants in recognizing others' actions, and speculate that anchoring socially-relevant perceptual decisions to such kinematic invariants provides a key computational advantage for inferring conspecifics' goals and intentions.

Health Implications of Virtual Architecture: An Interdisciplinary Exploration of the Transferability of Findings from Neuroarchitecture

Virtual architecture has been increasingly relied on to evaluate the health impacts of physical architecture. In this health research, exposure to virtual architecture has been used as a proxy for exposure to physical architecture. Despite the growing body of research on the health implications of physical architecture, there is a paucity of research examining the long-term health impacts of prolonged exposure to virtual architecture. In response, this paper considers: what can proxy studies, which use virtual architecture to assess the physiological response to physical architecture, tell us about the impact of extended exposure to virtual architecture on human health? The paper goes on to suggest that the applicability of these findings to virtual architecture may be limited by certain confounding variables when virtual architecture is experienced for a prolonged period of time. This paper explores the potential impact of two of these confounding variables: multisensory integration and gravitational perception. This paper advises that these confounding variables are unique to extended virtual architecture exposure and may not be captured by proxy studies that aim to capture the impact of physical architecture on human health through acute exposure to virtual architecture. While proxy studies may be suitable for measuring some aspects of the impact of both physical and virtual architecture on human health, this paper argues that they may be insufficient to fully capture the unintended consequences of extended exposure to virtual architecture on human health. Therefore, in the face of the increasing use of virtual architectural environments, the author calls for the establishment of a subfield of neuroarchitectural health research that empirically examines the physiological impacts of extended exposure to virtual architecture in its own right.

Tapping on a target: dealing with uncertainty about its position and motion

Reaching movements are guided by estimates of the target object's location. Since the precision of instantaneous estimates is limited, one might accumulate visual information over time. However, if the object is not stationary, accumulating information can bias the estimate. How do people deal with this trade-off between improving precision and reducing the bias? To find out, we asked participants to tap on targets. The targets were stationary or moving, with jitter added to their positions. By analysing the response to the jitter, we show that people continuously use the latest available information about the target's position. When the target is moving, they combine this instantaneous target position with an extrapolation based on the target's average velocity during the last several hundred milliseconds. This strategy leads to a bias if the target's velocity changes systematically. Having people tap on accelerating targets showed that the bias that results from ignoring systematic changes in velocity is removed by compensating for endpoint errors if such errors are consistent across trials. We conclude that combining simple continuous updating of visual information with the low-pass filter characteristics of muscles, and adjusting movements to compensate for errors made in previous trials, leads to the precise and accurate human goal-directed movements.

Humans Can Track But Fail to Predict Accelerating Objects

Objects in our visual environment often move unpredictably and can suddenly speed up or slow down. The ability to account for acceleration when interacting with moving objects can be critical for survival. Here, we investigate how human observers track an accelerating target with their eyes and predict its time of reappearance after a temporal occlusion by making an interceptive hand movement. Before occlusion, observers smoothly tracked the accelerating target with their eyes. At the time of occlusion, observers made a predictive saccade to the location where they subsequently intercepted the target with a quick pointing movement. We tested how observers integrated target motion information by comparing three alternative models that describe time-to-contact (TTC) based on the (1) final target velocity sample before occlusion, (2) average target velocity before occlusion, or (3) final target velocity and the rate of target acceleration. We show that observers were able to accurately track the accelerating target with visually-guided smooth pursuit eye movements. However, the timing of the predictive saccade and manual interception revealed inability to act on target acceleration when predicting TTC. Instead, interception timing was best described by the final velocity model that relies on extrapolating the last available target velocity sample before occlusion. Moreover, predictive saccades and manual interception showed similar insensitivity to target acceleration and were correlated on a trial-by-trial basis. These findings provide compelling evidence for the failure of integrating target acceleration into predictive models of target motion that drive both interceptive eye and hand movements.

Express: Cognition in Zero Gravity: Effects of Non-Terrestrial Gravity on Human Behaviour

As humanity prepares for deep space exploration, understanding the impact of spaceflight on bodily physiology is critical. While the effects of non-terrestrial gravity on the body are well established, little is known about its impact on human behaviour and cognition. Astronauts often describe dramatic alterations in sensorimotor functioning, including orientation, postural control and balance. Changes in cognitive functioning as well as in socio-affective processing have also been observed. Here we have reviewed the key literature and explored the impact of non-terrestrial gravity across three key functional domains: sensorimotor, cognition, and socio-affective processing. We have proposed a neuroanatomical model to account for the effects of non-terrestrial gravity in these domains. Understanding the impact of non-terrestrial gravity on human behaviour has never been more timely and it will help mitigate against risks in both commercial and non-commercial spaceflight.

Breaking Plausibility Without Breaking Presence - Evidence For The Multi-Layer Nature Of Plausibility

A novel theoretical model recently introduced coherence and plausibility as the essential conditions of XR experiences, challenging contemporary presence-oriented concepts. This article reports on two experiments validating this model, which assumes coherence activation on three layers (cognition, perception, and sensation) as the potential sources leading to a condition of plausibility and from there to other XR qualia such as presence or body ownership. The experiments introduce and utilize breaks in plausibility (in analogy to breaks in presence): We induce incoherence on the perceptual and the cognitive layer simultaneously by a simulation of object behaviors that do not conform to the laws of physics, i.e., gravity. We show that this manipulation breaks plausibility and hence confirm that it results in the desired effects in the theorized condition space but that the breaks in plausibility did not affect presence. In addition, we show that a cognitive manipulation by a storyline framing is too weak to successfully counteract the strong bottom-up inconsistencies. Both results are in line with the predictions of the recently introduced three-layer model of coherence and plausibility, which incorporates well-known top-down and bottom-up rivalries and its theorized increased independence between plausibility and presence.

Estimations of the Passing Height of Approaching Objects

SIGNIFICANCE

Limited optical cues associated with ball flight were inadequate to estimate the vertical passing distance of approaching balls. These results suggest that these optical cues either must be integrated with contextual and kinematic cues or must be of larger amplitude to contribute to estimates of vertical passing distance.

PURPOSE

To intercept or avoid approaching objects, individuals must estimate both when and where the object will arrive. The purpose of this experiment was to determine whether individuals could estimate the vertical passing height of a ball approaching at different linear speeds when vertical angular retinal image velocity and cues for time to contact were minimized.

METHODS

Twenty participants stood 40 feet from a pitching machine that projected tennis balls toward observers at six random speeds from 56 to 80 mph. The flight of the balls was stopped after 9 feet. The actual passing height ranged from about 35 (lowest speed) to 136 cm (highest speed). Observers indicated the height at which they expected the balls to arrive. Overall, the height estimates increased as ball speed increased (means, 121 ± 13 cm [lowest speed] and 131 ± 10 cm [highest speed]). However, only at the higher speeds were the absolute height estimates close to the actual height of the ball. At the higher ball speeds, estimates for participants with some experience in baseball or softball were more accurate (86.4% correct at the highest speed) than estimates for participants with no experience.

CONCLUSIONS

Overall, estimates of vertical passing distance were inaccurate particularly at the lower speeds. Underestimates of vertical drop at lower speeds may have resulted from overestimates of ball speeds. At short exposure durations, optical cues associated with ball flight were inadequate for predictions of vertical passing distance at all speeds for the no-experience group and at lower speeds for the experienced group.

Human movements do not look the same in a tilted world: Gravitational constraints influence the perception of biological motion

We investigated whether gravitational constraints influence the interaction of visual, proprioceptive and vestibular cues for Biological Motion Perception (BMP). Participants were asked to distinguish between plausible and random point-light movements, while passively placed in either an upright or a tilted body orientation. Manipulating the body orientation with respect to gravity leads to different gravitational signals transmitted by the visual, proprioceptive, and vestibular systems. Participants were overall faster in distinguishing plausible point-light movements than random movements. Critically, response times for biologically plausible point-light movements - but not for random movements - were significantly prolonged in the tilted body orientation. Our results suggest that BMP depends not only on the spatial-temporal cues embedded in point-light movements but also rely on the congruency between current gravitational signals detected by the sensory systems and our previous knowledge of terrestrial gravity. STATEMENT OF RELEVANCE: As humankind is preparing for a new space age, understanding how gravity influences behaviour and cognition has never been more pressing. All living organisms have evolved to survive in a terrestrial gravitational field. Although we cannot consciously feel gravity, it has an impact in our life: it affects how we move and interact with the external environment. The sensory signals from the vestibular system are continuously combined with visual and proprioceptive cues to help us in maintaining a stable representation of the world. Here we placed participants in a tilted body orientation and were able to determine that a conflict between prior gravitational knowledge and what was actively sensed about gravity affected human Biological Movement Perception. Humans suffer changes in perception under non-terrestrial gravity conditions that may potentially compromise performance during space exploration.

Naturalistic embodied interactions elicit intuitive physical behaviour in accordance with Newtonian physics

The success of visuomotor interactions in everyday activities such as grasping or sliding a cup is inescapably governed by the laws of physics. Research on intuitive physics has predominantly investigated reasoning about objects' behaviour involving binary forced choice responses. We investigated how the type of visuomotor response influences participants' beliefs about physical quantities and their lawful relationship implicit in their active behaviour. Participants propelled pucks towards targets positioned at different distances. Analysis with a probabilistic model of interactions showed that subjects adopted the non-linear control prescribed by Newtonian physics when sliding real pucks in a virtual environment even in the absence of visual feedback. However, they used a linear heuristic when viewing the scene on a monitor and interactions were implemented through key presses. These results support the notion of probabilistic internal physics models but additionally suggest that humans can take advantage of embodied, sensorimotor, multimodal representations in physical scenarios.

Judgments of Object Size and Distance across Different Virtual Reality Environments: A Preliminary Study

Emerging technologies offer the potential to expand the domain of the future workforce to extreme environments, such as outer space and alien terrains. To understand how humans navigate in such environments that lack familiar spatial cues this study examined spatial perception in three types of environments. The environments were simulated using virtual reality. We examined participants’ ability to estimate the size and distance of stimuli under conditions of minimal, moderate, or maximum visual cues, corresponding to an environment simulating outer space, an alien terrain, or a typical cityscape, respectively. The findings show underestimation of distance in both the maximum and the minimum visual cue environment but a tendency for overestimation of distance in the moderate environment. We further observed that depth estimation was substantially better in the minimum environment than in the other two environments. However, estimation of height was more accurate in the environment with maximum cues (cityscape) than the environment with minimum cues (outer space). More generally, our results suggest that familiar visual cues facilitated better estimation of size and distance than unfamiliar cues. In fact, the presence of unfamiliar, and perhaps misleading visual cues (characterizing the alien terrain environment), was more disruptive than an environment with a total absence of visual cues for distance and size perception. The findings have implications for training workers to better adapt to extreme environments.

Watching the Effects of Gravity. Vestibular Cortex and the Neural Representation of "Visual" Gravity

Gravity is a physical constraint all terrestrial species have adapted to through evolution. Indeed, gravity effects are taken into account in many forms of interaction with the environment, from the seemingly simple task of maintaining balance to the complex motor skills performed by athletes and dancers. Graviceptors, primarily located in the vestibular otolith organs, feed the Central Nervous System with information related to the gravity acceleration vector. This information is integrated with signals from semicircular canals, vision, and proprioception in an ensemble of interconnected brain areas, including the vestibular nuclei, cerebellum, thalamus, insula, retroinsula, parietal operculum, and temporo-parietal junction, in the so-called vestibular network. Classical views consider this stage of multisensory integration as instrumental to sort out conflicting and/or ambiguous information from the incoming sensory signals. However, there is compelling evidence that it also contributes to an internal representation of gravity effects based on prior experience with the environment. This a priori knowledge could be engaged by various types of information, including sensory signals like the visual ones, which lack a direct correspondence with physical gravity. Indeed, the retinal accelerations elicited by gravitational motion in a visual scene are not invariant, but scale with viewing distance. Moreover, the "visual" gravity vector may not be aligned with physical gravity, as when we watch a scene on a tilted monitor or in weightlessness. This review will discuss experimental evidence from behavioral, neuroimaging (connectomics, fMRI, TMS), and patients' studies, supporting the idea that the internal model estimating the effects of gravity on visual objects is constructed by transforming the vestibular estimates of physical gravity, which are computed in the brainstem and cerebellum, into internalized estimates of virtual gravity, stored in the vestibular cortex. The integration of the internal model of gravity with visual and non-visual signals would take place at multiple levels in the cortex and might involve recurrent connections between early visual areas engaged in the analysis of spatio-temporal features of the visual stimuli and higher visual areas in temporo-parietal-insular regions.

Gravity and Known Size Calibrate Visual Information to Time Parabolic Trajectories

Catching a ball in a parabolic flight is a complex task in which the time and area of interception are strongly coupled, making interception possible for a short period. Although this makes the estimation of time-to-contact (TTC) from visual information in parabolic trajectories very useful, previous attempts to explain our precision in interceptive tasks circumvent the need to estimate TTC to guide our action. Obtaining TTC from optical variables alone in parabolic trajectories would imply very complex transformations from 2D retinal images to a 3D layout. We propose based on previous work and show by using simulations that exploiting prior distributions of gravity and known physical size makes these transformations much simpler, enabling predictive capacities from minimal early visual information. Optical information is inherently ambiguous, and therefore, it is necessary to explain how these prior distributions generate predictions. Here is where the role of prior information comes into play: it could help to interpret and calibrate visual information to yield meaningful predictions of the remaining TTC. The objective of this work is: (1) to describe the primary sources of information available to the observer in parabolic trajectories; (2) unveil how prior information can be used to disambiguate the sources of visual information within a Bayesian encoding-decoding framework; (3) show that such predictions might be robust against complex dynamic environments; and (4) indicate future lines of research to scrutinize the role of prior knowledge calibrating visual information and prediction for action control.

Review: Head and Eye Movements and Gaze Tracking in Baseball Batting

SIGNIFICANCE

After a 30-year gap, several studies on head and eye movements and gaze tracking in baseball batting have been performed in the last decade. These baseball studies may lead to training protocols for batting. Here we review these studies and compare the tracking behaviors with those in other sports.Baseball batters are often instructed to "keep your eye on the ball." Until recently, the evidence regarding whether batters follow this instruction and if there are benefits to following this instruction was limited. Baseball batting studies demonstrate that batters tend to move the head more than the eyes in the direction of the ball at least until a saccade occurs. Foveal gaze tracking is often maintained on the ball through the early portion of the pitch, so it can be said that baseball batters do keep the eyes on the ball. While batters place gaze at or near the point of bat-ball contact, the way this is accomplished varies. In some studies, foveal gaze tracking continues late in the pitch trajectory, whereas in other studies, anticipatory saccades occur. The relative advantages of these discrepant gaze strategies on perceptual processing and motor planning speed and accuracy are discussed, and other variables that may influence anticipatory saccades including the predictability of the pitch and the level of batter expertise are described. Further studies involving larger groups with different levels of expertise under game conditions are required to determine which gaze tracking strategies are most beneficial for baseball batting.

Where is my hand in space? The internal model of gravity influences proprioception

Knowing where our limbs are in space is crucial for a successful interaction with the external world. Joint position sense (JPS) relies on both cues from muscle spindles and joint mechanoreceptors, as well as the effort required to move. However, JPS may also rely on the perceived external force on the limb, such as the gravitational field. It is well known that the internal model of gravity plays a large role in perception and behaviour. Thus, we have explored whether direct vestibular-gravitational cues could influence JPS. Participants passively estimated the position of their hand while they were upright and therefore aligned with terrestrial gravity, or pitch-tilted 45° backwards from gravity. Overall participants overestimated the position of their hand in both upright and tilted postures; however, the proprioceptive bias was significantly reduced when participants were tilted. Our findings therefore suggest that the internal model of gravity may influence and update JPS in order to allow the organism to interact with the environment.

The role of eye movements in manual interception: A mini-review

When we catch a moving object in mid-flight, our eyes and hands are directed toward the object. Yet, the functional role of eye movements in guiding interceptive hand movements is not yet well understood. This review synthesizes emergent views on the importance of eye movements during manual interception with an emphasis on laboratory studies published since 2015. We discuss the role of eye movements in forming visual predictions about a moving object, and for enhancing the accuracy of interceptive hand movements through feedforward (extraretinal) and feedback (retinal) signals. We conclude by proposing a framework that defines the role of human eye movements for manual interception accuracy as a function of visual certainty and object motion predictability.

Distinct adaptation patterns between grip dynamics and arm kinematics when the body is upside-down

In humans, practically all movements are learnt and performed in a constant gravitational field. Yet, studies on arm movements and object manipulation in parabolic flight have highlighted very fast sensorimotor adaptations to altered gravity environments. Here, we wondered if the motor adjustments observed in those altered gravity environments could also be observed on Earth in a situation where the body is upside-down. To address this question, we asked participants to perform rhythmic arm movements in two different body postures (right-side-up and upside-down) while holding an object in precision grip. Analyses of grip-load force coordination and of movement kinematics revealed distinct adaptation patterns between grip and arm control. Grip force and load force were tightly synchronized from the first movements performed in upside-down posture, reflecting a malleable allocentric grip control. In contrast, velocity profiles showed a more progressive adaptation to the upside-down posture and reflected an egocentric planning of arm kinematics. In addition to suggesting distinct mechanisms between grip dynamics and arm kinematics for adaptation to novel contexts, these results also suggest the existence of general mechanisms underlying gravity-dependent motor adaptation that can be used for fast sensorimotor coordination across different postures on Earth and, incidentally, across different gravitational conditions in parabolic flights, in human centrifuges, or in Space.NEW & NOTEWORTHY During rhythmic arm movements performed in an upside-down posture, grip control adapted very quickly, but kinematics adaptation was more progressive. Our results suggest that grip control and movement kinematics planning might operate in different reference frames. Moreover, by comparing our results with previous results from parabolic flight studies, we propose that a common mechanism underlies adaptation to unfamiliar body postures and adaptation to altered gravity.

Turning the Face Inversion Effect on Its Head: Violated Expectations of Orientation, Lighting, and Gravity Enhance N170 Amplitudes

Face inversion effects occur for both behavioral and electrophysiological responses when people view faces. In EEG, inverted faces are often reported to evoke an enhanced amplitude and delayed latency of the N170 ERP. This response has been attributed to the indexing of specialized face processing mechanisms within the brain. However, inspection of the literature revealed that, although N170 is consistently delayed to a variety of face representations, only photographed faces invoke enhanced N170 amplitudes upon inversion. This suggests that the increased N170 amplitudes to inverted faces may have other origins than the inversion of the face's structure. We hypothesize that the unique N170 amplitude response to inverted photographed faces stems from multiple expectation violations, over and above structural inversion. For instance, rotating an image of a face upside-down not only violates the expectation that faces appear upright but also lifelong priors about illumination and gravity. We recorded EEG while participants viewed face stimuli (upright vs. inverted), where the faces were illuminated from above versus below, and where the models were photographed upright versus hanging upside-down. The N170 amplitudes were found to be modulated by a complex interaction between orientation, lighting, and gravity factors, with the amplitudes largest when faces consistently violated all three expectations. These results confirm our hypothesis that face inversion effects on N170 amplitudes are driven by a violation of the viewer's expectations across several parameters that characterize faces, rather than a disruption in the configurational disposition of its features.

A Bird's eye view from below: Activity in the temporo-parietal junction predicts from-above Necker Cube percepts

The temporo-parietal junction (TPJ) consistently emerges in other-regarding behavior, including tasks probing affective phenomena such as morality and empathy. Yet the TPJ is also recruited in processes with no affective or social component, such as visuo-spatial processing and mathematical cognition. We present serendipitous findings from a perceptual decision-making task on a bistable stimulus, the Necker Cube, performed in an MRI scanner. The stimulus in question is a transparent, wire-frame cube that evokes spontaneous switches in perception. Individuals can view the cube from below or from above, though a consistent bias is shown towards seeing the cube from above. We replicate this bias, finding participants spend more time in the from-above percept. However, in testing for BOLD differences between percept orientations, we found robust responses in bilateral TPJ for the from-above > from-below perceptual state. We speculate that this neural response comes from the sensory incongruence of viewing an object from above while lying supine in the scanner. We further speculate that the TPJ resolves this incongruence by facilitating an egocentric projection. Such a function would explain the TPJ's ubiquitous response to other-regarding, visuo-spatial and mathematical cognition, as all these phenomena demand an ability to ambulate through the coordinate space. Our findings suggest the TPJ may not play a specific role in social or moral components of other-regarding behavior, such as altruism, and further indirectly suggest that "pure", allocentric altruism may not correlate with the TPJ. Results further have implications on how the TPJ may be modulated by activities such as flight or drone operation. Finally, this study highlights the possible need for congruence between stimuli and body position in neuroimaging studies.

The Effects of Visual Parabolic Motion on the Subjective Vertical and on Interception

Observers typically present a strong bias in estimating the orientation of a visual bar when their body is tilted >60° in the roll plane and in the absence of visual background information. Known as the A-effect, this phenomenon likely results from the under-compensation of body tilt. Static visual cues can reduce such bias in the perceived vertical. Yet, it is unknown whether dynamic visual cues would be also effective. Here we presented projectile motions of a visual target along parabolic trajectories with different orientations relative to physical gravity. The aim of the experiment was twofold: First, we assessed whether the projectile motions could bias the estimation of the perceived orientation of a visual bar, measured with a classical subjective visual vertical (SVV) task. Second, we evaluated whether the ability to estimate time-to-contact of the visual target in an interception task was influenced by the orientation of these parabolic trajectories. Two groups of participants performed the experiment, either with their head and body tilted 90° along the roll plane or in an upright position. We found that the perceived orientation of the visual bar in the SVV task was affected by the orientation of the parabolic trajectories. This result was present in the tilted but not in the upright participants. In the interception task, the timing error increased linearly as a function of the orientation of the parabola. These results support the hypothesis that a gravity vector estimated from dynamic visual stimuli contributes to the subjective visual vertical.

Determining mean and standard deviation of the strong gravity prior through simulations

Humans expect downwards moving objects to accelerate and upwards moving objects to decelerate. These results have been interpreted as humans maintaining an internal model of gravity. We have previously suggested an interpretation of these results within a Bayesian framework of perception: earth gravity could be represented as a Strong Prior that overrules noisy sensory information (Likelihood) and therefore attracts the final percept (Posterior) very strongly. Based on this framework, we use published data from a timing task involving gravitational motion to determine the mean and the standard deviation of the Strong Earth Gravity Prior. To get its mean, we refine a model of mean timing errors we proposed in a previous paper (Jörges & López-Moliner, 2019), while expanding the range of conditions under which it yields adequate predictions of performance. This underscores our previous conclusion that the gravity prior is likely to be very close to 9.81 m/s2. To obtain the standard deviation, we identify different sources of sensory and motor variability reflected in timing errors. We then model timing responses based on quantitative assumptions about these sensory and motor errors for a range of standard deviations of the earth gravity prior, and find that a standard deviation of around 2 m/s2 makes for the best fit. This value is likely to represent an upper bound, as there are strong theoretical reasons along with supporting empirical evidence for the standard deviation of the earth gravity being lower than this value.

Evidence of inverted gravity-driven variation in predictive sensorimotor function

We move our eyes to place the fovea into the part of a viewed scene currently of interest. Recent evidence suggests that each human has signature patterns of eye movements like handwriting which depend on their sensitivity, allocation of attention and experience. Use of implicit knowledge of how earth's gravity influences object motion has been shown to aid dynamic perception. We used a projected ball-tracking task with a plain background offering no context cues to probe the effect of acquired experience about physical laws of gravitation on performance differences of 44 participants under a simulated gravity and an atypical (upward) antigravity condition. Performance measured by the unsigned difference between instantaneous eye and stimulus positions (RMSE) was consistently worse in the antigravity condition. In the vertical RMSE, participants took about 200 ms longer to improve to the best performance for antigravity compared to gravity trials. The antigravity condition produced a divergence of individual performance which was correlated with levels of questionnaire-based quantified traits of schizotypy but not control traits. Grouping participants by high or low traits revealed a negative relationship between schizotypy trait level and both initiation and maintenance of tracking, a result consistent with trait-related impoverished sensory prediction. The findings confirm for the first time that where cues enabling exact estimation of acceleration are unavailable, knowledge of gravity contributes to dynamic prediction improving motion processing. With acceleration expectations violated, we demonstrate that antigravity tracking could act as a multivariate diagnostic window into predictive brain function.

Gravity prior in human behaviour: a perceptual or semantic phenomenon?

Humans show a gravitational advantage in perception: we are more precise at judging the speed of downwards-moving than upwards-moving objects, indicating that gravitational acceleration is an internalised prior. However, it is unclear whether this gravity prior is based on purely perceptual cues or whether it can incorporate semantic knowledge. Previous research has used only objects which are known to comply with gravity, possibly confounding semantic and perceptual cues. Here we have addressed this question by asking participants to judge the speed of objects that typically move coherently with gravity (ball) or against it (rocket). Our results showed a perceptual advantage for falling stimuli, irrespective of object identity, suggesting the gravity prior is based on perceptual cues.

The gravitational imprint on sensorimotor planning and control

Humans excel at learning complex tasks, and elite performers such as musicians or athletes develop motor skills that defy biomechanical constraints. All actions require the movement of massive bodies. Of particular interest in the process of sensorimotor learning and control is the impact of gravitational forces on the body. Indeed, efficient control and accurate internal representations of the body configuration in space depend on our ability to feel and anticipate the action of gravity. Here we review studies on perception and sensorimotor control in both normal and altered gravity. Behavioral and modeling studies together suggested that the nervous system develops efficient strategies to take advantage of gravitational forces across a wide variety of tasks. However, when the body was exposed to altered gravity, the rate and amount of adaptation exhibited substantial variation from one experiment to another and sometimes led to partial adjustment only. Overall, these results support the hypothesis that the brain uses a multimodal and flexible representation of the effect of gravity on our body and movements. Future work is necessary to better characterize the nature of this internal representation and the extent to which it can adapt to novel contexts.

Visuomotor Interactions and Perceptual Judgments in Virtual Reality Simulating Different Levels of Gravity

Virtual reality is used to manipulate sensorimotor interactions in a controlled manner. A critical issue is represented by the extent to which virtual scenarios must conform to physical realism to allow ecological human–machine interactions. Among the physical constraints, Earth gravity is one of the most pervasive and significant for sensorimotor coordination. However, it is still unclear whether visual perception is sensitive to the level of gravity acting on target motion displayed in virtual reality, given the poor visual discrimination of accelerations. To test gravity sensitivity, we asked participants to hit a virtual ball rolling down an incline and falling in air, and to report whether ball motion was perceived as natural or unnatural. We manipulated the gravity level independently for the motion on the incline and for the motion in air. The ball was always visible during rolling, whereas it was visible or occluded during falling before interception. The scene included several cues allowing metric calibration of visual space and motion. We found that the perception rate of natural motion was significantly higher and less variable when ball kinematics was congruent with Earth gravity during both rolling and falling. Moreover, the timing of target interception was accurate only in this condition. Neither naturalness perception nor interception timing depended significantly on whether the target was visible during free-fall. Even when occluded, free-fall under natural gravity was correctly extrapolated from the preceding, visible phase of rolling motion. Naturalness perception depended on motor performance, in addition to the gravity level. In sum, both motor and perceptual responses were guided by an internal model of Earth gravity effects. We suggest that, in order to enhance perceptual sensitivity to physical realism, virtual reality should involve visual backgrounds with metric cues and closed-loop sensorimotor interactions. This suggestion might be especially relevant for the design of rehabilitation protocols.

Motion direction, luminance contrast, and speed perception: An unexpected meeting

Motion direction and luminance contrast are two central features in the representation of visual motion in humans. In five psychophysical experiments, we showed that these two features affect the perceived speed of a visual stimulus. Our data showed a surprising interaction between contrast and direction. Participants perceived downward moving stimuli as faster than upward or rightward stimuli, but only at high contrast. Likewise, luminance contrast produced an underestimation of motion speed, but mostly when the stimuli moved downward. We explained these novel phenomena by means of a theoretical model, accounting for prior knowledge of motion dynamics.

The role of cortical areas hMT/V5+ and TPJ on the magnitude of representational momentum and representational gravity: a transcranial magnetic stimulation study

The perceived vanishing location of a moving target is systematically displaced forward, in the direction of motion-representational momentum-, and downward, in the direction of gravity-representational gravity. Despite a wealth of research on the factors that modulate these phenomena, little is known regarding their neurophysiological substrates. The present experiment aims to explore which role is played by cortical areas hMT/V5+, linked to the processing of visual motion, and TPJ, thought to support the functioning of an internal model of gravity, in modulating both effects. Participants were required to perform a standard spatial localization task while the activity of the right hMT/V5+ or TPJ sites was selectively disrupted with an offline continuous theta-burst stimulation (cTBS) protocol, interspersed with control blocks with no stimulation. Eye movements were recorded during all spatial localizations. Results revealed an increase in representational gravity contingent on the disruption of the activity of hMT/V5+ and, conversely, some evidence suggested a bigger representational momentum when TPJ was stimulated. Furthermore, stimulation of hMT/V5+ led to a decreased ocular overshoot and to a time-dependent downward drift of gaze location. These outcomes suggest that a reciprocal balance between perceived kinematics and anticipated dynamics might modulate these spatial localization responses, compatible with a push-pull mechanism.

Earth-Gravity Congruent Motion Facilitates Ocular Control for Pursuit of Parabolic Trajectories

There is evidence that humans rely on an earth gravity (9.81 m/s²) prior for a series of tasks involving perception and action, the reason being that gravity helps predict future positions of moving objects. Eye-movements in turn are partially guided by predictions about observed motion. Thus, the question arises whether knowledge about gravity is also used to guide eye-movements: If humans rely on a representation of earth gravity for the control of eye movements, earth-gravity-congruent motion should elicit improved visual pursuit. In a pre-registered experiment, we presented participants (n = 10) with parabolic motion governed by six different gravities (-1/0.7/0.85/1/1.15/1.3 g), two initial vertical velocities and two initial horizontal velocities in a 3D environment. Participants were instructed to follow the target with their eyes. We tracked their gaze and computed the visual gain (velocity of the eyes divided by velocity of the target) as proxy for the quality of pursuit. An LMM analysis with gravity condition as fixed effect and intercepts varying per subject showed that the gain was lower for -1 g than for 1 g (by -0.13, SE = 0.005). This model was significantly better than a null model without gravity as fixed effect (p < 0.001), supporting our hypothesis. A comparison of 1 g and the remaining gravity conditions revealed that 1.15 g (by 0.043, SE = 0.005) and 1.3 g (by 0.065, SE = 0.005) were associated with lower gains, while 0.7 g (by 0.054, SE = 0.005) and 0.85 g (by 0.029, SE = 0.005) were associated with higher gains. This model was again significantly better than a null model (p < 0.001), contradicting our hypothesis. Post-hoc analyses reveal that confounds in the 0.7/0.85/1/1.15/1.3 g condition may be responsible for these contradicting results. Despite these discrepancies, our data thus provide some support for the hypothesis that internalized knowledge about earth gravity guides eye movements.

Ocular tracking of occluded ballistic trajectories: Effects of visual context and of target law of motion

In tracking a moving target, the visual context may provide cues for an observer to interpret the causal nature of the target motion and extract features to which the visual system is weakly sensitive, such as target acceleration. This information could be critical when vision of the target is temporarily impeded, requiring visual motion extrapolation processes. Here we investigated how visual context influences ocular tracking of motion either congruent or not with natural gravity. To this end, 28 subjects tracked computer-simulated ballistic trajectories either perturbed in the descending segment with altered gravity effects (0g/2g) or retaining natural-like motion (1g). Shortly after the perturbation (550 ms), targets disappeared for either 450 or 650 ms and became visible again until landing. Target motion occurred with either quasi-realistic pictorial cues or a uniform background, presented in counterbalanced order. We analyzed saccadic and pursuit movements after 0g and 2g target-motion perturbations and for corresponding intervals of unperturbed 1g trajectories, as well as after corresponding occlusions. Moreover, we considered the eye-to-target distance at target reappearance. Tracking parameters differed significantly between scenarios: With a neutral background, eye movements did not depend consistently on target motion, whereas with pictorial background they showed significant dependence, denoting better tracking of accelerated targets. These results suggest that oculomotor control is tuned to realistic properties of the visual scene.

Getting ready for Mars: How the brain perceives new simulated gravitational environments

On Earth, we are continually exposed to gravity: sensory signals are constantly integrated to form an internal model of gravity. However, it is unclear whether this internal model is fixed to Earth's gravity or whether it can be applied to a new gravitational environment. Under terrestrial gravity, observers show a "gravitational bias" while judging the speed of falling versus rising objects, as they comply with the physical laws of gravity. We investigated whether this gravitational bias may be present when judging the speed of objects moving upwards or downwards in both virtual reality (VR)-simulated Earth gravity (9.81 m/s²) and Mars gravity (3.71 m/s²). Our results highlighted a gravitational bias in both Earth and Mars VR-simulated gravity: the speed of downwards movement was more precisely detected than the speed of upwards movement. Although the internal model of gravity has been built up under terrestrial gravity, it can quickly expand to novel non-terrestrial gravitational environments.

Body orientation contributes to modelling the effects of gravity for target interception in humans

KEY POINTS

It is known that interception of targets accelerated by gravity involves internal models coupled with visual signals. Non-visual signals related to head and body orientation relative to gravity may also contribute, although their role is poorly understood. In a novel experiment, we asked pitched observers to hit a virtual target approaching with an acceleration that was either coherent or incoherent with their pitch-tilt. Initially, the timing errors were large and independent of the coherence between target acceleration and observer's pitch. With practice, however, the timing errors became substantially smaller in the coherent conditions. The results show that information about head and body orientation can contribute to modelling the effects of gravity on a moving target. Orientation cues from vestibular and somatosensory signals might be integrated with visual signals in the vestibular cortex, where the internal model of gravity is assumed to be encoded.

ABSTRACT

Interception of moving targets relies on visual signals and internal models. Less is known about the additional contribution of non-visual cues about head and body orientation relative to gravity. We took advantage of Galileo's law of motion along an incline to demonstrate the effects of vestibular and somatosensory cues about head and body orientation on interception timing. Participants were asked to hit a ball rolling in a gutter towards the eyes, resulting in image expansion. The scene was presented in a head-mounted display, without any visual information about gravity direction. In separate blocks of trials participants were pitched backwards by 20° or 60°, whereas ball acceleration was randomized across trials so as to be compatible with rolling down a slope of 20° or 60°. Initially, the timing errors were large, independently of the coherence between ball acceleration and pitch angle, consistent with responses based exclusively on visual information because visual stimuli were identical at both tilts. At the end of the experiment, however, the timing errors were systematically smaller in the coherent conditions than the incoherent ones. Moreover, the responses were significantly (P = 0.007) earlier when participants were pitched by 60° than when they were pitched by 20°. Therefore, practice with the task led to incorporation of information about head and body orientation relative to gravity for response timing. Instead, posture did not affect response timing in a control experiment in which participants hit a static target in synchrony with the last of a predictable series of stationary audiovisual stimuli.

Gravity modulates behaviour control strategy

Human behaviour is a trade-off between exploitation of familiar resources and exploration of new ones. In a challenging environment-such as outer space-making the correct decision is vital. On Earth, gravity is always there, and is an important reference for behaviour. Thus, altered gravitational signals may affect behaviour control strategies. Here, we investigated whether changing the body's orientation to the gravitational vector would modulate the balance between routine and novel behaviour. Participants completed a random number generation task while upright or supine. We found decreased randomness when participants were supine. In particular, the degree of equiprobability of pairs of consecutive responses was reduced in the supine orientation. Online gravitational signals may shape the balance between exploitation and exploration, in favour of more stereotyped and routine responses.

Adaptation and spatial generalization to a triaxial visuomotor perturbation in a virtual reality environment

We explored visuomotor adaptation and spatial generalization of three-dimensional reaching movements performed in a virtual reality environment. We used a multiphase learning paradigm. First, subjects performed reaching movements to six targets without visual feedback (VF) (pre-exposure phase). Next, participants aimed at one target with veridical VF (baseline phase). Immediately after, they were required to adapt their movements to a triaxial visuomotor perturbation (horizontal, vertical, and sagittal translations) between actual hand motion and VF of hand motion in the virtual environment (learning phase). Finally, subjects aimed at the same targets as in the baseline (aftereffect) and pre-exposure phases (generalization) without VF (post-exposure phase). The results revealed spatial axis-dependent visuomotor adaptation capacities. First, subjects showed smaller intertrial variability along the horizontal compared to the sagittal and vertical axes during the baseline and learning phases. Second, although subjects were unaware of the visual distortion, they adapted their movements to each component of the triaxial perturbation. However, they showed reduced learning rate and less persistent adaptation (aftereffect) along the vertical than the horizontal and sagittal axes. Similarly, subjects transferred the newly learned visuomotor association to untrained regions of the workspace, but their average level of generalization was smaller along the vertical than the horizontal and sagittal axes. Collectively, our results suggest that adapting three-dimensional movements to a visual distortion involves distinct processes according to the specific sensorimotor integration demands of moving along each spatial axis. This finding supports the idea that the brain employs a modular decomposition strategy to simplify complex multidimensional visuomotor tasks.

Continuously updating one’s predictions underlies successful interception

This paper reviews our understanding of the interception of moving objects. Interception is a demanding task that requires both spatial and temporal precision. The required precision must be achieved on the basis of imprecise and sometimes biased sensory information. We argue that people make precise interceptive movements by continuously adjusting their movements. Initial estimates of how the movement should progress can be quite inaccurate. As the movement evolves, the estimate of how the rest of the movement should progress gradually becomes more reliable as prediction is replaced by sensory information about the progress of the movement. The improvement is particularly important when things do not progress as anticipated. Constantly adjusting one’s estimate of how the movement should progress combines the opportunity to move in a way that one anticipates will best meet the task demands with correcting for any errors in such anticipation. The fact that the ongoing movement might have to be adjusted can be considered when determining how to move, and any systematic anticipation errors can be corrected on the basis of the outcome of earlier actions.

Mental imagery of gravitational motion

There is considerable evidence that gravitational acceleration is taken into account in the interaction with falling targets through an internal model of Earth gravity. Here we asked whether this internal model is accessed also when target motion is imagined rather than real. In the main experiments, naïve participants grasped an imaginary ball, threw it against the ceiling, and caught it on rebound. In different blocks of trials, they had to imagine that the ball moved under terrestrial gravity (1g condition) or under microgravity (0g) as during a space flight. We measured the speed and timing of the throwing and catching actions, and plotted ball flight duration versus throwing speed. Best-fitting duration-speed curves estimate the laws of ball motion implicit in the participant's performance. Surprisingly, we found duration-speed curves compatible with 0g for both the imaginary 0g condition and the imaginary 1g condition, despite the familiarity with Earth gravity effects and the added realism of performing the throwing and catching actions. In a control experiment, naïve participants were asked to throw the imaginary ball vertically upwards at different heights, without hitting the ceiling, and to catch it on its way down. All participants overestimated ball flight durations relative to the durations predicted by the effects of Earth gravity. Overall, the results indicate that mental imagery of motion does not have access to the internal model of Earth gravity, but resorts to a simulation of visual motion. Because visual processing of accelerating/decelerating motion is poor, visual imagery of motion at constant speed or slowly varying speed appears to be the preferred mode to perform the tasks.