On-line and model-based approaches to the visual control of action

Influence of Visual Stimulus Changes in a Virtual Environment on Postural Control: Focusing on a Hallway Walking Simulation

The purpose of this study was to clarify the effects of the standing center of gravity sway by providing visual stimulus information as if the subjects were walking in virtual reality (VR) and by monitoring conditions with different corridor widths. We included 25 healthy young individuals in our study. The center of gravity sway was measured during open- and closed-eye static standing using images of walking in corridors of different widths (780 and 1600 mm) presented on a VR and personal computer monitor (Monitor). The parameters measured for the center of gravity sway were swing path length (SPL), height of excursion (HoE), and width of excursion (WoE). The results showed that the SPL and HoE values were significantly greater in the VR group than those in the Monitor group. The greater center of gravity sway in the VR compared with the Monitor group can be attributed to the ability of the head-mounted VR display to cover the entire field of vision and its head-tracking function. There was no change in the center of gravity sway with respect to the corridor width, which may be because the width of the corridor alone did not provide sufficient visual stimulation to affect physical function. This research could lead to further studies which could impact the motivation of patients for rehabilitation therapies.

A potential mechanism for Gibsonian resonance: behavioral entrainment emerges from local homeostasis in an unsupervised reservoir network

While the cognitivist school of thought holds that the mind is analogous to a computer, performing logical operations over internal representations, the tradition of ecological psychology contends that organisms can directly "resonate" to information for action and perception without the need for a representational intermediary. The concept of resonance has played an important role in ecological psychology, but it remains a metaphor. Supplying a mechanistic account of resonance requires a non-representational account of central nervous system (CNS) dynamics. Towards this, we present a series of simple models in which a reservoir network with homeostatic nodes is used to control a simple agent embedded in an environment. This network spontaneously produces behaviors that are adaptive in each context, including (1) visually tracking a moving object, (2) substantially above-chance performance in the arcade game Pong, (2) and avoiding walls while controlling a mobile agent. Upon analyzing the dynamics of the networks, we find that behavioral stability can be maintained without the formation of stable or recurring patterns of network activity that could be identified as neural representations. These results may represent a useful step towards a mechanistic grounding of resonance and a view of the CNS that is compatible with ecological psychology.

Embodying Time in the Brain: A Multi-Dimensional Neuroimaging Meta-Analysis of 95 Duration Processing Studies

Time is an omnipresent aspect of almost everything we experience internally or in the external world. The experience of time occurs through such an extensive set of contextual factors that, after decades of research, a unified understanding of its neural substrates is still elusive. In this study, following the recent best-practice guidelines, we conducted a coordinate-based meta-analysis of 95 carefully-selected neuroimaging papers of duration processing. We categorized the included papers into 14 classes of temporal features according to six categorical dimensions. Then, using the activation likelihood estimation (ALE) technique we investigated the convergent activation patterns of each class with a cluster-level family-wise error correction at p < 0.05. The regions most consistently activated across the various timing contexts were the pre-SMA and bilateral insula, consistent with an embodied theory of timing in which abstract representations of duration are rooted in sensorimotor and interoceptive experience, respectively. Moreover, class-specific patterns of activation could be roughly divided according to whether participants were timing auditory sequential stimuli, which additionally activated the dorsal striatum and SMA-proper, or visual single interval stimuli, which additionally activated the right middle frontal and inferior parietal cortices. We conclude that temporal cognition is so entangled with our everyday experience that timing stereotypically common combinations of stimulus characteristics reactivates the sensorimotor systems with which they were first experienced.

Latent transition analysis to explore patterns of physical functional decline among older adults in China: A national 6-year longitudinal study

BACKGROUND AND AIMS

Multiple limitations often co-occur and accumulate, leading to subsequent function decline. However, there is a scarcity of longitudinal studies examining the progression of physical function among the general population of older adults in China. This study aimed to define typical physical function status and its change, which were characterized by the coexistence and accumulation of diverse limitations targeting a Chinese sample of older adults.

METHODS

This study used the three recent public data waves of the Chinese Longitudinal Healthy Longevity Survey during a 6-year follow-up period. 9765 individuals who were over 65 and participated in the 2011 survey were included. Latent transition analysis was used to identify the latent physical function status and explore the transition of older adults among different latent statuses.

RESULTS

Seven latent statuses of physical function were identified, with visual impairment and related limitations being particularly prevalent among older adults. Upper limb mobility appeared to be a differentiated indicator of physical functional status. Physical function decline mainly started with the limitations in squatting, carrying weights and walking, then to the status with intact upper limb mobility and hearing function only, or converted directly into the latter, then to complete dysfunction.

CONCLUSIONS

Our findings suggest some indicative limitations and critical steps in the process of functional decline among older adults. These results may provide insight for researchers and policymakers to develop tailored preventive and rehabilitation care and provide support for physically limited elderly according to their latent status and course of functional decline.

Emergent Coordination of Heading in Soccer: Of Two Players and a Single Ball

Purpose: In many sports situations, two or more players need to coordinate their actions to make sure that one of them intercepts a ball or opponent. We considered how two soccer players head back a thrown ball. Two accounts for the joint decision making by both players were considered. These two accounts not only differ in their theoretical basis but also have vastly different implications for training practice. In a first account, players know their areas of responsibility for interception, and combine this with their prediction of the ball's landing location. In a second account, the coordination emerges from the unfolding dynamics of the system of informationally connected players and ball. According to this second account, especially for balls aimed in between the two players, both of the players may start moving and one player sees that the ball will be interceptable for the other player, and subsequently yields the interception. Methods: We instrumented soccer players and the ball with Kinexon sensors and had pairs of players head back the thrown ball. Results: In line with the second account, the results showed a fair number of instances where the player who intercepted the ball had to move the longest distance. Furthermore, considerable movement by both players was not an exception. Conclusion: The results can be taken as a first step towards an understanding of joint coordination as an emergent phenomenon.

Eye movements during motor imagery and execution reveal different visuomotor control strategies in manual interception

Previous research has investigated the degree of congruency in gaze metrics between action execution (AE) and motor imagery (MI) for similar manual tasks. Although eye movement dynamics seem to be limited to relatively simple actions toward static objects, there is little evidence of how gaze parameters change during imagery as a function of more dynamic spatial and temporal task demands. This study examined the similarities and differences in eye movements during AE and MI for an interception task. Twenty-four students were asked to either mentally simulate or physically intercept a moving target on a computer display. Smooth pursuit, saccades, and response time were compared between the two conditions. The results show that MI was characterized by higher smooth pursuit gain and duration while no meaningful differences were found in the other parameters. The findings indicate that eye movements during imagery are not simply a duplicate of what happens during actual performance. Instead, eye movements appear to vary as a function of the interaction between visuomotor control strategies and task demands.

Perceptual-Cognitive Integration for Goal-Directed Action in Naturalistic Environments

Real-world actions require one to simultaneously perceive, think, and act on the surrounding world, requiring the integration of (bottom-up) sensory information and (top-down) cognitive and motor signals. Studying these processes involves the intellectual challenge of cutting across traditional neuroscience silos, and the technical challenge of recording data in uncontrolled natural environments. However, recent advances in techniques, such as neuroimaging, virtual reality, and motion tracking, allow one to address these issues in naturalistic environments for both healthy participants and clinical populations. In this review, we survey six topics in which naturalistic approaches have advanced both our fundamental understanding of brain function and how neurologic deficits influence goal-directed, coordinated action in naturalistic environments. The first part conveys fundamental neuroscience mechanisms related to visuospatial coding for action, adaptive eye-hand coordination, and visuomotor integration for manual interception. The second part discusses applications of such knowledge to neurologic deficits, specifically, steering in the presence of cortical blindness, impact of stroke on visual-proprioceptive integration, and impact of visual search and working memory deficits. This translational approach-extending knowledge from lab to rehab-provides new insights into the complex interplay between perceptual, motor, and cognitive control in naturalistic tasks that are relevant for both basic and clinical research.

The functional role of visual information and fixation stillness in the quiet eye

The final fixation to a target in far-aiming tasks, known as the quiet eye, has been consistently identified as an important perceptual-cognitive variable for task execution. Yet, despite a number of proposed mechanisms it remains unclear whether the fixation itself is driving performance effects or is simply an emergent property of underpinning cognitions. Across two pre-registered studies, novice golfers (n = 127) completed a series of golf putts in a virtual reality simulation to examine the function of the quiet eye in the absence of visual information. In experiment 1 participants maintained a quiet eye fixation even when all visual information was occluded. Visual occlusion did significantly disrupt motor skill accuracy, but the effect was relatively small (89cm vs 105cm radial error, std. beta = 0.25). In experiment 2, a 'noisy eye' was induced using covertly moving fixation points, which disrupted skill execution (p = .04, BF = 318.07, std. beta = -0.25) even though visual input was equivalent across conditions. Overall, the results showed that performers persist with a long pre-shot fixation even in the absence of visual information, and that the stillness of this fixation confers a functional benefit that is not merely related to improved information extraction.

Deficits in Reach Planning and On-Line Grasp Control in Adults With Amblyopia

Purpose

Adults with amblyopia exhibit impairments when reaching to grasp three-dimensional objects. We examined whether their deficits derive from problems with feedforward planning of these prehension movements or in using visual feedback to control them on-line.

Methods

Twenty-one adults with mild to severe anisometropic and/or strabismic amblyopia and reduced binocularity participated, along with 21 normally sighted age- and gender-matched controls. Subjects used their preferred hand to reach for, precision grasp, and then lift cylindrical table-top objects (two sizes, two distances) using binocular, dominant eye, or amblyopic/non-sighting eye vision just to plan their movements during a 1-second task preview with vision then occluded so feedback was absent or to plan and execute them (i.e., with visual feedback fully available). Kinematic and error measures of the timing and accuracy of the reach and grasp were quantified by view and feedback and compared by ANOVA.

Results

The amblyopic adults performed generally worse than controls across all three views in both feedback conditions. With vision for planning only, their movement initiation and duration times were significantly increased, as were their initial reach times and error rates, especially when using the amblyopic eye alone, whatever its visual acuity loss. These relative planning deficits were only partially rectified with visual feedback available on-line. Relative grasp planning deficits were less evident in the amblyopia group, who instead produced significantly increased grip times and errors under binocular and amblyopic eye visual feedback conditions, although the subgroup with unmeasurable stereovision also formed wider (inaccurate) grasps across all conditions.

Conclusions

Adults with amblyopia seem to have problems constructing reliable internal spatial representations for the feedforward planning of prehension, particularly with their affected eye and mainly affecting their reach, with additional deficits in on-line grasp control related to poor binocularity.

Generalizing the optic flow equalization control law to an asymmetrical person-plus-object system

Visually guided action in humans occurs in part through the use of control laws, which are dynamical equations in which optical information modulates an actor's interaction with their environment. For example, humans locomote through the center of a corridor by equalizing the speed of optic flow across their left and right fields of view. This optic flow equalization control law relies on a crucial assumption: that the shape of the body relative to the eyes is laterally symmetrical. Humans engaging in tool use are often producing person-plus-object systems that are not laterally symmetrical, such as when they hold a tool, bag, or briefcase in one hand, or when they drive a vehicle. This experiment tests a new generalized control law for centered steering that accounts for asymmetries produced by external tool use. Participants held an asymmetrical bar and centered themselves within a virtual moving hallway while the speed of the virtual walls were systematically changed. The results demonstrate that humans engaging with an asymmetrical tool can (1) perceive the asymmetry of a person-plus-object system, (2) use that information to modulate the use of optic flow equalization control laws for centered steering, and (3) functionally incorporate the asymmetrical tool into their perception-action system to successfully navigate their environment.

Grounding Intuitive Physics in Perceptual Experience

This review article explores the foundation of laypeople's understanding of the physical world rooted in perceptual experience. Beginning with a concise historical overview of the study of intuitive physics, the article presents the hypothesis that laypeople possess accurate internalized representations of physical laws. A key aspect of this hypothesis is the contention that correct representations of physical laws emerge in ecological experimental conditions, where the scenario being examined resembles everyday life experiences. The article critically examines empirical evidence both supporting and challenging this claim, revealing that despite everyday-life-like conditions, fundamental misconceptions often persist. Many of these misconceptions can be attributed to a domain-general heuristic that arises from the overgeneralization of perceptual-motor experiences with physical objects. To conclude, the article delves into ongoing controversies and highlights promising future avenues in the field of intuitive physics, including action-judgment dissociations, insights from developmental psychology, and computational models integrating artificial intelligence.

Dynamical biomarkers in teams and other multiagent systems

Effective team behavior in high-performance environments such as in sport and the military requires individual team members to efficiently perceive the unfolding task events, predict the actions and action intents of the other team members, and plan and execute their own actions to simultaneously accomplish individual and collective goals. To enhance team performance through effective cooperation, it is crucial to measure the situation awareness and dynamics of each team member and how they collectively impact the team's functioning. Further, to be practically useful for real-life settings, such measures must be easily obtainable from existing sensors. This paper presents several methodologies that can be used on positional and movement acceleration data of team members to quantify and/or predict team performance, assess situation awareness, and to help identify task-relevant information to support individual decision-making. Given the limited reporting of these methods within military cohorts, these methodologies are described using examples from team sports and teams training in virtual environments, with discussion as to how they can be applied to real-world military teams.

How the conception of control influences our understanding of actions

Wilful movement requires neural control. Commonly, neural computations are thought to generate motor commands that bring the musculoskeletal system - that is, the plant - from its current physical state into a desired physical state. The current state can be estimated from past motor commands and from sensory information. Modelling movement on the basis of this concept of plant control strives to explain behaviour by identifying the computational principles for control signals that can reproduce the observed features of movements. From an alternative perspective, movements emerge in a dynamically coupled agent-environment system from the pursuit of subjective perceptual goals. Modelling movement on the basis of this concept of perceptual control aims to identify the controlled percepts and their coupling rules that can give rise to the observed characteristics of behaviour. In this Perspective, we discuss a broad spectrum of approaches to modelling human motor control and their notions of control signals, internal models, handling of sensory feedback delays and learning. We focus on the influence that the plant control and the perceptual control perspective may have on decisions when modelling empirical data, which may in turn shape our understanding of actions.

Predicting and understanding human action decisions during skillful joint-action using supervised machine learning and explainable-AI

This study investigated the utility of supervised machine learning (SML) and explainable artificial intelligence (AI) techniques for modeling and understanding human decision-making during multiagent task performance. Long short-term memory (LSTM) networks were trained to predict the target selection decisions of expert and novice players completing a multiagent herding task. The results revealed that the trained LSTM models could not only accurately predict the target selection decisions of expert and novice players but that these predictions could be made at timescales that preceded a player's conscious intent. Importantly, the models were also expertise specific, in that models trained to predict the target selection decisions of experts could not accurately predict the target selection decisions of novices (and vice versa). To understand what differentiated expert and novice target selection decisions, we employed the explainable-AI technique, SHapley Additive explanation (SHAP), to identify what informational features (variables) most influenced modelpredictions. The SHAP analysis revealed that experts were more reliant on information about target direction of heading and the location of coherders (i.e., other players) compared to novices. The implications and assumptions underlying the use of SML and explainable-AI techniques for investigating and understanding human decision-making are discussed.

Give Me a Hand: Improving the Effectiveness of Near-field Augmented Reality Interactions By Avatarizing Users' End Effectors

Inspired by previous works showing promise for AR self-avatarization - providing users with an augmented self avatar, we investigated whether avatarizing users' end-effectors (hands) improved their interaction performance on a near-field, obstacle avoidance, object retrieval task wherein users were tasked with retrieving a target object from a field of non-target obstacles for a number of trials. We employed a 3 (Augmented hand representation) X 2 (density of obstacles) X 2 (size of obstacles) X 2 (virtual light intensity) multi-factorial design, manipulating the presence/absence and anthropomorphic fidelity of augmented self-avatars overlaid on the user's real hands, as a between subjects factor across three experimental conditions: (1) No-Augmented Avatar (using only real hands); (2) Iconic-Augmented Avatar; (3) Realistic Augmented Avatar. Results indicated that self-avatarization improved interaction performance and was perceived as more usable regardless of the anthropomorphic fidelity of avatar. We also found that the virtual light intensity used in illuminating holograms affects how visible one's real hands are. Overall, our findings seem to indicate that interaction performance may improve when users are provided with a visual representation of the AR system's interacting layer in the form of an augmented self-avatar.

A neural active inference model of perceptual-motor learning

The active inference framework (AIF) is a promising new computational framework grounded in contemporary neuroscience that can produce human-like behavior through reward-based learning. In this study, we test the ability for the AIF to capture the role of anticipation in the visual guidance of action in humans through the systematic investigation of a visual-motor task that has been well-explored-that of intercepting a target moving over a ground plane. Previous research demonstrated that humans performing this task resorted to anticipatory changes in speed intended to compensate for semi-predictable changes in target speed later in the approach. To capture this behavior, our proposed "neural" AIF agent uses artificial neural networks to select actions on the basis of a very short term prediction of the information about the task environment that these actions would reveal along with a long-term estimate of the resulting cumulative expected free energy. Systematic variation revealed that anticipatory behavior emerged only when required by limitations on the agent's movement capabilities, and only when the agent was able to estimate accumulated free energy over sufficiently long durations into the future. In addition, we present a novel formulation of the prior mapping function that maps a multi-dimensional world-state to a uni-dimensional distribution of free-energy/reward. Together, these results demonstrate the use of AIF as a plausible model of anticipatory visually guided behavior in humans.

Characterisation of visual guidance of steering to intercept targets following curving trajectories using Qualitative Inconsistency Detection

This study explored the informational variables guiding steering behaviour in a locomotor interception task with targets moving along circular trajectories. Using a new method of analysis focussing on the temporal co-evolution of steering behaviour and the potential information sources driving it, we set out to invalidate reliance on plausible informational candidates. Applied to individual trials rather than ensemble averages, this Qualitative Inconsistency Detection (QuID) method revealed that steering behaviour was not compatible with reliance on information grounded in any type of change in the agent-centred target-heading angle. First-order changes in the environment-centred target's bearing angle could also not adequately account for the variations in behaviour observed under the different experimental conditions. Capturing the observed timing of unfolding steering behaviour ultimately required a combination of (velocity-based) first-order and (acceleration-based) second-order changes in bearing angle. While this result may point to reliance on fractional-order based changes in bearing angle, the overall importance of the present findings resides in the demonstration of the necessity to break away from the existing practice of trying to fit behaviour into a priori postulated functional strategies based on categorical differences between operative heuristic rules or control laws.

Humans Can Track But Fail to Predict Accelerating Objects

Objects in our visual environment often move unpredictably and can suddenly speed up or slow down. The ability to account for acceleration when interacting with moving objects can be critical for survival. Here, we investigate how human observers track an accelerating target with their eyes and predict its time of reappearance after a temporal occlusion by making an interceptive hand movement. Before occlusion, observers smoothly tracked the accelerating target with their eyes. At the time of occlusion, observers made a predictive saccade to the location where they subsequently intercepted the target with a quick pointing movement. We tested how observers integrated target motion information by comparing three alternative models that describe time-to-contact (TTC) based on the (1) final target velocity sample before occlusion, (2) average target velocity before occlusion, or (3) final target velocity and the rate of target acceleration. We show that observers were able to accurately track the accelerating target with visually-guided smooth pursuit eye movements. However, the timing of the predictive saccade and manual interception revealed inability to act on target acceleration when predicting TTC. Instead, interception timing was best described by the final velocity model that relies on extrapolating the last available target velocity sample before occlusion. Moreover, predictive saccades and manual interception showed similar insensitivity to target acceleration and were correlated on a trial-by-trial basis. These findings provide compelling evidence for the failure of integrating target acceleration into predictive models of target motion that drive both interceptive eye and hand movements.

Time for Space and the Stability of Prospective Control: Reaching-to-Grasp Gibson

Gibson formulated an approach to goal-directed behavior using prospective information in the context of visually guided locomotion and manual behavior. The former was Gibson's paradigm case, but it is the rapidity of targeted reaching that has provided the special challenge for stable control. Recent treatments of visually guided reaching assume that internal forward models are required to generate stable behavior given delays caused by neural transmission times. Internal models are representations of the sort eschewed by Gibson in favor of prospective information. Reaching is usually described as guided using relative distances of hand and target, but prospective information is usually temporal rather than spatial. We describe proportional rate control models that incorporate time dimensioned prospective information and show they remain stable in the face of delays. The use of time-dimensioned prospective information removes the need for internal models for stable behavior despite neural transmission delays and allows Gibson's approach to prevail.

Predictive eye movements are adjusted in a Bayes-optimal fashion in response to unexpectedly changing environmental probabilities

This study examined the application of active inference to dynamic visuomotor control. Active inference proposes that actions are dynamically planned according to uncertainty about sensory information, prior expectations, and the environment, with motor adjustments serving to minimise future prediction errors. We investigated whether predictive gaze behaviours are indeed adjusted in this Bayes-optimal fashion during a virtual racquetball task. In this task, participants intercepted bouncing balls with varying levels of elasticity, under conditions of higher or lower environmental volatility. Participants' gaze patterns differed between stable and volatile conditions in a manner consistent with generative models of Bayes-optimal behaviour. Partially observable Markov models also revealed an increased rate of associative learning in response to unpredictable shifts in environmental probabilities, although there was no overall effect of volatility on this parameter. Findings extend active inference frameworks into complex and unconstrained visuomotor tasks and present important implications for a neurocomputational understanding of the visual guidance of action.

Gravity and Known Size Calibrate Visual Information to Time Parabolic Trajectories

Catching a ball in a parabolic flight is a complex task in which the time and area of interception are strongly coupled, making interception possible for a short period. Although this makes the estimation of time-to-contact (TTC) from visual information in parabolic trajectories very useful, previous attempts to explain our precision in interceptive tasks circumvent the need to estimate TTC to guide our action. Obtaining TTC from optical variables alone in parabolic trajectories would imply very complex transformations from 2D retinal images to a 3D layout. We propose based on previous work and show by using simulations that exploiting prior distributions of gravity and known physical size makes these transformations much simpler, enabling predictive capacities from minimal early visual information. Optical information is inherently ambiguous, and therefore, it is necessary to explain how these prior distributions generate predictions. Here is where the role of prior information comes into play: it could help to interpret and calibrate visual information to yield meaningful predictions of the remaining TTC. The objective of this work is: (1) to describe the primary sources of information available to the observer in parabolic trajectories; (2) unveil how prior information can be used to disambiguate the sources of visual information within a Bayesian encoding-decoding framework; (3) show that such predictions might be robust against complex dynamic environments; and (4) indicate future lines of research to scrutinize the role of prior knowledge calibrating visual information and prediction for action control.

Sonification of Golf Putting Gesture Reduces Swing Movement Variability in Novices

Purpose: To study whether novices can use sonification to enhance golf putting performance and swing movements. Method: Forty participants first performed a series of 2 m and 4 m putts, where swing velocities associated with successful trials were used to calculate their mean velocity profile (MVP). Participants were then divided into four groups with different auditory conditions: static pink noise unrelated to movement, auditory guidance based on personalized MVP, and two sonification strategies that mapped the real-time error between observed and MVP swings to modulate either the stereo display or roughness of the auditory guidance signal. Participants then performed a series of 2 m and 4 m putts with the auditory condition designated to their group. Results: In general our results showed significant correlations between swing movement variability and putting performance for all sonification groups. More specifically, in comparison to the group exposed to static pink noise, participants who were presented auditory guidance significantly reduced the deviation from their average swing movement. In addition, participants exposed to error-based sonification with stereo display modulation significantly lowered their variability in timing swing movements. These results provide further evidence of the benefits of sonification for novices performing complex motor skill tasks. Conclusions: More importantly, our findings suggest participants were able to better use online error-based sonification rather than auditory guidance to reduce variability in the execution and timing of their movements.

Visual anticipation of the future path: Predictive gaze and steering

Skillful behavior requires the anticipation of future action requirements. This is particularly true during high-speed locomotor steering where solely detecting and correcting current error is insufficient to produce smooth and accurate trajectories. Anticipating future steering requirements could be supported using "model-free" prospective signals from the scene ahead or might rely instead on model-based predictive control solutions. The present study generated conditions whereby the future steering trajectory was specified using a breadcrumb trail of waypoints, placed at regular intervals on the ground to create a predictable course (a repeated series of identical "S-bends"). The steering trajectories and gaze behavior relative to each waypoint were recorded for each participant (N = 16). To investigate the extent to which drivers predicted the location of future waypoints, "gaps" were included (20% of waypoints) whereby the next waypoint in the sequence did not appear. Gap location was varied relative to the S-bend inflection point to manipulate the chances that the next waypoint indicated a change in direction of the bend. Gaze patterns did indeed change according to gap location, suggesting that participants were sensitive to the underlying structure of the course and were predicting the future waypoint locations. The results demonstrate that gaze and steering both rely upon anticipation of the future path consistent with some form of internal model.

Review: Approaches to Visual-motor Control in Baseball Batting

SIGNIFICANCE

This review evaluates model-based online approaches to visual-motor control in baseball batting in light of research studies on this topic.Throughout the history of research on baseball batting, there has been a presumptive winner in terms of how visual-motor control occurs for this complex skill. Because of the severe time constraints and the short duration of the action, it has been assumed that a baseball swing must involve model-based control. That is, hitting involves using an open-loop, pre-programmed movement that is parameterized based on situational probabilities, advance cues from the pitcher's delivery, and information early in the ball flight, which are used by an internal model to predict the future location of the ball. In this review, the author contrasts two variants of this type of model-based control (a 3D world model and spatial memory of trajectories) with an online control approach in which the batter uses only currently available perceptual information to control the swing prospectively via information-movement coupling. It is shown that the assumed necessity of predictive control in baseball batting is based on too narrow of a conception of online control. Although work still needs to be done to elucidate the specifics of the control, it is argued here that online control provides an account of visual-motor control in baseball batting that is both more parsimonious and more consistent with published research findings.

Flexible viewing time when estimating time-to-contact in 3D parabolic trajectories

Obtaining reliable estimates of the time-to-contact (TTC) in a three-dimensional (3D) parabolic trajectory is still an open issue. A direct analysis of the optic flow cannot make accurate predictions for gravitationally accelerated objects. Alternatively, resorting to prior knowledge of gravity and size can provide accurate estimates of TTC in parabolic head-on trajectories, but its generalization depends on the specific geometry of the trajectory and particular moments. The aim of this work is to explore the preferred viewing windows to estimate TTC and how the available visual information affects these estimations. We designed a task in which participants, wearing an head-mounted display (HMD), had to time the moment a ball in a parabolic path returned at eye level. We used five trajectories for which accurate temporal predictions were available at different points of flight time. Our results show that our observers can predict both the trajectory of the ball and TTC based on the available visual information and previous experience with the task. However, the times at which our observers chose to gather the visual evidence did not match those in which visual information provided accurate TTC. Instead, they looked at the ball at relatively fixed temporal windows depending on the trajectory but not of TTC.

How do people steer a car to intercept a moving target: Interceptions in different environments point to one strategy

Which strategy people use to guide locomotor interception remains unclear despite considerable research and the importance of an answer with ramification into the heuristics and biases debate. Because the constant bearing (CB) strategy corresponds to the target-heading (CTH) strategy with an additional constraint, these two strategies can be confounded experimentally. But, the two strategies are distinct in the information they require: while the CTH strategy only requires access to the relative angle between the direction of motion and the target, the CB strategy requires access to a stable allocentric reference frame. Here, we manipulated the visual information about allocentric reference frames in three virtual environments and asked participants to steer a car to intercept a moving target. Participants' interception paths showed different degrees of curvature and their target-heading angles were approximately constant, consistent with the CTH strategy. By contrast, the target's bearing angle continuously changed in all participants except one. This particular participant produced linear interception paths with little change in the target's bearing angle, seemingly consistent with both strategies. This participant continued this pattern of steering even in the environment without any visual information about allocentric reference frames. Therefore, this pattern of steering is attributed to the CTH strategy rather than the CB strategy. The overall results add important evidence for the conclusion that locomotor interception is better accounted for by the CTH strategy and that experimentally observing a straight interception trajectory with a CB angle is not sufficient evidence for the CB strategy.

The role of eye movements in manual interception: A mini-review

When we catch a moving object in mid-flight, our eyes and hands are directed toward the object. Yet, the functional role of eye movements in guiding interceptive hand movements is not yet well understood. This review synthesizes emergent views on the importance of eye movements during manual interception with an emphasis on laboratory studies published since 2015. We discuss the role of eye movements in forming visual predictions about a moving object, and for enhancing the accuracy of interceptive hand movements through feedforward (extraretinal) and feedback (retinal) signals. We conclude by proposing a framework that defines the role of human eye movements for manual interception accuracy as a function of visual certainty and object motion predictability.

Monocular guidance of reaches-to-grasp using visible support surface texture: data and model

We investigated monocular information for the continuous online guidance of reaches-to-grasp and present a dynamical control model thereof. We defined an information variable using optical texture projected from a support surface (i.e. a table) over which the participants reached-to-grasp target objects sitting on the table surface at different distances. Using either binocular or monocular vision in the dark, participants rapidly reached-to-grasp a phosphorescent square target object with visibly phosphorescent thumb and index finger. Targets were one of three sizes. The target either sat flat on the support surface or was suspended a few centimeters above the surface at a slant. The later condition perturbed the visible relation of the target to the support surface. The support surface was either invisible in the dark or covered with a visible phosphorescent checkerboard texture. Reach-to-grasp trajectories were recorded and Maximum Grasp Apertures (MGA), Movement Times (MT), Time of MGA (TMGA), and Time of Peak Velocities (TPV) were analyzed. These measures were selected as most indicative of the participant's certainty about the relation of hand to target object during the reaches. The findings were that, in general, especially monocular reaches were less certain (slower, earlier TMGA and TPV) than binocular reaches except with the target flat on the visible support surface where performance with monocular and binocular vision was equivalent. The hypothesized information was the difference in image width of optical texture (equivalent to density of optical texture) at the hand versus the target. A control dynamic equation was formulated representing proportional rate control of the reaches-to-grasp (akin to the model using binocular disparity formulated by Anderson and Bingham (Exp Brain Res 205: 291-306, 2010). Simulations were performed and presented using this model. Simulated performance was compared to actual performance and found to replicate it. To our knowledge, this is the first study of monocular information used for continuous online guidance of reaches-to-grasp, complete with a control dynamic model.

Effects of Mirror and Metronome Use on Spontaneous Dance Movements

This study investigated effects of mirror and metronome use on spontaneous upper body movements by 10 preprofessional dancers in a motor task in which maximally diverse upper body movement patterns were targeted. Hand and trunk accelerations were digitally recorded utilizing accelerometers and analyzed using polar frequency distributions of the realized acceleration directions and sample entropy of the acceleration time. Acceleration directions were more variably used by the arms than by the torso, particularly so when participants monitored their performance via a mirror. Metronome use hardly affected the predictability of the acceleration time series. The findings underscore the intrinsic limitations that people experience when being asked to move randomly and reveal moderate effects of visual and acoustic constraints on doing so in dance.

Vertical head and eye movements in baseball batting

PURPOSE

The purpose of this paper is to describe a method utilized to measure vertical head and eye movements and gaze positions of baseball batters and to report the initial findings generated with this method.

METHOD

Two former collegiate baseball players participated. Subjects batted balls from a pitching machine.

RESULTS

Responses were similar for the two subjects. The head demonstrated a small upward rotation followed by a downward rotation. The eye was rotated opposite to the head throughout portions of the swing while gaze was directed below the ball (more for one subject than the other) for much of the pitch trajectory.

DISCUSSION

These data align with previous assertions that in baseball batting, players attempt to keep pitched balls in a constant egocentric direction.

The role of variability in the control of the basketball dribble under different perceptual setups

When executing a sport-specific movement, athletes cannot use all perceptual resources to control their actions. The complexity of a basketball match, demands that individuals command their attention towards the context to make decisions. The dependency on the perceptual sources to control a movement should be kept to a minimum. During a match due to situational constraints, players often see themselves with impaired perceptual sources (e.g. auditory and peripheral vision occlusions). Assuming that professional basketball players are more skilled than amateurs, we analysed how both groups were affected by perceptual impairment, within and in-between groups in a dribbling task. A variability analysis (correlation dimension, approximate entropy and Lyapunov exponent) was used to evaluate how an increased variability or stability, in a specific joint movement, contributes to a better adaptive behaviour when facing perceptual impairment. Professionals showed a significantly lower variability of the wrist movements, but had a significantly higher value of variability in the shoulder horizontal movements (anterior-posterior and lateral), and also in the lateral elbow movements when their downwards peripheral vision was impaired. The increase in variability in such joint movements reflects adaptive behaviour and might be a performance factor.

Movements of the eyes and hands are coordinated by a common predictive strategy

Although attempts to intercept a ball in flight are often preceded by predictive gaze behavior, the relationship between the predictive control of gaze and the effector is largely unexplored. The present study was designed to investigate the influence of the spatiotemporal demands of the task on a switch to the predictive control. Ten subjects immersed in a virtual environment attempted to intercept a ball that disappeared for 500 ms of its parabolic approach. The timing of the blank was varied through manipulation of the post-blank duration prior to the ball's arrival, and the shape of the trajectory was manipulated through variation of the pre-blank duration. Results reveal that the gaze movement trajectory during the blank was curvilinear, appropriately scaled to the curvature of the invisible moving ball, and the gaze vector was within 4° of the ball upon reappearance, despite 10° to 13° of ball movement. The timing of the blank did not influence the accuracy of predictive positioning of the paddle at the time of ball reappearance, indicated by the distance of the paddle relative to the ball's eventual passing location. However, analysis of trial-by-trial covariations revealed that, when the gaze vector more accurately predicted the ball's trajectory at reappearance, the paddle was also held closer to the ball's eventual passing location. This suggests that predictive strategies for paddle placement are more strongly mediated by the accuracy of gaze behavior than by the observed range of trajectories, or the timing of the blank.

Affordance-based versus current-future accounts of choosing whether to pursue or abandon the chase of a moving target

Affordance-based control and current-future control offer competing theoretical accounts of the visual control of locomotion. The aim of this study was to test predictions derived from these accounts about the necessity of self-motion (Experiment 1) and target-ground contact (Experiment 2) in perceiving whether a moving target can be intercepted before it reaches an escape zone. We designed a novel interception task wherein the ability to perceive target catchability before initiating movement was advantageous. Subjects pursued a target moving through a field in a virtual environment and attempted to intercept the target before it escaped into a forest. Targets were catchable on some trials but not others. If subjects perceived that they could not reach the target, they were instructed to immediately give up by pressing a button. After each trial, subjects received a point reward that incentivized them to pursue only those targets that were catchable. On the majority of trials, subjects either pursued and successfully intercepted the target or chose not to pursue at all, demonstrating that humans are sensitive to catchability while stationary. Performance also degraded when the target was floating rather than in contact with the ground. Both findings are incompatible with the current-future account and support the affordance-based account of choosing whether to pursue moving targets.

Visual control of steering in curve driving

This pair of studies investigated steering in the absence of continuous visual information. In a driving simulator, participants steered a curving path that was displayed either continuously or intermittently. Optic flow conditions were manipulated to alter the nature of the heading information with respect to the path being steered. Removing or biasing heading information had little effect on steering even during long and frequent path occlusions as long as turn rate was available. This demonstrates that participants can use intermittent views of the path to plan their steering actions and optic flow to accurately update vehicle turns with respect to that path.

Introduction to special issue on "Prediction in Perception and Action"

The wide diversity of articles in this issue reveals an explosion of evidence for the mechanisms of prediction in the visual system. When thought of as visual priors, predictive mechanisms can be seen as tightly interwoven with incoming sensory data. Prediction is thus a fundamental and essential aspect not only of visual perception but of the actions that are guided by perception.

Seeing Gravity: Gait Adaptations to Visual and Physical Inclines - A Virtual Reality Study

Using advanced virtual reality technology, we demonstrate that exposure to virtual inclinations visually simulating inclined walking induces gait modulations in a manner consistent with expected gravitational forces (i.e., acting upon a free body), suggesting vision-based perception of gravity. The force of gravity critically impacts the regulation of our movements. However, how humans perceive and incorporate gravity into locomotion is not well understood. In this study, we introduce a novel paradigm for exposing humans to incongruent sensory information under conditions constrained by distinct gravitational effects, facilitating analysis of the consistency of human locomotion with expected gravitational forces. Young healthy adults walked under conditions of actual physical inclinations as well as virtual inclinations. We identify and describe ‘braking’ and ‘exertion’ effects – locomotor adaptations accommodating gravito-inertial forces associated with physical inclines. We show that purely visual cues (from virtual inclinations) induce consistent locomotor adaptations to counter expected gravity-based changes, consistent with indirect prediction mechanisms. Specifically, downhill visual cues activate the braking effect in anticipation of a gravitational boost, whereas uphill visual cues promote an exertion effect in anticipation of gravitational deceleration. Although participants initially rely upon vision to accommodate environmental changes, a sensory reweighting mechanism gradually reprioritizes body-based cues over visual ones. A high-level neural model outlines a putative pathway subserving the observed effects. Our findings may be pivotal in designing virtual reality-based paradigms for understanding perception and action in complex environments with potential translational benefits.

The visual control of interceptive steering: How do people steer a car to intercept a moving target?

The visually guided interception of a moving target is a fundamental visuomotor task that humans can do with ease. But how humans carry out this task is still unclear despite numerous empirical investigations. Measurements of angular variables during human interception have suggested three possible strategies: the pursuit strategy, the constant bearing angle strategy, and the constant target-heading strategy. Here, we review previous experimental paradigms and show that some of them do not allow one to distinguish among the three strategies. Based on this analysis, we devised a virtual driving task that allows investigating which of the three strategies best describes human interception. Crucially, we measured participants' steering, head, and gaze directions over time for three different target velocities. Subjects initially aligned head and gaze in the direction of the car's heading. When the target appeared, subjects centered their gaze on the target, pointed their head slightly off the heading direction toward the target, and maintained an approximately constant target-heading angle, whose magnitude varied across participants, while the target's bearing angle continuously changed. With a second condition, in which the target was partially occluded, we investigated several alternative hypotheses about participants' visual strategies. Overall, the results suggest that interceptive steering is best described by the constant target-heading strategy and that gaze and head are coordinated to continuously acquire visual information to achieve successful interception.

The development of visually guided stepping

Adults use vision during stepping and walking to fine-tune foot placement. However, the developmental profile of visually guided stepping is unclear. We asked (1) whether children use online vision to fine-tune precise steps and (2) whether precision stepping develops as part of broader visuomotor development, alongside other fundamental motor skills like reaching. With 6-(N = 11), 7-(N = 11), 8-(N = 11)-year-olds and adults (N = 15), we manipulated visual input during steps and reaches. Using motion capture, we measured step and reach error, and postural stability. We expected (1) both steps and reaches would be visually guided (2) with similar developmental profiles (3) foot placement biases that promote stability, and (4) correlations between postural stability and step error. Children used vision to fine-tune both steps and reaches. At all ages, foot placement was biased (albeit not in the predicted directions). Contrary to our predictions, step error was not correlated with postural stability. By 8 years, children's step and reach error were adult-like. Despite similar visual control mechanisms, stepping and reaching had different developmental profiles: step error reduced with age whilst reach error was lower and stable with age. We argue that the development of both visually guided and non-visually guided action is limb-specific.

Getting Back Into the Loop: The Perceptual-Motor Determinants of Successful Transitions out of Automated Driving

OBJECTIVE

To present a structured, narrative review highlighting research into human perceptual-motor coordination that can be applied to automated vehicle (AV)-human transitions.

BACKGROUND

Manual control of vehicles is made possible by the coordination of perceptual-motor behaviors (gaze and steering actions), where active feedback loops enable drivers to respond rapidly to ever-changing environments. AVs will change the nature of driving to periods of monitoring followed by the human driver taking over manual control. The impact of this change is currently poorly understood.

METHOD

We outline an explanatory framework for understanding control transitions based on models of human steering control. This framework can be summarized as a perceptual-motor loop that requires (a) calibration and (b) gaze and steering coordination. A review of the current experimental literature on transitions is presented in the light of this framework.

RESULTS

The success of transitions are often measured using reaction times, however, the perceptual-motor mechanisms underpinning steering quality remain relatively unexplored.

CONCLUSION

Modeling the coordination of gaze and steering and the calibration of perceptual-motor control will be crucial to ensure safe and successful transitions out of automated driving.

APPLICATION

This conclusion poses a challenge for future research on AV-human transitions. Future studies need to provide an understanding of human behavior that will be sufficient to capture the essential characteristics of drivers reengaging control of their vehicle. The proposed framework can provide a guide for investigating specific components of human control of steering and potential routes to improving manual control recovery.

Predictive Smooth Pursuit Eye Movements

Smooth pursuit eye movements maintain the line of sight on smoothly moving targets. Although often studied as a response to sensory motion, pursuit anticipates changes in motion trajectories, thus reducing harmful consequences due to sensorimotor processing delays. Evidence for predictive pursuit includes (a) anticipatory smooth eye movements (ASEM) in the direction of expected future target motion that can be evoked by perceptual cues or by memory for recent motion, (b) pursuit during periods of target occlusion, and (c) improved accuracy of pursuit with self-generated or biologically realistic target motions. Predictive pursuit has been linked to neural activity in the frontal cortex and in sensory motion areas. As behavioral and neural evidence for predictive pursuit grows and statistically based models augment or replace linear systems approaches, pursuit is being regarded less as a reaction to immediate sensory motion and more as a predictive response, with retinal motion serving as one of a number of contributing cues.

Object Properties Influence Visual Guidance of Motor Actions

The dynamic nature of the real world poses challenges for predicting where best to allocate gaze during object interactions. The same object may require different visual guidance depending on its current or upcoming state. Here, we explore how object properties (the material and shape of objects) and object state (whether it is full of liquid, or to be set down in a crowded location) influence visual supervision while setting objects down, which is an element of object interaction that has been relatively neglected in the literature. In a liquid pouring task, we asked participants to move empty glasses to a filling station; to leave them empty, half fill, or completely fill them with water; and then move them again to a tray. During the first putdown (when the glasses were all empty), visual guidance was determined only by the type of glass being set down—with more unwieldy champagne flutes being more likely to be guided than other types of glasses. However, when the glasses were then filled, glass type no longer mattered, with the material and fill level predicting whether the glasses were set down with visual supervision: full, glass material containers were more likely to be guided than empty, plastic ones. The key finding from this research is that the visual system responds flexibly to dynamic changes in object properties, likely based on predictions of risk associated with setting-down the object unsupervised by vision. The factors that govern these mechanisms can vary within the same object as it changes state.

Humans Use Predictive Gaze Strategies to Target Waypoints for Steering

A major unresolved question in understanding visually guided locomotion in humans is whether actions are driven solely by the immediately available optical information (model-free online control mechanisms), or whether internal models have a role in anticipating the future path. We designed two experiments to investigate this issue, measuring spontaneous gaze behaviour while steering, and predictive gaze behaviour when future path information was withheld. In Experiment 1 participants (N = 15) steered along a winding path with rich optic flow: gaze patterns were consistent with tracking waypoints on the future path 1–3 s ahead. In Experiment 2, participants (N = 12) followed a path presented only in the form of visual waypoints located on an otherwise featureless ground plane. New waypoints appeared periodically every 0.75 s and predictably 2 s ahead, except in 25% of the cases the waypoint at the expected location was not displayed. In these cases, there were always other visible waypoints for the participant to fixate, yet participants continued to make saccades to the empty, but predictable, waypoint locations (in line with internal models of the future path guiding gaze fixations). This would not be expected based upon existing model-free online steering control models, and strongly points to a need for models of steering control to include mechanisms for predictive gaze control that support anticipatory path following behaviours.

Reinforcement effects in anticipatory smooth eye movements

When predictive information about target motion is available, anticipatory smooth pursuit eye movements (aSPEM) are consistently generated before target appearance, thereby reducing the typical sensorimotor delay between target motion onset and foveation. By manipulating the probability for target motion direction, we were able to bias the direction and mean velocity of aSPEM. This suggests that motion-direction expectancy has a strong effect on the initiation of anticipatory movements. To further understand the nature of anticipatory smooth eye movements, we investigated different effects of reinforcement on aSPEM. In a first experiment, the reinforcement was contingent to a particular anticipatory behavior. A monetary reward was associated to a criterion-matching anticipatory velocity as estimated online during the gap before target motion onset. Our results showed a small but significant effect of behavior-contingent monetary reward on aSPEM. In a second experiment, the proportion of rewarded trials was manipulated across motion directions (right vs. left) independently from participants' behavior. Our results indicate that a bias in expected reward does not systematically affect anticipatory eye movements. Overall, these findings strengthen the notion that anticipatory eye movements can be considered as an operant behavior (similar to visually guided ones), whereas the expectancy for a noncontingent reward cannot efficiently bias them.

Some binocular advantages for planning reach, but not grasp, components of prehension

Proficient (fast, accurate, precise) hand actions for reaching-to-grasp 3D objects are known to benefit significantly from the use of binocular vision compared to one eye alone. We examined whether these binocular advantages derive from increased reliability in encoding the goal object’s properties for feedforward planning of prehension movements or from enhanced feedback mediating their online control. Adult participants reached for, precision grasped and lifted cylindrical table-top objects (two sizes, 2 distances) using binocular vision or only their dominant/sighting eye or their non-dominant eye to program and fully execute their movements or using each of the three viewing conditions only to plan their reach-to-grasp during a 1 s preview, with vision occluded just before movement onset. Various kinematic measures of reaching and grasping proficiency, including corrective error rates, were quantified and compared by view, feedback and object type. Some significant benefits of binocular over monocular vision when they were just available for pre-movement planning were retained for the reach regardless of target distance, including higher peak velocities, straighter paths and shorter low velocity approach times, although these latter were contaminated by more velocity corrections and by poorer coordination with object contact. By contrast, virtually all binocular advantages for grasping, including improvements in peak grip aperture scaling, the accuracy and precision of digit placements at object contact and shorter grip application times preceding the lift, were eliminated with no feedback available, outcomes that were influenced by the object’s size. We argue that vergence cues can improve the reliability of binocular internal representations of object distance for the feedforward programming of hand transport, whereas the major benefits of binocular vision for enhancing grasping performance derive exclusively from its continuous presence online.

Intuitive physics of gravitational motion as shown by perceptual judgment and prediction-motion tasks

In Experiment 1, we explored participants' perceptual knowledge of vertical fall by presenting them with virtually simulated polystyrene or wooden spheres falling to the ground from about two meters high. Participants rated the perceived naturalness of the motion. Besides the implied mass of the sphere, we manipulated the motion pattern (i.e., uniform acceleration vs. uniform velocity), and the magnitude of acceleration or velocity. Results show that relatively low values of acceleration or velocity were judged as natural for the polystyrene sphere, whereas relatively high values of acceleration or velocity were judged as natural for the wooden sphere. In Experiment 2, the same stimuli of Experiment 1 were used, but the sphere disappeared behind an invisible occluder at some point of its trajectory. Participants were asked to predict the time-to-contact (TTC) of the sphere with the ground by pressing a key at the exact time of impact of the lower edge of the sphere with the floor of the room. Results show that the estimated TTC for the simulated wooden sphere was slightly but consistently smaller than the estimated TTC for the simulated polystyrene sphere. The influence of the implied mass on participants' responses might be the manifestation of two processes, namely an explicit 'heavy-fast, light-slow' heuristic, and/or an implicit, automatic association between mass and falling speed.

External relative to internal attentional focus enhances motor performance and learning in visually impaired individuals

Background: Research has demonstrated the advantages of an external relative to internal focus of attention for enhancing motor performance and learning across diverse tasks, contexts and populations. However, research has yet to examine whether this finding holds true for individuals who have a major visual impairment in discrete and locomotion-based continuous motor tasks.Methods: In experiment 1, twenty-four visually impaired participants were asked to kick a soccer ball with their dominant foot to a target 7 meters away. Participants performed 10 trials within an internal focus (concentration on inside of the foot), external focus (concentration on the ball), and control (no focus instructions) conditions, in a counterbalanced order. In experiment 2, thirty-nine visually impaired adults were asked to ride a rehabilitation Pedalo for a distance of 7 meters. Participants were randomly assigned to either an internal focus (focus on the feet), external focus (focus on the platform), or control (no focus instructions) group. Retention and transfer tests were conducted on day 2.Results: An external focus resulted in more accurate kicks and faster pedalo movement times compared to an internal focus.Conclusions: These findings indicate that visual information does not mediate external focus benefits for motor performance and learning.Implications for RehabilitationPractitioners should use instructions that encourage visually impaired individuals who are going through rehabilitation to adopt an appropriate focus of attention for enhancing motor performance and learning of discrete or locomotion-based motor skills.Instructions that foster an external focus, relative to an internal focus, enhances performance of both discrete and continuous motor skills in individuals with visual impairment.

Continuously updating one’s predictions underlies successful interception

This paper reviews our understanding of the interception of moving objects. Interception is a demanding task that requires both spatial and temporal precision. The required precision must be achieved on the basis of imprecise and sometimes biased sensory information. We argue that people make precise interceptive movements by continuously adjusting their movements. Initial estimates of how the movement should progress can be quite inaccurate. As the movement evolves, the estimate of how the rest of the movement should progress gradually becomes more reliable as prediction is replaced by sensory information about the progress of the movement. The improvement is particularly important when things do not progress as anticipated. Constantly adjusting one’s estimate of how the movement should progress combines the opportunity to move in a way that one anticipates will best meet the task demands with correcting for any errors in such anticipation. The fact that the ongoing movement might have to be adjusted can be considered when determining how to move, and any systematic anticipation errors can be corrected on the basis of the outcome of earlier actions.

The self-organization of ball bouncing

The hybrid rhythmic ball-bouncing task considered in this study requires a participant to hit a ball in a virtual environment by moving a paddle in the real environment. It allows for investigation of the online visual control of action in humans. Changes in gravity acceleration in the virtual environment affect the ball dynamics and modify the ball-paddle system limit cycle. These changes are shown to be accurately reproduced through simulation by a model integrating continuous information-movement couplings between the ball trajectory and the paddle trajectory, giving rise to a resonance-tuning phenomenon. On the contrary, the tested models integrating only intermittent sensorimotor couplings were unable to replicate the observed human behavior. Results suggest that the visual control of action is achieved online, in a prospective way. Human rhythmic motor control would benefit from the timing and phase control emerging from the low-level continuous coupling between the central pattern generator and the visual perception of the ball trajectory. This control strategy, which precludes the need for internal clock and explicit environmental representation, is also able to explain the empirical result that the bounces tend to converge toward a passive stability regime during human ball bouncing.