Visual guidance of intercepting a moving target on foot

Modelling human navigation and decision dynamics in a first-person herding task

This study investigated whether dynamical perceptual-motor primitives (DPMPs) could also be used to capture human navigation in a first-person herding task. To achieve this aim, human participants played a first-person herding game, in which they were required to corral virtual cows, called targets, into a specified containment zone. In addition to recording and modelling participants' movement trajectories during gameplay, participants' target-selection decisions (i.e. the order in which participants corralled targets) were recorded and modelled. The results revealed that a simple DPMP navigation model could effectively reproduce the movement trajectories of participants and that almost 80% of the participants' target-selection decisions could be captured by a simple heuristic policy. Importantly, when this policy was coupled to the DPMP navigation model, the resulting system could successfully simulate and predict the behavioural dynamics (movement trajectories and target-selection decisions) of participants in novel multi-target contexts. Implications of the findings for understanding complex human perceptual-motor behaviour and the development of artificial agents for robust human-machine interaction are discussed.

Age-Related Changes in the Utilization of Visual Information for Collision Prediction: A Study Using an Affordance-Based Model

The ability to predict collisions with moving objects deteriorates with aging. We followed the affordance-based model to identify optical variables that older adults had difficulty using for collision prediction. We reproduced a modified version of the interception task used in Steinmetz (Steinmetz, Layton, Powell, & Fajen, 2020, "Affordance-based versus current - future accounts of choosing whether to pursue or abandon the chase of a moving target," Journal of Vision, 20(3), 8) in a virtual reality (VR) environment and newly introduced perturbation for each of three optical variables (vertical and horizontal expansions of a moving object and the bearing angle produced between participants and a moving object). We expected that perturbation would negatively affect the performance only for those who rely on the optical variable to perform the interception task effectively. We tested 18 older and 15 younger adults and showed that older participants were not negatively affected by the perturbation for the vertical and horizontal expansion of a moving object, while they showed decreased performance when the perturbation was introduced with a bearing angle. These findings suggest that predicting collisions with moving objects deteriorates with aging because the perception of object expansion is impaired with aging.

Grounding social timing: A commentary on "The evolution of social timing" by Verga et al. (2023)

We are excited about Verga et al.'s [22] exhortation to look beyond humans to understand the purpose, scope, and evolution of social timing. We argue that the field should expand even further. We first point out the enabling role of the spatial environment, which constrains social interaction and in which social interaction is embedded. Second, we argue that a full appreciation of the emergence of social timing must include a focus on physical prerequisites of interactive systems, exemplified by studies of dissipative structures more broadly. By situating interacting systems-whether biological or not-within their shared dynamic environment, we can more clearly and more fully understand social timing.

People learn a two-stage control for faster locomotor interception

People can use the constant target-heading (CTH) strategy or the constant bearing (CB) strategy to guide their locomotor interception. But it is still unclear whether people can learn new interception behavior. Here, we investigated how people learn to adjust their steering to intercept targets faster. Participants steered a car to intercept a moving target in a virtual environment similar to a natural open field. Their baseline interceptions were better accounted for by the CTH strategy. After five learning sessions across multiple days, in which participants received feedback about their interception durations, they adopted a two-stage control: a quick initial burst of turning accompanied by an increase of the target-heading angle during early interception was followed by significantly less turning with small changes in target-heading angle during late interception. The target's bearing angle did not only show this two-stage pattern but also changed comparatively little during late interception, leaving it unclear which strategy participants had adopted. In a following test session, the two-stage pattern of participants' turning adjustment and the target-heading angle transferred to new target conditions and a new environment without visual information about an allocentric reference frame, which should preclude participants from using the CB strategy. Indeed, the pattern of the target's bearing angle did not transfer to all the new conditions. These results suggest that participants learned a two-stage control for faster interception: they learned to quickly increase the target-heading angle during early interception and subsequently follow the CTH strategy during late interception.

Adaptive echolocation behavior of bats and toothed whales in dynamic soundscapes

Journal of Experimental Biology has a long history of reporting research discoveries on animal echolocation, the subject of this Centenary Review. Echolocating animals emit intense sound pulses and process echoes to localize objects in dynamic soundscapes. More than 1100 species of bats and 70 species of toothed whales rely on echolocation to operate in aerial and aquatic environments, respectively. The need to mitigate acoustic clutter and ambient noise is common to both aerial and aquatic echolocating animals, resulting in convergence of many echolocation features, such as directional sound emission and hearing, and decreased pulse intervals and sound intensity during target approach. The physics of sound transmission in air and underwater constrains the production, detection and localization of sonar signals, resulting in differences in response times to initiate prey interception by aerial and aquatic echolocating animals. Anti-predator behavioral responses of prey pursued by echolocating animals affect behavioral foraging strategies in air and underwater. For example, many insect prey can detect and react to bat echolocation sounds, whereas most fish and squid are unresponsive to toothed whale signals, but can instead sense water movements generated by an approaching predator. These differences have implications for how bats and toothed whales hunt using echolocation. Here, we consider the behaviors used by echolocating mammals to (1) track and intercept moving prey equipped with predator detectors, (2) interrogate dynamic sonar scenes and (3) exploit visual and passive acoustic stimuli. Similarities and differences in animal sonar behaviors underwater and in air point to open research questions that are ripe for exploration.

The accuracy of object motion perception during locomotion

Human observers are capable of perceiving the motion of moving objects relative to the stationary world, even while undergoing self-motion. Perceiving world-relative object motion is complicated because the local optical motion of objects is influenced by both observer and object motion, and reflects object motion in observer coordinates. It has been proposed that observers recover world-relative object motion using global optic flow to factor out the influence of self-motion. However, object-motion judgments during simulated self-motion are biased, as if the visual system cannot completely compensate for the influence of self-motion. Recently, Xie et al. demonstrated that humans are capable of accurately judging world-relative object motion when self-motion is real, actively generated by walking, and accompanied by optic flow. However, the conditions used in that study differ from those found in the real world in that the moving object was a small dot with negligible optical expansion that moved at a fixed speed in retinal (rather than world) coordinates and was only visible for 500 ms. The present study investigated the accuracy of object motion perception under more ecologically valid conditions. Subjects judged the trajectory of an object that moved through a virtual environment viewed through a head-mounted display. Judgments exhibited bias in the case of simulated self-motion but were accurate when self-motion was real, actively generated, and accompanied by optic flow. The findings are largely consistent with the conclusions of Xie et al. and demonstrate that observers are capable of accurately perceiving world-relative object motion under ecologically valid conditions.

Characterisation of visual guidance of steering to intercept targets following curving trajectories using Qualitative Inconsistency Detection

This study explored the informational variables guiding steering behaviour in a locomotor interception task with targets moving along circular trajectories. Using a new method of analysis focussing on the temporal co-evolution of steering behaviour and the potential information sources driving it, we set out to invalidate reliance on plausible informational candidates. Applied to individual trials rather than ensemble averages, this Qualitative Inconsistency Detection (QuID) method revealed that steering behaviour was not compatible with reliance on information grounded in any type of change in the agent-centred target-heading angle. First-order changes in the environment-centred target's bearing angle could also not adequately account for the variations in behaviour observed under the different experimental conditions. Capturing the observed timing of unfolding steering behaviour ultimately required a combination of (velocity-based) first-order and (acceleration-based) second-order changes in bearing angle. While this result may point to reliance on fractional-order based changes in bearing angle, the overall importance of the present findings resides in the demonstration of the necessity to break away from the existing practice of trying to fit behaviour into a priori postulated functional strategies based on categorical differences between operative heuristic rules or control laws.

Visual guidance of locomotor interception is based on nulling changes in target bearing (not egocentric target direction nor target-heading angle)

In two experiments we studied how participants steer to intercept uniformly moving targets in a virtual driving task under hypotheses-differentiating conditions of initial target eccentricity and target motion. In line with our re-analysis of findings from earlier studies, in both experiments the observed interception behavior could not be understood as resulting from reliance on (changes in) egocentric target direction nor from reliance on (changes in) target-heading angle. The overall pattern of results observed was however compatible with a control strategy based on nulling changes in the target's bearing angle. The presence of reversals in movement direction under specific combinations of target eccentricity and motion conditions indicated that the information used was not purely rate-of-change (i.e., first-order) based but carried traces of an influence of initial target position. In Experiment 2 we explicitly tested the potential role of early reliance on perceived egocentric target direction by examining the effects of a 10° rotation of the visual scene (i.e., of both target and environment). While such a rotation gave rise to minor changes in the moment of initiation of the first steering action, contrary to predictions it did not affect the characteristics of the direction-reversal phenomenon. We conclude that the visual guidance of locomotor interception is best understood as resulting from nulling changes in the target's bearing angle, with such nulling perhaps best conceived as being fractional-order (rather integer-order) driven.

Navigational Behavior of Humans and Deep Reinforcement Learning Agents

Rapid advances in the field of Deep Reinforcement Learning (DRL) over the past several years have led to artificial agents (AAs) capable of producing behavior that meets or exceeds human-level performance in a wide variety of tasks. However, research on DRL frequently lacks adequate discussion of the low-level dynamics of the behavior itself and instead focuses on meta-level or global-level performance metrics. In doing so, the current literature lacks perspective on the qualitative nature of AA behavior, leaving questions regarding the spatiotemporal patterning of their behavior largely unanswered. The current study explored the degree to which the navigation and route selection trajectories of DRL agents (i.e., AAs trained using DRL) through simple obstacle ridden virtual environments were equivalent (and/or different) from those produced by human agents. The second and related aim was to determine whether a task-dynamical model of human route navigation could not only be used to capture both human and DRL navigational behavior, but also to help identify whether any observed differences in the navigational trajectories of humans and DRL agents were a function of differences in the dynamical environmental couplings.

Flexible prediction of opponent motion with internal representation in interception behavior

Skilled interception behavior often relies on accurate predictions of external objects because of a large delay in our sensorimotor systems. To deal with the sensorimotor delay, the brain predicts future states of the target based on the current state available, but it is still debated whether internal representations acquired from prior experience are used as well. Here we estimated the predictive manner by analyzing the response behavior of a pursuer to a sudden directional change of the evasive target, providing strong evidence that prediction of target motion by the pursuer was incompatible with a linear extrapolation based solely on the current state of the target. Moreover, using neural network models, we validated that nonlinear extrapolation as estimated was computationally feasible and useful even against unknown opponents. These results support the use of internal representations in predicting target motion, suggesting the usefulness and versatility of predicting external object motion through internal representations.

How do people steer a car to intercept a moving target: Interceptions in different environments point to one strategy

Which strategy people use to guide locomotor interception remains unclear despite considerable research and the importance of an answer with ramification into the heuristics and biases debate. Because the constant bearing (CB) strategy corresponds to the target-heading (CTH) strategy with an additional constraint, these two strategies can be confounded experimentally. But, the two strategies are distinct in the information they require: while the CTH strategy only requires access to the relative angle between the direction of motion and the target, the CB strategy requires access to a stable allocentric reference frame. Here, we manipulated the visual information about allocentric reference frames in three virtual environments and asked participants to steer a car to intercept a moving target. Participants' interception paths showed different degrees of curvature and their target-heading angles were approximately constant, consistent with the CTH strategy. By contrast, the target's bearing angle continuously changed in all participants except one. This particular participant produced linear interception paths with little change in the target's bearing angle, seemingly consistent with both strategies. This participant continued this pattern of steering even in the environment without any visual information about allocentric reference frames. Therefore, this pattern of steering is attributed to the CTH strategy rather than the CB strategy. The overall results add important evidence for the conclusion that locomotor interception is better accounted for by the CTH strategy and that experimentally observing a straight interception trajectory with a CB angle is not sufficient evidence for the CB strategy.

Reversals in Movement Direction in Locomotor Interception of Uniformly Moving Targets

Here we studied how participants steer to intercept uniformly moving targets in a virtual driving task. We tested the hypothesis that locomotor interception behavior cannot fully be explained by a strategy of nulling rate of change in pertinent agent-target relations such as the target-heading angle or target’s bearing angle. In line with a previously reported observation and model simulations, we found that, under specific combinations of initial target eccentricity and target motion direction, locomotor paths revealed reversals in movement direction. This phenomenon is not compatible with unique reliance on first-order (i.e., rate-of-change based) information in the case of uniformly moving targets. We also found that, as expected, such reversals in movement direction were not observed consistently over all trials of the same experimental condition: their presence depended on the timing of the first steering action effected by the participant, with only early steering actions leading to reversals in movement direction. These particular characteristics of the direction-reversal phenomenon demonstrated here for a locomotor interception-by-steering task correspond to those reported for lateral manual interception. Together, these findings suggest that control strategies operating in manual and locomotor interception may at least share certain characteristics.

A least action principle for interceptive walking

The principle of least effort has been widely used to explain phenomena related to human behavior ranging from topics in language to those in social systems. It has precedence in the principle of least action from the Lagrangian formulation of classical mechanics. In this study, we present a model for interceptive human walking based on the least action principle. Taking inspiration from Lagrangian mechanics, a Lagrangian is defined as effort minus security, with two different specific mathematical forms. The resulting Euler–Lagrange equations are then solved to obtain the equations of motion. The model is validated using experimental data from a virtual reality crossing simulation with human participants. We thus conclude that the least action principle provides a useful tool in the study of interceptive walking.

Hierarchical goal effects on center of mass velocity and eye fixations during gait

The purpose of this study was to determine the effect of hierarchical goal structure of a yet-to-be performed task on gait and eye fixation behavior while walking to the location of where the task was to be performed. Subjects performed different goal-directed tasks representing three hierarchical levels of planning. The first level of planning consisted of having the subject walk to a bookcase on which an object (a cup) was located in the middle of a shelf. The second level of planning consisted of walking to the bookcase and picking up the cup which was in the middle, on the right side, or on the left side of the bookcase shelf. The third level of planning consisted of walking to the bookcase, picking up the cup which was located in the middle of the bookcase shelf, and moving it to a higher shelf. Findings showed that hierarchal goals do affect center of mass velocity and eye fixation behavior. Center of mass velocity to the bookcase increased with an increase in the number of goals. Subjects decreased gait velocity as they approached the bookcase and adjusted their last steps to accommodate picking up the cup. The findings also demonstrated the important role of vision in controlling gait velocity in goal-directed tasks. Eye fixation duration was more important than the number of eye fixations in controlling gait velocity. Thus, the amount of information gained through object fixation duration is of greater importance than the number of fixations on the object for effective goal achievement.

Bioinspired pursuit with a swimming robot using feedback control of an internal rotor

Theoretical guarantees of capture become complicated in the case of a swimming fish or fish robot because of the oscillatory nature of the fish heading. Building on the connection between a swimming fish and the canonical Chaplygin sleigh, a novel state feedback control law is shown to result in closed-loop dynamics that exhibit a limit cycle resulting in steady forward-swimming motion in a desired heading. Analysis of this limit cycle reveals boundaries on the size of the oscillations around the desired heading, which are then used to specify under what conditions (e.g. prey speed, predator speed, control gains) capture is guaranteed. By changing the desired swimming direction in response to prey movements, the control law is shown to be capable of pure pursuit, deviated pure pursuit, intercept, and parallel navigation in simulation. An experimental demonstration of pure pursuit by a flexible fish-inspired robot actuated with an internal reaction wheel is described.

Affordance-based versus current-future accounts of choosing whether to pursue or abandon the chase of a moving target

Affordance-based control and current-future control offer competing theoretical accounts of the visual control of locomotion. The aim of this study was to test predictions derived from these accounts about the necessity of self-motion (Experiment 1) and target-ground contact (Experiment 2) in perceiving whether a moving target can be intercepted before it reaches an escape zone. We designed a novel interception task wherein the ability to perceive target catchability before initiating movement was advantageous. Subjects pursued a target moving through a field in a virtual environment and attempted to intercept the target before it escaped into a forest. Targets were catchable on some trials but not others. If subjects perceived that they could not reach the target, they were instructed to immediately give up by pressing a button. After each trial, subjects received a point reward that incentivized them to pursue only those targets that were catchable. On the majority of trials, subjects either pursued and successfully intercepted the target or chose not to pursue at all, demonstrating that humans are sensitive to catchability while stationary. Performance also degraded when the target was floating rather than in contact with the ground. Both findings are incompatible with the current-future account and support the affordance-based account of choosing whether to pursue moving targets.

Behavioral Dynamics of Pedestrians Crossing between Two Moving Vehicles

This study examines the human behavioral dynamics of pedestrians crossing a street with vehicular traffic. To this end, an experiment was constructed in which human participants cross a road between two moving vehicles in a virtual reality setting. A mathematical model is developed in which the position is given by a simple function. The model is used to extract information on each crossing by performing root-mean-square deviation (RMSD) minimization of the function from the data. By isolating the parameter adjusted to gap features, we find that the subjects primarily changed the timing of the acceleration to adjust to changing gap conditions, rather than walking speed or duration of acceleration. Moreover, this parameter was also adjusted to the vehicle speed and vehicle type, even when the gap size and timing were not changed. The model is found to provide a description of gap affordance via a simple inequality of the fitting parameters. In addition, the model turns out to predict a constant bearing angle with the crossing point, which is also observed in the data. We thus conclude that our model provides a mathematical tool useful for modeling crossing behaviors and probing existing models. It may also provide insight into the source of traffic accidents.

Human Navigational Strategy for Intercepting an Erratically Moving Target in Chase and Escape Interactions

Pursuit and interception of moving targets are fundamental skills of many animal species. Although previous studies in human interception behaviors have proposed several navigational strategies for intercepting a moving target, it is still unknown which navigational strategy humans use in chase-and-escape interactions. In the present experimental study, by using two one-on-one tasks as seen in ball sports, we showed that human interception behaviors were statistically consistent with a time-optimal model. Our results provide the insight about the navigational strategy for intercepting a moving target in chase-and-escape interactions, which may be common across species.

The visual control of interceptive steering: How do people steer a car to intercept a moving target?

The visually guided interception of a moving target is a fundamental visuomotor task that humans can do with ease. But how humans carry out this task is still unclear despite numerous empirical investigations. Measurements of angular variables during human interception have suggested three possible strategies: the pursuit strategy, the constant bearing angle strategy, and the constant target-heading strategy. Here, we review previous experimental paradigms and show that some of them do not allow one to distinguish among the three strategies. Based on this analysis, we devised a virtual driving task that allows investigating which of the three strategies best describes human interception. Crucially, we measured participants' steering, head, and gaze directions over time for three different target velocities. Subjects initially aligned head and gaze in the direction of the car's heading. When the target appeared, subjects centered their gaze on the target, pointed their head slightly off the heading direction toward the target, and maintained an approximately constant target-heading angle, whose magnitude varied across participants, while the target's bearing angle continuously changed. With a second condition, in which the target was partially occluded, we investigated several alternative hypotheses about participants' visual strategies. Overall, the results suggest that interceptive steering is best described by the constant target-heading strategy and that gaze and head are coordinated to continuously acquire visual information to achieve successful interception.

Spatiotemporal characteristics of an attacker's strategy to pass a defender effectively in a computer-based one-on-one task

For modern humans, chase-and-escape behaviors are fundamental skills in many sports. A critical factor related to the success or failure of chase-and-escape is the visuomotor delay. Recent studies on sensorimotor decision making have shown that humans can incorporate their own visuomotor delay into their decisions. However, the relationship between the decision of an attacker and the visuomotor delay of a defender is still unknown. Here, we conducted a one-on-one chase-and-escape task for humans and investigated the characteristics of the direction changes of the attacker and the responses of the defender. Our results showed that the direction change of the attacker has two characteristics: uniformity of spatial distribution and bimodality of temporal distribution. In addition, we showed that the response of the defender did not depend on the position but it was delayed to the direction change of the attacker with a short interval. These results suggest that the characteristics of direction change of an attacker increased unpredictability, and it could be useful for preventing the predictive response of the defender and to receive the benefit of an extra response delay of tens of milliseconds, respectively.

Vestibular heading perception in Parkinson's disease

Postural instability and falls are common causes of morbidity and mortality in the second most prevalent neurodegenerative condition, Parkinson's disease (PD). Poor understanding of balance dysfunction in PD has hampered the development of novel therapeutic measures for postural instability and balance dysfunction. We aimed to determine how the ability to perceive one's own linear motion in the absence of visual cues, i.e., vestibular heading, is affected in PD. We examined vestibular heading function using a two-alternative forced choice task performed on a six-degree-of-freedom motion platform. Sensitivity of the vestibular system to subtle variations in heading direction and systematic errors in accuracy of responses were assessed for each subject using a Gaussian cumulative distribution psychometric function. Compared to healthy subjects, PD presented with higher angular thresholds to detect vestibular heading direction. These results confirm the potential of our study to provide valuable insight to the vestibular system's role in spatial navigation deficits in PD.

Probabilistic analytical modelling of predator-prey interactions in fishes

Predation is a fundamental interaction between species, yet it is largely unclear what tactics are successful for the survival or capture of prey. One challenge in this area comes with how to test theoretical ideas about strategy with experimental measurements of features such as speed, flush distance and escape angles. Tactics may be articulated with an analytical model that predicts the motion of predator or prey as they interact. However, it may be difficult to recognize how the predictions of such models relate to behavioural measurements that are inherently variable. Here, we present an alternative approach for modelling predator-prey interactions that uses deterministic dynamics, yet incorporates experimental kinematic measurements of natural variation to predict the outcome of biological events. This technique, called probabilistic analytical modelling (PAM), is illustrated by the interactions between predator and prey fish in two case studies that draw on recent experiments. In the first case, we use PAM to model the tactics of predatory bluefish ( Pomatomus saltatrix) as they prey upon smaller fish ( Fundulus heteroclitus). We find that bluefish perform deviated pure pursuit with a variable pursuit angle that is suboptimal for the time to capture. In the second case, we model the escape tactics of zebrafish larvae ( Danio rerio) when approached by adult predators of the same species. Our model successfully predicts the measured patterns of survivorship using measured probability density functions as parameters. As these results demonstrate, PAM is a data-driven modelling approach that can be predictive, offers analytical transparency, and does not require numerical simulations of system dynamics. Though predator-prey interactions demonstrate the use of this technique, PAM is not limited to studying biological systems and has broad utility that may be applied towards understanding a wide variety of natural and engineered dynamical systems where data-driven modelling is beneficial.

The History and Philosophy of Ecological Psychology

Ecological Psychology is an embodied, situated, and non-representational approach pioneered by J. J. Gibson and E. J. Gibson. This theory aims to offer a third way beyond cognitivism and behaviorism for understanding cognition. The theory started with the rejection of the premise of the poverty of the stimulus, the physicalist conception of the stimulus, and the passive character of the perceiver of mainstream theories of perception. On the contrary, the main principles of ecological psychology are the continuity of perception and action, the organism-environment system as unit of analysis, the study of affordances as the objects of perception, combined with an emphasis on perceptual learning and development. In this paper, first, we analyze the philosophical and psychological influences of ecological psychology: pragmatism, behaviorism, phenomenology, and Gestalt psychology. Second, we summarize the main concepts of the approach and their historical development following the academic biographies of the proponents. Finally, we highlight the most significant developments of this psychological tradition. We conclude that ecological psychology is one of the most innovative approaches in the psychological field, as it is reflected in its current influence in the contemporary embodied and situated cognitive sciences, where the notion of affordance and the work of E. J. Gibson and J. J. Gibson is considered as a historical antecedent.

The Reality of Virtual Reality: A Comparison of Pedestrian Behavior in Real and Virtual Environments

Virtual reality (VR) can be a very effective tool to evaluate built environment to support improvement of pedestrian and other vulnerable road user safety. However, in order to draw actionable conclusions from VR it is important to understand the degree to which pedestrians’ perceptions and behaviors match across real and virtual environments. In this study, participants experienced equivalent real and virtual environments and performed similar tasks in each. Tasks included pedestrian’ intention to cross, estimation of speed and distance of an approaching vehicle, and the perceived safety and risk of crossing a road. Pedestrians’ presence was also measured in all environments. Result showed that there were no differences between the real and virtual environments for most of the tasks. Significant differences between real and virtual environments were observed in the estimation of speed and measures of presence. These results have important implications for using VR as tool to evaluate pedestrian safety in built environments.

Collision Avoidance Behavior between Walkers: Global and Local Motion Cues

Daily activities require agents to interact with each other, such as during collision avoidance. The nature of visual information that is used for a collision free interaction requires further understanding. We aim to manipulate the nature of visual information in two forms, global and local information appearances. Sixteen healthy participants navigated towards a target in an immersive computer-assisted virtual environment (CAVE) using a joystick. A moving passive obstacle crossed the participant's trajectory perpendicularly at various pre-defined risks of collision distances. The obstacle was presented with one of five virtual appearances, associated to global motion cues (i.e., a cylinder or a sphere), or local motion cues (i.e., only the legs or the trunk). A full body virtual walker, showing both local and global motion cues, used as a reference condition. The final crossing distance was affected by the global motion appearances, however, appearance had no qualitative effect on motion adaptations. These findings contribute towards further understanding what information people use when interacting with others.

Division of labor as an emergent phenomenon of social coordination: The example of playing doubles-pong

In many daily situations, our behavior is coordinated with that of others. This study investigated this coordination in a doubles-pong task. In this task, two participants each controlled a paddle that could move laterally near the bottom of a shared computer screen. With their paddles, the players needed to block balls that moved down under an angle. In doing so, they needed to make sure that their paddles did not collide. A successful interception led to the ball bouncing back upwards. Importantly, all communication other than through vision of the shared screen was excluded. In the experiment, the initial position of the paddle of the right player was varied across trials. This allowed testing hypotheses regarding the use of a tacitly understood boundary to divide interception space. This boundary could be halfway the screen, or in the middle between the initial positions of the two paddles. These two hypotheses did not hold. As an alternative to planned division of labor, the behavioral patterns might emerge from continuous visual couplings of paddles and ball. This was tested with an action-based decision model that considered the rates of change of each player's angle between the interception axis and the line connecting the ball and inner edge of the paddle. The model accounted for the observed patterns of behavior to a very large extent. This led to the conclusion that decisions of who would take the ball emerged from ongoing social coordination. Implications for social coordination in general are discussed.

Intercepting a moving target: On-line or model-based control?

When walking to intercept a moving target, people take an interception path that appears to anticipate the target's trajectory. According to the constant bearing strategy, the observer holds the bearing direction of the target constant based on current visual information, consistent with on-line control. Alternatively, the interception path might be based on an internal model of the target's motion, known as model-based control. To investigate these two accounts, participants walked to intercept a moving target in a virtual environment. We degraded the target's visibility by blurring the target to varying degrees in the midst of a trial, in order to influence its perceived speed and position. Reduced levels of visibility progressively impaired interception accuracy and precision; total occlusion impaired performance most and yielded nonadaptive heading adjustments. Thus, performance strongly depended on current visual information and deteriorated qualitatively when it was withdrawn. The results imply that locomotor interception is normally guided by current information rather than an internal model of target motion, consistent with on-line control.

To Pass or Not to Pass: Modeling the Movement and Affordance Dynamics of a Pick and Place Task

Humans commonly engage in tasks that require or are made more efficient by coordinating with other humans. In this paper we introduce a task dynamics approach for modeling multi-agent interaction and decision making in a pick and place task where an agent must move an object from one location to another and decide whether to act alone or with a partner. Our aims were to identify and model (1) the affordance related dynamics that define an actor's choice to move an object alone or to pass it to their co-actor and (2) the trajectory dynamics of an actor's hand movements when moving to grasp, relocate, or pass the object. Using a virtual reality pick and place task, we demonstrate that both the decision to pass or not pass an object and the movement trajectories of the participants can be characterized in terms of a behavioral dynamics model. Simulations suggest that the proposed behavioral dynamics model exhibits features observed in human participants including hysteresis in decision making, non-straight line trajectories, and non-constant velocity profiles. The proposed model highlights how the same low-dimensional behavioral dynamics can operate to constrain multiple (and often nested) levels of human activity and suggests that knowledge of what, when, where and how to move or act during pick and place behavior may be defined by these low dimensional task dynamics and, thus, can emerge spontaneously and in real-time with little a priori planning.

Playing 'Pong' Together: Emergent Coordination in a Doubles Interception Task

In this contribution we set out to study how a team of two players coordinated their actions so as to intercept an approaching ball. Adopting a doubles-pong task, six teams of two participants each intercepted balls moving downward across a screen toward an interception axis by laterally displacing participant-controlled on-screen paddles. With collisions between paddles resulting in unsuccessful interception, on each trial participants had to decide amongst them who would intercept the ball and who would not. In the absence of possibilities for overt communication, such team decisions were informed exclusively by the visual information provided on the screen. Results demonstrated that collisions were rare and that 91.3 ± 3.4% of all balls were intercepted. While all teams demonstrated a global division of interception space, boundaries between interception domains were fuzzy and could moreover be shifted away from the center of the screen. Balls arriving between the participants’ initial paddle positions often gave rise to both participants initiating an interception movement, requiring one of the participants to abandon the interception attempt at some point so as to allow the other participant to intercept the ball. A simulation of on-the-fly decision making of who intercepted the ball based on a measure capturing the triangular relations between the two paddles and the ball allowed the qualitative aspects of the pattern of observed results to be reproduced, including the timing of abandoning. Overall, the results thus suggest that decisions regarding who intercepts the ball emerge from between-participant interactions.

Perceiving Possibilities for Action: On the Necessity of Calibration and Perceptual Learning for the Visual Guidance of Action

Tasks such as steering, braking, and intercepting moving objects constitute a class of behaviors, known as visually guided actions, which are typically carried out under continuous control on the basis of visual information. Several decades of research on visually guided action have resulted in an inventory of control laws that describe for each task how information about the sufficiency of one's current state is used to make ongoing adjustments. Although a considerable amount of important research has been generated within this framework, several aspects of these tasks that are essential for successful performance cannot be captured. The purpose of this paper is to provide an overview of the existing framework, discuss its limitations, and introduce a new framework that emphasizes the necessity of calibration and perceptual learning. Within the proposed framework, successful human performance on these tasks is a matter of learning to detect and calibrate optical information about the boundaries that separate possible from impossible actions. This resolves a long-lasting incompatibility between theories of visually guided action and the concept of an affordance. The implications of adopting this framework for the design of experiments and models of visually guided action are discussed.

When hawks attack: animal-borne video studies of goshawk pursuit and prey-evasion strategies

Video filmed by a camera mounted on the head of a Northern Goshawk (Accipiter gentilis) was used to study how the raptor used visual guidance to pursue prey and land on perches. A combination of novel image analysis methods and numerical simulations of mathematical pursuit models was used to determine the goshawk's pursuit strategy. The goshawk flew to intercept targets by fixing the prey at a constant visual angle, using classical pursuit for stationary prey, lures or perches, and usually using constant absolute target direction (CATD) for moving prey. Visual fixation was better maintained along the horizontal than vertical direction. In some cases, we observed oscillations in the visual fix on the prey, suggesting that the goshawk used finite-feedback steering. Video filmed from the ground gave similar results. In most cases, it showed goshawks intercepting prey using a trajectory consistent with CATD, then turning rapidly to attack by classical pursuit; in a few cases, it showed them using curving non-CATD trajectories. Analysis of the prey's evasive tactics indicated that only sharp sideways turns caused the goshawk to lose visual fixation on the prey, supporting a sensory basis for the surprising frequency and effectiveness of this tactic found by previous studies. The dynamics of the prey's looming image also suggested that the goshawk used a tau-based interception strategy. We interpret these results in the context of a concise review of pursuit-evasion in biology, and conjecture that some prey deimatic 'startle' displays may exploit tau-based interception.

Different temporal bases for body and arm movements in volleyball serve reception

In many sports, successfully intercepting a ball requires players to move both their body and their arms. Yet, studies of interception typically focus on one or the other. We performed an analysis of the moments of first foot and arm movements of elite-level volleyball players during serve reception. Video footage of five international matches of the Netherlands men's national volleyball team allowed the systematic coding and analysis of 347 different serve reception events. For each event, we identified the time of serve (TS) and time of contact (TC). Ball flight time (from TS to TC) varied between and within types of serve (power jump serves, n = 193, and jumping float serves, n = 154). Correlation analyses revealed that foot movement was initiated with respect to time from TS, while arm movement was initiated with respect to time until TC. These results suggest that whole-body and arm movements rely on different control processes.

On-line and model-based approaches to the visual control of action

Two general approaches to the visual control of action have emerged in last few decades, known as the on-line and model-based approaches. The key difference between them is whether action is controlled by current visual information or on the basis of an internal world model. In this paper, we evaluate three hypotheses: strong on-line control, strong model-based control, and a hybrid solution that combines on-line control with weak off-line strategies. We review experimental research on the control of locomotion and manual actions, which indicates that (a) an internal world model is neither sufficient nor necessary to control action at normal levels of performance; (b) current visual information is necessary and sufficient to control action at normal levels; and (c) under certain conditions (e.g. occlusion) action is controlled by less accurate, simple strategies such as heuristics, visual-motor mappings, or spatial memory. We conclude that the strong model-based hypothesis is not sustainable. Action is normally controlled on-line when current information is available, consistent with the strong on-line control hypothesis. In exceptional circumstances, action is controlled by weak, context-specific, off-line strategies. This hybrid solution is comprehensive, parsimonious, and able to account for a variety of tasks under a range of visual conditions.

Falcons pursue prey using visual motion cues: new perspectives from animal-borne cameras

This study reports on experiments on falcons wearing miniature videocameras mounted on their backs or heads while pursuing flying prey. Videos of hunts by a gyrfalcon (Falco rusticolus), gyrfalcon (F. rusticolus)/Saker falcon (F. cherrug) hybrids and peregrine falcons (F. peregrinus) were analyzed to determine apparent prey positions on their visual fields during pursuits. These video data were then interpreted using computer simulations of pursuit steering laws observed in insects and mammals. A comparison of the empirical and modeling data indicates that falcons use cues due to the apparent motion of prey on the falcon's visual field to track and capture flying prey via a form of motion camouflage. The falcons also were found to maintain their prey's image at visual angles consistent with using their shallow fovea. These results should prove relevant for understanding the co-evolution of pursuit and evasion, as well as the development of computer models of predation and the integration of sensory and locomotion systems in biomimetic robots.

How children and adults learn to intercept moving gaps

We used an immersive virtual environment to examine how children and adults learn to intercept moving gaps and whether children and adults benefit from variability of practice. Children (10- and 12-year-olds) and adults attempted to bicycle between two moving vehicle-size blocks without stopping. In Experiment 1, block motions were timed such that if participants maintained a constant speed, they would intercept the gap between the blocks. By the last set of intersections, adults learned to maintain a constant speed throughout the approach to the intersection, 12-year-olds exhibited less variability in time-to-spare when they intercepted the blocks, and 10-year-olds exhibited no significant change across intersection sets. In Experiment 2, block motions during the first eight intersections were timed such that participants needed to either speed up or slow down on all intersections or needed to speed up on half and slow down on half of the intersections. On the last four intersections, all age groups encountered a novel block timing in which no adjustment in speed was necessary to intercept the blocks. The adults performed well regardless of whether they experienced consistent or variable block timings. The 10-year-olds in the variable condition performed better on slow-down trials than their peers in the slow-down condition but performed worse on speed-up trials than their peers in the speed-up condition. Discussion focuses on possible developmental changes in reliance on perceptually available and remembered information in complex perception-action tasks.

Task-specific response strategy selection on the basis of recent training experience

The goal of training is to produce learning for a range of activities that are typically more general than the training task itself. Despite a century of research, predicting the scope of learning from the content of training has proven extremely difficult, with the same task producing narrowly focused learning strategies in some cases and broadly scoped learning strategies in others. Here we test the hypothesis that human subjects will prefer a decision strategy that maximizes performance and reduces uncertainty given the demands of the training task and that the strategy chosen will then predict the extent to which learning is transferable. To test this hypothesis, we trained subjects on a moving dot extrapolation task that makes distinct predictions for two types of learning strategy: a narrow model-free strategy that learns an input-output mapping for training stimuli, and a general model-based strategy that utilizes humans' default predictive model for a class of trajectories. When the number of distinct training trajectories is low, we predict better performance for the mapping strategy, but as the number increases, a predictive model is increasingly favored. Consonant with predictions, subject extrapolations for test trajectories were consistent with using a mapping strategy when trained on a small number of training trajectories and a predictive model when trained on a larger number. The general framework developed here can thus be useful both in interpreting previous patterns of task-specific versus task-general learning, as well as in building future training paradigms with certain desired outcomes.

Predicting what humans will learn from a training task, in particular, whether learning will generalize beyond the specifics of the given experience, is of both significant practical and theoretical interest. However, a principled understanding of the relationship between training conditions and learning generalization remains elusive. In this paper, we develop a computational framework for predicting which of two basic decision-making strategies will be utilized by human subjects - 1) simple stimulus-response mappings or 2) predictive models. Through simulation, we show that the nature of the training experience determines which of these categories leads to better in-task performance; repetitive training on a small set of examples favors simple stimulus-response mappings, whereas training on a large set of examples favors predictive strategies. We then show that humans trained under these various conditions do indeed utilize the predicted strategy. Finally, we show that the strategies that are utilized during training predict generalization of learning. Those who learn simple mappings fail to generalize their new skills, in contrast to those who use default predictive strategies. The framework developed here is useful both in interpreting previous patterns of learning, as well as in building training paradigms with given desired outcomes.

Blind(fold)ed by science: a constant target-heading angle is used in visual and nonvisual pursuit

Previous work investigating the strategies that observers use to intercept moving targets has shown that observers maintain a constant target-heading angle (CTHA) to achieve interception. Most of this work has concluded or indirectly assumed that vision is necessary to do this. We investigated whether blindfolded pursuers chasing a ball carrier holding a beeping football would utilize the same strategy that sighted observers use to chase a ball carrier. Results confirm that both blindfolded and sighted pursuers use a CTHA strategy in order to intercept targets, whether jogging or walking and irrespective of football experience and path and speed deviations of the ball carrier during the course of the pursuit. This work shows that the mechanisms involved in intercepting moving targets may be designed to use different sensory mechanisms in order to drive behavior that leads to the same end result. This has potential implications for the supramodal representation of motion perception in the human brain.

Humans perceive object motion in world coordinates during obstacle avoidance

A fundamental question about locomotion in the presence of moving objects is whether movements are guided based upon perceived object motion in an observer-centered or world-centered reference frame. The former captures object motion relative to the moving observer and depends on both observer and object motion. The latter captures object motion relative to the stationary environment and is independent of observer motion. Subjects walked through a virtual environment (VE) viewed through a head-mounted display and indicated whether they would pass in front of or behind a moving obstacle that was on course to cross their future path. Subjects' movement through the VE was manipulated such that object motion in observer coordinates was affected while object motion in world coordinates was the same. We found that when moving observers choose routes around moving obstacles, they rely on object motion perceived in world coordinates. This entails a process, which has been called flow parsing (Rushton & Warren, 2005; Warren & Rushton, 2009a), that recovers the component of optic flow due to object motion independent of self-motion. We found that when self-motion is real and actively generated, the process by which object motion is recovered relies on both visual and nonvisual information to factor out the influence of self-motion. The remaining component contains information about object motion in world coordinates that is needed to guide locomotion.

Guiding locomotion in complex, dynamic environments

Locomotion in complex, dynamic environments is an integral part of many daily activities, including walking in crowded spaces, driving on busy roadways, and playing sports. Many of the tasks that humans perform in such environments involve interactions with moving objects-that is, they require people to coordinate their own movement with the movements of other objects. A widely adopted framework for research on the detection, avoidance, and interception of moving objects is the bearing angle model, according to which observers move so as to keep the bearing angle of the object constant for interception and varying for obstacle avoidance. The bearing angle model offers a simple, parsimonious account of visual control but has several significant limitations and does not easily scale up to more complex tasks. In this paper, I introduce an alternative account of how humans choose actions and guide locomotion in the presence of moving objects. I show how the new approach addresses the limitations of the bearing angle model and accounts for a variety of behaviors involving moving objects, including (1) choosing whether to pass in front of or behind a moving obstacle, (2) perceiving whether a gap between a pair of moving obstacles is passable, (3) avoiding a collision while passing through single or multiple lanes of traffic, (4) coordinating speed and direction of locomotion during interception, (5) simultaneously intercepting a moving target while avoiding a stationary or moving obstacle, and (6) knowing whether to abandon the chase of a moving target. I also summarize data from recent studies that support the new approach.

Visuomotor control of human adaptive locomotion: understanding the anticipatory nature

To maintain balance during locomotion, the central nervous system (CNS) accommodates changes in the constraints of spatial environment (e.g., existence of an obstacle or changes in the surface properties). Locomotion while modifying the basic movement patterns in response to such constraints is referred to as adaptive locomotion. The most powerful means of ensuring balance during adaptive locomotion is to visually perceive the environmental properties at a distance and modify the movement patterns in an anticipatory manner to avoid perturbation altogether. For this reason, visuomotor control of adaptive locomotion is characterized, at least in part, by its anticipatory nature. The purpose of the present article is to review the relevant studies which revealed the anticipatory nature of the visuomotor control of adaptive locomotion. The anticipatory locomotor adjustments for stationary and changeable environment, as well as the spatio-temporal patterns of gaze behavior to support the anticipatory locomotor adjustments are described. Such description will clearly show that anticipatory locomotor adjustments are initiated when an object of interest (e.g., a goal or obstacle) still exists in far space. This review also show that, as a prerequisite of anticipatory locomotor adjustments, environmental properties are accurately perceived from a distance in relation to individual’s action capabilities.

Modeling heading and path perception from optic flow in the case of independently moving objects

Humans are usually accurate when estimating heading or path from optic flow, even in the presence of independently moving objects (IMOs) in an otherwise rigid scene. To invoke significant biases in perceived heading, IMOs have to be large and obscure the focus of expansion (FOE) in the image plane, which is the point of approach. For the estimation of path during curvilinear self-motion no significant biases were found in the presence of IMOs. What makes humans robust in their estimation of heading or path using optic flow? We derive analytical models of optic flow for linear and curvilinear self-motion using geometric scene models. Heading biases of a linear least squares method, which builds upon these analytical models, are large, larger than those reported for humans. This motivated us to study segmentation cues that are available from optic flow. We derive models of accretion/deletion, expansion/contraction, acceleration/deceleration, local spatial curvature, and local temporal curvature, to be used as cues to segment an IMO from the background. Integrating these segmentation cues into our method of estimating heading or path now explains human psychophysical data and extends, as well as unifies, previous investigations. Our analysis suggests that various cues available from optic flow help to segment IMOs and, thus, make humans' heading and path perception robust in the presence of such IMOs.

Visual and non-visual contributions to the perception of object motion during self-motion

Many locomotor tasks involve interactions with moving objects. When observer (i.e., self-)motion is accompanied by object motion, the optic flow field includes a component due to self-motion and a component due to object motion. For moving observers to perceive the movement of other objects relative to the stationary environment, the visual system could recover the object-motion component - that is, it could factor out the influence of self-motion. In principle, this could be achieved using visual self-motion information, non-visual self-motion information, or a combination of both. In this study, we report evidence that visual information about the speed (experiment 1) and direction (experiment 2) of self-motion plays a role in recovering the object-motion component even when non-visual self-motion information is also available. However, the magnitude of the effect was less than one would expect if subjects relied entirely on visual self-motion information. Taken together with previous studies, we conclude that when self-motion is real and actively generated, both visual and non-visual self-motion information contribute to the perception of object motion. We also consider the possible role of this process in visually guided interception and avoidance of moving objects.

Receivers in American Football Use a Constant Optical Projection Plane Angle to Pursue and Catch Thrown Footballs

In the present work we test how well two interceptive strategies, which have been proposed for catching balls hit high in the air in baseball and cricket, account for receivers in American football catching footballs. This is an important test of the domain generality of these strategies as this is the first study examining a situation where the pursuer's locomotor axis is directed away from the origin of the ball, and because the flight characteristics of an American football are far different from targets studied in prior work. The first strategy is to elicit changes in the ball's lateral optical position that match changes in the vertical optical position so that the optical projection plane angle, ψ, remains constant, thus resulting in a linear optical trajectory (LOT). The second is keeping vertical optical ball velocity decreasing while maintaining constant lateral optical velocity (generalized optical acceleration cancellation, or GOAC). We found that the optical projection plane angle was maintained as constant significantly more often than maintaining vertical and lateral optical velocities as GOAC predicted. The present experiment extends previous research by showing that the constancy of ψ resulting in an LOT is used by humans pursuing American footballs and demonstrates the domain generality of the LOT heuristic.

Intercepting a moving traffic gap while avoiding collision with lead and trail vehicles: gap-related and boundary-related influences on drivers' speed regulations during approach to an intersection

Using a fixed-base driving simulator, 15 participants actively drove their vehicle across a rural road toward an intersection. Their task was to safely cross the intersection, passing through a gap in the train of incoming traffic. Spatiotemporal task constraints were manipulated by varying the initial conditions (offsets) with respect to the time of arrival of the traffic gap at the intersection. Orthogonally manipulating the motion characteristics of the lead and trail vehicles forming the traffic gap allowed evaluating the influences of the global (gap-related) and local (lead/trail-vehicle-related) aspects of the inter-vehicular interval. The results revealed that the different initial offsets gave rise to functional, continuous and gradual adjustments in approach speed, initiated early on during approach to the intersection. Drivers systematically accelerated during the final stages of approach, on average crossing the gap slightly ahead of the center of the traffic gap. A special-purpose ANOVA demonstrated an influence of (global) gap characteristics such as gap size and speed. Further analyses demonstrated that the motion characteristics of the lead vehicle exerted a stronger influence on approach behavior than the motion characteristics of the trail vehicle. The results are interpreted as signing the online regulation of approach speed, concurrently based on intercepting the (center of the) traffic gap and avoiding collision with the lead and trail vehicles.