Missing in action: the effect of obstacle position and size on avoidance while reaching

Wing-shaped walls: A directional effect of obstacles on manual avoidance

Visual information can be used to plan, start, and coordinate manual movements in obstacle avoidance. An intriguing example of visuomotor coordination is the effect of wing-shaped walls, in which walls are oriented away from or toward a moving agent. A historical story from medieval Japan recounts that wing-shaped walls disrupted the agent's movement more when oriented toward the agent than when oriented away from the agent. This study aimed at examining whether the disruptive effect of wing-shaped walls occurs in a schematic situation represented on a 2D plane. In this study, we conducted psychophysical experiments in which participants were asked to move a stylus from a start point to a goal while avoiding multiple line obstacles that were arranged alternately at a course. In the two experiments, we manipulated the orientation and the size of the visible parts of the obstacles systematically. We found that the obstacles oriented toward the agent produced frequent contacts with the agent and attracted manual movements to the endpoints of obstacles. We discussed possible interpretations of the results in the context of attentional guidance.

Online updating of obstacle positions when intercepting a virtual target

People rely upon sensory information in the environment to guide their actions. Ongoing goal-directed arm movements are constantly adjusted to the latest estimate of both the target and hand's positions. Does the continuous guidance of ongoing arm movements also consider the latest visual information of the position of obstacles in the surrounding? To find out, we asked participants to slide their finger across a screen to intercept a laterally moving virtual target while moving through a gap that was created by two virtual circular obstacles. At a fixed time during each trial, the target suddenly jumped slightly laterally while still continuing to move. In half the trials, the size of the gap changed at the same moment as the target jumped. As expected, participants adjusted their movements in response to the target jump. Importantly, the magnitude of this response depended on the new size of the gap. If participants were told that the circles were irrelevant, changing the gap between them had no effect on the responses. This shows that obstacles' instantaneous positions can be considered when visually guiding goal-directed movements.

Eye-hand coordination: memory-guided grasping during obstacle avoidance

When reaching to grasp previously seen, now out-of-view objects, we rely on stored perceptual representations to guide our actions, likely encoded by the ventral visual stream. So-called memory-guided actions are numerous in daily life, for instance, as we reach to grasp a coffee cup hidden behind our morning newspaper. Little research has examined obstacle avoidance during memory-guided grasping, though it is possible obstacles with increased perceptual salience will provoke exacerbated avoidance maneuvers, like exaggerated deviations in eye and hand position away from obtrusive obstacles. We examined the obstacle avoidance strategies adopted as subjects reached to grasp a 3D target object under visually-guided (closed loop or open loop with full vision prior to movement onset) and memory-guided (short- or long-delay) conditions. On any given trial, subjects reached between a pair of flanker obstacles to grasp a target object. The positions and widths of the obstacles were manipulated, though their inner edges remained a constant distance apart. While reach and grasp behavior was consistent with the obstacle avoidance literature, in that reach, grasp, and gaze positions were biased away from obstacles most obtrusive to the reaching hand, our results reveal distinctive avoidance approaches undertaken depend on the availability of visual feedback. Contrary to expectation, we found subjects reaching to grasp after a long delay in the absence of visual feedback failed to modify their final fixation and grasp positions to accommodate the different positions of obstacles, demonstrating a more moderate, rather than exaggerative, obstacle avoidance strategy.

Online modification of goal-directed control in human reaching movements

Humans are able to perform very sophisticated reaching movements in a myriad of contexts based on flexible control strategies influenced by the task goal and environmental constraints such as obstacles. However, it remains unknown whether these control strategies can be adjusted online. The objective of this study was to determine whether the factors that determine control strategies during planning also modify the execution of an ongoing movement following sudden changes in task demand. More precisely, we investigated whether, and at which latency, feedback responses to perturbation loads followed the change in the structure of the goal target or environment. We changed the target width (square or rectangle) to alter the task redundancy, or the presence of obstacles to induce different constraints on the reach path, and assessed based on surface electromyography (EMG) recordings when the change in visual display altered the feedback response to mechanical perturbations. Task-related EMG responses were detected within 150 ms of a change in target shape. Considering visuomotor delays of ∼ 100 ms, these results suggest that it takes 50 ms to change control policy within a trial. An additional 30-ms delay was observed when the change in context involved sudden appearance or disappearance of obstacles. Overall, our results demonstrate that the control policy within a reaching movement is not static: contextual factors that influence movement planning also influence movement execution at surprisingly short latencies. Moreover, the additional 30 ms associated with obstacles suggests that these two types of changes may be mediated via distinct processes.NEW & NOTEWORTHY The present work demonstrates that the control strategies used to perform reaching movements are adjusted online when the structure of the target or the presence of obstacles are altered during movements. Thus, the properties of goal-directed reaching control are not simply selected during the planning stage of a movement prior to execution. Rather, they are dynamically and rapidly adjusted online, within ∼150 ms, according to changes in environment.

When two worlds collide: the influence of an obstacle in peripersonal space on multisensory encoding

Multisensory coding of the space surrounding our body, the peripersonal space, is crucial for motor control. Recently, it has been proposed that an important function of multisensory coding is that it allows anticipation of the tactile consequences of contact with a nearby object. Indeed, performing goal-directed actions (i.e. pointing and grasping) induces a continuous visuotactile remapping as a function of on-line sensorimotor requirements. Here, we investigated whether visuotactile remapping can be induced by obstacles, e.g. objects that are not the target of the grasping movement. In the current experiment, we used a cross-modal obstacle avoidance paradigm, in which participants reached past an obstacle to grasp a second object. Participants indicated the location of tactile targets delivered to the hand during the grasping movement, while a visual cue was sometimes presented simultaneously on the to-be-avoided object. The tactile and visual stimulation was triggered when the reaching hand passed a position that was drawn randomly from a continuous set of predetermined locations (between 0 and 200 mm depth at 5 mm intervals). We observed differences in visuotactile interaction during obstacle avoidance dependent on the location of the stimulation trigger: visual interference was enhanced for tactile stimulation that occurred when the hand was near the to-be-avoided object. We show that to-be-avoided obstacles, which are relevant for action but are not to-be-interacted with (as the terminus of an action), automatically evoke the tactile consequences of interaction. This shows that visuotactile remapping extends to obstacle avoidance and that this process is flexible.

Reaching for known unknowns: Rapid reach decisions accurately reflect the future state of dynamic probabilistic information

Everyday tasks such as catching a ball appear effortless, but in fact require complex interactions and tight temporal coordination between the brain's visual and motor systems. What makes such interceptive actions particularly impressive is the capacity of the brain to account for temporal delays in the central nervous system-a limitation that can be mitigated by making predictions about the environment as well as one's own actions. Here, we wanted to assess how well human participants can plan an upcoming movement based on a dynamic, predictable stimulus that is not the target of action. A central stationary or rotating stimulus determined the probability that each of two potential targets would be the eventual target of a rapid reach-to-touch movement. We examined the extent to which reach movement trajectories convey internal predictions about the future state of dynamic probabilistic information conveyed by the rotating stimulus. We show that movement trajectories reflect the target probabilities determined at movement onset, suggesting that humans rapidly and accurately integrate visuospatial predictions and estimates of their own reaction times to effectively guide action.

Blindsight

For over a century, research has demonstrated that damage to primary visual cortex does not eliminate all capacity for visual processing in the brain. From Riddoch's (1917) early demonstration of intact motion processing for blind field stimuli, to the iconic work of Weiskrantz et al. (1974) showing reliable spatial localization, it is clear that secondary visual pathways that bypass V1 carry information to the visual brain that in turn influences behavior. In this chapter, we briefly outline the history and phenomena associated with blindsight, before discussing the nature of the secondary visual pathways that support residual visual processing in the absence of V1. We finish with some speculation as to the functional characteristics of these secondary pathways.

A double dissociation between action and perception in bimanual grasping: evidence from the Ponzo and the Wundt-Jastrow illusions

Research on visuomotor control suggests that visually guided actions toward objects rely on functionally distinct computations with respect to perception. For example, a double dissociation between grasping and between perceptual estimates was reported in previous experiments that pit real against illusory object size differences in the context of the Ponzo illusion. While most previous research on the relation between action and perception focused on one-handed grasping, everyday visuomotor interactions also entail the simultaneous use of both hands to grasp objects that are larger in size. Here, we examined whether this double dissociation extends to bimanual movement control. In Experiment 1, participants were presented with different-sized objects embedded in the Ponzo Illusion. In Experiment 2, we tested whether the dissociation between perception and action extends to a different illusion, the Wundt-Jastrow illusion, which has not been previously used in grasping experiments. In both experiments, bimanual grasping trajectories reflected the differences in physical size between the objects; At the same time, perceptual estimates reflected the differences in illusory size between the objects. These results suggest that the double dissociation between action and perception generalizes to bimanual movement control. Unlike conscious perception, bimanual grasping movements are tuned to real-world metrics, and can potentially resist irrelevant information on relative size and depth.

Reaching around obstacles accounts for uncertainty in coordinate transformations

When reaching to a visual target, humans need to transform the spatial target representation into the coordinate system of their moving arm. It has been shown that increased uncertainty in such coordinate transformations, for instance, when the head is rolled toward one shoulder, leads to higher movement variability and influence movement decisions. However, it is unknown whether the brain incorporates such added variability in planning and executing movements. We designed an obstacle avoidance task in which participants had to reach with or without visual feedback of the hand to a visual target while avoiding collisions with an obstacle. We varied coordinate transformation uncertainty by varying head roll (straight, 30° clockwise, and 30° counterclockwise). In agreement with previous studies, we observed that the reaching variability increased when the head was tilted. Indeed, head roll did not influence the number of collisions during reaching compared with the head-straight condition, but it did systematically change the obstacle avoidance behavior. Participants changed the preferred direction of passing the obstacle and increased the safety margins indicated by stronger movement curvature. These results suggest that the brain takes the added movement variability during head roll into account and compensates for it by adjusting the reaching trajectories.NEW & NOTEWORTHY We show that changing body geometry such as head roll results in compensatory reaching behaviors around obstacles. Specifically, we observed head roll causes changed preferred movement direction and increased trajectory curvature. As has been shown before, head roll increases movement variability due to stochastic coordinate transformations. Thus these results provide evidence that the brain must consider the added movement variability caused by coordinate transformations for accurate reach movements.

A comparison of simple movement behaviors across three different devices

Reaching trajectories have provided a unique tool to observe changes in internal cognitive decisions. Furthermore, technological advances have made devices for measuring reach movements more accessible and researchers have recognized that various populations including children, elderly populations, and non-human primates can easily execute simple movements as responses. As a result, devices such as a three-dimensional (3D) reach tracker, a stylus, or a computer-mouse have been increasingly utilized to study cognitive processes. However, although the specific type of tracking device that a researcher uses may impact behavior due to the constraints it places on movements, most researchers in these fields are unaware of this potential issue. Here, we examined the potential behavioral impact of using each of these three devices. To induce re-directed movements that mimic the movements that often occur following changes in cognitive states, we used a double-step task in which displacement of an initial target location requires participants to quickly re-direct their movement. We found that reach movement parameters were largely comparable across the three devices. However, hand movements measured by a 3D reach tracker showed earlier reach initiation latencies (relative to stylus movements) and more curved movement trajectories (relative to both mouse and stylus movements). Reach movements were also re-directed following target displacement more rapidly. Thus, 3D reach trackers may be ideal for observing fast, subtle changes in internal decision-making processes compared to other devices. Taken together, this study provides a useful reference for comparing and implementing reaching studies to examine human cognition.

Neural Networks Mediating Perceptual Learning in Congenital Blindness

Despite the fact that complete visual deprivation leads to volumetric reductions in brain structures associated with spatial learning, blind individuals are still able to navigate. The neural structures involved in this function are not fully understood. Our study aims to correlate the performance of congenitally blind individuals (CB) and blindfolded sighted controls (SC) in a life-size obstacle-course using a visual-to-tactile sensory substitution device, with the size of brain structures (voxel based morphometry-VBM-) measured through structural magnetic resonance Imaging (MRI). VBM was used to extract grey matter volumes within several a-priori defined brain regions in all participants. Principal component analysis was utilized to group brain regions in factors and orthogonalize brain volumes. Regression analyses were then performed to link learning abilities to these factors. We found that (1) both CB and SC were able to learn to detect and avoid obstacles; (2) their learning rates for obstacle detection and avoidance correlated significantly with the volume of brain structures known to be involved in spatial skills. There is a similar relation between regions of the dorsal stream network and avoidance for both SC and CB whereas for detection, SC rely more on medial temporal lobe structures and CB on sensorimotor areas.

Visual Selection of the Future Reach Path in Obstacle Avoidance

In two EEG experiments, we studied the role of visual attention during the preparation of manual movements around an obstacle. Participants performed rapid hand movements to a goal position avoiding a central obstacle either on the left or right side, depending on the pitch of the acoustical go signal. We used a dot probe paradigm to analyze the deployment of spatial attention in the visual field during the motor preparation. Briefly after the go signal but still before the hand movement actually started, a visual transient was flashed either on the planned pathway of the hand (congruent trials) or on the opposite, movement-irrelevant side (incongruent trials). The P1/N1 components that were evoked by the onset of the dot probe were enhanced in congruent trials where the visual transient was presented on the planned path of the hand. The results indicate that, during movement preparation, attention is allocated selectively to the planned trajectory the hand is going to take around the obstacle.

Characterization of normative hand movements during two functional upper limb tasks

Background

Dexterous hand function is crucial for completing activities of daily living (ADLs), which typically require precise hand-object interactions. Kinematic analyses of hand trajectory, hand velocity, and grip aperture provide valuable mechanistic insights into task performance, but there is a need for standardized tasks representative of ADLs that are amenable to motion capture and show consistent performance in non-disabled individuals. Our objective was to develop two standardized functional upper limb tasks and to quantitatively characterize the kinematics of normative hand movement.

Methods

Twenty non-disabled participants were recruited to perform two tasks: the Pasta Box Task and Cup Transfer Task. A 12-camera motion capture system was used to collect kinematic data from which hand movement and grip aperture measures were calculated. Measures reported for reach-grasp and transport-release segments were hand distance travelled, hand trajectory variability, movement time, peak and percent-to-peak hand velocity, number of movement units, peak and percent-to-peak grip aperture, and percent-to-peak hand deceleration. A between-session repeatability analysis was conducted on 10 participants.

Results

Movement times were longer for transport-release compared to reach-grasp for every movement. Hand and grip aperture measures had low variability, with 55 out of 63 measures showing good repeatability (ICC > 0.75). Cross-body movements in the Pasta Box Task had longer movement times and reduced percent-to-peak hand velocity values. The Cup Transfer Task showed decoupling of peak grip aperture and peak hand deceleration for all movements. Movements requiring the clearing of an obstacle while transporting an object displayed a double velocity peak and typically a longer deceleration phase.

Discussion

Normative hand kinematics for two standardized functional tasks challenging various aspects of hand-object interactions important for ADLs showed excellent repeatability. The consistency in normative task performance across a variety of task demands shows promise as a potential outcome assessment for populations with upper limb impairment.

Principles of Motor Recovery After Neurological Injury Based on a Motor Control Theory

Problems of neurological rehabilitation are considered based on two levels of the International Classification of Functioning (ICF)-Body Structures and Function level and Activity level-and modulating factors related to the individual and the environment. Specifically, at the Body Structures and Function level, problems addressed include spasticity, muscle weakness, disordered muscle activation patterns and disruptions in coordinated movement. At the Activity level, deficits in multi-joint and multi-segment upper limb reaching movements are reviewed. We address how physiologically well established principles in the control of actions, Threshold Control and Referent Control as outlined in the Equilibrium-Point theory can help advance the understanding of underlying deficits that may limit recovery at each level.

Keeping Safe: Intra-individual Consistency in Obstacle Avoidance Behaviour Across Grasping and Locomotion Tasks

Successful obstacle avoidance requires a close coordination of the visual and the motor systems. Visual information is essential for adjusting movements in order to avoid unwanted collisions. Yet, established obstacle avoidance paradigms have typically either focused on gaze strategies or on motor adjustments. Here we were interested in whether humans show similar visuomotor sensitivity to obstacles when gaze and motor behaviour are measured across different obstacle avoidance tasks. To this end, we measured participants’ hand movement paths when grasping targets in the presence of obstacles as well as their gaze behaviour when walking through a cluttered hallway. We found that participants who showed more pronounced motor adjustments during grasping also spent more time looking at obstacles during locomotion. Furthermore, movement durations correlated positively in both tasks. Results suggest considerable intra-individual consistency in the strength of the avoidance response across different visuomotor measures potentially indicating an individual’s tendency to perform safe actions.

Avoiding unseen obstacles: Subcortical vision is not sufficient to maintain normal obstacle avoidance behaviour during reaching

Previous research found that a patient with cortical blindness (homonymous hemianopia) was able to successfully avoid an obstacle placed in his blind field, despite reporting no conscious awareness of it [Striemer, C. L., Chapman, C. S., & Goodale, M. A., 2009, PNAS, 106(37), 15996-16001]. This finding led to the suggestion that dorsal stream areas, that are assumed to mediate obstacle avoidance behaviour, may obtain their visual input primarily from subcortical pathways. Hence, it was suggested that normal obstacle avoidance behaviour can proceed without input from the primary visual cortex. Here we tried to replicate this finding in a group of patients (N = 6) that suffered from highly circumscribed lesions in the occipital lobe (including V1) that spared the subcortical structures that have been associated with action-blindsight. We also tested if obstacle avoidance behaviour differs depending on whether obstacles are placed only in the blind field or in both the blind and intact visual field of the patients simultaneously. As expected, all patients successfully avoided obstacles placed in their intact visual field. However, none of them showed reliable avoidance behaviour - as indicated by adjustments in the hand trajectory in response to obstacle position - for obstacles placed in their blind visual field. The effects were not dependent on whether one or two obstacles were present. These findings suggest that behaviour in complex visuomotor tasks relies on visual input from occipital areas.

It is the flash which appears, the movement will follow: Investigating the relation between spatial attention and obstacle avoidance

Obstacles are represented in the attentional landscape. However, it is currently unclear what the exclusive contribution of attention is to the avoidance response. This is because in earlier obstacle avoidance designs, it was impossible to disentangle an effect of attention from the changing features of the obstacle (e.g., its identity, size, or orientation). Conversely, any feature manipulation could be interpreted as an attentional as well as an obstacle effect on avoidance behavior. We tested the possible tuning of avoidance responses by a spatial cue in two experiments. In both experiments, spatial and nonspatial cues were separately given as go cues for an obstacle avoidance task. Participants had to reach past two obstacles in Experiment 1, and past a single obstacle in Experiment 2. We found that when the right obstacle was flashed, participants veered away more and produced more-variable trajectories over trials than in conditions with nonspatial and left spatial cues, regardless of the presence or absence of another obstacle. Therefore, we concluded that the tuning of avoidance responses can be influenced by spatial cues. Moreover, we speculated that a flashed obstacle receives more attentional weighting in the attentional landscape and prompts a stronger repulsion away from the obstacle.

The Effect of Gaze Position on Reaching Movements in an Obstacle Avoidance Task

Numerous studies have addressed the issue of where people look when they perform hand movements. Yet, very little is known about how visuomotor performance is affected by fixation location. Previous studies investigating the accuracy of actions performed in visual periphery have revealed inconsistent results. While movements performed under full visual-feedback (closed-loop) seem to remain surprisingly accurate, open-loop as well as memory-guided movements usually show a distinct bias (i.e. overestimation of target eccentricity) when executed in periphery. In this study, we aimed to investigate whether gaze position affects movements that are performed under full-vision but cannot be corrected based on a direct comparison between the hand and target position. To do so, we employed a classical visuomotor reaching task in which participants were required to move their hand through a gap between two obstacles into a target area. Participants performed the task in four gaze conditions: free-viewing (no restrictions on gaze), central fixation, or fixation on one of the two obstacles. Our findings show that obstacle avoidance behaviour is moderated by fixation position. Specifically, participants tended to select movement paths that veered away from the obstacle fixated indicating that perceptual errors persist in closed-loop vision conditions if they cannot be corrected effectively based on visual feedback. Moreover, measuring the eye-movement in a free-viewing task (Experiment 2), we confirmed that naturally participants’ prefer to move their eyes and hand to the same spatial location.

Use of early phase online vision for grip configuration is modulated according to movement duration in prehension

Our previous study (Hum Mov Sci 25:349-371, 2006) investigated whether and how online vision in the early phase of movement influences the control of reach-to-grasp movements (movement duration: approximately 1000 ms). We used liquid-crystal shutter goggles to manipulate the duration of available online vision during the movement and specified that online vision during the early phase influences grasping movements. The current study examined the effect of online early phase vision on the grip configuration according to the movement duration and compared it between two different movement durations (approximately 500 and 1000 ms). We found that non-availability of early phase online vision affected the grip configuration (i.e., inducing a larger peak grip aperture) even in the shorter movement duration. The influential period for online vision for grasping control shifts to an earlier time when movement time is shorter (i.e., from approximately 214 to 106 ms after movement onset), indicating a flexible mechanism for grip configuration according to the movement duration and the available online vision.

Hitting a target is fundamentally different from avoiding obstacles

To successfully move our hand to a target, it is important not only to consider the target of our movements but also to consider other objects in the environment that may act as obstacles. We previously found that the time needed to respond to a change in position was considerably longer for a displacement of an obstacle than for a displacement of the target (Aivar, Brenner, & Smeets, 2008. Experimental Brain Research 190, 251-264). In that study, the movement constraints imposed by the obstacles differed from those imposed by the target. To examine whether the latency is really different for targets and obstacles, irrespective of any constraints they impose, we modified the design of the previous experiment to make sure that the constraints were matched. In each trial, two aligned 'objects' of the same size were presented at different distances to the left of the initial position of the hand. Each of these objects could either be a target or a gap (opening between two obstacles). Participants were instructed to pass through both objects. All possible combinations of these two objects were tested: gap-target, target-gap, gap-gap, target-target. On some trials one of the objects changed position after movement onset. Participants systematically responded faster to the displacement of a target than to the displacement of a gap at the same location. We conclude that targets are prioritized over obstacles in movement control.

Non-obstructing 3D depth cues influence reach-to-grasp kinematics

It has been demonstrated that both visual feedback and the presence of certain types of non-target objects in the workspace can affect kinematic measures and the trajectory path of the moving hand during reach-to-grasp movements. Yet no study to date has examined the possible effect of providing non-obstructing three-dimensional (3D) depth cues within the workspace and with consistent retinal inputs and whether or not these alter manual prehension movements. Participants performed a series of reach-to-grasp movements in both open- (without visual feedback) and closed-loop (with visual feedback) conditions in the presence of one of three possible 3D depth cues. Here, it is reported that preventing online visual feedback (or not) and the presence of a particular depth cue had a profound effect on kinematic measures for both the reaching and grasping components of manual prehension-despite the fact that the 3D depth cues did not act as a physical obstruction at any point. The depth cues modulated the trajectory of the reaching hand when the target block was located on the left side of the workspace but not on the right. These results are discussed in relation to previous reports and implications for brain-computer interface decoding algorithms are provided.

Line-bisectioning and obstacle avoidance: evidence for separate strategies

Previous studies have frequently applied a combination of line-bisection tasks (in which participants indicate the middle of a line) and obstacle avoidance tasks (in which participants move their hand between two obstacles) with the aim of revealing perception-action dissociations in certain neurological disorders, such as visual form agnosia and optic ataxia. However, valid conclusions about the underlying processing pathways can only be drawn if participants apply the same strategy in both tasks (i.e. finding the middle between the obstacles). Yet, this assumption has never been tested directly. In this experiment, we investigated whether participants perform obstacle avoidance and line-bisectioning using similar strategies by manipulating the position of the obstacles and the start position of the hand relative to the obstacles. Our results indicate that the lateral hand position during obstacle avoidance does not only vary as a function of obstacle location but also strongly depends on the start position. Moreover, participants showed increased sensitivity to obstacle shifts occurring closer to the hand's start position. In contrast, during line-bisectioning the sensitivity to obstacles shifts was unaffected by the hand's start position. The findings suggest that during obstacle-avoidance the need to keep a safe distance from the obstacles is balanced with the requirement to minimise energetic demands. In contrast, the main intention during line-bisectioning is to move to the perceived midpoint as accurately as possible. The fact that very different constraints underlie trajectory planning in both tasks implies that caution has to be taken when interpreting differences in performance levels.

The influence of object identity on obstacle avoidance reaching behaviour

When reaching for target objects, we hardly ever collide with other objects located in our working environment. Behavioural studies have demonstrated that the introduction of non-target objects into the workspace alters both spatial and temporal parameters of reaching trajectories. Previous studies have shown the influence of spatial object features (e.g. size and position) on obstacle avoidance movements. However, obstacle identity may also play a role in the preparation of avoidance responses as this allows prediction of possible negative consequences of collision based on recognition of the obstacle. In this study we test this hypothesis by asking participants to reach towards a target as quickly as possible, in the presence of an empty or full glass of water placed about half way between the target and the starting position, at 8 cm either left or right of the virtual midline. While the spatial features of full and empty glasses of water are the same, the consequences of collision are clearly different. Indeed, when there was a high chance of collision, reaching trajectories veered away more from filled than from empty glasses. This shows that the identity of potential obstacles, which allows for estimating the predicted consequences of collision, is taken into account during obstacle avoidance.

Dyadic movement synchronization while performing incongruent trajectories requires mutual adaptation

Unintentional movement synchronization is often emerging between interacting humans. In the present study, we investigate the extent to which the incongruence of movement trajectories has an influence on unintentional dyadic movement synchronization. During a target-directed tapping task, a participant repetitively moved between two targets in front of another participant who performed the same task in parallel but independently. When the movement path of one participant was changed by placing an obstacle between the targets, the degree of their unintentional movement synchronization was measured. Movement synchronization was observed despite of their substantially different movement trajectories. A deeper investigation of the participant's unintentional behavior shows, that although the actor who cleared the obstacle puts unintentional effort in establishing synchrony by increasing movement velocity-the other actor also unintentionally adjusted his/her behavior by increasing dwell times. Results are discussed in the light of joint action, movement interference and obstacle avoidance behavior.

Outsider interference: no role for motor lateralization in determining the strength of avoidance responses during reaching

When reaches are performed toward target objects, the presence of other non-target objects influences kinematic parameters of the reach. A typical observation has been that non-targets positioned ipsilaterally to the acting limb interfere more with the trajectory of the hand than contralateral non-targets. Here, we investigate whether this effect is mediated by motor lateralization or by the relative positioning of the objects with reference to the acting limb. Participants were asked to perform reaches toward physical target objects with their preferred or non-preferred hands while physical non-targets were present in different possible positions in the workspace. We tested both left-handers and right-handers. Our results show that a participant's handedness does not influence reaching behavior in an obstacle avoidance paradigm. Furthermore, no statistically significant differences between the use of the preferred and non-preferred hand were observed on the kinematic parameters of the reaches. We found evidence that non-targets positioned on the outside of the reaching limb influenced the reaching behavior more strongly than non-targets on the inside. Moreover, the type of movement also appeared to play a role, as reaches that crossed the workspace had a stronger effect on avoidance behavior than reaches that were 'uncrossed.' We interpret these results as support for the hypothesis that the avoidance response is determined by keeping a preferred distance between the acting limb in all stages of its reach toward the target and the non-target position. This process is not biased by hand dominance or the hand preference of the actor.

Gaze-centered spatial updating in delayed reaching even in the presence of landmarks

Previous results suggest that the brain predominantly relies on a constantly updated gaze-centered target representation to guide reach movements when no other visual information is available. In the present study, we investigated whether the addition of reliable visual landmarks influences the use of spatial reference frames for immediate and delayed reaching. Subjects reached immediately or after a delay of 8 or 12s to remembered target locations, either with or without landmarks. After target presentation and before reaching they shifted gaze to one of five different fixation points and held their gaze at this location until the end of the reach. With landmarks present, gaze-dependent reaching errors were smaller and more precise than when reaching without landmarks. Delay influenced neither reaching errors nor variability. These findings suggest that when landmarks are available, the brain seems to still use gaze-dependent representations but combine them with gaze-independent allocentric information to guide immediate or delayed reach movements to visual targets.

The effect of similarity: non-spatial features modulate obstacle avoidance

The introduction of non-target objects into a workspace leads to temporal and spatial adjustments of reaching trajectories towards a target. If the non-target is obstructing the path of the hand towards the target, the reach is adjusted such that collision with the non-target, or obstacle, is avoided. Little is known about the influence of features which are irrelevant for the execution of the movement on avoidance movements, like color similarity between target and non-target objects. In eye movement studies the similarity of non-targets has been revealed to influence oculomotor competition. Because of the tight neural and behavioral coupling between the gaze and reaching system, our aim was to determine the contribution of similarity between target and non-target to avoidance movements. We performed 2 experiments in which participants had to reach to grasp a target object while a non-target was present in the workspace. These non-targets could be either similar or dissimilar in color to the target. The results indicate that the non-spatial feature similarity can further modify the avoidance response and therefore further modify the spatial path of the reach. Indeed, we find that dissimilar pairs have a stronger effect on reaching-to-grasp movements than similar pairs. This effect was most pronounced when the non-target was on the outside of the reaching hand, where it served as more of an obstacle to the trailing arm. We propose that the increased capture of attention by the dissimilar obstacle is responsible for the more robust avoidance response.

How do flanking objects affect reaching and grasping behavior in participants with macular disorders?

PURPOSE

To investigate how objects (flankers) placed on either side of a target affect reaching and grasping behavior in visually impaired (VI) subjects due to macular disorders compared with age-matched normals.

METHODS

Subjects reached out to grasp a cylindrical target placed on its own and when it had two identical objects (flankers) placed either half or one target diameter away on each side of the target. A motion analysis system (Vicon 460) recorded and reconstructed the 3-dimemsional (3D) hand and finger movements. Kinematic data for transport and grasping mechanisms were measured.

RESULTS

In subjects with VI, crowding effected the overall movement duration, time after maximum velocity, and maximum grip aperture. Maximum effect was shown when the flankers were placed close to the target (high-level crowding) with a decreased effect shown for flankers placed farther away (medium-level crowding). Compared with normals, subjects with VI generally took longer to initiate the hand movement and to complete the movement. Time after maximum velocity and time after maximum grip aperture were also longer in subjects with VI. No interaction effects were found for any of the indices for the different levels of crowding in the two visual groups.

CONCLUSIONS

Reaching and grasping behavior is compromised in subjects with VI due to macular disorders compared with normals, and crowding affected performance for both normal subjects and those with VI. Flankers placed half an object diameter away showed greater deterioration than those placed further away.

Speeded reaching movements around invisible obstacles

We analyze the problem of obstacle avoidance from a Bayesian decision-theoretic perspective using an experimental task in which reaches around a virtual obstacle were made toward targets on an upright monitor. Subjects received monetary rewards for touching the target and incurred losses for accidentally touching the intervening obstacle. The locations of target-obstacle pairs within the workspace were varied from trial to trial. We compared human performance to that of a Bayesian ideal movement planner (who chooses motor strategies maximizing expected gain) using the Dominance Test employed in Hudson et al. (2007). The ideal movement planner suffers from the same sources of noise as the human, but selects movement plans that maximize expected gain in the presence of that noise. We find good agreement between the predictions of the model and actual performance in most but not all experimental conditions.

In everyday, cluttered environments, moving to reach or grasp an object can result in unintended collisions with other objects along the path of movement. Depending on what we run into (a priceless Ming vase, a crotchety colleague) we can suffer serious monetary or social consequences. It makes sense to choose movement trajectories that trade off the value of reaching a goal against the consequences of unintended collisions along the way. In the research described here, subjects made speeded movements to touch targets while avoiding obstacles placed along the natural reach trajectory. There were explicit monetary rewards for hitting the target and explicit monetary costs for accidentally hitting the intervening obstacle. We varied the cost and location of the obstacle across conditions. The task was to earn as large a monetary bonus as possible, which required that reaches curve around obstacles only to the extent justified by the location and cost of the obstacle. We compared human performance in this task to that of a Bayesian movement planner who maximized expected gain on each trial. In most conditions, but not all, movement strategies were close to optimal.

How obstructing is an obstacle? The influence of starting posture on obstacle avoidance

The introduction of non-target objects into a workspace leads to temporal and spatial adjustments of reaching trajectories towards a target. Currently, there are two different explanations for this phenomenon: the non-target objects are considered as either physical obstacles to which we maintain a preferred distance (see Tresilian, 1998) or as distractors that interfere with movement planning (see Tipper, Howard, & Jackson, 1997). These components are difficult to disentangle, however. Our aim was to determine the unique contribution of the avoidance of a physical obstacle to the adjustments of reaching trajectories. In this study, we manipulate the degree of physical obstruction by non-target objects while keeping the a priori visual layout of the workspace more or less constant. This is achieved by placing participants in different starting postures with respect to the orientation of their limb segments. Participants reach towards and grasp target objects with non-targets present in the workspace in a frontal and a lateral starting posture. In the frontal conditions participants showed larger movements away from the non-target on the ipsilateral side of the workspace than in the lateral conditions. The results provide evidence for the interpretation that non-targets influence the movement trajectory partly because they are 'obstructing'.

Influence of the behavioral goal and environmental obstacles on rapid feedback responses

The motor system must consider a variety of environmental factors when executing voluntary motor actions, such as the shape of the goal or the possible presence of intervening obstacles. It remains unknown whether rapid feedback responses to mechanical perturbations also consider these factors. Our first experiment quantified how feedback corrections were altered by target shape, which was either a circular dot or a bar. Unperturbed movements to each target were qualitatively similar on average but with greater dispersion of end point positions when reaching to the bar. On random trials, multijoint torque perturbations deviated the hand left or right. When reaching to a circular target, perturbations elicited corrective movements that were directed straight to the location of the target. In contrast, corrective movements when reaching to a bar were redirected to other locations along the bar axis. Our second experiment quantified whether the presence of obstacles could interfere with feedback corrections. We found that hand trajectories after the perturbations were altered to avoid obstacles in the environment. Importantly, changes in muscle activity reflecting the different target shapes (bar vs. dot) or the presence of obstacles were observed in as little as 70 ms. Such changes in motor responses were qualitatively consistent with simulations based on optimal feedback control. Taken together, these results highlight that long-latency motor responses consider spatial properties of the goal and environment.

Gait adaptation during obstacle crossing reveals impairments in the visual control of locomotion in Williams syndrome

Recent evidence indicates that individuals with Williams syndrome (WS), a rare genetically based neurodevelopmental disorder, show abnormalities of parietal and cerebellar regions of the brain that may be involved in the visual control of locomotion. Here we examined whether parietal and cerebellar abnormalities contribute to deficits in spatiotemporal characteristics and foot placement variability during obstacle crossing in adults with WS, when compared with an IQ-matched group of adults with Down syndrome (DS) and typically developing adult controls. We used the GAITRite walkway to examine the spatiotemporal characteristics and foot placement variability relative to a small ground-based obstacle in the travel path. We found that adults with WS showed late adjustments to spatiotemporal gait characteristics alongside an exaggerated and more spatially constrained visual guidance of foot positioning in the final steps prior to stepping over the obstacle. In contrast, the adults with DS showed longer step duration and more variable step length and step duration during the crossing and recovery steps after the obstacle, suggestive of cerebellar dysfunction. Although the controls were able to reduce the variability of foot placement across the obstacle crossing trials, both the WS and DS groups did not become more consistent with practice. These findings indicate a less flexible and overly constrained visuomotor system in WS, which is consistent with more widespread and diffuse abnormalities in parietal and cerebellar regions.

Mental blocks: fMRI reveals top-down modulation of early visual cortex when obstacles interfere with grasp planning

When grasping an object, the fingers, hand and arm rarely collide with other non-target objects in the workspace. Kinematic studies of neurological patients (Schindler et al., 2004) and healthy participants (Chapman and Goodale, 2010a) suggest that the location of potential obstacles and the degree of interference they pose are encoded by the dorsal visual stream during action planning. Here, we used a slow event-related paradigm in functional magnetic resonance imaging (fMRI) to examine the neural encoding of obstacles in normal participants. Fifteen right-handed participants grasped a square target object with a thumb-front or thumb-side wrist-posture with (1) no obstacle present, (2) an obstacle behind the target object (interfering with the thumb-front grasp), or (3) an obstacle beside the target object (interfering with the thumb-side grasp). Within a specified network of areas involved in planning, a group voxelwise analysis revealed that one area in the left posterior intraparietal sulcus (pIPS) and one in early visual cortex were modulated by the degree of obstacle interference, and that this modulation occurred prior to movement execution. Given previous reports of a functional link between IPS and early visual cortex, we suggest that the increasing activity in the IPS with obstacle interference provides the top-down signal to suppress the corresponding obstacle coding in early visual areas, where we observed that activity decreased with interference. This is the first concrete evidence that the planning of a grasping movement can modulate early visual cortex and provides a unifying framework for understanding the dual role played by the IPS in motor planning and attentional orienting.

Tool use and action planning in apraxia

Apraxia after left inferior parietal lesions has been widely interpreted as evidence of damage or impaired access to representations of tool-use, but most research has investigated pantomime of tool actions, not handling of actual tools. An alternative account is that inferior parietal damage does not affect tool-use representations but impairs cognitive processing about postural and hand-tool spatial relationships which is necessary for planning and controlling any complex action. Four apraxic patients and 10 age-matched controls were asked to reach rapidly for tools or abstract objects of similar dimensions. Under conditions of time pressure and divided attention, the patients frequently failed to invert the hand to grasp inverted tools by the handle, whereas ability to invert the hand to avoid a barrier and grasp abstract objects was largely unimpaired. Frequency of errors in tool grasping correlated with severity of apraxia. When inverted tools were correctly grasped, rotation of the wrist occurred later during the reaching movement than when inverting the hand to grasp an abstract object. These data are consistent with the theory of degraded access to tool-use representations in apraxia, but this theory cannot account for co-occurring deficits in imitating or matching meaningless hand or body postures.

"Real-time" obstacle avoidance in the absence of primary visual cortex

When we reach toward objects, we easily avoid potential obstacles located in the workspace. Previous studies suggest that obstacle avoidance relies on mechanisms in the dorsal visual stream in the posterior parietal cortex. One fundamental question that remains unanswered is where the visual inputs to these dorsal-stream mechanisms are coming from. Here, we provide compelling evidence that these mechanisms can operate in "real-time" without direct input from primary visual cortex (V1). In our first experiment, we used a reaching task to demonstrate that an individual with a dense left visual field hemianopia after damage to V1 remained strikingly sensitive to the position of unseen static obstacles placed in his blind field. Importantly, in a second experiment, we showed that his sensitivity to the same obstacles in his blind field was abolished when a short 2-s delay (without vision) was introduced before reach onset. These findings have far-reaching implications, not only for our understanding of the time constraints under which different visual pathways operate, but also in relation to how these seemingly "primitive" subcortical visual pathways can control complex everyday behavior without recourse to conscious vision.