Selective Reaching to Grasp: Evidence for Distractor Interference Effects

The adaptive global effect: Luminance contrast modulates the global effect zone

When two peripheral objects are presented in close proximity, saccades towards one of these objects land at a weighted average location between the two objects. This phenomenon, known as the 'global effect' or 'saccade averaging', disappears when the distance between the objects increases. When objects are further apart, outside the averaging zone, saccades land on one of the objects with little or no saccade averaging. Although it is known that the strength of the global effect is dependent on the specific features of the two objects, it is unclear if the size of the zone in which averaging can occur (i.e., the averaging zone) is adaptive. The aim of the current study was to investigate whether the size of the averaging zone adapts to variations in object luminance contrast of the objects. In order to systematically assess changes in the averaging zone, in two experiments, observers made saccadic eye movements while the luminance of the target and the distractor varied. We report three major findings: 1) When a distractor was more luminant relative to the target, the averaging zone increased (Exp. 1). Notably, saccade averaging never entirely ceased to exist, even for remote distractors. 2) When target and distractor were equiluminant, the averaging zone did not change with absolute luminance (Exp. 2). 3) Higher (relative and absolute) luminance increased the averaging zone especially for shorter saccadic response times (SRT). We conclude that the averaging zone is adaptive and becomes larger with increasing relative luminance and especially when SRTs are short.

Incompatibility Influences Cursor Placement When Pointing to Images of Cups

OBJECTIVE

As images are used within graphical user interfaces to signify menu selection, it is important to understand how image properties can influence cursor placement online.

BACKGROUND

Objects have multiple dimensions that create potential ambiguity and Stroop-like confusions for the operator if a previously habitual response conflicts with the required response.

METHODS

To examine the impact of compatibility and other contextual factors, 41 participants used a computer Mouse or touch screen to place the cursor upon images of full or empty cups that varied in size, and direction of handle.

RESULTS

Cursor placements took longer using the Mouse than touch screen. Although participants were placing the cursor on images, the size of the cup, whether it was empty or full, and the handle orientation interacted in their effects upon response duration and cursor placement. The effects of cup size reversed for empty cups or those with incompatible handles.

CONCLUSION

Context can influence cursor placement. Perceived spillability influenced precision requirements, and the cup handle can serve as target or a flanking distractor.

APPLICATION

Image content can influence screen hotspots. As performance can change with cup spillability, this bodes well for attempts to detect intent from cursor trajectories.

Inhibitory modulation of speech trajectories: Evidence from a vowel-modified Stroop task

How does cognitive inhibition influence speaking? The Stroop effect is a classic demonstration of the interference between reading and color naming. We used a novel variant of the Stroop task to measure whether this interference impacts not only the response speed, but also the acoustic properties of speech. Speakers named the color of words in three categories: congruent (e.g., red written in red), color-incongruent (e.g., green written in red), and vowel-incongruent - those with partial phonological overlap with their color (e.g., rid written in red, grain in green, and blow in blue). Our primary aim was to identify any effect of the distractor vowel on the acoustics of the target vowel. Participants were no slower to respond on vowel-incongruent trials, but formant trajectories tended to show a bias away from the distractor vowel, consistent with a phenomenon of acoustic inhibition that increases contrast between confusable alternatives.

Visuo-motor interference is modulated by task interactivity: A kinematic study

Extensive evidence shows that action observation can influence action execution, a phenomenon often referred to as visuo-motor interference. Little is known about whether this effect can be modulated by the type of interaction agents are involved in, as different studies show conflicting results. In the present study, we aimed at shedding light on this question by recording and analyzing the kinematic unfolding of reach-to-grasp movements performed in interactive and noninteractive settings. Using a machine learning approach, we investigated whether the extent of visuo-motor interference would be enhanced or reduced in two different joint action settings compared with a noninteractive one. Our results reveal that the detrimental effect of visuo-motor interference is reduced when the action performed by the partner is relevant to achieve a common goal, regardless of whether this goal requires to produce a concrete sensory outcome in the environment (joint outcome condition) or only a joint movement configuration (joint movement condition). These findings support the idea that during joint actions we form dyadic motor plans, in which both our own and our partner's actions are represented in predictive terms and in light of the common goal to be achieved. The formation of a dyadic motor plan might allow agents to shift from the automatic simulation of an observed action to the active prediction of the consequences of a partner's action. Overall, our results demonstrate the unavoidable impact of others' action on our motor behavior in social contexts, and how strongly this effect can be modulated by task interactivity.

Cursor movements to targets labelled "stop": a kinematic analysis

The label 'Stop' potentially generates conflict-signifying important corrective action, or a warning not to touch. To examine potential conflict between an incongruent label (i.e. STOP) and an imperative command (i.e. MOVE!), 18 participants used a computer mouse to move a crosshair cursor to targets with superimposed labels. Trials systematically varied Imperative (blank or MOVE!), Label (+GO + or STOP) and movement Distance. Kinematic analyses examined response latency, movement duration and accuracy. Incongruent labels had little impact upon response latencies, but they affected cursor deceleration and the variability of cursor placement. Although reading is assumed to be obligatory, the impact of written labels is not immediate, instead affecting cursor deceleration. Indeed, responses to controls labelled STOP were less accurate than those labelled + GO+. As labelled interfaces can create error versus command confusions, enhancing the discriminability of controls to afford more obvious visible cues as to method of use is recommended. Practitioner summary: Emergency stop and shutdown controls can cause response conflict as their labels signify both urgent corrective actions and 'don't touch'. Response conflict caused by confusing superimposed labels is resolved as cursors near the target control and may result in reduced movement accuracy. Prior warnings may influence resolution of response conflict. Abbreviations: Hz: Hertz; M: Mean; ms: millisecond; mm: millimetre; S: second; SD: Standard Deviation; SE: Standard Error; USB: Universal Serial Bus.

Saccadic trajectories deviate toward or away from optimally informative visual features

The saccades' path is influenced by visual distractors, making their trajectory curve away or toward them. Previous research suggested that the more salient the distractor, the more pronounced is the curvature. We investigate the saliency of spatial visual features, predicted by a constrained maximum entropy model to be optimal or non-optimal information carriers in fast vision, by using them as distractors in a saccadic task. Their effect was compared to that of luminance-based control distractors. Optimal features evoke a larger saccadic curvature compared to non-optimal features, and the magnitude and direction of deviation change as a function of the delay between distractor and saccade onset. Effects were similar to those found with high-luminance versus low-luminance distractors. Therefore, model-predicted information optimal features interfere with target-oriented saccades, following a dynamic attraction-repulsion pattern. This suggests that the visuo-oculomotor system rapidly and automatically processes optimally informative features while programming visually guided eye movements.

Food induced distractibility in restrictive anorexia nervosa: Different motor patterns for different foods as revealed by a mouse tracker evaluation

An altered automatic processing of food stimuli may contribute to the maintenance of calorie restriction in patients with restrictive Anorexia Nervosa (AN-R). The present study aimed to assess whether task-irrelevant food distractors elicited a different interference effect in the motor actions of patients with AN-R compared to healthy controls (HC). 40 patients with acute AN-R and 40 HC performed an irrelevant distractor task in which they were required to perform a reaching movement from a starting point to a green dot, while an irrelevant distractor (a high-calorie food, low-calorie food, or neutral object) was presented in the middle of the screen. Mouse trajectories and response times (RT) were recorded. The analyses conducted on the kinematic variables revealed that while the trajectories of HC veered similarly toward the three categories of stimuli, AN-R patients showed an increased deviation toward low-calorie foods and a reduced deviation toward high-calorie foods compared to neutral objects. No significant results emerged as regards RT. The pattern of responses observed in patients with AN-R (deviation increased toward low-calorie and reduced toward high-calorie) is consistent with their eating habits and may thus represent an implicit mechanism sustaining calorie restriction in patients with AN-R.

Biological motion elicits between-person Inhibition of Return in temporal and spatial movement parameters

The present study was designed to gain a deeper understanding of the processing of biological motion stimuli. To this end, we investigated if the inhibition of return (IoR) effect emerges in initiation times and trajectories of pointing movements to targets in left and right space where the preceding cues were pointing movement of a human model or a dot with the same biological motion. Targets were randomly presented in the same or opposite side from the direction of the motion cue. It was hypothesised that the visuomotor system should resonate with the biological motion of a dot, but that the human model should exaggerate the effect. Thus, the human model should trigger stronger attention shifts compared with the dot model and lead to more robust IoR effects in both spatial (movement) and temporal parameters of the observer's pointing responses. Initiation times and the spatial parameters (angle of the hand trajectory) of the pointing movements were analysed. Results indicate that facilitation and IoR effects triggered by human and dot stimuli did not differ. Based on these findings, it seems that the crucial feature of motion cues that generate shifts in attention is biological motion, rather than human appearance per se.

Trial-by-trial mouse trajectory predicts variance in precision across working memory representations: A critical reanalysis of Hao et al. (2021)

Multiple representations in visual working memory (VWM) can vary in mnemonic precision. This inhomogeneity of VWM precision has received some support from recent studies with the whole-report procedure, in which all memory items are recalled in free or forced orders. Recently, Hao et al. (2021, Cognition, 214, 104739) added a novel item-selection stage before each memory recall and found smaller between-trial variance in mouse trajectory during the selection stage in free-recall condition as compared with forced recall, which was taken as evidence for less between-item interference and the resulting precision benefit under free recall. Here, we reanalyzed the original dataset with a different analytic approach and attempted independent hypothesis testing focusing on within-trial trajectory deviations. We found that the direction of trial-by-trial trajectory bias for the first to-be-recalled item was predictive of the relative mnemonic precision of the remaining items. Critically, this relationship was only present for forced recall but not for free recall. Hierarchical Bayesian modeling of recall errors further identified that this relationship was selectively driven by VWM precision. Together, our reanalysis provides evidence for the source of between-item interference and its direct association with variable precision of VWM representations, and further highlights the novel methodological benefits of probing memory decisional processes using mouse trajectory data.

Having several options does not increase the time it takes to make a movement to an adequate end point

Throughout the day, people constantly make choices such as where to direct their gaze or place their foot. When making such movement choices, there are usually multiple acceptable options, although some are more advantageous than others. How much time does it take to make such choices and to what extent is the most advantageous option chosen from the available alternatives? To find out, we asked participants to collect points by tapping on any of several targets with their index finger. It did not take participants more time to direct their movements to an advantageous target when there were more options. Participants chose targets that were advantageous because they were easier to reach. Targets could be easier to reach because the finger was already moving in their direction when they appeared, or because they were larger or oriented along the movement direction so that the finger could move faster towards them without missing them. When the target’s colour indicated that it was worth more points they chose it slightly less fast, presumably because it generally takes longer to respond to colour than to respond to attributes such as size. They also chose it less often than they probably should have, presumably because the advantage of choosing it was established arbitrarily. We conclude that having many options does not increase the time it takes to move to an adequate target.

The heavier the arm, the higher the action: the effects of forearm-weight changes on reach-to-grasp movements

Usually, our bodily movements are performed against gravity. Most studies using a force field have focused on adaptation processes to force applied in the horizontal plane, which is novel to us, but not to force in the gravitational direction. The present study investigated the immediate effects (aftereffects) of a force toward the gravitational direction on the kinematics of reach-to-grasp movements as well as short-term adaptation to the force, simply by adding a weight to participants' forearm. Healthy young adults performed blocks of 10 reach-to-grasp movements under three weight conditions; as the weights were changed between blocks, the participants experienced weight changes ranging from - 200 to + 200 g. We obtained three main results; first, the height of movement trajectory (trajectory height) was remarkably higher immediately after the forearm weight changed to lighter than after the weight changed to heavier, suggesting that participants planed the trajectory height with the same muscle efforts as in the previous trial. Second, the trajectory height at the end of the block became higher only in 200 g condition, indicating that the participants could not achieve same trajectory height as that without any weight load, at least in ten trials of adaptation period to the 200 g weight load. Third, the coordination between reach and grasp components was preserved immediately after forearm-weight changes. These findings may contribute to further understand how we perform adaptive reach-to-grasp movements with frequent weight changes that are inevitable in everyday life.

Eye-hand coordination: memory-guided grasping during obstacle avoidance

When reaching to grasp previously seen, now out-of-view objects, we rely on stored perceptual representations to guide our actions, likely encoded by the ventral visual stream. So-called memory-guided actions are numerous in daily life, for instance, as we reach to grasp a coffee cup hidden behind our morning newspaper. Little research has examined obstacle avoidance during memory-guided grasping, though it is possible obstacles with increased perceptual salience will provoke exacerbated avoidance maneuvers, like exaggerated deviations in eye and hand position away from obtrusive obstacles. We examined the obstacle avoidance strategies adopted as subjects reached to grasp a 3D target object under visually-guided (closed loop or open loop with full vision prior to movement onset) and memory-guided (short- or long-delay) conditions. On any given trial, subjects reached between a pair of flanker obstacles to grasp a target object. The positions and widths of the obstacles were manipulated, though their inner edges remained a constant distance apart. While reach and grasp behavior was consistent with the obstacle avoidance literature, in that reach, grasp, and gaze positions were biased away from obstacles most obtrusive to the reaching hand, our results reveal distinctive avoidance approaches undertaken depend on the availability of visual feedback. Contrary to expectation, we found subjects reaching to grasp after a long delay in the absence of visual feedback failed to modify their final fixation and grasp positions to accommodate the different positions of obstacles, demonstrating a more moderate, rather than exaggerative, obstacle avoidance strategy.

Oculomotor Target Selection is Mediated by Complex Objects

Oculomotor target selection often requires discriminating visual features, but it remains unclear how oculomotor substrates encoding saccade vectors functionally contribute to this process. One possibility is that oculomotor vector representations (observed directly as physiological activation or inferred from behavioral interference) of potential targets are continuously re-weighted by task-relevance computed elsewhere in specialized visual modules, while an alternative possibility is that oculomotor modules utilize local featural analyses to actively discriminate potential targets. Strengthening the former account, oculomotor vector representations have longer onset latencies for ventral- (i.e., color) than dorsal-stream features (i.e., luminance), suggesting that oculomotor vector representations originate from featurally-relevant specialized visual modules. Here, we extended this reasoning by behaviorally examining whether the onset latency of saccadic interference elicited by visually complex stimuli is greater than is commonly observed for simple stimuli. We measured human saccade metrics (saccade curvature, endpoint deviations, saccade frequency, error proportion) as a function of time after abrupt distractor onset. Distractors were novel, visually complex, and had to be discriminated from targets to guide saccades. The earliest saccadic interference latency was ~110 ms, considerably longer than previous experiments, suggesting that sensory representations projected into the oculomotor system are gated to allow for sufficient featural processing to satisfy task demands. Surprisingly, initial oculomotor vector representations encoded features, as we manipulated the visual similarity between targets and distractors and observed increased vector modulation response magnitude and duration when the distractor was highly similar to the target. Oculomotor vector modulation was gradually extinguished over the time course of the experiment.

A nearby distractor does not influence hand movements

When interacting with the environment, our manual actions are often preceded by an eye movement. This suggests that the processes underlying target selection in hand and eye movements may be coupled. It is known that when a distractor is presented close to a target, the endpoint of an eye movement will be biased towards the distractor. The size of this so-called global effect decreases when more viewing time is available. Here we investigate whether a similar effect is also present in hand movements. If the processes underlying target selection for hand and eye movements are indeed coupled, a similar bias should be present in hand movements as well. To test this, we adopted a classic global effect paradigm but applied it to goal-directed hand movements. We show that the endpoints of hand movements are unbiased for all but one participant, irrespective of the viewing time. These results suggest that the processes underlying target selection for hand movements operate independently from those for eye movements.

When two worlds collide: the influence of an obstacle in peripersonal space on multisensory encoding

Multisensory coding of the space surrounding our body, the peripersonal space, is crucial for motor control. Recently, it has been proposed that an important function of multisensory coding is that it allows anticipation of the tactile consequences of contact with a nearby object. Indeed, performing goal-directed actions (i.e. pointing and grasping) induces a continuous visuotactile remapping as a function of on-line sensorimotor requirements. Here, we investigated whether visuotactile remapping can be induced by obstacles, e.g. objects that are not the target of the grasping movement. In the current experiment, we used a cross-modal obstacle avoidance paradigm, in which participants reached past an obstacle to grasp a second object. Participants indicated the location of tactile targets delivered to the hand during the grasping movement, while a visual cue was sometimes presented simultaneously on the to-be-avoided object. The tactile and visual stimulation was triggered when the reaching hand passed a position that was drawn randomly from a continuous set of predetermined locations (between 0 and 200 mm depth at 5 mm intervals). We observed differences in visuotactile interaction during obstacle avoidance dependent on the location of the stimulation trigger: visual interference was enhanced for tactile stimulation that occurred when the hand was near the to-be-avoided object. We show that to-be-avoided obstacles, which are relevant for action but are not to-be-interacted with (as the terminus of an action), automatically evoke the tactile consequences of interaction. This shows that visuotactile remapping extends to obstacle avoidance and that this process is flexible.

Selective attention to real-world objects drives their emotional appraisal

Attentional manipulations have been shown to influence subsequent evaluations of objects and images. For example, images used as distractors in a visual search task are subsequently rated more negatively than are target images. One powerful manipulation of attention occurs when we plan and execute movements toward objects in our environment. Here, in two experiments, we show that selective attention to real-world objects subsequently improves emotional appraisal of those objects-an effect we term "target appreciation." Participants were presented with abstract images on three-dimensional objects, and were cued to either reach and grasp one of the two objects, or to respond to the cued object with a keyboard. Images presented on target objects were appraised more positively when compared with novel images. In contrast, images associated with obstacles or distractor objects were not appraised differently than novel images, despite the attentional suppression thought to be required to successfully avoid or ignore these objects. We speculate that this automatic appreciation of the objects of selective attention may be adaptive for organisms acting in complex environments.

The attractiveness of salient distractors to reaching movements is task dependent

Previous studies in visual attention and oculomotor research showed that a physically salient distractor does not always capture attention or the eyes. Under certain top-down task sets, a salient distractor can be actively suppressed, avoiding capture. Even though previous studies showed that reaching movements are also influenced by salient distractors, it is unclear if and how a mechanism of active suppression of distractors would affect reaching movements. Active suppression might also explain why some studies find reaching movements to curve towards a distractor, while others find reaching movements to curve away. In this study, we varied the top-down task set in two separate experiments by manipulating the certainty about the target location. Participants had to reach for a diamond present among three circles. In Experiments 1 and 3, participants had to search for the reach targets; hence, the target's location certainty was low. In Experiments 2 and 3, the target's location was cued before the reach; hence, the target's location certainty was high. We found that reaches curved towards the physically salient, color singleton, distractor in the search-to-reach task (Experiments 1 and 3), but not in the cued reach task (Experiments 2 and 3). Thus, the saliency of the distractor only attracted reaching movements when the certainty of the target's location was low. Our findings suggest that the attractiveness of physically salient distractors to reaching movements depends on the top-down task set. The results can be explained by the effect of active attentional suppression on the competition between movement plans.

Trait self-control does not predict attentional control: Evidence from a novel attention capture paradigm

To what extent are low-level visual and attentional phenomena related to higher-level personality traits? Trait self-control is thought to modulate behavior via two separate mechanisms: 1) by preventing initial temptation and, 2) by inhibiting temptation when it occurs (disengagement). Similarly, the control of visual attention often entails preventing initial distraction by irrelevant but tempting (goal-similar) objects, and disengaging attention when it has been inappropriately captured. Given these similarities, we examined whether individuals higher versus lower in trait self-control would differ in their susceptibility to attention capture using mouse-tracking as a sensitive, online measure of how attentional dynamics resolve over time and space in response to a distracting visual cue. Using a variety of metrics of attention capture, we found that differences among people in trait self-control did not predict initial selection of visual information nor subsequent disengagement. Overall, these results suggest that trait self-control and attention capture operate via separate mechanisms.

Lost to translation: How design factors of the mouse-tracking procedure impact the inference from action to cognition

From an embodiment perspective, action and cognition influence each other constantly. This interaction has been utilized in mouse-tracking studies to infer cognitive states from movements, assuming a continuous manifestation of cognitive processing into movement. However, it is mostly unknown how this manifestation is affected by the variety of possible design choices in mouse-tracking paradigms. Here we studied how three design factors impact the manifestation of cognition into movement in a Simon task with mouse tracking. We varied the response selection (i.e., with or without clicking), the ratio between hand and mouse cursor movement, and the location of the response boxes. The results show that all design factors can blur or even prevent the manifestation of cognition into movement, as reflected by a reduction in movement consistency and action dynamics, as well as by the adoption of unsuitable movement strategies. We conclude that deliberate and careful design choices in mouse-tracking experiments are crucial to ensuring a continuous manifestation of cognition in movement. We discuss the importance of developing a standard practice in the design of mouse-tracking experiments.

Decision-making in sensorimotor control

Skilled sensorimotor interactions with the world result from a series of decision-making processes that determine, on the basis of information extracted during the unfolding sequence of events, which movements to make and when and how to make them. Despite this inherent link between decision-making and sensorimotor control, research into each of these two areas has largely evolved in isolation, and it is only fairly recently that researchers have begun investigating how they interact and, together, influence behaviour. Here, we review recent behavioural, neurophysiological and computational research that highlights the role of decision-making processes in the selection, planning and control of goal-directed movements in humans and nonhuman primates.

Target Uncertainty During Motor Decision-Making: The Time Course of Movement Variability Reveals the Effect of Different Sources of Uncertainty on the Control of Reaching Movements

The processes underlying motor decision-making have recently caught considerable amount of scientific attention, focusing on the integration of empirical evidence from sensorimotor control research with psychological theories and computational models on decision-making. Empirical studies on motor decision-making suggest that the kinematics of goal-directed reaching movements are sensitive to the level of target uncertainty during movement planning. However, the source of uncertainty as a relevant factor influencing the process of motor decision-making has not been sufficiently considered, yet. In this study, we test the assumption that the source of target uncertainty has an effect on motor decision-making, which can be proven by analyzing movement variability during the time course of movement execution. Ten healthy young adults performed three blocks with 66 trials of goal-directed reaching movements in each block, across which the source and level of reach target uncertainty at movement onset were manipulated (“no uncertainty”, “extrinsic uncertainty”, and “intrinsic uncertainty”). Fingertip position of the right index finger was recorded using an optical motion tracking system. Standard kinematic measures (i.e., path length and movement duration) as well as variability of fingertip position across the time course of movement execution and at movement end were analyzed. In line with previous studies, we found that a high level of extrinsic target uncertainty leads to increased overall movement duration, which could be attributed to increased path length in this condition, as compared to intrinsic and no target uncertainty (all p < 0.001). Movement duration and path length did not show any differences between the latter two conditions. However, the time course analysis of movement variability revealed significant differences between these two conditions, with increased variability of fingertip position in the presence of intrinsic target uncertainty (Condition × Sampling point: p = 0.01), though considerably less than under high extrinsic target uncertainty (p ≤ 0.001). These findings suggest that both the level and source of uncertainty have a significant effect on the processing of potential action plans during motor decision-making, which can be revealed through the analysis of the time course of movement variability at the end-effector level.

Visual Selection of the Future Reach Path in Obstacle Avoidance

In two EEG experiments, we studied the role of visual attention during the preparation of manual movements around an obstacle. Participants performed rapid hand movements to a goal position avoiding a central obstacle either on the left or right side, depending on the pitch of the acoustical go signal. We used a dot probe paradigm to analyze the deployment of spatial attention in the visual field during the motor preparation. Briefly after the go signal but still before the hand movement actually started, a visual transient was flashed either on the planned pathway of the hand (congruent trials) or on the opposite, movement-irrelevant side (incongruent trials). The P1/N1 components that were evoked by the onset of the dot probe were enhanced in congruent trials where the visual transient was presented on the planned path of the hand. The results indicate that, during movement preparation, attention is allocated selectively to the planned trajectory the hand is going to take around the obstacle.

A review and consideration on the kinematics of reach-to-grasp movements in macaque monkeys

The bases for understanding the neuronal mechanisms that underlie the control of reach-to-grasp movements among nonhuman primates, particularly macaques, has been widely studied. However, only a few kinematic descriptions of their prehensile actions are available. A thorough understanding of macaques' prehensile movements is manifestly critical, in light of their role in biomedical research as valuable models for studying neuromotor disorders and brain mechanisms, as well as for developing brain-machine interfaces to facilitate arm control. This article aims to review the current state of knowledge on the kinematics of grasping movements that macaques perform in naturalistic, seminaturalistic, and laboratory settings, to answer the following questions: Are kinematic signatures affected by the context within which the movement is performed? In what ways are kinematics of humans' and macaques' prehensile actions similar/dissimilar? Our analysis reflects the challenges involved in making comparisons across settings and species due to the heterogeneous picture in terms of the number of subjects, stimuli, conditions, and hands used. The kinematics of free-ranging macaques are characterized by distinctive features that are exhibited neither by macaques in laboratory setting nor by human subjects. The temporal incidence of key kinematic landmarks diverges significantly between species, indicating disparities in the overall organization of movement. Given such complexities, we attempt a synthesis of the extant body of evidence, intending to generate some significant implications for directions that future research might take to recognize the remaining gaps and pursue the insights and resolutions to generate an interpretation of movement kinematics that accounts for all settings and subjects.

Higher order, multifeatural object encoding by the oculomotor system

Previous behavioral and physiological research has demonstrated that as the behavioral relevance of potential saccade goals increases, they elicit more competition during target selection processing as evidenced by increased saccade curvature and neural activity. However, these effects have only been demonstrated for lower order feature singletons, and it remains unclear whether more complicated featural differences between higher order objects also elicit vector modulation. Therefore, we measured human saccades curvature elicited by distractors bilaterally flanking a target during a visual search saccade task and systematically varied subsets of features shared between the two distractors and the target, referred to as objective similarity (OS). Our results demonstrate that saccades deviated away from the distractor highest in OS to the target and that there was a linear relationship between the magnitude of saccade deviation and the number of feature differences between the most similar distractor and the target. Furthermore, an analysis of curvature over the time course of the saccade demonstrated that curvature only occurred in the first 20-30 ms of the movement. Given the multifeatural complexity of the novel stimuli, these results suggest that saccadic target selection processing involves dynamically reweighting vector representations for movement planning to several possible targets based on their behavioral relevance. NEW & NOTEWORTHY We demonstrate that small featural differences between unfamiliar, higher order object representations modulate vector weights during saccadic target selection processing. Such effects have previously only been demonstrated for familiar, simple feature singletons (e.g., color) in which features characterize entire objects. The complexity and novelty of our stimuli suggest that the oculomotor system dynamically receives visual/cognitive information processed in the higher order representational networks of the cortical visual processing hierarchy and integrates this information for saccadic movement planning.

Hear speech, change your reach: changes in the left-hand grasp-to-eat action during speech processing

Research has shown that the kinematic characteristics of right-hand movements change when executed during both speech production and processing. Despite the variety of prehension and manual actions used to examine this relationship, the literature has yet to examine potential movement effects using an action with a distinct kinematic signature: the hand-to-mouth (grasp-to-eat) action. In this study, participants performed grasp-to-eat and grasp-to-place actions in (a) a quiet environment and (b) while processing speech. Results during the quiet condition replicated the previous findings; consistently smaller grasp-to-eat (compared to grasp-to-place), maximum grip apertures appeared only when using the right hand. Interestingly, in the listen condition, smaller maximum grip apertures in the grasp-to-eat movement appeared in both the right and left hands, despite the fact that participants were right-handed. This paper addresses these results in relation with similar behaviour observed in children, and discusses implications for functional lateralization and neural organization.

Picking an apple from a tree: Response-selection demands, inhibition requirements, and the functionality of the Quiet Eye in a far-aiming task

In the study of the mutual coupling between perception and action, the performance-enhancing effect of the last fixation before movement initiation, the Quiet Eye (QE), has been repeatedly shown. To the explanation of this phenomenon, among others, an inhibition hypothesis was formulated which suggests that the parametrisation of the optimal task solution is shielded against non-optimal task solutions. In this study, a prediction of this hypothesis was tested by manipulating response-selection demands over movement preparation in a targeting task which required to throw balls as accurate as possible at virtual target discs. Participants in the group with high response-selection demands always had to select one out of four targets, whereas the selection for the participants in the group with low response-selection demands was yoked to the selection of the other group. The results showed the predicted longer QE durations for the high response-selection demands group that, particularly, emanated from earlier QE onsets. Because of similar throwing demands, these differences cannot merely be explained by differences in the fine-tuning of the motor response but provide evidence for the suggested inhibition function. Particularly, with high response-selection demands, the parametrisation of the non-selected targets over movement preparation had to be inhibited. Descriptively, differences in the QE offset suggest that these shielding requirements persisted over movement control. This study extends earlier work on the theoretical foundation of the QE phenomenon and provides fruitful insights into its underlying mechanisms.

The fate of nonselected activity in saccadic decisions: distinct goal-related and history-related modulation

The global effect (GE) traditionally refers to the tendency of effectors (e.g., hand, eyes) to first land in between two nearby stimuli, forming a unimodal distribution. By measuring a shift of this distribution, recent studies used the GE to assess the presence of decision-related inputs on the motor map for eye movements. However, this method cannot distinguish whether one stimulus is inhibited or the other is facilitated and could not detect situations where both stimuli are inhibited or facilitated. Here, we detect deviations in the bimodal distribution of landing positions for remote stimuli and find that this bimodal GE reveals the presence, location, and polarity (facilitation or inhibition) of history-related and goal-related modulation of the nonselected activity (e.g., the distractor activity in correct trials, and the target activity in error trials). We tested, for different interstimulus distances, the effect of the rarity of double-stimulus trials and the difference between performing a discrimination task compared with free choice. Our work shows that the effect of rarity is symmetric and decreases with interstimulus distances, while the effect of goal-directed discrimination is asymmetric - occurring only when the distractor is selected for the saccade - and maintained across interstimulus distances. These results suggest that the former effect changes the response property of the motor map, while the latter specifically facilitates the target location. NEW & NOTEWORTHY Deviations in landing positions for saccades to targets and distractors reveal the presence, location and polarity of history-related or goal-related signals. Goal-directed discrimination appears to facilitate the target location, rather than inhibiting the distractor location, Rare occurrence of a choice appears to indiscriminately increase the neural response for both locations.

Movement Trajectories in the Presence of a Distracting Stimulus: Evidence for a Response Activation Model of Selective Reaching

Consistent with action–based theories of attention, the presence of a nontarget stimulus in the environment has been shown to alter the characteristics of goal–directed movements. Specifically, it has been reported that movement trajectories veer away from (Howard & Tipper, 1997) or towards (Welsh, Elliott, & Weeks, 1999) the location of a nontarget stimulus. The purpose of the experiments reported in this paper was to test a response activation model of selective reaching conceived to account for these variable results. In agreement with the model, the trajectory changes in the movements appear to be determined by the activation levels of each competing response at the moment of response initiation. The results of the present work, as well as those of previous studies, are discussed within the framework of the model of response activation.

Saccades and reaches curve away from the other effector’s target in simultaneous eye and hand movements

Simultaneous eye and hand movements are highly coordinated and tightly coupled. This raises the question whether the selection of eye and hand targets relies on a shared attentional mechanism or separate attentional systems. Previous studies have revealed conflicting results by reporting evidence for both a shared as well as separate systems. Movement properties such as movement curvature can provide novel insights into this question as they provide a sensitive measure for attentional allocation during target selection. In the current study, participants performed simultaneous eye and hand movements to the same or different visual target locations. We show that both saccade and reaching movements curve away from the other effector’s target location when they are simultaneously performed to spatially distinct locations. We argue that there is a shared attentional mechanism involved in selecting eye and hand targets that may be found on the level of effector-independent priority maps.

NEW & NOTEWORTHY Movement properties such as movement curvature have been widely neglected as important sources of information in investigating whether the attentional systems underlying target selection for eye and hand movements are separate or shared. We convincingly show that movement curvature is influenced by the other effector’s target location in simultaneous eye and hand movements to spatially distinct locations. Our results provide evidence for shared attentional systems involved in the selection of saccade and reach targets.

Object-based processes in the planning of goal-directed hand movements

Theories in motor control suggest that the parameters specified during the planning of goal-directed hand movements to a visual target are defined in spatial parameters like direction and amplitude. Recent findings in the visual attention literature, however, argue widely for early object-based selection processes. The present experiments were designed to examine the contributions of object-based and space-based selection processes to the preparation time of goal-directed pointing movements. Therefore, a cue was presented at a specific location. The question addressed was whether the initiation of responses to uncued target stimuli could benefit from being either within the same object (object based) or presented at the same direction (space based). Experiment 1 replicated earlier findings of object-based benefits for non-goal-directed responses. Experiment 2 confirmed earlier findings of space-based benefits for goal-directed hand pointing movements. In Experiments 3 and 4, space-based and object-based manipulations were combined while requiring goal-directed hand pointing movements. The results clearly favour the notion that the selection processes for goal-directed pointing movements are primarily object based. Implications for theories on selective attention and action planning are discussed.

Inhibition in movement plan competition: reach trajectories curve away from remembered and task-irrelevant present but not from task-irrelevant past visual stimuli

The current study investigated the role of automatic encoding and maintenance of remembered, past, and present visual distractors for reach movement planning. The previous research on eye movements showed that saccades curve away from locations actively kept in working memory and also from task-irrelevant perceptually present visual distractors, but not from task-irrelevant past distractors. Curvature away has been associated with an inhibitory mechanism resolving the competition between multiple active movement plans. Here, we examined whether reach movements underlie a similar inhibitory mechanism and thus show systematic modulation of reach trajectories when the location of a previously presented distractor has to be (a) maintained in working memory or (b) ignored, or (c) when the distractor is perceptually present. Participants performed vertical reach movements on a computer monitor from a home to a target location. Distractors appeared laterally and near or far from the target (equidistant from central fixation). We found that reaches curved away from the distractors located close to the target when the distractor location had to be memorized and when it was perceptually present, but not when the past distractor had to be ignored. Our findings suggest that automatically encoding present distractors and actively maintaining the location of past distractors in working memory evoke a similar response competition resolved by inhibition, as has been previously shown for saccadic eye movements.

Moving higher and higher: imitators' movements are sensitive to observed trajectories regardless of action rationality

Humans sometimes perform actions which, at least superficially, appear suboptimal to the goal they are trying to achieve. Despite being able to identify these irrational actions from an early age, humans display a curious tendency to copy them. The current study recorded participants’ movements during an established imitation task and manipulated the rationality of the observed action in two ways. Participants observed videos of a model point to a series of targets with either a low, high or ‘superhigh’ trajectory either in the presence or absence of obstacles between her targets. The participants’ task was to watch which targets the model pointed to and then point to the same targets on the table in front of them. There were no obstacles between the participants’ targets. Firstly, we found that the peak height of participants’ movements between their targets was sensitive to the height of the model’s movements, even in the ‘superhigh’ condition where the model’s action was rated as irrational. Secondly, participants showed obstacle priming—the peak height of participants’ movements was higher after having observed the model move over obstacles to reach her targets, compared to when there were no obstacles between her targets. This suggests that participants code the environment of co-actors into their own motor programs, even when this compromises the efficiency of their own movements. We discuss the implications of our findings in terms of theories of imitation and obstacle priming.

Trajectory curvature in saccade sequences: spatiotopic influences vs. residual motor activity

When decisions drive saccadic eye movements, traces of the decision process can be inferred from the movement trajectories. For example, saccades can curve away from distractor stimuli, which was thought to reflect cortical inhibition biasing activity in the superior colliculus. Recent neurophysiological work does not support this theory, and two recent models have replaced top-down inhibition with lateral interactions in the superior colliculus or neural fatigue in the brainstem saccadic burst generator. All current models operate in retinotopic coordinates and are based on single saccade paradigms. To extend these models to sequences of saccades, we assessed whether and how saccade curvature depends on previously fixated locations and the direction of previous saccades. With a two-saccade paradigm, we first demonstrated that second saccades curved away from the initial fixation stimulus. Furthermore, by varying the time from fixation offset and the intersaccadic duration, we distinguished the extent of curvature originating from the spatiotopic representation of the previous fixation location or residual motor activity of the previous saccade. Results suggest that both factors drive curvature, and we discuss how these effects could be implemented in current models. In particular, we propose that the collicular retinotopic maps receive an excitatory spatiotopic update from the lateral interparial region.NEW & NOTEWORTHY Saccades curve away from locations of previous fixation. Varying stimulus timing demonstrates the effects of both 1) spatiotopic representation and 2) motor residual activity from previous saccades. The spatiotopic effect can be explained if current models are augmented with an excitatory top-down spatiotopic signal.

Automatic and intentional influences on saccade landing

Saccadic eye movements enable us to rapidly direct our high-resolution fovea onto relevant parts of the visual world. However, while we can intentionally select a location as a saccade target, the wider visual scene also influences our executed movements. In the presence of multiple objects, eye movements may be "captured" to the location of a distractor object, or be biased toward the intermediate position between objects (the "global effect"). Here we examined how the relative strengths of the global effect and visual object capture changed with saccade latency, the separation between visual items and stimulus contrast. Importantly, while many previous studies have omitted giving observers explicit instructions, we instructed participants to either saccade to a specified target object or to the midpoint between two stimuli. This allowed us to examine how their explicit movement goal influenced the likelihood that their saccades terminated at either the target, distractor, or intermediate locations. Using a probabilistic mixture model, we found evidence that both visual object capture and the global effect co-occurred at short latencies and declined as latency increased. As object separation increased, capture came to dominate the landing positions of fast saccades, with reduced global effect. Using the mixture model fits, we dissociated the proportion of unavoidably captured saccades to each location from those intentionally directed to the task goal. From this we could extract the time course of competition between automatic capture and intentional targeting. We show that task instructions substantially altered the distribution of saccade landing points, even at the shortest latencies.NEW & NOTEWORTHY When making an eye movement to a target location, the presence of a nearby distractor can cause the saccade to unintentionally terminate at the distractor itself or the average position in between stimuli. With probabilistic mixture models, we quantified how both unavoidable capture and goal-directed targeting were influenced by changing the task and the target-distractor separation. Using this novel technique, we could extract the time course over which automatic and intentional processes compete for control of saccades.

Target-distractor synchrony affects performance in a novel motor task for studying action selection

The study of action selection in humans can present challenges of task design since our actions are usually defined by many degrees of freedom and therefore occupy a large action-space. While saccadic eye-movement offers a more constrained paradigm for investigating action selection, the study of reach-and-grasp in upper limbs has often been defined by more complex scenarios, not easily interpretable in terms of such selection. Here we present a novel motor behaviour task which addresses this by limiting the action space to a single degree of freedom in which subjects have to track (using a stylus) a vertical coloured target line displayed on a tablet computer, whilst ignoring a similarly oriented distractor line in a different colour. We ran this task with 55 subjects and showed that, in agreement with previous studies, the presence of the distractor generally increases the movement latency and directional error rate. Further, we used two distractor conditions according to whether the distractor’s location changes asynchronously or synchronously with the location of the target. We found that the asynchronous distractor yielded poorer performance than its synchronous counterpart, with significantly higher movement latencies and higher error rates. We interpret these results in an action selection framework with two actions (move left or right) and competing ‘action requests’ offered by the target and distractor. As such, the results provide insights into action selection performance in humans and supply data for directly constraining future computational models therein.

The Emergence of Selective Attention through Probabilistic Associations between Stimuli and Actions

In this paper we show how a multilayer neural network trained to master a context-dependent task in which the action co-varies with a certain stimulus in a first context and with a second stimulus in an alternative context exhibits selective attention, i.e. filtering out of irrelevant information. This effect is rather robust and it is observed in several variations of the experiment in which the characteristics of the network as well as of the training procedure have been varied. Our result demonstrates how the filtering out of irrelevant information can originate spontaneously as a consequence of the regularities present in context-dependent training set and therefore does not necessarily depend on specific architectural constraints. The post-evaluation of the network in an instructed-delay experimental scenario shows how the behaviour of the network is consistent with the data collected in neuropsychological studies. The analysis of the network at the end of the training process indicates how selective attention originates as a result of the effects caused by relevant and irrelevant stimuli mediated by context-dependent and context-independent bidirectional associations between stimuli and actions that are extracted by the network during the learning.

Differential Effects of Cast Shadows on Perception and Action

In two experiments we investigated the effects of cast shadows on different real-life tasks. In experiment 1, participants were required to make a speeded verbal identification of the target object (perceptual task), whereas in experiment 2 participants were required to reach for and grasp the target object (motor task). In both experiments real three-dimensional (3-D) objects were presented, one at a time, either with their own natural cast shadow (congruent condition) or with the cast shadow of a different object (incongruent condition). Shadows were cast either to the left or to the right of the object. We asked whether the features of the shadow (ie whether it is congruent or incongruent with the object, and whether it is cast to the left or to the right of the object) could influence perception and action differently. Results showed that cast shadows did not influence identification of real 3-D objects (experiment 1), but they affected movement kinematics, producing distractor-like interference, particularly on movement trajectory (experiment 2). These findings suggest a task-dependent influence of cast shadows on human performance. In the case of object-oriented actions, cast shadows may represent further affordances of the object, and as such compete for the control of the action.

It is the flash which appears, the movement will follow: Investigating the relation between spatial attention and obstacle avoidance

Obstacles are represented in the attentional landscape. However, it is currently unclear what the exclusive contribution of attention is to the avoidance response. This is because in earlier obstacle avoidance designs, it was impossible to disentangle an effect of attention from the changing features of the obstacle (e.g., its identity, size, or orientation). Conversely, any feature manipulation could be interpreted as an attentional as well as an obstacle effect on avoidance behavior. We tested the possible tuning of avoidance responses by a spatial cue in two experiments. In both experiments, spatial and nonspatial cues were separately given as go cues for an obstacle avoidance task. Participants had to reach past two obstacles in Experiment 1, and past a single obstacle in Experiment 2. We found that when the right obstacle was flashed, participants veered away more and produced more-variable trajectories over trials than in conditions with nonspatial and left spatial cues, regardless of the presence or absence of another obstacle. Therefore, we concluded that the tuning of avoidance responses can be influenced by spatial cues. Moreover, we speculated that a flashed obstacle receives more attentional weighting in the attentional landscape and prompts a stronger repulsion away from the obstacle.

Oculomotor interference of bimodal distractors

•

Bimodal distractors evoked more oculomotor competition than unimodal distractors.

•

The direction of interference was dependent on the spatial layout of the scene.

•

Close distractors cause deviation towards, remote distractors cause deviation away.

•

Saccade averaging and trajectory deviation were similarly affected by distractors.

•

Interfering effects were most pronounced in the spatial domain.

When executing an eye movement to a target location, the presence of an irrelevant distracting stimulus can influence the saccade metrics and latency. The present study investigated the influence of distractors of different sensory modalities (i.e. auditory, visual and audiovisual) which were presented at various distances (i.e. close or remote) from a visual target. The interfering effects of a bimodal distractor were more pronounced in the spatial domain than in the temporal domain. The results indicate that the direction of interference depended on the spatial layout of the visual scene. The close bimodal distractor caused the saccade endpoint and saccade trajectory to deviate towards the distractor whereas the remote bimodal distractor caused a deviation away from the distractor. Furthermore, saccade averaging and trajectory deviation evoked by a bimodal distractor was larger compared to the effects evoked by a unimodal distractor. This indicates that a bimodal distractor evoked stronger spatial oculomotor competition compared to a unimodal distractor and that the direction of the interference depended on the distance between the target and the distractor. Together, these findings suggest that the oculomotor vector to irrelevant bimodal input is enhanced and that the interference by multisensory input is stronger compared to unisensory input.

The sequential encoding of competing action goals involves dynamic restructuring of motor plans in working memory

Recent neural and behavioral findings provide support for the influential idea that in situations in which multiple action options are presented simultaneously, we prepare action plans for each competing option before deciding between and executing one of those plans. However, in natural, everyday environments, our available action options frequently change from one moment to the next, and there is often uncertainty as to whether additional options will become available before having to select a particular course of action. Here, with the use of a target-directed reaching task, we show that in this situation, the brain specifies a competing action for each new, sequentially presented potential target and that recently formed action plans can be revisited and updated so as to conform with separate, more newly developed, plans. These findings indicate that the brain forms labile motor plans for sequentially arising target options that can be flexibly restructured to accommodate new motor plans.

Bodily action penetrates affective perception

Fantoni & Gerbino (2014) showed that subtle postural shifts associated with reaching can have a strong hedonic impact and affect how actors experience facial expressions of emotion. Using a novel Motor Action Mood Induction Procedure (MAMIP), they found consistent congruency effects in participants who performed a facial emotion identification task after a sequence of visually-guided reaches: a face perceived as neutral in a baseline condition appeared slightly happy after comfortable actions and slightly angry after uncomfortable actions. However, skeptics about the penetrability of perception (Zeimbekis & Raftopoulos, 2015) would consider such evidence insufficient to demonstrate that observer's internal states induced by action comfort/discomfort affect perception in a top-down fashion. The action-modulated mood might have produced a back-end memory effect capable of affecting post-perceptual and decision processing, but not front-end perception. Here, we present evidence that performing a facial emotion detection (not identification) task after MAMIP exhibits systematic mood-congruent sensitivity changes, rather than response bias changes attributable to cognitive set shifts; i.e., we show that observer's internal states induced by bodily action can modulate affective perception. The detection threshold for happiness was lower after fifty comfortable than uncomfortable reaches; while the detection threshold for anger was lower after fifty uncomfortable than comfortable reaches. Action valence induced an overall sensitivity improvement in detecting subtle variations of congruent facial expressions (happiness after positive comfortable actions, anger after negative uncomfortable actions), in the absence of significant response bias shifts. Notably, both comfortable and uncomfortable reaches impact sensitivity in an approximately symmetric way relative to a baseline inaction condition. All of these constitute compelling evidence of a genuine top-down effect on perception: specifically, facial expressions of emotion are penetrable by action-induced mood. Affective priming by action valence is a candidate mechanism for the influence of observer's internal states on properties experienced as phenomenally objective and yet loaded with meaning.