Deficits in reach target selection during inactivation of the midbrain superior colliculus

Pathways from the superior colliculus and the nucleus of the optic tract to the posterior parietal cortex in macaque monkeys: Functional frameworks for representation updating and online movement guidance

The posterior parietal cortex (PPC) integrates multisensory and motor-related information for generating and updating body representations and movement plans. We used retrograde transneuronal transfer of rabies virus combined with a conventional tracer in macaque monkeys to identify direct and disynaptic pathways to the arm-related rostral medial intraparietal area (MIP), the ventral lateral intraparietal area (LIPv), belonging to the parietal eye field, and the pursuit-related lateral subdivision of the medial superior temporal area (MSTl). We found that these areas receive major disynaptic pathways via the thalamus from the nucleus of the optic tract (NOT) and the superior colliculus (SC), mainly ipsilaterally. NOT pathways, targeting MSTl most prominently, serve to process the sensory consequences of slow eye movements for which the NOT is the key sensorimotor interface. They potentially contribute to the directional asymmetry of the pursuit and optokinetic systems. MSTl and LIPv receive feedforward inputs from SC visual layers, which are potential correlates for fast detection of motion, perceptual saccadic suppression and visual spatial attention. MSTl is the target of efference copy pathways from saccade- and head-related compartments of SC motor layers and head-related reticulospinal neurons. They are potential sources of extraretinal signals related to eye and head movement in MSTl visual-tracking neurons. LIPv and rostral MIP receive efference copy pathways from all SC motor layers, providing online estimates of eye, head and arm movements. Our findings have important implications for understanding the role of the PPC in representation updating, internal models for online movement guidance, eye-hand coordination and optic ataxia.

Effector-independent Representations Guide Sequential Target Selection Biases in Action

Previous work shows that automatic attention biases toward recently selected target features transfer across action and perception and even across different effectors such as the eyes and hands on a trial-by-trial basis. Although these findings suggest a common neural representation of selection history across effectors, the extent to which information about recently selected target features is encoded in overlapping versus distinct brain regions is unknown. Using fMRI and a priming of pop-out task where participants selected unpredictable, uniquely colored targets among homogeneous distractors via reach or saccade, we show that color priming is driven by shared, effector-independent underlying representations of recent selection history. Consistent with previous work, we found that the intraparietal sulcus (IPS) was commonly activated on trials where target colors were switched relative to those where the colors were repeated; however, the dorsal anterior insula exhibited effector-specific activation related to color priming. Via multivoxel cross-classification analyses, we further demonstrate that fine-grained patterns of activity in both IPS and the medial temporal lobe encode information about selection history in an effector-independent manner, such that ROI-specific models trained on activity patterns during reach selection could predict whether a color was repeated or switched on the current trial during saccade selection and vice versa. Remarkably, model generalization performance in IPS and medial temporal lobe also tracked individual differences in behavioral priming sensitivity across both types of action. These results represent a first step to clarify the neural substrates of experience-driven selection biases in contexts that require the coordination of multiple actions.

Superior colliculus bidirectionally modulates choice activity in frontal cortex

Action selection occurs through competition between potential choice options. Neural correlates of choice competition are observed across frontal cortex and downstream superior colliculus (SC) during decision-making, yet how these regions interact to mediate choice competition remains unresolved. Here we report that SC can bidirectionally modulate choice competition and drive choice activity in frontal cortex. In the mouse, topographically matched regions of frontal cortex and SC formed a descending motor pathway for directional licking and a re-entrant loop via the thalamus. During decision-making, distinct neuronal populations in both frontal cortex and SC encoded opposing lick directions and exhibited competitive interactions. SC GABAergic neurons encoded ipsilateral choice and locally inhibited glutamatergic neurons that encoded contralateral choice. Activating or suppressing these cell types could bidirectionally drive choice activity in frontal cortex. These results thus identify SC as a major locus to modulate choice competition within the broader action selection network.

Done in 65 ms: Express Visuomotor Responses in Upper Limb Muscles in Rhesus Macaques

How rapidly can the brain transform vision into action? Work in humans has established that the transformation for visually-guided reaching can be remarkably rapid, with the first phase of upper limb muscle recruitment, the express visuomotor response, beginning within less than 100 ms of visual target presentation. Such short-latency responses limit the opportunities for extensive cortical processing, leading to the hypothesis that they are generated via the subcortical tecto-reticulo-spinal pathway. Here, we examine whether nonhuman primates (NHPs) exhibit express visuomotor responses. Two male macaques made visually-guided reaches in a behavioral paradigm known to elicit express visuomotor responses in humans, while we acquired intramuscular recordings from the deltoid muscle. Across several variants of this paradigm, express visuomotor responses began within 65 ms (range: 48-91 ms) of target presentation. Although the timing of the express visuomotor response did not co-vary with reaction time, larger express visuomotor responses tended to precede shorter latency reaches. Further, we observed that the magnitude of the express visuomotor response could be muted by contextual context, although this effect was quite variable. Overall, the response properties in NHPs resemble those in humans. Our results establish a new benchmark for visuomotor transformations underlying visually-guided reaches, setting the stage for experiments that can directly compare the role of cortical and subcortical areas in reaching when time is of the essence.

Superior colliculus cell types bidirectionally modulate choice activity in frontal cortex

Action selection occurs through competition between potential choice options. Neural correlates of choice competition are observed across frontal cortex and downstream superior colliculus (SC) during decision-making, yet how these regions interact to mediate choice competition remains unresolved. Here we report that cell types within SC can bidirectionally modulate choice competition and drive choice activity in frontal cortex. In the mouse, topographically matched regions of frontal cortex and SC formed a descending motor pathway for directional licking and a re-entrant loop via the thalamus. During decision-making, distinct neuronal populations in both frontal cortex and SC encoded opposing lick directions and exhibited push-pull dynamics. SC GABAergic neurons encoded ipsilateral choice and glutamatergic neurons encoded contralateral choice, and activating or suppressing these cell types could bidirectionally drive push-pull choice activity in frontal cortex. These results thus identify SC as a major locus to modulate choice competition within the broader action selection network.

Reciprocal facilitation between mental and visuomotor rotations

Humans exhibit remarkably complex cognitive abilities and adaptive behavior in daily life. Cognitive operation in the "mental workspace," such as mentally rotating a piece of luggage to fit into fixed trunk space, helps us maintain and manipulate information on a moment-to-moment basis. Skill acquisition in the "sensorimotor workspace," such as learning a new mapping between the magnitude of new vehicle movement and wheel turn, allows us to adjust our behavior to changing environmental or internal demands to maintain appropriate motor performance. While this cognitive and sensorimotor synergy is at the root of adaptive behavior in the real world, their interplay has been understudied due to a divide-and-conquer approach. We evaluated whether a separate domain-specific or common domain-general operation drives mental and sensorimotor rotational transformations. We observed that participants improved the efficiency of mental rotation speed after the visuomotor rotation training, and their learning rate for visuomotor adaptation also improved after their mental rotation training. Such bidirectional transfer between two widely different tasks highlights the remarkable reciprocal plasticity and demonstrates a common transformation mechanism between two intertwined workspaces. Our findings urge the necessity of an explicitly integrated approach to enhance our understanding of the dynamic interdependence between cognitive and sensorimotor mechanisms.

The Superior Colliculus: Cell Types, Connectivity, and Behavior

The superior colliculus (SC), one of the most well-characterized midbrain sensorimotor structures where visual, auditory, and somatosensory information are integrated to initiate motor commands, is highly conserved across vertebrate evolution. Moreover, cell-type-specific SC neurons integrate afferent signals within local networks to generate defined output related to innate and cognitive behaviors. This review focuses on the recent progress in understanding of phenotypic diversity amongst SC neurons and their intrinsic circuits and long-projection targets. We further describe relevant neural circuits and specific cell types in relation to behavioral outputs and cognitive functions. The systematic delineation of SC organization, cell types, and neural connections is further put into context across species as these depend upon laminar architecture. Moreover, we focus on SC neural circuitry involving saccadic eye movement, and cognitive and innate behaviors. Overall, the review provides insight into SC functioning and represents a basis for further understanding of the pathology associated with SC dysfunction.

Orienting to fear under transient focal disruption of the human amygdala

Responding to threat is under strong survival pressure, promoting the evolution of systems highly optimized for the task. Though the amygdala is implicated in 'detecting' threat, its role in the action that immediately follows-'orienting'-remains unclear. Critical to mounting a targeted response, such early action requires speed, accuracy, and resilience optimally achieved through conserved, parsimonious, dedicated systems, insured against neural loss by a parallelized functional organization. These characteristics tend to conceal the underlying substrate not only from correlative methods but also from focal disruption over time scales long enough for compensatory adaptation to take place. In a study of six patients with intracranial electrodes temporarily implanted for the clinical evaluation of focal epilepsy, we investigated gaze orienting to fear during focal, transient, unilateral direct electrical disruption of the amygdala. We showed that the amygdala is necessary for rapid gaze shifts towards faces presented in the contralateral hemifield regardless of their emotional expression, establishing its functional lateralization. Behaviourally dissociating the location of presented fear from the direction of the response, we implicated the amygdala not only in detecting contralateral faces, but also in automatically orienting specifically towards fearful ones. This salience-specific role was demonstrated within a drift-diffusion model of action to manifest as an orientation bias towards the location of potential threat. Pixel-wise analysis of target facial morphology revealed scleral exposure as its primary driver, and induced gamma oscillations-obtained from intracranial local field potentials-as its time-locked electrophysiological correlate. The amygdala is here reconceptualized as a functionally lateralized instrument of early action, reconciling previous conflicting accounts confined to detection, and revealing a neural organisation analogous to the superior colliculus, with which it is phylogenetically kin. Greater clarity on its role has the potential to guide therapeutic resection, still frequently complicated by impairments of cognition and behaviour related to threat, and inform novel focal stimulation techniques for the management of neuropsychiatric conditions.

Striatal indirect pathway mediates exploration via collicular competition

The ability to suppress actions that lead to a negative outcome and explore alternative actions is necessary for optimal decision making. Although the basal ganglia have been implicated in these processes^1-5, the circuit mechanisms underlying action selection and exploration remain unclear. Here, using a simple lateralized licking task, we show that indirect striatal projection neurons (iSPN) in the basal ganglia contribute to these processes through modulation of the superior colliculus (SC). Optogenetic activation of iSPNs suppresses contraversive licking and promotes ipsiversive licking. Activity in lateral superior colliculus (lSC), a region downstream of the basal ganglia, is necessary for task performance and predicts lick direction. Furthermore, iSPN activation suppresses ipsilateral lSC, but surprisingly excites contralateral lSC, explaining the emergence of ipsiversive licking. Optogenetic inactivation reveals inter-collicular competition whereby each hemisphere of the superior colliculus inhibits the other, thus allowing the indirect pathway to disinhibit the contralateral lSC and trigger licking. Finally, inactivating iSPNs impairs suppression of devalued but previously rewarded licking and reduces exploratory licking. Our results reveal that iSPNs engage the competitive interaction between lSC hemispheres to trigger a motor action and suggest a general circuit mechanism for exploration during action selection.

A nearby distractor does not influence hand movements

When interacting with the environment, our manual actions are often preceded by an eye movement. This suggests that the processes underlying target selection in hand and eye movements may be coupled. It is known that when a distractor is presented close to a target, the endpoint of an eye movement will be biased towards the distractor. The size of this so-called global effect decreases when more viewing time is available. Here we investigate whether a similar effect is also present in hand movements. If the processes underlying target selection for hand and eye movements are indeed coupled, a similar bias should be present in hand movements as well. To test this, we adopted a classic global effect paradigm but applied it to goal-directed hand movements. We show that the endpoints of hand movements are unbiased for all but one participant, irrespective of the viewing time. These results suggest that the processes underlying target selection for hand movements operate independently from those for eye movements.

Role of the Superior Colliculus in Guiding Movements Not Made by the Eyes

The superior colliculus (SC) has long been associated with the neural control of eye movements. Over seventy years ago, the orderly topography of saccade vectors and corresponding visual field locations was discovered in the cat SC. Since then, numerous high-impact studies have investigated and manipulated the relationship between visuotopic space and saccade vector across this topography to better understand the physiological underpinnings of the sensorimotor signal transformation. However, less attention has been paid to the other motor responses that may be associated with SC activity, ranging in complexity from concerted movements of skeletomotor muscle groups, such as arm-reaching movements, to behaviors that involve whole-body movement sequences, such as fight-or-flight responses in murine models. This review surveys these more complex movements associated with SC (optic tectum in nonmammalian species) activity and, where possible, provides phylogenetic and ethological perspective. Expected final online publication date for the Annual Review of Vision Science, Volume 7 is September 2021. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

High-contrast, moving targets in an emerging target paradigm promote fast visuomotor responses during visually guided reaching

Humans have a remarkable capacity to rapidly interact with the surrounding environment, often by transforming visual input into motor output on a moment-to-moment basis. But what visual features promote rapid reaching? High-contrast, fast-moving targets elicit strong responses in the superior colliculus (SC), a structure associated with express saccades and implicated in rapid electromyographic (EMG) responses on upper limb muscles. To test the influence of stimulus properties on rapid reaches, we had human subjects perform visually guided reaches to moving targets varied by speed (experiment 1) or speed and contrast (experiment 2) in an emerging target paradigm that has recently been shown to robustly elicit fast visuomotor responses. Our analysis focused on stimulus-locked responses (SLRs) on upper limb muscles. SLRs appear within <100 ms of target presentation, and as the first wave of muscle recruitment they have been hypothesized to arise from the SC. Across 32 subjects studied in both experiments, 97% expressed SLRs in the emerging target paradigm, whereas only 69% expressed SLRs in an immediate response paradigm toward static targets. Faster-moving targets (experiment 1) evoked large-magnitude SLRs, whereas high-contrast fast-moving targets (experiment 2) evoked short-latency, large-magnitude SLRs. In some instances, SLR magnitude exceeded the magnitude of movement-aligned activity. Both large-magnitude and short-latency SLRs were correlated with short-latency reach reaction times. Our results support the hypothesis that, in scenarios requiring expedited responses, a subcortical pathway originating in the SC elicits the earliest wave of muscle recruitment, expediting reaction times.NEW & NOTEWORTHY How does the brain rapidly transform vision into action? Here, by recording upper limb muscle activity, we find that high-contrast and fast-moving targets are highly effective at evoking rapid visually guided reaches. We surmise that a brain stem circuit originating in the superior colliculus contributes to the most rapid reaching responses. When time is of the essence, cortical areas may serve to prime this circuit and elaborate subsequent phases of recruitment.

A cortico-collicular pathway for motor planning in a memory-dependent perceptual decision task

Survival in a dynamic environment requires animals to plan future actions based on past sensory evidence, known as motor planning. However, the neuronal circuits underlying this crucial brain function remain elusive. Here, we employ projection-specific imaging and perturbation methods to investigate the direct pathway linking two key nodes in the motor planning network, the secondary motor cortex (M2) and the midbrain superior colliculus (SC), in mice performing a memory-dependent perceptual decision task. We find dynamic coding of choice information in SC-projecting M2 neurons during motor planning and execution, and disruption of this information by inhibiting M2 terminals in SC selectively impaired decision maintenance. Furthermore, we show that while both excitatory and inhibitory SC neurons receive synaptic inputs from M2, these SC subpopulations display differential temporal patterns in choice coding during behavior. Our results reveal the dynamic recruitment of the premotor-collicular pathway as a circuit mechanism for motor planning.

Duan, Pan et al. find that the premotor cortex cooperates with the midbrain superior colliculus via direct projections to implement decision maintenance. These results reveal mechanisms of cortico-collicular interaction during cognition and action in a pathway- and cell-type-specific manner.

Visual selective attention and the control of tracking eye movements: a critical review

People’s eyes are directed at objects of interest with the aim of acquiring visual information. However, processing this information is constrained in capacity, requiring task-driven and salience-driven attentional mechanisms to select few among the many available objects. A wealth of behavioral and neurophysiological evidence has demonstrated that visual selection and the motor selection of saccade targets rely on shared mechanisms. This coupling supports the premotor theory of visual attention put forth more than 30 years ago, postulating visual selection as a necessary stage in motor selection. In this review, we examine to which extent the coupling of visual and motor selection observed with saccades is replicated during ocular tracking. Ocular tracking combines catch-up saccades and smooth pursuit to foveate a moving object. We find evidence that ocular tracking requires visual selection of the speed and direction of the moving target, but the position of the motion signal may not coincide with the position of the pursuit target. Further, visual and motor selection can be spatially decoupled when pursuit is initiated (open-loop pursuit). We propose that a main function of coupled visual and motor selection is to serve the coordination of catch-up saccades and pursuit eye movements. A simple race-to-threshold model is proposed to explain the variable coupling of visual selection during pursuit, catch-up and regular saccades, while generating testable predictions. We discuss pending issues, such as disentangling visual selection from preattentive visual processing and response selection, and the pinpointing of visual selection mechanisms, which have begun to be addressed in the neurophysiological literature.

Unraveling circuits of visual perception and cognition through the superior colliculus

The superior colliculus is a conserved sensorimotor structure that integrates visual and other sensory information to drive reflexive behaviors. Although the evidence for this is strong and compelling, a number of experiments reveal a role for the superior colliculus in behaviors usually associated with the cerebral cortex, such as attention and decision-making. Indeed, in addition to collicular outputs targeting brainstem regions controlling movements, the superior colliculus also has ascending projections linking it to forebrain structures including the basal ganglia and amygdala, highlighting the fact that the superior colliculus, with its vast inputs and outputs, can influence processing throughout the neuraxis. Today, modern molecular and genetic methods combined with sophisticated behavioral assessments have the potential to make significant breakthroughs in our understanding of the evolution and conservation of neuronal cell types and circuits in the superior colliculus that give rise to simple and complex behaviors.

Functional Use of Eye Movements for an Acting System

Movements of the eyes assist vision and support hand and body movements in a cooperative way. Despite their strong functional coupling, different types of movements are usually studied independently. We integrate knowledge from behavioral, neurophysiological, and clinical studies on how eye movements are coordinated with goal-directed hand movements and how they facilitate motor learning. Understanding the coordinated control of eye and hand movements can provide important insights into brain functions that are essential for performing or learning daily tasks in health and disease. This knowledge can also inform applications such as robotic manipulation and clinical rehabilitation.

Control of Orienting Movements and Locomotion by Projection-Defined Subsets of Brainstem V2a Neurons

Spatial orientation requires the execution of lateralized movements and a change in the animal's heading in response to multiple sensory modalities. While much research has focused on the circuits for sensory integration, chiefly to the midbrain superior colliculus (SC), the downstream cells and circuits that engage adequate motor actions have remained elusive. Furthermore, the mechanisms supporting trajectory changes are still speculative. Here, using transneuronal viral tracings in mice, we show that brainstem V2a neurons, a genetically defined subtype of glutamatergic neurons of the reticular formation, receive putative synaptic inputs from the contralateral SC. This makes them a candidate relay of lateralized orienting commands. We next show that unilateral optogenetic activations of brainstem V2a neurons in vivo evoked ipsilateral orienting-like responses of the head and the nose tip on stationary mice. When animals are walking, similar stimulations impose a transient locomotor arrest followed by a change of trajectory. Third, we reveal that these distinct motor actions are controlled by dedicated V2a subsets each projecting to a specific spinal cord segment, with at least (1) a lumbar-projecting subset whose unilateral activation specifically controls locomotor speed but neither impacts trajectory nor evokes orienting movements, and (2) a cervical-projecting subset dedicated to head orientation, but not to locomotor speed. Activating the latter subset suffices to steer the animals' directional heading, placing the head orientation as the prime driver of locomotor trajectory. V2a neurons and their modular organization may therefore underlie the orchestration of multiple motor actions during multi-faceted orienting behaviors.

Reaching movements are automatically redirected to nearby options during target split

Motor behavior often occurs in environments with multiple goal options that can vary during the ongoing action. We explored this situation by requiring subjects to select between different target options during an ongoing reach. During split trials the original target was replaced with a left and a right flanking target, and participants had to select between them. This contrasted with the standard jump trials, where the original target would be replaced with a single flanking target, left or right. When participants were instructed to follow their natural tendency, they all tended to select the split target nearest the original. The near-target preference was more prominent with increased spatial disparity between the options and when participants could preview the potential options. Moreover, explicit instruction to obtain the "far" target during split trials resulted many errors compared with a "near" instruction, ~50% vs. ~15%. Online reaction times to target change were delayed in split trials compared with jump trials, ~200 ms vs. ~150 ms, but also highly automatic. Trials in which the instructed far target was correctly obtained were delayed by a further ~50 ms, unlike those in which the near target was incorrectly obtained. We also observed nonspecific responses from arm muscles at the jump trial latency during split trials. Taken together, our results indicate that online selection of reach targets is automatically linked to the spatial distribution of the options, though at greater delays than redirecting to a single target.NEW & NOTEWORTHY This work demonstrates that target selection during an ongoing reach is automatically linked to the option nearest a voided target. Online reaction times for two options are longer than redirection to a single option. Attempts to override the near-target tendency result in a high number of errors at the normal delay and further delays when the attempt is successful.

A comparison of simple movement behaviors across three different devices

Reaching trajectories have provided a unique tool to observe changes in internal cognitive decisions. Furthermore, technological advances have made devices for measuring reach movements more accessible and researchers have recognized that various populations including children, elderly populations, and non-human primates can easily execute simple movements as responses. As a result, devices such as a three-dimensional (3D) reach tracker, a stylus, or a computer-mouse have been increasingly utilized to study cognitive processes. However, although the specific type of tracking device that a researcher uses may impact behavior due to the constraints it places on movements, most researchers in these fields are unaware of this potential issue. Here, we examined the potential behavioral impact of using each of these three devices. To induce re-directed movements that mimic the movements that often occur following changes in cognitive states, we used a double-step task in which displacement of an initial target location requires participants to quickly re-direct their movement. We found that reach movement parameters were largely comparable across the three devices. However, hand movements measured by a 3D reach tracker showed earlier reach initiation latencies (relative to stylus movements) and more curved movement trajectories (relative to both mouse and stylus movements). Reach movements were also re-directed following target displacement more rapidly. Thus, 3D reach trackers may be ideal for observing fast, subtle changes in internal decision-making processes compared to other devices. Taken together, this study provides a useful reference for comparing and implementing reaching studies to examine human cognition.

No one knows what attention is

In this article, we challenge the usefulness of "attention" as a unitary construct and/or neural system. We point out that the concept has too many meanings to justify a single term, and that "attention" is used to refer to both the explanandum (the set of phenomena in need of explanation) and the explanans (the set of processes doing the explaining). To illustrate these points, we focus our discussion on visual selective attention. It is argued that selectivity in processing has emerged through evolution as a design feature of a complex multi-channel sensorimotor system, which generates selective phenomena of "attention" as one of many by-products. Instead of the traditional analytic approach to attention, we suggest a synthetic approach that starts with well-understood mechanisms that do not need to be dedicated to attention, and yet account for the selectivity phenomena under investigation. We conclude that what would serve scientific progress best would be to drop the term "attention" as a label for a specific functional or neural system and instead focus on behaviorally relevant selection processes and the many systems that implement them.

Independent selection of eye and hand targets suggests effector-specific attentional mechanisms

Both eye and hand movements bind visual attention to their target locations during movement preparation. However, it remains contentious whether eye and hand targets are selected jointly by a single selection system, or individually by independent systems. To unravel the controversy, we investigated the deployment of visual attention – a proxy of motor target selection – in coordinated eye-hand movements. Results show that attention builds up in parallel both at the eye and the hand target. Importantly, the allocation of attention to one effector’s motor target was not affected by the concurrent preparation of the other effector’s movement at any time during movement preparation. This demonstrates that eye and hand targets are represented in separate, effector-specific maps of action-relevant locations. The eye-hand synchronisation that is frequently observed on the behavioral level must emerge from mutual influences of the two effector systems at later, post-attentional processing stages.

Extinction as a deficit of the decision-making circuitry in the posterior parietal cortex

Extinction is a common neurologic deficit that often occurs as one of a constellation of symptoms seen with lesions of the posterior parietal cortex (PPC). Although extinction has typically been considered a deficit in the allocation of attention, new findings, particularly from nonhuman primate studies, point to one potential and important source of extinction as damage to decision-making circuits for actions within the PPC. This new understanding provides clues to potential therapies for extinction. Also the finding that the PPC is important for action decisions and action planning has led to new neuroprosthetic applications using PPC recordings as control signals to assist paralyzed patients.

Done in 100 ms: path-dependent visuomotor transformation in the human upper limb

A core assumption underlying mental chronometry is that more complex tasks increase cortical processing, prolonging reaction times. In this study we show that increases in task complexity alter the magnitude, rather than the latency, of the output for a circuit that rapidly transforms visual information into motor actions. We quantified visual stimulus-locked responses (SLRs), which are changes in upper limb muscle recruitment that evolve at a fixed latency ~100 ms after novel visual stimulus onset. First, we studied the underlying reference frame of the SLR by dissociating the initial eye and hand position. Despite its quick latency, we found that the SLR was expressed in a hand-centric reference frame, suggesting that the circuit mediating the SLR integrated retinotopic visual information with body configuration. Next, we studied the influence of planned movement trajectory, requiring participants to prepare and generate either curved or straight reaches in the presence of obstacles to attain the same visual stimulus location. We found that SLR magnitude was influenced by the planned movement trajectory to the same visual stimulus. On the basis of these results, we suggest that the circuit mediating the SLR lies in parallel to other well-studied corticospinal pathways. Although the fixed latency of the SLR precludes extensive cortical processing, inputs conveying information relating to task complexity, such as body configuration and planned movement trajectory, can preset nodes within the circuit underlying the SLR to modulate its magnitude. NEW & NOTEWORTHY We studied stimulus-locked responses (SLRs), which are changes in human upper limb muscle recruitment that evolve at a fixed latency ~100 ms after novel visual stimulus onset. We showed that despite its quick latency, the circuitry mediating the SLR transformed a retinotopic visual signal into a hand-centric motor command that is modulated by the planned movement trajectory. We suggest that the circuit generating the SLR is mediated through a tectoreticulospinal, rather than a corticospinal, pathway.

Abandoning and modifying one action plan for alternatives

Visual scenes are often complex and crowded with many different objects. To interact effectively, we must choose one object at a time as a goal for action. Certain external cues can act as a stop signal, quickly cancelling an ongoing action. Less recognized are internal signals. These can come from recent experience, anticipated action outcomes, cognitive states, and when attention is captured by a salient object. These signals elevate one action plan over alternatives and can quickly modify an initial choice. Here, we focus on these internal processes responsible for selecting, abandoning and modifying action plans. We first highlight how the brain resolves competition among multiple action plans. Critical is the existence of parallel motor planning processes, which allow efficient and timely changes. Then, we discuss how the action system interplays with perception, attention and memory processes to bias action selection and suppress or modify erroneous selections. Subsequently, we show how tracking the continuous modification of action trajectories can provide a tool to read out changes in internal cognitive states. Taken together, we shed light on a broader view that sensorimotor networks can continuously modify actions through simultaneous evaluation of alternative activities in concert with widely distributed perceptual and cognitive networks.This article is part of the themed issue 'Movement suppression: brain mechanisms for stopping and stillness'.

Dynamic modulation of illusory and physical target size on separate and coordinated eye and hand movements

In everyday behavior, two of the most common visually guided actions-eye and hand movements-can be performed independently, but are often synergistically coupled. In this study, we examine whether the same visual representation is used for different stages of saccades and pointing, namely movement preparation and execution, and whether this usage is consistent between independent and naturalistic coordinated eye and hand movements. To address these questions, we used the Ponzo illusion to dissociate the perceived and physical sizes of visual targets and measured the effects on movement preparation and execution for independent and coordinated saccades and pointing. During independent movements, we demonstrated that both physically and perceptually larger targets produced faster preparation for both effectors. Furthermore, participants who showed a greater influence of the illusion on saccade preparation also showed a greater influence on pointing preparation, suggesting that a shared mechanism involved in preparation across effectors is influenced by illusions. However, only physical but not perceptual target sizes influenced saccade and pointing execution. When pointing was coordinated with saccades, we observed different dynamics: pointing no longer showed modulation from illusory size, while saccades showed illusion modulation for both preparation and execution. Interestingly, in independent and coordinated movements, the illusion modulated saccade preparation more than pointing preparation, with this effect more pronounced during coordination. These results suggest a shared mechanism, dominated by the eyes, may underlie visually guided action preparation across effectors. Furthermore, the influence of illusions on action may operate within such a mechanism, leading to dynamic interactions between action modalities based on task demands.

Contrasting speed-accuracy tradeoffs for eye and hand movements reveal the optimal nature of saccade kinematics

In contrast to hand movements, the existence of a neural representation of saccade kinematics is unclear. Saccade kinematics is typically thought to be specified by motor error/desired displacement and generated by brain stem circuits that are not penetrable to voluntary control. We studied the influence of instructed hand movement velocity on the kinematics of saccades executed without explicit instructions. When the hand movement was slow the saccade velocity decreased, independent of saccade amplitude. We leveraged this modulation of saccade velocity to study the optimality of saccades (in terms of velocity and endpoint accuracy) in relation to the well-known speed-accuracy tradeoff that governs voluntary movements (Fitts' law). In contrast to hand movements that obeyed Fitts' law, normometric saccades exhibited the greatest endpoint accuracy and lower reaction times, relative to saccades accompanying slow and fast hand movements. In the slow condition, where saccade endpoint accuracy suffered, we observed that targets were more likely to be foveated by two saccades resulting in step-saccades. Interestingly, the endpoint accuracy was higher in two-saccade trials, compared with one-saccade trials in both the slow and fast conditions. This indicates that step-saccades are a part of the kinematic plan for optimal control of endpoint accuracy. Taken together, these findings suggest normometric saccades are already optimized to maximize endpoint accuracy and the modulation of saccade velocity by hand velocity is likely to reflect the sharing of kinematic plans between the two effectors.NEW & NOTEWORTHY The optimality of saccade kinematics has been suggested by modeling studies but experimental evidence is lacking. However, we observed that, when subjects voluntarily modulated their hand velocity, the velocity of saccades accompanying these hand movements was also modulated, suggesting a shared kinematic plan for eye and hand movements. We leveraged this modulation to show that saccades had less endpoint accuracy when their velocity decreased, illustrating that normometric saccades have optimal speed and accuracy.

Human centromedian-parafascicular complex signals sensory cues for goal-oriented behavior selection

Experimental research has shown that the centromedian-parafascicular complex (CM-Pf) of the intralaminar thalamus is activated in attentional orienting and processing of behaviorally relevant stimuli. These observations resulted in the hypothesis that the CM-Pf plays a pivotal role in goal-oriented behavior selection. We here set out to test this hypothesis with electrophysiological recordings from patients with electrodes implanted in CM-Pf for deep brain stimulation (DBS) treatment of chronic neuropathic pain. Six patients participated in (1) an auditory three-class oddball experiment, which required a button press to target tones, but not to standard and deviant tones and in (2) a multi-speaker experiment with a target word that required attention selection and a target image that required response selection. Subjects showed transient neural responses (8-15Hz) to the target tone and the target word. Two subjects additionally showed transient neural responses (15-25Hz) to the target image. All sensory target stimuli were related to an internal goal and required a behavior selection (attention selection, response selection). In group analyses, neural responses were greater to target tones than deviant and standard tones and to target words than other task-relevant words that did not require attention selection. The transient neural responses occurred after the target stimuli but prior to the overt behavioral response. Our results demonstrate that in human subjects the CM-Pf is involved in signaling sensory inputs related to goal-oriented selection of behavior.

Deafferentation of the Superior Colliculus Abolishes Spatial Summation of Redundant Visual Signals

Two visual signals appearing simultaneously are detected more rapidly than either signal appearing alone. Part of this redundant target effect (RTE) can be attributed to neural summation that has been proposed to occur in the superior colliculus (SC). We report direct evidence in two neurological patients for neural summation in the SC, and that it is mediated by afferent visual information transmitted through its brachium. The RTE was abolished in one patient with a hemorrhage involving the right posterior thalamus that damaged part of the SC and that disrupted its brachium; and in another patient in whom the SC appeared intact but deafferented due to traumatic avulsion of its brachium. In addition reaction time for unilateral targets in the contralesional field was slowed in both patients, providing the first evidence that visual afferents to the SC contribute to the efficiency of target detection.

Target selection biases from recent experience transfer across effectors

Target selection is often biased by an observer's recent experiences. However, not much is known about whether these selection biases influence behavior across different effectors. For example, does looking at a red object make it easier to subsequently reach towards another red object? In the current study, we asked observers to find the uniquely colored target object on each trial. Randomly intermixed pre-trial cues indicated the mode of action: either an eye movement or a visually guided reach movement to the target. In Experiment 1, we found that priming of popout, reflected in faster responses following repetition of the target color on consecutive trials, occurred regardless of whether the effector was repeated from the previous trial or not. In Experiment 2, we examined whether an inhibitory selection bias away from a feature could transfer across effectors. While priming of popout reflects both enhancement of the repeated target features and suppression of the repeated distractor features, the distractor previewing effect isolates a purely inhibitory component of target selection in which a previewed color is presented in a homogenous display and subsequently inhibited. Much like priming of popout, intertrial suppression biases in the distractor previewing effect transferred across effectors. Together, these results suggest that biases for target selection driven by recent trial history transfer across effectors. This indicates that representations in memory that bias attention towards or away from specific features are largely independent from their associated actions.

Mesencephalic representations of recent experience influence decision making

Decisions are influenced by recent experience, but the neural basis for this phenomenon is not well understood. Here, we address this question in the context of action selection. We focused on activity in the pedunculopontine tegmental nucleus (PPTg), a mesencephalic region that provides input to several nuclei in the action selection network, in well-trained mice selecting actions based on sensory cues and recent trial history. We found that, at the time of action selection, the activity of many PPTg neurons reflected the action on the previous trial and its outcome, and the strength of this activity predicted the upcoming choice. Further, inactivating the PPTg predictably decreased the influence of recent experience on action selection. These findings suggest that PPTg input to downstream motor regions, where it can be integrated with other relevant information, provides a simple mechanism for incorporating recent experience into the computations underlying action selection.

DOI:http://dx.doi.org/10.7554/eLife.16572.001

The decisions we make are influenced by recent experience, yet it is not known how this experience is represented in the brain. For decisions about when, where and how to move, researchers have hypothesized that recent experience might influence activity in a region of the brainstem – the central trunk of the brain – that is known to be involved in movement.

When deciding when, where and how to move, several areas of the brain are involved in selecting the optimal action. Recent studies suggest that groups of neurons known as locomotor brainstem nuclei may also contribute to making decisions about movements.

Thompson et al. investigated whether a brainstem locomotor area called the pedunculopontine tegmental (PPTg) nucleus in mice might contribute to decision making rather than just conveying the selected response. The mice were trained to recognize particular odors and move to either the left or right to collect a food reward. While the mice were selecting an action, the activity of neurons in the PPTg nucleus reflected the action they had chosen on a previous experience and the outcome of that choice (i.e. whether they received a reward). These representations of past experiences influenced the upcoming decision the mice were about to take.

The findings of Thompson et al. suggest that the PPTg nucleus might play a critical role in the process of selecting the optimal action. Future work will examine what kinds of information about the environment or recent experience have the biggest effect on the activity of this region.

DOI:http://dx.doi.org/10.7554/eLife.16572.002

Inactivation of Parietal Reach Region Affects Reaching But Not Saccade Choices in Internally Guided Decisions

The posterior parietal cortex (PPC) has traditionally been considered important for awareness, spatial perception, and attention. However, recent findings provide evidence that the PPC also encodes information important for making decisions. These findings have initiated a running argument of whether the PPC is critically involved in decision making. To examine this issue, we reversibly inactivated the parietal reach region (PRR), the area of the PPC that is specialized for reaching movements, while two monkeys performed a memory-guided reaching or saccade task. The task included choices between two equally rewarded targets presented simultaneously in opposite visual fields. Free-choice trials were interleaved with instructed trials, in which a single cue presented in the peripheral visual field defined the reach and saccade target unequivocally. We found that PRR inactivation led to a strong reduction of contralesional choices, but only for reaches. On the other hand, saccade choices were not affected by PRR inactivation. Importantly, reaching and saccade movements to single instructed targets remained largely intact. These results cannot be explained as an effector-nonspecific deficit in spatial attention or awareness, since the temporary "lesion" had an impact only on reach choices. Hence, the PPR is a part of a network for reach decisions and not just reach planning.

SIGNIFICANCE STATEMENT

There has been an ongoing debate on whether the posterior parietal cortex (PPC) represents only spatial awareness, perception, and attention or whether it is also involved in decision making for actions. In this study we explore whether the parietal reach region (PRR), the region of the PPC that is specialized for reaches, is involved in the decision process. We inactivated the PRR while two monkeys performed reach and saccade choices between two targets presented simultaneously in both hemifields. We found that inactivation affected only the reach choices, while leaving saccade choices intact. These results cannot be explained as a deficit in attention, since the temporary lesion affected only the reach choices. Thus, PRR is a part of a network for making reach decisions.

Eye-hand coordination during a double-step task: evidence for a common stochastic accumulator

Many studies of reaching and pointing have shown significant spatial and temporal correlations between eye and hand movements. Nevertheless, it remains unclear whether these correlations are incidental, arising from common inputs (independent model); whether these correlations represent an interaction between otherwise independent eye and hand systems (interactive model); or whether these correlations arise from a single dedicated eye-hand system (common command model). Subjects were instructed to redirect gaze and pointing movements in a double-step task in an attempt to decouple eye-hand movements and causally distinguish between the three architectures. We used a drift-diffusion framework in the context of a race model, which has been previously used to explain redirect behavior for eye and hand movements separately, to predict the pattern of eye-hand decoupling. We found that the common command architecture could best explain the observed frequency of different eye and hand response patterns to the target step. A common stochastic accumulator for eye-hand coordination also predicts comparable variances, despite significant difference in the means of the eye and hand reaction time (RT) distributions, which we tested. Consistent with this prediction, we observed that the variances of the eye and hand RTs were similar, despite much larger hand RTs (∼90 ms). Moreover, changes in mean eye RTs, which also increased eye RT variance, produced a similar increase in mean and variance of the associated hand RT. Taken together, these data suggest that a dedicated circuit underlies coordinated eye-hand planning.

Attention in Active Vision: A Perspective on Perceptual Continuity Across Saccades

Alfred L. Yarbus was among the first to demonstrate that eye movements actively serve our perceptual and cognitive goals, a crucial recognition that is at the heart of today's research on active vision. He realized that not the changes in fixation stick in memory but the changes in shifts of attention. Indeed, oculomotor control is tightly coupled to functions as fundamental as attention and memory. This tight relationship offers an intriguing perspective on transsaccadic perceptual continuity, which we experience despite the fact that saccades cause rapid shifts of the image across the retina. Here, I elaborate this perspective based on a series of psychophysical findings. First, saccade preparation shapes the visual system's priorities; it enhances visual performance and perceived stimulus intensity at the targets of the eye movement. Second, before saccades, the deployment of visual attention is updated, predictively facilitating perception at those retinal locations that will be relevant once the eyes land. Third, saccadic eye movements strongly affect the contents of visual memory, highlighting their crucial role for which parts of a scene we remember or forget. Together, these results provide insights on how attentional processes enable the visual system to cope with the retinal consequences of saccades.

Electrical stimulation of the superior colliculus induces non-topographically organized perturbation of reaching movements in cats

Besides its well-known contribution to orienting behaviors, the superior colliculus (SC) might also play a role in controlling visually guided reaching movements. This view has been inferred from studies in monkeys showing that some tectal cells located in the deep layers are active prior to reaching movements; it was corroborated by functional imaging studies performed in humans. Likewise, our group has already demonstrated that, in cats, SC electrical stimulation can modify the trajectory of goal-directed forelimb movements without necessarily affecting the gaze position. However, as in monkeys, we could not establish any congruence between the usual retinotopic SC map and direction of evoked forelimb movements, albeit only a small portion of the collicular map was investigated. Therefore, the aim of the current study was to further ascertain the causal contribution of SC to reaching movement by exploring the whole collicular map. Our results confirmed that SC electrical stimulation deflected the trajectory of reaching movements, but this deviation was always directed downward and backward, irrespective of the location of the stimulation site. The lack of a complete map of reach directions in the SC and the absence of congruence between the direction of evoked forelimb movements and the collicular oculomotor map challenge the view that, in the cat, the SC causally contributes to coding forelimb movements. Interestingly, the very short latencies of the effect argue also against the interruption of reaching movements being driven by a disruption of the early visual processing. Our results rather suggest that the SC might contribute to the reach target selection process. Alternatively, SC stimulation might have triggered a postural adjustment anticipating an upcoming orienting reaction, leading to an interruption of the on-going reaching movement.

An integrative role for the superior colliculus in selecting targets for movements

A fundamental goal of systems neuroscience is to understand the neural mechanisms underlying decision making. The midbrain superior colliculus (SC) is known to be central to the selection of one among many potential spatial targets for movements, which represents an important form of decision making that is tractable to rigorous experimental investigation. In this review, we first discuss data from mammalian models-including primates, cats, and rodents-that inform our understanding of how neural activity in the SC underlies the selection of targets for movements. We then examine the anatomy and physiology of inputs to the SC from three key regions that are themselves implicated in motor decisions-the basal ganglia, parabrachial region, and neocortex-and discuss how they may influence SC activity related to target selection. Finally, we discuss the potential for methodological advances to further our understanding of the neural bases of target selection. Our overarching goal is to synthesize what is known about how the SC and its inputs act together to mediate the selection of targets for movements, to highlight open questions about this process, and to spur future studies addressing these questions.

Visual attention: Linking prefrontal sources to neuronal and behavioral correlates

Attention is a means of flexibly selecting and enhancing a subset of sensory input based on the current behavioral goals. Numerous signatures of attention have been identified throughout the brain, and now experimenters are seeking to determine which of these signatures are causally related to the behavioral benefits of attention, and the source of these modulations within the brain. Here, we review the neural signatures of attention throughout the brain, their theoretical benefits for visual processing, and their experimental correlations with behavioral performance. We discuss the importance of measuring cue benefits as a way to distinguish between impairments on an attention task, which may instead be visual or motor impairments, and true attentional deficits. We examine evidence for various areas proposed as sources of attentional modulation within the brain, with a focus on the prefrontal cortex. Lastly, we look at studies that aim to link sources of attention to its neuronal signatures elsewhere in the brain.

Transient visual responses reset the phase of low-frequency oscillations in the skeletomotor periphery

We recorded muscle activity from an upper limb muscle while human subjects reached towards peripheral targets. We tested the hypothesis that the transient visual response sweeps not only through the central nervous system, but also through the peripheral nervous system. Like the transient visual response in the central nervous system, stimulus-locked muscle responses (< 100 ms) were sensitive to stimulus contrast, and were temporally and spatially dissociable from voluntary orienting activity. Also, the arrival of visual responses reduced the variability of muscle activity by resetting the phase of ongoing low-frequency oscillations. This latter finding critically extends the emerging evidence that the feedforward visual sweep reduces neural variability via phase resetting. We conclude that, when sensory information is relevant to a particular effector, detailed information about the sensorimotor transformation, even from the earliest stages, is found in the peripheral nervous system.

Motor cortex guides selection of predictable movement targets

The present paper asks whether the motor cortex contributes to prediction-based guidance of target selection. This question was inspired by recent evidence that suggests (i) recurrent connections from the motor system into the attentional system may extract movement-relevant perceptual information and (ii) that the motor cortex cannot only generate predictions of the sensory consequences of movements but may also operate as predictor of perceptual events in general. To test this idea we employed a choice reaching task requiring participants to rapidly reach and touch a predictable or unpredictable colour target. Motor cortex activity was modulated via transcranial direct current stimulation (tDCS). In Experiment 1 target colour repetitions were predictable. Under such conditions anodal tDCS facilitated selection versus sham and cathodal tDCS. This improvement was apparent for trajectory curvature but not movement initiation. Conversely, where no predictability of colour was embedded reach performance was unaffected by tDCS. Finally, the results of a key-press experiment suggested that motor cortex involvement is restricted to tasks where the predictable target colour is movement-relevant. The outcomes are interpreted as evidence that the motor system contributes to the top-down guidance of selective attention to movement targets.

Neural correlates of target selection for reaching movements in superior colliculus

We recently demonstrated that inactivation of the primate superior colliculus (SC) causes a deficit in target selection for arm-reaching movements when the reach target is located in the inactivated field (Song JH, Rafal RD, McPeek RM. Proc Natl Acad Sci USA 108: E1433-E1440, 2011). This is consistent with the notion that the SC is part of a general-purpose target selection network beyond eye movements. To understand better the role of SC activity in reach target selection, we examined how individual SC neurons in the intermediate layers discriminate a reach target from distractors. Monkeys reached to touch a color oddball target among distractors while maintaining fixation. We found that many SC neurons robustly discriminate the goal of the reaching movement before the onset of the reach even though no saccade is made. To identify these cells in the context of conventional SC cell classification schemes, we also recorded visual, delay-period, and saccade-related responses in a delayed saccade task. On average, SC cells that discriminated the reach target from distractors showed significantly higher visual and delay-period activity than nondiscriminating cells, but there was no significant difference in saccade-related activity. Whereas a majority of SC neurons that discriminated the reach target showed significant delay-period activity, all nondiscriminating cells lacked such activity. We also found that some cells without delay-period activity did discriminate the reach target from distractors. We conclude that the majority of intermediate-layer SC cells discriminate a reach target from distractors, consistent with the idea that the SC contains a priority map used for effector-independent target selection.

Fractionation of the visuomotor feedback response to directions of movement and perturbation

Recent studies have highlighted the modulation and control of feedback gains as support for optimal feedback control. While many experiments contrast feedback gains across different environments, only a few have demonstrated the appropriate modulation of feedback gains from one movement to the next. Here we extend previous work by examining whether different visuomotor feedback gains can be learned for different directions of movement or perturbation directions in the same posture. To do this we measure visuomotor responses (involuntary motor responses to shifts in the visual feedback of the hand) during reaching movements. Previous work has demonstrated that these feedback responses can be modulated depending on the statistical distributions of the environment. Specifically, feedback gains were upregulated for task-relevant environments and downregulated for task-irrelevant environments. Using these two statistical distributions, the first experiment examined whether these feedback responses could be independently modulated for the same limb posture for two directions of movement (same limb posture but on either an inward or outward movement), while the second examined whether the feedback responses could modulate, within a single movement, to perturbations to the left or right of the reach. Both experiments demonstrated that visuomotor feedback responses could be learned independently such that the response was appropriate for the environment. This work demonstrates that feedback gains can be simultaneously tuned (upregulated and downregulated) depending on the state of the body and the environment. The results indicate the degree to which feedback responses can be fractionated in order to adapt to the world.

Perceptual decision processes flexibly adapt to avoid change-of-mind motor costs

The motor system is tightly linked with perception and cognition. Recent studies have shown that even anticipated biophysical action costs associated with competing response options can be incorporated into decision-making processes. As a result, choices associated with high energy costs are less likely to be selected. However, some action costs may be harder to predict. For example, a person choosing among apples at a grocery store may change his or her mind suddenly about which apple to put into the cart. This change of mind may be reflected in motor output as the initial decision triggers a motor response toward a Granny Smith that is subsequently redirected toward a Red Delicious. In the present study, to examine how motor costs associated with changes of mind affect perceptual decision making, participants performed a difficult random dot–motion discrimination task in which they had to indicate the direction of motion by reaching to one of two response options. Although each response box was always equidistant from the starting position, the physical distance between the two response options was varied. We found that when the boxes were far apart from one another, and thus changes of mind incurred greater redirection motor costs, change-of-mind frequency decreased while latency to initiate movement increased. This occurred even when response box distance varied randomly from trial to trial and was cued only 1 s before each trial began. Thus, we demonstrated that observers can dynamically adjust perceptual decision-making processes to avoid high motor costs incurred by a change of mind.

Arm movements induced by electrical microstimulation in the superior colliculus of the macaque monkey

Neuronal activity in the deep layers of the macaque (Macaca mulatta) superior colliculus (SC) and the underlying reticular formation is correlated with the initiation and execution of arm movements (Werner, 1993). Although the correlation of this activity with EMGs of proximal arm muscles is as strong as in motor cortex (Werner et al., 1997a; Stuphorn et al., 1999), little is known about the influence of electrical microstimulation in the SC on the initiation and trajectories of arm movements. Our experiments on three macaque monkeys clearly show that arm movements can be elicited by electrical microstimulation in the deep layers of the lateral SC and underlying reticular formation. The most extensively trained monkey, M1, extended his arm toward the screen in front of him more or less stereotypically upon electrical SC stimulation. In two other monkeys, M2 and M3, a larger repertoire of arm movements were elicited, categorized into three movement types, and compared before (M3) and after (M2 and M3) training: twitch (56% vs. 62%), lift (6% vs. 5%), and extend (37% vs. 32%), respectively. Therefore, arm movements induced by electrical stimulation in the monkey SC represent a further component of the functional repertoire of the SC using its impact on motoneurons in the spinal cord, probably via premotor neurons in the brainstem, as well as on structures involved in executing more complex movements such as target-directed reaching. Therefore, the macaque SC could be involved directly in the initiation, execution, and amendment of arm and hand movements.