Neural encoding of musical expectations in a non-human primate

The appreciation of music is a universal trait of humankind.1,2,3 Evidence supporting this notion includes the ubiquity of music across cultures4,5,6,7 and the natural predisposition toward music that humans display early in development.8,9,10 Are we musical animals because of species-specific predispositions? This question cannot be answered by relying on cross-cultural or developmental studies alone, as these cannot rule out enculturation.11 Instead, it calls for cross-species experiments testing whether homologous neural mechanisms underlying music perception are present in non-human primates. We present music to two rhesus monkeys, reared without musical exposure, while recording electroencephalography (EEG) and pupillometry. Monkeys exhibit higher engagement and neural encoding of expectations based on the previously seeded musical context when passively listening to real music as opposed to shuffled controls. We then compare human and monkey neural responses to the same stimuli and find a species-dependent contribution of two fundamental musical features-pitch and timing12-in generating expectations: while timing- and pitch-based expectations13 are similarly weighted in humans, monkeys rely on timing rather than pitch. Together, these results shed light on the phylogeny of music perception. They highlight monkeys' capacity for processing temporal structures beyond plain acoustic processing, and they identify a species-dependent contribution of time- and pitch-related features to the neural encoding of musical expectations.

A view-based decision mechanism for rewards in the primate amygdala

Primates make decisions visually by shifting their view from one object to the next, comparing values between objects, and choosing the best reward, even before acting. Here, we show that when monkeys make value-guided choices, amygdala neurons encode their decisions in an abstract, purely internal representation defined by the monkey's current view but not by specific object or reward properties. Across amygdala subdivisions, recorded activity patterns evolved gradually from an object-specific value code to a transient, object-independent code in which currently viewed and last-viewed objects competed to reflect the emerging view-based choice. Using neural-network modeling, we identified a sequence of computations by which amygdala neurons implemented view-based decision making and eventually recovered the chosen object's identity when the monkeys acted on their choice. These findings reveal a neural mechanism in the amygdala that derives object choices from abstract, view-based computations, suggesting an efficient solution for decision problems with many objects.

Cortico-spinal modularity in the parieto-frontal system: A new perspective on action control

Classical neurophysiology suggests that the motor cortex (MI) has a unique role in action control. In contrast, this review presents evidence for multiple parieto-frontal spinal command modules that can bypass MI. Five observations support this modular perspective: (i) the statistics of cortical connectivity demonstrate functionally-related clusters of cortical areas, defining functional modules in the premotor, cingulate, and parietal cortices; (ii) different corticospinal pathways originate from the above areas, each with a distinct range of conduction velocities; (iii) the activation time of each module varies depending on task, and different modules can be activated simultaneously; (iv) a modular architecture with direct motor output is faster and less metabolically expensive than an architecture that relies on MI, given the slow connections between MI and other cortical areas; (v) lesions of the areas composing parieto-frontal modules have different effects from lesions of MI. Here we provide examples of six cortico-spinal modules and functions they subserve: module 1) arm reaching, tool use and object construction; module 2) spatial navigation and locomotion; module 3) grasping and observation of hand and mouth actions; module 4) action initiation, motor sequences, time encoding; module 5) conditional motor association and learning, action plan switching and action inhibition; module 6) planning defensive actions. These modules can serve as a library of tools to be recombined when faced with novel tasks, and MI might serve as a recombinatory hub. In conclusion, the availability of locally-stored information and multiple outflow paths supports the physiological plausibility of the proposed modular perspective.

The parietal lobe evolution and the emergence of material culture in the human genus

Traditional and new disciplines converge in suggesting that the parietal lobe underwent a considerable expansion during human evolution. Through the study of endocasts and shape analysis, paleoneurology has shown an increased globularity of the braincase and bulging of the parietal region in modern humans, as compared to other human species, including Neandertals. Cortical complexity increased in both the superior and inferior parietal lobules. Emerging fields bridging archaeology and neuroscience supply further evidence of the involvement of the parietal cortex in human-specific behaviors related to visuospatial capacity, technological integration, self-awareness, numerosity, mathematical reasoning and language. Here, we complement these inferences on the parietal lobe evolution, with results from more classical neuroscience disciplines, such as behavioral neurophysiology, functional neuroimaging, and brain lesions; and apply these to define the neural substrates and the role of the parietal lobes in the emergence of functions at the core of material culture, such as tool-making, tool use and constructional abilities.

The functional characterization of callosal connections

•

The functional characterization of callosal connections is informed by anatomical data.

•

Callosal connections play a conditional driving role depending on the brain state and behavioral demands.

•

Callosal connections play a modulatory function, in addition to a driving role.

•

The corpus callosum participates in learning and interhemispheric transfer of sensorimotor habits.

•

The corpus callosum contributes to language processing and cognitive functions.

The brain operates through the synaptic interaction of distant neurons within flexible, often heterogeneous, distributed systems. Histological studies have detailed the connections between distant neurons, but their functional characterization deserves further exploration. Studies performed on the corpus callosum in animals and humans are unique in that they capitalize on results obtained from several neuroscience disciplines. Such data inspire a new interpretation of the function of callosal connections and delineate a novel road map, thus paving the way toward a general theory of cortico-cortical connectivity. Here we suggest that callosal axons can drive their post-synaptic targets preferentially when coupled to other inputs endowing the cortical network with a high degree of conditionality. This might depend on several factors, such as their pattern of convergence-divergence, the excitatory and inhibitory operation mode, the range of conduction velocities, the variety of homotopic and heterotopic projections and, finally, the state-dependency of their firing. We propose that, in addition to direct stimulation of post-synaptic targets, callosal axons often play a conditional driving or modulatory role, which depends on task contingencies, as documented by several recent studies.

On the cortical connectivity in the macaque brain: A comparison of diffusion tractography and histological tracing data

Diffusion-weighted magnetic resonance imaging (DW-MRI) tractography is a non-invasive tool to probe neural connections and the structure of the white matter. It has been applied successfully in studies of neurological disorders and normal connectivity. Recent work has revealed that tractography produces a high incidence of false-positive connections, often from "bottleneck" white matter configurations. The rich literature in histological connectivity analysis studies in the macaque monkey enables quantitative evaluation of the performance of tractography algorithms. In this study, we use the intricate connections of frontal, cingulate, and parietal areas, well established by the anatomical literature, to derive a symmetrical histological connectivity matrix composed of 59 cortical areas. We evaluate the performance of fifteen diffusion tractography algorithms, including global, deterministic, and probabilistic state-of-the-art methods for the connectivity predictions of 1711 distinct pairs of areas, among which 680 are reported connected by the literature. The diffusion connectivity analysis was performed on a different ex-vivo macaque brain, acquired using multi-shell DW-MRI protocol, at high spatial and angular resolutions. Across all tested algorithms, the true-positive and true-negative connections were dominant over false-positive and false-negative connections, respectively. Moreover, three-quarters of streamlines had endpoints location in agreement with histological data, on average. Furthermore, probabilistic streamline tractography algorithms show the best performances in predicting which areas are connected. Altogether, we propose a method for quantitative evaluation of tractography algorithms, which aims at improving the sensitivity and the specificity of diffusion-based connectivity analysis. Overall, those results confirm the usefulness of tractography in predicting connectivity, although errors are produced. Many of the errors result from bottleneck white matter configurations near the cortical grey matter and should be the target of future implementation of methods.

A Brief History of the Encoding of Hand Position by the Cerebral Cortex: Implications for Motor Control and Cognition

Encoding hand position by the cerebral cortex is essential not only for the neural representation of the body image but also for different actions based on eye-hand coordination. These include reaching for visual objects as well as complex movement sequences, such as tea-making, tool use, and object construction, among many others. All these functions depend on a continuous refreshing of the hand position representation, relying on both predictive signaling and afferent information. The hand position influence on neural activity in the parietofrontal system, together with eye position signals, are the basic elements of an eye-hand matrix from which all the above functions can emerge and could be regarded as key features of a network with several entry points, command nodes and outflow pathways, as confirmed by the discovery of a direct parietospinal projection for the control of hand action. The integrity of this system is crucial for daily life, as testified by the consequences of cortical lesions, spanning from severe paralysis to complex forms of apraxia. In this review, I will sketch my personal understanding of the scientific and conceptual trajectory of a line of investigation with many unexpected influences on cortical function and disease, from motor behavior to cognition.

Corticocortical Systems Underlying High-Order Motor Control

Cortical networks are characterized by the origin, destination, and reciprocity of their connections, as well as by the diameter, conduction velocity, and synaptic efficacy of their axons. The network formed by parietal and frontal areas lies at the core of cognitive-motor control because the outflow of parietofrontal signaling is conveyed to the subcortical centers and spinal cord through different parallel pathways, whose orchestration determines, not only when and how movements will be generated, but also the nature of forthcoming actions. Despite intensive studies over the last 50 years, the role of corticocortical connections in motor control and the principles whereby selected cortical networks are recruited by different task demands remain elusive. Furthermore, the synaptic integration of different cortical signals, their modulation by transthalamic loops, and the effects of conduction delays remain challenging questions that must be tackled to understand the dynamical aspects of parietofrontal operations. In this article, we evaluate results from nonhuman primate and selected rodent experiments to offer a viewpoint on how corticocortical systems contribute to learning and producing skilled actions. Addressing this subject is not only of scientific interest but also essential for interpreting the devastating consequences for motor control of lesions at different nodes of this integrated circuit. In humans, the study of corticocortical motor networks is currently based on MRI-related methods, such as resting-state connectivity and diffusion tract-tracing, which both need to be contrasted with histological studies in nonhuman primates.

Organization and evolution of parieto-frontal processing streams in macaque monkeys and humans

The functional organization of the parieto-frontal system is crucial for understanding cognitive-motor behavior and provides the basis for interpreting the consequences of parietal lesions in humans from a neurobiological perspective. The parieto-frontal connectivity defines some main information streams that, rather than being devoted to restricted functions, underlie a rich behavioral repertoire. Surprisingly, from macaque to humans, evolution has added only a few, new functional streams, increasing however their complexity and encoding power. In fact, the characterization of the conduction times of parietal and frontal areas to different target structures has recently opened a new window on cortical dynamics, suggesting that evolution has amplified the probability of dynamic interactions between the nodes of the network, thanks to communication patterns based on temporally-dispersed conduction delays. This might allow the representation of sensory-motor signals within multiple neural assemblies and reference frames, as to optimize sensory-motor remapping within an action space characterized by different and more complex demands across evolution.

Timing and communication of parietal cortex for visuomotor control

In both monkeys and humans, motor cognition emerges from a parietal-frontal network containing discrete dominant domains of visual, eye and hand signals, where neurons are responsible for goal and effector selection. Within these domains, the combination of different inputs shape the tuning properties of neurons, while local and long cortico-cortical connections outline the architecture of the distributed network and determine the conduction time underlying eye-hand coordination, necessary for visually guided operations in the action space. The analysis of the communication timing between parietal and frontal nodes of the network helps understanding the sensorimotor cortical delays associated to different functions, such as online control of movement and eye-hand coordination, and opens a new perspective to the study of the parieto-frontal interactions.

Impairment of online control of hand and eye movements in a monkey model of optic ataxia

The parietal mechanisms for online control of hand trajectory were studied by combining single-cell recording and reversible inactivation of superior parietal area 5 (PE/PEc; SPL) of monkeys while these made reaches and saccades to visual targets, when the target position changed unexpectedly. Neural activity was modulated by hand position, speed, and movement direction, and by pre- and/or postsaccadic signals. After bilateral muscimol injection, an increase in the hand reaction- and movement-time toward both the first and second targets was observed. This caused an increase in the time necessary for the trajectory correction, and therefore an elongation of the hand-path toward the first target location. Furthermore, hand trajectories were different in shape than control ones. An elongation of the eye reaction time to both first and second targets was also observed, which could partially explain the deficit of planning and correction of hand movement. These results identify the superior parietal lobule as a crucial node in the online control of hand and eye movement and highlight the role of the eye impairment in the emergence of the reaching disorder so far regarded as the hallmark of optic ataxia.

Understanding the parietal lobe syndrome from a neurophysiological and evolutionary perspective

In human and nonhuman primates parietal cortex is formed by a multiplicity of areas. For those of the superior parietal lobule (SPL) there exists a certain homology between man and macaques. As a consequence, optic ataxia, a disturbed visual control of hand reaching, has similar features in man and monkeys. Establishing such correspondence has proven difficult for the areas of the inferior parietal lobule (IPL). This difficulty depends on many factors. First, no physiological information is available in man on the dynamic properties of cells in the IPL. Second, the number of IPL areas identified in the monkey is paradoxically higher than that so far described in man, although this issue will probably be reconsidered in future years, thanks to comparative imaging studies. Third, the consequences of parietal lesions in monkeys do not always match those observed in humans. This is another paradox if one considers that, in certain cases, the functional properties of neurons in the monkey's IPL would predict the presence of behavioral skills, such as construction capacity, that however do not seem to emerge in the wild. Therefore, constructional apraxia, which is well characterized in man, has never been described in monkeys and apes. Finally, only certain aspects, i.e. hand directional hypokinesia and gaze apraxia (Balint's psychic paralysis of gaze), of the multifaceted syndrome hemispatial neglect have been described in monkeys. These similarities, differences and paradoxes, among many others, make the study of the evolution and function of parietal cortex a challenging case.

Statistical analysis of parieto-frontal cognitive-motor networks

Considerable information has been gathered on the anatomical connectivity within the parieto-frontal network of the primate brain. To examine the statistical regularities in this connectivity, we carried out hierarchical cluster analysis and found statistically significant clusters of areas: four in the parietal and six in the frontal lobe. Clusters were based on patterns of inputs from all cortical areas. Both parietal and frontal clusters were composed of sets of spatially contiguous architectonic areas. The four parietal clusters were composed of sets of anterior (somatosensory), dorsal, inferior, and medio-lateral parietal cortical areas. The six frontal clusters were composed of sets of dorsal premotor, ventral premotor, primary motor, cingulate motor, and dorsal and ventral prefrontal cortical areas. Furthermore, connectivity between frontal and parietal clusters was topographic and reciprocal. Thus we found substantial statistical structure and organization in the parieto-frontal network that gives a simplified but accurate description of this system.

Cortical mechanisms for online control of hand movement trajectory: the role of the posterior parietal cortex

The parietal mechanisms for the control of hand movement trajectory were studied by recording cell activity in area 5 of monkeys making direct reaches to visual targets and online corrections of movement trajectory, after change of target location in space. The activity of hand-related cells was fitted with a linear model including hand position, movement direction, and speed. The neural activity modulation mostly led, but also followed, hand movement. When a change of hand trajectory occurred, the pattern of activity associated with the movement to the first target evolved into that typical of the movement to the second one, thus following the corresponding variations of the hand kinematics. The visual signal concerning target location in space did not influence the firing activity associated with the direction of hand movement within the first 150 ms after target presentation. This might be the time necessary for the visuo-motor transformation underlying reaching. We conclude that online control of hand trajectory not only resides in the relationships between neural activity and kinematics, but, under specific circumstances, also on the coexistence of signals about ongoing and future hand movement direction.

Parietal encoding of action in depth

The posterior parietal cortex is a crucial node in the process of coordinates transformation for the visual control of eye and hand movements. This conviction stems from both neurophysiological studies in the behaving monkey and from the analysis of the consequences of parietal lobe lesions in humans. Despite an extensive literature concerning varying aspects of the composition and control of eye and hand movements, there is little information about the physiological processes responsible for encoding target distance and hand movement in depth or about their control and impairment in parietal patients. This review is an attempt to provide a comprehensive picture from the fragmentary material existing on this issue in the literature. This should serve as a basis for discussion of what we consider to be a prototypical function of the dorsal visuomotor stream in the primate brain, that of encoding eye and hand movement in depth.

Temporal Evolution and Strength of Neural Activity in Parietal Cortex during Eye and Hand Movements

The role of area 7a in eye-hand movement was studied by recording from individual neurons while monkeys performed 7 different tasks, aimed at assessing the relative influence of retinal, eye, and hand information on neural activity. Parietal cell activity was modulated by visuospatial signals about target location, as well as by information concerning eye and/or hand movement, and position. The highest activity was elicited when the hand moved to the fixation point. The population activities across different memory tasks showed common temporal peaks when aligned to the visual instruction (visuospatial peak) or Go signal (motor peak) for eye, hand, and coordinated eye-hand movement. The motor peak was higher for coordinated eye-hand movement, and it was absent in a No-Go task. Two activation maxima were also observed during visual reaching. They had the same latency of the visuospatial and motor peaks seen in the memory tasks. Therefore, area 7a seems to operate through a common neural mechanism underlying eye, hand, or combined eye-hand movement. This mechanism is revealed by invariant temporal activity profiles and is independent from the effector selected and from the presence or absence of a visible target during movement. For comparative purposes, we have studied the temporal evolution of the population activity in the superior parietal lobule (SPL) during the same reaching tasks and during a saccade task. In SPL, the population activity was characterized by a single peak, time locked to the Go signal for eye, hand, or combined eye-hand movement. As in IPL, the time of occurrence of this peak was effector independent. The population activity remained unchanged when the position of the eye changed, suggesting that SPL is mostly devoted to the hand motor behavior.

The cortical network for eye–hand coordination and its relevance to understanding motor disorders of parietal patients

Cortical neurons in both superior (SPL) and inferior (IPL) parietal lobules are modulated by a variety of signals concerning planning and execution of eye and hand movement. Thanks to these properties, parietal neurons are ideally suited for eye-hand coordination during reaching. In SPL, a fundamental feature of neurons is the invariance of their directional tuning properties across tasks that require different forms of spatial relationships between the eye and the hand. In such conditions, the orientation of the preferred directions (PDs) of individual SPL cells cluster within a limited sector of space, the global tuning field (GTF), to be regarded as an ideal frame to dynamically match eye and hand signals on the basis of the orientation of their PDs. At the population level, the mean vectors of the GTF cover the direction continuum in a uniform fashion. These neurons are part of a parietal network richly interconnected with the premotor and motor areas of the frontal lobe. Thus, the reaching disorders of patients with optic ataxia might be interpreted as a consequence of the breakdown of the combinatorial mechanisms of the GTF of parietal neurons, and of their interplay with premotor cortex. In IPL, the main feature of eye and/or hand related neurons is the uneven distribution of their PDs, that mostly point toward the contralateral space. This anisotropy of the representation of directional motor space might explain the movement disorders that characterize directional hypokinesia in neglect patients. In conclusion, the study of the dynamic properties of parietal neurons and of their relationships with the premotor cortex via cortico-cortical connections provides a basis for an interpretation of movement disorders of parietal patients from a neurophysiological perspective.

Decoding of path-guided apparent motion from neural ensembles in posterior parietal cortex

We compared quantitatively the psychometric capacity of human subjects to detect path-guided apparent motion (PAM) and the accuracy of cell ensembles in area 7a to code the same type of stimuli. Nine human subjects performed a detection task of PAM. They were instructed to indicate with a key-press whether they perceived a circularly moving object when five stimuli were flashed successively at the vertices of a regular pentagon. The stimuli were presented along a low contrast circular path with one of 33 speeds (150-600 degrees /s). The average psychometric curve revealed that the threshold for PAM detection was 314 degrees /s. The minimum and maximum thresholds for individual subjects were 277 degrees and 378 degrees /s, respectively. In addition, the activity of cells in area 7a that were modulated by the stimulus position in real or apparent motion was used in a multivariate linear regression analysis to recover the stimulus position over time. Real stimulus motion was decoded successfully from neural ensemble activity at all speeds. In contrast, the decoding of PAM was poor at low stimulus speeds but improved markedly above 300 degrees /s: in fact, this was very close to the threshold above for human subjects to perceive continuous stimulus motion in this condition. These results suggest that the posterior parietal cortex is part of a high-level system that is directly involved in the dynamic representation of complex motion.

Neurophysiology of the parieto-frontal system during target interception

We studied the functional properties of neurons of two elements of the parieto-frontal system: area 7a of the PPC and the motor cortex (M1), during an interception task of stimuli moving in real (RM) and apparent motion (AM). The stimulus moved along a circular path with one of 5 speeds, and was intercepted at 6 o'clock by exerting a force pulse on a joystick. A smooth stimulus motion was produced in RM, whereas in AM 5 stimuli were flashed successively at the vertices of a pentagon. The results showed, that a group of neurons in both areas above responded not only during the interception but also during a NOGO task in which the same stimuli were presented in the absence of a motor response. Most of these neurons were tuned to the stimulus angular position. In addition, we found that the time-varying neuronal activity in both areas was related to various aspects of stimulus motion and hand force, with stimulus-related activity prevailing in area 7a and hand-related activity prevailing in M1. Interestingly, the neural activity was selectively associated with the stimulus angle during RM, whereas it was tightly correlated to the time-to-contact during AM. Thus, the results suggest that area 7a was processing high level features of the circularly moving stimuli and was involved in the production of an early command signal for stimulus interception, whereas M1 was still processing some aspect of the visual stimulus that were used to trigger the interception movement using a predictive mechanism.

The over-representation of contralateral space in parietal cortex: a positive image of directional motor components of neglect?

The activity of single cells was recorded in behaving monkeys while they performed several eye-hand directional motor tasks. The results revealed that in parietal area 7a there exists a directional representation of eye and hand motor space that, contrary to that of superior parietal, premotor and motor cortex, is highly skewed toward the contralateral workspace. In man, the loss of this representation after parietal lesions might explain the emergence of the directional movement disorders of neglect. In fact, although unilateral neglect is consequence of damage to different brain structures, it is more common and enduring after right inferior parietal cortex lesions. Neglect patients ignore and avoid interacting with events occurring in the contralesional part of their physical and mental space. Current theories distinguish perceptual from motor components of neglect. One key feature of the latter is directional hypokinesia, an impaired representation of space for action, evident as difficulty to plan hand movements toward the contralesional part of egocentric space. An impairment of a similar nature is also observed for eye movements. In this study, we offer an interpretation of directional movement disorders of neglect from a physiological perspective, i.e. by focusing on the mechanisms underlying the representation of visuomotor space in parietal cortex.

Neural responses during interception of real and apparent circularly moving stimuli in motor cortex and area 7a

We recorded the neuronal activity in the arm area of the motor cortex and parietal area 7a of two monkeys during interception of stimuli moving in real and apparent motion. The stimulus moved along a circular path with one of five speeds (180-540 degrees/s), and was intercepted at 6 o'clock by exerting a force pulse on a semi-isometric joystick which controlled a cursor on the screen. The real stimuli were shown in adjacent positions every 16 ms, whereas in the apparent motion situation five stimuli were flashed successively at the vertices of a regular pentagon. The results showed, first, that a group of neurons in both areas above responded not only during the interception but also during a NOGO task in which the same stimuli were presented in the absence of a motor response. This finding suggests these areas are involved in both the processing of the stimulus as well as in the preparation and production of the interception movement. In addition, a group of motor cortical cells responded during the interception task but not during a center --> out task, in which the monkeys produced similar force pulses towards eight stationary targets. This group of cells may be engaged in sensorimotor transformations more specific to the interception of real and apparent moving stimuli. Finally, a multiple regression analysis revealed that the time-varying neuronal activity in area 7a and motor cortex was related to various aspects of stimulus motion and hand force in both the real and apparent motion conditions, with stimulus-related activity prevailing in area 7a and hand-related activity prevailing in motor cortex. In addition, the neural activity was selectively associated with the stimulus angle during real motion, whereas it was tightly correlated to the time-to-contact in the apparent motion condition, particularly in the motor cortex. Overall, these observations indicate that neurons in motor cortex and area 7a are processing different parameters of the stimulus depending on the kind of stimulus motion, and that this information is used in a predictive fashion in motor cortex to trigger the interception movement.

Neural responses in motor cortex and area 7a to real and apparent motion

The neural activity in area 7a and the arm area of motor cortex was recorded while real or path-guided apparent motion stimuli were presented to behaving monkeys in the absence of a motor response. A smooth stimulus motion was produced in the real motion condition, whereas in the apparent motion condition five stimuli were flashed successively at the vertices of a regular pentagon. The stimuli moved along a low contrast circular path with one of five speeds (180-540 deg/s). We found strong neural responses to real and apparent motion in area 7a and motor cortex. In the motor cortex, a substantial population of neurons showed a selective response to real moving stimuli in the absence of a motor response. This activity was modulated in some cases by the stimulus speed, and some of the neurons showed a response during a particular part of the circular trajectory of the stimulus; the preferred stimulus angular locations were evenly distributed across this neuronal ensemble. It is likely that these neural signals are continuously available to the motor cortex in order to generate responses that demand immediate action. In area 7a, two overlapping populations of neurons were observed. The first comprised cells the activity of which was tuned to the angular location of a circularly moving stimulus in the real motion condition. These cells also responded to apparent motion at high stimulus speeds. A visual receptive field analysis showed that the angular tuning in most of the area 7a neurons did not depend on the spatial location of the stimulus in relation to their receptive field. The second population was selective to apparent moving stimuli and showed a periodic entrainment of activation with the period of the inter-stimulus interval of the flashing dots. Both the angular location and the inter-stimulus interval neural signals can be used to generate precise behavioral responses towards real or apparent moving stimuli.

The eye and the hand: neural mechanisms and network models for oculomanual coordination in parietal cortex

The coordinated action of the eye and the hand is necessary for the successful performance of a large variety of motor tasks based on visual information. Although at the output level the neural control systems for the eye and the hand are largely segregated, in the parietal cortex of the macaque monkey there exist populations of neurons able to combine ocular and manual signals on the basis of their spatial congruence. An expression of this congruence is the clustering of eye- and hand-related preferred directions of these neurons into a restricted region of the workspace, defined as field of global tuning. This domain may represent a neural substrate for the early composition of commands for coordinated oculo-manual actions. Here we study two different prototypical network models integrating inputs about retinal target location, eye position and hand position. In the first one, we model the interaction of these different signals, as it occurs at the afferent level, in a feed-forward fashion. In the second model, we assume that recurrent interactions are responsible for their combination. Both models account surprisingly well for the experimentally observed global tuning fields of parietal neurons. When we compare them with the experimental findings, no significant difference emerges between the two. Experiments potentially able to discriminate between these models could be performed.

Multiple levels of representation of reaching in the parieto-frontal network

In daily life, hand and eye movements occur in different contexts. Hand movements can be made to a visual target shortly after its presentation, or after a longer delay; alternatively, they can be made to a memorized target location. In both instances, the hand can move in a visually structured scene under normal illumination, which allows visual monitoring of its trajectory, or in darkness. Across these conditions, movement can be directed to points in space already foveated, or to extrafoveal ones, thus requiring different forms of eye-hand coordination. The ability to adapt to these different contexts by providing successful answers to their demands probably resides in the high degree of flexibility of the operations that govern cognitive visuomotor behavior. The neurophysiological substrates of these processes include, among others, the context-dependent nature of neural activity, and a transitory, or task-dependent, affiliation of neurons to the assemblies underlying different forms of sensorimotor behavior. Moreover, the ability to make independent or combined eye and hand movements in the appropriate order and time sequence must reside in a process that encodes retinal-, eye- and hand-related inputs in a spatially congruent fashion. This process, in fact, requires exact knowledge of where the eye and the hand are at any given time, although we have no or little conscious experience of where they stay at any instant. How this information is reflected in the activity of cortical neurons remains a central question to understanding the mechanisms underlying the planning of eye-hand movement in the cerebral cortex. In the last 10 years, psychophysical analyses in humans, as well as neurophysiological studies in monkeys, have provided new insights on the mechanisms of different forms of oculo-manual actions. These studies have also offered preliminary hints as to the cortical substrates of eye-hand coordination. In this review, we will highlight some of the results obtained as well as some of the questions raised, focusing on the role of eye- and hand-tuning signals in cortical neural activity. This choice rests on the crucial role this information exerts in the specification of movement, and coordinate transformation.

Interception of real and apparent motion targets: psychophysics in humans and monkeys

Human subjects and monkeys intercepted real (RM) and apparent (AM) moving targets that traveled through a low contrast circular path. The subjects intercepted the targets at 6 o'clock by applying a net force pulse on a semi-isometric joystick which controlled a cursor on the screen. Eight target speeds (180-560 degrees/s) were used. The starting points of the moving target were systematically placed around the circle in order to determine the effect of the target travel time and velocity on the decision to initiate the interception movement and on the interception accuracy. It was found that the probability of interception in the first revolution varied as a function of the target travel time, which followed an S-shaped psychometric curve. The minimum processing time (MPT) was defined as the target travel that corresponded to a 75% probability of interception in the first revolution on the psychometric curve. The MPT decreased slightly as a function of target speed and was larger in AM than RM. In addition, the interception accuracy increased when the target travel time was above the MPT, and the angular error was smaller in RM than in AM. Finally, the interception movement was initiated at different target locations and time-to-contacts, depending on the target speed and the motion condition. Interestingly, similar findings were observed in human subjects and monkeys. These results suggest that the neural mechanisms engaged in extracting the visual motion information and in the implementation of the response are more efficient during RM than AM, and that such mechanisms need less processing time when the target is moving faster.

Functional organization of parietal neuronal responses to optic-flow stimuli

We analyzed the dissimilarity matrix of neuronal responses to moving visual stimuli using tree clustering and multidimensional scaling (MDS). Single-cell activity was recorded in area 7a while random dots moving coherently in eight different kinds of motion (right-, left-, up-, and downward, clockwise, counterclockwise, expansion, contraction) were presented to behaving monkeys with eyes fixated. Tree clustering analyses showed that the [rightward, leftward], [upward, downward], and [clockwise, counterclockwise]] motions were clustered in three separate branches (i.e., horizontal, vertical, and rotatory motion, respectively). In contrast, expansion was in a lone branch, whereas contraction was also separate but within a larger cluster. The distances among these clusters were then subjected to an MDS analysis to identify the dimensions underlying the tree clustering observed. This analysis revealed two major factors in operation. The first factor separated expansion from all other stimulus motions, which seems to reflect the prominence of expansion during the common activity of locomotion. In contrast, the second factor separated planar motions from motion in depth, which suggests that the latter may hold a special place in visual motion processing.

Optic ataxia as a result of the breakdown of the global tuning fields of parietal neurones

Optic ataxia is characterized by an impaired visual control of the direction of arm reaching to a visual target, accompanied by defective hand orientation and grip formation. In humans, optic ataxia is associated with lesions of the superior parietal lobule (SPL), which also affect visually guided saccades and other forms of eye-hand coordination. In the last 10 years, anatomical and physiological studies of the SPL have shed new light on the role of parietal cortex in the control of combined eye-hand movements to visual targets, and on the underlying distributed network which links parietal to frontal cortex. A main emerging functional feature of SPL neurones seems to be their capacity to combine, in a spatially congruent fashion, different directional eye- and hand-related information, that any coding scheme so far proposed, considers essential for the composition of motor commands for reaching. This integration occurs within the global tuning field of parietal neurones, is context-dependent and involves eye and hand information that shares the same directional properties. Depending on task demands, this integration of signals can result in the representation of different reference frames for coordinated eye-hand movements. The dynamic operations occurring within the global tuning fields might depend, at least in part, on the reciprocal sets of association connections linking the SPL and the premotor areas of the frontal lobe. From this picture, the SPL emerges as both a main source of visual input to the frontal cortex and a key structure for visuomotor integration based on re-entrant signalling and, therefore, as a crucial node in the visual control of movement. It is hypothesized that in parietal patients, the directional errors that characterize reaching are a consequence of the breakdown of the combination of directional eye and hand information within the global tuning fields of parietal neurones. In these patients, the spatial match among information about target location, eye and hand position, and movement direction would be prevented, so as to impair the composition of visually guided eye-hand movements. This breakdown could be dependent, at least in part, on the failure of a re-entrant frontoparietal signalling, an obvious consequence of the degeneration of the cortico-cortical systems linking parietal and frontal cortex. Cortico-cortical connections are, in fact, essential for shaping the dynamic properties of cortical neurones.

Effects of optic flow in motor cortex and area 7a

Moving visual stimuli were presented to behaving monkeys who fixated their eyes and did not move their arm. The stimuli consisted of random dots moving coherently in eight different kinds of motion (right, left, up, downward, expansion, contraction, clockwise, and counterclockwise) and were presented in 25 square patches on a liquid crystal display projection screen. Neuronal activity in the arm area of the motor cortex and area 7a was significantly influenced by the visual stimulation, as assessed using an ANOVA. The percentage of cells with a statistically significant effect of visual stimulation was 3 times greater in area 7a (370/587, 63%) than in motor cortex (148/693, 21.4%). With respect to stimulus properties, its location and kind of motion had differential effects on cell activity in the two areas. Specifically, the percentage of cells with a significant stimulus location effect was approximately 2.5 times higher in area 7a (311/370, 84%) than in motor cortex (48/148, 32.4%), whereas the percentage of cells with a significant stimulus motion effect was approximately 2 times higher in the motor cortex (79/148, 53.4%) than in area 7a (102/370, 27.6%). We also assessed the selectivity of responses to particular stimulus motions using a Poisson train analysis and determined the percentage of cells that showed activation in only one stimulus condition. This percentage was 2 times higher in the motor cortex (73.7%) than in area 7a (37.7%). Of all kinds of stimulus motion tested, responses to expanding optic flow were the strongest in both cortical areas. Finally, we compared the activation of motor cortical cells during visual stimulation to that observed during force exertion in a center --> out task. Of 514 cells analyzed for both the motor and visual tasks, 388 (75.5%) showed a significant relation to either or both tasks, as follows: 284/388 (73.2%) cells showed a significant relation only to the motor task, 27/388 (7%) cells showed a significant relation only to the visual task, whereas the remaining 77/388 (19.8%) cells showed significant relations to both tasks. Therefore a total of 361/514 (70.2%) cells were related to the motor task and 104/514 (20.2%) were related to the visual task. Finally, with respect to receptive fields (RFs), there was no clear visual receptive field structure in the motor cortical neuronal responses, in contrast to area 7a where RFs were present and could be modulated by the type of optic flow stimulus.

Eye-Hand Coordination during Reaching. I. Anatomical Relationships between Parietal and Frontal Cortex

The anatomical and physiological substrata of eye-hand coordination during reaching were studied through combined anatomical and physiological techniques. The association connections of parietal areas V6A and PEc, and those of dorso-rostral (F7) and dorso-caudal (F2) premotor cortex were studied in monkeys, after physiological characterization of the parietal regions where retrograde tracers were injected. The results show that parieto-occipital area V6A is reciprocally connected with F7, and receives a smaller projection from F2. Local parietal projections to V6A arise from areas MIP and, to a lesser extent, 7m, PEa and PEC: On the contrary, parietal area PEc is strongly and reciprocally connected with the part of F2 located close to the pre-central dimple (pre-CD). Local parietal projections to PEc come from a distributed network, including PEa, MIP, PEci and, to a lesser extent, 7m, V6A, 7a and MST. Premotor area F7 receives parietal projections mainly from 7m and V6A, and local frontal projections mainly from F2. On the contrary, premotor area F2 in the pre-CD zone receives parietal inputs from PEc and, to a lesser extent, PEci, while in the peri-arcuate zone F2 receives parietal projections from PEa and MIP. Local frontal projections to F2 pre-CD mostly stem from F4, and, to a lesser extent, from F7 and F3, and CMAd; those addressed to peri-arcuate zone of F2 arise mainly from F5 and, to a lesser extent, from F7, F4, dorsal (CMAd) and ventral (CMAv) cingulate motor areas, pre-supplementary (F6) and supplementary (F3) motor areas. The distribution of association cells in both frontal and parietal cortex was characterized through a spectral analysis that revealed an arrangement of these cells in the form of bands, composed of cell clusters, or 'columns'. The reciprocal connections linking parietal and frontal cortex might explain the presence of visually related and eye-position signals in premotor cortex, as well as the influence of information about arm position and movement direction in V6A and PEC: The association connections identified in this study might carry sensory as well motor information that presumably provides a basis for a re-entrant signaling. This might be necessary to match retinal-, eye- and hand-related information underlying eye-hand coordination during reaching.

Eye-Hand Coordination during Reaching. II. An Analysis of the Relationships between Visuomanual Signals in Parietal Cortex and Parieto-frontal Association Projections

The relationships between the distribution of visuomanual signals in parietal cortex and that of parieto-frontal projections are the subject of the present study. Single cell recording was performed in areas PEc and V6A, where different anatomical tracers were also injected. The monkeys performed a variety of behavioral tasks, aimed at studying the visual and motor properties of parietal cells, as well as the potential combination of retinal-, eye- and hand-related signals on cell activity. The activity of most cells was related to the direction of movement and the active position of the hand. Many of these reach-related cells were influenced by eye position information. Fewer cells displayed relationships to saccadic eye movements. The activity of most neurons related to a combination of both hand and eye signals. Many cells were also modulated during preparation for hand movement. Light-dark differences of activity were common and interpreted as related to the sight and monitoring of hand motion and/or position in the visual field. Most cells studied were very sensitive to moving visual stimuli and also responded to optic flow stimulation. Visual receptive fields were generally large and extended to the periphery of the visual field. For most neurons, the orientation of the preferred directions computed across different epochs and tasks conditions clustered within a limited sector of space, the field of global tuning. This can be regarded as an ideal frame to combine spatially congruent eye- and hand-related information for different forms of visuomanual behavior. All these properties were common to both PEc and V6A. Retinal, eye- and hand-related activity types, as well as parieto-frontal association cells, were distributed in a periodic fashion across the tangential domain of areas PEc and V6A. These functional and anatomical distributions were characterized and compared through a spectral and coherency analysis, which revealed the existence of a selective 'match' between activity types and parieto-frontal connections. This match depended on where each individual efferent projection was addressed. The results of the present and of the companion study can be relevant for a re-interpretation of optic ataxia as the consequence of the breakdown of the combination of retinal-, eye- and hand-related directional signals within the global tuning fields of parietal neurons.

Visual motion responses of neurons in the caudal area pe of macaque monkeys

Area PE of macaques has traditionally been considered a somatosensory association cortex. Recent studies, however, suggest that neurons of this and neighboring areas are involved in the visual control of movement, especially arm movement. We investigated the neuronal sensitivity to local visual stimuli of this region by recording neuronal activity in two behaving macaque monkeys trained in a simple visual fixation task. Recordings were performed from the dorsal surface of the caudal pole of the superior parietal lobule (SPL). Classical receptive fields (RFs) were mapped by using conventional static or moving luminous figures. We found that many neurons in this area were selectively activated by moving visual stimuli. Cell responses were tuned to the movement direction. RFs were usually large; their mean surface covered some 30 x 30 degrees of the visual field. The fovea was often included into RF, in many cases it was along a RF side. The center of RFs was mainly located in the contralateral hemifield, although RFs having the center ipsilaterally sited were also found. No evident retinotopy was found. Visual neurons were especially concentrated in a region of the SPL likely corresponding to area PEc. These results suggest that the caudal part of area PE contains neuronal populations specifically signaling local visual motion, possibly encoding the direction of moving objects. These signals might well be suited for sensorimotor integration mechanisms aimed at motor acts.

Early coding of visuomanual coordination during reaching in parietal area PEc

The parietal mechanisms of eye-hand coordination during reaching were studied by recording neural activity in area PEc while monkeys performed different tasks, aimed at assessing the influence of retinal, hand-, and eye-related signals on neural activity. The tasks used consisted of 1) reaching to foveated and 2) to extra-foveal targets, with constant eye position; and 3) saccadic eye movement toward, and holding of eye position on peripheral targets, the same as those of the reaching tasks. In all tasks, hand and/or eye movements were made from a central position to eight peripheral targets. A conventional visual fixation paradigm was used as a control task, to assess location and extent of visual receptive field of neurons. A large proportion of cells in area PEc displayed significant relationships to hand movement direction and position. Many of them were also related to the eye's position. Relationships to saccadic eye movements were found for a smaller proportion of cells. Most neurons were tuned to different combination of hand- and eye-related signals; some of them were also influenced by visual information. This combination of signals can be an expression of the early stages of the composition of motor commands for different forms of visuomotor coordination that depend on the integration of hand- and eye-related information. These results assign to area PEc, classically considered as a somatosensory association cortex, a new visuomotor role.

Early coding of reaching in the parietooccipital cortex

Neural activity was recorded in the parietooccipital cortex while monkeys performed different tasks aimed at investigating visuomotor interactions of retinal, eye, and arm-related signals on neural activity. The tasks were arm reaching 1) to foveated targets; 2) to extrafoveal targets, with constant eye position; 3) within an instructed-delayed paradigm, under both light and darkness; 4) saccadic eye movements toward, and static eye holding on peripheral targets; and 5) visual fixation and stimulation. The activity of many cells was modulated during arm reaction (68%) and movement time (58%), and during static holding of the arm in space (64%), when eye position was kept constant. Eye position influenced the activity of many cells during hand reaction (45%) and movement time (51%) and holding of hand static position (69%). Many cells (56%) were also modulated during preparation for hand movement, in the delayed reach task. Modulation was present also in the dark in 59% of cells during this epoch, 51% during reaction and movement time, and 48% during eye/hand holding on the target. Cells (50%) displaying light-dark differences of activity were considered as related to the sight and monitoring of hand motion and/or position in the visual field. Saccadic eye movements modulated a smaller percentage (25%) of cells than eye position (68%). Visual receptive fields were mapped in 44% of the cells studied. They were generally large and extended to the periphery of the tested (30 degrees ) visual field. Sixty-six percent of cells were motion sensitive. Therefore the activity of many neurons in this area reflects the combined influence of visual, eye, and arm movement-related signals. For most neurons, the orientation of the preferred directions computed across different epochs and tasks, therefore expression of all different eye- and hand-related activity types, clustered within a limited sector of space, the field of global tuning. These spatial fields might be an ideal frame to combine eye and hand signals, thanks to the congruence of their tuning properties. The relationships between cell activity and oculomotor and visuomanual behavior were task dependent. During saccades, most cells were recruited when the eye moved to a spatial location that was also target for hand movement, whereas during hand movement most cells fired depending on whether or not the animal had prior knowledge about the location of the visual targets.

Parieto-frontal coding of reaching: an integrated framework

In the last few years, anatomical and physiological studies have provided new insights into the organization of the parieto-frontal network underlying visually guided arm-reaching movements in at least three domains. (1) Network architecture. It has been shown that the different classes of neurons encoding information relevant to reaching are not confined within individual cortical areas, but are common to different areas, which are generally linked by reciprocal association connections. (2) Representation of information. There is evidence suggesting that reach-related populations of neurons do not encode relevant parameters within pure sensory or motor "reference frames", but rather combine them within hybrid dimensions. (3) Visuomotor transformation. It has been proposed that the computation of motor commands for reaching occurs as a simultaneous recruitment of discrete populations of neurons sharing similar properties in different cortical areas, rather than as a serial process from vision to movement, engaging different areas at different times. The goal of this paper was to link experimental (neurophysiological and neuroanatomical) and computational aspects within an integrated framework to illustrate how different neuronal populations in the parieto-frontal network operate a collective and distributed computation for reaching. In this framework, all dynamic (tuning, combinatorial, computational) properties of units are determined by their location relative to three main functional axes of the network, the visual-to-somatic, position-direction, and sensory-motor axis. The visual-to-somatic axis is defined by gradients of activity symmetrical to the central sulcus and distributed over both frontal and parietal cortices. At least four sets of reach-related signals (retinal, gaze, arm position/movement direction, muscle output) are represented along this axis. This architecture defines informational domains where neurons combine different inputs. The position-direction axis is identified by the regular distribution of information over large populations of neurons processing both positional and directional signals (concerning the arm, gaze, visual stimuli, etc.) Therefore, the activity of gaze- and arm-related neurons can represent virtual three-dimensional (3D) pathways for gaze shifts or hand movement. Virtual 3D pathways are thus defined by a combination of directional and positional information. The sensory-motor axis is defined by neurons displaying different temporal relationships with the different reach-related signals, such as target presentation, preparation for intended arm movement, onset of movements, etc. These properties reflect the computation performed by local networks, which are formed by two types of processing units: matching and condition units. Matching units relate different neural representations of virtual 3D pathways for gaze or hand, and can predict motor commands and their sensory consequences. Depending on the units involved, different matching operations can be learned in the network, resulting in the acquisition of different visuo-motor transformations, such as those underlying reaching to foveated targets, reaching to extrafoveal targets, and visual tracking of hand movement trajectory. Condition units link these matching operations to reinforcement contingencies and therefore can shape the collective neural recruitment along the three axes of the network. This will result in a progressive match of retinal, gaze, arm, and muscle signals suitable for moving the hand toward the target.

Visual control of hand-reaching movement: activity in parietal area 7m

The activity of single neurons was studied in parietal area 7m while monkeys performed an instructed-delay reaching task to visual targets under normal light conditions and in darkness. The task was aimed at assessing the influence of vision of hand position on the neural activity of 7m related either to static posture and movement of the hand or to eye position in the orbit. The results show the existence of preparatory, movement-related and postural activity for the control of reaching, all of which are strongly modulated by vision. The activity of many 7m neurons, otherwise insensitive to pure visual stimuli, seems to reflect complex interactions between gaze angle and hand position in the visual field.

Combination of hand and gaze signals during reaching: activity in parietal area 7 m of the monkey

The role of area 7 m has been studied by recording the activity of single neurons of monkeys trained to fixate and reach toward peripheral targets. The target was randomly selected from eight possible locations on a virtual circle, of radius 30 degrees visual angle from a central target. Three tasks were employed to dissociate hand- from eye-related contributions. In the first task, animals looked and reached to the peripheral target. In a second task, the animal reached to the peripheral target while maintaining fixation on the central target. In the third task, the monkey maintained fixation on peripheral targets that were spatially coincident with those of the reaching tasks. The results show that cell activity in area 7 m relates, for some cells to eye position, for others to hand position and movement, and for the majority of cells to a combination of visuomanual and oculomotor information. This area, therefore, seems to perform an early combination of information in the processing leading from target localization to movement generation.