Effector specificity in macaque frontal and parietal cortex

Embodying Time in the Brain: A Multi-Dimensional Neuroimaging Meta-Analysis of 95 Duration Processing Studies

Time is an omnipresent aspect of almost everything we experience internally or in the external world. The experience of time occurs through such an extensive set of contextual factors that, after decades of research, a unified understanding of its neural substrates is still elusive. In this study, following the recent best-practice guidelines, we conducted a coordinate-based meta-analysis of 95 carefully-selected neuroimaging papers of duration processing. We categorized the included papers into 14 classes of temporal features according to six categorical dimensions. Then, using the activation likelihood estimation (ALE) technique we investigated the convergent activation patterns of each class with a cluster-level family-wise error correction at p < 0.05. The regions most consistently activated across the various timing contexts were the pre-SMA and bilateral insula, consistent with an embodied theory of timing in which abstract representations of duration are rooted in sensorimotor and interoceptive experience, respectively. Moreover, class-specific patterns of activation could be roughly divided according to whether participants were timing auditory sequential stimuli, which additionally activated the dorsal striatum and SMA-proper, or visual single interval stimuli, which additionally activated the right middle frontal and inferior parietal cortices. We conclude that temporal cognition is so entangled with our everyday experience that timing stereotypically common combinations of stimulus characteristics reactivates the sensorimotor systems with which they were first experienced.

Spike rates of frontal eye field neurons predict reaction times in a spatial attention task

Which neuronal signal(s) predict reaction times when subjects respond to a target at covertly attended locations? Although recent studies showed that spike rates are not predictive, it remains a highly contested question. Therefore, we record single-unit activity from frontal eye field (FEF) neurons while macaques are performing a covert spatial attention task. We find that the attentional modulation of spike rates of FEF neurons is strongly correlated with behavioral reaction times. Moreover, this correlation already emerges 1 s before target dimming, which triggers the behavioral responses. This prediction of reaction times by spike rates is found in neurons showing attention-dependent enhanced and suppressed activity for targets and distractors, respectively, yet in varying degrees across subjects. Thus, spike rates of FEF neurons can predict reaction times persistently and well before the operant behavior during selective attention tasks. Such long prediction windows will be useful for developing spike-based brain-machine interfaces.

Attention control in the primate brain

Attention is fundamental to all cognition. In the primate brain, it is implemented by a large-scale network that consists of areas spanning across all major lobes, also including subcortical regions. Classical attention accounts assume that control over the selection process in this network is exerted by 'top-down' mechanisms in the fronto-parietal cortex that influence sensory representations via feedback signals. More recent studies have expanded this view of attentional control. In this review, we will start from a traditional top-down account of attention control, and then discuss more recent findings on feature-based attention, thalamic influences, temporal network dynamics, and behavioral dynamics that collectively lead to substantial modifications. We outline how the different emerging accounts can be reconciled and integrated into a unified theory.

Modelling behaviors relevant to brain disorders in the nonhuman primate: Are we there yet?

Recent years have seen a profound resurgence of activity with nonhuman primates (NHPs) to model human brain disorders. From marmosets to macaques, the study of NHP species offers a unique window into the function of primate-specific neural circuits that are impossible to examine in other models. Examining how these circuits manifest into the complex behaviors of primates, such as advanced cognitive and social functions, has provided enormous insights to date into the mechanisms underlying symptoms of numerous neurological and neuropsychiatric illnesses. With the recent optimization of modern techniques to manipulate and measure neural activity in vivo, such as optogenetics and calcium imaging, NHP research is more well-equipped than ever to probe the neural mechanisms underlying pathological behavior. However, methods for behavioral experimentation and analysis in NHPs have noticeably failed to keep pace with these advances. As behavior ultimately lies at the junction between preclinical findings and its translation to clinical outcomes for brain disorders, approaches to improve the integrity, reproducibility, and translatability of behavioral experiments in NHPs requires critical evaluation. In this review, we provide a unifying account of existing brain disorder models using NHPs, and provide insights into the present and emerging contributions of behavioral studies to the field.

Temporal dynamics of neural activity in macaque frontal cortex assessed with large-scale recordings

The cortical network controlling the arm and hand when grasping objects consists of several areas in parietal and frontal cortex. Recently, more anterior prefrontal areas have also been implicated in object grasping, but their exact role is currently unclear. To investigate the neuronal encoding of objects during grasping in these prefrontal regions and their relation with other cortical areas of the grasping network, we performed large-scale recordings (more than 2000 responsive sites) in frontal cortex of monkeys during a saccade-reach-grasp task. When an object appeared in peripheral vision, the first burst of activity emerged in prearcuate areas (the FEF and area 45B), followed by dorsal and ventral premotor cortex, and a buildup of activity in primary motor cortex. After the saccade, prearcuate activity remained elevated while primary motor and premotor activity rose in anticipation of the upcoming arm and hand movement. Remarkably, a large number of premotor and prearcuate sites responded when the object appeared in peripheral vision and remained active when the object came into foveal vision. Thus, prearcuate and premotor areas continuously encode object information when directing gaze and grasping objects.

Comparative anatomy of the macaque and the human frontal oculomotor domain

In non-human primates, at the junction of the prefrontal with the premotor cortex, there is a sector designated as frontal eye field (FEF), involved in controlling oculomotor behavior and spatial attention. Evidence for at least two FEFs in humans is at the basis of the still open issue of the possible homologies between the macaque and the human frontal oculomotor system. In this review article we address this issue suggesting a new view solidly grounded on evidence from the last decade showing that, in macaques, the FEF is at the core of an oculomotor domain in which several distinct areas, including areas 45A and 45B, provide the substrate for parallel processing of different aspects of oculomotor behavior. Based on comparative considerations, we will propose a correspondence between some of the macaque and the human oculomotor fields, thus suggesting sharing of neural substrate for oculomotor control, gaze processing, and orienting attention in space. Accordingly, this article could contribute to settle some aspects of the so-called "enigma" of the human FEF anatomy.

Mechanistic determinants of effector-independent motor memory encoding

Coordinated, purposeful movements learned with one effector generalize to another effector, a finding that has important implications for tool use, sports, performing arts, and rehabilitation. This occurs because the motor memory acquired through learning comprises representations that are effector-independent. Despite knowing this for decades, the neural mechanisms and substrates that are causally associated with the encoding of effector-independent motor memories remain poorly understood. Here we exploit intereffector generalization, the behavioral signature of effector-independent representations, to address this crucial gap. We first show in healthy human participants that postlearning generalization across effectors is principally predicted by the level of an implicit mechanism that evolves gradually during learning to produce a temporally stable memory. We then demonstrate that interfering with left but not right posterior parietal cortex (PPC) using high-definition cathodal transcranial direct current stimulation impedes learning mediated by this mechanism, thus potentially preventing the encoding of effector-independent memory components. We confirm this in our final experiment in which we show that disrupting left PPC but not primary motor cortex after learning has been allowed to occur blocks intereffector generalization. Collectively, our results reveal the key mechanism that encodes an effector-independent memory trace and uncover a central role for the PPC in its representation. The encoding of such motor memory components outside primary sensorimotor regions likely underlies a parsimonious neural organization that enables more efficient movement planning in the brain, independent of the effector used to act.

Rapid event-related, BOLD fMRI, non-human primates (NHP): choose two out of three

Human functional magnetic resonance imaging (fMRI) typically employs the blood-oxygen-level-dependent (BOLD) contrast mechanism. In non-human primates (NHP), contrast enhancement is possible using monocrystalline iron-oxide nanoparticles (MION) contrast agent, which has a more temporally extended response function. However, using BOLD fMRI in NHP is desirable for interspecies comparison, and the BOLD signal’s faster response function promises to be beneficial for rapid event-related (rER) designs. Here, we used rER BOLD fMRI in macaque monkeys while viewing real-world images, and found visual responses and category selectivity consistent with previous studies. However, activity estimates were very noisy, suggesting that the lower contrast-to-noise ratio of BOLD, suboptimal behavioural performance, and motion artefacts, in combination, render rER BOLD fMRI challenging in NHP. Previous studies have shown that rER fMRI is possible in macaques with MION, despite MION’s prolonged response function. To understand this, we conducted simulations of the BOLD and MION response during rER, and found that no matter how fast the design, the greater amplitude of the MION response outweighs the contrast loss caused by greater temporal smoothing. We conclude that although any two of the three elements (rER, BOLD, NHP) have been shown to work well, the combination of all three is particularly challenging.

Functional Similarity of Medial Superior Parietal Areas for Shift-Selective Attention Signals in Humans and Monkeys

We continually shift our attention between items in the visual environment. These attention shifts are usually based on task relevance (top-down) or the saliency of a sudden, unexpected stimulus (bottom-up), and are typically followed by goal-directed actions. It could be argued that any species that can covertly shift its focus of attention will rely on similar, evolutionarily conserved neural substrates for processing such shift-signals. To address this possibility, we performed comparative fMRI experiments in humans and monkeys, combining traditional, and novel, data-driven analytical approaches. Specifically, we examined correspondences between monkey and human brain areas activated during covert attention shifts. When "shift" events were compared with "stay" events, the medial (superior) parietal lobe (mSPL) and inferior parietal lobes showed similar shift sensitivities across species, whereas frontal activations were stronger in monkeys. To identify, in a data-driven manner, monkey regions that corresponded with human shift-selective SPL, we used a novel interspecies beta-correlation strategy whereby task-related beta-values were correlated across voxels or regions-of-interest in the 2 species. Monkey medial parietal areas V6/V6A most consistently correlated with shift-selective human mSPL. Our results indicate that both species recruit corresponding, evolutionarily conserved regions within the medial superior parietal lobe for shifting spatial attention.

Functional MRI in Macaque Monkeys during Task Switching

Nonhuman primates have proven to be a valuable animal model for exploring neuronal mechanisms of cognitive control. One important aspect of executive control is the ability to switch from one task to another, and task-switching paradigms have often been used in human volunteers to uncover the underlying neuronal processes. To date, however, no study has investigated task-switching paradigms in nonhuman primates during functional magnetic resonance imaging (fMRI). We trained two rhesus macaques to switch between arm movement, eye movement, and passive fixation tasks during fMRI. Similar to results obtained in human volunteers, task switching elicits increased fMRI activations in prefrontal cortex, anterior cingulate cortex, orbitofrontal cortex, and caudate nucleus. Our results indicate that the macaque monkey is a reliable model with which to investigate higher-order cognitive functioning such as task switching. As such, these results can pave the way for a detailed investigation of the neural basis of complex human behavior.SIGNIFICANCE STATEMENT Task switching is an important aspect of cognitive control, and task-switching paradigms have often been used to investigate higher-order executive functioning in human volunteers. We used a task-switching paradigm in the nonhuman primate during fMRI and found increased activation mainly in prefrontal areas (46, 45, frontal eye field, and anterior cingulate), in orbitofrontal area 12, and in the caudate nucleus. These data fit surprisingly well with previous human imaging data, proving that the monkey is an excellent model to study task switching with high spatiotemporal resolution tools that are currently not applicable in humans. As such, our results pave the way for a detailed interrogation of regions performing similar executive functions in humans and monkeys.

Spatial eye-hand coordination during bimanual reaching is not systematically coded in either LIP or PRR

When we reach for something, we also look at it. If we reach for two objects at once, one with each hand, we look first at one and then the other. It is not known which brain areas underlie this coordination. We studied two parietal areas known to be involved in eye and arm movements. Neither area was sensitive to the order in which the targets were looked at. This implies that coordinated saccades are driven by downstream areas and not by the parietal cortex as is commonly assumed.

We often orient to where we are about to reach. Spatial and temporal correlations in eye and arm movements may depend on the posterior parietal cortex (PPC). Spatial representations of saccade and reach goals preferentially activate cells in the lateral intraparietal area (LIP) and the parietal reach region (PRR), respectively. With unimanual reaches, eye and arm movement patterns are highly stereotyped. This makes it difficult to study the neural circuits involved in coordination. Here, we employ bimanual reaching to two different targets. Animals naturally make a saccade first to one target and then the other, resulting in different patterns of limb–gaze coordination on different trials. Remarkably, neither LIP nor PRR cells code which target the eyes will move to first. These results suggest that the parietal cortex plays at best only a permissive role in some aspects of eye–hand coordination and makes the role of LIP in saccade generation unclear.

Task-Relevant Information Modulates Primary Motor Cortex Activity Before Movement Onset

Monkey neurophysiology research supports the affordance competition hypothesis (ACH) proposing that cognitive information useful for action selection is integrated in sensorimotor areas. In this view, action selection would emerge from the simultaneous representation of competing action plans, in parallel biased by relevant task factors. This biased competition would take place up to primary motor cortex (M1). Although ACH is plausible in environments affording choices between actions, its relevance for human decision making is less clear. To address this issue, we designed an functional magnetic resonance imaging (fMRI) experiment modeled after monkey neurophysiology studies in which human participants processed cues conveying predictive information about upcoming button presses. Our results demonstrate that, as predicted by the ACH, predictive information (i.e., the relevant task factor) biases activity of primary motor regions. Specifically, first, activity before movement onset in contralateral M1 increases as the competition is biased in favor of a specific button press relative to activity in ipsilateral M1. Second, motor regions were more tightly coupled with fronto-parietal regions when competition between potential actions was high, again suggesting that motor regions are also part of the biased competition network. Our findings support the idea that action planning dynamics as proposed in the ACH are valid both in human and non-human primates.

The dorsal "action" pathway

In 1992, Goodale and Milner proposed a division of labor in the visual pathways of the primate cerebral cortex. According to their account, the ventral pathway, which projects to occipitotemporal cortex, constructs our visual percepts, while the dorsal pathway, which projects to posterior parietal cortex, mediates the visual control of action. Although the framing of the two-visual-system hypothesis has not been without controversy, it is clear that vision for action and vision for perception have distinct computational requirements, and significant support for the proposed neuroanatomic division has continued to emerge over the last two decades from human neuropsychology, neuroimaging, behavioral psychophysics, and monkey neurophysiology. In this chapter, we review much of this evidence, with a particular focus on recent findings from human neuroimaging and monkey neurophysiology, demonstrating a specialized role for parietal cortex in visually guided behavior. But even though the available evidence suggests that dedicated circuits mediate action and perception, in order to produce adaptive goal-directed behavior there must be a close coupling and seamless integration of information processing across these two systems. We discuss such ventral-dorsal-stream interactions and argue that the two pathways play different, yet complementary, roles in the production of skilled behavior.

Action Categorization in Rhesus Monkeys: discrimination of grasping from non-grasping manual motor acts

The ability to recognize others’ actions is an important aspect of social behavior. While neurophysiological and behavioral research in monkeys has offered a better understanding of how the primate brain processes this type of information, further insight with respect to the neural correlates of action recognition requires tasks that allow recording of brain activity or perturbing brain regions while monkeys simultaneously make behavioral judgements about certain aspects of observed actions. Here we investigated whether rhesus monkeys could actively discriminate videos showing grasping or non-grasping manual motor acts in a two-alternative categorization task. After monkeys became proficient in this task, we tested their ability to generalize to a number of untrained, novel videos depicting grasps or other manual motor acts. Monkeys generalized to a wide range of novel human or conspecific grasping and non-grasping motor acts. They failed, however, for videos showing unfamiliar actions such as a non-biological effector performing a grasp, or a human hand touching an object with the back of the hand. This study shows the feasibility of training monkeys to perform active judgements about certain aspects of observed actions, instrumental for causal investigations into the neural correlates of action recognition.

Observing Others Speak or Sing Activates Spt and Neighboring Parietal Cortex

To obtain further evidence that action observation can serve as a proxy for action execution and planning in posterior parietal cortex, we scanned participants while they were (1) observing two classes of action: vocal communication and oral manipulation, which share the same effector but differ in nature, and (2) rehearsing and listening to nonsense sentences to localize area Spt, thought to be involved in audio-motor transformation during speech. Using this localizer, we found that Spt is specifically activated by vocal communication, indicating that Spt is not only involved in planning speech but also in observing vocal communication actions. In addition, we observed that Spt is distinct from the parietal region most specialized for observing vocal communication, revealed by an interaction contrast and located in PFm. The latter region, unlike Spt, processes the visual and auditory signals related to other's vocal communication independently. Our findings are consistent with the view that several small regions in the temporoparietal cortex near the ventral part of the supramarginal/angular gyrus border are involved in the planning of vocal communication actions and are also concerned with observation of these actions, though involvements in those two aspects are unequal.

Computational Architecture of the Parieto-Frontal Network Underlying Cognitive-Motor Control in Monkeys

The statistical structure of intrinsic parietal and parieto-frontal connectivity in monkeys was studied through hierarchical cluster analysis. Based on their inputs, parietal and frontal areas were grouped into different clusters, including a variable number of areas that in most instances occupied contiguous architectonic fields. Connectivity tended to be stronger locally: that is, within areas of the same cluster. Distant frontal and parietal areas were targeted through connections that in most instances were reciprocal and often of different strength. These connections linked parietal and frontal clusters formed by areas sharing basic functional properties. This led to five different medio-laterally oriented pillar domains spanning the entire extent of the parieto-frontal system, in the posterior parietal, anterior parietal, cingulate, frontal, and prefrontal cortex. Different information processing streams could be identified thanks to inter-domain connectivity. These streams encode fast hand reaching and its control, complex visuomotor action spaces, hand grasping, action/intention recognition, oculomotor intention and visual attention, behavioral goals and strategies, and reward and decision value outcome. Most of these streams converge on the cingulate domain, the main hub of the system. All of them are embedded within a larger eye–hand coordination network, from which they can be selectively set in motion by task demands.

Functional interactions between the macaque dorsal and ventral visual pathways during three-dimensional object vision

The division of labor between the dorsal and the ventral visual stream in the primate brain has inspired numerous studies on the visual system in humans and in nonhuman primates. However, how and under which circumstances the two visual streams interact is still poorly understood. Here we review evidence from anatomy, modelling, electrophysiology, electrical microstimulation (EM), reversible inactivation and functional imaging in the macaque monkey aimed at clarifying at which levels in the hierarchy of visual areas the two streams interact, and what type of information might be exchanged between the two streams during three-dimensional (3D) object viewing. Neurons in both streams encode 3D structure from binocular disparity, synchronized activity between parietal and inferotemporal areas is present during 3D structure categorization, and clusters of 3D structure-selective neurons in parietal cortex are anatomically connected to ventral stream areas. In addition, caudal intraparietal cortex exerts a causal influence on 3D-structure related activations in more anterior parietal cortex and in inferotemporal cortex. Thus, both anatomical and functional evidence indicates that the dorsal and the ventral visual stream interact during 3D object viewing.

Functional versus effector-specific organization of the human posterior parietal cortex: revisited

In the present study, we show that regions in posterior parietal regions process information independent of the currently used effector (hand, foot, or eye) during goal-directed actions. Functional MRI repetition suppression analysis suggests that generality across effectors holds also on the neuronal level and not just at the level of entire regions. More anterior parietal regions process information only for a specific effector or a subset of effectors.

It has been proposed that the posterior parietal cortex (PPC) is characterized by an effector-specific organization. However, strikingly similar functional MRI (fMRI) activation patterns have been found in the PPC for hand and foot movements. Because the fMRI signal is related to average neuronal activity, similar activation levels may result either from effector-unspecific neurons or from intermingled subsets of effector-specific neurons within a voxel. We distinguished between these possibilities using fMRI repetition suppression (RS). Participants made delayed, goal-directed eye, hand, and foot movements to visual targets. In each trial, the instructed effector was identical or different to that of the previous trial. RS effects indicated an attenuation of the fMRI signal in repeat trials. The caudal PPC was active during the delay but did not show RS, suggesting that its planning activity was effector independent. Hand and foot-specific RS effects were evident in the anterior superior parietal lobule (SPL), extending to the premotor cortex, with limb overlap in the anterior SPL. Connectivity analysis suggested information flow between the caudal PPC to limb-specific anterior SPL regions and between the limb-unspecific anterior SPL toward limb-specific motor regions. These results underline that both function and effector specificity should be integrated into a concept of PPC action representation not only on a regional but also on a fine-grained, subvoxel level.

Posterior Parietal Cortex Drives Inferotemporal Activations During Three-Dimensional Object Vision

The primate visual system consists of a ventral stream, specialized for object recognition, and a dorsal visual stream, which is crucial for spatial vision and actions. However, little is known about the interactions and information flow between these two streams. We investigated these interactions within the network processing three-dimensional (3D) object information, comprising both the dorsal and ventral stream. Reversible inactivation of the macaque caudal intraparietal area (CIP) during functional magnetic resonance imaging (fMRI) reduced fMRI activations in posterior parietal cortex in the dorsal stream and, surprisingly, also in the inferotemporal cortex (ITC) in the ventral visual stream. Moreover, CIP inactivation caused a perceptual deficit in a depth-structure categorization task. CIP-microstimulation during fMRI further suggests that CIP projects via posterior parietal areas to the ITC in the ventral stream. To our knowledge, these results provide the first causal evidence for the flow of visual 3D information from the dorsal stream to the ventral stream, and identify CIP as a key area for depth-structure processing. Thus, combining reversible inactivation and electrical microstimulation during fMRI provides a detailed view of the functional interactions between the two visual processing streams.

From Behavior to Neural Dynamics: An Integrated Theory of Attention

The brain has a limited capacity and therefore needs mechanisms to selectively enhance the information most relevant to one's current behavior. We refer to these mechanisms as "attention." Attention acts by increasing the strength of selected neural representations and preferentially routing them through the brain's large-scale network. This is a critical component of cognition and therefore has been a central topic in cognitive neuroscience. Here we review a diverse literature that has studied attention at the level of behavior, networks, circuits, and neurons. We then integrate these disparate results into a unified theory of attention.

Covert shifts of spatial attention in the macaque monkey

In the awake state, shifts of spatial attention alternate with periods of sustained attention at a fixed location or object. Human fMRI experiments revealed the critical role of the superior parietal lobule (SPL) in shifting spatial attention, a finding not predicted by human lesion studies and monkey electrophysiology. To investigate whether a potential homolog of the human SPL shifting region exists in monkeys (Macaca mulatta), we adopted an event-related fMRI paradigm that closely resembled a human experiment (Molenberghs et al., 2007). In this paradigm, a pair of relevant and irrelevant shapes was continuously present on the horizontal meridian. Subjects had to covertly detect a dimming of the relevant shape while ignoring the irrelevant dimmings. The events of interest consisted of the replacement of one stimulus pair by the next. During shift but not stay events, the relevant shape of the new pair appeared at the contralateral position relative to the previous one. Spatial shifting events activated parietal areas V6/V6A and medial intraparietal area, caudo-dorsal visual areas, the most posterior portion of the superior temporal sulcus, and several smaller frontal areas. These areas were not activated during passive stimulation with the same sensory stimuli. During stay events, strong direction-sensitive attention signals were observed in a distributed set of contralateral visual, temporal, parietal, and lateral prefrontal areas, the vast majority overlapping with the sensory stimulus representation. We suggest medial intraparietal area and V6/V6A as functional counterparts of human SPL because they contained the most widespread shift signals in the absence of contralateral stay activity, resembling the functional characteristics of the human SPL shifting area.