Neurons in the Rostral Cingulate Motor Area Monitor Multiple Phases of Visuomotor Behavior With Modest Parametric Selectivity

Check or Go? Impact of Doubt on the Hierarchical Organization of the Mediofrontal Area

BACKGROUND

Based on numerous imaging and electrophysiological studies, the presupplementary motor area (pre-SMA) and the rostral cingulate motor area are cortical regions considered to be essential to voluntary movement initiation and behavioral control. However, their respective roles and functional interactions remain a long-standing and still debated question.

METHODS

Here, we trained 2 rhesus monkeys (Macaca mulatta) in a complex cognitive task to compare the neuronal activity of these 2 regions on the medial wall during both perceptual and internally guided decisions.

RESULTS

We confirmed the implication of both areas throughout the decision process. Critically, we demonstrate that instead of a stable invariant role, the pre-SMA and rostral cingulate motor area manifested a versatile hierarchical relationship depending on the mode of movement initiation. Whereas pre-SMA neurons were primarily engaged in decisions based on perceptual information, rostral cingulate motor area neurons preempted the decision process in case of an internally doubt-driven checking behavior, withholding pre-SMA recruitment during the time spent inhibiting the habitual action.

CONCLUSIONS

We identified a versatile hierarchical organization of the mediofrontal area that may substantially affect normal and pathological decision processes because adaptive behaviors, such as doubt-checking and its compulsive counterpart, rely on this subtle equilibrium in controlling action initiation.

The anterior midcingulate cortex might be a neuronal substrate for the ideomotor mechanism

The way the brain controls voluntary movements for normal and pathological subject remains puzzling. In this selective review, we provide unreported harmonies between the anterior midcingulate cortex (aMCC) activities and the ideomotor mechanism postulating that voluntary movements are controlled by the anticipation of the expected perceptual consequences of an action, critically involving bidirectional interplay of a given motor activity and corresponding sensory feedback. Among other evidence, we found that the required asymmetry in the bidirectional interplay between a given motor command and its expected sensory effect could rely on the specific activity of aMCC neurons when observing errors and successes. We confirm this hypothesis by presenting a pathological perspective, studying obsessive-compulsive and other related disorders in which hyperactivated and uniform aMCC activities should lead to a circular-reflex process that results in persistent ideas and repeated actions. By evaluating normal and pathological data, we propose considering the aMCC at a central position within the cerebral network involved in the ideomotor mechanism.

Human midcingulate cortex encodes distributed representations of task progress

The function of midcingulate cortex (MCC) remains elusive despite decades of investigation and debate. Complicating matters, individual MCC neurons respond to highly diverse task-related events, and MCC activation is reported in most human neuroimaging studies employing a wide variety of task manipulations. Here we investigate this issue by applying a model-based cognitive neuroscience approach involving neural network simulations, functional magnetic resonance imaging, and representational similarity analysis. We demonstrate that human MCC encodes distributed, dynamically evolving representations of extended, goal-directed action sequences. These representations are uniquely sensitive to the stage and identity of each sequence, indicating that MCC sustains contextual information necessary for discriminating between task states. These results suggest that standard univariate approaches for analyzing MCC function overlook the major portion of task-related information encoded by this brain area and point to promising new avenues for investigation.

Multisynaptic Projections from the Amygdala to the Ventral Premotor Cortex in Macaque Monkeys: Anatomical Substrate for Feeding Behavior

The amygdala codes the visual-gustatory/somatosensory valence for feeding behavior. On the other hand, the ventral premotor cortex (PMv) plays a central role in reaching and grasping movements prerequisite for feeding behavior. This implies that object valence signals derived from the amygdala may be crucial for feeding-related motor actions exerted by PMv. However, since no direct connectivity between the amygdala and PMv has been reported, the structural basis of their functional interactions still remains elusive. In the present study, we employed retrograde transneuronal labeling with rabies virus to identify the amygdalar origin and possible route of multisynaptic projections to PMv in macaque monkeys. Histological analysis of the distribution pattern of labeled neurons has found that PMv receives disynaptic input primarily from the basal nucleus, especially from its intermediate subdivision. It has also been revealed that the medial (e.g., the cingulate motor areas, CMA) and lateral (e.g., the insular cortices) cortical areas, and the cholinergic cell group 4 in the basal forebrain probably mediate the projections from the amygdala to PMv. Such multisynaptic pathways might represent amygdalar influences on PMv functions for feeding behavior.

Pregenual Anterior Cingulate Gyrus Involvement in Spontaneous Social Interactions in Primates-Evidence from Behavioral, Pharmacological, Neuropsychiatric, and Neurophysiological Findings

The anterior cingulate cortex (ACC) has been implicated in different aspects of cognition and decision making, including social cognition. Several studies suggest that this region is actually formed by sub-regions concerned with distinct cognitive functions. The ACC is usually divided in its rostro-caudal axis, with the caudal ACC playing a major role in processing own actions, and the rostral ACC being related to social cognition. Recently, it has been suggested that the ACC can also be functionally divided in its dorso-ventral axis into ACC gyrus (ACCg) and ACC sulcus (ACCs), with the ACCg having a central role in processing social information. In this context, we propose that the pregenual ACCg might be especially important for engaging in social interactions. We discuss previous findings that support this hypothesis and present evidence suggesting that the activity of pregenual ACCg neurons is modulated during spontaneous social interactions.

Rostrocaudal functional gradient among the pre-dorsal premotor cortex, dorsal premotor cortex and primary motor cortex in goal-directed motor behaviour

The dorsal premotor cortex residing in the dorsolateral aspect of area 6 is a rostrocaudally elongated area that is rostral to the primary motor cortex (M1) and caudal to the prefrontal cortex. This region, which is subdivided into rostral [pre-dorsal premotor cortex (pre-PMd)] and caudal [dorsal premotor cortex proper (PMd)] components, probably plays a central role in planning and executing actions to achieve a behavioural goal. In the present study, we investigated the functional specializations of the pre-PMd, PMd, and M1, because the synthesis of the specific functions performed by each area is considered to be essential. Neurons were recorded while monkeys performed a conditional visuo-goal task designed to include separate processes for determining a behavioural goal (reaching towards a right or left potential target) on the basis of visual object instructions, specifying actions (direction of reaching) to be performed on the basis of the goal, and preparing and executing the action. Neurons in the pre-PMd and PMd retrieved and maintained behavioural goals without encoding the visual features of the visual object instructions, and subsequently specified the actions by multiplexing the goals with the locations of the targets. Furthermore, PMd and M1 neurons played a major role in representing the action during movement preparation and execution, whereas the contribution of the pre-PMd progressively decreased as the time of the actual execution of the movement approached. These findings revealed that the multiple processing stages necessary for the realization of an action to accomplish a goal were implemented in an area-specific manner across a functional gradient from the pre-PMd to M1 that included the PMd as an intermediary.

Dorsal Anterior Cingulate Cortex: A Bottom-Up View

The dorsal anterior cingulate cortex (dACC) has attracted great interest from neuroscientists because it is associated with so many important cognitive functions. Despite, or perhaps because of, its rich functional repertoire, we lack a single comprehensive view of its function. Most research has approached this puzzle from the top down, using aggregate measures such as neuroimaging. We provide a view from the bottom up, with a focus on single-unit responses and anatomy. We summarize the strengths and weaknesses of the three major approaches to characterizing the dACC: as a monitor, as a controller, and as an economic structure. We argue that neurons in the dACC are specialized for representing contexts, or task-state variables relevant for behavior, and strategies, or aspects of future plans. We propose that dACC neurons link contexts with strategies by integrating diverse task-relevant information to create a rich representation of task space and exert high-level and abstract control over decision and action.

Area- and band-specific representations of hand movements by local field potentials in caudal cingulate motor area and supplementary motor area of monkeys

The caudal cingulate motor area (CMAc) and the supplementary motor area (SMA) play important roles in movement execution. The present study examined the neural mechanisms underlying these roles by investigating local field potentials (LFPs) from these areas while monkeys pressed buttons with either their left or right hand. During hand movement, power increases in the high-gamma (80-120 Hz) and theta (3-8 Hz) bands and a power decrease in the beta (12-30 Hz) band were observed in both the CMAc and SMA. High-gamma and beta activity in the SMA predominantly represented contralateral hand movements, whereas activity in the CMAc preferentially represented movement of either hand. Theta activity in both brain regions most frequently reflected movement of either hand, but a contralateral hand bias was more evident in the SMA than in the CMAc. An analysis of the relationships of the laterality representations between the high-gamma and theta bands at each recording site revealed that, irrespective of the hand preference for the theta band, the high-gamma band in the SMA preferentially represented contralateral hand movement, whereas the high-gamma band in the CMAc represented movement of either hand. These findings suggest that the input-output relationships for ipsilateral and contralateral hand movements in the CMAc and SMA differ in terms of their functionality. The CMAc may transform the input signals representing general aspects of movement into commands to perform movements with either hand, whereas the SMA may transform the input signals into commands to perform movement with the contralateral hand.

Breakdown of Sensorimotor Network Communication in Leukoaraiosis

BACKGROUND

Leukoaraiosis (LA) patients may suffer from sensorimotor dysfunctions. The relationship between behavioral disturbances and changes in the sensorimotor network (SMN) has not been thoroughly elucidated.

OBJECTIVE

This study investigated the hypothesized breakdown of communication of SMN and its behavioral consequences in LA.

METHODS

Fluid-attenuated inversion recovery (FLAIR) images, resting-state functional magnetic resonance images (fMRI) and behavioral data were collected from 30 LA patients and 26 healthy individuals (normal controls, NC). The subjects were grouped according to LA severity, as indicated by their FLAIR images. Group independent component analysis was applied to the fMRI data to map the functional connectivity of SMN for NC and LA patients. A whole-brain, voxel-wise analysis was employed to investigate the functional connectivity alteration of SMN in LA. The relationships between LA severity, functional connectivity alteration of the SMN and behavioral clinical symptoms were examined by correlation analysis.

RESULTS

The right cingulate motor area (rCMA), left posterior insula and left ventral premotor area showed attenuated functional connectivity in the LA patients. The extent of the attenuation was related to the severity of the disease. Furthermore, the attenuation in the rCMA was associated with worse sensorimotor integration performance.

CONCLUSIONS

These results suggest that LA impairs sensorimotor integration by interfering with the communication or coordination of these aforementioned regions related to the SMN.

Neural activity in monkey amygdala during performance of a multisensory operant task

In this paper, we study the potential involvement of monkey amygdala in the evaluation of value encoding of visual and auditive stimuli associated with reward or no reward. We recorded the activity of 93 extracellular neurons from the monkey right amygdala, while performing a multisensory operant task. The activity of 78 task-related neurons was studied. Of these, 13 neurons (16%) responded to the value of visual stimuli, 22 neurons (28%) responded after the presentation of visual stimuli, 22 neurons (28%) showed an inhibition around the lever-pressing and were classified as action related neurons and 22 neurons (28%) responded after reward delivery. These findings suggest that neurons in the amygdala play a role in encoding value and processing visual information, participate in motor regulation and are sensitive to reward. The activity of these neurons did not change in the evaluation of auditive stimuli. These data support the hypothesis that amygdala neurons are specific to each sensory modality and that different groups of amygdala neurons process visual and auditive information.

Electrophysiological Correlates of a Versatile Executive Control System in the Monkey Anterior Cingulate Cortex

When a subject faces conflicting situations, decision-making becomes uncertain. The human dorsal anterior cingulate cortex (dACC) has been repeatedly implicated in the monitoring of such situations, and its neural activity is thought to be involved in behavioral adjustment. However, this hypothesis is mainly based on neuroimaging results and is challenged by animal studies that failed to report any neuronal correlates of conflict monitoring. This discrepancy is thought be due either to methodological or more fundamental cross-species differences. In this study, we eliminated methodological biases and recorded single-neuron activity in monkeys performing a Stroop-like task. We found specific changes in dACC activity during incongruent trials but only in a small subpopulation of cells. Critically, these changes were not related to reaction time and were absent before any incorrect action was taken. A larger fraction of neurons exhibited sustained activity during the whole decision period, whereas another subpopulation of neurons was modulated by reaction time, with a gradual increase in their firing rate that peaked at movement onset. Most of the neurons found in these subpopulations exhibited activity after the delivery of an external negative feedback stimulus that indicated an error had been made. These findings, which are consistent with an executive control role, reconcile various theories of prefrontal cortex function and support the homology between human and monkey cognitive architectures.

Object size modulates fronto-parietal activity during reaching movements

In both monkeys and humans, reaching-related sensorimotor transformations involve the activation of a wide fronto-parietal network. Recent neurophysiological evidence suggests that some components of this network host not only neurons encoding the direction of arm reaching movements, but also neurons whose involvement is modulated by the intrinsic features of an object (e.g. size and shape). To date, it has yet to be investigated whether a similar modulation is evident in the human reaching-related areas. To fill this gap, we asked participants to reach towards either a small or a large object while kinematic and electroencephalographic signals were recorded. Behavioral results showed that the precision requirements were taken into account and the kinematics of reaching was modulated depending on the object size. Similarly, reaching-related neural activity at the level of the posterior parietal and premotor cortices was modulated by the level of accuracy determined by object size. We therefore conclude that object size is engaged in the neural computations for reach planning and execution, consistent with the results from physiological studies in non-human primates.

The relationship between self-awareness of attentional status, behavioral performance and oscillatory brain rhythms

High-level cognitive factors, including self-awareness, are believed to play an important role in human visual perception. The principal aim of this study was to determine whether oscillatory brain rhythms play a role in the neural processes involved in self-monitoring attentional status. To do so we measured cortical activity using magnetoencephalography (MEG) and functional magnetic resonance imaging (fMRI) while participants were asked to self-monitor their internal status, only initiating the presentation of a stimulus when they perceived their attentional focus to be maximal. We employed a hierarchical Bayesian method that uses fMRI results as soft-constrained spatial information to solve the MEG inverse problem, allowing us to estimate cortical currents in the order of millimeters and milliseconds. Our results show that, during self-monitoring of internal status, there was a sustained decrease in power within the 7-13 Hz (alpha) range in the rostral cingulate motor area (rCMA) on the human medial wall, beginning approximately 430 msec after the trial start (p < 0.05, FDR corrected). We also show that gamma-band power (41-47 Hz) within this area was positively correlated with task performance from 40–640 msec after the trial start (r = 0.71, p < 0.05). We conclude: (1) the rCMA is involved in processes governing self-monitoring of internal status; and (2) the qualitative differences between alpha and gamma activity are reflective of their different roles in self-monitoring internal states. We suggest that alpha suppression may reflect a strengthening of top-down interareal connections, while a positive correlation between gamma activity and task performance indicates that gamma may play an important role in guiding visuomotor behavior.

Comparison of abstract decision encoding in the monkey prefrontal cortex, the presupplementary, and cingulate motor areas

Deciding between alternatives is a critical element of flexible behavior. Perceptual decisions have been studied extensively in an action-based framework. Recently, we have shown that abstract perceptual decisions are encoded in prefrontal cortex (PFC) neurons ( Merten and Nieder 2012 ). However, the role of other frontal cortex areas remained elusive. Here, we trained monkeys to perform a rule-based visual detection task that disentangled abstract perceptual decisions from motor preparation. We recorded the single-neuron activity in the presupplementary (preSMA) and the rostral part of the cingulate motor area (CMAr) and compared it to the results previously found in the PFC. Neurons in both areas traditionally identified with motor planning process the abstract decision independently of any motor preparatory activity by similar mechanisms as the PFC. A larger proportion of decision neurons and a higher strength of decision encoding was found in the preSMA than in the PFC. Neurons in both areas reliably predicted the monkeys' decisions. The fraction of CMAr decision neurons and their strength of the decision encoding were comparable to the PFC. Our findings highlight the role of both preSMA and CMAr in abstract cognitive processing and emphasize that both frontal areas encode decisions prior to the preparation of a motor output.

Active encoding of decisions about stimulus absence in primate prefrontal cortex neurons

Judging the presence or absence of a stimulus is likely the most basic perceptual decision. A fundamental difference of detection tasks in contrast to discrimination tasks is that only the stimulus presence decision can be inferred from sensory evidence, whereas the alternative decision about stimulus absence lacks sensory evidence by definition. Detection decisions have been studied in an intentional, action-based framework, in which decisions were regarded as intentions to pursue particular actions. These studies have found that only stimulus-present decisions are actively encoded by neurons, whereas the decision about the absence of a stimulus does not affect default neuronal responses. We tested whether this processing mechanism also holds for abstract detection decisions that are dissociated from motor preparation. We recorded single-neuron activity from the prefrontal cortex (PFC) of monkeys performing a visual detection task that forced a report-independent decision. We not only found neurons that actively encoded the subjective decision of monkeys about the presence of a stimulus, but also cells responding actively for the decision about the absence of stimuli. These results suggest that abstract detection decisions are processed in a different way compared with the previously reported action-based decisions. In a report-independent framework, neuronal networks seem to generate a second set of neurons actively encoding the absence of sensory stimulation, thus translating decisions into abstract categories. This mechanism may allow the brain to "buffer" a decision in a nonmovement-related framework.

Contextual encoding by ensembles of medial prefrontal cortex neurons

Contextual representations serve to guide many aspects of behavior and influence the way stimuli or actions are encoded and interpreted. The medial prefrontal cortex (mPFC), including the anterior cingulate subregion, has been implicated in contextual encoding, yet the nature of contextual representations formed by the mPFC is unclear. Using multiple single-unit tetrode recordings in rats, we found that different activity patterns emerged in mPFC ensembles when animals moved between different environmental contexts. These differences in activity patterns were significantly larger than those observed for hippocampal ensembles. Whereas ≈11% of mPFC cells consistently preferred one environment over the other across multiple exposures to the same environments, optimal decoding (prediction) of the environmental setting occurred when the activity of up to ≈50% of all mPFC neurons was taken into account. On the other hand, population activity patterns were not identical upon repeated exposures to the very same environment. This was partly because the state of mPFC ensembles seemed to systematically shift with time, such that we could sometimes predict the change in ensemble state upon later reentry into one environment according to linear extrapolation from the time-dependent shifts observed during the first exposure. We also observed that many strongly action-selective mPFC neurons exhibited a significant degree of context-dependent modulation. These results highlight potential differences in contextual encoding schemes by the mPFC and hippocampus and suggest that the mPFC forms rich contextual representations that take into account not only sensory cues but also actions and time.

The "what" and "when" of self-initiated movements

The ability to generate intentional behavior is undeniably at the core of what makes us acting subjects. Intentional actions consist of at least 2 components (Brass M, Haggard P. 2008. The what, when, whether model of intentional action. Neuroscientist. 14:319-325.): choosing an appropriate behavior (what) and selecting the moment of execution (when). The aim of this study was to identify differing and overlapping neural networks underlying the "what" and "when" of intentional movement initiation. While scanned with functional magnetic resonance imaging, 35 healthy subjects performed self-initiated and reactive, that is, internally and externally triggered movements of the right or left index finger in 3 experimental conditions: 1) "Free Choice" (free timing: when/choice of hand: what), 2) "Timed Choice" (external timing/choice of hand: what), and 3) "No Choice" (external timing/cued hand). The what-component specifically employed the presupplementary motor area (SMA) and dorsal premotor cortex bilaterally. The when-network consisted of superior SMA together with insula and Area 44 bilaterally as well as bilateral anterior putamen, globus pallidus, and left cerebellum subcortically. These 2 components recruited different networks, pointing to a partially distinct neuronal realization of the relating functions. Finally, the more intentional components were involved, the higher was activity in the anterior midcingulate cortex, which highlighted its role in intentional initiation of behavior.

Neural correlates of sleepiness induced by catecholamine depletion

Although extensive indirect evidence exists to suggest that the central dopaminergic system plays a significant role in the modulation of arousal, the functional effect of the dopaminergic influence on the regulation of the sleep-wake cycle remains unclear. Thirteen healthy volunteers and 15 unmedicated subjects with a history of major depressive disorder underwent catecholamine depletion (CD) using oral alpha-methyl-para-tyrosine in a randomized, placebo-controlled, double-blind, crossover study. The main outcome measures in both sessions were sleepiness (Stanford-Sleepiness-Scale), cerebral glucose metabolism (positron emission tomography), and serum prolactin concentration. CD consistently induced clinically relevant sleepiness in both groups. The CD-induced prolactin increase significantly correlated with CD-induced sleepiness but not with CD-induced mood and anxiety symptoms. CD-induced sleepiness correlated with CD-induced increases in metabolism in the medial and orbital frontal cortex, bilateral superior temporal cortex, left insula, cingulate motor area and in the vicinity of the periaqueductal gray. This study suggests that the association between dopamine depletion and sleepiness is independent of the brain reward system and the risk for depression. The visceromotor system, the cingulate motor area, the periaqueductal gray and the caudal hypothalamus may mediate the impact of the dopaminergic system on regulation of wakefulness and sleep.

Development of multidimensional representations of task phases in the lateral prefrontal cortex

The temporal structuring of multiple events is essential for the purposeful regulation of behavior. We investigated the role of the lateral prefrontal cortex (LPFC) in transforming external signals of multiple sensory modalities into information suitable for monitoring successive events across behavioral phases until an intended action is prompted and then initiated. We trained monkeys to receive a succession of 1 s visual, auditory, or tactile sensory signals separated by variable intervals and to then release a key as soon as the fourth signal appeared. Thus, the animals had to monitor and update information about the progress of the task upon receiving each signal preceding the key release in response to the fourth signal. We found that the initial, short-latency responses of LPFC neurons reflected primarily the sensory modality, rather than the phase or progress of the task. However, a task phase-selective response developed within 500 ms of signal reception, and information about the task phase was maintained throughout the presentation of successive cues. The task phase-selective activity was updated with the appearance of each cue until the planned action was initiated. The phase-selective activity of individual neurons reflected not merely a particular phase of the task but also multiple successive phases. Furthermore, we found combined representations of task phase and sensory modality in the activity of individual LPFC neurons. These properties suggest how information representing multiple phases of behavioral events develops in the LPFC to provide a basis for the temporal regulation of behavior.

A neural representation of sequential states within an instructed task

In the study of the neural basis of sensorimotor transformations, it has become clear that the brain does not always wait to sense external events and afterward select the appropriate responses. If there are predictable regularities in the environment, the brain begins to anticipate the timing of instructional cues and the signals to execute a response, revealing an internal representation of the sequential behavioral states of the task being performed. To investigate neural mechanisms that could represent the sequential states of a task, we recorded neural activity from two oculomotor structures implicated in behavioral timing--the supplementary eye fields (SEF) and the lateral intraparietal area (LIP)--while rhesus monkeys performed a memory-guided saccade task. The neurons of the SEF were found to collectively encode the progression of the task with individual neurons predicting and/or detecting states or transitions between states. LIP neurons, while also encoding information about the current temporal interval, were limited with respect to SEF neurons in two ways. First, LIP neurons tended to be active when the monkey was planning a saccade but not in the precue or intertrial intervals, whereas SEF neurons tended to have activity modulation in all intervals. Second, the LIP neurons were more likely to be spatially tuned than SEF neurons. SEF neurons also show anticipatory activity. The state-selective and anticipatory responses of SEF neurons support two complementary models of behavioral timing, state dependent and accumulator models, and suggest that each model describes a contribution SEF makes to timing at different temporal resolutions.

Dynamic encoding of responses and outcomes by neurons in medial prefrontal cortex

Medial prefrontal cortex (MPFC) and lateral prefrontal cortex (LPFC) both contribute to goal-directed behavior, but their precise role remains unclear. Several lines of evidence suggest that MPFC is more important than LPFC for outcome-guided response selection. To examine this, we trained two subjects to perform a task that required them to monitor the specific outcome associated with a specific response on a trial-by-trial basis. While the subjects performed this task, we recorded the electrical activity of single neurons simultaneously from MPFC and LPFC. There were marked differences in the neuronal properties of these two areas. Neurons encoding the response were present in both areas, but in MPFC, there were also neurons that encoded the outcome. In particular, neurons encoded the subject's intended response and how preferable the received outcome was. Thus, only in MPFC was all the information necessary to solve the task encoded. In addition, largely separate populations of MPFC neurons encoded the response and the outcome. Neurons encoding the outcome were in the anterior parts of MPFC: posterior to the corpus callosum, there was a marked drop in their incidence. Our results suggest differences in the contribution of MPFC and LPFC to action control. MPFC neurons encode the desirability of the outcome produced by a specific response on a trial-by-trial basis. This capability may contribute to several of the functions of MPFC, such as action valuation, error detection, and decision making.

Transdural doppler ultrasonography monitors cerebral blood flow changes in relation to motor tasks

Monitoring changes in cerebral blood flow in association with neuronal activity has widely been used to evaluate various brain functions. However, current techniques do not directly measure blood flow changes in specified blood vessels. The present study identified arterioles within the cerebral cortex by echoencephalography and color Doppler imaging, and then measured blood flow velocity (BFV) changes in pulsed-wave Doppler mode. We applied this "transdural Doppler ultrasonography (TDD)" to examine BFV changes in the cortical motor-related areas of monkeys during the performance of unimanual (right or left) and bimanual key-press tasks. BFV in the primary motor cortex (MI) was increased in response to contralateral movement. In each of the unimanual and bimanual tasks, bimodal BFV increases related to both the instruction signal and the movement were observed in the supplementary motor area (SMA). Such BFV changes in the SMA were prominent during the early stage of task training and gradually decreased with improvements in task performance, leaving those in the MI unchanged. Moreover, BFV changes in the SMA depended on task difficulty. The present results indicate that TDD is useful for evaluating regional brain functions.

Successful choice behavior is associated with distinct and coherent network states in anterior cingulate cortex

Successful decision making requires an ability to monitor contexts, actions, and outcomes. The anterior cingulate cortex (ACC) is thought to be critical for these functions, monitoring and guiding decisions especially in challenging situations involving conflict and errors. A number of different single-unit correlates have been observed in the ACC that reflect the diverse cognitive components involved. Yet how ACC neurons function as an integrated network is poorly understood. Here we show, using advanced population analysis of multiple single-unit recordings from the rat ACC during performance of an ecologically valid decision-making task, that ensembles of neurons move through different coherent and dissociable states as the cognitive requirements of the task change. This organization into distinct network patterns with respect to both firing-rate changes and correlations among units broke down during trials with numerous behavioral errors, especially at choice points of the task. These results point to an underlying functional organization into cell assemblies in the ACC that may monitor choices, outcomes, and task contexts, thus tracking the animal's progression through "task space."

Determining a role for ventromedial prefrontal cortex in encoding action-based value signals during reward-related decision making

Considerable evidence has emerged to implicate ventromedial prefrontal cortex in encoding expectations of future reward during value-based decision making. However, the nature of the learned associations upon which such representations depend is much less clear. Here, we aimed to determine whether expected reward representations in this region could be driven by action-outcome associations, rather than being dependent on the associative value assigned to particular discriminative stimuli. Subjects were scanned with functional magnetic resonance imaging while performing 2 variants of a simple reward-related decision task. In one version, subjects made choices between 2 different physical motor responses in the absence of discriminative stimuli, whereas in the other version, subjects chose between 2 different stimuli that were randomly assigned to different responses on a trial-by-trial basis. Using an extension of a reinforcement learning algorithm, we found activity in ventromedial prefrontal cortex tracked expected future reward during the action-based task as well as during the stimulus-based task, indicating that value representations in this region can be driven by action-outcome associations. These findings suggest that ventromedial prefrontal cortex may play a role in encoding the value of chosen actions irrespective of whether those actions denote physical motor responses or more abstract decision options.

Choice, uncertainty and value in prefrontal and cingulate cortex

Reinforcement learning models that focus on the striatum and dopamine can predict the choices of animals and people. Representations of reward expectation and of reward prediction errors that are pertinent to decision making, however, are not confined to these regions but are also found in prefrontal and cingulate cortex. Moreover, decisions are not guided solely by the magnitude of the reward that is expected. Uncertainty in the estimate of the reward expectation, the value of information that might be gained by taking a course of action and the cost of an action all influence the manner in which decisions are made through prefrontal and cingulate cortex.

Encoding problem-solving strategies in prefrontal cortex: activity during strategic errors

The primate prefrontal cortex (PF) plays a central role in choosing goals and strategies. To better understand its mechanisms, we recorded from PF neurons as monkeys used abstract response strategies to select a spatial goal. A visual cue, selected randomly from a set of three cues, appeared on each trial. All three cues were novel when neuronal recording commenced. From trial to trial, the cue could have either been repeated or changed from the previous trial; these were called repeat trials and change trials, respectively. On repeat trials, the monkeys used a Repeat-stay strategy to gain a reward by choosing the same spatial goal as on the previous trial; on change trials, they used a Change-shift strategy to reject the previous goal in favour of an alternative. We reported previously that when monkeys performed the task correctly, many PF neurons had activity encoding one of these two strategies. The monkeys sometimes chose the incorrect strategy, however. Strategy coding was weak or absent during the cue period of error trials which was, for correct trials, the time when the monkeys used a strategy to choose a future goal. By contrast, later in the trial, after the chosen goal had been attained and the monkeys awaited feedback, strategy coding was present and it reflected the strategy used, whether correct or incorrect. The weak cue-period strategy signal could, whatever its cause, have contributed to the errors made, whereas the activity prior to feedback suggests a role in monitoring task performance.

Neuronal activity in the cingulate motor areas during adaptation to a new dynamic environment

Neurons in the cingulate motor areas (CMA) have been shown to be involved in many aspects of sensorimotor behavior, although their role in motor learning has received less attention. Here, we recorded single-cell activity in the CMA of monkeys while they adapted reaching movements to different dynamic environments. Specifically, we analyzed CMA activity during normal reaching to visual targets and during reaching in the presence of an applied velocity-dependent force field. We found that the cingulate neuronal activity was modulated during each phase of the task and in response to the applied forces. The neurons' involvement in the visuomotor transformation was influenced by their rostrocaudal location in the cingulate sulcus. Rostral CMA (CMAr) neurons were modulated by the visual instruction to a greater extent than caudal CMA (CMAc) neurons. In contrast, CMAc neurons had a greater amount of phasic and directionally tuned activity during movement than CMAr cells. Furthermore, compared with CMAr cells, the movement-related activity of CMAc cells was more frequently modulated by the applied force fields. The magnitude of the force-field-related neuronal response scaled with the amount of perturbation in each reaching direction. However, contrary to previous results from other cortical motor areas, force-field adaptation was not correlated with a shift in directional tuning of the CMA population. Based on these results, we suggest that although the CMA is clearly sensitive to applied forces, it is less involved in generating anticipatory responses to predictable forces than other cortical motor areas.

Neural substrates of visuomotor learning based on improved feedback control and prediction

Motor skills emerge from learning feedforward commands as well as improvements in feedback control. These two components of learning were investigated in a compensatory visuomotor tracking task on a trial-by-trial basis. Between-trial learning was characterized with a state-space model to provide smoothed estimates of feedforward and feedback learning, separable from random fluctuations in motor performance and error. The resultant parameters were correlated with brain activity using magnetic resonance imaging. Learning related to the generation of a feedforward command correlated with activity in dorsal premotor cortex, inferior parietal lobule, supplementary motor area and cingulate motor area, supporting a role of these areas in retrieving and executing a predictive motor command. Modulation of feedback control was associated with activity in bilateral posterior superior parietal lobule as well as right ventral premotor cortex. Performance error correlated with activity in a widespread cortical and subcortical network including bilateral parietal, premotor and rostral anterior cingulate cortex as well as the cerebellar cortex. Finally, trial-by-trial changes of kinematics, as measured by mean absolute hand acceleration, correlated with activity in motor cortex and anterior cerebellum. The results demonstrate that incremental, learning-dependent changes can be modeled on a trial-by-trial basis and neural substrates for feedforward control of novel motor programs are localized to secondary motor areas.

Temporal filtering of reward signals in the dorsal anterior cingulate cortex during a mixed-strategy game

The process of decision making in humans and other animals is adaptive and can be tuned through experience so as to optimize the outcomes of their choices in a dynamic environment. Previous studies have demonstrated that the anterior cingulate cortex plays an important role in updating the animal's behavioral strategies when the action outcome contingencies change. Moreover, neurons in the anterior cingulate cortex often encode the signals related to expected or actual reward. We investigated whether reward-related activity in the anterior cingulate cortex is affected by the animal's previous reward history. This was tested in rhesus monkeys trained to make binary choices in a computer-simulated competitive zero-sum game. The animal's choice behavior was relatively close to the optimal strategy but also revealed small systematic biases that are consistent with the use of a reinforcement learning algorithm. In addition, the activity of neurons in the dorsal anterior cingulate cortex that was related to the reward received by the animal in a given trial often was modulated by the rewards in the previous trials. Some of these neurons encoded the rate of rewards in previous trials, whereas others displayed activity modulations more closely related to the reward prediction errors. In contrast, signals related to the animal's choices were represented only weakly in this cortical area. These results suggest that neurons in the dorsal anterior cingulate cortex might be involved in the subjective evaluation of choice outcomes based on the animal's reward history.

Contrasting roles for cingulate and orbitofrontal cortex in decisions and social behaviour

There is general acknowledgement that both the anterior cingulate and orbitofrontal cortex are implicated in reinforcement-guided decision making, and emotion and social behaviour. Despite the interest that these areas generate in both the cognitive neuroscience laboratory and the psychiatric clinic, ideas about the distinctive contributions made by each have only recently begun to emerge. This reflects an increasing understanding of the component processes that underlie reinforcement-guided decision making, such as the representation of reinforcement expectations, the exploration, updating and representation of action values, and the appreciation that choices are guided not just by the prospect of reward but also by the costs that action entails. Evidence is emerging to suggest that the anterior cingulate and orbitofrontal cortex make distinct contributions to each of these aspects of decision making.

Amygdala interconnections with the cingulate motor cortex in the rhesus monkey

Amygdala interconnections with the cingulate motor cortices were investigated in the rhesus monkey. Using multiple tracing approaches, we found a robust projection from the lateral basal nucleus of the amygdala to Layers II, IIIa, and V of the rostral cingulate motor cortex (M3). A smaller source of amygdala input arose from the accessory basal, cortical, and lateral nuclei, which targeted only the rostral region of M3. We also found a light projection from the lateral basal nucleus to the same layers of the caudal cingulate motor cortex (M4). Experiments examining this projection to cingulate somatotopy using combined neural tracing strategies and stereology to estimate the total number of terminal-like immunoreactive particles demonstrated that the amygdala projection terminates heavily in the face representation of M3 and moderately in its arm representation. Fewer terminal profiles were found in the leg representation of M3 and the face, arm, and leg representations of M4. Anterograde tracers placed directly into M3 and M4 revealed the amygdala connection to be reciprocal and documented corticofugal projections to the facial nucleus, surrounding pontine reticular formation, and spinal cord. Clinically, such pathways would be in a position to contribute to mediating movements in the face, neck, and upper extremity accompanying medial temporal lobe seizures that have historically characterized this syndrome. Alterations within or disruption of the amygdalo-cingulate projection to the rostral part of M3 may also have an adverse effect on facial expression in patients presenting with neurological or neuropsychiatric abnormalities of medial temporal lobe involvement. Finally, the prominent amygdala projection to the face region of M3 may significantly influence the outcome of higher-order facial expressions associated with social communication and emotional constructs such as fear, anger, happiness, and sadness.

The sight of others' pain modulates motor processing in human cingulate cortex

Neuroimaging evidence has shown that a network including cingulate cortex and bilateral insula responds to both felt and seen pain. Of these, dorsal anterior cingulate and midcingulate areas are involved in preparing context-appropriate motor responses to painful situations, but it is unclear whether the same holds for observed pain. Participants in this functional magnetic resonance imaging study viewed short animations depicting a noxious implement (e.g., a sharp knife) or an innocuous implement (e.g., a butter knife) striking a person's hand. Participants were required to execute or suppress button-press responses depending on whether the implements hit or missed the hand. The combination of the implement's noxiousness and whether it contacted the hand strongly affected reaction times, with the fastest responses to noxious-hit trials. Blood oxygen level-dependent signal changes mirrored this behavioral interaction with increased activation during noxious-hit trials only in midcingulate, dorsal anterior, and dorsal posterior cingulate regions. Crucially, the activation in these cingulate regions also depended on whether the subject made an overt motor response to the event, linking their role in pain observation to their role in motor processing. This study also suggests a functional topography in medial premotor regions implicated in "pain empathy," with adjacent activations relating to pain-selective and motor-selective components, and their interaction.

Extended LATER model can account for trial-by-trial variability of both pre- and post-processes

We present a new decision-making model that can account for trial-by-trial variability induced by a process ("pre-process") that occurs before an explicit sensory signal specifying a later motor response. A process after explicit sensory signals, referred to herein as the "post-process", has been investigated by a variety of so-called rise-to-threshold models including the LATER model. The LATER model formulates post-process variability but treats the pre-process as fixed within a block of an experiment. We propose an extension of the LATER model, which we call the extended LATER (ELATER) model, to account for trial-by-trial variability of both pre- and post-processes together. We present the mathematical formulation of the ELATER model and analyze its characteristics, including numerical examples and an example of saccade latency data in reward-manipulated conditions with caudate activity. The ELATER model is useful for investigating decision making by taking account of trial-by-trial variability of both pre- and post-processes.

Integration of target and effector information in the human brain during reach planning

To plan a reaching movement, the brain must integrate information about the location of the target with information about the limb selected for the reach. Here, we applied rapid event-related 3-T fMRI to investigate this process in human subjects (n = 16) preparing a reach following two successive visual instruction cues. One cue instructed which arm to use; the other cue instructed the location of the reach target. We hypothesized that regions involved in the integration of target and effector information should not only respond to each of the two instruction cues, but should respond more strongly to the second cue due to the added integrative processing to establish the reach plan. We found bilateral regions in the posterior parietal cortex, the premotor cortex, the medial frontal cortex, and the insular cortex to be involved in target-arm integration, as well as the left dorsolateral prefrontal cortex and an area in the right lateral occipital sulcus to respond in this manner. We further determined the functional properties of these regions in terms of spatial and effector specificity. This showed that the posterior parietal cortex and the dorsal premotor cortex specify both the spatial location of a target and the effector selected for the response. We therefore conclude that these regions are selectively engaged in the neural computations for reach planning, consistent with the results from physiological studies in nonhuman primates.

Differential Involvement of Neurons in the Dorsal and Ventral Premotor Cortex During Processing of Visual Signals for Action Planning

We examined neuronal activity in the dorsal and ventral premotor cortex (PMd and PMv, respectively) to explore the role of each motor area in processing visual signals for action planning. We recorded neuronal activity while monkeys performed a behavioral task during which two visual instruction cues were given successively with an intervening delay. One cue instructed the location of the target to be reached, and the other indicated which arm was to be used. We found that the properties of neuronal activity in the PMd and PMv differed in many respects. After the first cue was given, PMv neuron response mostly reflected the spatial position of the visual cue. In contrast, PMd neuron response also reflected what the visual cue instructed, such as which arm to be used or which target to be reached. After the second cue was given, PMv neurons initially responded to the cue's visuospatial features and later reflected what the two visual cues instructed, progressively increasing information about the target location. In contrast, the activity of the majority of PMd neurons responded to the second cue with activity reflecting a combination of information supplied by the first and second cues. Such activity, already reflecting a forthcoming action, appeared with short latencies (<400 ms) and persisted throughout the delay period. In addition, both the PMv and PMd showed bilateral representation on visuospatial information and motor-target or effector information. These results further elucidate the functional specialization of the PMd and PMv during the processing of visual information for action planning.

Functional specialization within the dorsolateral prefrontal cortex: A review of anatomical and physiological studies of non-human primates

The dorsolateral prefrontal cortex (DLPFC) possesses cortico-cortical connections with the parietal and premotor cortices that are involved in visuomotor control of actions. Studies have shown that the DLPFC, especially the caudal part, has a crucial role in cognitive control of motor behavior, and that it uses spatial information in conjunction with information such as object identity, behavioral rules, and rewards. Current anatomical and physiological studies indicate that the DLPFC may not be a single entity. Anatomical studies show that preferential anatomical connections exist between subregions of the DLPFC and the parietal/premotor cortices. Physiological studies based on data obtained from monkeys performing a variety of cognitive tasks report region-specific neuronal activity within the DLPFC. In this article, I review evidence for functional segregation within the DLPFC and postulate that at least two distinct subregions, i.e., the dorsal and ventral parts, can be identified.

Role for Human Posterior Parietal Cortex in Visual Processing of Aversive Objects in Peripersonal Space

The posterior parietal cortex of both human and non-human primates is known to play a crucial role in the early integration of visual information with somatosensory, proprioceptive and vestibular signals. However, it is not known whether in humans this region is further capable of discriminating if a stimulus poses a threat to the body. In this functional magnetic resonance imaging (fMRI) study, we tested the hypothesis that the posterior parietal cortex of humans is capable of modulating its response to the visual processing of noxious threat representation in the absence of tactile input. During fMRI, participants watched while we "stimulated" a visible rubber hand, placed over their real hand with either a sharp (painful) or a blunt (nonpainful) probe. We found that superior and inferior parietal regions (BA5/7 and BA40) increased their activity in response to observing a painful versus nonpainful stimulus. However, this effect was only evident when the rubber hand was in a spatially congruent (vs. incongruent) position with respect to the participants' own hand. In addition, areas involved in motivational-affective coding such as mid-cingulate (BA24) and anterior insula also showed such relevance-dependent modulation, whereas premotor areas known to receive multisensory information about limb position did not. We suggest these results reveal a human anatomical-functional homologue to monkey inferior parietal areas that respond to aversive stimuli by producing nocifensive muscle and limb movements.

Reward encoding in the monkey anterior cingulate cortex

The anterior cingulate cortex (ACC) is known to play a crucial role in the fast adaptations of behavior based on immediate reward values. What is less certain is whether the ACC is also involved in long-term adaptations to situations with uncertain outcomes. To study this issue, we placed macaque monkeys in a probabilistic context in which the appropriate strategy to maximize reward was to identify the stimulus with the highest reward value (optimal stimulus). Only knowledge of the theoretical average reward value associated with this stimulus--referred to as 'the task value'--was available. Remarkably, in each trial, ACC pre-reward activity correlated with the task value. Importantly, this neuronal activity was observed prior to the discovery of the optimal stimulus. We hypothesize that the received rewards and the task value, constructed a priori through learning, are used to guide behavior and identify the optimal stimulus. We tested this hypothesis by muscimol deactivation of the ACC. As predicted, this inactivation impaired the search for the optimal stimulus. We propose that ACC participates in long-term adaptation of voluntary reward-based behaviors by encoding general task values and received rewards.