Flexible and Stable Value Coding Areas in Caudate Head and Tail Receive Anatomically Distinct Cortical and Subcortical Inputs

Convergent representation of values from tactile and visual inputs for efficient goal-directed behavior in the primate putamen

Animals can discriminate diverse sensory values with a limited number of neurons, raising questions about how the brain utilizes neural resources to efficiently process multi-dimensional inputs for decision-making. Here, we demonstrate that this efficiency is achieved by reducing sensory dimensions and converging towards the value dimension essential for goal-directed behavior in the putamen. Humans and monkeys performed tactile and visual value discrimination tasks while their neural responses were examined. Value information, whether originating from tactile or visual stimuli, was found to be processed within the human putamen using fMRI. Notably, at the single-neuron level in the macaque putamen, half of the individual neurons encode values independently of sensory inputs, while the other half selectively encode tactile or visual value. The responses of bimodal value neurons correlate with value-guided finger insertion behavior in both tasks, whereas modality-selective value neurons show task-specific correlations. Simulation using these neurons reveals that the presence of bimodal value neurons enables value discrimination with a significantly reduced number of neurons compared to simulations without them. Our data indicate that individual neurons in the primate putamen process different values in a convergent manner, thereby facilitating the efficient use of constrained neural resources for value-guided behavior.

Shifting attention to orient or avoid: a unifying account of the tail of the striatum and its dopaminergic inputs

The tail of the striatum (TS) is increasingly recognized as a unique subdivision of the striatum, characterized by its dense sensory inputs and projections received from a distinct group of dopamine neurons. Separate lines of research have characterized the functional role of TS, and TS-projecting dopamine neurons, in three realms: saccadic eye movement towards valuable visual stimuli; tone-guided choice between two options; and defensive responses to threatening stimuli. We propose a framework for reconciling these diverse roles as varied implementations of a conserved response to salient stimuli, with dopamine in TS providing a teaching signal to promote quick attentional shifts that facilitate stimulus-driven orientation and/or avoidance.

Symmetry in Frontal But Not Motor and Somatosensory Cortical Projections

The neocortex and striatum are topographically organized for sensory and motor functions. While sensory and motor areas are lateralized for touch and motor control, respectively, frontal areas are involved in decision-making, where lateralization of function may be less important. This study contrasted the topographic precision of cell-type-specific ipsilateral and contralateral cortical projections while varying the injection site location in transgenic mice of both sexes. While sensory cortical areas had strongly topographic outputs to the ipsilateral cortex and striatum, they were weaker and not as topographically precise to contralateral targets. The motor cortex had somewhat stronger projections but still relatively weak contralateral topography. In contrast, frontal cortical areas had high degrees of topographic similarity for both ipsilateral and contralateral projections to the cortex and striatum. Corticothalamic organization is mainly ipsilateral, with weaker, more medial contralateral projections. Corticostriatal computations might integrate input outside closed basal ganglia loops using contralateral projections, enabling the two hemispheres to act as a unit to converge on one result in motor planning and decision-making.

A distinct circuit for biasing visual perceptual decisions and modulating superior colliculus activity through the mouse posterior striatum

The basal ganglia play a key role in visual perceptual decisions. Despite being the primary target in the basal ganglia for inputs from the visual cortex, the posterior striatum's (PS) involvement in visual perceptual behavior remains unknown in rodents. We reveal that the PS direct pathway is largely segregated from the dorsomedial striatum (DMS) direct pathway, the other major striatal target for visual cortex. We investigated the role of the PS in visual perceptual decisions by optogenetically stimulating striatal medium spiny neurons in the direct pathway (D1-MSNs) of mice performing a visual change-detection task. PS D1-MSN activation robustly biased visual decisions in a manner dependent on visual context, timing, and reward expectation. We examined the effects of PS and DMS direct pathway activation on neuronal activity in the superior colliculus (SC), a major output target of the basal ganglia. Activation of either direct pathway rapidly modulated SC neurons, but mostly targeted different SC neurons and had opposite effects. These results demonstrate that the PS in rodents provides an important route for controlling visual decisions, in parallel with the better known DMS, but with distinct anatomical and functional properties.

Implication of regional selectivity of dopamine deficits in impaired suppressing of involuntary movements in Parkinson's disease

To improve the initiation and speed of intended action, one of the crucial mechanisms is suppressing unwanted movements that interfere with goal-directed behavior, which is observed relatively aberrant in Parkinson's disease patients. Recent research has highlighted that dopamine deficits in Parkinson's disease predominantly occur in the caudal lateral part of the substantia nigra pars compacta (SNc) in human patients. We previously found two parallel circuits within the basal ganglia, primarily divided into circuits mediated by the rostral medial part and caudal lateral part of the SNc dopamine neurons. We have further discovered that the indirect pathway in caudal basal ganglia circuits, facilitated by the caudal lateral part of the SNc dopamine neurons, plays a critical role in suppressing unnecessary involuntary movements when animals perform voluntary goal-directed actions. We thus explored recent research in humans and non-human primates focusing on the distinct functions and networks of the caudal lateral part of the SNc dopamine neurons to elucidate the mechanisms involved in the impairment of suppressing involuntary movements in Parkinson's disease patients.

Neuronal response of the primate striatum tail to face of socially familiar persons

Recent studies have suggested that the basal ganglia, the center of stimulus-reward associative learning, are involved in social behavior. However, the role of the basal ganglia in social information processing remains unclear. Here, we demonstrate that the striatum tail (STRt) in macaque monkeys, which is sensitive to visual objects with long-term reward history (i.e., stable object value), is also sensitive to socially familiar persons. Many STRt neurons responded to face images of persons, especially those who took daily care of the subject monkeys. These face-responsive neurons also encoded stable object value. The strength of the neuronal modulation of social familiarity and stable object value biases were positively correlated. These results suggest that both social familiarity and stable object value information are mediated by a common neuronal mechanism. Thus, the representation of social information is linked to reward information in the STRt, not in the dedicated social information circuit.

Involvement of the claustrum in the cortico-basal ganglia circuitry: connectional study in the non-human primate

The claustrum is an ancient telencephalic subcortical structure displaying extensive, reciprocal connections with much of the cortex and receiving projections from thalamus, amygdala, and hippocampus. This structure has a general role in modulating cortical excitability and is considered to be engaged in different cognitive and motor functions, such as sensory integration and perceptual binding, salience-guided attention, top-down executive functions, as well as in the control of brain states, such as sleep and its interhemispheric integration. The present study is the first to describe in detail a projection from the claustrum to the striatum in the macaque brain. Based on tracer injections in different striatal regions and in different cortical areas, we observed a rough topography of the claustral connectivity, thanks to which a claustral zone projects to both a specific striatal territory and to cortical areas involved in a network projecting to the same striatal territory. The present data add new elements of complexity of the basal ganglia information processing mode in motor and non-motor functions and provide evidence for an influence of the claustrum on both cortical functional domains and cortico-basal ganglia circuits.

Symmetry in frontal but not motor and somatosensory cortical projections

Neocortex and striatum are topographically organized for sensory and motor functions. While sensory and motor areas are lateralized for touch and motor control, respectively, frontal areas are involved in decision making, where lateralization of function may be less important. This study contrasted the topographic precision of cell type-specific ipsilateral and contralateral cortical projections while varying the injection site location in transgenic mice of both sexes. While sensory cortical areas had strongly topographic outputs to ipsilateral cortex and striatum, they were weaker and not as topographically precise to contralateral targets. Motor cortex had somewhat stronger projections, but still relatively weak contralateral topography. In contrast, frontal cortical areas had high degrees of topographic similarity for both ipsilateral and contralateral projections to cortex and striatum. Corticothalamic organization is mainly ipsilateral, with weaker, more medial contralateral projections. Corticostriatal computations might integrate input outside closed basal ganglia loops using contralateral projections, enabling the two hemispheres to act as a unit to converge on one result in motor planning and decision making.

Dopamine transmission in the tail striatum: Regional variation and contribution of dopamine clearance mechanisms

The striatum can be divided into four anatomically and functionally distinct domains: the dorsolateral, dorsomedial, ventral and the more recently identified caudolateral (tail) striatum. Dopamine transmission in these striatal domains underlies many important behaviours, yet little is known about this phenomenon in the tail striatum. Furthermore, the tail is divided anatomically into four divisions (dorsal, medial, intermediate and lateral) based on the profile of D1 and D2 dopamine receptor-expressing medium spiny neurons, something that is not seen elsewhere in the striatum. Considering this organisation, how dopamine transmission occurs in the tail striatum is of great interest. We recorded evoked dopamine release in the four tail divisions, with comparison to the dorsolateral striatum, using fast-scan cyclic voltammetry in rat brain slices. Contributions of clearance mechanisms were investigated using dopamine transporter knockout (DAT-KO) rats, pharmacological transporter inhibitors and dextran. Evoked dopamine release in all tail divisions was smaller in amplitude than in the dorsolateral striatum and, importantly, regional variation was observed: dorsolateral ≈ lateral > medial > dorsal ≈ intermediate. Release amplitudes in the lateral division were 300% of that in the intermediate division, which also exhibited uniquely slow peak dopamine clearance velocity. Dopamine clearance in the intermediate division was most dependent on DAT, and no alternative dopamine transporters investigated (organic cation transporter-3, norepinephrine transporter and serotonin transporter) contributed significantly to dopamine clearance in any tail division. Our findings confirm that the tail striatum is not only a distinct dopamine domain but also that each tail division has unique dopamine transmission characteristics. This supports that the divisions are not only anatomically but also functionally distinct. How this segregation relates to the overall function of the tail striatum, particularly the processing of multisensory information, is yet to be determined.

Implicit Selective Attention: The Role of the Mesencephalic-basal Ganglia System

The ability of the brain to recognize and orient attention to relevant stimuli appearing in the visual field is highlighted by a tuning process, which involves modulating the early visual system by both cortical and subcortical brain areas. Selective attention is coordinated not only by the output of stimulus-based saliency maps but is also influenced by top-down cognitive factors, such as internal states, goals, or previous experiences. The basal ganglia system plays a key role in implicitly modulating the underlying mechanisms of selective attention, favouring the formation and maintenance of implicit sensory-motor memories that are capable of automatically modifying the output of priority maps in sensory-motor structures of the midbrain, such as the superior colliculus. The article presents an overview of the recent literature outlining the crucial contribution of several subcortical structures to the processing of different sources of salient stimuli. In detail, we will focus on how the mesencephalic- basal ganglia closed loops contribute to implicitly addressing and modulating selective attention to prioritized stimuli. We conclude by discussing implicit behavioural responses observed in clinical populations in which awareness is compromised at some level. Implicit (emergent) awareness in clinical conditions that can be accompanied by manifest anosognosic symptomatology (i.e., hemiplegia) or involving abnormal conscious processing of visual information (i.e., unilateral spatial neglect and blindsight) represents interesting neurocognitive "test cases" for inferences about mesencephalicbasal ganglia closed-loops involvement in the formation of implicit sensory-motor memories.

Prefrontal cortex encodes value pop-out in visual search

Recent evidence demonstrates that long-term object value association can enhance visual search efficiency, a phenomenon known as value pop-out. However, the neural mechanism underlying this effect is not fully understood. Given the known role of the ventrolateral prefrontal cortex (vlPFC) in visual search and value memory, we recorded its single-unit activity (n = 526) in two macaque monkeys while they engaged in the value-driven search. Monkeys had to determine whether a high-value target was present within a variable number of low-value objects. Differential neural firing, as well as gamma-band power, indicated the presence of a target within ∼150ms of display onset. Notably, this differential activity was negatively correlated with search time and had reduced set-size dependence during efficient search. On the other hand, neural firing and its variability were higher in inefficient search. These findings implicate vlPFC in rapid detection of valuable targets which would be a crucial skill in competitive environments.

Anatomical and Functional Comparison of the Caudate Tail in Primates and the Tail of the Striatum in Rodents: Implications for Sensory Information Processing and Habitual Behavior

The tail of the striatum (TS) is located at the caudal end in the striatum. Recent studies have advanced our knowledge of the anatomy and function of the TS but also raised questions about the differences between rodent and primate TS. In this review, we compare the anatomy and function of the TS in rodent and primate brains. The primate TS is expanded more caudally during brain development in comparison with the rodent TS. Additionally, five sensory inputs from the cortex and thalamus converge in the rodent TS, but this convergence is not observed in the primate TS. The primate TS, including the caudate tail and putamen tail, primarily receives inputs from the visual areas, implying a specialized function in processing visual inputs for action generation. This anatomical difference leads to further discussion of cellular circuit models to comprehend how the primate brain processes a wider range of complex visual stimuli to produce habitual behavior as compared with the rodent brain. Examining these differences and considering possible neural models may provide better understanding of the anatomy and function of the primate TS.

Environmental context-dependent activation of dopamine neurons via putative amygdala-nigra pathway in macaques

Seeking out good and avoiding bad objects is critical for survival. In practice, objects are rarely good every time or everywhere, but only at the right time or place. Whereas the basal ganglia (BG) are known to mediate goal-directed behavior, for example, saccades to rewarding objects, it remains unclear how such simple behaviors are rendered contingent on higher-order factors, including environmental context. Here we show that amygdala neurons are sensitive to environments and may regulate putative dopamine (DA) neurons via an inhibitory projection to the substantia nigra (SN). In male macaques, we combined optogenetics with multi-channel recording to demonstrate that rewarding environments induce tonic firing changes in DA neurons as well as phasic responses to rewarding events. These responses may be mediated by disinhibition via a GABAergic projection onto DA neurons, which in turn is suppressed by an inhibitory projection from the amygdala. Thus, the amygdala may provide an additional source of learning to BG circuits, namely contingencies imposed by the environment.

The zona incerta in control of novelty seeking and investigation across species

Many organisms rely on a capacity to rapidly replicate, disperse, and evolve when faced with uncertainty and novelty. But mammals do not evolve and replicate quickly. They rely on a sophisticated nervous system to generate predictions and select responses when confronted with these challenges. An important component of their behavioral repertoire is the adaptive context-dependent seeking or avoiding of perceptually novel objects, even when their values have not yet been learned. Here, we outline recent cross-species breakthroughs that shed light on how the zona incerta (ZI), a relatively evolutionarily conserved brain area, supports novelty-seeking and novelty-related investigations. We then conjecture how the architecture of the ZI's anatomical connectivity - the wide-ranging top-down cortical inputs to the ZI, and its specifically strong outputs to both the brainstem action controllers and to brain areas involved in action value learning - place the ZI in a unique role at the intersection of cognitive control and learning.

Connectivity of the corticostriatal and thalamostriatal systems in normal and parkinsonian states: An update

The striatum receives abundant glutamatergic afferents from the cortex and thalamus. These inputs play a major role in the functions of the striatal neurons in normal conditions, and are significantly altered in pathological states, such as Parkinson's disease. This review summarizes the current knowledge of the connectivity of the corticostriatal and thalamostriatal pathways, with emphasis on the most recent advances in the field. We also discuss novel findings regarding structural changes in cortico- and thalamostriatal connections that occur in these connections as a consequence of striatal loss of dopamine in parkinsonism.

Salience memories formed by value, novelty and aversiveness jointly shape object responses in the prefrontal cortex and basal ganglia

Ecological fitness depends on maintaining object histories to guide future interactions. Recent evidence shows that value memory changes passive visual responses to objects in ventrolateral prefrontal cortex (vlPFC) and substantia nigra reticulata (SNr). However, it is not known whether this effect is limited to reward history and if not how cross-domain representations are organized within the same or different neural populations in this corticobasal circuitry. To address this issue, visual responses of the same neurons across appetitive, aversive and novelty domains were recorded in vlPFC and SNr. Results showed that changes in visual responses across domains happened in the same rather than separate populations and were related to salience rather than valence of objects. Furthermore, while SNr preferentially encoded outcome related salience memory, vlPFC encoded salience memory across all domains in a correlated fashion, consistent with its role as an information hub to guide behavior.

Functional architecture of executive control and associated event-related potentials in macaques

The medial frontal cortex (MFC) enables executive control by monitoring relevant information and using it to adapt behavior. In macaques performing a saccade countermanding (stop-signal) task, we simultaneously recorded electrical potentials over MFC and neural spiking across all layers of the supplementary eye field (SEF). We report the laminar organization of neurons enabling executive control by monitoring the conflict between incompatible responses, the timing of events, and sustaining goal maintenance. These neurons were a mix of narrow-spiking and broad-spiking found in all layers, but those predicting the duration of control and sustaining the task goal until the release of operant control were more commonly narrow-spiking neurons confined to layers 2 and 3 (L2/3). We complement these results with evidence for a monkey homolog of the N2/P3 event-related potential (ERP) complex associated with response inhibition. N2 polarization varied with error-likelihood and P3 polarization varied with the duration of expected control. The amplitude of the N2 and P3 were predicted by the spike rate of different classes of neurons located in L2/3 but not L5/6. These findings reveal features of the cortical microcircuitry supporting executive control and producing associated ERPs.

Crossed Corticostriatal Projections in the Macaque Brain

In nonhuman primates, major input to the striatum originates from ipsilateral cortex and thalamus. The striatum is a target also of crossed corticostriatal (CSt) projections from the contralateral hemisphere, which have been so far somewhat neglected. In the present study, based on neural tracer injections in different parts of the striatum in macaques of either sex, we analyzed and compared qualitatively and quantitatively the distribution of labeled CSt cells in the two hemispheres. The results showed that crossed CSt projections to the caudate and the putamen can be relatively robust (up to 30% of total labeled cells). The origin of the direct and the crossed CSt projections was not symmetrical as the crossed ones originated almost exclusively from motor, prefrontal, and cingulate areas and not from parietal and temporal areas. Furthermore, there were several cases in which the contribution of contralateral areas tended to equal that of the ipsilateral ones. The present study is the first detailed description of this anatomic pathway of the macaque brain and provides the substrate for bilateral distribution of motor, motivational, and cognitive signals for reinforcement learning and selection of actions or action sequences, and for learning compensatory motor strategies after cortical stroke.SIGNIFICANCE STATEMENT In nonhuman primates the striatum is a target of projections originating from the contralateral hemisphere (crossed CSt projections), which have been so far poorly investigated. The present study analyzed qualitatively and quantitatively in the macaque brain the origin of the crossed CSt projections compared with those originating from the ipsilateral hemisphere. The results showed that crossed CSt projections originate mostly from frontal and rostral cingulate areas and in some cases their contribution tended to equal that from ipsilateral areas. These projections could provide the substrate for bilateral distribution of motor, motivational, and cognitive signals for reinforcement learning and action selection, and for learning compensatory motor strategies after cortical stroke.

Conservation of the Direct and Indirect Pathway Dichotomy in Mouse Caudal Striatum With Uneven Distribution of Dopamine Receptor D1- and D2-Expressing Neurons

The striatum is one of the key nuclei for adequate control of voluntary behaviors and reinforcement learning. Two striatal projection neuron types, expressing either dopamine receptor D1 (D1R) or dopamine receptor D2 (D2R) constitute two independent output routes: the direct or indirect pathways, respectively. These pathways co-work in balance to achieve coordinated behavior. Two projection neuron types are equivalently intermingled in most striatal space. However, recent studies revealed two atypical zones in the caudal striatum: the zone in which D1R-neurons are the minor population (D1R-poor zone) and that in which D2R-neurons are the minority (D2R-poor zone). It remains obscure as to whether these imbalanced zones have similar properties on axonal projections and electrophysiology compared to other striatal regions. Based on morphological experiments in mice using immunofluorescence, in situ hybridization, and neural tracing, here, we revealed that the poor zones densely projected to the globus pallidus and substantia nigra pars lateralis, with a few collaterals in substantia nigra pars reticulata and compacta. Similar to that in other striatal regions, D1R-neurons were the direct pathway neurons. We also showed that the membrane properties of projection neurons in the poor zones were largely similar to those in the conventional striatum using in vitro electrophysiological recording. In addition, the poor zones existed irrespective of the age or sex of mice. We also identified the poor zones in the common marmoset as well as other rodents. These results suggest that the poor zones in the caudal striatum follow the conventional projection patterns irrespective of the imbalanced distribution of projection neurons. The poor zones could be an innate structure and common in mammals. The unique striatal zones possessing highly restricted projections could relate to functions different from those of motor-related striatum.

Brain substrates for automatic retrieval of value memory in the primate basal ganglia

Our behavior is often carried out automatically. Automatic behavior can be guided by past experiences, such as learned values associated with objects. Passive-viewing and free-viewing tasks with no immediate outcomes provide a testable condition in which monkeys and humans automatically retrieve value memories and perform habitual searching. Interestingly, in these tasks, caudal regions of the basal ganglia structures are involved in automatic retrieval of learned object values and habitual gaze. In contrast, rostral regions do not participate in these activities but instead monitor the changes in outcomes. These findings indicate that automatic behaviors based on the value memories are processed selectively by the caudal regions of the primate basal ganglia system. Understanding the distinct roles of the caudal basal ganglia may provide insight into finding selective causes of behavioral disorders in basal ganglia disease.

Altered Effective Connectivity within an Oculomotor Control Network in Unaffected Relatives of Individuals with Schizophrenia

The ability to rapidly stop or change a planned action is a critical cognitive process that is impaired in schizophrenia. The current study aimed to examine whether this impairment reflects familial vulnerability to schizophrenia across two experiments comparing unaffected first-degree relatives to healthy controls. First, we examined performance on a saccadic stop-signal task that required rapid inhibition of an eye movement. Then, in a different sample, we investigated behavioral and neural responses (using fMRI) during a stop-signal task variant that required rapid modification of a prepared eye movement. Here, we examined differences between relatives and healthy controls in terms of activation and effective connectivity within an oculomotor control network during task performance. Like individuals with schizophrenia, the unaffected relatives showed behavioral evidence for more inefficient inhibitory processes. Unlike previous findings in individuals with schizophrenia, however, the relatives showed evidence for a compensatory waiting strategy. Behavioral differences were accompanied by more activation among the relatives in task-relevant regions across conditions and group differences in effective connectivity across the task that were modulated differently by the instruction to exert control over a planned saccade. Effective connectivity parameters were related to behavioral measures of inhibition efficiency. The results suggest that individuals at familial risk for schizophrenia were engaging an oculomotor control network differently than controls and in a way that compromises inhibition efficiency.

Altered effective connectivity within an oculomotor control network in individuals with schizophrenia

Rapid inhibition or modification of actions is a crucial cognitive ability, which is impaired in persons with schizophrenia (SZP). Primate neurophysiology studies have identified a network of brain regions that subserves control over gaze. Here, we examine effective connectivity within this oculomotor control network in SZP and healthy controls (HC). During fMRI, participants performed a stop-signal task variant in which they were instructed to saccade to a visual target (no-step trials) unless a second target appeared (redirect trials); on redirect trials, participants were instructed to inhibit the planned saccade and redirect to the new target. We compared functional responses on redirect trials to no-step trials and used dynamic causal modelling (DCM) to examine group differences in network effective connectivity. Behaviorally, SZP were less efficient at inhibiting, which was related to their employment status. Compared to HC, they showed a smaller difference in activity between redirect trials and no-step trials in frontal eye fields (FEF), supplementary eye fields (SEF), inferior frontal cortex (IFC), thalamus, and caudate. DCM analyses revealed widespread group differences in effective connectivity across the task, including different patterns of self-inhibition in many nodes in SZP. Group differences in how effective connectivity was modulated on redirect trials revealed differences between the FEF and SEF, between the SEF and IFC, between the superior colliculus and the thalamus, and self-inhibition within the FEF and caudate. These results provide insight into the neural mechanisms of inefficient inhibitory control in individuals with schizophrenia.

Common coding of expected value and value uncertainty memories in the prefrontal cortex and basal ganglia output

Recent evidence implicates both basal ganglia and ventrolateral prefrontal cortex (vlPFC) in encoding value memories. However, comparative roles of cortical and basal nodes in value memory are not well understood. Here, single-unit recordings in vlPFC and substantia nigra reticulata (SNr), within macaque monkeys, revealed a larger value signal in SNr that was nevertheless correlated with and had a comparable onset to the vlPFC value signal. The value signal was maintained for many objects (>90) many weeks after reward learning and was resistant to extinction in both regions and to repetition suppression in vlPFC. Both regions showed comparable granularity in encoding expected value and value uncertainty, which was paralleled by enhanced gaze bias during free viewing. The value signal dynamics in SNr could be predicted by combining responses of vlPFC neurons according to their value preferences consistent with a scheme in which cortical neurons reached SNr via direct and indirect pathways.

Primate ventral striatum maintains neural representations of the value of previously rewarded objects for habitual seeking

The ventral striatum (VS) is considered a key region that flexibly updates recent changes in reward values for habit learning. However, this update process may not serve to maintain learned habitual behaviors, which are insensitive to value changes. Here, using fMRI in humans and single-unit electrophysiology in macaque monkeys we report another role of the primate VS: that the value memory subserving habitual seeking is stably maintained in the VS. Days after object-value associative learning, human and monkey VS continue to show increased responses to previously rewarded objects, even when no immediate reward outcomes are expected. The similarity of neural response patterns to each rewarded object increases after learning among participants who display habitual seeking. Our data show that long-term memory of high-valued objects is retained as a single representation in the VS and may be utilized to evaluate visual stimuli automatically to guide habitual behavior.

Laminar Origin of Corticostriatal Projections to the Motor Putamen in the Macaque Brain

In the macaque brain, projections from distant, interconnected cortical areas converge in specific zones of the striatum. For example, specific zones of the motor putamen are targets of projections from frontal motor, inferior parietal, and ventrolateral prefrontal hand-related areas and thus are integral part of the so-called "lateral grasping network." In the present study, we analyzed the laminar distribution of corticostriatal neurons projecting to different parts of the motor putamen. Retrograde neural tracers were injected in different parts of the putamen in 3 Macaca mulatta (one male) and the laminar distribution of the labeled corticostriatal neurons was analyzed quantitatively. In frontal motor areas and frontal operculum, where most labeled cells were located, almost everywhere the proportion of corticostriatal labeled neurons in layers III and/or VI was comparable or even stronger than in layer V. Furthermore, within these regions, the laminar distribution pattern of corticostriatal labeled neurons largely varied independently from their density and from the projecting area/sector, but likely according to the target striatal zone. Accordingly, the present data show that cortical areas may project in different ways to different striatal zones, which can be targets of specific combinations of signals originating from the various cortical layers of the areas of a given network. These observations extend current models of corticostriatal interactions, suggesting more complex modes of information processing in the basal ganglia for different motor and nonmotor functions and opening new questions on the architecture of the corticostriatal circuitry.SIGNIFICANCE STATEMENT Projections from the ipsilateral cerebral cortex are the major source of input to the striatum. Previous studies have provided evidence for distinct zones of the putamen specified by converging projections from specific sets of interconnected cortical areas. The present study shows that the distribution of corticostriatal neurons in the various layers of the primary motor and premotor areas varies depending on the target striatal zone. Accordingly, different striatal zones collect specific combinations of signals from the various cortical layers of their input areas, possibly differing in terms of coding, timing, and direction of information flow (e.g., feed-forward, or feed-back).

The Tail of the Striatum: From Anatomy to Connectivity and Function

The dorsal striatum, the largest subcortical structure of the basal ganglia, is critical in controlling motor, procedural, and reinforcement-based behaviors. Although in mammals the striatum extends widely along the rostro-caudal axis, current knowledge and derived theories about its anatomo-functional organization largely rely on results obtained from studies of its rostral sectors, leading to potentially oversimplified working models of the striatum as a whole. Recent findings indicate that the extreme caudal part of the striatum, also referred to as the tail of striatum (TS), represents an additional functional domain. Here, we provide an overview of past and recent studies revealing that the TS displays a heterogeneous cell-type-specific organization, and a unique input-output connectivity, which poises the TS as an integrator of sensory processing.

How Outcome Uncertainty Mediates Attention, Learning, and Decision-Making

Animals and humans evolved sophisticated nervous systems that endowed them with the ability to form internal-models or beliefs and make predictions about the future to survive and flourish in a world in which future outcomes are often uncertain. Crucial to this capacity is the ability to adjust behavioral and learning policies in response to the level of uncertainty. Until recently, the neuronal mechanisms that could underlie such uncertainty-guided control have been largely unknown. In this review, I discuss newly discovered neuronal circuits in primates that represent uncertainty about future rewards and propose how they guide information-seeking, attention, decision-making, and learning to help us survive in an uncertain world. Lastly, I discuss the possible relevance of these findings to learning in artificial systems.

Long-Term Value Memory in the Primate Posterior Thalamus for Fast Automatic Action

The thalamus is known to process information from various brain regions and relay it to other brain regions, serving an essential role in sensory perception and motor execution. The thalamus also receives inputs from basal ganglia nuclei (BG) involved in value-based decision making, suggesting a role in the value process. We found that neurons in a particular area of the rhesus macaque posterior thalamus encoded the historical value memory of visual objects. Many of these value-coding neurons were located in the suprageniculate nucleus (SGN). This thalamic area directly received anatomical input from the superior colliculus (SC), and the neurons showed visual responses with contralateral preferences. Notably, the value discrimination activity of these thalamic neurons increased during learning, with the learned values stably retained even more than 200 days after learning. Our data indicate that single neurons in the posterior thalamus not only processed simple visual information but also represented historical values. Furthermore, our data suggest an SC-posterior thalamus-BG-SC subcortical loop circuit that encodes the historical value, enabling a quick automatic gaze by bypassing the visual cortex.

Brain Networks Sensitive to Object Novelty, Value, and Their Combination

Novel and valuable objects are motivationally attractive for animals including primates. However, little is known about how novelty and value processing is organized across the brain. We used fMRI in macaques to map brain responses to visual fractal patterns varying in either novelty or value dimensions and compared the results with the structure of functionally connected brain networks determined at rest. The results show that different brain networks possess unique combinations of novelty and value coding. One network identified in the ventral temporal cortex preferentially encoded object novelty, whereas another in the parietal cortex encoded the learned value. A third network, broadly composed of temporal and prefrontal areas (TP network), along with functionally connected portions of the striatum, amygdala, and claustrum, encoded both dimensions with similar activation dynamics. Our results support the emergence of a common currency signal in the TP network that may underlie the common attitudes toward novel and valuable objects.

Heterogeneity in striatal dopamine circuits: Form and function in dynamic reward seeking

The striatal dopamine system has long been studied in the context of reward learning, motivation, and movement. Given the prominent role dopamine plays in a variety of adaptive behavioral states, as well as diseases like addiction, it is essential to understand the full complexity of dopamine neurons and the striatal systems they target. A growing number of studies are uncovering details of the heterogeneity in dopamine neuron subpopulations. Here, we review that work to synthesize current understanding of dopamine system heterogeneity across three levels, anatomical organization, functions in behavior, and modes of action, wherein we focus on signaling profiles and local mechanisms for modulation of dopamine release. Together, these studies reveal new and emerging dimensions of the striatal dopamine system, informing its contribution to dynamic motivational and decision-making processes.

Primate Amygdalo-Nigral Pathway for Boosting Oculomotor Action in Motivating Situations

A primary function of the primate amygdala is to modulate behavior based on emotional cues. To study the underlying neural mechanism, we first inactivated the amygdala locally and temporarily by injecting a GABA agonist. Then, saccadic eye movements and gaze were suppressed only on the contralateral side. Next, we performed optogenetic activation after injecting a viral vector into the amygdala. Optical stimulation in the amygdala excited amygdala neurons, whereas optical stimulation of axon terminals in the substantia nigra pars reticulata inhibited nigra neurons. Optical stimulation in either structure facilitated saccades to the contralateral side. These data suggest that the amygdala controls saccades and gaze through the basal ganglia output to the superior colliculus. Importantly, this amygdala-derived circuit mediates emotional context information, whereas the internal basal ganglia circuit mediates object value information. This finding demonstrates a basic mechanism whereby basal ganglia output can be modulated by other areas conveying distinct information.

Optogenetic manipulation of a value-coding pathway from the primate caudate tail facilitates saccadic gaze shift

In the primate basal ganglia, the caudate tail (CDt) encodes the historical values (good or bad) of visual objects (i.e., stable values), and electrical stimulation of CDt evokes saccadic eye movements. However, it is still unknown how output from CDt conveys stable value signals to govern behavior. Here, we apply a pathway-selective optogenetic manipulation to elucidate how such value information modulates saccades. We express channelrhodopsin-2 in CDt delivered by viral vector injections. Selective optical activation of CDt-derived terminals in the substantia nigra pars reticulata (SNr) inhibits SNr neurons. Notably, these SNr neurons show inhibitory responses to good objects. Furthermore, the optical stimulation causes prolonged excitation of visual-saccadic neurons in the superior colliculus (SC), and induces contralateral saccades. These SC neurons respond more strongly to good than to bad objects in the contralateral hemifield. The present results demonstrate that CDt facilitates saccades toward good objects by serial inhibitory pathways through SNr.

Reward learning biases the direction of saccades

The role of associative reward learning in guiding feature-based attention and spatial attention is well established. However, no studies have looked at the extent to which reward learning can modulate the direction of saccades during visual search. Here, we introduced a novel reward learning paradigm to examine whether reward-associated directions of eye movements can modulate performance in different visual search tasks. Participants had to fixate a peripheral target before fixating one of four disks that subsequently appeared in each cardinal position. This was followed by reward feedback contingent upon the direction chosen, where one direction consistently yielded a high reward. Thus, reward was tied to the direction of saccades rather than the absolute location of the stimulus fixated. Participants selected the target in the high-value direction on the majority of trials, demonstrating robust learning of the task contingencies. In an untimed visual foraging task that followed, which was performed in extinction, initial saccades were reliably biased in the previously rewarded-associated direction. In a second experiment, following the same training procedure, eye movements in the previously high-value direction were facilitated in a saccade-to-target task. Our findings suggest that rewarding directional eye movements biases oculomotor search patterns in a manner that is robust to extinction and generalizes across stimuli and task.

Projections to the putamen from neurons located in the white matter and the claustrum in the macaque

Continuing investigations of corticostriatal connections in rodents emphasize an intricate architecture where striatal projections originate from different combinations of cortical layers, include an inhibitory component, and form terminal arborizations which are cell-type dependent, extensive, or compact. Here, we report that in macaque monkeys, deep and superficial cortical white matter neurons (WMNs), peri-claustral WMNs, and the claustrum proper project to the putamen. WMNs retrogradely labeled by injections in the putamen (four injections in three macaques) were widely distributed, up to 10 mm antero-posterior from the injection site, mainly dorsal to the putamen in the external capsule, and below the premotor cortex. Striatally projecting labeled WMNs (WMNsST) were heterogeneous in size and shape, including a small GABAergic component. We compared the number of WMNsST with labeled claustral and cortical neurons and also estimated their proportion in relation to total WMNs. Since some WMNsST were located adjoining the claustrum, we wanted to compare results for density and distribution of striatally projecting claustral neurons (ClaST). ClaST neurons were morphologically heterogeneous and mainly located in the dorsal and anterior claustrum, in regions known to project to frontal, motor, and cingulate cortical areas. The ratio of ClaST to WMNsST was about 4:1 averaged across the four injections. These results provide new specifics on the connectional networks of WMNs in nonhuman primates, and delineate additional loops in the corticostriatal architecture, consisting of interconnections across cortex, claustralstriatal and striatally projecting WMNs.

Threat reduces value-driven but not salience-driven attentional capture

What we direct our attention to is strongly influenced by both bottom-up and top-down processes. Moreover, the control of attention is biased by prior learning, such that attention is automatically captured by stimuli previously associated with either reward or threat. It is unknown whether value-oriented and threat-oriented mechanisms of selective information processing function independently of one another, or whether they interact with each other in the selection process. Here, we introduced the threat of electric shock into the value-driven attentional capture paradigm to examine whether the experience of threat influences the attention capturing quality of previously reward-associated stimuli. The results showed that value-driven attentional capture was blunted by the experience of threat. This contrasts with previous reports of threat potentiating attentional capture by physically salient stimuli, which we replicate here. Our findings demonstrate that threat selectively interferes with value-based but not salience-based attentional priority, consistent with a competitive relationship between value-based and threat-based information processing. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Neuronal connections of direct and indirect pathways for stable value memory in caudal basal ganglia

Direct and indirect pathways in the basal ganglia work together for controlling behavior. However, it is still a controversial topic whether these pathways are segregated or merged with each other. To address this issue, we studied the connections of these two pathways in the caudal parts of the basal ganglia of rhesus monkeys using anatomical tracers. Our previous studies showed that the caudal basal ganglia control saccades by conveying long-term values (stable values) of many visual objects toward the superior colliculus. In experiment 1, we injected a tracer in the caudate tail (CDt), and found local dense plexuses of axon terminals in the caudal-dorsal-lateral part of substantia nigra pars reticulata (cdlSNr) and the caudal-ventral part of globus pallidus externus (cvGPe). These anterograde projections may correspond to the direct and indirect pathways, respectively. To verify this in experiment 2, we injected different tracers into cdlSNr and cvGPe, and found many retrogradely labeled neurons in CDt and, in addition, the caudal-ventral part of the putamen (cvPut). These cdlSNr-projecting and cvGPe-projecting neurons were found intermingled in both CDt and cvPut (which we call "striatum tail"). A small but significant proportion of neurons (<15%) were double-labeled, indicating that they projected to both cdlSNr and cvGPe. These anatomical results suggest that stable value signals (good vs. bad) are sent from the striatum tail to cdlSNr and cvGPe in a biased (but not exclusive) manner. These connections may play an important role in biasing saccades toward higher valued objects and away from lower valued objects.

The role of the dorsal striatum in choice impulsivity

It has long been recognized that the dorsal striatum is an essential brain region for control of action selection based on action-outcome contingency learning, particularly when the available actions are bound to rewarding outcomes. In principle, intertemporal choice in the delay-discounting task-a validated measure of choice impulsivity-involves reward-associated actions that require the recruitment of the dorsal striatum. Here, we conjecture about ways the dorsal striatum is involved in choice impulsivity. Based on a selective body of studies, we begin with a brief history of research on choice impulsivity and the dorsal striatum, and then provide a comprehensive summary of contemporary studies utilizing human neuroimaging and animal models to search for links between choice impulsivity and the dorsal striatum. In particular, we discuss in-depth the converging evidence for the associations of choice impulsivity with the reward valuation coded by the caudate, a ventral-to-dorsal gradient in the dorsal striatum, the origins of striatal afferents, and developmental maturation of frontostriatal connectivity during adolescence.

The Organization and Operation of Inferior Temporal Cortex

Inferior temporal cortex (IT) is a key part of the ventral visual pathway implicated in object, face, and scene perception. But how does IT work? Here, I describe an organizational scheme that marries form and function and provides a framework for future research. The scheme consists of a series of stages arranged along the posterior-anterior axis of IT, defined by anatomical connections and functional responses. Each stage comprises a complement of subregions that have a systematic spatial relationship. The organization of each stage is governed by an eccentricity template, and corresponding eccentricity representations across stages are interconnected. Foveal representations take on a role in high-acuity object vision (including face recognition); intermediate representations compute other aspects of object vision such as behavioral valence (using color and surface cues); and peripheral representations encode information about scenes. This multistage, parallel-processing model invokes an innately determined organization refined by visual experience that is consistent with principles of cortical development. The model is also consistent with principles of evolution, which suggest that visual cortex expanded through replication of retinotopic areas. Finally, the model predicts that the most extensively studied network within IT-the face patches-is not unique but rather one manifestation of a canonical set of operations that reveal general principles of how IT works.

Prefrontal Cortex Represents Long-Term Memory of Object Values for Months

As a central hub for cognitive control, prefrontal cortex (PFC) is thought to utilize memories. However, unlike working or short-term memory, the neuronal representation of long-term memory in PFC has not been systematically investigated. Using single-unit recordings in macaques, we show that PFC neurons rapidly update and maintain responses to objects based on short-term reward history. Interestingly, after repeated object-reward association, PFC neurons continue to show value-biased responses to objects even in the absence of reward. This value-biased response is retained for several months after training and is resistant to extinction and to interference from new object-reward learning for many complex objects (>90). Accordingly, the monkeys remember the values of the learned objects for several months in separate testing. These findings reveal that in addition to flexible short-term and low-capacity memories, primate PFC represents stable long-term and high-capacity memories, which could prioritize valuable objects far into the future.

Anatomical Inputs From the Sensory and Value Structures to the Tail of the Rat Striatum

The caudal region of the rodent striatum, called the tail of the striatum (TS), is a relatively small area but might have a distinct function from other striatal subregions. Recent primate studies showed that this part of the striatum has a unique function in encoding long-term value memory of visual objects for habitual behavior. This function might be due to its specific connectivity. We identified inputs to the rat TS and compared those with inputs to the dorsomedial striatum (DMS) in the same animals. The TS directly received anatomical inputs from both sensory structures and value-coding regions, but the DMS did not. First, inputs from the sensory cortex and sensory thalamus to the TS were found; visual, auditory, somatosensory and gustatory cortex and thalamus projected to the TS but not to the DMS. Second, two value systems innervated the TS; dopamine and serotonin neurons in the lateral part of the substantia nigra pars compacta (SNc) and dorsal raphe nucleus projected to the TS, respectively. The DMS received inputs from the separate group of dopamine neurons in the medial part of the SNc. In addition, learning-related regions of the limbic system innervated the TS; the temporal areas and the basolateral amygdala selectively innervated the TS, but not the DMS. Our data showed that both sensory and value-processing structures innervated the TS, suggesting its plausible role in value-guided sensory-motor association for habitual behavior.

Direct and indirect pathways for choosing objects and actions

A prominent target of the basal ganglia is the superior colliculus (SC) which controls gaze orientation (saccadic eye movement in primates) to an important object. This 'object choice' is crucial for choosing an action on the object. SC is innervated by the substantia nigra pars reticulata (SNr) which is controlled mainly by the caudate nucleus (CD). This CD-SNr-SC circuit is sensitive to the values of individual objects and facilitates saccades to good objects. The object values are processed differently in two parallel circuits: flexibly by the caudate head (CDh) and stably by the caudate tail (CDt). To choose good objects, we need to reject bad objects. In fact, these contrasting functions are accomplished by the circuit originating from CDt: The direct pathway focuses on good objects and facilitates saccades to them; the indirect pathway focuses on bad objects and suppresses saccades to them. Inactivation of CDt deteriorated the object choice, because saccades to bad objects were no longer suppressed. This suggests that the indirect pathway is important for object choice. However, the direct and indirect pathways for 'object choice', which aim at the same action (i.e., saccade), may not work for 'action choice'. One possibility is that circuits controlling different actions are connected through the indirect pathway. Additional connections of the indirect pathway with brain areas outside the basal ganglia may also provide a wider range of behavioral choice. In conclusion, basal ganglia circuits are composed of the basic direct/indirect pathways and additional connections and thus have acquired multiple functions.

Temporal-prefrontal cortical network for discrimination of valuable objects in long-term memory

Remembering and discriminating objects based on their previously learned values are essential for goal-directed behaviors. While the cerebral cortex is known to contribute to object recognition, surprisingly little is known about its role in retaining long-term object-value associations. To address this question, we trained macaques to arbitrarily associate small or large rewards with many random fractal objects (>100) and then used fMRI to study the long-term retention of value-based response selectivity across the brain. We found a pronounced long-term value memory in core subregions of temporal and prefrontal cortex where, several months after training, fractals previously associated with high reward ("good" stimuli) elicited elevated fMRI responses compared with those associated with low reward ("bad" stimuli). Similar long-term value-based modulation was also observed in subregions of the striatum, amygdala, and claustrum, but not in the hippocampus. The value-modulated temporal-prefrontal subregions showed strong resting-state functional connectivity to each other. Moreover, for areas outside this core, the magnitude of long-term value responses was predicted by the strength of resting-state functional connectivity to the core subregions. In separate testing, free-viewing gaze behavior indicated that the monkeys retained stable long-term memory of object value. These results suggest an implicit and high-capacity memory mechanism in the temporal-prefrontal circuitry and its associated subcortical regions for long-term retention of object-value memories that can guide value-oriented behavior.