GABAA-mediated inhibition of basolateral amygdala blocks reward devaluation in macaques

Focal pharmacological manipulation of serotonin signaling in the amygdala does not alter social behavior

Serotonin signaling plays critical roles in social and emotional behaviors. Likewise, decades of research demonstrate that the amygdala is a prime modulator of social behavior. Permanent excitotoxic lesions and transient amygdala inactivation consistently increase social behaviors in non-human primates. In rodents, acute systemic administration of drugs that increase serotonin signaling is associated with decreased social interactions. However, in primates, the direct involvement of serotonin signaling in the amygdala, particularly in affiliative social interaction, remains unexplored. Here, we examined the effects of serotonin manipulations within the amygdala on social behavior in eight pairs of familiar male macaques. We microinfused drugs targeting the serotonin system into either the basolateral (BLA) or central (CeA) amygdala and measured changes in social behavior. Surprisingly, the results demonstrated no significant differences in social behavior following the infusion of a selective serotonin reuptake inhibitor, 5-HT1A agonist or antagonist, 5-HT2A agonist or antagonist, or 5-HT3 agonist or antagonist into either the BLA or CeA. These findings suggest that serotonin signaling in the amygdala does not directly contribute to the regulation of social behavior between familiar conspecifics. Future research should explore alternative mechanisms and potential interactions with other brain regions to gain a comprehensive understanding of the complex neural circuitry governing social behavior.

A corticoamygdalar pathway controls reward devaluation and depression using dynamic inhibition code

Reward devaluation adaptively controls reward intake. It remains unclear how cortical circuits causally encode reward devaluation in healthy and depressed states. Here, we show that the neural pathway from the anterior cingulate cortex (ACC) to the basolateral amygdala (BLA) employs a dynamic inhibition code to control reward devaluation and depression. Fiber photometry and imaging of ACC pyramidal neurons reveal reward-induced inhibition, which weakens during satiation and becomes further attenuated in depression mouse models. Ablating or inhibiting these neurons desensitizes reward devaluation, causes reward intake increase and ultimate obesity, and ameliorates depression, whereas activating the cells sensitizes reward devaluation, suppresses reward consumption, and produces depression-like behaviors. Among various ACC neuron subpopulations, the BLA-projecting subset bidirectionally regulates reward devaluation and depression-like behaviors. Our study thus uncovers a corticoamygdalar circuit that encodes reward devaluation via blunted inhibition and suggests that enhancing inhibition within this circuit may offer a therapeutic approach for treating depression.

Quinpirole, but not muscimol, infused into the nucleus accumbens disrupts prepulse inhibition of the acoustic startle in rhesus macaques

Sensorimotor gating is the ability to suppress motor responses to irrelevant sensory inputs. This response is disrupted in a range of neuropsychiatric disorders. Prepulse inhibition (PPI) of the acoustic startle response (ASR) is a form of sensorimotor gating in which a low-intensity prepulse immediately precedes a startling stimulus, resulting in an attenuation of the startle response. PPI is conserved across species and the underlying circuitry mediating this effect has been widely studied in rodents. However, recent work from our laboratories has shown an unexpected divergence between the circuitry controlling PPI in rodents as compared to macaques. The nucleus accumbens, a component of the basal ganglia, has been identified as a key modulatory node for PPI in rodents. The role of the nucleus accumbens in modulating PPI in primates has yet to be investigated. We measured whole-body PPI of the ASR in six rhesus macaques following (1) pharmacological inhibition of the nucleus accumbens using the GABAA agonist muscimol, and (2) focal application of the dopamine D2/3 agonist quinpirole (at 3 doses). We found that quinpirole, but not muscimol, infused into the nucleus accumbens disrupts prepulse inhibition in monkeys. These results differ from those observed in rodents, where both muscimol and quinpirole disrupt prepulse inhibition.

The orbitofrontal cortex: A goal-directed cognitive map framework for social and non-social behaviors

The orbitofrontal cortex (OFC) is regarded as one of the core brain areas in a variety of value-based behaviors. Over the past two decades, tremendous knowledge about the OFC function was gained from studying the behaviors of single subjects. As a result, our previous understanding of the OFC's function of encoding decision variables, such as the value and identity of choices, has evolved to the idea that the OFC encodes a more complex representation of the task space as a cognitive map. Accumulating evidence also indicates that the OFC importantly contributes to behaviors in social contexts, especially those involved in cooperative interactions. However, it remains elusive how exactly OFC neurons contribute to social functions and how non-social and social behaviors are related to one another in the computations performed by OFC neurons. In this review, we aim to provide an integrated view of the OFC function across both social and non-social behavioral contexts. We propose that seemingly complex functions of the OFC may be explained by its role in providing a goal-directed cognitive map to guide a wide array of adaptive reward-based behaviors in both social and non-social domains.

Pharmacological Inactivation of the Bed Nucleus of the Stria Terminalis Increases Affiliative Social Behavior in Rhesus Macaques

The bed nucleus of the stria terminalis (BNST) has been implicated in a variety of social behaviors, including aggression, maternal care, mating behavior, and social interaction. Limited evidence from rodent studies suggests that activation of the BNST results in a decrease in social interaction between unfamiliar animals. The role of the BNST in social interaction in primates remains wholly unexamined. Nonhuman primates provide a valuable model for studying social behavior because of both their rich social repertoire and neural substrates of behavior with high translational relevance to humans. To test the hypothesis that the primate BNST is a critical modulator of social behavior, we performed intracerebral microinfusions of the GABAA agonist muscimol to transiently inactivate the BNST in male macaque monkeys. We measured changes in social interaction with a familiar same-sex conspecific. Inactivation of the BNST resulted in significant increase in total social contact. This effect was associated with an increase in passive contact and a significant decrease in locomotion. Other nonsocial behaviors (sitting passively alone, self-directed behaviors, and manipulation) were not impacted by BNST inactivation. As part of the "extended amygdala," the BNST is highly interconnected with the basolateral (BLA) and central (CeA) nuclei of the amygdala, both of which also play critical roles in regulating social interaction. The precise pattern of behavioral changes we observed following inactivation of the BNST partially overlaps with our prior reports in the BLA and CeA. Together, these data demonstrate that the BNST is part of a network regulating social behavior in primates.SIGNIFICANCE STATEMENT The bed nucleus of the stria terminalis (BNST) has a well-established role in anxiety behaviors, but its role in social behavior is poorly understood. No prior studies have evaluated the impact of BNST manipulations on social behavior in primates. We found that transient pharmacological inactivation of the BNST increased social behavior in pairs of macaque monkeys. These data suggest the BNST contributes to the brain networks regulating sociability.

Bidirectional and parallel relationships in macaque face circuit revealed by fMRI and causal pharmacological inactivation

Although the presence of face patches in primate inferotemporal (IT) cortex is well established, the functional and causal relationships among these patches remain elusive. In two monkeys, muscimol was infused sequentially into each patch or pair of patches to assess their respective influence on the remaining IT face network and the amygdala, as determined using fMRI. The results revealed that anterior face patches required input from middle face patches for their responses to both faces and objects, while the face selectivity in middle face patches arose, in part, from top-down input from anterior face patches. Moreover, we uncovered a parallel fundal-lateral functional organization in the IT face network, supporting dual routes (dorsal-ventral) in face processing within IT cortex as well as between IT cortex and the amygdala. Our findings of the causal relationship among the face patches demonstrate that the IT face circuit is organized into multiple functional compartments.

Selective Prefrontal-Amygdala Circuit Interactions Underlie Social and Nonsocial Valuation in Rhesus Macaques

Lesion studies in macaques suggest dissociable functions of the orbitofrontal cortex (OFC) and medial frontal cortex (MFC), with OFC being essential for goal-directed decision-making and MFC supporting social cognition. Bilateral amygdala damage results in impairments in both of these domains. There are extensive reciprocal connections between these prefrontal areas and the amygdala; however, it is not known whether the dissociable roles of OFC and MFC depend on functional interactions with the amygdala. To test this possibility, we compared the performance of male rhesus macaques (Macaca mulatta) with crossed surgical disconnection of the amygdala and either MFC (MFC × AMY, n = 4) or OFC (OFC × AMY, n = 4) to a group of unoperated controls (CON, n = 5). All monkeys were assessed for their performance on two tasks to measure the following: (1) food-retrieval latencies while viewing videos of social and nonsocial stimuli in a test of social interest and (2) object choices based on current food value using reinforcer devaluation in a test of goal-directed decision-making. Compared with the CON group, the MFC × AMY group, but not the OFC × AMY group, showed significantly reduced food-retrieval latencies while viewing videos of conspecifics, indicating reduced social valuation and/or interest. By contrast, on the devaluation task, group OFC × AMY, but not group MFC × AMY, displayed deficits on object choices following changes in food value. These data indicate that the MFC and OFC must functionally interact with the amygdala to support normative social and nonsocial valuation, respectively.SIGNIFICANCE STATEMENT Ascribing value to conspecifics (social) versus objects (nonsocial) may be supported by distinct but overlapping brain networks. Here, we test whether two nonoverlapping regions of the prefrontal cortex, the medial frontal cortex and the orbitofrontal cortex, must causally interact with the amygdala to sustain social valuation and goal-directed decision-making, respectively. We found that these prefrontal-amygdala circuits are functionally dissociable, lending support for the idea that medial frontal and orbital frontal cortex make independent contributions to cognitive appraisals of the environment. These data provide a neural framework for distinct value assignment processes and may enhance our understanding of the cognitive deficits observed following brain injury or in the development of mental health disorders.

Brain structures associated with individual differences in decisional and emotional forgiveness

In responding to interpersonal conflicts, forgiveness goes a long way. Past brain imaging studies have examined the activation patterns of forgiving responses. However, the individual differences in brain structures associated with decisional forgiveness and emotional forgiveness are not well understood. In this voxel-based morphometry study, participants (85 men, 210 women) completed the Decisional Forgiveness Scale (DFS) and the Emotional Forgiveness Scale (EFS) and underwent an anatomical magnetic resonance imaging scan. Higher DFS scores were associated with larger GM volumes in a cluster that included regions in the orbitofrontal cortex (OFC). Higher EFS scores were associated with larger GM volumes in a cluster that included regions in the medial prefrontal cortex (mPFC) and the superior frontal gyrus (SFG), which were also associated with smaller GM volumes in a cluster that included regions in the left inferior parietal lobule (IPL). The associations between the identified regions and DFS scores and EFS scores were supported by the cross-validation test. In addition, the GMV of OFC, mPFC and SFG partially mediated the relationship between DFS and EFS. These results provide direct neuroanatomical evidence for an association between decisional and emotional forgiveness and brain regions which are critical for cognitive control, theory of mind and moral judgment.

Prefrontal cortex interactions with the amygdala in primates

This review addresses functional interactions between the primate prefrontal cortex (PFC) and the amygdala, with emphasis on their contributions to behavior and cognition. The interplay between these two telencephalic structures contributes to adaptive behavior and to the evolutionary success of all primate species. In our species, dysfunction in this circuitry creates vulnerabilities to psychopathologies. Here, we describe amygdala-PFC contributions to behaviors that have direct relevance to Darwinian fitness: learned approach and avoidance, foraging, predator defense, and social signaling, which have in common the need for flexibility and sensitivity to specific and rapidly changing contexts. Examples include the prediction of positive outcomes, such as food availability, food desirability, and various social rewards, or of negative outcomes, such as threats of harm from predators or conspecifics. To promote fitness optimally, these stimulus-outcome associations need to be rapidly updated when an associative contingency changes or when the value of a predicted outcome changes. We review evidence from nonhuman primates implicating the PFC, the amygdala, and their functional interactions in these processes, with links to experimental work and clinical findings in humans where possible.

Functions of primate amygdala neurons in economic decisions and social decision simulation

Long implicated in aversive processing, the amygdala is now recognized as a key component of the brain systems that process rewards. Beyond reward valuation, recent findings from single-neuron recordings in monkeys indicate that primate amygdala neurons also play an important role in decision-making. The reward value signals encoded by amygdala neurons constitute suitable inputs to economic decision processes by being sensitive to reward contingency, relative reward quantity and temporal reward structure. During reward-based decisions, individual amygdala neurons encode both the value inputs and corresponding choice outputs of economic decision processes. The presence of such value-to-choice transitions in single amygdala neurons, together with other well-defined signatures of decision computation, indicate that a decision mechanism may be implemented locally within the primate amygdala. During social observation, specific amygdala neurons spontaneously encode these decision signatures to predict the choices of social partners, suggesting neural simulation of the partner's decision-making. The activity of these 'simulation neurons' could arise naturally from convergence between value neurons and social, self-other discriminating neurons. These findings identify single-neuron building blocks and computational architectures for decision-making and social behavior in the primate amygdala. An emerging understanding of the decision function of primate amygdala neurons can help identify potential vulnerabilities for amygdala dysfunction in human conditions afflicting social cognition and mental health.

Choose your path: Divergent basolateral amygdala efferents differentially mediate incentive motivation, flexibility and decision-making

To survive in a complex environment, individuals form associations between environmental stimuli and rewards to organize and optimize reward seeking behaviors. The basolateral amygdala (BLA) uses these learned associations to inform decision-making processes. In this review, we describe functional projections between BLA and its cortical and striatal targets that promote learning and motivational processes central to decision-making. Specifically, we compare and contrast divergent projections from the BLA to the orbitofrontal (OFC) and to the nucleus accumbens (NAc) and examine the roles of these pathways in associative learning, value-guided decision-making, choice behaviors, as well as cue and context-driven drug seeking. Finally, we consider how these projections are involved in disorders of motivation, with a focus on Substance Use Disorder.

Preferences for nutrients and sensory food qualities identify biological sources of economic values in monkeys

Value is a foundational concept in reinforcement learning and economic choice theory. In these frameworks, individuals choose by assigning values to objects and learn by updating values with experience. These theories have been instrumental for revealing influences of probability, risk, and delay on choices. However, they do not explain how values are shaped by intrinsic properties of the choice objects themselves. Here, we investigated how economic value derives from the biologically critical components of foods: their nutrients and sensory qualities. When monkeys chose nutrient-defined liquids, they consistently preferred fat and sugar to low-nutrient alternatives. Rather than maximizing energy indiscriminately, they seemed to assign subjective values to specific nutrients, flexibly trading them against offered reward amounts. Nutrient-value functions accurately modeled these preferences, predicted choices across contexts, and accounted for individual differences. The monkeys' preferences shifted their daily nutrient balance away from dietary reference points, contrary to ecological foraging models but resembling human suboptimal eating in free-choice situations. To identify the sensory basis of nutrient values, we developed engineering tools that measured food textures on biological surfaces, mimicking oral conditions. Subjective valuations of two key texture parameters-viscosity and sliding friction-explained the monkeys' fat preferences, suggesting a texture-sensing mechanism for nutrient values. Extended reinforcement learning and choice models identified candidate neuronal mechanisms for nutrient-sensitive decision-making. These findings indicate that nutrients and food textures constitute critical reward components that shape economic values. Our nutrient-choice paradigm represents a promising tool for studying food-reward mechanisms in primates to better understand human-like eating behavior and obesity.

A bidirectional corticoamygdala circuit for the encoding and retrieval of detailed reward memories

Adaptive reward-related decision making often requires accurate and detailed representation of potential available rewards. Environmental reward-predictive stimuli can facilitate these representations, allowing one to infer which specific rewards might be available and choose accordingly. This process relies on encoded relationships between the cues and the sensory-specific details of the rewards they predict. Here, we interrogated the function of the basolateral amygdala (BLA) and its interaction with the lateral orbitofrontal cortex (lOFC) in the ability to learn such stimulus-outcome associations and use these memories to guide decision making. Using optical recording and inhibition approaches, Pavlovian cue-reward conditioning, and the outcome-selective Pavlovian-to-instrumental transfer (PIT) test in male rats, we found that the BLA is robustly activated at the time of stimulus-outcome learning and that this activity is necessary for sensory-specific stimulus-outcome memories to be encoded, so they can subsequently influence reward choices. Direct input from the lOFC was found to support the BLA in this function. Based on prior work, activity in BLA projections back to the lOFC was known to support the use of stimulus-outcome memories to influence decision making. By multiplexing optogenetic and chemogenetic inhibition we performed a serial circuit disconnection and found that the lOFC→BLA and BLA→lOFC pathways form a functional circuit regulating the encoding (lOFC→BLA) and subsequent use (BLA→lOFC) of the stimulus-dependent, sensory-specific reward memories that are critical for adaptive, appetitive decision making.

Noninvasive Brain Stimulation Rescues Cocaine-Induced Prefrontal Hypoactivity and Restores Flexible Behavior

BACKGROUND

To obtain desirable goals, individuals must predict the outcome of specific choices, use that information to direct appropriate actions, and adjust behavior accordingly in changing environments (behavioral flexibility). Substance use disorders are marked by impairments in behavioral flexibility along with decreased prefrontal cortical function that limits the efficacy of treatment strategies. Restoring prefrontal hypoactivity, ideally in a noninvasive manner, is an intriguing target for improving flexible behavior and treatment outcomes.

METHODS

A behavioral flexibility task was used in Long-Evans male rats (n = 97) in conjunction with electrophysiology, optogenetics, and a novel rat model of transcranial alternating current stimulation (tACS) to examine the prelimbic cortex (PrL) to nucleus accumbens (NAc) core circuit in behavioral flexibility and determine whether tACS can restore cocaine-induced neural and cognitive dysfunction.

RESULTS

Optogenetic inactivation revealed that the PrL-NAc core circuit is necessary for the ability to learn strategies to flexibly shift behavior. Cocaine self-administration history caused aberrant PrL-NAc core neural encoding and deficits in flexibility. Optogenetics that selectively activated the PrL-NAc core pathway prior to learning rescued cocaine-induced cognitive flexibility deficits. Remarkably, tACS prior to learning the task reestablished adaptive signaling in the PrL-NAc circuit and restored flexible behavior in a relatively noninvasive and frequency-specific manner.

CONCLUSIONS

We establish a role of NAc core-projecting PrL neurons in behavioral flexibility and provide a novel noninvasive brain stimulation method in rats to rescue cocaine-induced frontal hypofunction and restore flexible behavior, supporting a role of tACS as a therapeutic to treat cognitive deficits in substance use disorders.

The Parahippocampal Cortex and its Functional Connection with the Hippocampus are Critical for Nonnavigational Spatial Memory in Macaques

The Hamilton Search Task (HST) is a test of nonnavigational spatial memory that is dependent on the hippocampus. The parahippocampal cortex (PHC) is a major route for spatial information to reach the hippocampus, but the extent to which the PHC and hippocampus function independently of one another in the context of nonnavigational spatial memory is unclear. Here, we tested the hypotheses that (1) bilateral pharmacological inactivation of the PHC would impair HST performance, and (2) that functional disconnection of the PHC and hippocampus by contralateral (crossed) inactivation would likewise impair performance. Transient inactivation of the PHC impaired HST performance most robustly with 30 s intertrial delays, but not when color cues were introduced. Functional disconnection of the PHC and hippocampus, but not separate unilateral inactivation of either region, also selectively impaired long-term spatial memory. These findings indicate a critical role for the PHC and its interactions with the hippocampus in nonnavigational spatial memory.

Prediction errors and valence: From single units to multidimensional encoding in the amygdala

The amygdala-one of the primary structures of the limbic system-is comprised of interconnected nuclei situated within the temporal lobe. It has a well-established role in the modulation of negative affective states, as well as in fear processing. However, its vast projections with diverse brain regions-ranging from the cortex to the brainstem-are suggestive of its more complex involvement in affective or motivational aspects of cognitive processing. The amygdala can play an invaluable role in context-dependent associative learning, unsigned prediction error learning, influencing outcome selection, and multidimensional encoding. In this review, we delve into the amygdala's role in associative learning and outcome selection, emphasizing its intrinsic involvement in the appropriate context-dependent modulation of motivated behavior.

Inhibition of the Deep and Intermediate Layers of the Superior Colliculus Disrupts Sensorimotor Gating in Monkeys

The deep and intermediate layers of the superior colliculus (DLSC) respond to visual, auditory, and tactile inputs and act as a multimodal sensory association area. In turn, activity in the DLSC can drive orienting and avoidance responses-such as saccades and head and body movements-across species, including in rats, cats, and non-human primates. As shown in rodents, DLSC also plays a role in regulating pre-pulse inhibition (PPI) of the acoustic startle response (ASR), a form of sensorimotor gating. DLSC lesions attenuate PPI and electrical stimulation of DLSC inhibits the startle response. While the circuitry mediating PPI is well-characterized in rodents, less is known about PPI regulation in primates. Two recent studies from our labs reported a species difference in the effects of pharmacological inhibition of the basolateral amygdala and substantia nigra pars reticulata (SNpr) on PPI between rats and macaques: in rats, inhibition of these structures decreased PPI, while in macaques, it increased PPI. Given that the SNpr sends direct inhibitory projections to DLSC, we next sought to determine if this species difference was similarly evident at the level of DLSC. Here, we transiently inactivated DLSC in four rhesus macaques by focal microinfusion of the GABAA receptor agonist muscimol. Similar to findings reported in rodents, we observed that bilateral inhibition of the DLSC in macaques significantly disrupted PPI. The impairment was specific to the PPI as the ASR itself was not affected. These results indicate that our previously reported species divergence at the level of the SNpr is not due to downstream differences at the level of the DLSC. Species differences at the level of the SNpr and basolateral amygdala emphasize the importance of studying the underlying circuitry in non-human primates, as impairment in PPI has been reported in several disorders in humans, including schizophrenia, autism, and PTSD.

Dysregulation of behavioral and autonomic responses to emotional and social stimuli following bidirectional pharmacological manipulation of the basolateral amygdala in macaques

The amygdala is a key component of the neural circuits mediating the processing and response to emotionally salient stimuli. Amygdala lesions dysregulate social interactions, responses to fearful stimuli, and autonomic functions. In rodents, the basolateral and central nuclei of the amygdala have divergent roles in behavioral control. However, few studies have selectively examined these nuclei in the primate brain. Moreover, the majority of non-human primate studies have employed lesions, which only allow for unidirectional manipulation of amygdala activity. Thus, the effects of amygdala disinhibition on behavior in the primate are unknown. To address this gap, we pharmacologically inhibited by muscimol or disinhibited by bicuculline methiodide the basolateral complex of the amygdala (BLA; lateral, basal, and accessory basal) in nine awake, behaving male rhesus macaques (Macaca mulatta). We examined the effects of amygdala manipulation on: (1) behavioral responses to taxidermy snakes and social stimuli, (2) food competition and social interaction in dyads, (3) autonomic arousal as measured by cardiovascular response, and (4) prepulse inhibition of the acoustic startle (PPI) response. All modalities were impacted by pharmacological inhibition and/or disinhibition. Amygdala inhibition decreased fear responses to snake stimuli, increased examination of social stimuli, reduced competitive reward-seeking in dominant animals, decreased heart rate, and increased PPI response. Amygdala disinhibition restored fearful response after habituation to snakes, reduced competitive reward-seeking behavior in dominant animals, and lowered heart rate. Thus, both hypoactivity and hyperactivity of the basolateral amygdala can lead to dysregulated behavior, suggesting that a narrow range of activity is necessary for normal functions.

Effects of hM4Di activation in CamKII basolateral amygdala neurons and CNO treatment on sensory-specific vs. general PIT: refining PIT circuits and considerations for using CNO

BACKGROUND

Pavlovian stimuli can influence instrumental behaviors via phenomena such as Pavlovian-to-instrumental transfer (PIT). PIT arises via dissociable processes as sensory-specific PIT (SS-PIT) and general PIT. The basolateral amygdala (BLA) mediates SS-PIT, but not general PIT. However, the specific BLA neuronal populations involved are unknown.

AIMS

To determine the contribution of glutamatergic BLA neurons to the expression of SS-PIT and to the recall of sensory-specific properties of stimulus-outcome associations.

METHODS

BLA neurons were transduced with virus containing either GFP or hM4Di, driven by the CamKII promoter. Rats were then tested for SS and general PIT and subsequently for expression of Pavlovian outcome devaluation effects and conditioned taste aversion following injections of vehicle or clozapine-N-oxide (CNO, the hM4Di agonist).

RESULTS

CNO selectively blocked SS-PIT in the hM4Di-expressing group, but not controls, without altering expression of Pavlovian outcome devaluation or sensory-specific taste aversion in either group. Unexpectedly, CNO disrupted general PIT in both groups.

CONCLUSIONS

CamKII BLA neurons mediate the expression of SS-PIT by enabling Pavlovian stimuli to trigger recall of the correct action-outcome associations rather than by mediating recall of the sensory-specific properties of the stimulus-outcome association. Separately, our data demonstrate that CNO alone is sufficient to disrupt affective, but not sensory-specific processes, an effect that was not due to generalized motor disruption. This non-specific effect on general PIT may be related to CNO-induced shifts in internal state. Together, these data identify BLA CamKII neurons as critical for the expression of SS-PIT and reveal important considerations for using CNO to study general affective motivation.

Chemogenetic Inhibition of the Amygdala Modulates Emotional Behavior Expression in Infant Rhesus Monkeys

Manipulation of neuronal activity during the early postnatal period in monkeys has been largely limited to permanent lesion studies, which can be impacted by developmental plasticity leading to reorganization and compensation from other brain structures that can interfere with the interpretations of results. Chemogenetic tools, such as DREADDs (designer receptors exclusively activated by designer drugs), can transiently and reversibly activate or inactivate brain structures, avoiding the pitfalls of permanent lesions to better address important developmental neuroscience questions. We demonstrate that inhibitory DREADDs in the amygdala can be used to manipulate socioemotional behavior in infant monkeys. Two infant rhesus monkeys (1 male, 1 female) received AAV5-hSyn-HA-hM4Di-IRES-mCitrine injections bilaterally in the amygdala at 9 months of age. DREADD activation after systemic administration of either clozapine-N-oxide or low-dose clozapine resulted in decreased freezing and anxiety on the human intruder paradigm and changed the looking patterns on a socioemotional attention eye-tracking task, compared with vehicle administration. The DREADD-induced behaviors were reminiscent of, but not identical to, those seen after permanent amygdala lesions in infant monkeys, such that neonatal lesions produce a more extensive array of behavioral changes in response to the human intruder task that were not seen with DREADD-evoked inhibition of this region. Our results may help support the notion that the more extensive behavior changes seen after early lesions are manifested from brain reorganization that occur after permanent damage. The current study provides a proof of principle that DREADDs can be used in young infant monkeys to transiently and reversibly manipulate behavior.

Pre-training inactivation of basolateral amygdala and mediodorsal thalamus, but not orbitofrontal cortex or prelimbic cortex, impairs devaluation in a multiple-response/multiple-reinforcer cued operant task

Reinforcer devaluation is a task often used to model flexible goal-directed behavior. Here, we inactivated basolateral amygdala (BLA), orbitofrontal cortex (OFC), mediodorsal thalamus (MD) (Exp. 1) and prelimbic cortex (PL) (Exp. 3) in rats during multiple-response/multiple-reinforcer operant training with levers available to earn reinforcers during cued trials. After two training days with each lever-food relationship, a reinforcer was devalued through selective satiety and devaluation was assessed in a choice test with the brain areas non-inactivated. The control and OFC and PL inactivation groups exhibited a devaluation effect, but the BLA or MD groups did not. Since the OFC is proposed to be required in devaluation tasks when a discrete cue signals an outcome and PL is proposed to be required when responses based on lever spatial-location guide behavior, we ran new rats through a cue-switching experiment (Exp. 2) to determine the strategy rats use to complete our task (attending to the discrete light cue or spatial lever location). Both groups (cue switched and cue normal) showed a devaluation effect based on the lever spatial location, suggesting that rats rely on the spatial lever location to guide behavior. Future studies will determine whether OFC and PL can compensate for each other to show intact devaluation when the functioning of one of them is impaired.

Specializations for reward-guided decision-making in the primate ventral prefrontal cortex

The estimated values of choices, and therefore decision-making based on those values, are influenced by both the chance that the chosen items or goods can be obtained (availability) and their current worth (desirability) as well as by the ability to link the estimated values to choices (a process sometimes called credit assignment). In primates, the prefrontal cortex (PFC) has been thought to contribute to each of these processes; however, causal relationships between particular subdivisions of the PFC and specific functions have been difficult to establish. Recent lesion-based research studies have defined the roles of two different parts of the primate PFC - the orbitofrontal cortex (OFC) and the ventral lateral frontal cortex (VLFC) - and their subdivisions in evaluating each of these factors and in mediating credit assignment during reward-based decision-making.

Colocalization of Tectal Inputs With Amygdala-Projecting Neurons in the Macaque Pulvinar

Neuropsychological and neuroimaging studies have suggested the presence of a fast, subcortical route for the processing of emotionally-salient visual information in the primate brain. This putative pathway consists of the superior colliculus (SC), pulvinar and amygdala. While the presence of such a pathway has been confirmed in sub-primate species, it has yet to be documented in the primate brain using conventional anatomical methods. We injected retrograde tracers into the amygdala and anterograde tracers into the colliculus, and examined regions of colocalization of these signals within the pulvinar of the macaque. Anterograde tracers injected into the SC labeled axonal projections within the pulvinar, primarily within the oral, lateral and medial subdivisions. These axonal projections from the colliculus colocalized with cell bodies within the pulvinar that were labeled by retrograde tracer injected into the lateral amygdala. This zone of overlap was most notable in the medial portions of the medial (PM), oral (PO) and inferior pulvinar (PI), and was often densely concentrated in the vicinity of the brachium of the SC. These data provide an anatomical basis for the previously suggested pathway mediating fast processing of emotionally salient information.

Amygdala Represents Diverse Forms of Intangible Knowledge, That Illuminate Social Processing and Major Clinical Disorders

Amygdala is an intensively researched brain structure involved in social processing and multiple major clinical disorders, but its functions are not well understood. The functions of a brain structure are best hypothesized on the basis of neuroanatomical connectivity findings, and of behavioral, neuroimaging, neuropsychological and physiological findings. Among the heaviest neuroanatomical interconnections of amygdala are those with perirhinal cortex (PRC), but these are little considered in the theoretical literature. PRC integrates complex, multimodal, meaningful and fine-grained distributed representations of objects and conspecifics. Consistent with this connectivity, amygdala is hypothesized to contribute meaningful and fine-grained representations of intangible knowledge for integration by PRC. Behavioral, neuroimaging, neuropsychological and physiological findings further support amygdala mediation of a diversity of such representations. These representations include subjective valence, impact, economic value, noxiousness, importance, ingroup membership, social status, popularity, trustworthiness and moral features. Further, the formation of amygdala representations is little understood, and is proposed to be often implemented through embodied cognition mechanisms. The hypothesis builds on earlier work, and makes multiple novel contributions to the literature. It highlights intangible knowledge, which is an influential but insufficiently researched factor in social and other behaviors. It contributes to understanding the heavy but neglected amygdala-PRC interconnections, and the diversity of amygdala-mediated intangible knowledge representations. Amygdala is a social brain region, but it does not represent species-typical social behaviors. A novel proposal to clarify its role is postulated. The hypothesis is also suggested to illuminate amygdala's involvement in several core symptoms of autism spectrum disorder (ASD). Specifically, novel and testable explanations are proposed for the ASD symptoms of disorganized visual scanpaths, apparent social disinterest, preference for concrete cognition, aspects of the disorder's heterogeneity, and impairment in some activities of daily living. Together, the presented hypothesis demonstrates substantial explanatory potential in the neuroscience, social and clinical domains.

Inhibition of the substantia nigra pars reticulata produces divergent effects on sensorimotor gating in rats and monkeys

The basal ganglia are an evolutionarily old group of structures, with gross organization conserved across species. Despite this conservation, there is evidence suggesting that anatomical organization of a key output nucleus of the basal ganglia, the substantia nigra pars reticulata (SNpr), diverges across species. Nevertheless, there are relatively few comparative studies examining the impact of manipulations of SNpr across species. Here, we evaluated the role of SNpr in a highly conserved behavior: prepulse inhibition of the acoustic startle response (PPI). We performed parallel experiments in both rats and rhesus macaques using intracranial microinfusions of GABAA agonist muscimol to investigate the role of SNpr in PPI. SNpr inactivation significantly disrupted PPI in rats, congruent with prior studies; however, in macaques, SNpr inactivation resulted in facilitation of PPI. We suggest that this difference in circuit function results from a divergence in anatomical connectivity, underscoring the importance of circuit dissection studies across species.

Mediodorsal thalamus is required for discrete phases of goal-directed behavior in macaques

Reward contingencies are dynamic: outcomes that were valued at one point may subsequently lose value. Action selection in the face of dynamic reward associations requires several cognitive processes: registering a change in value of the primary reinforcer, adjusting the value of secondary reinforcers to reflect the new value of the primary reinforcer, and guiding action selection to optimal choices. Flexible responding has been evaluated extensively using reinforcer devaluation tasks. Performance on this task relies upon amygdala, Areas 11 and 13 of orbitofrontal cortex (OFC), and mediodorsal thalamus (MD). Differential contributions of amygdala and Areas 11 and 13 of OFC to specific sub-processes have been established, but the role of MD in these sub-processes is unknown. Pharmacological inactivation of the macaque MD during specific phases of this task revealed that MD is required for reward valuation and action selection. This profile is unique, differing from both amygdala and subregions of the OFC.

Most of us have experienced feeling full after a main course, only to discover that we somehow still have room for dessert. Eating a particular foodstuff to the point of satiety makes that item temporarily less appealing. This is an example of reward devaluation. We typically respond to this phenomenon by adjusting our behavior. We give up on the main course, for example, and turn our attention instead to dessert. This ability to adjust our actions based on changes in the value of their outcomes is a form of behavioral flexibility.

Several brain regions contribute to behavioral flexibility. These include the amygdala, parts of the orbitofrontal cortex, and the mediodorsal thalamus. Wicker et al. have now explored the role of the mediodorsal thalamus by temporarily inactivating it in monkeys performing a task involving reward devaluation. The monkeys learned to associate one set of objects with peanuts and another with fruit. They were then given unlimited access to either peanuts or fruit. Finally, they were offered a choice between the two sets of objects. Like people who opt for dessert rather than another helping of a main course, the monkeys that had received peanuts chose the objects associated with fruit, and vice versa.

Temporarily inactivating the mediodorsal thalamus prevented this change in behavior. This occurred if the inactivation took place while the monkeys had unlimited access to the reward, or if it took place while they were choosing between the two objects. The mediodorsal thalamus is thus required both to update the value of a reward and to select the best course of action. This is in contrast to the amygdala and the orbitofrontal cortex, which each support only one of these processes.

Impaired behavioral flexibility is a hallmark of neuropsychiatric disorders, including addiction. Understanding the brain networks that support flexible responding may help improve the treatment of such disorders. As therapies that involve electrically stimulating the brain become more common, knowing which regions to avoid will be just as important as identifying new targets.

Effects of systemic cholinergic antagonism on reinforcer devaluation in macaques

The capacity to adjust actions based on new information is a vital cognitive function. An animal's ability to adapt behavioral responses according to changes in reward value can be measured using a reinforcer devaluation task, wherein the desirability of a given object is reduced by decreasing the value of the associated food reinforcement. Elements of the neural circuits serving this ability have been studied in both rodents and nonhuman primates. Specifically, the basolateral amygdala, orbitofrontal cortex, nucleus accumbens, and mediodorsal thalamus have each been shown to play a critical role in the process of value updating, required for adaptive goal selection. As these regions receive dense cholinergic input, we investigated whether systemic injections of non-selective nicotinic or muscarinic acetylcholine receptor antagonists, mecamylamine and scopolamine, respectively, would impair performance on a reinforcer devaluation task. Here we demonstrate that in the presence of either a nicotinic or muscarinic antagonist, animals are able to shift their behavioral responses in an appropriate manner, suggesting that disruption of cholinergic neuromodulation is not sufficient to disrupt value updating, and subsequent goal selection, in rhesus macaques.

Orbitofrontal Cortex: A Neural Circuit for Economic Decisions

Economic choice behavior entails the computation and comparison of subjective values. A central contribution of neuroeconomics has been to show that subjective values are represented explicitly at the neuronal level. With this result at hand, the field has increasingly focused on the difficult question of where in the brain and how exactly subjective values are compared to make a decision. Here, we review a broad range of experimental and theoretical results suggesting that good-based decisions are generated in a neural circuit within the orbitofrontal cortex (OFC). The main lines of evidence supporting this proposal include the fact that goal-directed behavior is specifically disrupted by OFC lesions, the fact that different groups of neurons in this area encode the input and the output of the decision process, the fact that activity fluctuations in each of these cell groups correlate with choice variability, and the fact that these groups of neurons are computationally sufficient to generate decisions. Results from other brain regions are consistent with the idea that good-based decisions take place in OFC and indicate that value signals inform a variety of mental functions. We also contrast the present proposal with other leading models for the neural mechanisms of economic decisions. Finally, we indicate open questions and suggest possible directions for future research.

Basolateral Amygdala to Orbitofrontal Cortex Projections Enable Cue-Triggered Reward Expectations

To make an appropriate decision, one must anticipate potential future rewarding events, even when they are not readily observable. These expectations are generated by using observable information (e.g., stimuli or available actions) to retrieve often quite detailed memories of available rewards. The basolateral amygdala (BLA) and orbitofrontal cortex (OFC) are two reciprocally connected key nodes in the circuitry supporting such outcome-guided behaviors. But there is much unknown about the contribution of this circuit to decision making, and almost nothing known about the whether any contribution is via direct, monosynaptic projections, or the direction of information transfer. Therefore, here we used designer receptor-mediated inactivation of OFC→BLA or BLA→OFC projections to evaluate their respective contributions to outcome-guided behaviors in rats. Inactivation of BLA terminals in the OFC, but not OFC terminals in the BLA, disrupted the selective motivating influence of cue-triggered reward representations over reward-seeking decisions as assayed by Pavlovian-to-instrumental transfer. BLA→OFC projections were also required when a cued reward representation was used to modify Pavlovian conditional goal-approach responses according to the reward's current value. These projections were not necessary when actions were guided by reward expectations generated based on learned action-reward contingencies, or when rewards themselves, rather than stored memories, directed action. These data demonstrate that BLA→OFC projections enable the cue-triggered reward expectations that can motivate the execution of specific action plans and allow adaptive conditional responding.SIGNIFICANCE STATEMENT Deficits anticipating potential future rewarding events are associated with many psychiatric diseases. Presently, we know little about the neural circuits supporting such reward expectation. Here we show that basolateral amygdala to orbitofrontal cortex projections are required for expectations of specific available rewards to influence reward seeking and decision making. The necessity of these projections was limited to situations in which expectations were elicited by reward-predictive cues. These projections therefore facilitate adaptive behavior by enabling the orbitofrontal cortex to use environmental stimuli to generate expectations of potential future rewarding events.

Bidirectional Control of Social Behavior by Activity within Basolateral and Central Amygdala of Primates

Both hypoactivity and hyperactivity in the amygdala are associated with perturbations in social behavior. While >60 years of experimental manipulations of the amygdala in animal models have shown that amygdala is critical for social behavior, many of these studies contradict one another. Moreover, several questions remain unaddressed. (1) What effect does activation of amygdala have on social behavior? (2) What is the effect of transient silencing, rather than permanent damage? (3) Is there a dissociation between the roles of the central (CeA) and basolateral amygdala (BLA) in regulating social behavior? (4) Can the prosocial effects of amygdala manipulations be explained by anxiolytic effects? We focally manipulated activity within the CeA or BLA in macaques by intracerebral microinjection of muscimol (to inactivate) or bicuculline (to activate) to these amygdaloid subregions. Social interactions were observed in pairs of highly familiar monkeys. We compared these effects to those achieved with systemic diazepam. Activation of the BLA but not CeA suppressed social behavior. Inhibition of either structure increased social behavior, although the effect was greater following inhibition of the BLA. Systemic diazepam was without effect. These studies, which are the first to bidirectionally manipulate the primate amygdala for effects on social behavior, revealed that (1) the amygdala, as a critical regulator of the social network, is bidirectionally sensitive to perturbations in activity, and (2) increased sociability after amygdala inactivation cannot be solely explained by decreased fear.

SIGNIFICANCE STATEMENT

Many previous studies reported loss of social interactions following permanent damage to the amygdala in nonhuman primates. In contrast, we report that transient inhibition of the basolateral amygdala triggered a profound increase in social interactions in dyads of monkeys highly familiar with each other. We compared these effects to those of systemic diazepam, which failed to increase social behavior. While it has been suggested that suppression of "fear" could underlie the prosocial effects of amygdala manipulations, our data strongly suggest that impairment in fear processing per se cannot account for the prosocial effects of amygdala inhibition. Furthermore, our studies are the first to examine activation of the amygdala and to assess the separate roles of the amygdaloid nuclei in social behavior in primates.

Successful pharmacotherapy for the treatment of severe feeding aversion with mechanistic insights from cross-species neuronal remodeling

Pediatric feeding disorders affect up to 5% of children, causing severe food intake problems that can result in serious medical and developmental outcomes. Behavioral intervention (BI) is effective in extinguishing feeding aversions, and also expert-dependent, time/labor-intensive and not well understood at a neurobiological level. Here we first conducted a double-blind, placebo-controlled trial comparing BI with BI plus d-cycloserine (DCS). DCS is a partial N-methyl-d-aspartate (NMDA) receptor agonist shown to augment extinction therapies in multiple anxiety disorders. We examined whether DCS enhanced extinction of feeding aversion in 15 children with avoidant/restrictive food intake disorder (ages 20-58 months). After five treatment days, BI improved feeding by 37%. By contrast, BI+DCS improved feeding by 76%. To gain insight into possible mechanisms of successful intervention, we next tested the neurobiological consequences of DCS in a murine model of feeding aversion and avoidance. In mice with conditioned food aversion, DCS enhanced avoidance extinction across a broad dose range. Confocal fluorescence microscopy and three-dimensional neuronal reconstruction indicated that DCS enlarged dendritic spine heads-the primary sites of excitatory plasticity in the brain-within the orbitofrontal prefrontal cortex, a sensory-cognition integration hub. DCS also increased phosphorylation of the plasticity-associated extracellular signal-regulated kinase 1/2. In summary, DCS successfully augments the extinction of food aversion in children and mice, an effect that may involve plasticity in the orbitofrontal cortex. These results warrant a larger-scale efficacy study of DCS for the treatment of pediatric feeding disorders and further investigations of neural mechanisms.

Induction and Blockade of Adolescent Cocaine-Induced Habits

BACKGROUND

Cocaine use during adolescence increases vulnerability to drug dependence and decreases the likelihood that individuals will seek treatment as adults. Understanding how early-life cocaine exposure influences decision-making processes in adulthood is thus critically important.

METHODS

Adolescent or adult mice were exposed to subchronic cocaine, then behavioral sensitivity to changes in the predictive relationship between actions and their consequences was tested. Dendritic spines on the principal pyramidal neurons of the orbitofrontal prefrontal cortex (oPFC) were also imaged and enumerated. To determine whether cytoskeletal regulatory systems in the oPFC influenced decision-making strategies, we then inhibited the activity of Abl family and Rho kinases as well as NR2B-containing N-methyl-D-aspartate receptors. We also attempted to block the reinstatement of cocaine seeking in cocaine self-administering mice.

RESULTS

Adult mice with a history of subchronic cocaine exposure in adolescence engaged habit-based response strategies at the expense of goal-directed decision-making strategies and had fewer dendritic spines in the oPFC. Inhibition of the cytoskeletal regulatory Abl family kinases in the oPFC recapitulated these neurobehavioral deficiencies, whereas Rho kinase inhibition corrected response strategies. Additionally, the NR2B-selective N-methyl-D-aspartate receptor antagonists ifenprodil and CP-101,606 blocked cocaine-induced habits; this was dependent on Abl family signaling in the oPFC. Ifenprodil also mitigated cue-induced reinstatement of cocaine seeking in mice self-administering cocaine.

CONCLUSIONS

We suggest that adolescent cocaine exposure confers a bias toward habit-based behavior in adulthood via long-term cellular structural modifications in the oPFC. Treatments aimed at mitigating the durable consequences of early-life cocaine use may benefit from targeting cytoskeletal regulatory systems.

Defensive Vocalizations and Motor Asymmetry Triggered by Disinhibition of the Periaqueductal Gray in Non-human Primates

Rapid and reflexive responses to threats are present across phylogeny. The neural circuitry mediating reflexive defense reactions has been well-characterized in a variety of species, for example, in rodents and cats, the detection of and species-typical response to threats is mediated by a network of structures including the midbrain tectum (deep and intermediate layers of the superior colliculus [DLSC]), periaqueductal gray (PAG), and forebrain structures such as the amygdala and hypothalamus. However, relatively little is known about the functional architecture of defense circuitry in primates. We have previously reported that pharmacological activation of the DLSC evokes locomotor asymmetry, defense-associated vocalizations, cowering behavior, escape responses, and attack of inanimate objects (Holmes et al., 2012; DesJardin et al., 2013; Forcelli et al., 2016). Here, we sought to determine if pharmacological activation of the PAG would induce a similar profile of responses. We activated the PAG in three awake, behaving macaques by microinfusion of GABA-A receptor antagonist, bicuculline methiodide. Activation of PAG evoked defense-associated vocalizations and postural/locomotor asymmetry, but not motor defense responses (e.g., cowering, escape behavior). These data suggest a partial dissociation between the role of the PAG and the DLSC in the defense network of macaques, but a general conservation of the role of PAG in defense responses across species.

Blockade of glutamatergic transmission in the primate basolateral amygdala suppresses active behavior without altering social interaction

The amygdala is an integrator of affective processing, and a key component of a network regulating social behavior. While decades of lesion studies in nonhuman primates have shown alterations in social interactions after amygdala damage, acute manipulations of the amygdala in primates have been underexplored. We recently reported (Wellman, Forcelli, Aguilar, & Malkova, 2016) that acute pharmacological inhibition of the basolateral complex of the amygdala (BLA) or the central nucleus of the amygdala increased affiliative social interactions in experimental dyads of macaques; this was achieved through microinjection of a GABA-A receptor agonist. Prior studies in rodents have shown similar effects achieved by blocking NMDA receptors or AMPA receptors within the BLA. Here, we sought to determine the role of these receptor systems in the primate BLA in the context of social behavior. In familiar dyads, we microinjected the NMDA receptor antagonist 2-amino-7-phosphonoheptanoic acid (AP7) or the AMPA receptor antagonist 2,3-dioxo-6-nitro-1,2,3,4-tetrahydrobenzo[f]quinoxaline-7-sulfonamide (NBQX) and observed behaviors and social interactions in the immediate postinjection period. In striking contrast with our prior report using GABA agonists, and in contrast with prior reports in rodents using glutamate antagonists, we found that neither NMDA nor AMPA blockade increase social interaction. Both treatments, however, were associated with decreases in locomotion and manipulation and increases in passive behavior. These data suggest that local blockade of glutamatergic neurotransmission in BLA is not the functional equivalent of local activation of GABAergic signaling, and raise interesting questions regarding the functional microcircuitry of the nonhuman primate amygdala in the context of social behavior. (PsycINFO Database Record

Connections of the Mouse Orbitofrontal Cortex and Regulation of Goal-Directed Action Selection by Brain-Derived Neurotrophic Factor

BACKGROUND

Distinguishing between actions that are more likely or less likely to be rewarded is a critical aspect of goal-directed decision making. However, neuroanatomic and molecular mechanisms are not fully understood.

METHODS

We used anterograde tracing, viral-mediated gene silencing, functional disconnection strategies, pharmacologic rescue, and designer receptors exclusively activated by designer drugs (DREADDs) to determine the anatomic and functional connectivity between the orbitofrontal cortex (OFC) and the amygdala in mice. In particular, we knocked down brain-derived neurotrophic factor (Bdnf) bilaterally in the OFC or generated an OFC-amygdala "disconnection" by pairing unilateral OFC Bdnf knockdown with lesions of the contralateral amygdala. We characterized decision-making strategies using a task in which mice selected actions based on the likelihood that they would be reinforced. Additionally, we assessed the effects of DREADD-mediated OFC inhibition on the consolidation of action-outcome conditioning.

RESULTS

As in other species, the OFC projects to the basolateral amygdala and dorsal striatum in mice. Bilateral Bdnf knockdown within the ventrolateral OFC and unilateral Bdnf knockdown accompanied by lesions of the contralateral amygdala impede goal-directed response selection, implicating BDNF-expressing OFC projection neurons in selecting actions based on their consequences. The tyrosine receptor kinase B agonist 7,8-dihydroxyflavone rescues action selection and increases dendritic spine density on excitatory neurons in the OFC. Rho-kinase inhibition also rescues goal-directed response strategies, linking neural remodeling with outcome-based decision making. Finally, DREADD-mediated OFC inhibition weakens new action-outcome memory.

CONCLUSIONS

Activity-dependent and BDNF-dependent neuroplasticity within the OFC coordinate outcome-based decision making through interactions with the amygdala. These interactions break reward-seeking habits, a putative factor in multiple psychopathologies.

Identity-Specific Reward Representations in Orbitofrontal Cortex Are Modulated by Selective Devaluation

Goal-directed behavior is sensitive to the current value of expected outcomes. This requires independent representations of specific rewards, which have been linked to orbitofrontal cortex (OFC) function. However, the mechanisms by which the human brain updates specific goals on the fly, and translates those updates into choices, have remained unknown. Here we implemented selective devaluation of appetizing food odors in combination with pattern-based neuroimaging and a decision-making task. We found that in a hungry state, participants chose to smell high-intensity versions of two value-matched food odor rewards. After eating a meal corresponding to one of the two odors, participants switched choices toward the low intensity of the sated odor but continued to choose the high intensity of the nonsated odor. This sensory-specific behavioral effect was mirrored by pattern-based changes in fMRI signal in lateral posterior OFC, where specific reward identity representations were altered after the meal for the sated food odor but retained for the nonsated counterpart. In addition, changes in functional connectivity between the OFC and general value coding in ventromedial prefrontal cortex (vmPFC) predicted individual differences in satiety-related choice behavior. These findings demonstrate how flexible representations of specific rewards in the OFC are updated by devaluation, and how functional connections to vmPFC reflect the current value of outcomes and guide goal-directed behavior.SIGNIFICANCE STATEMENT The orbitofrontal cortex (OFC) is critical for goal-directed behavior. A recent proposal is that OFC fulfills this function by representing a variety of state and task variables ("cognitive maps"), including a conjunction of expected reward identity and value. Here we tested how identity-specific representations of food odor reward are updated by satiety. We found that fMRI pattern-based signatures of reward identity in lateral posterior OFC were modulated after selective devaluation, and that connectivity between this region and general value coding ventromedial prefrontal cortex (vmPFC) predicted choice behavior. These results provide evidence for a mechanism by which devaluation modulates a cognitive map of expected reward in OFC and thereby alters general value signals in vmPFC to guide goal-directed behavior.

The Role of Orbitofrontal-Amygdala Interactions in Updating Action-Outcome Valuations in Macaques

A previous study revealed that, although monkeys with bilateral lesions of either the orbitofrontal cortex (OFC) or the amygdala could learn an action-outcome task, they could not adapt their choices in response to devalued outcomes. Specifically, they could not adjust their choice between two actions after the value of the outcome associated with one of the actions had decreased. Here, we investigated whether OFC needs to interact functionally with the amygdala in mediating such choices. Rhesus monkeys were trained to make two mutually exclusive actions on a touch-sensitive screen: "tap" and "hold." Taps led to the availability of one kind of food outcome; holds produced a different food. On each trial, monkeys could choose either a tap or a hold to earn the corresponding food reward. After consuming one of the two foods to satiety, monkeys were then tested on their ability to adapt their choices in response to the updated relative valuation of the two predicted outcomes. Whereas intact (control) monkeys shifted their choices toward the action associated with the higher value (nonsated) food, monkeys with crossed surgical disconnection of the amygdala and OFC did not. These findings demonstrate that amygdala-OFC interactions are necessary for choices among actions based on the updated value of predicted outcomes and they also have a bearing on the idea that OFC specializes in stimulus- or object-based choices in contrast to action- or response-based choices.SIGNIFICANCE STATEMENT Dysfunctional interactions between orbitofrontal cortex (OFC) and the amygdala underlie several mental health disorders, often related to value-based decision making. Understanding the underlying neural circuitry may help to develop therapies for those suffering from mood and anxiety disorders and provide insight into addiction. Here, we investigated whether the amygdala must interact with OFC to make adaptive choices. Monkeys learned to perform two different actions, "tap" for one kind of food reward and "hold" for another, and then one of the two foods was devalued temporarily. Intact monkeys shifted their choice to whichever action produced the higher-value food; monkeys with crossed surgical disconnection of OFC and the amygdala did not. Therefore, OFC and the amygdala must interact functionally to mediate adaptive choices.

Primate amygdala neurons evaluate the progress of self-defined economic choice sequences

The amygdala is a prime valuation structure yet its functions in advanced behaviors are poorly understood. We tested whether individual amygdala neurons encode a critical requirement for goal-directed behavior: the evaluation of progress during sequential choices. As monkeys progressed through choice sequences toward rewards, amygdala neurons showed phasic, gradually increasing responses over successive choice steps. These responses occurred in the absence of external progress cues or motor preplanning. They were often specific to self-defined sequences, typically disappearing during instructed control sequences with similar reward expectation. Their build-up rate reflected prospectively the forthcoming choice sequence, suggesting adaptation to an internal plan. Population decoding demonstrated a high-accuracy progress code. These findings indicate that amygdala neurons evaluate the progress of planned, self-defined behavioral sequences. Such progress signals seem essential for aligning stepwise choices with internal plans. Their presence in amygdala neurons may inform understanding of human conditions with amygdala dysfunction and deregulated reward pursuit.

DOI:http://dx.doi.org/10.7554/eLife.18731.001

Amygdala selectively modulates defensive responses evoked from the superior colliculus in non-human primates

Brain circuitry underlying defensive behaviors includes forebrain modulatory sites, e.g. the amygdala and hypothalamus, and midbrain effector regions, such as the deep/intermediate layers of the superior colliculus (DLSC). When disinhibited, this network biases behavior towards reflexive defense reactions. While well characterized in rodent models, little is known about this system in the primate brain. Employing focal pharmacological manipulations, we have previously shown that activation of the DLSC triggers reflexive defensive responses, including cowering, escape behaviors and defensive vocalizations. Here, we show that activation of the DLSC also disrupts normal dyadic social interactions between familiar pairs of monkeys. When the basolateral complex of the amygdala (BLA) was inhibited concurrent with DLSC activation, cowering behavior was attenuated, whereas escape behaviors and defensive vocalizations were not. Moreover, inhibition of the BLA, previously shown to produce a profound increase in dyadic social interactions, was unable to normalize the decrease in social behavior resulting from DLSC activation. Together these data provide an understanding of forebrain-midbrain interactions in a species and circuit with translational relevance for the psychiatry of anxiety and post-traumatic stress disorders.

Back to basics: Making predictions in the orbitofrontal-amygdala circuit

Underlying many complex behaviors are simple learned associations that allow humans and animals to anticipate the consequences of their actions. The orbitofrontal cortex and basolateral amygdala are two regions which are crucial to this process. In this review, we go back to basics and discuss the literature implicating both these regions in simple paradigms requiring the development of associations between stimuli and the motivationally-significant outcomes they predict. Much of the functional research surrounding this ability has suggested that the orbitofrontal cortex and basolateral amygdala play very similar roles in making these predictions. However, electrophysiological data demonstrates critical differences in the way neurons in these regions respond to predictive cues, revealing a difference in their functional role. On the basis of these data and theories that have come before, we propose that the basolateral amygdala is integral to updating information about cue-outcome contingencies whereas the orbitofrontal cortex is critical to forming a wider network of past and present associations that are called upon by the basolateral amygdala to benefit future learning episodes. The tendency for orbitofrontal neurons to encode past and present contingencies in distinct neuronal populations may facilitate its role in the formation of complex, high-dimensional state-specific associations.

Translational Research on Habit and Alcohol

Habitual actions enable efficient daily living, but they can also contribute to pathological behaviors that resistant change, such as alcoholism. Habitual behaviors are learned actions that appear goal-directed but are in fact no longer under the control of the action's outcome. Instead, these actions are triggered by stimuli, which may be exogenous or interoceptive, discrete or contextual. A major hallmark characteristic of alcoholism is continued alcohol use despite serious negative consequences. In essence, although the outcome of alcohol seeking and drinking is dramatically devalued, these actions persist, often triggered by environmental cues associated with alcohol use. Thus, alcoholism meets the definition of an initially goal-directed behavior that converts to a habit-based process. Habit and alcohol have been well investigated in rodent models, with comparatively less research in non-human primates and people. This review focuses on translational research on habit and alcohol with an emphasis on cross-species methodology and neural circuitry.

Specialized areas for value updating and goal selection in the primate orbitofrontal cortex

The macaque orbitofrontal cortex (OFC) is essential for selecting goals based on current, updated values of expected reward outcomes. As monkeys consume a given type of reward to satiety, its value diminishes, and OFC damage impairs the ability to shift goal choices away from devalued outcomes. To examine the contributions of OFC’s components to goal selection, we reversibly inactivated either its anterior (area 11) or posterior (area 13) parts. We found that neurons in area 13 must be active during the selective satiation procedure to enable the updating of outcome valuations. After this updating has occurred, however, area 13 is not needed to select goals based on this knowledge. In contrast, neurons in area 11 do not need to be active during the value-updating process. Instead, inactivation of this area during choices causes an impairment. These findings demonstrate selective and complementary specializations within the OFC.

DOI:http://dx.doi.org/10.7554/eLife.11695.001

Everyone knows that somehow, somewhere, the brain translates knowledge into action. In some people, however, knowledge and action become disconnected. These people behave in a way that either ignores or contradicts the knowledge that they have. They know what to do and can explain it to others, but – when the time comes to act – they do something else, something wrong.

Murray et al. have now investigated how a brain region called the orbitofrontal cortex helps to link knowledge and action in macaque monkeys, which, unlike rodents, have all of the main brain areas that make up the orbitofrontal cortex of humans. The monkeys learned to associate images with different types of food, and then performed a task where they chose between two images in order to get the food they wanted. On some days, one of the foods was less ‘valuable’ because the monkeys had already eaten a lot of it. In these circumstances, monkeys chose fewer of the images associated with that food.

By temporarily inactivating either the front or back region of the monkey’s orbitofrontal cortex at different times, Murray et al. showed that these regions make different contributions to decision making. Inactivating the back region of the orbitofrontal cortex disrupted the ability of monkeys to update their knowledge about the value of a particular foodstuff. However, inactivating the front part of the orbitofrontal cortex disrupted their ability to use this knowledge to select the images that led to the most valuable food. This contradicts the widely held belief that the orbitofrontal cortex acts as a single entity to update values and translate this knowledge into action.

Future work will need to investigate how, having translated knowledge into a chosen action, the orbitofrontal cortex stimulates the motor areas of the brain to generate the movements needed to perform that action.

DOI:http://dx.doi.org/10.7554/eLife.11695.002

Neural Estimates of Imagined Outcomes in Basolateral Amygdala Depend on Orbitofrontal Cortex

Reciprocal connections between the orbitofrontal cortex (OFC) and the basolateral nucleus of the amygdala (BLA) provide a critical circuit for guiding normal behavior when information about expected outcomes is required. Recently, we reported that outcome signaling by OFC neurons is also necessary for learning in the face of unexpected outcomes during a Pavlovian over-expectation task. Key to learning in this task is the ability to build on prior learning to infer or estimate an amount of reward never previously received. OFC was critical to this process. Notably, in parallel work, we found that BLA was not necessary for learning in this setting. This suggested a dissociation in which the BLA might be critical for acquiring information about the outcomes but not for subsequently using it to make novel predictions. Here we evaluated this hypothesis by recording single-unit activity from BLA in rats during the same Pavlovian over-expectation task used previously. We found that spiking activity recorded in BLA in control rats did reflect novel outcome estimates derived from the integration of prior learning, however consistent with a model in which this process occurs in the OFC, these correlates were entirely abolished by ipsilateral OFC lesions. These data indicate that this information about these novel predictions is represented in the BLA, supported via direct or indirect input from the OFC, even though it does not appear to be necessary for learning.

SIGNIFICANCE STATEMENT

The basolateral nucleus of the amygdala (BLA) and the orbitofrontal cortex (OFC) are involved in behavior that depends on knowledge of impending outcomes. Recently, we found that only the OFC was necessary for using such information for learning in a Pavlovian over-expectation task. The current experiment was designed to search for neural correlates of this process in the BLA and, if present, to ask whether they would still be dependent on OFC input. We found that although spiking activity in BLA in control rats did reflect the novel outcome estimates underlying learning, these correlates were entirely abolished by OFC lesions.

The basolateral amygdala in reward learning and addiction

Sophisticated behavioral paradigms partnered with the emergence of increasingly selective techniques to target the basolateral amygdala (BLA) have resulted in an enhanced understanding of the role of this nucleus in learning and using reward information. Due to the wide variety of behavioral approaches many questions remain on the circumscribed role of BLA in appetitive behavior. In this review, we integrate conclusions of BLA function in reward-related behavior using traditional interference techniques (lesion, pharmacological inactivation) with those using newer methodological approaches in experimental animals that allow in vivo manipulation of cell type-specific populations and neural recordings. Secondly, from a review of appetitive behavioral tasks in rodents and monkeys and recent computational models of reward procurement, we derive evidence for BLA as a neural integrator of reward value, history, and cost parameters. Taken together, BLA codes specific and temporally dynamic outcome representations in a distributed network to orchestrate adaptive responses. We provide evidence that experiences with opiates and psychostimulants alter these outcome representations in BLA, resulting in long-term modified action.

Basolateral amygdala rapid glutamate release encodes an outcome-specific representation vital for reward-predictive cues to selectively invigorate reward-seeking actions

Environmental stimuli have the ability to generate specific representations of the rewards they predict and in so doing alter the selection and performance of reward-seeking actions. The basolateral amygdala participates in this process, but precisely how is unknown. To rectify this, we monitored, in near-real time, basolateral amygdala glutamate concentration changes during a test of the ability of reward-predictive cues to influence reward-seeking actions (Pavlovian-instrumental transfer). Glutamate concentration was found to be transiently elevated around instrumental reward seeking. During the Pavlovian-instrumental transfer test these glutamate transients were time-locked to and correlated with only those actions invigorated by outcome-specific motivational information provided by the reward-predictive stimulus (i.e., actions earning the same specific outcome as predicted by the presented CS). In addition, basolateral amygdala AMPA, but not NMDA glutamate receptor inactivation abolished the selective excitatory influence of reward-predictive cues over reward seeking. These data support [corrected] the hypothesis that transient glutamate release in the BLA can encode the outcome-specific motivational information provided by reward-predictive stimuli.

Blockade of glutamatergic transmission in perirhinal cortex impairs object recognition memory in macaques

The perirhinal cortex (PRc) is essential for visual recognition memory, as shown by electrophysiological recordings and lesion studies in a variety of species. However, relatively little is known about the functional contributions of perirhinal subregions. Here we used a systematic mapping approach to identify the critical subregions of PRc through transient, focal blockade of glutamate receptors by intracerebral infusion of kynurenic acid. Nine macaques were tested for visual recognition memory using the delayed nonmatch-to-sample task. We found that inactivation of medial PRc (consisting of Area 35 together with the medial portion of Area 36), but not lateral PRc (the lateral portion of Area 36), resulted in a significant delay-dependent impairment. Significant impairment was observed with 30 and 60 s delays but not with 10 s delays. The magnitude of impairment fell within the range previously reported after PRc lesions. Furthermore, we identified a restricted area located within the most anterior part of medial PRc as critical for this effect. Moreover, we found that focal blockade of either NMDA receptors by the receptor-specific antagonist AP-7 or AMPA receptors by the receptor-specific antagonist NBQX was sufficient to disrupt object recognition memory. The present study expands the knowledge of the role of PRc in recognition memory by identifying a subregion within this area that is critical for this function. Our results also indicate that, like in the rodent, both NMDA and AMPA-mediated transmission contributes to object recognition memory.

Planning activity for internally generated reward goals in monkey amygdala neurons

The best rewards are often distant and can only be achieved by planning and decision-making over several steps. We designed a multi-step choice task in which monkeys followed internal plans to save rewards toward self-defined goals. During this self-controlled behavior, amygdala neurons showed future-oriented activity that reflected the animal's plan to obtain specific rewards several trials ahead. This prospective activity encoded crucial components of the animal's plan, including value and length of the planned choice sequence. It began on initial trials when a plan would be formed, reappeared step by step until reward receipt, and readily updated with a new sequence. It predicted performance, including errors, and typically disappeared during instructed behavior. Such prospective activity could underlie the formation and pursuit of internal plans characteristic of goal-directed behavior. The existence of neuronal planning activity in the amygdala suggests that this structure is important in guiding behavior toward internally generated, distant goals.

Central amygdalar nucleus treated with orexin neuropeptides evoke differing feeding and grooming responses in the hamster

Interaction of the orexinergic (ORXergic) neuronal system with the excitatory (glutamate, l-Glu) or the inhibitory (GABA) neurosignaling complexes evokes major homeostatic physiological events. In this study, effects of the two ORXergic neuropeptides (ORX-A/B) on their receptor (ORX-2R) expression changes were correlated to feeding and grooming actions of the hibernating hamster (Mesocricetus auratus). Infusion of the central amygdala nucleus (CeA) with ORX-A caused hamsters to consume notable quantities of food, while ORX-B accounted for a moderate increase. Interestingly the latter neuropeptide was responsible for greater frequencies of grooming with respect to both controls and the hamsters treated with ORX-A. These distinct behavioral changes turned out to be even greater in the presence of l-Glu agonist (NMDA) while the α1 GABAA receptor agonist (zolpidem, Zol) greatly reduced ORX-A-dependent feeding bouts. Moreover, ORX-A+NMDA mainly promoted greater ORX-2R expression levels with respect to ORX-A-treated hamsters while ORX-B+Zol was instead largely responsible for a down-regulatory trend. Overall, these features point to CeA ORX-2R sites as key sensory limbic elements capable of regulating eating and grooming responses, which may provide useful insights regarding the type of molecular mechanism(s) operating during feeding bouts.