The primate amygdala combines information about space and value

In monkeys making value-based decisions, amygdala neurons are sensitive to cue value as distinct from cue salience

Neurons in the lateral intraparietal (LIP) area of macaque monkey parietal cortex respond to cues predicting rewards and penalties of variable size in a manner that depends on the motivational salience of the predicted outcome (strong for both large reward and large penalty) rather than on its value (positive for large reward and negative for large penalty). This finding suggests that LIP mediates the capture of attention by salient events and does not encode value in the service of value-based decision making. It leaves open the question whether neurons elsewhere in the brain encode value in the identical task. To resolve this issue, we recorded neuronal activity in the amygdala in the context of the task employed in the LIP study. We found that responses to reward-predicting cues were similar between areas, with the majority of reward-sensitive neurons responding more strongly to cues that predicted large reward than to those that predicted small reward. Responses to penalty-predicting cues were, however, markedly different. In the amygdala, unlike LIP, few neurons were sensitive to penalty size, few penalty-sensitive neurons favored large over small penalty, and the dependence of firing rate on penalty size was negatively correlated with its dependence on reward size. These results indicate that amygdala neurons encoded cue value under circumstances in which LIP neurons exhibited sensitivity to motivational salience. However, the representation of negative value, as reflected in sensitivity to penalty size, was weaker than the representation of positive value, as reflected in sensitivity to reward size.NEW & NOTEWORTHY This is the first study to characterize amygdala neuronal responses to cues predicting rewards and penalties of variable size in monkeys making value-based choices. Manipulating reward and penalty size allowed distinguishing activity dependent on motivational salience from activity dependent on value. This approach revealed in a previous study that neurons of the lateral intraparietal (LIP) area encode motivational salience. Here, it reveals that amygdala neurons encode value. The results establish a sharp functional distinction between the two areas.

Primate amygdala neurons evaluate the progress of self-defined economic choice sequences

The amygdala is a prime valuation structure yet its functions in advanced behaviors are poorly understood. We tested whether individual amygdala neurons encode a critical requirement for goal-directed behavior: the evaluation of progress during sequential choices. As monkeys progressed through choice sequences toward rewards, amygdala neurons showed phasic, gradually increasing responses over successive choice steps. These responses occurred in the absence of external progress cues or motor preplanning. They were often specific to self-defined sequences, typically disappearing during instructed control sequences with similar reward expectation. Their build-up rate reflected prospectively the forthcoming choice sequence, suggesting adaptation to an internal plan. Population decoding demonstrated a high-accuracy progress code. These findings indicate that amygdala neurons evaluate the progress of planned, self-defined behavioral sequences. Such progress signals seem essential for aligning stepwise choices with internal plans. Their presence in amygdala neurons may inform understanding of human conditions with amygdala dysfunction and deregulated reward pursuit.

DOI:http://dx.doi.org/10.7554/eLife.18731.001

Input-specific contributions to valence processing in the amygdala

Reward and punishment are often thought of as opposing processes: rewards and the environmental cues that predict them elicit approach and consummatory behaviors, while punishments drive aversion and avoidance behaviors. This framework suggests that there may be segregated brain circuits for these valenced behaviors. The basolateral amygdala (BLA) is one brain region that contributes to both types of motivated behavior. Individual neurons in the BLA can favor positive over negative valence, or vice versa, but these neurons are intermingled, showing no anatomical segregation. The amygdala receives inputs from many brain areas and current theories posit that encoding of positive versus negative valence by BLA neurons is determined by the wiring of each neuron. Specifically, many projections from other brain areas that respond to positive and negative valence stimuli and predictive cues project strongly to the BLA and likely contribute to valence processing within the BLA. Here we review three of these areas, the basal forebrain, the dorsal raphe nucleus and the ventral tegmental area, and discuss how these may promote encoding of positive and negative valence within the BLA.

How motivation and reward learning modulate selective attention

Motivational stimuli such as rewards elicit adaptive responses and influence various cognitive functions. Notably, increasing evidence suggests that stimuli with particular motivational values can strongly shape perception and attention. These effects resemble both selective top-down and stimulus-driven attentional orienting, as they depend on internal states but arise without conscious will, yet they seem to reflect attentional systems that are functionally and anatomically distinct from those classically associated with frontoparietal cortical networks in the brain. Recent research in human and nonhuman primates has begun to reveal how reward can bias attentional selection, and where within the cognitive system the signals providing attentional priority are generated. This review aims at describing the different mechanisms sustaining motivational attention, their impact on different behavioral tasks, and current knowledge concerning the neural networks governing the integration of motivational influences on attentional behavior.

Orbitofrontal Cortex Value Signals Depend on Fixation Location during Free Viewing

In the natural world, monkeys and humans judge the economic value of numerous competing stimuli by moving their gaze from one object to another, in a rapid series of eye movements. This suggests that the primate brain processes value serially, and that value-coding neurons may be modulated by changes in gaze. To test this hypothesis, we presented monkeys with value-associated visual cues and took the unusual step of allowing unrestricted free viewing while we recorded neurons in the orbitofrontal cortex (OFC). By leveraging natural gaze patterns, we found that a large proportion of OFC cells encode gaze location and, that in some cells, value coding is amplified when subjects fixate near the cue. These findings provide the first cellular-level mechanism for previously documented behavioral effects of gaze on valuation and suggest a major role for gaze in neural mechanisms of valuation and decision-making under ecologically realistic conditions.

Dopamine reward prediction-error signalling: a two-component response

Environmental stimuli and objects, including rewards, are often processed sequentially in the brain. Recent work suggests that the phasic dopamine reward prediction-error response follows a similar sequential pattern. An initial brief, unselective and highly sensitive increase in activity unspecifically detects a wide range of environmental stimuli, then quickly evolves into the main response component, which reflects subjective reward value and utility. This temporal evolution allows the dopamine reward prediction-error signal to optimally combine speed and accuracy.

Modulation of Tonically Active Neurons of the Monkey Striatum by Events Carrying Different Force and Reward Information

The role of basal ganglia in motivational processes has been under scrutiny in recent decades, with increasing evidence from clinical studies of cognitive and motivational deficits in patients with basal ganglia lesions. Tonically active neurons (TANs), the presumed striatal cholinergic interneurons, could be important actors in integrating and relaying motivational information arising from various modalities. Their multiphasic responses to rewards and to conditioned stimuli associated with reward conferred them a role in limbic processes. They are also modulated by a task's motor aspect. Recent studies suggest they are influenced by the context in which behavioral responses are expressed. To investigate the role of TANs in motor-limbic interaction processes, we recorded 169 TANs in the striatum of two monkeys performing a motivational task, in which they had to develop a variable force to receive different amounts of reward in response to visual stimuli. Our results reveal new features of TANs response properties. First, TANs usually responded either by a pause or an elevation of discharge rate to the visual cues and the reward, with few neurons combining both pause and rebound. Second, the elevations of discharge rate after the cues were most sensitive to the least valuable (high force or small reward) task conditions. Finally, the responses of TANs to the visual cues were time locked on the onset of the animal's movement. TANs' population and responses could thus play a role in signaling less attractive situations, those with either a high motor demand and/or small reward.

SIGNIFICANCE STATEMENT

Tonically active neurons (TANs) are known for their responses to unpredictable positive or negative events. However, here we show that TANs respond by a pause or an increase in their activity to all rewarding events in a task in which combined visual cues indicate to the monkeys the levels of force to produce and the upcoming reward. Unlike the pause, the increase in activity is modulated by task parameters and is most sensitive to the least attractive task conditions (high force and/or small reward). TANs' responses triggered by cue occurrence are also modulated by movement-related information (movement onset). We therefore propose here that TANs could play a role, via their action on striatal projections neurons, in maintaining high cost/low benefit ratio behaviors.

A ventral salience network in the macaque brain

Successful navigation of the environment requires attending and responding efficiently to objects and conspecifics with the potential to benefit or harm (i.e., that have value). In humans, this function is subserved by a distributed large-scale neural network called the "salience network". We have recently demonstrated that there are two anatomically and functionally dissociable salience networks anchored in the dorsal and ventral portions of the human anterior insula (Touroutoglou et al., 2012). In this paper, we test the hypothesis that these two subnetworks exist in rhesus macaques (Macaca mulatta). We provide evidence that a homologous ventral salience network exists in macaques, but that the connectivity of the dorsal anterior insula in macaques is not sufficiently developed as a dorsal salience network. The evolutionary implications of these finding are considered.

Reward functions of the basal ganglia

Besides their fundamental movement function evidenced by Parkinsonian deficits, the basal ganglia are involved in processing closely linked non-motor, cognitive and reward information. This review describes the reward functions of three brain structures that are major components of the basal ganglia or are closely associated with the basal ganglia, namely midbrain dopamine neurons, pedunculopontine nucleus, and striatum (caudate nucleus, putamen, nucleus accumbens). Rewards are involved in learning (positive reinforcement), approach behavior, economic choices and positive emotions. The response of dopamine neurons to rewards consists of an early detection component and a subsequent reward component that reflects a prediction error in economic utility, but is unrelated to movement. Dopamine activations to non-rewarded or aversive stimuli reflect physical impact, but not punishment. Neurons in pedunculopontine nucleus project their axons to dopamine neurons and process sensory stimuli, movements and rewards and reward-predicting stimuli without coding outright reward prediction errors. Neurons in striatum, besides their pronounced movement relationships, process rewards irrespective of sensory and motor aspects, integrate reward information into movement activity, code the reward value of individual actions, change their reward-related activity during learning, and code own reward in social situations depending on whose action produces the reward. These data demonstrate a variety of well-characterized reward processes in specific basal ganglia nuclei consistent with an important function in non-motor aspects of motivated behavior.

Neural mechanisms of social decision-making in the primate amygdala

Social decisions require evaluation of costs and benefits to oneself and others. Long associated with emotion and vigilance, the amygdala has recently been implicated in both decision-making and social behavior. The amygdala signals reward and punishment, as well as facial expressions and the gaze of others. Amygdala damage impairs social interactions, and the social neuropeptide oxytocin (OT) influences human social decisions, in part, by altering amygdala function. Here we show in monkeys playing a modified dictator game, in which one individual can donate or withhold rewards from another, that basolateral amygdala (BLA) neurons signaled social preferences both across trials and across days. BLA neurons mirrored the value of rewards delivered to self and others when monkeys were free to choose but not when the computer made choices for them. We also found that focal infusion of OT unilaterally into BLA weakly but significantly increased both the frequency of prosocial decisions and attention to recipients for context-specific prosocial decisions, endorsing the hypothesis that OT regulates social behavior, in part, via amygdala neuromodulation. Our findings demonstrate both neurophysiological and neuroendocrinological connections between primate amygdala and social decisions.

Neuronal selectivity for spatial positions of offers and choices in five reward regions

When we evaluate an option, how is the neural representation of its value linked to information that identifies it, such as its position in space? We hypothesized that value information and identity cues are not bound together at a particular point but are represented together at the single unit level throughout the entirety of the choice process. We examined neuronal responses in two-option gambling tasks with lateralized and asynchronous presentation of offers in five reward regions: orbitofrontal cortex (OFC, area 13), ventromedial prefrontal cortex (vmPFC, area 14), ventral striatum (VS), dorsal anterior cingulate cortex (dACC), and subgenual anterior cingulate cortex (sgACC, area 25). Neuronal responses in all areas are sensitive to the positions of both offers and of choices. This selectivity is strongest in reward-sensitive neurons, indicating that it is not a property of a specialized subpopulation of cells. We did not find consistent contralateral or any other organization to these responses, indicating that they may be difficult to detect with aggregate measures like neuroimaging or studies of lesion effects. These results suggest that value coding is wed to factors that identify the object throughout the reward system and suggest a possible solution to the binding problem raised by abstract value encoding schemes.

Contrasting Roles for Orbitofrontal Cortex and Amygdala in Credit Assignment and Learning in Macaques

Recent studies have challenged the view that orbitofrontal cortex (OFC) and amygdala mediate flexible reward-guided behavior. We trained macaques to perform an object discrimination reversal task during fMRI sessions and identified a lateral OFC (lOFC) region in which activity predicted adaptive win-stay/lose-shift behavior. Amygdala and lOFC activity was more strongly coupled on lose-shift trials. However, lOFC-amygdala coupling was also modulated by the relevance of reward information in a manner consistent with a role in establishing how credit for reward should be assigned. Day-to-day fluctuations in signals and signal coupling were correlated with day-to-day fluctuation in performance. A second experiment confirmed the existence of signals for adaptive stay/shift behavior in lOFC and reflecting irrelevant reward in the amygdala in a probabilistic learning task. Our data demonstrate that OFC and amygdala each make unique contributions to flexible behavior and credit assignment.

•

Orbitofrontal cortex determines future behavior on the basis of reward feedback

•

Variation in orbitofrontal cortex activity is correlated with variation in learning

•

Amygdala carries information about irrelevant reward

•

Amygdala-orbitofrontal interactions emphasize relevant not irrelevant reward

The attention habit: how reward learning shapes attentional selection

There is growing consensus that reward plays an important role in the control of attention. Until recently, reward was thought to influence attention indirectly by modulating task-specific motivation and its effects on voluntary control over selection. Such an account was consistent with the goal-directed (endogenous) versus stimulus-driven (exogenous) framework that had long dominated the field of attention research. Now, a different perspective is emerging. Demonstrations that previously reward-associated stimuli can automatically capture attention even when physically inconspicuous and task-irrelevant challenge previously held assumptions about attentional control. The idea that attentional selection can be value driven, reflecting a distinct and previously unrecognized control mechanism, has gained traction. Since these early demonstrations, the influence of reward learning on attention has rapidly become an area of intense investigation, sparking many new insights. The result is an emerging picture of how the reward system of the brain automatically biases information processing. Here, I review the progress that has been made in this area, synthesizing a wealth of recent evidence to provide an integrated, up-to-date account of value-driven attention and some of its broader implications.

It All Depends on the Context, but Also on the Amygdala

Behavioral flexibility requires the brain to maintain and rely on cognitive contexts for dictating appropriate responses. Saez et al. (2015) demonstrate that such abstract rule-based representations co-exist in prefrontal cortices and in the amygdala, with the latter being surprisingly crucial for correct performance.

Ensemble coding in amygdala circuits for associative learning

Associative fear learning in the basolateral amygdala (BLA) is crucial for an animal's survival upon environmental threats. BLA neurons are defined on the basis of their projection target, genetic markers, and associated function. BLA principal neuron responses to threat signaling stimuli are potentiated upon associative fear learning, which is tightly controlled by defined interneuron subpopulations. In addition, BLA population activity correlates with behavioral states and threat or safety signals. BLA neuronal ensembles activated by different behavioral signals can be identified using immediate early gene markers. The next challenge will be to determine the activity patterns and coding properties of defined BLA ensembles in relation to the whole neuronal population.

Attentional Selection Can Be Predicted by Reinforcement Learning of Task-relevant Stimulus Features Weighted by Value-independent Stickiness

Attention includes processes that evaluate stimuli relevance, select the most relevant stimulus against less relevant stimuli, and bias choice behavior toward the selected information. It is not clear how these processes interact. Here, we captured these processes in a reinforcement learning framework applied to a feature-based attention task that required macaques to learn and update the value of stimulus features while ignoring nonrelevant sensory features, locations, and action plans. We found that value-based reinforcement learning mechanisms could account for feature-based attentional selection and choice behavior but required a value-independent stickiness selection process to explain selection errors while at asymptotic behavior. By comparing different reinforcement learning schemes, we found that trial-by-trial selections were best predicted by a model that only represents expected values for the task-relevant feature dimension, with nonrelevant stimulus features and action plans having only a marginal influence on covert selections. These findings show that attentional control subprocesses can be described by (1) the reinforcement learning of feature values within a restricted feature space that excludes irrelevant feature dimensions, (2) a stochastic selection process on feature-specific value representations, and (3) value-independent stickiness toward previous feature selections akin to perseveration in the motor domain. We speculate that these three mechanisms are implemented by distinct but interacting brain circuits and that the proposed formal account of feature-based stimulus selection will be important to understand how attentional subprocesses are implemented in primate brain networks.

Reward expectation differentially modulates attentional behavior and activity in visual area V4

Neural activity in visual area V4 is enhanced when attention is directed into neuronal receptive fields. However, the source of this enhancement is unclear, as most physiological studies have manipulated attention by changing the absolute reward associated with a particular location as well as its value relative to other locations. We trained monkeys to discriminate the orientation of two stimuli presented simultaneously in different hemifields while we independently varied the reward magnitude associated with correct discrimination at each location. Behavioral measures of attention were controlled by the relative value of each location. By contrast, neurons in V4 were consistently modulated by absolute reward value, exhibiting increased activity, increased gamma-band power and decreased trial-to-trial variability whenever receptive field locations were associated with large rewards. These data challenge the notion that the perceptual benefits of spatial attention rely on increased signal-to-noise in V4. Instead, these benefits likely derive from downstream selection mechanisms.

Neural activity in monkey amygdala during performance of a multisensory operant task

In this paper, we study the potential involvement of monkey amygdala in the evaluation of value encoding of visual and auditive stimuli associated with reward or no reward. We recorded the activity of 93 extracellular neurons from the monkey right amygdala, while performing a multisensory operant task. The activity of 78 task-related neurons was studied. Of these, 13 neurons (16%) responded to the value of visual stimuli, 22 neurons (28%) responded after the presentation of visual stimuli, 22 neurons (28%) showed an inhibition around the lever-pressing and were classified as action related neurons and 22 neurons (28%) responded after reward delivery. These findings suggest that neurons in the amygdala play a role in encoding value and processing visual information, participate in motor regulation and are sensitive to reward. The activity of these neurons did not change in the evaluation of auditive stimuli. These data support the hypothesis that amygdala neurons are specific to each sensory modality and that different groups of amygdala neurons process visual and auditive information.

The amygdala and basal forebrain as a pathway for motivationally guided attention

Visual stimuli associated with rewards attract spatial attention. Neurophysiological mechanisms that mediate this process must register both the motivational significance and location of visual stimuli. Recent neurophysiological evidence indicates that the amygdala encodes information about both of these parameters. Furthermore, the firing rate of amygdala neurons predicts the allocation of spatial attention. One neural pathway through which the amygdala might influence attention involves the intimate and bidirectional connections between the amygdala and basal forebrain (BF), a brain area long implicated in attention. Neurons in the rhesus monkey amygdala and BF were therefore recorded simultaneously while subjects performed a detection task in which the stimulus-reward associations of visual stimuli modulated spatial attention. Neurons in BF were spatially selective for reward-predictive stimuli, much like the amygdala. The onset of reward-predictive signals in each brain area suggested different routes of processing for reward-predictive stimuli appearing in the ipsilateral and contralateral fields. Moreover, neurons in the amygdala, but not BF, tracked trial-to-trial fluctuations in spatial attention. These results suggest that the amygdala and BF could play distinct yet inter-related roles in influencing attention elicited by reward-predictive stimuli.

Neuronal Reward and Decision Signals: From Theories to Data

Rewards are crucial objects that induce learning, approach behavior, choices, and emotions. Whereas emotions are difficult to investigate in animals, the learning function is mediated by neuronal reward prediction error signals which implement basic constructs of reinforcement learning theory. These signals are found in dopamine neurons, which emit a global reward signal to striatum and frontal cortex, and in specific neurons in striatum, amygdala, and frontal cortex projecting to select neuronal populations. The approach and choice functions involve subjective value, which is objectively assessed by behavioral choices eliciting internal, subjective reward preferences. Utility is the formal mathematical characterization of subjective value and a prime decision variable in economic choice theory. It is coded as utility prediction error by phasic dopamine responses. Utility can incorporate various influences, including risk, delay, effort, and social interaction. Appropriate for formal decision mechanisms, rewards are coded as object value, action value, difference value, and chosen value by specific neurons. Although all reward, reinforcement, and decision variables are theoretical constructs, their neuronal signals constitute measurable physical implementations and as such confirm the validity of these concepts. The neuronal reward signals provide guidance for behavior while constraining the free will to act.

Making eye contact without awareness

Direct gaze is a potent non-verbal signal that establishes a communicative connection between two individuals, setting the course for further interactions. Although consciously perceived faces with direct gaze have been shown to capture attention, it is unknown whether an attentional preference for these socially meaningful stimuli exists even in the absence of awareness. In two experiments, we recorded participants' eye movements while they were exposed to faces with direct and averted gaze rendered invisible by interocular suppression. Participants' inability to correctly guess the occurrence of the faces in a manual forced-choice task demonstrated complete unawareness of the faces. However, eye movements were preferentially directed towards faces with direct compared to averted gaze, indicating a specific sensitivity to others' gaze directions even without awareness. This oculomotor preference suggests that a rapid and automatic establishment of mutual eye contact constitutes a biological advantage, which could be mediated by fast subcortical pathways in the human brain.

Normative development of ventral striatal resting state connectivity in humans

Incentives play a crucial role in guiding behavior throughout our lives, but perhaps no more so than during the early years of life. The ventral striatum is a critical piece of an incentive-based learning circuit, sharing robust anatomical connections with subcortical (e.g., amygdala, hippocampus) and cortical structures (e.g., medial prefrontal cortex (mPFC), insula) that collectively support incentive valuation and learning. Resting-state functional connectivity (rsFC) is a powerful method that provides insight into the development of the functional architecture of these connections involved in incentive-based learning. We employed a seed-based correlation approach to investigate ventral striatal rsFC in a cross-sectional sample of typically developing individuals between the ages of 4.5 and 23-years old (n=66). Ventral striatal rsFC with the mPFC showed regionally specific linear age-related changes in connectivity that were associated with age-related increases in circulating testosterone levels. Further, ventral striatal connectivity with the posterior hippocampus and posterior insula demonstrated quadratic age-related changes characterized by negative connectivity in adolescence. Finally, across this age range, the ventral striatum demonstrated positive coupling with the amygdala beginning during childhood and remaining consistently positive across age. In sum, our findings suggest that normative ventral striatal rsFC development is dynamic and characterized by early establishment of connectivity with medial prefrontal and limbic structures supporting incentive-based learning, as well as substantial functional reorganization with later developing regions during transitions into and out of adolescence.

Value-based attentional capture influences context-dependent decision-making

Normative theories posit that value-based decision-making is context independent. However, decisions between two high-value options can be suboptimally biased by the introduction of a third low-value option. This context-dependent modulation is consistent with the divisive normalization of the value of each stimulus by the total value of all stimuli. In addition, an independent line of research demonstrates that pairing a stimulus with a high-value outcome can lead to attentional capture that can mediate the efficiency of visual information processing. Here we tested the hypothesis that value-based attentional capture interacts with value-based normalization to influence the optimality of decision-making. We used a binary-choice paradigm in which observers selected between two targets and the color of each target indicated the magnitude of their reward potential. Observers also had to simultaneously ignore a task-irrelevant distractor rendered in a color that was previously associated with a specific reward magnitude. When the color of the task-irrelevant distractor was previously associated with a high reward, observers responded more slowly and less optimally. Moreover, as the learned value of the distractor increased, electrophysiological data revealed an attenuation of the lateralized N1 and N2Pc responses evoked by the relevant choice stimuli and an attenuation of the late positive deflection (LPD). Collectively, these behavioral and electrophysiological data suggest that value-based attentional capture and value-based normalization jointly mediate the influence of context on free-choice decision-making.

Amygdala processing of social cues from faces: an intracrebral EEG study

The amygdala is a key structure for monitoring the relevance of environmental stimuli. Yet, little is known about the dynamics of its response to primary social cues such as gaze and emotion. Here, we examined evoked amygdala responses to gaze and facial emotion changes in five epileptic patients with intracerebral electrodes. Patients first viewed a neutral face that would then convey social cues: it turned either happy or fearful with or without gaze aversion. This social cue was followed by a laterally presented target, the detection of which was faster if it appeared in a location congruent with the averted gaze direction. First, we observed pronounced evoked amygdala potentials to the initial neutral face. Second, analysis of the evoked responses to the cue showed an early effect of gaze starting at 123 ms in the right amygdala. Differential effects of fearful vs happy valence were individually present but more variable in time and therefore not observed at group-level. Our study is the first to demonstrate such an early effect of gaze in the amygdala, in line with its particular behavioral relevance in the spatial attention task.

The primate amygdala in social perception - insights from electrophysiological recordings and stimulation

The role of the amygdala in emotion and social perception has been intensively investigated primarily through studies using functional magnetic resonance imaging (fMRI). Recently, this topic has been examined using single-unit recordings in both humans and monkeys, with a focus on face processing. The findings provide novel insights, including several surprises: amygdala neurons have very long response latencies, show highly nonlinear responses to whole faces, and can be exquisitely selective for very specific parts of faces such as the eyes. In humans, the responses of amygdala neurons correlate with internal states evoked by faces, rather than with their objective features. Current and future studies extend the investigations to psychiatric illnesses such as autism, in which atypical face processing is a hallmark of social dysfunction.

Amygdala-prefrontal interactions in (mal)adaptive learning

The study of neurobiological mechanisms underlying anxiety disorders has been shaped by learning models that frame anxiety as maladaptive learning. Pavlovian conditioning and extinction are particularly influential in defining learning stages that can account for symptoms of anxiety disorders. Recently, dynamic and task related communication between the basolateral complex of the amygdala (BLA) and the medial prefrontal cortex (mPFC) has emerged as a crucial aspect of successful evaluation of threat and safety. Ongoing patterns of neural signaling within the mPFC-BLA circuit during encoding, expression and extinction of adaptive learning are reviewed. The mechanisms whereby deficient mPFC-BLA interactions can lead to generalized fear and anxiety are discussed in learned and innate anxiety. Findings with cross-species validity are emphasized.

Task-dependent spatial selectivity in the primate amygdala

Humans and other animals routinely encounter visual stimuli that indicate whether future reward delivery depends upon the identity or location of a stimulus, or the performance of a particular action. These reinforcement contingencies can influence how much attention is directed toward a stimulus. Neurons in the primate amygdala encode information about the association between visual stimuli and reinforcement as well as about the location of reward-predictive stimuli. Amygdala neural activity also predicts variability in spatial attention. In principle, the spatial properties of amygdala neurons may be present independent of spatial attention allocation. Alternatively, the encoding of spatial information may require attention. We trained monkeys to perform tasks that engaged spatial attention to varying degrees to understand the genesis of spatial processing in the amygdala. During classical conditioning tasks, conditioned stimuli appeared at different locations; amygdala neurons responded selectively to the location of stimuli. These spatial signals diminished rapidly upon stimulus disappearance and were unrelated to selectivity for expected reward. In contrast, spatial selectivity was sustained in time when monkeys performed a delayed saccade task that required sustained spatial attention. This temporally extended spatial signal was correlated with signals encoding reward expectation. Furthermore, variability in firing rates was correlated with variability in spatial attention, as measured by reaction time. These results reveal two types of spatial signals in the amygdala: one that is tied to initial visual responses and a second that reflects coordination between spatial and reinforcement information and that relates to the engagement of spatial attention.

The attribution of value-based attentional priority in individuals with depressive symptoms

The capture of attention by stimuli previously associated with reward has been demonstrated across a wide range of studies. Such value-based attentional priority appears to be robust, and cases where reward feedback fails to modulate subsequent attention have not been reported. However, individuals differ in their sensitivity to external rewards, and such sensitivity is abnormally blunted in depression. Here, we show that depressive symptomology is accompanied by insensitivity to value-based attentional bias. We replicate attentional capture by stimuli previously associated with reward in a control sample and show that these same reward-related stimuli do not capture attention in individuals experiencing symptoms of depression. This sharp contrast in performance indicates that value-based attentional biases depend on the normal functioning of the brain's reward system and suggests that a failure to preferentially attend to reward-related information may play a role in the experience of depression.

Amygdala neural activity reflects spatial attention towards stimuli promising reward or threatening punishment

Humans and other animals routinely identify and attend to sensory stimuli so as to rapidly acquire rewards or avoid aversive experiences. Emotional arousal, a process mediated by the amygdala, can enhance attention to stimuli in a non-spatial manner. However, amygdala neural activity was recently shown to encode spatial information about reward-predictive stimuli, and to correlate with spatial attention allocation. If representing the motivational significance of sensory stimuli within a spatial framework reflects a general principle of amygdala function, then spatially selective neural responses should also be elicited by sensory stimuli threatening aversive events. Recordings from amygdala neurons were therefore obtained while monkeys directed spatial attention towards stimuli promising reward or threatening punishment. Neural responses encoded spatial information similarly for stimuli associated with both valences of reinforcement, and responses reflected spatial attention allocation. The amygdala therefore may act to enhance spatial attention to sensory stimuli associated with rewarding or aversive experiences.

Directional influence between the human amygdala and orbitofrontal cortex at the time of decision-making

There is a growing consensus that the brain makes simple choices, such as choosing between an apple and an orange, by assigning value to the options under consideration, and comparing those values to make a choice. There is also a consensus that value signals computed in orbitofrontal cortex (OFC) and amygdala play a critical role in the choice process. However, the nature of the flow of information between OFC and amygdala at the time of decision is still unknown. In order to study this question, simultaneous local field potentials were recorded from OFC and amygdala in human patients while they performed a simple food choice task. Although the interaction of these circuits has been studied in animals, this study examines the effective connectivity directly in the human brain on a moment-by-moment basis. A spectral conditional Granger causality analysis was performed in order to test if the modulation of activity goes mainly from OFC-to-amygdala, from amygdala-to-OFC, or if it is bi-directional. Influence from amygdala-to-OFC was dominant prior to the revealed choice, with a small but significant OFC influence on the amygdala earlier in the trial. Alpha oscillation amplitudes analyzed with the Hilbert-Huang transform revealed differences in choice valence coincident with temporally specific amygdala influence on the OFC.

Neurons in the monkey amygdala detect eye contact during naturalistic social interactions

Primates explore the visual world through eye-movement sequences. Saccades bring details of interest into the fovea, while fixations stabilize the image. During natural vision, social primates direct their gaze at the eyes of others to communicate their own emotions and intentions and to gather information about the mental states of others. Direct gaze is an integral part of facial expressions that signals cooperation or conflict over resources and social status. Despite the great importance of making and breaking eye contact in the behavioral repertoire of primates, little is known about the neural substrates that support these behaviors. Here we show that the monkey amygdala contains neurons that respond selectively to fixations on the eyes of others and to eye contact. These "eye cells" share several features with the canonical, visually responsive neurons in the monkey amygdala; however, they respond to the eyes only when they fall within the fovea of the viewer, either as a result of a deliberate saccade or as eyes move into the fovea of the viewer during a fixation intended to explore a different feature. The presence of eyes in peripheral vision fails to activate the eye cells. These findings link the primate amygdala to eye movements involved in the exploration and selection of details in visual scenes that contain socially and emotionally salient features.

Attention as an effect not a cause

Attention is commonly thought to be important for managing the limited resources available in sensory areas of the neocortex. Here we present an alternative view that attention arises as a byproduct of circuits centered on the basal ganglia involved in value-based decision making. The central idea is that decision making depends on properly estimating the current state of the animal and its environment and that the weighted inputs to the currently prevailing estimate give rise to the filter-like properties of attention. After outlining this new framework, we describe findings from physiological, anatomical, computational, and clinical work that support this point of view. We conclude that the brain mechanisms responsible for attention employ a conserved circuit motif that predates the emergence of the neocortex.

Reduced dopamine transporter expression in the amygdala of subjects diagnosed with schizophrenia

A disruption of dopaminergic transmission in the amygdala of subjects with schizophrenia was proposed as a main contributor to pathophysiological and clinical manifestations of this disorder. We tested the hypothesis that the expression of the dopamine transporter (DAT) is decreased in the amygdala of subjects with schizophrenia. In normal control, schizophrenic subjects and bipolar disorder subjects, we measured numerical density of axon varicosities immunoreactive (IR) for DAT in the lateral (LN), basal, accessory basal (ABN), and cortical (CO) nuclei and intercalated cell masses (ITCM) of the amygdala. Tyrosine hydroxylase (TH)-IR and dopamine beta-hydroxylase (DBH)-IR varicosities were measured to test for potential loss of varicosities and serotonin transporter (5HTT)-IR for involvement of the serotoninergic system. Among several potential confounding variables tested, particular emphasis was placed on exposure to therapeutic drugs. In schizophrenic subjects, DAT-IR varicosities were decreased in LN (P = .0002), ABN (P = .013), and CO (P = .0001) in comparison with controls, and in comparison with bipolar disorder subjects in LN (P = .004) and CO (P = .002). DBH-IR varicosities were decreased in ABN (P = .008) and ITCM (P = .017), compared with controls. TH- and 5HTT-IR varicosities were not altered. No changes were detected in bipolar disorder. Taken together with TH and DBH findings, reductions of DAT-IR varicosities point to decreased DAT expression in dopaminergic terminals in the amygdala of subjects with schizophrenia. This DAT decrease may disrupt dopamine uptake, leading to increased dopaminergic synaptic transmission and spillage into the extracellular space with activation of extrasynaptic dopamine receptors. Concurrent decrease of noradrenaline in the ABN may disrupt memory consolidation.

Emotions and motivated behavior converge on an amygdala-like structure in the zebrafish

The brain reward circuitry plays a key role in emotional and motivational behaviors, and its dysfunction underlies neuropsychiatric disorders such as schizophrenia, depression and drug addiction. Here, we characterized the neuronal activity pattern induced by acute amphetamine administration and during drug-seeking behavior in the zebrafish, and demonstrate the existence of conserved underlying brain circuitry. Combining quantitative analyses of cfos expression with neuronal subtype-specific markers at single-cell resolution, we show that acute d-amphetamine administration leads to both increased neuronal activation and the recruitment of neurons in the medial (Dm) and the lateral (Dl) domains of the adult zebrafish pallium, which contain homologous structures to the mammalian amygdala and hippocampus, respectively. Calbindin-positive and glutamatergic neurons are recruited in Dm, and glutamatergic and γ-aminobutyric acid (GABAergic) neurons in Dl. The drug-activated neurons in Dm and Dl are born at juvenile stage rather than in the embryo or during adulthood. Furthermore, the same territory in Dm is activated during both drug-seeking approach and light avoidance behavior, while these behaviors do not elicit activation in Dl. These data identify the pallial territories involved in acute psychostimulant response and reward formation in the adult zebrafish. They further suggest an evolutionarily conserved function of amygdala-like structures in positive emotions and motivated behavior in zebrafish and mammals.

The human amygdala encodes value and space during decision making

Valuable stimuli are invariably localized in space. While our knowledge regarding the neural networks supporting value assignment and comparisons is considerable, we lack a basic understanding of how the human brain integrates motivational and spatial information. The amygdala is a key structure for learning and maintaining the value of sensory stimuli and a recent non-human primate study provided initial evidence that it also acts to integrate value with spatial location, a question we address here in a human setting. We measured haemodynamic responses (fMRI) in amygdala while manipulating the value and spatial configuration of stimuli in a simple stimulus–reward task. Subjects responded significantly faster and showed greater amygdala activation when a reward was dependent on a spatial specific response, compared to when a reward required less spatial specificity. Supplemental analysis supported this spatial specificity by demonstrating that the pattern of amygdala activity varied based on whether subjects responded to a motivational target presented in the ipsilateral or contralateral visual space. Our data show that the human amygdala integrates information about space and value, an integration of likely importance for assigning cognitive resources towards highly valuable stimuli in our environment.

•

Amygdala responds to valuable stimuli in a spatial specific manner.

•

Amygdala–dACC connectivity varies according to the spatial location of value cues.

•

Amygdala integrates information about stimulus value and its spatial representation.

•

Dorsal ACC may supply information about spatial location to the amygdala.

Neurons in the human amygdala selective for perceived emotion

The human amygdala plays a key role in recognizing facial emotions and neurons in the monkey and human amygdala respond to the emotional expression of faces. However, it remains unknown whether these responses are driven primarily by properties of the stimulus or by the perceptual judgments of the perceiver. We investigated these questions by recording from over 200 single neurons in the amygdalae of 7 neurosurgical patients with implanted depth electrodes. We presented degraded fear and happy faces and asked subjects to discriminate their emotion by button press. During trials where subjects responded correctly, we found neurons that distinguished fear vs. happy emotions as expressed by the displayed faces. During incorrect trials, these neurons indicated the patients' subjective judgment. Additional analysis revealed that, on average, all neuronal responses were modulated most by increases or decreases in response to happy faces, and driven predominantly by judgments about the eye region of the face stimuli. Following the same analyses, we showed that hippocampal neurons, unlike amygdala neurons, only encoded emotions but not subjective judgment. Our results suggest that the amygdala specifically encodes the subjective judgment of emotional faces, but that it plays less of a role in simply encoding aspects of the image array. The conscious percept of the emotion shown in a face may thus arise from interactions between the amygdala and its connections within a distributed cortical network, a scheme also consistent with the long response latencies observed in human amygdala recordings.

Trait impulsivity is related to ventral ACC and amygdala activity during primary reward anticipation

Trait impulsivity is characterized by behavioral disinhibition and rash decision-making that contribute to many maladaptive behaviors. Previous research demonstrates that trait impulsivity is related to the activity of brain regions underlying reward sensitivity and emotion regulation, but little is known about this relationship in the context of immediately available primary reward. This is unfortunate, as impulsivity in these contexts can lead to unhealthy behaviors, including poor food choices, dangerous drug use and risky sexual practices. In addition, little is known about the relationship between integration of reward and affective neurocircuitry, as measured by resting-state functional connectivity, and trait impulsivity in everyday life, as measured with a commonly used personality inventory. We therefore asked healthy adults to undergo a functional magnetic resonance imaging task in which they saw cues indicating the imminent oral administration of rewarding taste, as well as a resting-state scan. Trait impulsivity was associated with increased activation during anticipation of primary reward in the anterior cingulate cortex (ACC) and amygdala. Additionally, resting-state functional connectivity between the ACC and the right amygdala was negatively correlated with trait impulsivity. These findings demonstrate that trait impulsivity is related not only to ACC-amygdala activation but also to how tightly coupled these regions are to one another.

Dopamine prediction error responses integrate subjective value from different reward dimensions

Prediction error signals enable us to learn through experience. These experiences include economic choices between different rewards that vary along multiple dimensions. Therefore, an ideal way to reinforce economic choice is to encode a prediction error that reflects the subjective value integrated across these reward dimensions. Previous studies demonstrated that dopamine prediction error responses reflect the value of singular reward attributes that include magnitude, probability, and delay. Obviously, preferences between rewards that vary along one dimension are completely determined by the manipulated variable. However, it is unknown whether dopamine prediction error responses reflect the subjective value integrated from different reward dimensions. Here, we measured the preferences between rewards that varied along multiple dimensions, and as such could not be ranked according to objective metrics. Monkeys chose between rewards that differed in amount, risk, and type. Because their choices were complete and transitive, the monkeys chose "as if" they integrated different rewards and attributes into a common scale of value. The prediction error responses of single dopamine neurons reflected the integrated subjective value inferred from the choices, rather than the singular reward attributes. Specifically, amount, risk, and reward type modulated dopamine responses exactly to the extent that they influenced economic choices, even when rewards were vastly different, such as liquid and food. This prediction error response could provide a direct updating signal for economic values.

An evolutionary perspective on the behavioral consequences of exogenous oxytocin application

Oxytocin (OT) is released in response to social signals, particularly positive ones like eye contact, social touch, sexual behavior, and affiliative vocalizations. Conversely, exogenous delivery of OT has diverse behavioral effects, sometimes promoting affiliative and prosocial behaviors, but sometimes suppressing them. Here, we argue that one unifying interpretation of these diverse effects is to view OT as an evolutionarily conserved physiological signal indicating affiliative interactions and predicting their behavioral consequences. In this model, OT regulates the way information about the social environment accesses the neural circuitry responsible for social behavior, thereby shaping it in sometimes counter intuitive but adaptive ways. Notably, prosociality is not always the most adaptive response to an affiliative signal from another individual. In many circumstances, an asocial or even antisocial response may confer greater fitness benefits. We argue that the behavioral effects of exogenous OT delivery not only parallel the behavioral effects of affiliative interactions, but are themselves adaptive responses to affiliative interactions. In support of this idea, we review recent evidence that OT does not unilaterally enhance social attention, as previously thought, but rather can reduce the typical prioritization of social information at the expense of other information or goals. Such diminished social vigilance may be an adaptive response to affiliative social interactions because it frees attentional resources for the pursuit of other goals. Finally, we predict that OT may mediate other behavioral consequences of social interactions, such as reduced predator vigilance, and argue that this is a rich avenue for future behavioral and neurobiological study.

Single-neuron correlates of atypical face processing in autism

People with autism spectrum disorder (ASD) show abnormal processing of faces. A range of morphometric, histological, and neuroimaging studies suggest the hypothesis that this abnormality may be linked to the amygdala. We recorded data from single neurons within the amygdalae of two rare neurosurgical patients with ASD. While basic electrophysiological response parameters were normal, there were specific and striking abnormalities in how individual facial features drove neuronal response. Compared to control patients, a population of neurons in the two ASD patients responded significantly more to the mouth, but less to the eyes. Moreover, we found a second class of face-responsive neurons for which responses to faces appeared normal. The findings confirm the amygdala's pivotal role in abnormal face processing by people with ASD at the cellular level and suggest that dysfunction may be traced to a specific subpopulation of neurons with altered selectivity for the features of faces.

Enhanced visual cortical activation for emotional stimuli is preserved in patients with unilateral amygdala resection

Emotionally arousing pictures induce increased activation of visual pathways relative to emotionally neutral images. A predominant model for the preferential processing and attention to emotional stimuli posits that the amygdala modulates sensory pathways through its projections to visual cortices. However, recent behavioral studies have found intact perceptual facilitation of emotional stimuli in individuals with amygdala damage. To determine the importance of the amygdala to modulations in visual processing, we used functional magnetic resonance imaging to examine visual cortical blood oxygenation level-dependent (BOLD) signal in response to emotionally salient and neutral images in a sample of human patients with unilateral medial temporal lobe resection that included the amygdala. Adults with right (n = 13) or left (n = 5) medial temporal lobe resections were compared with demographically matched healthy control participants (n = 16). In the control participants, both aversive and erotic images produced robust BOLD signal increases in bilateral primary and secondary visual cortices relative to neutral images. Similarly, all patients with amygdala resections showed enhanced visual cortical activations to erotic images both ipsilateral and contralateral to the lesion site. All but one of the amygdala resection patients showed similar enhancements to aversive stimuli and there were no significant group differences in visual cortex BOLD responses in patients compared with controls for either aversive or erotic images. Our results indicate that neither the right nor left amygdala is necessary for the heightened visual cortex BOLD responses observed during emotional stimulus presentation. These data challenge an amygdalo-centric model of emotional modulation and suggest that non-amygdalar processes contribute to the emotional modulation of sensory pathways.