Catecholamine theories of reward: a critical review

Orexin signaling via the orexin 1 receptor mediates operant responding for food reinforcement

BACKGROUND

Orexin (hypocretin) signaling is implicated in drug addiction and reward, but its role in feeding and food-motivated behavior remains unclear.

METHODS

We investigated orexin's contribution to food-reinforced instrumental responding using an orexin 1 receptor (Ox1r) antagonist, orexin -/- (OKO) and littermate wildtype (WT) mice, and RNAi-mediated knockdown of orexin. C57BL/6J (n = 76) and OKO (n = 39) mice were trained to nose poke for food under a variable ratio schedule of reinforcement. After responding stabilized, a progressive ratio schedule was initiated to evaluate motivation to obtain food reinforcement.

RESULTS

Blockade of Ox1r in C57BL/6J mice impaired performance under both the variable ratio and progressive ratio schedules of reinforcement, indicating impaired motivational processes. In contrast, OKO mice initially demonstrated a delay in acquisition but eventually achieved levels of responding similar to those observed in WT animals. Moreover, OKO mice did not differ from WT mice under a progressive ratio schedule, indicating delayed learning processes but no motivational impairments. Considering the differences between pharmacologic blockade of Ox1r and the OKO mice, animals with RNAi mediated knockdown of orexin were then generated and analyzed to eliminate possible developmental effects of missing orexin. Orexin gene knockdown in the lateral hypothalamus in C57BL/6J mice resulted in blunted performance under both the variable ratio and progressive ratio schedules, resembling data obtained following Ox1r antagonism.

CONCLUSIONS

The behavior seen in OKO mice likely reflects developmental compensation often seen in mutant animals. These data suggest that activation of the Ox1r is a necessary component of food-reinforced responding, motivation, or both in normal mice.

Pupil dilation betrays the timing of decisions

The notion of “mind-reading” by carefully observing another individual's physiological responses has recently become commonplace in popular culture, particularly in the context of brain imaging. The question remains, however, whether outwardly accessible physiological signals indeed betray a decision before a person voluntarily reports it. In one experiment we asked observers to push a button at any time during a 10-s period (“immediate overt response”). In a series of three additional experiments observers were asked to select one number from five sequentially presented digits but concealed their decision until the trial's end (“covert choice”). In these experiments observers either had to choose the digit themselves under conditions of reward and no reward, or were instructed which digit to select via an external cue provided at the time of the digit presentation. In all cases pupil dilation alone predicted the choice (timing of button response or chosen digit, respectively). Consideration of the average pupil-dilation responses, across all experiments, showed that this prediction of timing was distinct from a general arousal or reward-anticipation response. Furthermore, the pupil dilation appeared to reflect the post-decisional consolidation of the selected outcome rather than the pre-decisional cognitive appraisal component of the decision. Given the tight link between pupil dilation and norepinephrine levels during constant illumination, our results have implications beyond the tantalizing mind-reading speculations. These findings suggest that similar noradrenergic mechanisms may underlie the consolidation of both overt and covert decisions.

Depression: The predisposing influence of stress

Aversive experiences have been thought to provoke or exacerbate clinical depression. The present review provides a brief survey of the stress-depression literature and suggests that the effects of stressful experiences on affective state may be related to depletion of several neurotransmitters, including norepinephrine, dopamine, and serotonin. A major element in determining the neurochemical changes is the organism's ability to cope with the aversive stimuli through behavioral means. Aversive experiences give rise to behavioral attempts to cope with the stressor, coupled with increased utilization and synthesis of brain amines to contend with environmental demands. When behavioral coping is possible, neurochemical systems are not overly taxed, and behavioral pathology will not ensue. However, when there can be no behavioral control over the stressful stimuli, or when the aversive experience is perceived as uncontrollable, increased emphasis is placed on coping through endogenous neurochemical mechanisms. Amine utilization increases appreciably and may exceed synthesis, resulting in a net reduction of amine stores, which in turn promotes or exacerbates affective disorder. The processes governing the depletions may be subject to sensitization or conditioning, such that exposure to traumatic experiences may have long-term repercussions when the organism subsequently encounters related stressful stimuli. With continued uncontrollable stimulation, adaptation occurs in the form of increased activity of synthetic enzymes, and levels of amines approach basal values. It is suggested that either the initial amine depletion provoked by aversive experiences or a dysfunction of the adaptive processes, resulting in persistent amine depletion, contributes to behavioral depression. Aside from the contribution of behavioral coping, several organismic, experiential, and environmental variables will influence the effects of aversive experiences on neurochemical activity, and may thus influence vulnerability to depression.

Sensation seeking: A comparative approach to a human trait

A comparative method of studying the biological bases of personality compares human trait dimensions with likely animal models in terms of genetic determination and common biological correlates. The approach is applied to the trait of sensation seeking, which is defined on the human level by a questionnaire, reports of experience, and observations of behavior, and on the animal level by general activity, behavior in novel situations, and certain types of naturalistic behavior in animal colonies. Moderately high genetic determination has been found for human sensation seeking, and marked strain differences in rodents have been found in open-field behavior that may be related to basic differences in brain neurochemistry. Agonistic and sociable behaviors in both animals and humans and the trait measure of sensation seeking in humans have been related to certain common biological correlates such as gonadal hormones, monoamine oxidase (MAO), and augmenting of the cortical evoked potential.

The monoamine systems in the rodent brain are involved in general activity, exploratory behavior, emotionality, socialization, dominance, sexual and consummately behaviors, and intracranial self-stimulation. Preliminary studies have related norepinephrine and enzymes involved in its production and degradation to human sensation seeking. A model is suggested that relates mood, behavioral activity, sociability, and clinical states to activity of the central catecholamine neurotransmitters and to neuroregulators and other transmitters that act in opposite ways on behavior or stabilize activity in the arousal systems. Stimulation and behavioral activity act on the catecholamine systems in a brain–behavior feedback loop. At optimal levels of catecholamine systems activity (CSA) mood is positive and activity and sociability are adaptive. At very low or very high levels of CSA mood is dysphoric, activity is restricted or stereotyped, and the organism is unsocial or aggressively antisocial. Novelty, in the absence of threat, may be rewarding through activation of noradrenergic neurons.

Précis ofThe neuropsychology of anxiety: An enquiry into the functions of the septo-hippocampal system

A model of the neuropsychology of anxiety is proposed. The model is based in the first instance upon an analysis of the behavioural effects of the antianxiety drugs (benzodiazepines, barbiturates, and alcohol) in animals. From such psychopharmacologi-cal experiments the concept of a “behavioural inhibition system” (BIS) has been developed. This system responds to novel stimuli or to those associated with punishment or nonreward by inhibiting ongoing behaviour and increasing arousal and attention to the environment. It is activity in the BIS that constitutes anxiety and that is reduced by antianxiety drugs. The effects of the antianxiety drugs in the brain also suggest hypotheses concerning the neural substrate of anxiety. Although the benzodiazepines and barbiturates facilitate the effects of γ-aminobutyrate, this is insufficient to explain their highly specific behavioural effects. Because of similarities between the behavioural effects of certain lesions and those of the antianxiety drugs, it is proposed that these drugs reduce anxiety by impairing the functioning of a widespread neural system including the septo-hippocampal system (SHS), the Papez circuit, the prefrontal cortex, and ascending monoaminergic and cholinergic pathways which innervate these forebrain structures. Analysis of the functions of this system (based on anatomical, physiological, and behavioural data) suggests that it acts as a comparator: it compares predicted to actual sensory events and activates the outputs of the BIS when there is a mismatch or when the predicted event is aversive. Suggestions are made as to the functions of particular pathways within this overall brain system. The resulting theory is applied to the symptoms and treatment of anxiety in man, its relations to depression, and the personality of individuals who are susceptible to anxiety or depression.

Dopamine, schizophrenia, mania, and depression: Toward a unified hypothesis of cortico-striatopallido-thalamic function

Considerable evidence from preclinical and clinical investigations implicates disturbances of brain dopamine (DA) function in the pathophysiology of several psychiatric and neurologic disorders. We describe a neural model that may help organize theseindependent experimental observations. Cortical regions classically associated with the limbic system interact with infracortical structures, including the nucleus accumbens, ventral pallidum, and dorsomedial nucleus of the thalamus. In our model, overactivity in forebrain DA systems results in the loss of lateral inhibitory interactions in the nucleus accumbens, causing disinhibition of pallidothalamic efferents; this in turn causes rapid changes and a loss of focused corticothalamic activity in cortical regions controlling cognitive and emotional processes. These effects might be manifested clinically by some symptoms of psychoses. Underactivity of forebrain DA results in excess lateral inhibition in the nucleus accumbens, causing tonic inhibition of pallidothalamic efferents; this perpetuates tonic corticothalamic activity and prevents the initiation of new activity in other critical cortical regions. These effects might be manifested clinically by some symptoms of depression. This model parallels existing explanations for the etiology of several movement disorders, and may lead to testable inferences regarding the neural substrates of specific psychopathologies.

Neuroleptics and operant behavior: The anhedonia hypothesis

Neuroleptic drugs disrupt the learning and performance of operant habits motivated by a variety of positive reinforcers, including food, water, brain stimulation, intravenous opiates, stimulants, and barbiturates. This disruption has been demonstrated in several kinds of experiments with doses that do not significantly limit normal response capacity. With continuous reinforcement neuroleptics gradually cause responding to cease, as in extinction or satiation. This pattern is not due to satiation, however, because it also occurs with nonsatiating reinforcement (such as saccharin or brain stimulation). Repeated tests with neuroleptics result in earlier and earlier response cessation reminiscent of the kind of decreased resistance to extinction caused by repeated tests without the expected reward. Indeed, withholding reward can have the same effect on responding under later neuroleptic treatment as prior experience with neuroleptics themselves; this suggests that there is a transfer of learning (really unlearning) from nonreward to neuroleptic conditions. These tests under continuous reinforcement schedules suggest that neuroleptics blunt the ability of reinforcers to sustain responding at doses which largely spare the ability of the animal to initiate responding. Animals trained under partial reinforcement, however, do not respond as well during neuroleptic testing as animals trained under continuous reinforcement. Thus, neuroleptics can also impair responding (though not response capacity) that is normally sustained by environmental stimuli (and associated expectancies) in the absence of the primary reinforcer. Neuroleptics also blunt the euphoric impact of amphetamine in humans. These data suggest that the most subtle and interesting effect of neuroleptics is a selective attenuation of motivational arousal which is (a) critical for goal-directed behavior, (b) normally induced by reinforcers and associated environmental stimuli, and (c) normally accompanied by the subjective experience of pleasure. Because these drugs are used to treat schizophrenia and because they cause parkinsonian-like side effects, this action has implications for a better understanding of human pathology as well as normal motivational processes.

Toward a general psychobiological theory of emotions

Emotions seem to arise ultimately from hard-wired neural circuits in the visceral-limbic brain that facilitate diverse and adaptive behavioral and physiological responses to major classes of environmental challenges. Presumably these circuits developed early in mammalian brain evolution, and the underlying control mechanisms remain similar in humans and “lower” mammals. This would suggest that theoretically guided studies of the animal brain can reveal how primitive emotions are organized in the human brain. Conversely, granted this cross-species heritage, it is arguable that human introspective access to emotional states may provide direct information concerning operations of emotive circuits and thus be a primary source of hypotheses for animal brain research. In this article the possibility that emotions are elaborated by transhypothalamic executive (command) circuits that concurrently activate related behavior patterns is assessed. Current neurobehavioral evidence indicates that there are at least four executive circuits of this type – those which elaborate central states of expectancy, rage, fear, and panic. The manner in which learning and psychiatric disorders may arise from activities of such circuits is also discussed.