Neurons in dopamine-rich areas of the rat medial midbrain predominantly encode the outcome-related rather than behavioural switching properties of conditioned stimuli

Midbrain dopamine neurons are phasically activated by a variety of sensory stimuli. It has been hypothesized that these activations contribute to reward prediction or behavioural switching. To test the latter hypothesis we recorded from 131 single neurons in the ventral tegmental area and retrorubral field of thirsty rats responding during a modified go/no-go task. One-quarter (n = 33) of these neurons responded to conditioned stimuli in the task, which varied according to the outcome with which they were associated (saccharin or quinine solution) and according to whether they triggered a switch in the ongoing sequence of the animal's behaviour ('behavioural switching'). Almost half the neurons (45%) responded differentially to saccharin- vs. quinine-conditioned stimuli; the activity of a minority (15%) correlated with an aspect of behavioural switching (mostly exhibiting changes from baseline activity in the absence of a behavioural switch) and one-third (33%) encoded various outcome-switch combinations. The strongest response was excitation to the saccharin-conditioned stimulus. Additionally, a proportion (38%) of neurons responded during outcome delivery, typically exhibiting inhibition during saccharin consumption. The neurons sampled did not fall into distinct clusters on the basis of their electrophysiological characteristics. However, most neurons that responded to the outcome-related properties of conditioned stimuli had long action potentials (> 1.2 ms), a reported characteristic of dopamine neurons. Moreover, responses to saccharin-conditioned stimuli were functionally akin to dopamine responses found in the macaque and rat nucleus accumbens responses observed within the same task. In conclusion, our data are more consistent with the reward-prediction than the behavioural switching hypothesis.

Development of a behavioral task measuring reward "wanting" and "liking" in rats

It has been suggested that reward "wanting" and "liking" are mediated by separable brain systems. To facilitate neuropharmacological and neurophysiological research on this issue we developed a behavioral task with putative measures of reward "wanting" and "liking" available on a trial-by-trial basis. We were able to test whether our measures were sensitive to changes in thirsty rats' "wanting" and "liking" of liquid reward by manipulating its delay, taste and volume. We found that three of our putative "wanting" measures (anticipatory errors, reaction time and reward collection latency) were affected by upcoming reward delay and/or taste and our putative "liking" measure (post-reward licking) was sensitive to variations in reward taste and volume. To cross-validate our measures with previous pharmacological work we tested rats following acute, systemic administration of drug compounds that globally enhance serotonin and noradrenaline (imipramine), dopamine (GBR 12909) and opioid (morphine) function. Imipramine augmented the effects of delay and taste on reward "wanting", GBR 12909 attenuated the effects of delay on reward "wanting" and the effects of taste on reward "liking", and morphine reduced the effect of delay on a measure of reward "wanting". Since morphine failed to affect reward "liking" but has been previously found to enhance reward "liking" in taste reactivity tests, our measure requires further pharmacological validation. However, this task shows potential to assess the specific neural mechanisms that contribute to the impact of reward parameters on "wanting" and "liking".

Rat nucleus accumbens neurons predominantly respond to the outcome-related properties of conditioned stimuli rather than their behavioral-switching properties

It has been proposed that nucleus accumbens neurons respond to outcome (reward and punishment) and outcome-predictive information. Alternatively, it has been suggested that these neurons respond to salient stimuli, regardless of their outcome-predictive properties, to facilitate a switch in ongoing behavior. We recorded the activity of 82 single-nucleus accumbens neurons in thirsty rats responding within a modified go/no-go task. The task design allowed us to analyze whether neurons responded to conditioned stimuli that predicted rewarding (saccharin) or aversive (quinine) outcomes, and whether the neural responses correlated with behavioral switching. Approximately one third (28/82) of nucleus accumbens neurons exhibited 35 responses to conditioned stimuli. Over 2/3 of these responses encoded the nature of the upcoming rewarding (19/35) or aversive (5/35) outcome. No response was selective solely for the switching of the rat's behavior, although the activity of approximately one third of responses (11/35) predicted the upcoming outcome and was correlated with the presence or absence of a subsequent behavioral switch. Our data suggest a primary functional role for the nucleus accumbens in encoding outcome-predicting information and a more limited role in behavioral switching.

Second-order stimuli do not always increase overall response rates in second-order schedules of reinforcement in the rat

RATIONALE

Second-order schedules of reinforcement have been used extensively to model reward-seeking and drug-seeking behaviour. Second-order stimuli within second-order schedules have been shown to enhance response rates during operant responding for natural reinforcers and drug reinforcers. This has led some to view second-order schedules of drug reinforcement as a model maintained of drug-seeking in addicts by drug-associated stimuli. However, the functional role of the second-order stimulus within second-order schedules is complex.

OBJECTIVE

We investigated the role of second-order stimuli within a second-order schedule of reinforcement [FI 4 min (FR10: S)] maintained by sweetened water reinforcement.

METHODS

Eight rats were trained to press a bar on a second-order schedule of reinforcement and tested in the presence and absence of the second-order stimulus.

RESULTS

In contrast to most previous work, overall bar-pressing rates were significantly increased when the second-order stimulus was omitted (second-order stimulus omission: 0.17 Hz (+/-0.04, 95% CI); second-order stimulus present: 0.13 Hz (+/-0.04, 95% CI)). However, second-order stimuli also changed the pattern of responding whereby rats would make a bout of bar presses prior to the presentation of the second-order stimulus and then pause briefly after the second-order stimulus. In the absence of second-order stimuli, responding was uniformly high. Control measures, such as the ability of the second-order stimulus to evoke checking for the primary reinforcers, indicated that the second-order stimulus was associated with the primary reinforcer.

CONCLUSIONS

These results demonstrated that although second-order stimuli maintained responding and caused the rat to check for primary reinforcement, overall response rates were increased when the second-order stimuli were omitted. This has implications for interpreting the results of studies where overall response rates within second-order schedules have been the only measure used to assess the effects of potential anti-addiction drugs. Future studies could be improved by performing a second-order stimulus omission test analysing both the overall response rates and the temporal organization of responding with respect to the second-order stimulus.

Thalamic reticular nucleus activation reflects attentional gating during classical conditioning

All senses, except olfaction, are routed through the thalamus to cerebral cortex. Thus, the thalamus is often referred to as the sensory gateway to cortex. Located between thalamus and cortex is a thin lamina of neurons called the thalamic reticular nucleus, which may function as an attentional gate. The phenomenon of blocking in classical conditioning provides an opportunity to test whether an attended stimulus activates the thalamic reticular nucleus more than an unattended stimulus: when a second stimulus is presented together with a previously conditioned stimulus, conditioned responding to the second stimulus is inhibited. Different groups of rats were given conditioning sessions with a single stimulus, a light or a tone, and then given conditioning sessions with compound (light and tone) stimuli. Blocking was confirmed using probe trials of single stimulus presentations. After a final test session of compound stimulus presentations, the brains were processed for the presence of Fos protein. Here we show that Fos-positive neurons were more numerous in the sector of the thalamic reticular nucleus associated with the attended conditioned stimulus than in the sector associated with the unattended stimulus. Thus, we provide evidence for an involvement of the thalamic reticular nucleus in selective attention.

Effects of excitotoxic lesions of the rat ventral striatum on the perception of reward cost

This study examined the possibility that lesions of the nucleus accumbens in rats impair the perception of the "cost of reward", as defined by the number of operant responses needed to obtain a food pellet. In a first experiment, visual cues indicated the cost of reward under a multiple-ratio schedule of reinforcement. In a second experiment, the number of lever presses required for each reward incremented with each trial in a progressive-ratio schedule of reinforcement. Lesions of the nucleus accumbens altered the behavioral response to the increasing cost of reward when there was an absence of external cues. There was no change in the ability of the lesioned rats to respond to visual cues that indicated reward availability. The results are considered in terms of the traditional idea of the nucleus accumbens as a limbic-motor interface: it is suggested that, if the nucleus accumbens serves such a function, it is limited to only some contexts.

The effect of systemic d-amphetamine on motor versus motivational processes in the rat

This study examined the effects of systemic amphetamine in rats performing a reaction time task in which motivation and motor readiness were independently varied. Visual cues indicated the number of trials (one, two or three) needed before reinforcement was made available (i.e., reward cost). Lower reward cost was reflected in both a greater proportion of correctly completed trials and faster reaction times. Reaction times were also shorter as a function of increasing time from start of trial to the onset of the imperative stimulus (foreperiod), reflecting motor readiness or temporal probability summation. It was found that increasing dose of amphetamine resulted in faster reaction times, but the manner in which reaction time was speeded more closely resembled that of motor readiness than it did the speeding due to increasing motivation. Furthermore, the effects on performance of amphetamine and motivational condition were found to be entirely independent: there was no evidence to suggest that amphetamine enhanced, or disrupted, the expectation of forthcoming work or the response vigor which this engenders. It is concluded that systemic amphetamine does not act simply to amplify a natural reward signal. By contrast, amphetamine was found to enhance the effect of foreperiod, suggestive of a mechanism for the psychomotor stimulating effects of amphetamine.

Neural signals in the monkey ventral striatum related to motivation for juice and cocaine rewards

1. The results of neuropsychological, neuropharmacological, and neurophysiological experiments have implicated the ventral striatum in reward-related processes. We designed a task to allow us to separate the effects of sensory, motor, and internal signals so that we could study the correlation between the activity of neurons in the ventral striatum and different motivational states. In this task, a visual stimulus was used to cue the monkeys as to their progress toward earning a reward. The monkeys performed more quickly and with fewer mistakes in the rewarded trials. After analyzing the behavioral results from three monkeys, we recorded from 143 neurons from two of the monkeys while they performed the task with either juice or cocaine reward. 2. In this task the monkey was required to release its grip on a bar when a small visual response cue changed colors from red (the wait signal) to green (the go signal). The duration of the wait signal was varied randomly. The cue became blue whenever the monkey successfully responded to the go signal within 1 s of its appearance. A reward was delivered after the monkey successfully completed one, two, or three trials. The schedules were randomly interleaved. A second visual stimulus that progressively brightened or dimmed signaled to the monkeys their progress toward earning a reward. This discriminative cue allowed the monkeys to judge the proportion of work remaining in the current ratio schedule of reinforcement. Data were collected from three monkeys while they performed this task. 3. The average reaction times became faster and error rates declined as the monkeys progressed toward completing the current schedule of reinforcement and thereby earning a reward, whereas the modal reaction time did not change. As the duration of the wait period before the go signal increased, the monkeys reacted more quickly but their error rates scarcely changed. From these results we infer that the effects of motivation and motor readiness in this task are generated by separate mechanisms rather than by a single mechanism subserving generalized arousal. 4. The activity of 138 ventral striatal neurons was sampled in two monkeys while they performed the task to earn juice reward. We saw tonic changes in activity throughout the trials, and we saw phasic activity following the reward. The activity of these neurons was markedly different during juice-rewarded trials than during correctly performed trials when no reward was forthcoming (or expected). The responses also were weakly, but significantly, related to the proximity of the reward in the schedules requiring more than one trial. 5. The monkeys worked to obtain intravenous cocaine while we recorded 62 neurons. For 57 of the neurons, we recorded activity while the monkeys worked in blocks of trials during which they self-administered cocaine after blocks during which they worked for juice. Although fewer neurons responded to cocaine than to juice reward (19 vs. 33%), this difference was not significant. The neuronal response properties to cocaine and juice rewards were independent; that is, the responses when one was the reward one failed to predict the response when the other was the reward. In addition, the neuronal activity lost most of its selectivity for rewarded trials, i.e, the activity did not distinguish nearly as well between cocaine and sham rewards as between juice and sham rewards. 6. Our results show that mechanisms by which cocaine acts do not appear to be the same as the ones activated when the monkeys were presented with an oral juice reward. This finding raises the intriguing possibility that the effects of cocaine could be reduced selectively without blocking the effects of many natural rewards.

Discriminative cues indicating reward magnitude continue to determine reaction time of rats following lesions of the nucleus accumbens

The role of the nucleus accumbens in incentive motivation is accepted but poorly understood. In this study, we examined in the rat one aspect of motivated behaviour which might be mediated by the nucleus accumbens, namely the translation of a motivational signal (the expected value of a reward) into motor output (responding for the reward). Rats were trained in a reaction time task in which on each trial they received one, two or three pellets. The number of pellets for each trial was randomly determined in advance and signalled to the rats by cue lights. Rats responded with faster reaction times as the size of the expected reward increased. Following ibotenic acid lesions of the nucleus accumbens, there was no difference in the pattern or the speed of reaction times. Although lesions of the nucleus accumbens did not disconnect the motivational system from the motor system, it is possible that the nucleus accumbens is involved in the learning of the incentive salience of external stimuli. Therefore, after postoperative testing the cue contingencies were reversed. Initially, the cues continued to be interpreted according to their prior significance, but eventually both the lesioned rats and the control group acquired the new relationship and did so in equivalent times. We conclude that the nucleus accumbens is not involved in the acquisition or expression of the processes whereby the expectation of rewards of different value is translated into a motor initiation signal.

Covert orienting of attention in macaques. II. Contributions of parietal cortex

1. To understand some of the contributions of parietal cortex to the dynamics of visual spatial attention, we recorded from cortical cells of monkeys performing attentional tasks. We studied 484 neurons in the intraparietal sulcus and adjacent gyral tissue of two monkeys. We measured phasic responses to peripheral visual stimuli while the monkeys attended toward or away from the stimuli or when attention was not controlled. Neurons were tested while the monkeys gazed at a spot of light (simple fixation task), actively attended to a foveal target (foveal attention task), performed a reaction time task (cued reaction time task), made saccadic eye movements to visual targets (saccade task), or responded to a repetitious peripheral target (probability task). 2. In a previous paper we demonstrated that monkeys, like humans, responded more quickly to visual targets when the targets followed briefly flashed visual cues (validly cued targets) (Bowman et al. 1993). It has been hypothesized that the cue attracts attention to its locus and results in faster reaction times (Posner 1980). In the present physiological studies, visual cues consistently excited these neurons when they were flashed in the receptive field. Such activity might signal a shift of attention. Visual targets that fell within the receptive field and that immediately followed the cue evoked relatively weak responses. This response was due to a relative refractory period. 3. Next we tested attentional processes in these tasks that were independent of the visual response to the cue. We placed the cue outside of the receptive field and the target within the receptive field. We found that 23% of these cells had a significant decrease in their firing rate to validly cued targets in their receptive fields under these conditions. Strong responses were evoked by the same target when the cue was flashed in the opposite hemifield (invalidly cued targets). Thus this group of neurons responded best when attention was directed toward the opposite hemifield. 4. For another group of parietal cells (13%) there was an enhanced response to targets in the visual receptive field when the cue was in the same hemifield. For the remaining 64% of the cells there was no significant modulation in this task. 5. The cued reaction time task involved exogenous control of attention; the sensory cue gave spatial and temporal direction to attention. We used several other tasks to test for endogenous control of attention.(ABSTRACT TRUNCATED AT 400 WORDS)

Covert orienting of attention in macaques. I. Effects of behavioral context

1. A task was used by Posner (1980) to measure shifts of attention that occurred covertly, in the absence of an eye movement or other orienting response. This paradigm was used here to assess the nature of covert attentional orienting in monkeys to develop an animal model for neurophysiological studies. Shifts of attention were measurable in monkeys and were consistent across a variety of experimental conditions. 2. The paradigm required that monkeys fixate and release a bar at the appearance of a target, which was preceded by a cue. Reaction times to targets that followed peripheral cues at the same location (validly cued) were significantly faster than those that followed cues in the opposite visual field (invalidly cued). This difference was defined as the validity effect, which as in humans, is used as the measure of a covert attentional shift. 3. When the proportion of validly to invalidly cued targets was decreased, no change was seen in the validity effect of the monkeys. This is in contrast to humans, for whom the ratio of validly to invalidly cued targets affected the magnitude of the validity effect. When 80% of the targets were preceded by cues at the same location, the validity effect was greatest. The effect was reversed when the proportions were reversed. From this result, it is concluded that cognitive processes can affect covert orienting to peripheral cues in humans, whereas in trained monkeys, performance was automatic. 4. To test whether cognitive influences on attention could be demonstrated in the monkey, an animal was taught to use symbolic, foveal signals to covertly direct attention. The magnitude of this validity effect was greater than that obtained with peripheral cues. 5. The effects of motivational and perceptual processes were tested. Although overall reaction times could be modified, the facilitating effects of the cues persisted. This constancy across motivational and perceptual levels supports the notion that the monkeys were performing the task in an automatic way, under the exogenous control of peripheral cues. 6. Most visual cuing has been tested with visual landmarks at the locations of cues and targets. These monkeys were trained with such landmarks, and when tested without them, the attentional effect of the cues was nearly abolished. These data suggest that local visual features can be important for covert orienting. 7. To determine the spatial extent of the effect of the cue, monkeys and humans were tested with four cue-target distances (0-60 degrees).(ABSTRACT TRUNCATED AT 400 WORDS)

Dopamine dependent reaction time deficits in patients with Parkinson's disease are task specific

This study tested the hypothesis that patients with Parkinson's disease are impaired when they must rely on internal information to generate a response. Choice reaction times of control subjects and patients with Parkinson's disease, on and off their medication, were measured in tasks in which the motor demands were constant but which varied in the degree to which the stimuli held intrinsic information about the required response. A dopaminergic deficit was observed only in the tasks which employed stimuli compatible with the response and not in a task employing stimuli arbitrarily associated with the response. The data do not support the hypothesis that patients are differentially impaired in using internalized stimulus-response relationships.

Response-related deficits following unilateral lesions of the medial agranular cortex of the rat

Rats with lesions of the medial agranular frontal cortex (AGm) were tested for sensorimotor function. Spatial response bias and reaction time to lateralized visual targets were recorded in an automated test of visual reaction time. The same rats were also tested for somatosensory capacity and on a skilled reaching task. In all tasks, there was an ipsilateral response bias but no evidence of sensory neglect. In the visual reaction time task, initiation time was lengthened bilaterally. These deficits may parallel the effects on motor function after unilateral frontal cortical lesioning in primates. The results support the hypothesis that rat AGm contains a homologue of primate secondary motor cortex.

Response-related deficits following unilateral lesions of the medial agranular cortex of the rat

Rats with lesions of the medial agranular frontal cortex (AGm) were tested for sensorimotor function. Spatial response bias and reaction time to lateralized visual targets were recorded in an automated test of visual reaction time. The same rats were also tested for somatosensory capacity and on a skilled reaching task. In all tasks, there was an ipsilateral response bias but no evidence of sensory neglect. In the visual reaction time task, initiation time was lengthened bilaterally. These deficits may parallel the effects on motor function after unilateral frontal cortical lesioning in primates. The results support the hypothesis that rat AGm contains a homologue of primate secondary motor cortex.

Visual and auditory association areas of the cat's posterior ectosylvian gyrus: cortical afferents

In a preceding report, we described patterns of thalamic retrograde labeling following 17 tracer deposits on the cat's posterior ectosylvian gyrus and concluded, on the basis of patterns of thalamic connectivity, that the posterior ectosylvian gyrus is composed of three major divisions: a tonotopic auditory zone located anteriorly, a belt of auditory association cortex occupying the gyral crown, and a visual belt located posteriorly. We describe here patterns of transcortical retrograde labeling obtained from tracer deposits in the three zones so defined. Our results indicate that the tonotopic auditory strip is innervated primarily by axons from low-order auditory areas (AAF, AI, P, VP, and V), that the auditory belt receives its strongest input from nontonotopic auditory fields (AII, temporal cortex, and other parts of the auditory belt), and that projections to the visual belt derive primarily from extrastriate visual areas (ALLS, PLLS, DLS, 19, 20, and 21) and from association areas affiliated with the visual system (insular cortex, posterior cingulate gyrus, area 7p, and frontal cortex). We discuss the results in relation to previous systems for parcellating the posterior ectosylvian gyrus of the cat and consider the possibility that divisions of the feline posterior ectosylvian gyrus correspond directly to areas making up the superior temporal gyrus in primates.

Visual and auditory association areas of the cat's posterior ectosylvian gyrus: thalamic afferents

The feline posterior ectosylvian gyrus contains a broad band of association cortex that is bounded anteriorly by tonotopic auditory areas and posteriorly by retinotopic visual areas. To characterize the possible functions of this cortex and to throw light on its pattern of internal divisions, we have carried out an analysis of its thalamic afferents. Deposits of differentiable retrograde tracers were placed at 17 cortical sites in nine cats. The deposit sites spanned the crown of the posterior ectosylvian gyrus and adjacent cortex in the suprasylvian sulcus. We compiled counts of retrogradely labeled neurons in 12 thalamic nuclei delineated by use of Nissl and acetylcholinesterase stains. We then employed a statistical clustering algorithm to identify groups of injections that gave rise to similar patterns of thalamic labeling. The results suggest that the posterior ectosylvian gyrus contains 3 fundamentally different cortical districts that have the form of parallel vertical bands. Very anterior cortex, overlapping previously identified tonotopic auditory areas (AI, P and VP) receives a dense projection from the laminated division of the medial geniculate body (MGl). An intermediate strip, to which we refer as the auditory belt, is innervated by axons from nontonotopic divisions of the medial geniculate body (MGds, MGvl, MGm, and MGd), from the lateral division of the posterior group (Pol), and from the posterior suprageniculate nucleus (SGp). A posterior strip, to which we refer as EPp, receives strong projections from the LM-SG complex (LM-SGa and LMp), and lighter projections from the intralaminar and lateroposterior (LPm and LPl) nuclei. On grounds of thalamic connectivity, EPp is not obviously distinguishable from adjacent retinotopic visual areas (PLLS, DLS, and VLS), and may be regarded as forming, together with these areas, a connectionally homogeneous visual belt.