Development of brain stimulation reward in the medial prefrontal cortex: facilitation by prior electrical stimulation of the sulcal prefrontal cortex

Repeated cocaine exposure increases fast-spiking interneuron excitability in the rat medial prefrontal cortex

The medial prefrontal cortex plays a key role in cocaine addiction. However, how chronic cocaine exposure affects cortical networks remains unclear. Most studies have focused on layer 5 pyramidal neurons (the circuit output), while the response of local GABAergic interneurons to cocaine remains poorly understood. Here, we recorded from fast-spiking interneurons (FS-IN) after repeated cocaine exposure and found altered membrane excitability. After cocaine withdrawal, FS-IN showed an increase in the number of spikes evoked by positive current injection, increased input resistance, and decreased hyperpolarization-activated current. We also observed a reduction in miniature excitatory postsynaptic currents, whereas miniature inhibitory postsynaptic current activity was unaffected. We show that, in animals with cocaine history, dopamine receptor D(2) activation is less effective in increasing FS-IN intrinsic excitability. Interestingly, these alterations are only observed 1 wk or more after the last cocaine exposure. This suggests that the dampening of D(2)-receptor-mediated response may be a compensatory mechanism to rein down the excitability of FS-IN.

Tracing the Neuroanatomical Profiles of Reward Pathways with Markers of Neuronal Activation

Functional neuroanatomical tools have played an important role in proposing which structures underlie brain stimulation reward circuitry. This review focuses on studies employing metabolic markers of neuronal and glial activation, including 2-deoxyglucose, cytochrome oxidase, and glycogen phosphorylase, and a marker of cellular activation, the immediate early gene c-fos. The principles underlying each method, their application to the study of brain stimulation reward, and their strengths and limitations are described. The usefulness of this strategy in identifying candidate structures, and the degree of overlap in the patterns of activation arising from different markers is addressed in detail. How these data have contributed to an understanding of the organization of reward circuitry and directed our thinking towards an alternative framework of neuronal arrangement is discussed in the final section.

Neurons in medial prefrontal cortex signal memory for fear extinction

Conditioned fear responses to a tone previously paired with a shock diminish if the tone is repeatedly presented without the shock, a process known as extinction. Since Pavlov it has been hypothesized that extinction does not erase conditioning, but forms a new memory. Destruction of the ventral medial prefrontal cortex, which consists of infralimbic and prelimbic cortices, blocks recall of fear extinction, indicating that medial prefrontal cortex might store long-term extinction memory. Here we show that infralimbic neurons recorded during fear conditioning and extinction fire to the tone only when rats are recalling extinction on the following day. Rats that froze the least showed the greatest increase in infralimbic tone responses. We also show that conditioned tones paired with brief electrical stimulation of infralimbic cortex elicit low freezing in rats that had not been extinguished. Thus, stimulation resembling extinction-induced infralimbic tone responses is able to simulate extinction memory. We suggest that consolidation of extinction learning potentiates infralimbic activity, which inhibits fear during subsequent encounters with fear stimuli.

Prefrontal cortex and the relative associability of taste and place cues in rats

The effects of cutting the corticocortical connections between medial and sulcal prefrontal areas on the conditioning of taste and place cues were examined. In Experiment 1, rats were simultaneously exposed to taste and place cues before injection of 0.15 M LiCl. In controls, a significant conditioned taste aversion (CTA) but no conditioned place aversion (CPA) was observed. In contrast, rats with bilateral knife cuts showed a significant CPA but a weaker CTA. To test whether these results could have been due to the effects of simultaneously exposing the rats to taste and place cues during conditioning, rats were trained independently in either CTA or CPA paradigms in Experiment 2. In the CTA test, rats both in operated and control groups showed a CTA when first tested. Rats with bilateral knife cuts, however, showed a weaker CTA than those in the control group. In the CPA test, rats in the control group did not exhibit a CPA, whereas the knife cut group did. Rats with sham lesions tested in Experiment 2 did not differ from control subjects on either the CPA or the CTA test. Thus, bilateral cuts increased the CPA and decreased the CTA even when tested independently. These results indicate that the relative ease of association of place and taste stimuli may be accounted for in part by the organization of the intrinsic connections of the prefrontal cortex in the rat.

Determinants of the slow acquisition of medical and sulcal prefrontal cortex self-stimulation: an individual differences approach

Stimulation-naive rats were tested for motor activity during noncontingent electrical stimulation of the medial prefrontal cortex (MPC) or sulcal prefrontal cortex (SPC). Defecation during stimulation was also measured. The rats were then tested using a conditioned taste aversion paradigm for aversion to a novel flavor (0.1% saccharin) paired with stimulation. Finally, the rats were trained to acquire self-stimulation over 26 days of training. Large individual differences were seen in motor activity, defecation, and conditioned taste aversion to initial stimulation and in the subsequent speed of self-stimulation acquisition. In the MPC-stimulated group, acquisition speed was positively correlated with motor activity to initial stimulation and negatively correlated with defecation to this stimulation. In the SPC-stimulated group, the same correlations were evident, but only when rats suffering seizures prior to self-stimulation acquisition were excluded from the analysis. Such preacquisition seizures, which were only found in the SPC-stimulated group, retarded self-stimulation acquisition. In most rats, MPC or SPC stimulation failed to condition a taste aversion to saccharin. These results suggest that the slow acquisition of MPC and SPC self-stimulation may be partly related to the motor suppressive, aversive, and convulsive properties of initial stimulation.

Behaviourally derived estimates of excitability in striatal and medial prefrontal cortical self-stimulation sites

The refractory periods of the substrate underlying brain-stimulation reward were investigated in three rats with moveable electrodes implanted in the rostral caudate-putamen and the medial prefrontal cortex. Acquisition of caudate-putamen self-stimulation occurred within the first session, while self-stimulation for medial prefrontal cortex was observed only after three sessions of caudate-putamen stimulation. The currents required for self-stimulation ranged from 300 to 800 microA (0.1 ms pulse duration) across animals; the maximum response rates averaged roughly 40 bar presses per minute for both structures. Refractory period estimates were obtained from ten caudate-putamen and four medial prefrontal cortex sites. The time course of recovery had the following profile: the curves began to rise at 0.65 ms and 0.95 ms for caudate-putamen and medial prefrontal cortex stimulation, respectively, thereafter increasing to approach an asymptote at 6.00 ms for the caudate-putamen and 6.25 ms for the medial prefrontal cortex. The mean effectiveness value corresponding to the asymptotic portion of the curves was 73% for the caudate-putamen and 69% for the medial prefrontal cortex. Like other forebrain structures, the behaviourally derived refractory periods underlying caudate-putamen and medial prefrontal cortex stimulation, at least at these particular sites, are significantly longer than those observed in most medial forebrain bundle areas, both beginning and ending later. One interpretation for the similarity in their refractory period profiles and the apparent facilitating effect of caudate-putamen stimulation on acquisition of medial prefrontal cortex self-stimulation is that these two regions form part of the same reward substrate.

The acquisition of self-stimulation of the medical prefrontal cortex following exposure to escapable or inescapable footshock

The effect of acute stress on the acquisition of an instrumental action reinforced by electrical stimulation of the medial prefrontal cortex (MPC) was investigated by exposing rats to either escapable, inescapable or no footshock prior to daily self-stimulation training sessions. Treatment with inescapable footshock did not affect the number of sessions required for acquisition of MPC self-stimulation but did increase the rate of responding over acquisition sessions compared with the no-shock group. When the treatment footshock was escapable, however, both a facilitation in acquisition, as indexed by a reduction in the number of sessions to criterion, and an increase in the rate of MPC self-stimulation was found. These data were interpreted as offering evidence for the operation of a dopaminergic mechanism in the acquisition of MPC self-stimulation. Further, they indicate, contrary to the reported effects of footshock on self-stimulation of other brain areas, that exposure to acute stress has a facilitatory effect on the rate of self stimulation of the MPC.

Ketamine blocks the plasticity associated with prefrontal cortex self-stimulation

Intracranial self-stimulation (ICSS) at sites within the medial prefrontal cortex (MFC) is acquired slowly but can be hastened by prior exposure to a regimen of noncontingent stimulation delivered to the MFC ICSS electrode. The facilitatory effects of noncontingent MFC stimulation on subsequent ICSS acquisition were blocked by pretreatment with ketamine, a noncompetitive antagonist of the N-methyl-D-aspartate (NMDA) receptor. These findings provide further support for the view that the NMDA receptor is importantly involved in mechanisms of neural plasticity.

Amphetamine affects the extinction of self-stimulation differently in prefrontal cortex and posterior hypothalamus of rats

The effects of amphetamine on the extinction of intracranial self-stimulation (ICSS) and on postextinction ICSS performance were examined in rats implanted with electrodes either in medial prefrontal cortex (mPFC) or in the posterior hypothalamus-ventral tegmental area (PH-VTA). Lever-pressing for ICSS was allowed to stabilize in daily 15-minute sessions before each animal was exposed to 5 minutes of extinction (responding without reward). Animals were administered either 0.25 mg/kg d-amphetamine or saline before baseline, extinction and postextinction sessions. After amphetamine treatment, the number of lever presses during extinction was higher in mPFC animals and lower in PH-VTA animals compared with saline-treated controls. Rates did not change immediately after extinction but, one day later, rates had increased in all saline-treated animals (both PH-VTA and mPFC animals) and had decreased in all amphetamine-treated animals. These findings demonstrated that the effects of amphetamine on the extinction of ICSS were different in cortical and hypothalamic sites, possibly because of regional differences in stimulus-evoked reinforcement and inhibitory processes.

Cocaine facilitates prefrontal cortex self-stimulation

It has been demonstrated that cocaine HCl lowers thresholds for and increases rates of medial forebrain bundle intracranial self-stimulation. The influence of cocaine on prefrontal cortex self-stimulation was assessed in the present experiment. The prefrontal cortex was chosen because evidence indicates that the neuroanatomical and pharmacological substrate for intracranial self-stimulation at this site may differ from the substrate for medial forebrain bundle self-stimulation. Cocaine significantly decreased train-duration thresholds and increased the rate of prefrontal cortex self-stimulation. It was concluded that cocaine facilitates both prefrontal cortex and medial forebrain bundle self-stimulation, perhaps by influencing neural activity in the mesocorticolimbic dopamine system. However, the role of dopamine in cocaine's effects at both sites remains speculative.

Differences in sensitivity to neuroleptic blockade: medial forebrain bundle versus frontal cortex self-stimulation

The effects of systemic injections of the dopamine receptor antagonist, cis-flupenthixol were tested on intracranial self-stimulation at electrode sites in the medial forebrain bundle and the medial prefrontal cortex. Changes in the reward effectiveness of the brain stimulation were assessed using a curve-shift paradigm. Low to moderate doses of cis-flupenthixol (0.05, 0.1 and 0.15 mg/kg) consistently produced larger upward shifts in the rate-frequency function for medial forebrain bundle than for medial prefrontal self-stimulation. At the highest doses of cis-flupenthixol (0.15 and 0.2 mg/kg), some of the medial forebrain bundle rats failed to respond, whereas all medial prefrontal rats responded at these doses. These results demonstrate that medial forebrain bundle self-stimulation is much more dependent on dopamine systems than is prefrontal cortex self-stimulation.

Controllability of prestimulation of the medial prefrontal cortex determines the facilitation of self-stimulation and kindled seizures

Electrical stimulation of the medial prefrontal cortex (MPC) was administered according to the triadic design typically used to demonstrate learned helplessness. Three groups received either controllable, uncontrollable or no stimulation during the pretreatment phase. The effects of this pretreatment on the acquisition of self-stimulation at the same electrode site were investigated in the second phase of the experiment. Relative to unstimulated controls, both controllable and uncontrollable prestimulation facilitated the acquisition of self-stimulation and produced higher self-stimulation rates. In addition, compared with controllable stimulation, pretreatment with uncontrollable stimulation produced a greater facilitation in self-stimulation rate. The unambiguous demonstration of a behavioural facilitation produced by pretreatment with uncontrollable stimulation is, effectively, the inverse of the typical learned helplessness finding. It was also found, in the second phase of the experiment, that 6 of the 7 rats previously exposed to uncontrollable stimulation developed full class 5 seizures. No behavioural evidence of kindling was seen in any of the other rats or during the prestimulation procedure. These data are interpreted in terms of kindling and stress effects both proximal and distal to the site of stimulation.

Multiple reward systems and the prefrontal cortex

Electrical stimulation of the major divisions of the prefrontal cortex, the mediodorsal and sulcal areas, can serve as a reinforcing stimulus. Studies of self-stimulation of the prefrontal cortex have produced behavioral, anatomical and pharmacological evidence that the substrate of these rewarding effects can be dissociated from that subserving self-stimulation of ventral diencephalic sites such as the lateral hypothalamus. Other studies indicate that within the prefrontal cortex itself, self-stimulation of the medial and sulcal divisions can be attributed to dissociable processes. These observations suggest the existence of multiple, largely autonomous prefrontal subsystems involved in reinforcement. This raises the question of the functional significance of such systems, and of their organization. An approach to this problem is to consider the relationship between the behavioral functions of the prefrontal divisions and the characteristics of stimulation-induced reward obtained at each site. Studies of the effects of restricted prefrontal lesions indicate that the medial and sulcal divisions can be dissociated according to their involvement in the control of distinct types of sensory and motor events. Further experiments indicate that damage to each division causes selective deficits in the learning of stimulus-reinforcer and response-reinforcer relations, depending in part on the nature of the reinforcing event. Conditioning experiments further show that the rewarding effects produced by stimulation of these areas are preferentially associated to sensory events which correspond to the functional specialization of each division. These data are interpreted to suggest that different rewarding events and/or different attributes of rewarding stimuli are processed by distinct systems which are reflected by the organization of dissociable self-stimulation pathways.

Prefrontal cortex lesions attenuate substantia nigra self-stimulation: a reward summation analysis

A curve-shift paradigm was used to assess the effects of lesions of the prefrontal cortex on self-stimulation from electrode sites in the substantia nigra. Combined lesions of the medial and sulcal cortical regions severely attenuated substantia nigra self-stimulation. These results are discussed in the context of the frontal cortex and the substantia nigra as belonging to a reinforcement system that is largely independent of the medial forebrain bundle system.

The role of corticocortical projections in self-stimulation of the prelimbic and sulcal prefrontal cortex in rats

Four experiments were performed to assess the nature of the contribution of the corticocortical projections between the prelimbic and sulcal divisions of the rat prefrontal cortex to self-stimulation (SS) of these sites. The first experiment showed that transection of these projections by parasagittal knife cuts or bilateral electrolytic lesions of the prelimbic cortex had no effect on SS of the sulcal cortex. The second experiment demonstrated that SS of the prelimbic cortex could be obtained after transection of the corticocortical projection path. The third experiment demonstrated that the deficit in prelimbic SS, seen to follow such bilateral transections, is a function of the amount of exposure to the stimulation given to the animals after the lesion. The fourth experiment showed that the stimulation-dependent process underlying the acquisition of prelimbic and sulcal SS could be dissociated by the knife cuts. The discussion focused on the implications of these findings for an account of prefrontal self-stimulation behavior.

Acquisition of intracranial self-stimulation in medial prefrontal cortex of rats facilitated by amphetamine

Two groups of rats were trained to lever press for intracranial self-stimulation (ICSS) in the medial prefrontal cortex (mPFC) using a uniform amount of stimulation for all animals. One group acquired the lever pressing task very gradually during saline pretreatment but dramatically improved its rate of acquisition during the third week of training when pretreated with d-amphetamine (0.5 mg/kg). Administration of amphetamine to the other group of rats before each of the first five training sessions greatly facilitated acquisition of the ICSS task, and a significant improvement in performance over the saline control group appeared on the third day of training. After ICSS performance had stabilized, testing the animals revealed a significant amphetamine-induced increase in rate over the dose range of 0.25 to 1.0 mg/kg. These effects of amphetamine suggest that ICSS in mPFC is sensitive to changes in catecholamine neurotransmission during both the acquisition and maintenance of this behavior.

Rat strain differences in the acquisition of hippocampal self-stimulation

The rate of acquisition of lever-pressing for electrical stimulation of the hippocampus (HPC) was compared in two strains of rat: barrier-sustained Wistar and Sprague-Dawley. Sprague-Dawley rats initially bar-pressed at very low rates and took a median of 11 days to self-stimulate, according to the criterion used. Wistar rats all reached the same criterion in the first test session. Differential sensitivity to the activating effects of stimulation as an explanation for this difference was ruled out by the observation that both strains decreased response rates at the same rate and to the same level if stimulation was made non-contingent on lever-pressing. Differential threshold for reward was ruled out by the observation that rate-intensity curves yielded the same threshold currents and peak rates in both strains. Finally, it was shown that the rate of development of kindled seizures in the two strains of rats is different: Wistars kindle to full seizures faster than do Sprague-Dawleys. The relationship between the quicker onset of self-stimulation and of kindled seizures in Wistars is discussed.

Distinct substrates influence the acquisition of self-stimulation of the hippocampus and the prefrontal cortex

Self-stimulation (SS) of both the medial prefrontal cortex (MPFC) and the dorsolateral hippocampus (HPC) is known to develop slowly, over a period of days. In both cases, the acquisition of bar-pressing can be markedly hastened by delivery of noncontingent electrical stimulation for several days prior to SS training. The similarity of these effects suggests that there might be a common substrate mediating the acquisition process. However, in the present experiment, pre-training noncontingent electrical stimulation of the MPFC had no effect on how rapidly rats acquired the bar-pressing response for HPC stimulation, or vice versa. A further dissociation of the elements governing the acquisition process for these two SS sites was suggested by the observation that pre-training noncontingent stimulation of the entorhinal cortex facilitated the speed of acquisition of SS of the HPC but not of the MPFC. It seems that the HPC and entorhinal cortex can be excluded from the subset of neural structures which are known to influence the acquisition process governing MPFC SS. These and other data suggest that the development of SS of the MPFC and HPC can be regarded, at least in part, as involving a process rooted in distinct substrates.

Cortical and ventral tegmental systems exert opposing influences on self-stimulation from the prefrontal cortex

Intracranial self-stimulation (ICSS) was obtained from 3 areas of anteromedial cortex: the prelimbic area (Brodman's area 32), the anterior cingulate area and the posterior cingulate area. Electrical stimulation in the prelimbic and anterior cingulate areas also produces a behavioral inhibition which is most pronounced at anterior sites (i.e. prelimbic) and declines at increasingly more posterior sites. It was found that the acquisition of responding for ICSS and the magnitude of amphetamine's facilitation of ICSS were inversely related to the degree of behavioral inhibition. These data and the ability of amphetamine to reverse prefrontal stimulation-induced inhibition suggest an important interaction between the prefrontal cortex and the mesolimbic dopamine systems in the control of goal-directed behavior. A model involving cortical suppression of mesolimbic dopamine function is discussed.

Post-stimulation excitability of mediodorsal thalamic self-stimulation

The post-stimulation excitability of the substrate for brain stimulation reward in the mediodorsal thalamus was assessed using equal- and unequal-pulse procedures. In 3 rats, refractory periods were found to begin no earlier than 1 ms and to end as late as 10 ms. Using test (T) pulses 1.5 times the amplitude of condition (C) pulses, the contribution of absolute and relative refractory periods was determined in one subject. No change in the slope of the recovery function was obtained in this condition, suggesting that several populations of neurons with different absolute refractory periods compose the behaviorally relevant substrate. A large supernormal contribution, evaluated by increasing the C amplitude to 1.5T, occurred between 3 and 10 ms with a peak at 7.5 ms. These results suggest that mediodorsal thalamic self-stimulation is mediated by a wide range of small, probably unmyelinated fibers.

An investigation of the factors affecting development of frontal cortex self-stimulation

Intracranial self-stimulation (ICSS) of the medial prefrontal cortex (MFC) is acquired gradually, taking 4 or more days to establish. One explanation for this finding is that the stimulation becomes more rewarding with repetition. Four experiments were conducted to test this hypotheses. In Experiment 1, the MFC ICSS frequency thresholds remained constant over the first 3 weeks of testing while the rate of lever pressing response increased. In Experiment 2, it was found that acquisition of MFC ICSS was much more rapid when a motorically simpler response (nose-poking) was employed. Similarly, Experiments 3 and 4 further demonstrated that response factors such as task complexity may ultimately determine the rate of development of frontal cortex ICSS. Overall, these data suggest that independent of the rewarding effects of MFC stimulation there are other effects that initially interfere with learning of complex operant responses.