Role of the prefrontal cortex of the rat in learning and decision making: effects of transient inactivation

The medial prefrontal cortex during flexible decisions: Evidence for its role in distinct working memory processes

During decisions that involve working memory, task-related information must be encoded, maintained across delays, and retrieved. Few studies have attempted to causally disambiguate how different brain structures contribute to each of these components of working memory. In the present study, we used transient optogenetic disruptions of rat medial prefrontal cortex (mPFC) during a serial spatial reversal learning (SSRL) task to test its role in these specific working memory processes. By analyzing numerous performance metrics, we found: (1) mPFC disruption impaired performance during only the choice epoch of initial discrimination learning of the SSRL task; (2) mPFC disruption impaired performance in dissociable ways across all task epochs (delay, choice, return) during flexible decision-making; (3) mPFC disruption resulted in a reduction of the typical vicarious-trial-and-error rate modulation that was related to changes in task demands. Taken together, these findings suggest that the mPFC plays an outsized role in working memory retrieval, becomes involved in encoding and maintenance when recent memories conflict with task demands, and enables animals to flexibly utilize working memory to update behavior as environments change.

Early Life to Adult Brain Lipidome Dynamic: A Temporospatial Study Investigating Dietary Polar Lipid Supplementation Efficacy

The lipid composition of the brain is well regulated during development, and the specific temporospatial distribution of various lipid species is essential for the development of optimal neural functions. Dietary lipids are the main source of brain lipids and thus contribute to the brain lipidome. Human milk is the only source of a dietary lipids for exclusively breastfed infant. Notably, it contains milk fat globule membrane (MFGM) enriched in polar lipids (PL). While early life is a key for early brain development, the interplay between dietary intake of polar lipids and spatial dynamics of lipid distribution during brain development is poorly understood. Here, we carried out an exploratory study to assess the early postnatal temporal profiling of brain lipidome between postnatal day (PND) 7 and PND 50 using matrix-assisted laser desorption ionization as a mass spectrometry imaging (MALDI-MSI) in an in vivo preclinical model. We also assessed the effect of chronic supplementation with PL extracted from alpha-lactalbumin-enriched whey protein concentrate (WPC) containing 10% lipids, including major lipid classes found in the brain (37% phospholipids and 15% sphingomyelin). MALDI-MSI of the spatial and temporal accretion of lipid species during brain development showed that the brain lipidome is changing heterogeneously along time during brain development. In addition, increases in 400+ PL supplement-dependent lipids were observed. PL supplementation had significant spatial and temporal effect on specific fatty esters, glycerophosphocholines, glycerophosphoethanolamines, and phosphosphingolipids. Interestingly, the average levels of these lipids per brain area tended to be constant in various brain structures across the age groups, paralleling the general brain growth. In contrast, other lipids, such as cytidine diphosphate diacylglycerol, diacylglycerophosphates, phosphocholines, specific ether-phosphoethanolamines, phosphosphingolipids, glycerophosphoinositols, and glycerophosphoserines showed clear age-dependent changes uncoupled from the general brain growth. These results suggest that the dietary PL supplementation may preferentially provide the building blocks for the general brain growth during development. Our findings add to the understanding of brain-nutrient relations, their temporospatial dynamics, and potential impact on neurodevelopment.

Microelectrode implants, inflammatory response and long-lasting effects on NADPH diaphorase neurons in the rat frontal cortex

At present, one of the main therapeutic challenges comprises the development of technologies to improve the life quality of people suffering from different types of body paralysis, through the reestablishment of sensory and motor functions. In this regard, brain-machine interfaces (BMI) offer hope to effectively mitigate body paralysis through the control of paralyzed body parts by brain activity. Invasive BMI use chronic multielectrode implants to record neural activity directly from the brain tissue. While such invasive devices provide the highest amount of usable neural activity for BMI control, they also involve direct damage to the nervous tissue. In the cerebral cortex, high levels of the enzyme NADPH diaphorase (NADPH-d) characterize a particular class of interneurons that regulates neuronal excitability and blood supply. To gain insight into the biocompatibility of invasive BMI, we assessed the impact of chronic implanted tungsten multielectrode bundles on the distribution and morphology of NADPH-d-reactive neurons in the rat frontal cortex. NADPH-d neuronal labeling was correlated with glial response markers and with indices of healthy neuronal activity measured by electrophysiological recordings performed up to 3 months after multielectrode implantation. Chronic electrode arrays caused a small and quite localized structural disturbance on the implanted site, with neuronal loss and glial activation circumscribed to the site of implant. Electrodes remained viable during the entire period of implantation. Moreover, neither the distribution nor the morphology of NADPH-d neurons was altered. Overall, our findings provide additional evidence that tungsten multielectrodes can be employed as a viable element for long-lasting therapeutic BMI applications.

Dynamics of Neural Microstates in the VTA-Striatal-Prefrontal Loop during Novelty Exploration in the Rat

Neural activity at the large-scale population level has been suggested to be consistent with a sequence of brief, quasistable spatial patterns. These "microstates" and their temporal dynamics have been linked to myriad cognitive functions and brain diseases. Most of this research has been performed using EEG, leaving many questions, such as the existence, dynamics, and behavioral relevance of microstates at the level of local field potentials (LFPs), unaddressed. Here, we adapted the standard EEG microstate analysis to triple-area LFP recordings from 192 electrodes in rats to investigate the mesoscopic dynamics of neural microstates within and across brain regions during novelty exploration. We performed simultaneous recordings from the prefrontal cortex, striatum, and ventral tegmental area in male rats during awake behavior (object novelty and exploration). We found that the LFP data can be accounted for by multiple, recurring microstates that were stable for ∼60-100 ms. The simultaneous microstate activity across brain regions revealed rhythmic patterns of coactivations, which we interpret as a novel indicator of inter-regional, mesoscale synchronization. Furthermore, these rhythmic coactivation patterns across microstates were modulated by behavioral states such as movement and exploration of a novel object. These results support the existence of a functional mesoscopic organization across multiple brain areas and present a possible link of the origin of macroscopic EEG microstates to zero-lag neuronal synchronization within and between brain areas, which is of particular interest to the human research community.SIGNIFICANCE STATEMENT The coordination of neural activity across the entire brain has remained elusive. Here we combine large-scale neural recordings at fine spatial resolution with the analysis of microstates (i.e., short-lived, recurring spatial patterns of neural activity). We demonstrate that the local activity in different brain areas can be accounted for by only a few microstates per region. These microstates exhibited temporal dynamics that were correlated across regions in rhythmic patterns. We demonstrate that these microstates are linked to behavior and exhibit different properties in the frequency domain during different behavioral states. In summary, LFP microstates provide an insightful approach to studying both mesoscopic and large-scale brain activation within and across regions.

Cognitive flexibility deficits in rats with dorsomedial striatal 6-hydroxydopamine lesions tested using a three-choice serial reaction time task with reversal learning

Lesions of the dorsomedial striatum elicit deficits in cognitive flexibility that are an early feature of Parkinson's disease (PD), and presumably reflect alterations in frontostriatal processing. The current study aimed to examine deficits in cognitive flexibility in rats with bilateral 6-hydroxydopamine lesions in the dorsomedial striatum. While deficits in cognitive flexibility have previously been examined in rodent PD models using the cross-maze, T-maze, and a food-digging task, the current study is the first to examine such deficits using a 3-choice serial reaction time task (3-CSRT) with reversal learning (3-CSRT-R). Although the rate of acquisition in 3-CSRT was slower in lesioned compared to control rats, lesioned animals were able to acquire a level of accuracy comparable to that of control animals following 4 weeks of training. In contrast, substantial and persistent deficits were apparent during the reversal learning phase. Our results demonstrate that deficits in cognitive flexibility can be robustly unmasked by reversal learning in the 3-CSRT-R paradigm, which can be a useful test for evaluating effects of dorsomedial striatal deafferentation and interventions.

Involvement of the rodent prelimbic and medial orbitofrontal cortices in goal-directed action: A brief review

Goal-directed action refers to selecting behaviors based on the expectation that they will be reinforced with desirable outcomes. It is typically conceptualized as opposing habit-based behaviors, which are instead supported by stimulus-response associations and insensitive to consequences. The prelimbic prefrontal cortex (PL) is positioned along the medial wall of the rodent prefrontal cortex. It is indispensable for action-outcome-driven (goal-directed) behavior, consolidating action-outcome relationships and linking contextual information with instrumental behavior. In this brief review, we will discuss the growing list of molecular factors involved in PL function. Ventral to the PL is the medial orbitofrontal cortex (mOFC). We will also summarize emerging evidence from rodents (complementing existing literature describing humans) that it too is involved in action-outcome conditioning. We describe experiments using procedures that quantify responding based on reward value, the likelihood of reinforcement, or effort requirements, touching also on experiments assessing food consumption more generally. We synthesize these findings with the argument that the mOFC is essential to goal-directed action when outcome value information is not immediately observable and must be recalled and inferred.

Learning, memory and consolidation mechanisms for behavioral control in hierarchically organized cortico-basal ganglia systems

This article aims to provide a synthesis on the question how brain structures cooperate to accomplish hierarchically organized behaviors, characterized by low‐level, habitual routines nested in larger sequences of planned, goal‐directed behavior. The functioning of a connected set of brain structures—prefrontal cortex, hippocampus, striatum, and dopaminergic mesencephalon—is reviewed in relation to two important distinctions: (a) goal‐directed as opposed to habitual behavior and (b) model‐based and model‐free learning. Recent evidence indicates that the orbitomedial prefrontal cortices not only subserve goal‐directed behavior and model‐based learning, but also code the “landscape” (task space) of behaviorally relevant variables. While the hippocampus stands out for its role in coding and memorizing world state representations, it is argued to function in model‐based learning but is not required for coding of action–outcome contingencies, illustrating that goal‐directed behavior is not congruent with model‐based learning. While the dorsolateral and dorsomedial striatum largely conform to the dichotomy between habitual versus goal‐directed behavior, ventral striatal functions go beyond this distinction. Next, we contextualize findings on coding of reward‐prediction errors by ventral tegmental dopamine neurons to suggest a broader role of mesencephalic dopamine cells, viz. in behavioral reactivity and signaling unexpected sensory changes. We hypothesize that goal‐directed behavior is hierarchically organized in interconnected cortico‐basal ganglia loops, where a limbic‐affective prefrontal‐ventral striatal loop controls action selection in a dorsomedial prefrontal–striatal loop, which in turn regulates activity in sensorimotor‐dorsolateral striatal circuits. This structure for behavioral organization requires alignment with mechanisms for memory formation and consolidation. We propose that frontal corticothalamic circuits form a high‐level loop for memory processing that initiates and temporally organizes nested activities in lower‐level loops, including the hippocampus and the ripple‐associated replay it generates. The evidence on hierarchically organized behavior converges with that on consolidation mechanisms in suggesting a frontal‐to‐caudal directionality in processing control.

Learning the meaning of new stimuli increases the cross-correlated activity of prefrontal neurons

The prefrontal cortex (PF) has a key role in learning rules and generating associations between stimuli and responses also called conditional motor learning. Previous studies in PF have examined conditional motor learning at the single cell level but not the correlation of discharges between neurons at the ensemble level. In the present study, we recorded from two rhesus monkeys in the dorsolateral and the mediolateral parts of the prefrontal cortex to address the role of correlated firing of simultaneously recorded pairs during conditional motor learning. We trained two rhesus monkeys to associate three stimuli with three response targets, such that each stimulus was mapped to only one response. We recorded the neuronal activity of the same neuron pairs during learning of new associations and with already learned associations. In these tasks after a period of fixation, a visual instruction stimulus appeared centrally and three potential response targets appeared in three positions: right, left, and up from center. We found a higher number of neuron pairs significantly correlated and higher cross-correlation coefficients during stimulus presentation in the new than in the familiar mapping task. These results demonstrate that learning affects the PF neural correlation structure.

Interplay of prefrontal cortex and amygdala during extinction of drug seeking

Extinction of Pavlovian conditioning is a complex process that involves brain regions such as the medial prefrontal cortex (mPFC), the amygdala and the locus coeruleus. In particular, noradrenaline (NA) coming from the locus coeruleus has been recently shown to play a different role in two subregions of the mPFC, the prelimbic (PL) and the infralimbic (IL) regions. How these regions interact in conditioning and subsequent extinction is an open issue. We studied these processes using two approaches: computational modelling and NA manipulation in a conditioned place preference paradigm (CPP) in mice. In the computational model, NA in PL and IL causes inputs arriving to these regions to be amplified, thus allowing them to modulate learning processes in amygdala. The model reproduces results from studies involving depletion of NA from PL, IL, or both in CPP. In addition, we simulated new experiments of NA manipulations in mPFC, making predictions on the possible results. We searched the parameters of the model and tested the robustness of the predictions by performing a sensitivity analysis. We also present an empirical experiment where, in accord with the model, a double depletion of NA from both PL and IL in CPP with amphetamine impairs extinction. Overall the proposed model, supported by anatomical, physiological, and behavioural data, explains the differential role of NA in PL and IL and opens up the possibility to understand extinction mechanisms more in depth and hence to aid the development of treatments for disorders such as addiction.

Differential roles of medial prefrontal subregions in the regulation of drug seeking

The prefrontal cortex plays an important role in shaping cognition and behavior. Many studies have shown that medial prefrontal cortex (mPFC) plays a key role in seeking, extinction, and reinstatement of cocaine seeking in rodent models of relapse. Subregions of mPFC appear to play distinct roles in these behaviors, such that the prelimbic cortex (PL) is proposed to drive cocaine seeking and the infralimbic cortex (IL) is proposed to suppress cocaine seeking after extinction. This dichotomy of mPFC function may be a general attribute, as similar dorsal-ventral distinctions exist for expression vs. extinction of fear conditioning. However, other results indicate that the role of mPFC neurons in reward processing is more complex than a simple PL-seek vs. IL-extinguish dichotomy. Both PL and IL have been shown to drive and inhibit drug seeking (and other types of behaviors) depending on a range of factors including the behavioral context, the drug-history of the animal, and the type of drug investigated. This heterogeneity of findings may reflect multiple subcircuits within each of these PFC areas supporting unique functions. It may also reflect the fact that the mPFC plays a multifaceted role in shaping cognition and behavior, including those overlapping with cocaine seeking and extinction. Here we discuss research leading to the hypothesis that dorsal and ventral mPFC differentially control drug seeking and extinction. We also present recent results calling the absolute nature of a PL vs. IL dichotomy into question. Finally, we consider alternate functions for mPFC that correspond less to response execution and inhibition and instead incorporate the complex cognitive behavior for which the mPFC is broadly appreciated.

Neural mechanisms regulating different forms of risk-related decision-making: Insights from animal models

Over the past 20 years there has been a growing interest in the neural underpinnings of cost/benefit decision-making. Recent studies with animal models have made considerable advances in our understanding of how different prefrontal, striatal, limbic and monoaminergic circuits interact to promote efficient risk/reward decision-making, and how dysfunction in these circuits underlies aberrant decision-making observed in numerous psychiatric disorders. This review will highlight recent findings from studies exploring these questions using a variety of behavioral assays, as well as molecular, pharmacological, neurophysiological, and translational approaches. We begin with a discussion of how neural systems related to decision subcomponents may interact to generate more complex decisions involving risk and uncertainty. This is followed by an overview of interactions between prefrontal-amygdala-dopamine and habenular circuits in regulating choice between certain and uncertain rewards and how different modes of dopamine transmission may contribute to these processes. These data will be compared with results from other studies investigating the contribution of some of these systems to guiding decision-making related to rewards vs. punishment. Lastly, we provide a brief summary of impairments in risk-related decision-making associated with psychiatric disorders, highlighting recent translational studies in laboratory animals.

Plasticity in the prefrontal cortex of adult rats

We review the plastic changes of the prefrontal cortex of the rat in response to a wide range of experiences including sensory and motor experience, gonadal hormones, psychoactive drugs, learning tasks, stress, social experience, metaplastic experiences, and brain injury. Our focus is on synaptic changes (dendritic morphology and spine density) in pyramidal neurons and the relationship to behavioral changes. The most general conclusion we can reach is that the prefrontal cortex is extremely plastic and that the medial and orbital prefrontal regions frequently respond very differently to the same experience in the same brain and the rules that govern prefrontal plasticity appear to differ for those of other cortical regions.

Inhibition of dopamine transporter activity impairs synaptic depression in rat prefrontal cortex through over-stimulation of D1 receptors

In rat prefrontal cortex (PFC), long-term depression induced by low-frequency single stimuli has never been studied. Combined with the well-documented involvement of dopamine transporters (DATs) in the regulation of PFC-dependent cognitive processes, it is important to test whether this form of plasticity can be modulated by DAT activity in the PFC. Here, we show first that prolonged 3-Hz stimuli successfully induced synaptic depression in rat PFC slices whose induction depended on endogenous stimulation of D1-like and D2-like receptors and the activation of extracellular signal-regulated kinase 1/2 (ERK1/2). This depression was found to be significantly impaired by selective inhibition of the DAT by GBR12909 (1-200 nM) or GBR12935 (100 nM). The excess amount of extracellular dopamine caused by DAT inhibition acted critically on D1-like receptors to impair depression. Furthermore, this impairment by GBR12 909 was cancelled by the allosteric-positive mGluR5 modulator CDPPB, the drug known to reverse hyperdopaminergia-induced abnormal PFC activity, and the associated cognitive disturbances. Finally, these induction, impairment, and restoration of synaptic depression were correlated by an inverted-U shape manner with the phosphorylation level of ERK1/2. We suggest that abnormal increases of the extracellular dopamine level by DAT inhibition impair synaptic depression in the PFC through over-stimulation of D1-like receptors.

The effects of long-term treatment with estradiol and medroxyprogesterone acetate on tyrosine hydroxylase fibers and neuron number in the medial prefrontal cortex of aged female rats

Menopausal women often initiate hormone treatment to alleviate the symptoms of menopause. Research suggests that these treatments also affect cognition, and studies in young animals indicate that hormone treatment can alter several neuroanatomical measures. However, very little is known about the effects of long-term hormone treatment on the aging female brain. This study investigated the effects of hormone treatment on neuron number and tyrosine hydroxylase (TH) in the rat medial prefrontal cortex (mPFC). Female Long Evans rats were ovariectomized at middle age (12-13 months) and placed in one of four groups: no replacement (NR) (n = 12), 17β-estradiol (E(2)) (n = 12), E(2) and progesterone (n = 7), or E(2) and medroxyprogesterone acetate (MPA) (n = 10). Animals were euthanized at 20 months, and the brains were Nissl stained; a subset was immunostained for TH [NR (n = 5); E(2) (n = 6); E(2) + MPA (n = 4); E(2) + progesterone (n = 6)]. E(2) was administered through the drinking water, and progestagens were administered via pellets inserted at the nape of the neck. Neuron number and TH fiber density were quantified in the mPFC. Hormone treatment did not alter neuron number. Treatment with E(2) and MPA resulted in greater TH densities than NR in layer 1 (P < 0.05). In layers 2/3, animals receiving E(2) had greater TH densities than NR animals (P < 0.01). These results indicate that long-term hormone treatments alter dopaminergic fibers and potentially the functioning of the aging mPFC.

Spatial reversal learning is robust to total sleep deprivation

Sleep deprivation affects cognitive functions that depend on the prefrontal cortex (PFC) such as cognitive flexibility, and the consolidation of newly learned information. The identification of cognitive processes that are either robustly sensitive or robustly insensitive to the same experimental sleep deprivation procedure, will allow us to better focus on the specific effects of sleep on cognition, and increase understanding of the mechanisms involved. In the present study we investigate whether sleep deprivation differentially affects the two separate cognitive processes of acquisition and consolidation of a spatial reversal task. After training on a spatial discrimination between two levers in a Skinner box, male Wistar rats were exposed to a reversal of the previously learned stimulus-response contingency. We first evaluated the effect of sleep deprivation on the acquisition of reversal learning. Performance on reversal learning after 12h of sleep deprivation (n=12) was compared to performance after control conditions (n=12). The second experiment evaluated the effect of sleep deprivation on the consolidation of reversal learning; the first session of reversal learning was followed by 3h of nap prevention (n=8) or undisturbed control conditions (n=8). The experiments had sufficient statistical power (0.90 and 0.81, respectively) to detect differences with medium effect sizes. Neither the acquisition, nor the consolidation, of reversal learning was affected by acute sleep deprivation. Together with previous findings, these results help to further delineate the role of sleep in cognitive processing.

Long-term replacement of estrogen in combination with medroxyprogesterone acetate improves acquisition of an alternation task in middle-aged female rats

Studies have shown that ovarian hormones protect against some of the cognitive deficits associated with aging. Although much of the literature in rodents has focused on hippocampal dependent tasks, studies suggest that tasks dependent on the prefrontal cortex are also influenced by ovarian hormones. The present study investigated the effects of ovarian hormone treatment during aging on a delayed alternation t-maze. Female Long Evans hooded rats were ovariectomized at middle age (11-12 months) and placed in 1 of 5 treatment groups: no replacement, chronic estradiol (E(2)), cyclic E(2), chronic E(2) and progesterone, or chronic E(2) and medroxyprogesterone acetate (MPA). Following 6 months of hormone treatment, animals were trained to alternate in a t-maze. After reaching criterion, a series of delays from 5 to 90 s were introduced in random order. Rats receiving E(2) with MPA reached criterion significantly faster than animals not receiving treatment and those who received chronic or cyclic E(2) only. There was a nonsignificant trend for animals receiving E(2) and progesterone to reach criterion in fewer sessions than animals receiving E(2) only. Mode of administration, cyclic or chronic, did not affect performance. Hormones did not affect performance on the delayed alternation. This study, in combination with previous research, indicates that hormone effects cannot be generalized across tasks, age, or duration, and long-term estrogen in combination with MPA can be beneficial for some tasks.

Distinct patterns of neuronal inputs and outputs of the juxtaparaventricular and suprafornical regions of the lateral hypothalamic area in the male rat

We have analyzed at high resolution the neuroanatomical connections of the juxtaparaventricular region of the lateral hypothalamic area (LHAjp); as a control and in comparison to this, we also performed a preliminary analysis of a nearby LHA region that is dorsal to the fornix, namely the LHA suprafornical region (LHAs). The connections of these LHA regions were revealed with a coinjection tract-tracing technique involving a retrograde (cholera toxin B subunit) and anterograde (Phaseolus vulgaris leucoagglutinin) tracer. The LHAjp and LHAs together connect with almost every major division of the cerebrum and cerebrospinal trunk, but their connection profiles are markedly different and distinct. In simple terms, the connections of the LHAjp indicate a possible primary role in the modulation of defensive behavior; for the LHAs, a role in the modulation of ingestive behavior is suggested. However, the relation of the LHAjp and LHAs to potential modulation of these behaviors, as indicated by their neuroanatomical connections, appears to be highly integrative as it includes each of the major functional divisions of the nervous system that together determine behavior, i.e., cognitive, state, sensory, and motor. Furthermore, although a primary role is indicated for each region with respect to a particular mode of behavior, intermode modulation of behavior is also indicated. In summary, the extrinsic connections of the LHAjp and LHAs (so far as we have described them) suggest that these regions have a profoundly integrative role in which they may participate in the orchestrated modulation of elaborate behavioral repertoires.

Medial prefrontal administration of MK-801 impairs T-maze discrimination reversal learning in weanling rats

Several executive functions rely on the medial prefrontal cortex (mPFC) in the rat. Aspiration and neurotoxic lesions of the mPFC impair reversal learning in adult rats. Systemic administration of MK-801, an NMDA-receptor antagonist, impairs T-maze reversal learning in weanling rats but the role of mPFC NMDA-receptor antagonism in this effect is not known in either adult or young animals. This set of studies showed that mPFC NMDA receptors are specifically involved in T-maze discrimination reversal in weanling rats. In Experiment 1, 26-day-old rats (P26) demonstrated a dose-dependent impairment following bilateral mPFC administration of either 2.5 or 5.0microg MK-801 or saline (vehicle) during the reversal training phase only. In Experiment 2, P26 rats were trained on the same task, but four groups of rats received bilateral mPFC infusions during acquisition only (MK-SAL), reversal only (SAL-MK), both phases (MK-MK), or neither phase (SAL-SAL). MK-801 impaired performance only when infused during reversal. This suggests that NMDA-receptor antagonism in the mPFC is selectively involved in reversal learning during development and this may account for the previously reported effects of systemic MK-801 on T-maze discrimination reversal in weanling rats.

Developmental exposure to PCBs and/or MeHg: effects on a differential reinforcement of low rates (DRL) operant task before and after amphetamine drug challenge

The current study assessed the effects of developmental PCB and/or MeHg exposure on an operant task of timing and inhibitory control and determined if amphetamine (AMPH) drug challenges differentially affected performance. Long-Evans rats were exposed to corn oil (control), PCBs alone (1 or 3 mg/kg), MeHg alone (1.5 or 4.5 ppm), the low combination (1 mg/kg PCBs+1.5 ppm MeHg), or the high combination (3 mg/kg PCBs+4.5 ppm MeHg) throughout gestation and lactation. An environmentally relevant, formulated PCB mixture was used. Male and female offspring were trained to asymptotic performance on a differential reinforcement of low rates (DRL) operant task as adults. PCB-exposed groups had a lower ratio of reinforced to non-reinforced responses than controls. Groups exposed to MeHg alone were not impaired and the deficits observed in PCB-exposed groups were not seen when PCBs were co-administered with MeHg. AMPH was less disruptive to responding in males receiving PCBs alone, MeHg alone, and 1.0 mg/kg PCB+1.5 ppm MeHg. Paradoxically, the disruption in responding by AMPH in males given 3.0 mg/kg PCB+4.5 ppm MeHg did not differ from controls. Exposed females from all treatment groups did not differ from controls in their AMPH response. Overall, the findings suggest that developmental exposure to PCBs can decrease DRL performance. Co-exposure to MeHg seemed to mitigate the detrimental effects of PCBs on performance. The finding that the disruptive effects of AMPH on DRL performance were lessened in some groups of exposed males suggests that alterations in dopaminergic functioning may have a role in behavioral changes seen after perinatal PCB and MeHg exposure.

Guidance of instrumental behavior under reversal conditions requires dopamine D1 and D2 receptor activation in the orbitofrontal cortex

The orbitofrontal cortex (OFC) plays a critical role in learning a reversal of stimulus-reward contingencies. Dopamine (DA) neurons probably support reversal learning by emitting prediction error signals that indicate the discrepancy between the actually received reward and its prediction. However, the role of DA receptor-mediated signaling in the OFC to adapt behavior to changing stimulus-reward contingencies is largely unknown. Here we examined the effects of a selective D1 or D2 receptor blockade in the OFC on learning a reversal of previously acquired stimulus-reward magnitude contingencies. Rats were trained on a reaction time (RT) task demanding conditioned lever release with discriminative visual stimuli signaling in advance the upcoming reward magnitude (one or five food pellets). After acquisition, RTs were guided by stimulus-associated reward magnitudes, i.e. RTs of responses were significantly shorter for expected high versus low reward. Thereafter, stimulus-reward magnitude contingencies were reversed and learning was tested under reversal conditions for three blocks after pre-trial infusions of the selective D1 or D2 receptor antagonists R(+)-7-chloro-8-hydroxy-3-methyl-1-phenyl-2,3,4,5-tetrahydro-1H-3-benzazepinhydrochloride (SCH23390), eticlopride, or vehicle. For comparisons, we included intra-OFC infusions of the selective N-methyl-D-aspartate receptor antagonist AP5. Results revealed that in animals subjected to intra-OFC infusions of SCH23390 or eticlopride learning a reversal of previously acquired stimulus reward-magnitude contingencies was impaired. Thus, in a visual discrimination task as used here, D1 and D2 receptor-mediated signaling in the OFC seems to be necessary to update the reward-predictive significance of stimuli.

Inactivation of the medial prefrontal cortex of the rat impairs strategy set-shifting, but not reversal learning, using a novel, automated procedure

The medial prefrontal cortex (mPFC) of the rat plays an essential role in behavioral flexibility, as lesions or inactivations of this region impair shifting between strategies or attentional sets using a variety of different behavioral tests. In the present study, we assessed the effects of inactivation of the mPFC on strategy set-shifting and reversal learning, using a novel, automated procedure conducted in an operant chamber. In Experiment 1, inactivation of the mPFC with bupivacaine did not impair the initial learning of a visual-cue (i.e.; always press the lever with a cue light illuminated above it) or a response (i.e.; always press the left lever) discrimination. Control rats required greater number of trials to shift from using a visual-cue to a response strategy than the opposite shift. mPFC inactivation impaired performance of a visual-cue-response set-shift, but not the easier response-visual-cue shift. In Experiment 2, pre-exposure to the visual-cue stimulus lights increased the difficulty of the response-visual-cue shift, reflected by a greater number of trials required by control rats to achieve criterion relative to those in Experiment 1. Under these conditions, inactivation of the mPFC did impair performance of this set-shift. In contrast, mPFC inactivation did not affect reversal learning of a response discrimination. These findings highlight the utility of this automated procedure for assessing set-shifting mediated by the mPFC. Furthermore, they reveal that the relative difficulty of the type of shift rats are required to perform has a direct impact on whether or not the mPFC contributes to this form of behavioral flexibility.

Medial prefrontal serotonin in the rat is involved in goal-directed behaviour when affect guides decision making

RATIONALE

Across species, serotonin (5-HT) depletion in the prefrontal cortex (PFC) has been shown to cause impaired performance on tests of cognitive flexibility and the processing of affective information (e.g. information with an 'emotional' content). While recent work has explored the specific role of the orbital PFC herein, the role of the medial PFC remains unclear.

OBJECTIVES

The aim of our current experiments was to study the role of medial PFC 5-HT in both the processing of affective information and reversal learning across stimulus modalities.

MATERIALS AND METHODS

To this end, we selectively destroyed 5-HT terminals in the medial PFC of male Wistar rats by means of local infusion of the toxin 5,7-dihydroxytryptamine. Both control and lesioned animals were tested in two reversal learning paradigms with either spatial or odour cues and an affective switch from non-preferred to preferred food rewards.

RESULTS

Our results indicate that a pellet switch during reversal learning impaired performance in control animals but not in lesioned animals, independent of the stimulus modality.

CONCLUSION

These results indicate that lesioned animals are not guided in their behaviour by the affective value of the reward like intact animals and thus that medial prefrontal 5-HT is needed for affective processing in goal-directed behaviour.

Effects of rat medial prefrontal cortex lesions on olfactory serial reversal and delayed alternation tasks

When reward reinforcement in a two-choice discrimination task is regularly changed from one stimulus to another immediately after one learning acquisition session, the learning efficiency of a rat increases as if the rat has come to recognize this regularity of reversal. To investigate how the rat medial prefrontal cortex (mPFC) is involved in such improvement, we examined the performance of mPFC-lesioned rats in a serial reversal task of olfactory discrimination. The performance of other mPFC-lesioned rats in a delayed alternation task was also analyzed using the same apparatus to evaluate the contribution of the mPFC to working memory. The mPFC-lesioned rats demonstrated selective difficulty in the second reversal session in the serial reversal task and also showed performance impairment in the delayed alternation task. These results suggest that the rat mPFC mediating working memory is involved in early progress in learning efficiency during experiences of multiple reversals, which may be relevant to cognitive operations in reversal learning beyond a one-time reversal of stimulus response associations.

Medial prefrontal cortex infusions of bupivacaine or AP-5 block extinction of amphetamine conditioned place preference

The present experiments used reversible lesion techniques and intra-mPFC infusions of the n-methyl D-aspartate (NMDA) receptor antagonist D,L-2-amino-5-phosphonovaleric acid (AP-5) to examine the role of the mPFC in extinction of an amphetamine conditioned place preference (CPP). Following initial training and testing for an amphetamine (2 mg/kg) CPP, adult male Long-Evans rats were given extinction trials that were identical to training, except in the absence of peripheral amphetamine injections. Immediately prior to each extinction trial, rats received intra-mPFC infusions of the anesthetic drug bupivacaine (0.75% solution/0.5 microl), AP-5 (1.25, 2.5, 5.0 microg/0.5 microl), or saline. Following extinction training, rats were given a second CPP test session. Rats receiving intra-mPFC infusions of saline displayed extinction of CPP behavior. In contrast, intra-mPFC infusions of bupivacaine or AP-5 (2.5, 5.0 microg) blocked CPP extinction. The findings indicate (1) the mPFC mediates extinction of approach behavior to drug-associated environmental contexts, and (2) NMDA receptor blockade within the mPFC is sufficient to block extinction of amphetamine CPP behavior.

Serotonin transporter deficiency in rats improves inhibitory control but not behavioural flexibility

Impulsivity and aggression have been suggested to inversely correlate with central serotonin (5-HT) levels in a trait-like manner. However, this relationship is far from straightforward. In the present study we addressed the effect of lifelong reduced or absent serotonin transporter (SERT) function, which is associated with constitutively increased extracellular 5-HT levels, on impulsivity and aggression. We used unique SERT knockout rats in a resident-intruder test, five-choice serial reaction time task and serial reversal learning task to assay aggression, inhibitory control and behavioural flexibility, respectively. Homozygous SERT knockout rats (SERT( -/-)) displayed reduced aggression and improved inhibitory control, but unchanged behavioural flexibility. The behavioural phenotype of heterozygous SERT knockout rats (SERT( +/-)) was not different from that of wild-type controls in any of the behavioural paradigms. We determined monoamine (metabolite) tissue levels in the medial prefrontal cortex, orbitofrontal cortex, lateral hypothalamus, raphe nuclei and cerebrospinal fluid, and found that the 5-HT levels, but not other monoamine tissue levels, were reduced in SERT( -/-) rats. In addition, the 5-hydroxyindoleacetic acid (5-HIAA)/5-HT ratio in cerebrospinal fluid was increased in these rats. In conclusion, our data show that the absence of the SERT affects aggression and inhibitory control, but not behavioural flexibility, characteristics that may reflect the trait-like consequences of constitutive changes in central 5-HT levels.

Differential effects of the D- and L- isomers of amphetamine on pharmacological MRI BOLD contrast in the rat

RATIONALE

The D - and L-amphetamine sulphate isomers are used in the formulation of Adderall XR(R), which is effective in the treatment of attention-deficit hyperactivity disorder (ADHD). The effects of these isomers on brain activity has not been examined using neuroimaging.

OBJECTIVES

This study determines the pharmacological magnetic resonance imaging blood-oxygenation-level-dependent (BOLD) response in rat brain regions after administration of each isomer.

MATERIALS AND METHODS

Rats were individually placed into a 2.35 T Bruker magnet for 60 min to achieve basal recording of variation in signal intensity. Either saline (n = 9), D-amphetamine sulphate (2 mg/kg, i.p.; n = 9) or L: -amphetamine sulphate (4 mg/kg, i.p.; n = 9) were administered, and recording continued for a further 90 min. Data were analysed for BOLD effects using statistical parametric maps. Blood pressure, blood gases and respiratory rate were monitored during scanning.

RESULTS

The isomers show overlapping effects on the BOLD responses in areas including nucleus accumbens, medial entorhinal cortex, colliculi, field CA1 of hippocampus and thalamic nuclei. The L-isomer produced greater global changes in the positive BOLD response than the D-isomer, including the somatosensory and motor cortices and frontal brain regions such as the orbitofrontal cortices, prelimbic and infralimbic cortex which were not observed with the D-isomer.

CONCLUSIONS

The amphetamine isomers produce different BOLD responses in brain areas related to cognition, pleasure, pain processing and motor control probably because of variations on brain amine systems such as dopamine and noradrenaline. The isomers may, therefore, have distinct actions on brain regions affected in ADHD patients.

To press or not to press? Differential receptor expression and response to novelty in rats learning an operant response for reward

Learning to perform instrumental tasks is an ability of all animals. In a population of rats, not all individuals will acquire an operant response for reward. We hypothesized that there could be a genetic explanation for differences between High Consumers (those that acquired the lever press response) and Low Consumers (lever press response is low). Additionally, we proposed that this genetic difference could produce measurable changes in response to novelty. Wistar rats were trained to lever press for a 0.2% saccharin reward and on the 10th day they were placed in a novel open field for 30 min to record locomotor activity. The prefrontal cortex and hippocampus were dissected and qPCR was used to measure mRNA expression. A significant difference (p=.048; 2-way ANOVA) in gene expression was observed between Low and High Consumers. A principal component analysis (PCA), to cluster which genes represent this difference, identified 4 genes; 5-HT2A and mGlu1 in the hippocampus and AMPA GluR1 and adrenergic alpha2A in the prefrontal cortex. Response to a novel open field also differed since Low Consumers displayed a higher Total Distance in comparison to High Consumers. Additionally, Low Consumers could be subdivided into Low-Lever (with lever press response only when water deprived) and Low-Non-Lever (lever press response is low throughout training). PCA with this subdivision identified an additional nine genes differing within the divisions; NMDA NR2B and GABAAalpha3 in the prefrontal cortex and adrenergic alpha2B and alpha2A, AMPA GluR1, GluR2 and GluR3, 5-HT1B and GABAAalpha5 in the hippocampus.

Guanfacine produces differential effects in frontal cortex compared with striatum: assessed by phMRI BOLD contrast

RATIONALE

Guanfacine (an alpha-(2A) adrenoreceptor agonist) is a drug of benefit in the treatment of attention deficit hyperactivity disorder (ADHD) (Taylor FB, Russo J, J Clin Psychopharmacol 21:223-228, 2001). Assessment of this drug using neuroimaging will provide information about the brain regions involved in its effects.

OBJECTIVES

The pharmacological magnetic resonance imaging blood oxygenation level dependent (BOLD) response was determined in rat brain regions following administration of guanfacine.

METHODS

Male rats were individually placed into a 2.35 T Bruker magnet for 60 min to achieve basal recording of changes in signal intensity. Either saline (n = 9) or guanfacine (0.3 mg/kg, i.p.; n = 9) was then administered and recording was continued for a further 90 min. Data were analysed for BOLD effects using statistical parametric maps. Respiration rate, blood pressure and blood gases were monitored and remained constant throughout scanning.

RESULTS

The main changes observed were negative BOLD effects in the caudate putamen and nucleus accumbens with positive BOLD effects in frontal association, prelimbic and motor cortex areas.

CONCLUSIONS

These data suggest that guanfacine can decrease neuronal activity in the caudate while increasing frontal cortex activity. This ability to change neuronal activity in specific areas of rat brain that are known to be impaired in ADHD (Solanto MV, Behav Brain Res 130:65-71, 2002) may contribute to guanfacine's beneficial effects.

Dopamine and noradrenaline efflux in the medial prefrontal cortex during serial reversals and extinction of instrumental goal-directed behavior

The prefrontal cortex (PFC) of the rat supports cognitive flexibility, the ability to spontaneously adapt goal-directed behavior in response to radically changing situational demands. We have shown previously that transient inactivation of the rat medial PFC (mPFC) impairs initial reversal learning in a spatial 2-lever discrimination task. Given the importance of dopamine (DA) for PFC function, we studied DA (and noradrenaline [NA]) efflux in the mPFC during reversal learning. We observed a higher and more extended increase in DA efflux in rats performing the first reversal compared with controls performing the previously acquired discrimination. The results of an additional experiment suggest that such a difference between the reversal- and control-induced DA increases was absent during a third reversal. During the extinction session, DA efflux did not increase from basal levels. Increases in NA efflux were less than in DA and did not differ between control and any condition. We conclude that prefrontal DA activity is increased during execution of instrumental discrimination tasks and that this increase is amplified during the acquisition of a first, but not of later reversals. These data corroborate our previous findings and indicate that DA is critically involved in this form of cognitive flexibility.

M2 muscarinic acetylcholine receptor knock-out mice show deficits in behavioral flexibility, working memory, and hippocampal plasticity

Muscarinic acetylcholine receptors are known to play key roles in facilitating cognitive processes. However, the specific roles of the individual muscarinic receptor subtypes (M1-M5) in learning and memory are not well understood at present. In the present study, we used wild-type (M2+/+) and M2 receptor-deficient (M2-/-) mice to examine the potential role of M2 receptors in learning and memory and hippocampal synaptic plasticity. M2-/- mice showed significant deficits in behavioral flexibility and working memory in the Barnes circular maze and the T-maze delayed alternation tests, respectively. The behavioral deficits of M2-/- mice were associated with profound changes in neuronal plasticity studied at the Schaffer-CA1 synapse of hippocampal slices. Strikingly, short-term potentiation (STP) was abolished, and long-term potentiation (LTP) was drastically reduced after high-frequency stimulation of M2-/- hippocampi. Treatment of M2-/- hippocampal slices with the GABA(A) receptor antagonist, bicuculline, restored STP and significantly increased LTP. Whole-cell recordings from CA1 pyramidal cells demonstrated a much stronger disinhibition of GABAergic than glutamatergic transmission in M2-/- hippocampi, which was particularly prominent during stimulus trains. Increased strength of GABAergic inhibition is thus a likely mechanism underlying the impaired synaptic plasticity observed with M2-/- hippocampi. Moreover, the persistent enhancement of excitatory synaptic transmission in CA1 pyramidal cells induced by the transient application of a low concentration of a muscarinic agonist (referred to as LTP(m)) was totally abolished in M2-/- mice. Because impaired muscarinic cholinergic neurotransmission is associated with Alzheimer's disease and normal aging processes, these findings should be of considerable therapeutic relevance.

Differential effects of infralimbic vs. ventromedial orbital PFC lidocaine infusions in CD-1 mice on defensive responding in the mouse defense test battery and rat exposure test

The ventromedial prefrontal cortex (vmPFC) is extremely sensitive to a variety of stressful situations and threatening events, and has been suggested to be an associative cortical brain system processing the integration of anxiety-related cognitive, affective and motivated behavior in rodents, primates and humans. In addition, recent evidence suggests that (a) anxiety-related affective processing appears to be lateralized to the right hemisphere vmPFC; and (b) there appears to be functional heterogeneity within the rodent vmPFC. The present study evaluated the possibility that distinct sub-areas of the right hemisphere ventral PFC might differentially influence anxiety-like defensive responding in two different predator stress situations following transient inactivation of the ventromedial orbital (vMO) or infralimbic (IL) vmPFC in CD-1 mice. In week 1, IL vmPFC lidocaine infusions reduced anxiety-like defensive responding in mice (enhanced approach and contact) confronted with a hand-held anesthetized rat stimulus in the mouse defense test battery (vMO inactivation exerted minimal effects). In week 2, vMO lidocaine infusions enhanced anxiety-like defensive responding (enhanced avoidance and protected risk assessment) toward a barricaded live rat in the rat exposure test (IL inactivation exerted minimal effects). Although it is unclear whether week 1 mouse defense test battery testing influenced week 2 rat exposure test results, these preliminary data suggest functional differences within the mouse right hemisphere ventral PFC related to cautious evaluation of predator threat. Given the dense unilateral reciprocal connectivity between the IL and vMO subregions of the PFC, both associative ventromedial cortical areas may exert complimentary yet dissociable roles in the processing of threat stimuli. This suggests that while the IL vmPFC may mediate cautious evaluation of threat situations (risk assessment), the vMO PFC may inhibit prepotent avoidance responses to facilitate such IL-mediated adaptive behavioral responses.

Influence of the hippocampus on interneurons of the rat prefrontal cortex

The hippocampus and prefrontal cortex (PFC), two structures implicated in learning and memory processes, are linked by a direct hippocampo-prefrontal pathway. It has been shown that PFC pyramidal cells receive monosynaptic excitatory inputs from the hippocampus and, in this study, we sought to determine the influence of the hippocampus on PFC interneurons in anesthetized rats. Extracellular recordings were coupled to juxtacellular injections of neurobiotin or biotinylated dextran amine to morphologically differentiate interneurons from pyramidal cells. In all cases, the action potentials of labeled interneurons were of shorter duration (< 0.70 ms) than those of identified pyramidal cells (> 0.70 ms). Single pulse stimulation of the hippocampal CA1/subiculum region induced an excitatory response in 70% of recorded interneurons in the prelimbic and medial-orbital areas of the PFC. In contrast to the one to two action potentials generated by pyramidal cells, an important group of interneurons fired a burst of action potentials in response to hippocampal stimulation. A large proportion of these excitatory responses was probably monosynaptic as their latency is consistent with the conduction time of the hippocampo-prefrontal pathway. In addition, when both a pyramidal cell and an interneuron were simultaneously recorded and both responded to stimulation, the interneuron consistently fired before the pyramidal cell. In conclusion, the hippocampus exerts a direct excitatory influence on PFC interneurons and is thus capable of feedforward inhibition of pyramidal cells. Hippocampal output is spatially and temporally focalized via this inhibitory process and consequently could facilitate the synchronization of a specific subset of PFC neurons with hippocampal activity.

Reward expectation, orientation of attention and locus coeruleus-medial frontal cortex interplay during learning

Regulation of attention and promotion of behavioural flexibility are functions attributed to both the noradrenergic nucleus locus coeruleus (LC) and the prefrontal cortex (PFC). The PFC receives a large innervation from LC and small changes in catecholaminergic activity in PFC profoundly affect cognitive function. It is crucial to the understanding of learning-related plasticity, that the cognitive context driving LC neurons be determined and the relation to activity in PFC be elucidated. To this end simultaneous recordings were made from LC and prelimbic cortex (PL) during an odour-reward association task in the rat. Neuronal activity related to orientation of attention, reward predictability, reward itself, and changes in stimulus reinforcement contingencies, was measured. All LC neurons and a significant proportion of PL neurons were engaged during several aspects of a Go/NoGo task, especially after the signal for trial onset and CS+ presentation. LC activation was, however, more tightly aligned to the behavioural response than to the CS+ 22% of PL neurons were activated during the response-reward delay. This suggests that the activity of both these structures is related to reward anticipation. Finally, LC neurons exhibited rapid plasticity when the reward-contingency was modified. Within-trial response latencies were always shorter in LC than in PL and between-trial response adaptation in LC preceded that in PL by many trials. Identifying such temporal relationships is an essential step toward understanding how neuromodulatory inputs to forebrain networks might promote or permit experience-dependent plasticity in behavioural situations.

Prefrontal cortex function, quasi-physiological stimuli, and synaptic plasticity

The prelimbic area of rat medial frontal cortex may be functionally analogous to human/primate dorsolateral prefrontal cortex. This area may be involved in selective attention to the external stimuli and the coupling of the attention to a repertory of actions. It was suggested that this function may rely on a form of long-term memory [Biol. Rev. 77 (2002) 563]. Indeed, during learning of this type of behavior, a portion of prelimbic neurons persistently change their firing characteristics [Prog. Brain Res. 126 (2000) 287]. It is therefore important to study long-term potentiation (LTP) and depression (LTD) in rat prelimbic neurons. In this article, the author first briefly reviews recent findings on the prefrontal cortex function and discusses that the prefrontal cortex may be involved in long-term memory. Second, the author will show some new results which indicate that quasi-physiological patterns of stimuli mimicking prelimbic neuronal activity during behavior can induce LTP in prelimbic pyramidal neuron synapses. These results suggest that prelimbic neuronal activity during behavior may lastingly modify prelimbic synaptic efficacy.

Noradrenergic action in prefrontal cortex in the late stage of memory consolidation

These experiments investigated the role of the noradrenergic system in the late stage of memory consolidation and in particular its action at beta receptors in the prelimbic region (PL) of the prefrontal cortex in the hours after training. Rats were trained in a rapidly acquired, appetitively motivated foraging task based on olfactory discrimination. They were injected with a beta adrenergic receptor antagonist into the PL 5 min or 2 h after training and tested 48 h later. Rats injected at 2 h showed amnesia, whereas those injected at 5 min had good retention, equivalent to saline-injected controls. Monitoring extracellular noradrenaline efflux in PL by in vivo microdialysis during the first hours after training revealed a significant increase shortly after training, with a rapid return to baseline, and then another increase around the 2-h posttraining time window. Pseudo-trained rats showed a smaller early efflux and did not show the second wave of efflux at 2 h. These results confirm earlier pharmacological and immunohistochemical studies suggesting a delayed role of noradrenaline in a late phase of long-term memory consolidation and the engagement of the PL during these consolidation processes.

C-fos activation patterns in rat prefrontal cortex during acquisition of a cued classical conditioning task

The prefrontal cortex (PFC) is known to be involved in associative learning; however, its specific role in acquisition of cued classical conditioning has not yet been determined. Furthermore, the role of regional differences within the PFC in the acquisition of cued conditioning is not well described. These issues were addressed by exposing rats to either one or four sessions of a cued classical conditioning task, and subsequently examining c-fos immunoreactivity in various areas of the PFC. Differences in patterns of c-fos immunopositive nuclei were found when comparing the PFC areas examined. No significant differences were found between rats presented with a temporally contingent conditioned stimulus (CS) light and food (paired groups) and those presented with the same stimuli temporally non-contingently (unpaired groups). In lateral and orbital PFC, both the paired and unpaired groups showed more c-fos immunopositive nuclei than control groups exposed only to the behavioral setup (context exposed groups), and all groups showed a drop in c-fos immunopositive nuclei from session 1 to session 4. In dorsal medial PFC, no differences were seen between the paired, unpaired and context exposed groups. These groups did, however, differ from naive animals, an effect that was not seen in the ventral medial PFC. The results of this study do not support a role for the PFC in the acquisition of a cued classical conditioning task. The differences seen between paired, unpaired and context exposed groups in orbital and lateral PFC could be due to contextual conditioning or reward-related effects.

Learning-related changes in response patterns of prefrontal neurons during instrumental conditioning

A crucial aspect of organizing goal-directed behavior is the ability to form neural representations of relationships between environmental stimuli, actions and reinforcement. Very little is known yet about the neural encoding of response-reward relationships, a process which is deemed essential for purposeful behavior. To investigate this, tetrode recordings were made in the medial prefrontal cortex (PFC) of rats performing a Go-NoGo task. After task acquisition, a subset of neurons showed a sustained change in firing during the rewarded action sequence that was triggered by a specific visual cue. When these changes were monitored in the course of learning, they were seen to develop in parallel with the behavioral learning curve and were highly sensitive to a switch in reward contingencies. These sustained changes correlated with the reward-associated action sequence, not with sensory or reward-predicting properties of the cue or individual motor acts per se. This novel type of neural plasticity may contribute to the formation of response-reinforcer associations and of behavioral strategies for guiding goal-directed action.

Do rats have a prefrontal cortex?

The lack of a single anatomical or functional definition of 'prefrontal cortex' has led to different and, in some respects, controversial views on the existence of a prefrontal cortex in non-primate mammals, in particular in rats. Until the classic paper by Rose and Woolsey [Res. Publ. Assoc. Nerv. Ment. Dis. 27 (1948) 210], the general idea was that a prefrontal cortex is unique to primate species. Rose and Woolsey's 'prefrontal cortex' definition was based upon a single anatomical criterion, i.e. the cortical projection area of the mediodorsal thalamic nucleus. Single criteria, however, do not appear to be sufficient for defining the prefrontal cortex. Therefore, other anatomical and functional characteristics are currently used to identify the prefrontal cortex in different species. Yet, recently the debate about the nature of the prefrontal cortex in non-primate species has been resumed. In the present paper we will compare the structural and functional characteristics of the prefrontal cortex of nonhuman primates and rats. We will argue that rats have a functionally divided prefrontal cortex that includes not only features of the medial and orbital areas in primates, but also some features of the primate dorsolateral prefrontal cortex.

Time-dependent reorganization of the brain components underlying memory retention in trace eyeblink conditioning

Many studies have confirmed the time-limited involvement of the hippocampus in mnemonic processes and suggested that there is reorganization of the responsible brain circuitry during memory consolidation. To clarify such reorganization, we chose trace classical eyeblink conditioning, in which hippocampal ablation produces temporally graded retrograde amnesia. Here, we extended the temporal characterization of retrograde amnesia to other regions that are involved in acquisition during this task: the medial prefrontal cortex (mPFC) and the cerebellum. At a various time interval after establishing the trace conditioned response (CR), rats received an aspiration of one of the three regions. After recovery, the animals were tested for their CR retention. When ablated 1 d after the learning, both the hippocampal lesion and the cerebellar lesion group of rats exhibited a severe impairment in retention of the CR, whereas the mPFC lesion group showed only a slight decline. With an increase in interval between the lesion and the learning, the effect of the hippocampal lesion diminished and that of the mPFC lesion increased. When ablated 4 weeks after the learning, the hippocampal lesion group exhibited as robust CRs as its corresponding control group. In contrast, the mPFC lesion and the cerebellar lesion groups failed to retain the CRs. These results indicate that the hippocampus and the cerebellum, but only marginally the mPFC, constitute a brain circuitry that mediates recently acquired memory. As time elapses, the circuitry is reorganized to use mainly the mPFC and the cerebellum, but not the hippocampus, for remotely acquired memory.

The role of prelimbic cortex in instrumental conditioning

Numerous studies have implicated human and primate prefrontal cortex in the ability to hold and manipulate goal or outcome-related information in working memory to guide the performance of forthcoming actions. Here we report that cell-body lesions of prelimbic cortex impair the ability of rats to select an action based on previously encoded action-outcome associations. Rats were food deprived and trained to press two levers, one delivering food pellets and the other a sucrose solution. All rats acquired the lever-press response although the initial acquisition in the prelimbic rats was significantly slower than in sham controls. Furthermore, whereas in sham-lesioned rats, post-training devaluation of one of the two outcomes using a specific satiety procedure produced a selective reduction in performance on the lever that in training delivered the prefed outcome, prelimbic rats failed to show a selective devaluation effect and appeared to reduce performance on both levers non-selectively. Importantly, this impairment only emerged in extinction; in subsequent experiments it was found that, when a specific action-outcome association was cued either by presentation of the outcome itself or by presenting a stimulus previously paired with the outcome, rats demonstrated an ability to select the associated action. These results suggest that action-outcome encoding may be intact in prelimbic rats and that the lesion impaired their ability to retain this learning in working memory in order to establish a course of action. Alternatively, the lesion may have altered the relative contribution of action-outcome and outcome-action associations to instrumental performance. On this account, prelimbic lesions affect action-outcome encoding but leave outcome-action associations intact providing the basis for outcome-mediated initiation of an action sufficient, perhaps, to support acquisition and performance in the lesioned rats.

Orbital prefrontal cortex and guidance of instrumental behaviour in rats under reversal conditions

The orbital prefrontal cortex (OPFC) is suggested to be part of a circuitry mediating the perception of reward and the initiation of adaptive behavioural responses. In the present study, we investigated in rats changes of goal-directed behaviour after bilateral OPFC-lesions by N-methyl-D-aspartate (NMDA) in more detail. A reaction time (RT) task was used which is sensitive to subtle changes in discriminative guidance of instrumental behaviour by the anticipated reward magnitudes. The task demands conditioned lever release triggered by an imperative stimulus. The upcoming reward magnitude (five or one food pellet) for each trial was randomly chosen and signalled in advance by distinct instructive stimuli. In trained rats, RTs of instrumental responses were determined by the two distinct stimulus-reward magnitude contingencies, i.e. RTs were shorter to the instructive stimulus predictive of the higher reward magnitude. Results show that lesions of the OPFC did not impair discriminative guidance of behavioural responses according to preoperatively acquired stimulus-reward magnitude contingencies. However, guidance of instrumental behaviour was altered in lesioned rats after a reversal of the stimulus-reward magnitude contingencies. The data add further support to the hypothesis that the rat OPFC is not involved in retrieval of acquired stimulus-reward magnitude contingencies but in integration of incentive information to guide behaviour after a reversal of stimulus-reward contingencies.

Operant learning and differential-reinforcement-of-low-rate 36-s responding in 5-HT1A and 5-HT1B receptor knockout mice

Previous studies with mice lacking 5-HT(1A) (1AKO) and 5-HT(1B) (1BKO) receptors in hippocampus-dependent learning and memory paradigms, suggest that these receptors play an important role in learning and memory, although their precise role is unclear. In the present study, 1AKO and 1BKO mice were studied in operant behavioural paradigms of decision making and response inhibition, to further study the putative involvement of these receptors in prefrontal cortex-dependent learning and memory. Moreover, because 1AKO mice have been shown to exhibit an antidepressant-like phenotype and 1BKO mice to be more impulsive in ethological studies, mice were trained in a differential-reinforcement-of-low-rates (DRL) procedure. Overall, results indicate that 1AKO and 1BKO mice display subtle differences in operant paradigms of decision making and response inhibition compared to wild type (WT) mice. In addition, when responding under a DRL 36-s schedule had stabilised, 1BKO mice showed a phenotype indicative of increased impulsivity, whereas 1AKO mice did not differ from WT mice. In conclusion, 5-HT(1B) receptors appear to play an important role in impulsivity and a minor role in prefrontal cortex-dependent learning and memory as shown by the results obtained in serial reversal learning and extinction. In contrast, 5-HT(1A) receptors appear to be involved in facilitation of autoshaping, but their role in impulsivity and prefrontal cortex-dependent learning and memory appears to be limited.