Prefrontal cortical cell firing during maintenance, extinction, and reinstatement of goal-directed behavior for natural reward

Inactivation of the infralimbic cortex decreases discriminative stimulus-controlled relapse to cocaine seeking in rats

Persistent susceptibility to cue-induced relapse is a cardinal feature of addiction. Discriminative stimuli (DSs) are one type of drug-associated cue that signal drug availability (DS+) or unavailability (DS-) and control drug seeking prior to relapse. We previously established a trial-based procedure in rats to isolate DSs from context, conditioned stimuli, and other drug-associated cues during cocaine self-administration and demonstrated DS-controlled cocaine seeking up to 300 abstinence days. The behavioral and neural mechanisms underlying trial-based DS-control of drug seeking have rarely been investigated. Here we show that following discrimination training in our trial-based procedure, the DS+ and DS- independently control the expression and suppression of cocaine seeking during abstinence. Using microinjections of GABA_A + GABA_B receptor agonists (muscimol + baclofen) in medial prefrontal cortex, we report that infralimbic, but not prelimbic, subregion of medial prefrontal cortex is critical to persistent DS-controlled relapse to cocaine seeking after prolonged abstinence, but not DS-guided discriminated cocaine seeking or DS-controlled cocaine self-admininstration. Finally, using ex vivo whole-cell recordings from pyramidal neurons in the medial prefrontal cortex, we demonstrate that the disruption of DS-controlled cocaine seeking following infralimbic cortex microinjections of muscimol+baclofen is likely a result of suppression of synaptic transmission in the region via a presynaptic mechanism of action.

Frontostriatal Projections Regulate Innate Avoidance Behavior

The dorsomedial prefrontal cortex (dmPFC) has been linked to avoidance and decision-making under conflict, key neural computations altered in anxiety disorders. However, the heterogeneity of prefrontal projections has obscured identification of specific top-down projections involved. While the dmPFC-amygdala circuit has long been implicated in controlling reflexive fear responses, recent work suggests that dmPFC-dorsomedial striatum (DMS) projections may be more important for regulating avoidance. Using fiber photometry recordings in both male and female mice during the elevated zero maze task, we show heightened neural activity in frontostriatal but not frontoamygdalar projection neurons during exploration of the anxiogenic open arms. Additionally, using optogenetics, we demonstrate that this frontostriatal projection preferentially excites postsynaptic D1 receptor-expressing neurons in the DMS and causally controls innate avoidance behavior. These results support a model for prefrontal control of defensive behavior in which the dmPFC-amygdala projection controls reflexive fear behavior and the dmPFC-striatum projection controls anxious avoidance behavior.SIGNIFICANCE STATEMENT The medial prefrontal cortex has been extensively linked to several behavioral symptom domains related to anxiety disorders, with much of the work centered around reflexive fear responses. Comparatively little is known at the mechanistic level about anxious avoidance behavior, a core feature across anxiety disorders. Recent work has suggested that the striatum may be an important hub for regulating avoidance behaviors. Our work uses optical circuit dissection techniques to identify a specific corticostriatal circuit involved in encoding and controlling avoidance behavior. Identifying neural circuits for avoidance will enable the development of more targeted symptom-specific treatments for anxiety disorders.

Integration of value and action in medial prefrontal neural systems

The rodent medial prefrontal cortex (mPFC) plays a key role in regulating cognition, emotion, and behavior. mPFC neurons are activated in diverse experimental paradigms, raising the questions of whether there are specific task elements or dimensions encoded by mPFC neurons, and whether these encoded parameters are selective to neurons in particular mPFC subregions or networks. Here, we consider the role of mPFC neurons in processing appetitive and aversive cues, outcomes, and related behaviors. mPFC neurons are strongly activated in tasks probing value and outcome-associated actions, but these responses vary across experimental paradigms. Can we identify specific categories of responses (e.g., positive or negative value), or do mPFC neurons exhibit response properties that are too heterogeneous/complex to cluster into distinct conceptual groups? Based on a review of relevant studies, we consider what has been done and what needs to be further explored in order to address these questions.

From Isolated Emotional Memories to Their Competition During Conflict

Aversive or rewarding experiences are remembered better than those of lesser survival significance. These emotional memories, whether negative or positive, leave traces in the brain which can later be retrieved and strongly influence how we perceive, how we form associations with environmental stimuli and, ultimately, guide our decision-making. In this review aticle, we outline what constitutes an emotional memory by focusing on threat- and reward-related memories and describe how they are formed in the brain during learning and reformed during retrieval. Finally, we discuss how the field is moving from understanding emotional memory brain circuits separately, towards studying how these two opposing brain systems interact to guide choices during conflict. Here, we outline two novel tasks in rodents that model opposing binary choices (approach or avoid) guided by competing emotional memories. The prefrontal cortex (PFC) is a major integration hub of emotional information which is also known to be critical for decision-making. Consequently, brain circuits that involve this brain region may be key for understanding how the retrieval of emotional memories flexibly orchestrates adaptive choice behavior. Because several mental disorders (e.g., drug addiction and depression) are characterized by deficits in decision-making in the face of conflicting emotional memories (maladaptively giving more weight to one memory over the other), the development of choice-based animal models for emotional regulation could give rise to new approaches for the treatment of these disorders in humans.

Fluid network dynamics in the prefrontal cortex during multiple strategy switching

Coordinated shifts of neuronal activity in the prefrontal cortex are associated with strategy adaptations in behavioural tasks, when animals switch from following one rule to another. However, network dynamics related to multiple-rule changes are scarcely known. We show how firing rates of individual neurons in the prelimbic and cingulate cortex correlate with the performance of rats trained to change their navigation multiple times according to allocentric and egocentric strategies. The concerted population activity exhibits a stable firing during the performance of one rule but shifted to another neuronal firing state when a new rule is learnt. Interestingly, when the same rule is presented a second time within the same session, neuronal firing does not revert back to the original neuronal firing state, but a new activity-state is formed. Our data indicate that neuronal firing of prefrontal cortical neurons represents changes in strategy and task-performance rather than specific strategies or rules.

Population activity of neurons in the prefrontal cortex has been shown to represent cognitive strategy and rules. Here the authors report that when the same rule is repeated on multiple occasions in the task, it is accompanied each time by a new prefrontal firing rate state.

Action-outcome relationships are represented differently by medial prefrontal and orbitofrontal cortex neurons during action execution

Internal representations of action-outcome relationships are necessary for flexible adaptation of motivated behavior in dynamic environments. Prefrontal cortex (PFC) is implicated in flexible planning and execution of goal-directed actions, but little is known about how information about action-outcome relationships is represented across functionally distinct regions of PFC. Here, we observe distinct patterns of action-evoked single unit activity in the medial prefrontal cortex (mPFC) and orbitofrontal cortex (OFC) during a task in which the relationship between outcomes and actions was independently manipulated. The mPFC encoded changes in the number of actions required to earn a reward, but not fluctuations in outcome magnitude. In contrast, OFC neurons decreased firing rates as outcome magnitude was increased, but were insensitive to changes in action requirement. A subset of OFC neurons also tracked outcome availability. Pre-outcome anticipatory activity in both mPFC and OFC was altered when reward expectation was reduced, but did not differ with outcome magnitude. These data provide novel evidence that PFC regions encode distinct information about the relationship between actions and impending outcomes during action execution.

Prefrontal neurons encode context-based response execution and inhibition in reward seeking and extinction

The prefrontal cortex (PFC) guides execution and inhibition of behavior based on contextual demands. In rodents, the dorsal/prelimbic (PL) medial PFC (mPFC) is frequently considered essential for execution of goal-directed behavior ("go") whereas ventral/infralimbic (IL) mPFC is thought to control behavioral suppression ("stop"). This dichotomy is commonly seen for fear-related behaviors, and for some behaviors related to cocaine seeking. Overall, however, data for reward-directed behaviors are ambiguous, and few recordings of PL/IL activity have been performed to demonstrate single-neuron correlates. We recorded neuronal activity in PL and IL during discriminative stimulus driven sucrose seeking followed by multiple days of extinction of the reward-predicting stimulus. Contrary to a generalized PL-go/IL-stop hypothesis, we found cue-evoked activity in PL and IL during reward seeking and extinction. Upon analyzing this activity based on resultant behavior (lever press or withhold), we found that neurons in both areas encoded contextually appropriate behavioral initiation (during reward seeking) and withholding (during extinction), where context was dictated by response-outcome contingencies. Our results demonstrate that PL and IL signal contextual information for regulation of behavior, irrespective of whether that involves initiation or suppression of behavioral responses, rather than topographically encoding go vs. stop behaviors. The use of context to optimize behavior likely plays an important role in maximizing utility-promoting exertion of activity when behaviors are rewarded and conservation of energy when not.

Cortical drive of low-frequency oscillations in the human nucleus accumbens during action selection

The nucleus accumbens is thought to contribute to action selection by integrating behaviorally relevant information from multiple regions, including prefrontal cortex. Studies in rodents suggest that information flow to the nucleus accumbens may be regulated via task-dependent oscillatory coupling between regions. During instrumental behavior, local field potentials (LFP) in the rat nucleus accumbens and prefrontal cortex are coupled at delta frequencies (Gruber AJ, Hussain RJ, O'Donnell P. PLoS One 4: e5062, 2009), possibly mediating suppression of afferent input from other areas and thereby supporting cortical control (Calhoon GG, O'Donnell P. Neuron 78: 181–190, 2013). In this report, we demonstrate low-frequency cortico-accumbens coupling in humans, both at rest and during a decision-making task. We recorded LFP from the nucleus accumbens in six epilepsy patients who underwent implantation of deep brain stimulation electrodes. All patients showed significant coherence and phase-synchronization between LFP and surface EEG at delta and low theta frequencies. Although the direction of this coupling as indexed by Granger causality varied between subjects in the resting-state data, all patients showed a cortical drive of the nucleus accumbens during action selection in a decision-making task. In three patients this was accompanied by a significant coherence increase over baseline. Our results suggest that low-frequency cortico-accumbens coupling represents a highly conserved regulatory mechanism for action selection.

Orbitofrontal cortical neurons encode expectation-driven initiation of reward-seeking

Adaptive execution and inhibition of behavior are guided by the activity of neuronal populations across multiple frontal cortical areas. The rodent medial prefrontal cortex has been well studied with respect to these behaviors, influencing behavioral execution/inhibition based on context. Other frontal regions, in particular the orbitofrontal cortex (OFC), are critical in directing behavior to obtain rewards, but the relationship between OFC neuronal activity and response execution or inhibition has been poorly characterized. In particular, little is known about OFC with respect to extinction learning, an important example of context-guided response inhibition. Here, we recorded the activity of OFC neurons while rats performed a discriminative-stimulus (DS)-driven sucrose-seeking task followed by multiple days of extinction of the DS. OFC neuronal activity was maximally responsive (1) to reward-predicting stimuli (RS) that triggered a lever press (i.e., lever-response initiation) and (2) during reward-well approach in pursuit of sucrose (i.e., well-response initiation). RS presentation that was not followed by a lever press or RS presentation during extinction produced weak activation, as did nonrewarded stimulus (NS) presentation regardless of response (press or withhold) or session (DS-sucrose or extinction). Activity related to nonrewarded well entry was minor, and activity was significantly inhibited during reward consumption. Finally, OFC neuronal activity switched selectivity to track rewarded behaviors when the RS/NS contingencies were reversed. Thus, rather than signaling variables related to extinction or response inhibition, activity in OFC was strongest at the initiation of multiple components of reward-seeking behavior, most prominently when valid reward-predicting cues drove these behaviors.

Cortical operation of the ventral striatal switchboard

How does the ventral striatum (VS) prioritize and process afferent input? In this issue, Calhoon and O'Donnell (2013) demonstrate that cortical projections to the VS can attenuate hippocampal and thalamic VS input, suggesting that the cortex can uniquely control VS circuit dynamics.

Closing the gate in the limbic striatum: prefrontal suppression of hippocampal and thalamic inputs

Many brain circuits control behavior by integrating information arising from separate inputs onto a common target neuron. Neurons in the ventral striatum (VS) receive converging excitatory afferents from the prefrontal cortex (PFC), hippocampus (HP), and thalamus, among other structures, and the integration of these inputs is critical for goal-directed behaviors. Although HP inputs have been described as gating PFC throughput in the VS, recent data reveal that the VS desynchronizes from the HP during epochs of burst-like PFC activity related to decision making. It is therefore possible that PFC inputs locally attenuate responses to other glutamatergic inputs to the VS. Here, we found that delivering trains of stimuli to the PFC suppresses HP- and thalamus-evoked synaptic responses in the VS, in part through activation of inhibitory processes. This interaction may enable the PFC to exert influence on basal ganglia loops during decision-making instances with minimal disturbance from ongoing contextual inputs.

The role of medial prefrontal cortex in memory and decision making

Some have claimed that the medial prefrontal cortex (mPFC) mediates decision making. Others suggest mPFC is selectively involved in the retrieval of remote long-term memory. Yet others suggests mPFC supports memory and consolidation on time scales ranging from seconds to days. How can all these roles be reconciled? We propose that the function of the mPFC is to learn associations between context, locations, events, and corresponding adaptive responses, particularly emotional responses. Thus, the ubiquitous involvement of mPFC in both memory and decision making may be due to the fact that almost all such tasks entail the ability to recall the best action or emotional response to specific events in a particular place and time. An interaction between multiple memory systems may explain the changing importance of mPFC to different types of memories over time. In particular, mPFC likely relies on the hippocampus to support rapid learning and memory consolidation.

The role of medial prefrontal cortex in memory and decision making

Some have claimed that the medial prefrontal cortex (mPFC) mediates decision making. Others suggest mPFC is selectively involved in the retrieval of remote long-term memory. Yet others suggests mPFC supports memory and consolidation on time scales ranging from seconds to days. How can all these roles be reconciled? We propose that the function of the mPFC is to learn associations between context, locations, events, and corresponding adaptive responses, particularly emotional responses. Thus, the ubiquitous involvement of mPFC in both memory and decision making may be due to the fact that almost all such tasks entail the ability to recall the best action or emotional response to specific events in a particular place and time. An interaction between multiple memory systems may explain the changing importance of mPFC to different types of memories over time. In particular, mPFC likely relies on the hippocampus to support rapid learning and memory consolidation.

Long-term effects of chronic oral Ritalin administration on cognitive and neural development in adolescent wistar kyoto rats

The diagnosis of Attention Deficit Hyperactivity Disorder (ADHD) often results in chronic treatment with psychostimulants such as methylphenidate (MPH, Ritalin^®). With increases in misdiagnosis of ADHD, children may be inappropriately exposed to chronic psychostimulant treatment during development. The aim of this study was to assess the effect of chronic Ritalin treatment on cognitive and neural development in misdiagnosed “normal” (Wistar Kyoto, WKY) rats and in Spontaneously Hypertensive Rats (SHR), a model of ADHD. Adolescent male animals were treated for four weeks with oral Ritalin^® (2 × 2 mg/kg/day) or distilled water (dH₂O). The effect of chronic treatment on delayed reinforcement tasks (DRT) and tyrosine hydroxylase immunoreactivity (TH-ir) in the prefrontal cortex was assessed. Two weeks following chronic treatment, WKY rats previously exposed to MPH chose the delayed reinforcer significantly less than the dH₂O treated controls in both the DRT and extinction task. MPH treatment did not significantly alter cognitive performance in the SHR. TH-ir in the infralimbic cortex was significantly altered by age and behavioural experience in WKY and SHR, however this effect was not evident in WKY rats treated with MPH. These results suggest that chronic treatment with MPH throughout adolescence in “normal” WKY rats increased impulsive choice and altered catecholamine development when compared to vehicle controls.

Firing patterns of maternal rat prelimbic neurons during spontaneous contact with pups

Extracellular single unit activity was recorded from medial prefrontal cortex (mPFC) of postpartum dams over the course of 3 days while they engaged in spontaneous pup-directed behaviors and non-specific exploratory behavior. Out of 109 units identified over the course of the experiment, 15 units were observed to be pup-responsive and 15 increased their discharge rates non-specifically while not attending to pups. An association between neuronal activity and typical maternal behaviors (e.g., retrieval, pup-grooming, nursing) was not observed. Instead, brief bouts of snout contact with pups were accompanied by phasic increases and decreases in spike rates. The observed pup contact responsive cells might play a role in processing of sensory feedback from pups or the transmission of modulatory output to other subcortical maternal brain areas.

Role of perisynaptic parameters in neurotransmitter homeostasis--computational study of a general synapse

Extracellular neurotransmitter concentrations vary over a wide range depending on the type of neurotransmitter and location in the brain. Neurotransmitter homeostasis near a synapse is achieved by a balance of several mechanisms including vesicular release from the presynapse, diffusion, uptake by transporters, nonsynaptic production, and regulation of release by autoreceptors. These mechanisms are also affected by the glia surrounding the synapse. However, the role of these mechanisms in achieving neurotransmitter homeostasis is not well understood. A biophysical modeling framework was proposed, based on a cortico-accumbens synapse example case, to reverse engineer glial configurations and parameters related to homeostasis for synapses that support a range of neurotransmitter gradients. Model experiments reveal that synapses with extracellular neurotransmitter concentrations in the micromolar range require nonsynaptic neurotransmitter sources and tight synaptic isolation by extracellular glial formations. The model was used to identify the role of perisynaptic parameters on neurotransmitter homeostasis and to propose glial configurations that could support different levels of extracellular neurotransmitter concentrations. Ranking the parameters based on their effect on neurotransmitter homeostasis, nonsynaptic sources were found to be the most important followed by transporter concentration and diffusion coefficient.

Optogenetic investigation of neural circuits underlying brain disease in animal models

Optogenetic tools have provided a new way to establish causal relationships between brain activity and behaviour in health and disease. Although no animal model captures human disease precisely, behaviours that recapitulate disease symptoms may be elicited and modulated by optogenetic methods, including behaviours that are relevant to anxiety, fear, depression, addiction, autism and parkinsonism. The rapid proliferation of optogenetic reagents together with the swift advancement of strategies for implementation has created new opportunities for causal and precise dissection of the circuits underlying brain diseases in animal models.

Preparatory attention relies on dynamic interactions between prelimbic cortex and anterior cingulate cortex

An emerging view of prefrontal cortex (PFC) function is that multiple PFC areas process information in parallel, rather than as distinct modules. Two key functions assigned to the PFC are the regulation of top-down attention and stimulus-guided action. Electrophysiology and lesion studies indicate the involvement of both the anterior cingulate cortex (ACC) and prelimbic cortex (PL) in these functions. Little is known, however, about how these cortical regions interact. We recorded single unit spiking and local field potentials (LFPs) simultaneously in rodents during a sustained attention task and assessed interactions between the ACC and PL by measuring spike-LFP phase synchrony and LFP-LFP phase synchrony between these areas. We demonstrate that the magnitude of synchrony between the ACC and PL, before stimulus onset, predicts the subjects' behavioral choice after the stimulus. Furthermore, neurons switched from a state of beta synchrony during attention to a state of delta synchrony before the instrumental action. Our results indicate that multiple PFC areas interact during attention and that the same neurons may participate in segregated assemblies that support both attention and action.

Multiple roles for orexin/hypocretin in addiction

Orexins/hypocretins are hypothalamic peptides involved in arousal and wakefulness, but also play a critical role in drug addiction and reward-related behaviors. Here, we review the roles played by orexins in a variety of animal models of drug addiction, emphasizing both commonalities and differences for orexin's involvement in seeking of the major classes of abused drugs, as well as food. One common theme that emerges is an involvement of orexins in drug seeking triggered by external stimuli (e.g., cues, contexts or stressors). We also discuss the functional neuronal circuits in which orexins are embedded, and how these circuits mediate addiction-related behaviors, with particular focus on the role of orexin and glutamate interactions within the ventral tegmental area. Finally, we attempt to contextualize the role of orexins in reward by discussing ways in which these peptides, expressed in only a few thousand neurons in the brain, can have such wide-ranging effects on behavior.

Prefrontal cell firing in male rats during approach towards sexually receptive female: interactions with cocaine

The medial prefrontal cortex (mPFC) plays a role in anticipation of rewards and goal orientation, properties that are influenced by cocaine administration. Single-unit firing was measured in the mPFC of seven male rats during the expression of approach responses toward a sexually receptive female. Nose-poking in male rats was used as a measure of approach behavior during the following periods: a baseline, first exposure to a female, a second baseline 2 h later and a second exposure to female 10 min after cocaine (15 mg kg⁻¹ i.p.). Two types of excitatory responses were identified. First, a subset of cells (23%) showed increased firing activity during nose-poke behavior upon presentation of the female, but not before. Another subset of cells (12%) showed increased firing in the presence of the female only after cocaine was administered. The present results provide preliminary evidence for neurons in the mPFC that are involved in sexually motivated approach behavior and that are modulated by cocaine.

A bold view of the lactating brain: functional magnetic resonance imaging studies of suckling in awake dams

Functional magnetic resonance imaging (fMRI) has been used to investigate the responsiveness of the maternal rat brain to pup-suckling under various experimental paradigms. Our research employing the lactating rat model has explored the cortical sensory processing of pup stimuli and the effect of suckling on the brain's reward system. Suckling was observed to increase blood-oxygen-level-dependent (BOLD) signal intensity in the midbrain, striatum and prefrontal cortex, which are areas that receive prominent dopaminergic inputs. The BOLD activation of the reward system occurs in parallel with the activation of extensive cortical sensory areas. The observed regions include the olfactory cortex, auditory cortex and gustatory cortex, and could correspond to cortical representations of pup odours, vocalisations and taste that are active during lactation. Activation patterns within reward regions are consistent with past research on maternal motivation and we explore the possibility that exposure to drugs of abuse might be disruptive of maternal neural responses to pups, particularly in the prefrontal cortex. Our ongoing fMRI studies support and extend past research on the maternal rat brain and its functional neurocircuitry.

Single units in the medial prefrontal cortex with anxiety-related firing patterns are preferentially influenced by ventral hippocampal activity

The medial prefrontal cortex (mPFC) and ventral hippocampus (vHPC) functionally interact during innate anxiety tasks. To explore the consequences of this interaction, we examined task-related firing of single units from the mPFC of mice exploring standard and modified versions of the elevated plus maze (EPM), an innate anxiety paradigm. Hippocampal local field potentials (LFPs) were simultaneously monitored. The population of mPFC units distinguished between safe and aversive locations within the maze, regardless of the nature of the anxiogenic stimulus. Strikingly, mPFC units with stronger task-related activity were more strongly coupled to theta-frequency activity in the vHPC LFP. Lastly, task-related activity was inversely correlated with behavioral measures of anxiety. These results clarify the role of the vHPC-mPFC circuit in innate anxiety and underscore how specific inputs may be involved in the generation of behaviorally relevant neural activity within the mPFC.

Hidden prenatal malnutrition in the rat: role of β₁-adrenoceptors on synaptic plasticity in the frontal cortex

Moderate reduction in the protein content of the mother's diet (hidden malnutrition) does not alter body and brain weights of rat pups at birth, but leads to dysfunction of neocortical noradrenaline systems together with impaired long-term potentiation and visuo-spatial memory performance. As β₁-adrenoceptors and downstream protein kinase signaling are critically involved in synaptic long-term potentiation and memory formation, we evaluated the β₁-adrenoceptor density and the expression of cyclic-AMP dependent protein kinase, calcium/calmodulin-dependent protein kinase and protein kinase Fyn, in the frontal cortex of prenatally malnourished adult rats. In addition, we also studied if β₁-adrenoceptor activation with the selective β₁ agonist dobutamine could improve deficits of prefrontal cortex long-term potentiation presenting these animals. Prenatally malnourished rats exhibited half of β₁-adrenoceptor binding, together with a 51% and 65% reduction of cyclic AMP-dependent protein kinase α and calcium/calmodulin-dependent protein kinase α expression, respectively, as compared with eutrophic animals. Administration of the selective β₁ agonist dobutamine prior to tetanization completely rescued the ability of the prefrontal cortex to develop and maintain long-term potentiation in the malnourished rats. Results suggest that under-expression of neocortical β₁-adrenoceptors and protein kinase signaling in hidden malnourished rats functionally affects the synaptic networks subserving prefrontal cortex long-term potentiation. β₁-adrenoceptor activation was sufficient to fully recover neocortical plasticity in the PKA- and calcium/calmodulin-dependent protein kinase II-deficient undernourished rats, possibly by producing extra amounts of cAMP and/or by recruiting alternative signaling cascades.

Effect of modafinil on learning performance and neocortical long-term potentiation in rats

Modafinil is a novel wake-promoting agent whose effects on cognitive performance have begun to be addressed at both preclinical and clinical level. The present study was designed to investigate in rats the effects of chronic modafinil administration on cognitive performance by evaluating: (i) working and reference memories in an Olton 4×4 maze, and (ii) learning of a complex operant conditioning task in a Skinner box. In addition, the effect of modafinil on the ability of the rat frontal cortex to develop long-term potentiation (LTP) was also studied. Chronic modafinil did not significantly modify working memory errors but decreased long-term memory errors on the Olton 4×4 maze, meaning that the drug may have a favourable profile on performance of visuo-spatial tasks (typically, a hippocampus-dependent task) when chronically administered. On the other hand, chronic modafinil resulted in a marked decrease of successful responses in a complex operant conditioning learning, which means that repeated administration of the drug influences negatively problem-solving abilities when confronting the rat to a sequencing task (typically, a prefrontal cortex-dependent task). In addition, in vivo electrophysiology showed that modafinil resulted in impaired capacity of the rat prefrontal cortex to develop LTP following tetanization. It is concluded that modafinil can improve the performance of spatial tasks that depend almost exclusively on hippocampal functioning, but not the performance in tasks including a temporal factor where the prefrontal cortex plays an important role. The fact that modafinil together with preventing operant conditioning learning was also able to block LTP induction in the prefrontal cortex, suggests that the drug could interfere some critical component required for LTP can be developed, thereby altering neuroplastic capabilities of the prefrontal cortex.

Nicotine dependence is characterized by disordered reward processing in a network driving motivation

BACKGROUND

Drug addiction is characterized by an unhealthy priority for drug consumption with a compulsive, uncontrolled drug-intake pattern due to a disordered motivational system. However, only some individuals become addicted, whereas others maintain regular but controlled drug use. Whether the transition occurs might depend on how individuals process drug relative to nondrug reward.

METHODS

We applied functional magnetic resonance imaging to measure mesocorticolimbic activity to stimuli predicting monetary or cigarette reward, together with behavioral assessment of subsequent motivation to obtain the respective reward on a trial-by-trial basis, in 21 nicotine-dependent and 21 nondependent, occasional smokers.

RESULTS

Occasional smokers showed increased reactivity of the mesocorticolimbic system to stimuli predicting monetary reward relative to cigarette reward and subsequently spent more effort to obtain money. In the group of dependent smokers, we found equivalent anticipatory activity and subsequent instrumental response rates for both reward types. Additionally, anticipatory mesocorticolimbic activation predicted subsequent motivation to obtain reward.

CONCLUSIONS

This imbalance in the incentive salience of drug relative to nondrug reward-predicting cues, in a network that drives motivation to obtain reward, could represent a central mechanism of drug addiction.

Inactivation or inhibition of neuronal activity in the medial prefrontal cortex largely reduces pup retrieval and grouping in maternal rats

Previous research suggests that the maternal medial prefrontal cortex (mPFC) may play a role in maternal care and that cocaine sensitization before pregnancy can affect neuronal activity within this region. The present work was carried out to test whether the mPFC does actually play a role in the expression of maternal behaviors in the rats and to understand what specific behaviors this cortical area may modulate. In the first experiment, tetrodotoxin (TTX) was used to chemically inactivate the mPFC during tests for maternal behavior latencies. Lactating rats were tested on postpartum days 7-9. The results of this first experiment indicate that there is a large effect of TTX-induced inactivation on retrieval behavior latencies. TTX nearly abolished the expression of maternal retrieval of pups without significantly impairing locomotor activity. In the second experiment, GABA-mediated inhibition was used to test maternal behavior latencies and durations of maternal and other behaviors in postpartum dams. In agreement with experiment 1, it was observed that dams capable of retrieving are rendered incapable by inhibition in the mPFC. GABA-mediated inhibition in the mPFC largely reduced retrieval without altering other indices of maternal care and non-specific behavior such as ambulation time, self-grooming, and inactivity. Moreover, in both experiments, dams were able to establish contact with pups within seconds. The overall results indicate that the mPFC may play an active role in modulating maternal care, particularly retrieval behavior. External factors that affect the function of the frontal cortical site may result in significant impairments in maternal goal-directed behavior as reported in our earlier work.

Corticostriatal Interactions during Learning, Memory Processing, and Decision Making

This mini-symposium aims to integrate recent insights from anatomy, behavior, and neurophysiology, highlighting the anatomical organization, behavioral significance, and information-processing mechanisms of corticostriatal interactions. In this summary of topics, which is not meant to provide a comprehensive survey, we will first review the anatomy of corticostriatal circuits, comparing different ways by which "loops" of cortical-basal ganglia circuits communicate. Next, we will address the causal importance and systems-neurophysiological mechanisms of corticostriatal interactions for memory, emphasizing the communication between hippocampus and ventral striatum during contextual conditioning. Furthermore, ensemble recording techniques have been applied to compare information processing in the dorsal and ventral striatum to predictions from reinforcement learning theory. We will next discuss how neural activity develops in corticostriatal areas when habits are learned. Finally, we will evaluate the role of GABAergic interneurons in dynamically transforming cortical inputs into striatal output during learning and decision making.

Bursting activation of prefrontal cortex drives sustained up states in nucleus accumbens spiny neurons in vivo

Hippocampal inputs to the nucleus accumbens (NA) have been proposed to implement a gating mechanism by driving NA medium spiny neurons (MSNs) to depolarized up states that facilitate action potential firing in response to brief activation of the prefrontal cortex (PFC). Brief PFC stimulation alone, on the other hand, could not drive NA up states. As these studies were conducted using single-pulse PFC stimulation, it remains possible that PFC activation with naturalistic, bursty patterns can also drive up states in NA MSNs. Here, we assessed NA responses to PFC stimulation with a pattern similar to what is typically observed in awake animals during PFC-relevant behaviors. In vivo intracellular recordings from NA MSNs revealed that brief 20-50 Hz PFC stimulus trains evoked depolarizations that were similar to spontaneous up states in NA MSNs and were sustained beyond stimulus offset. Similar train stimulation of corticoaccumbens afferents in a parasagittal slice preparation evoked large amplitude depolarizations in NA MSNs that were sustained during stimulation but decayed rapidly following stimulation offset, suggesting that activation of cortical afferents can drive MSN depolarizations but other mechanisms may contribute to sustaining up states. These data suggest that NA MSNs integrate temporal features of PFC activation and that the NA gating model can be reformulated to include a PFC-driven gating mechanism during periods of high PFC firing, such as during cognitively demanding tasks. Synapse 63:173-180, 2009. (c) 2008 Wiley-Liss, Inc.

The nucleus accumbens: a switchboard for goal-directed behaviors

Reward intake optimization requires a balance between exploiting known sources of rewards and exploring for new sources. The prefrontal cortex (PFC) and associated basal ganglia circuits are likely candidates as neural structures responsible for such balance, while the hippocampus may be responsible for spatial/contextual information. Although studies have assessed interactions between hippocampus and PFC, and between hippocampus and the nucleus accumbens (NA), it is not known whether 3-way interactions among these structures vary under different behavioral conditions. Here, we investigated these interactions with multichannel recordings while rats explored an operant chamber and while they performed a learned lever-pressing task for reward in the same chamber shortly afterward. Neural firing and local field potentials in the NA core synchronized with hippocampal activity during spatial exploration, but during lever pressing they instead synchronized more strongly with the PFC. The latter is likely due to transient drive of NA neurons by bursting prefrontal activation, as in vivo intracellular recordings in anesthetized rats revealed that NA up states can transiently synchronize with spontaneous PFC activity and PFC stimulation with a bursting pattern reliably evoked up states in NA neurons. Thus, the ability to switch synchronization in a task-dependent manner indicates that the NA core can dynamically select its inputs to suit environmental demands, thereby contributing to decision-making, a function that was thought to primarily depend on the PFC.

Differential representation of Pavlovian-instrumental transfer by prefrontal cortex subregions and striatum

Environmental cues that once predicted reward can restore extinguished behavior directed toward that reward. This process may be modeled by the Pavlovian-instrumental transfer (PIT) paradigm where a previously learned Pavlovian conditioned stimulus (CS) elicits a representation of the reward associated with that CS, prompts motivation toward the absent reward, and triggers an instrumental action. We recorded in the medial and orbital prefrontal cortex (mPFC and OFC) and dorsal striatum (DS) of freely moving rats during PIT and found that a Pavlovian CS, as compared with neutral or no stimuli, amplified the phasic neuronal responses to instrumental nosepokes ('transfer' event). In mPFC and OFC, but not the DS, representation of the transfer event correlated with the strength of PIT behavior. Neurons in all three regions showed CS-selective amplification of Pavlovian approaches toward the reward delivery site. Whereas striatal neurons represented transfer and approach behavior through mostly segregated neuronal subsets, overlapping subsets represented these events in the mPFC and OFC. These findings suggest that parallel phasic activation of mPFC and OFC neuronal subsets participates in the transfer from Pavlovian incentives to instrumental actions.

Cortically activated interneurons shape spatial aspects of cortico-accumbens processing

Basal ganglia circuits are organized as parallel loops that have been proposed to compete in a winner-take-all fashion to determine the appropriate behavioral outcome. However, limited experimental support for strong lateral inhibition mechanisms within striatal regions questions this model. Here, stimulation of the prefrontal cortex (PFC) using naturally occurring bursty patterns inhibited firing in most nucleus accumbens (NA) projection neurons. When an excitatory response was observed for one stimulation site, neighboring PFC sites evoked inhibition in the same neuron. Furthermore, PFC stimulation activated interneurons, and PFC-evoked inhibition was blocked by GABA(A) antagonists in corticoaccumbens slice preparations. Thus bursting PFC activity recruits local inhibition in the NA, shaping responses of projection neurons with a topographical arrangement that allows inhibition among parallel corticoaccumbens channels. The data indicate a high order of information processing within striatal circuits that should be considered in models of basal ganglia function and disease.

Effects of food deprivation on goal-directed behavior, spontaneous locomotion, and c-Fos immunoreactivity in the amygdala

Previous work in our laboratory has shown that food deprivation and food presentation produce different patterns of neuronal activity (as measured by c-Fos immunoreactivity) in the medial prefrontal cortex and nucleus accumbens of rats. Since the amygdala has been implicated in both motivational and reinforcement processes and has neuronal connections to both the prefrontal cortex and nucleus accumbens, it was of interest to assess amygdaloid c-Fos immunoreactivity during similar manipulations of food deprivation and presentation. In the current study, c-Fos counts in both basolateral and central amygdalar nuclei were observed to increase in rats 12- and 36-h food deprived (relative to 0-h controls)-an effect reversed by the presentation of either a small or large meal (2.5 or 20g of food). In another experiment, rats working on a progressive ratio schedule of reinforcement exhibited elevated break-points as a function of food deprivation, a result consistent with the view that the feeding manipulations increased the subjects' level of motivation. In contrast, food deprivation reduced the spontaneous locomotor activity of rats, presumably as a result of an inherent energy-conservation strategy when no food is readily available. These data suggest that the state of food deprivation is associated with: (a) enhanced behavioral output only when food is attainable (increased goal-directed behavior, but decreased spontaneous activity), and (b) increased synaptic engagement in neuronal circuits involved in affective valuation and related decision-making (increased c-Fos counts in the amygdala).

Computational model of extracellular glutamate in the nucleus accumbens incorporates neuroadaptations by chronic cocaine

Chronic cocaine administration causes instability in extracellular glutamate in the nucleus accumbens that is thought to contribute to the vulnerability to relapse. A computational framework was developed to model glutamate in the extracellular space, including synaptic and nonsynaptic glutamate release, glutamate elimination by glutamate transporters and diffusion, and negative feedback on synaptic release via metabotropic glutamate receptors (mGluR2/3). This framework was used to optimize the geometry of the glial sheath surrounding excitatory synapses, and by inserting physiological values, accounted for known stable extracellular, extrasynaptic concentrations of glutamate measured by microdialysis and glutamatergic tone on mGluR2/3. By using experimental values for cocaine-induced reductions in cystine-glutamate exchange and mGluR2/3 signaling, and by predicting the down-regulation of glutamate transporters, the computational model successfully represented the experimentally observed increase in glutamate that is seen in rats during cocaine-seeking. This model provides a mathematical framework for describing how pharmacological or pathological conditions influence glutamate transmission measured by microdialysis.

To press or not to press? Differential receptor expression and response to novelty in rats learning an operant response for reward

Learning to perform instrumental tasks is an ability of all animals. In a population of rats, not all individuals will acquire an operant response for reward. We hypothesized that there could be a genetic explanation for differences between High Consumers (those that acquired the lever press response) and Low Consumers (lever press response is low). Additionally, we proposed that this genetic difference could produce measurable changes in response to novelty. Wistar rats were trained to lever press for a 0.2% saccharin reward and on the 10th day they were placed in a novel open field for 30 min to record locomotor activity. The prefrontal cortex and hippocampus were dissected and qPCR was used to measure mRNA expression. A significant difference (p=.048; 2-way ANOVA) in gene expression was observed between Low and High Consumers. A principal component analysis (PCA), to cluster which genes represent this difference, identified 4 genes; 5-HT2A and mGlu1 in the hippocampus and AMPA GluR1 and adrenergic alpha2A in the prefrontal cortex. Response to a novel open field also differed since Low Consumers displayed a higher Total Distance in comparison to High Consumers. Additionally, Low Consumers could be subdivided into Low-Lever (with lever press response only when water deprived) and Low-Non-Lever (lever press response is low throughout training). PCA with this subdivision identified an additional nine genes differing within the divisions; NMDA NR2B and GABAAalpha3 in the prefrontal cortex and adrenergic alpha2B and alpha2A, AMPA GluR1, GluR2 and GluR3, 5-HT1B and GABAAalpha5 in the hippocampus.

Progression of cellular adaptations in medial prefrontal and orbitofrontal cortex in response to repeated amphetamine

Recent theories on addiction implicate adaptive changes in prefrontal cortex (PFC) neurons in reinforcing and psychotomimetic properties of psychostimulants, yet little is known about how neuronal responses to these drugs change over time. Here we describe electrophysiological evidence for a progressive and sustained change in the response of PFC neurons to amphetamine during repeated exposure. In spontaneously behaving rats and in rats engaged in an instrumental responding task, we followed the activity of medial PFC (mPFC) and orbitofrontal cortex (OFC) neurons during daily exposure to amphetamine and after a post-withdrawal challenge. Repeated amphetamine increased the number of responsive neurons and the magnitude of responses and modified spontaneous burst patterns. These changes were apparent after a few exposures to amphetamine, were amplified after withdrawal, and were region specific in that repeated amphetamine increasingly produced inhibitory responses in mPFC and excitatory responses in OFC. In behaviorally engaged animals, the gradual enhancement in mPFC inhibition and OFC overactivation correlated with a progressive impairment of instrumental responding. Furthermore, these changes were evident predominately in neurons that displayed phasic responses during task-related events. These rapid-onset and sustained cellular adaptations suggest that even limited exposure to psychostimulants may reduce the influence of mPFC neurons on behavior while at the same time exaggerating information encoded by OFC neurons.