Cholinergic control over attention in rats prone to attribute incentive salience to reward cues

A glucocorticoid receptor antagonist reduces sign-tracking behavior in male Japanese quail

Addiction is characterized as a chronic debilitating disease. One devastating feature of addiction is the susceptibility of relapse (40-60%) after stretches of abstinence. One theory that may account for relapse suggests that drug cues (e.g., paraphernalia) may increase stress hormones, and this may prompt relapse. Repeatedly pairing a neutral cue with a reward is commonly utilized to measure what subjects learn about a cue that is predictive of reward. Research has shown that animals that attend to a cue more than to the reward (sign trackers) may be more vulnerable to drug addiction. Additionally, research has shown that sign tracking is associated with an increase in corticosterone, a primary stress hormone. PT150 is a novel glucocorticoid receptor antagonist that moderates the release of corticosterone. In the current experiment, it was hypothesized that subjects given repeated administration of PT150 would reduce sign tracking compared to subjects given placebo. Time spent (in seconds) near a cue that predicts reward (conditional stimulus) served as a measure of sign tracking, and PT150 or placebo was administered following sign tracking. An independent-samples t test revealed that subjects that received PT150 had reduced time spent near the conditioned stimulus compared to controls. Given the devastating effects of drug addiction, identification of a potential pharmacological intervention in the reduction of relapse would be of great value. Therefore, future research is needed to validate the use of PT150 in reducing behaviors associated with drug addiction. (PsycINFO Database Record

Attentional capacities prior to drug exposure predict motivation to self-administer nicotine

RATIONALE

Nicotine can enhance attention and attribution of incentive salience to nicotine-associated stimuli. However, it is not clear whether inter-individual differences in attentional capacities prior to any exposure could play a role in vulnerability to nicotine self-administration. We further explored this vulnerability through pre-existing inter-individual differences in attention to a reward-predictive cue in drug-free animals.

METHODS

A cued version of the Fixed Consecutive Number schedule (FCN16_cue) of reinforcement task was used to assess attention. This task consists in completing a long chain of sequential lever presses to obtain a reward, and examines the rats' ability to pay attention to a cue light that signals its availability. Rats were then trained to self-administer nicotine intravenously (30 μg/kg/0.1 mL). Drug-taking and seeking behaviors were investigated.

RESULTS

Our results showed important inter-individual differences in response for nicotine during the progressive ratio schedule of reinforcement. By comparing rats in the lower and upper quartiles of the mean breaking point, we showed that high-motivated rats were also more sensitive to the reinforcing properties of nicotine than low-motivated ones. We found that while both groups did not differ in premature responding in the FCN16_cue task, high-motivated rats were more efficient in taking the cue light into account than low-motivated rats as shown by a higher proportion of optimal chains, indicating a higher level of attention to the reward-predictive cue. Moreover, it was positively correlated with higher motivation for nicotine, a hallmark of nicotine addiction.

CONCLUSIONS

These results suggest that higher attention to reward-associated cues prior to drug taking predicts vulnerability to nicotine-reinforcing properties.

Transient inactivation of the paraventricular nucleus of the thalamus enhances cue-induced reinstatement in goal-trackers, but not sign-trackers

RATIONALE

The paraventricular nucleus of the thalamus (PVT) has been shown to mediate cue-motivated behaviors, such as sign- and goal-tracking, as well as reinstatement of drug-seeking behavior. However, the role of the PVT in mediating individual variation in cue-induced drug-seeking behavior remains unknown.

OBJECTIVES

This study aimed to determine if inactivation of the PVT differentially mediates cue-induced drug-seeking behavior in sign-trackers and goal-trackers.

METHODS

Rats were characterized as sign-trackers (STs) or goal-trackers (GTs) based on their Pavlovian conditioned approach behavior. Rats were then exposed to 15 days of cocaine self-administration, followed by a 2-week forced abstinence period and then extinction training. Rats then underwent tests for cue-induced reinstatement and general locomotor activity, prior to which they received an infusion of either saline (control) or baclofen/muscimol (B/M) to inactivate the PVT.

RESULTS

Relative to control animals of the same phenotype, GTs show a robust increase in cue-induced drug-seeking behavior following PVT inactivation, whereas the behavior of STs was not affected. PVT inactivation did not affect locomotor activity in either phenotype.

CONCLUSION

In GTs, the PVT appears to inhibit the expression of drug-seeking, presumably by attenuating the incentive value of the drug cue. Thus, inactivation of the PVT releases this inhibition in GTs, resulting in an increase in cue-induced drug-seeking behavior. PVT inactivation did not affect cue-induced drug-seeking behavior in STs, suggesting that the role of the PVT in encoding the incentive motivational value of drug cues differs between STs and GTs.

The neuroscience of cognitive-motivational styles: Sign- and goal-trackers as animal models

Cognitive-motivational styles describe predominant patterns of processing or biases that broadly influence human cognition and performance. Here we focus on the impact of cognitive-motivational styles on the response to cues predicting the availability of food or addictive drugs. An individual may preferably conduct an analysis of the motivational significance of reward cues, with the result that such cues per se are perceived as rewarding and worth approaching and working for. Alternatively, a propensity for a "cold" analysis of the behavioral utility of a reward cue may yield search behavior for food or drugs but not involve cue approach. Animal models for studying the neuronal mechanisms mediating such styles have originated from research concerning behavioral indices that predict differential vulnerability to addiction-like behaviors. Rats classified as sign- or goal-trackers (STs, GTs) were found to have opposed attentional biases (bottom-up or cue-driven attention vs. top-down or goal-driven attentional control) that are mediated primarily via relatively unresponsive versus elevated levels of cholinergic neuromodulation in the cortex. The capacity for cholinergic neuromodulation in STs is limited by a neuronal choline transporter (CHT) that fails to support increases in cholinergic activity. Moreover, in contrast to STs, the frontal dopamine system in GTs does not respond to the presence of drug cues and, thus, biases against cue-oriented behavior. The opponent cognitive-motivational styles that are indexed by sign- and goal-tracking bestow different cognitive-behavioral vulnerabilities that may contribute to the manifestation of a wide range of neuropsychiatric disorders. (PsycINFO Database Record

Compensatory dopaminergic-cholinergic interactions in conflict processing: Evidence from patients with Parkinson's disease

Executive functions are complex both in the cognitive operations involved and in the neural structures and functions that support those operations. This complexity makes executive function highly vulnerable to the detrimental effects of aging, brain injury, and disease, but may also open paths to compensation. Neural compensation is often used to explain findings of additional or altered patterns of brain activations by older adults or patient populations compared to young adults or healthy controls, especially when associated with relatively preserved performance. Here we test the hypothesis of an alternative form of compensation, between different neuromodulator systems. 135 patients with Parkinson's Disease (PD) completed vesicular monoamine transporter type2 (VMAT2) and acetylcholinesterase PET scanning to assess the integrity of nigrostriatal dopaminergic, thalamic cholinergic, and cortical cholinergic pathways, and a behavioral test (Stroop + task-switching) that puts high demands on conflict processing, an important aspect of executive control. Supporting the compensatory hypothesis, regression models controlling for age and other covariates revealed an interaction between caudate dopamine and cortical cholinergic integrity: Cortical cholinergic integrity was a stronger predictor of conflict processing in patients with relatively low caudate dopaminergic function. These results suggest that although frontostriatal dopaminergic function plays a central role in executive control, cholinergic systems may also make an important contribution. The present results suggest potential pathways for remediation, and that the appropriate interventions for each patient may depend on their particular profile of decline. Furthermore, they help to elucidate the brain systems that underlie executive control, which may be important for understanding other disorders as well as executive function in healthy adults.

Sex-dependent impact of early-life stress and adult immobilization in the attribution of incentive salience in rats

Early life stress (ELS) induces long-term effects in later functioning and interacts with further exposure to other stressors in adulthood to shape our responsiveness to reward-related cues. The attribution of incentive salience to food-related cues may be modulated by previous and current exposures to stressors in a sex-dependent manner. We hypothesized from human data that exposure to a traumatic (severe) adult stressor will decrease the attribution of incentive salience to reward-associated cues, especially in females, because these effects are modulated by previous ELS. To study these factors in Long-Evans rats, we used as an ELS model of restriction of nesting material and concurrently evaluated maternal care. In adulthood, the offspring of both sexes were exposed to acute immobilization (IMO), and several days after, a Pavlovian conditioning procedure was used to assess the incentive salience of food-related cues. Some rats developed more attraction to the cue predictive of reward (sign-tracking) and others were attracted to the location of the reward itself, the food-magazine (goal-tracking). Several dopaminergic markers were evaluated by in situ hybridization. The results showed that ELS increased maternal care and decreased body weight gain (only in females). Regarding incentive salience, in absolute control animals, females presented slightly greater sign-tracking behavior than males. Non-ELS male rats exposed to IMO showed a bias towards goal-tracking, whereas in females, IMO produced a bias towards sign-tracking. Animals of both sexes not exposed to IMO displayed an intermediate phenotype. ELS in IMO-treated females was able to reduce sign-tracking and decrease tyrosine hydroxylase expression in the ventral tegmental area and dopamine D1 receptor expression in the accumbens shell. Although the predicted greater decrease in females in sign-tracking after IMO exposure was not corroborated by the data, the results highlight the idea that sex is an important factor in the study of the long-term impact of early and adult stressors.

Coordinated Acetylcholine Release in Prefrontal Cortex and Hippocampus Is Associated with Arousal and Reward on Distinct Timescales

Cholinergic neurotransmission throughout the neocortex and hippocampus regulates arousal, learning, and attention. However, owing to the poorly characterized timing and location of acetylcholine release, its detailed behavioral functions remain unclear. Using electrochemical biosensors chronically implanted in mice, we made continuous measurements of the spatiotemporal dynamics of acetylcholine release across multiple behavioral states. We found that tonic levels of acetylcholine release were coordinated between the prefrontal cortex and hippocampus and maximal during training on a rewarded working memory task. Tonic release also increased during REM sleep but was contingent on subsequent wakefulness. In contrast, coordinated phasic acetylcholine release occurred only during the memory task and was strongly localized to reward delivery areas without being contingent on trial outcome. These results show that coordinated acetylcholine release between the prefrontal cortex and hippocampus is associated with reward and arousal on distinct timescales, providing dual mechanisms to support learned behavior acquisition during cognitive task performance.

Adrenergic manipulation inhibits pavlovian conditioned approach behaviors

Environmental rewards and Pavlovian reward cues can acquire incentive salience, thereby eliciting incentive motivational states and instigate reward-seeking. In rats, the incentive salience of food cues can be measured during a Pavlovian conditioned approach paradigm, in which rats engage in cue-directed approach ("sign-tracking") or approach the food delivery location ("goal-tracking"). While it has been shown that dopamine signaling is necessary for sign-tracking, some studies have suggested that norepinephrine is involved in learning to sign-track as well. Thus, in order to investigate the influence of norepinephrine in Pavlovian conditioned approach, we administered three adrenergic drugs while rats learned that a food cue (an illuminated, retractable lever) preceded the delivery of banana-flavored food pellets into a food-cup. We found that pre-session injections of disulfiram (a dopamine-β-hydroxylase inhibitor) inhibited the development of sign-tracking, but goal-tracking was only affected at the high dose. In one experiment, post-session injections of disulfiram blocked the development of sign-tracking, although this effect was not replicated in a separate set of rats. Post-session injections of prazosin (an α1-adrenergic receptor antagonist) and propranolol (a β-adrenergic receptor antagonist) also blocked the development of sign-tracking but not goal-tracking. Taken together, these results suggest that adrenergic transmission mediates the acquisition of sign-tracking but not goal-tracking, and thus plays a selective role in the attribution of incentive salience food cues.

'Hot' vs. 'cold' behavioural-cognitive styles: motivational-dopaminergic vs. cognitive-cholinergic processing of a Pavlovian cocaine cue in sign- and goal-tracking rats

Discrete Pavlovian reward cues acquire more potent incentive motivational properties (incentive salience) in some animals (sign-trackers; STs) compared to others (goal-trackers; GTs). Conversely, GTs appear to be better than STs in processing more complex contextual cues, perhaps reflecting their relatively greater bias for goal-directed cue processing. Here, we investigated the activity of two major prefrontal neuromodulatory input systems, dopamine (DA) and acetylcholine (ACh), in response to a discrete Pavlovian cue that was previously paired with cocaine administration in STs and GTs. Rats underwent Pavlovian training in which light cue presentations were either paired or unpaired with an intravenous cocaine infusion. Following a 10-day abstinence period, prefrontal dialysates were collected in STs and GTs during cue presentations in the absence of cocaine. In STs, the cue previously paired with cocaine significantly increased prefrontal DA levels. DA levels remained elevated over baseline across multiple cue presentation blocks, and DA levels and approaches to the cue were significantly correlated. In STs, ACh levels were unaffected by cue presentations. In contrast, in GTs, presentations of the cocaine cue increased prefrontal ACh, but not DA, levels. GTs oriented towards the cue at rates similar to STs, but they did not approach it and elevated ACh levels did not correlate with conditioned orientation. The results indicate a double dissociation between the role of prefrontal DA and ACh in STs and GTs, and suggest that these phenotypes will be useful for studying the role of neuromodulator systems in mediating opponent behavioural-cognitive styles.

Basal Forebrain Cholinergic Circuits and Signaling in Cognition and Cognitive Decline

Recent work continues to place cholinergic circuits at center stage for normal executive and mnemonic functioning and provides compelling evidence that the loss of cholinergic signaling and cognitive decline are inextricably linked. This Review focuses on the last few years of studies on the mechanisms by which cholinergic signaling contributes to circuit activity related to cognition. We attempt to identify areas of controversy, as well as consensus, on what is and is not yet known about how cholinergic signaling in the CNS contributes to normal cognitive processes. In addition, we delineate the findings from recent work on the extent to which dysfunction of cholinergic circuits contributes to cognitive decline associated with neurodegenerative disorders.

Revisiting the role of the insula and smoking cue-reactivity in relapse: A replication and extension of neuroimaging findings

INTRODUCTION

The ability to direct smoking cessation treatment based on neuroscientific findings holds incredible promise. However, there is a strong need for consistency across studies to confirm neurobiological targets. While our prior work implicated enhanced insula reactivity to smoking cues in tobacco smoking relapse vulnerability, this finding has not been confirmed.

METHOD

Using functional magnetic resonance imaging (fMRI), we evaluated the pre-cessation brain reactivity to smoking vs. neutral cues in nicotine dependent smokers who were and were not able to maintain subsequent abstinence.

RESULTS

Of the 23 (7 women) individuals assessed, 13 relapsed and there were no demographic differences between those who did and did not relapse. However, smokers who relapsed showed enhanced reactivity to smoking cues in the right insula and dorsal striatum, showing significant overlap between our current and prior work despite methodological differences, including the fact that our previous work only included women.

CONCLUSION

The current work supports our prior results and builds on the concept that the insula and dorsal striatum work in concert to maintain nicotine dependence. Specifically, dorsal striatal-mediated habitual responding may be triggered both by the external drug-associated cues, and the insula-mediated internal states that provide additional context motivating drug use. This replicated finding also mirrors preclinical work that finds the same individualized distinction, as only some rodents attribute incentive salience to drug cues and are more likely to reinstate drug seeking after extinction. To effectively treat addiction, these individual characteristics and their underlying neurobiological foundations must be considered.

Diverse Roads to Relapse: A Discriminative Cue Signaling Cocaine Availability Is More Effective in Renewing Cocaine Seeking in Goal Trackers Than Sign Trackers and Depends on Basal Forebrain Cholinergic Activity

Stimuli associated with taking drugs are notorious instigators of relapse. There is, however, considerable variation in the motivational properties of such stimuli, both as a function of the individual and the nature of the stimulus. The behavior of some individuals (sign trackers, STs) is especially influenced by cues paired with reward delivery, perhaps because they are prone to process information via dopamine-dependent, cue-driven, incentive salience systems. Other individuals (goal trackers, GTs) are better able to incorporate higher-order contextual information, perhaps because of better executive/attentional control over behavior, which requires frontal cortical cholinergic activity. We hypothesized, therefore, that a cue that "sets the occasion" for drug taking (a discriminative stimulus, DS) would reinstate cocaine seeking more readily in GTs than STs and that this would require intact cholinergic neurotransmission. To test this, male STs and GTs were trained to self-administer cocaine using an intermittent access schedule with periods of cocaine availability and unavailability signaled by a DS+ and a DS-, respectively. Thereafter, half of the rats received an immunotoxic lesion that destroyed 40-50% of basal forebrain cholinergic neurons and later, after extinction training, were tested for the ability of noncontingent presentations of the DS+ to reinstate cocaine seeking behavior. The DS+ was much more effective in reinstating cocaine seeking in GTs than STs and this effect was abolished by cholinergic losses despite the fact that all rats continued to orient to the DS+ We conclude that vulnerability to relapse involves interactions between individual cognitive-motivational biases and the form of the drug cue encountered.SIGNIFICANCE STATEMENT The most predictable outcome of a diagnosis of addiction is a high chance for relapse. When addicts encounter cues previously associated with drug, their attention may be unduly attracted to such cues and these cues can evoke motivational states that instigate and maintain drug-seeking behavior. Although sign-tracking rats were previously demonstrated to exhibit greater relapse vulnerability to Pavlovian drug cues paired with drug delivery, here, we demonstrate that their counterparts, the goal trackers, are more vulnerable if the drug cue acts to signal drug availability and that the forebrain cholinergic system mediates such vulnerability. Given the importance of contextual cues for triggering relapse and the human cognitive-cholinergic capacity for the processing of such cues, goal trackers model essential aspects of relapse vulnerability.

The (α4)3(β2)2 Stoichiometry of the Nicotinic Acetylcholine Receptor Predominates in the Rat Motor Cortex

The α4β2 nicotinic acetylcholine receptor (nAChR) is important in central nervous system physiology and in mediating several of the pharmacological effects of nicotine on cognition, attention, and affective states. It is also the likely receptor that mediates nicotine addiction. This receptor assembles in two distinct stoichiometries: (α4)₂(β2)₃ and (α4)₃(β2)₂, which are referred to as high-sensitivity (HS) and low-sensitivity (LS) nAChRs, respectively, based on a difference in the potency of acetylcholine to activate them. The physiologic and pharmacological differences between these two receptor subtypes have been described in heterologous expression systems. However, the presence of each stoichiometry in native tissue currently remains unknown. In this study, different ratios of rat α4 and β2 subunit cDNA were transfected into human embryonic kidney 293 cells to create a novel model system of HS and LS α4β2 nAChRs expressed in a mammalian cell line. The HS and LS nAChRs were characterized through pharmacological and biochemical methods. Isolation of surface proteins revealed higher amounts of α4 or β2 subunits in the LS or HS nAChR populations, respectively. In addition, sazetidine-A displayed different efficacies in activating these two receptor stoichiometries. Using this model system, a neurophysiological "two-concentration" acetylcholine or carbachol paradigm was developed and validated to determine α4/β2 subunit stoichiometry. This paradigm was then used in layers I-IV of slices of the rat motor cortex to determine the percent contribution of HS and LS α4β2 receptors in this brain region. We report that the majority of α4β2 nAChRs in this brain region possess a stoichiometry of the (α4)₃(β2)₂ LS subtype.

Baseline-dependent effects of amphetamine on attention are associated with striatal dopamine metabolism

Psychostimulants, such as amphetamine, are widely used to treat attentional deficits. In humans, response to dopaminergic medications is complex with improvement often dependent on baseline performance. Our goal was to determine if attention in rats could be improved by low dose amphetamine in a baseline-dependent manner by examining the relationship between task performance, drug response and monoamine levels in corticostriatal tissue. Firstly, rats performed a signal detection task with varying signal durations before administration of saline, 0.1 or 0.25 mg/kg amphetamine. Following 0.1 mg/kg amphetamine, accuracy in poor performing individuals increased to that of high performing rats. Furthermore, baseline accuracy correlated with the magnitude of improvement after amphetamine. Secondly, neurochemical analysis of monoamine content and gene expression levels in the prefrontal cortex (PFC) and dorsal striatum (CPU) was conducted. CPU homovanillic acid and 5-hydroxyindoleacetic acid levels were increased in poor performers with a significant correlation between the expression of the dopamine transporter gene and baseline accuracy. No changes were found in the PFC. These results indicated poor performance was associated with greater response to amphetamine and altered DA and 5-HT neurotransmitter systems in CPU. These results suggest striatal monoamine function may be fundamental to explaining individual differences in psychostimulant response.

Acetylcholine Release in Prefrontal Cortex Promotes Gamma Oscillations and Theta-Gamma Coupling during Cue Detection

The capacity for using external cues to guide behavior ("cue detection") constitutes an essential aspect of attention and goal-directed behavior. The cortical cholinergic input system, via phasic increases in prefrontal acetylcholine release, plays an essential role in attention by mediating such cue detection. However, the relationship between cholinergic signaling during cue detection and neural activity dynamics in prefrontal networks remains unclear. Here we combined subsecond measures of cholinergic signaling, neurophysiological recordings, and cholinergic receptor blockade to delineate the cholinergic contributions to prefrontal oscillations during cue detection in rats. We first confirmed that detected cues evoke phasic acetylcholine release. These cholinergic signals were coincident with increased neuronal synchrony across several frequency bands and the emergence of theta-gamma coupling. Muscarinic and nicotinic cholinergic receptors both contributed specifically to gamma synchrony evoked by detected cues, but the effects of blocking the two receptor subtypes were dissociable. Blocking nicotinic receptors primarily attenuated high-gamma oscillations occurring during the earliest phases of the cue detection process, while muscarinic (M1) receptor activity was preferentially involved in the transition from high to low gamma power that followed and corresponded to the mobilization of networks involved in cue-guided decision making. Detected cues also promoted coupling between gamma and theta oscillations, and both nicotinic and muscarinic receptor activity contributed to this process. These results indicate that acetylcholine release coordinates neural oscillations during the process of cue detection.SIGNIFICANCE STATEMENT The capacity of learned cues to direct attention and guide responding ("cue detection") is a key component of goal-directed behavior. Rhythmic neural activity and increases in acetylcholine release in the prefrontal cortex contribute to this process; however, the relationship between these neuronal mechanisms is not well understood. Using a combination of in vivo neurochemistry, neurophysiology, and pharmacological methods, we demonstrate that cue-evoked acetylcholine release, through distinct actions at both nicotinic and muscarinic receptors, triggers a procession of neural oscillations that map onto the multiple stages of cue detection. Our data offer new insights into cholinergic function by revealing the temporally orchestrated changes in prefrontal network synchrony modulated by acetylcholine release during cue detection.

Unresponsive Choline Transporter as a Trait Neuromarker and a Causal Mediator of Bottom-Up Attentional Biases

Some rats [sign-trackers (STs)] are prone to attribute incentive salience to reward cues, which can manifest as a propensity to approach and contact pavlovian cues, and for addiction-like behavior. STs also exhibit poor attentional performance, relative to goal-trackers (GTs), which is associated with attenuated acetylcholine (ACh) levels in prefrontal cortex (Paolone et al., 2013). Here, we demonstrate a cellular mechanism, linked to ACh synthesis, that accounts for attenuated cholinergic capacity in STs. First, we found that electrical stimulation of the basal forebrain increased cortical choline transporter (CHT)-mediated choline transport in GTs, paralleled by a redistribution of CHTs to the synaptic plasma membrane. Neither increases in choline uptake nor translocation of CHTs occurred in STs. Second, and consistent with uptake/translocation alterations, STs demonstrated a reduced ability to support cortical ACh release in vivo compared with GTs after reverse-dialysis to elevate extracellular potassium levels. Third, rats were significantly more likely to develop sign-tracking behavior if treated systemically before pavlovian conditioned approach training with the CHT inhibitor VU6001221. Consistent with its proposed mechanisms, administration of VU6001221 attenuated potassium-evoked ACh levels in prefrontal cortex measured with in vivo microdialysis. We propose that loss of CHT-dependent activation of cortical cholinergic activity in STs degrades top-down executive control over behavior, producing a bias for bottom-up or stimulus-driven attention. Such an attentional bias contributes to nonadaptive reward processing and thus identifies a novel mechanism that can support psychopathology, including addiction.SIGNIFICANCE STATEMENT The vulnerability for addiction-like behavior has been associated with psychological traits, such as the propensity to attribute incentive salience to reward cues that is modeled in rats by sign-tracking behavior. Sign-trackers tend to approach and contact cues associated with reward, whereas their counterparts, the goal-trackers, have a preference for approaching the location of the reward. Here, we show that the capacity of presynaptic cholinergic synapses to respond to stimulation by elevating presynaptic choline uptake and releasing acetylcholine is attenuated in sign-trackers. Furthermore, pharmacological inhibition of choline transport induced sign-tracking behavior. Our findings suggest that reduced levels of cholinergic neuromodulation can mediate an attentional bias toward reward-related cues, thereby allowing such cues to exert relatively greater control over behavior.

Thalamic cholinergic innervation makes a specific bottom-up contribution to signal detection: Evidence from Parkinson's disease patients with defined cholinergic losses

Successful behavior depends on the ability to detect and respond to relevant cues, especially under challenging conditions. This essential component of attention has been hypothesized to be mediated by multiple neuromodulator systems, but the contributions of individual systems (e.g., cholinergic, dopaminergic) have remained unclear. The present study addresses this issue by leveraging individual variation in regionally-specific cholinergic denervation in Parkinson's disease (PD) patients, while controlling for variation in dopaminergic denervation. Patients whose dopaminergic and cholinergic nerve terminal integrity had been previously assessed using Positron Emission Tomography (Bohnen et al., 2012) and controls were tested in a signal detection task that manipulates attentional-perceptual challenge and has been used extensively in both rodents and humans to investigate the cholinergic system's role in responding to such challenges (Demeter et al., 2008; McGaughy and Sarter, 1995; see Hasselmo and Sarter 2011 for review). In simple correlation analyses, measures of midbrain dopaminergic, and both cortical and thalamic cholinergic innervation all predicted preserved signal detection under challenge. However, regression analyses also controlling for age, disease severity, and other variables showed that the only significant independent neurotransmitter-related predictor over and above the other variables in the model was thalamic cholinergic integrity. Furthermore, thalamic cholinergic innervation exclusively predicted hits, not correct rejections, indicating a specific contribution to bottom-up salience processing. These results help define regionally-specific contributions of cholinergic function to different aspects of attention and behavior.

Neurobiological Basis of Individual Variation in Stimulus-Reward Learning

Cues in the environment can guide behavior in adaptive ways, leading one towards valuable resources such as food, water, or a potential mate. However, cues in the environment may also serve as powerful motivators that lead to maladaptive patterns of behavior, such as addiction. Importantly, and central to this article, there is considerable individual variation in the extent to which reward cues gain motivational control over behavior. Here we describe an animal model that captures this individual variation, allowing us to better understand the psychological and neurobiological processes that contribute to cue-evoked behaviors. When a discrete cue is paired with a food reward in a Pavlovian manner it acquires greater control over motivated behavior in some rats ("sign-trackers, STs) than in others ("goal-trackers", GTs). We review studies that have exploited this animal model to parse the neurobiological mechanisms involved in learning associations between stimuli vs. those involved in attributing incentive salience to those same stimuli. The latter seems to be dependent on dopamine and subcortical circuits, whereas the former may engage more cortical "top-down" mechanisms.

The ability for cocaine and cocaine-associated cues to compete for attention

In humans, reward cues, including drug cues in individuals experiencing addiction, are especially effective in biasing attention towards them, so much so they can disrupt ongoing task performance. It is not known, however, whether this happens in rats. To address this question, we developed a behavioral paradigm to assess the capacity of an auditory drug (cocaine) cue to evoke cocaine-seeking behavior, thus distracting thirsty rats from performing a well-learned sustained attention task (SAT) to obtain a water reward. First, it was determined that an auditory cocaine cue (tone-CS) reinstated drug-seeking equally in sign-trackers (STs) and goal-trackers (GTs), which otherwise vary in the propensity to attribute incentive salience to a localizable drug cue. Next, we tested the ability of an auditory cocaine cue to disrupt performance on the SAT in STs and GTs. Rats were trained to self-administer cocaine intravenously using an Intermittent Access self-administration procedure known to produce a progressive increase in motivation for cocaine, escalation of intake, and strong discriminative stimulus control over drug-seeking behavior. When presented alone, the auditory discriminative stimulus elicited cocaine-seeking behavior while rats were performing the SAT, but it was not sufficiently disruptive to impair SAT performance. In contrast, if cocaine was available in the presence of the cue, or when administered non-contingently, SAT performance was severely disrupted. We suggest that performance on a relatively automatic, stimulus-driven task, such as the basic version of the SAT used here, may be difficult to disrupt with a drug cue alone. A task that requires more top-down cognitive control may be needed.

A food-predictive cue attributed with incentive salience engages subcortical afferents and efferents of the paraventricular nucleus of the thalamus

The paraventricular nucleus of the thalamus (PVT) has been implicated in behavioral responses to reward-associated cues. However, the precise role of the PVT in these behaviors has been difficult to ascertain since Pavlovian-conditioned cues can act as both predictive and incentive stimuli. The "sign-tracker/goal-tracker" rat model has allowed us to further elucidate the role of the PVT in cue-motivated behaviors, identifying this structure as a critical component of the neural circuitry underlying individual variation in the propensity to attribute incentive salience to reward cues. The current study assessed differences in the engagement of specific PVT afferents and efferents in response to presentation of a food-cue that had been attributed with only predictive value or with both predictive and incentive value. The retrograde tracer fluorogold (FG) was injected into the PVT or the nucleus accumbens (NAc) of rats, and cue-induced c-Fos in FG-labeled cells was quantified. Presentation of a predictive stimulus that had been attributed with incentive value elicited c-Fos in PVT afferents from the lateral hypothalamus, medial amygdala (MeA), and the prelimbic cortex (PrL), as well as posterior PVT efferents to the NAc. PVT afferents from the PrL also showed elevated c-Fos levels following presentation of a predictive stimulus alone. Thus, presentation of an incentive stimulus results in engagement of subcortical brain regions; supporting a role for the hypothalamic-thalamic-striatal axis, as well as the MeA, in mediating responses to incentive stimuli; whereas activity in the PrL to PVT pathway appears to play a role in processing the predictive qualities of reward-paired stimuli.

The sensory features of a food cue influence its ability to act as an incentive stimulus and evoke dopamine release in the nucleus accumbens core

The sensory properties of a reward-paired cue (a conditioned stimulus; CS) may impact the motivational value attributed to the cue, and in turn influence the form of the conditioned response (CR) that develops. A cue with multiple sensory qualities, such as a moving lever-CS, may activate numerous neural pathways that process auditory and visual information, resulting in CRs that vary both within and between individuals. For example, CRs include approach to the lever-CS itself (rats that “sign-track”; ST), approach to the location of reward delivery (rats that “goal-track”; GT), or an “intermediate” combination of these behaviors. We found that the multimodal sensory features of the lever-CS were important to the development and expression of sign-tracking. When the lever-CS was covered, and thus could only be heard moving, STs not only continued to approach the lever location but also started to approach the food cup during the CS period. While still predictive of reward, the auditory component of the lever-CS was a much weaker conditioned reinforcer than the visible lever-CS. This plasticity in behavioral responding observed in STs closely resembled behaviors normally seen in rats classified as “intermediates.” Furthermore, the ability of both the lever-CS and the reward-delivery to evoke dopamine release in the nucleus accumbens was also altered by covering the lever—dopamine signaling in STs resembled neurotransmission observed in rats that normally only GT. These data suggest that while the visible lever-CS was attractive, wanted, and had incentive value for STs, when presented in isolation, the auditory component of the cue was simply predictive of reward, lacking incentive salience. Therefore, the specific sensory features of cues may differentially contribute to responding and ensure behavioral flexibility.

Less is more: prolonged intermittent access cocaine self-administration produces incentive-sensitization and addiction-like behavior

RATIONALE

Contemporary animal models of cocaine addiction focus on increasing the amount of drug consumption to produce addiction-like behavior. However, another critical factor is the temporal pattern of consumption, which in humans is characterized by intermittency, both within and between bouts of use.

OBJECTIVE

To model this, we combined prolonged access to cocaine (∼70 days in total) with an intermittent access (IntA) self-administration procedure and used behavioral economic indicators to quantify changes in motivation for cocaine.

RESULTS

IntA produced escalation of intake, a progressive increase in cocaine demand (incentive-sensitization), and robust drug- and cue-induced reinstatement of drug-seeking behavior. We also asked whether rats that vary in their propensity to attribute incentive salience to reward cues (sign-trackers [STs] vs. goal-trackers [GTs]) vary in the development of addiction-like behavior. Although STs were more motivated to take cocaine after limited drug experience, after IntA, STs and GTs no longer differed on any measure of addiction-like behavior.

CONCLUSIONS

Exposure to large quantities of cocaine is not necessary for escalation of intake, incentive-sensitization, or other addiction-like behaviors (IntA results in far less total cocaine consumption than 'long access' procedures). Also, the ST phenotype may increase susceptibility to addiction, not because STs are inherently susceptible to incentive-sensitization (perhaps all individuals are at risk), but because this phenotype promotes continued drug use, subjecting them to incentive-sensitization. Thus, the pharmacokinetics associated with the IntA procedure are especially effective in producing a number of addiction-like behaviors and may be valuable for studying associated neuroadaptations and for assessing individual variation in vulnerability.

The tendency to sign-track predicts cue-induced reinstatement during nicotine self-administration, and is enhanced by nicotine but not ethanol

RATIONALE

Some individuals are particularly responsive to reward-associated stimuli ("cues"), including the effects of these cues on craving and relapse to drug-seeking behavior. In the cases of nicotine and alcohol, cues may acquire these abilities via the incentive-enhancing properties of the drug.

OBJECTIVES

To determine the interaction between cue-responsivity and nicotine reinforcement, we studied the patterns of nicotine self-administration in rats categorized based on their tendency to approach a food-predictive cue ("sign-trackers") or a reward-delivery location ("goal-trackers"). In a second experiment, we determined whether nicotine and ethanol altered the incentive value of a food cue.

METHODS

Rats were classified as sign- or goal-trackers during a Pavlovian conditioned approach paradigm. Rats then self-administered intravenous nicotine (0.03 mg/kg infusions) followed by extinction and cue-induced reinstatement tests. We also tested the effects of nicotine (0.4 mg/kg base s.c.) or ethanol (0.7 g/kg i.p.) on the approach to, and reinforcing efficacy of, a food cue.

RESULTS

Sign-trackers showed greater reinstatement in response to a nicotine cue. Further, nicotine enhanced sign-tracking but not goal-tracking to a food cue and also enhanced responding for the food cue during the conditioned reinforcement test. Conversely, ethanol reduced sign-tracking and increased goal-tracking, but had no effect on conditioned reinforcement.

CONCLUSIONS

Our studies demonstrate that the tendency to attribute incentive value to a food cue predicts enhanced cue-induced reinstatement. Additionally, the incentive value of food cues is differentially modulated by nicotine and ethanol, which may be related to the reinforcing effects of these drugs.

Cholinergic genetics of visual attention: Human and mouse choline transporter capacity variants influence distractibility

The basal forebrain cholinergic projection system to the cortex mediates essential aspects of visual attention performance, including the detection of cues and the response to performance challenges (top-down control of attention). Higher levels of top-down control are mediated via elevated levels of cholinergic neuromodulation. The neuronal choline transporter (CHT) strongly influences the synthesis and release of acetylcholine (ACh). As the capacity of the CHT to import choline into the neuron is a major, presynaptic determinant of cholinergic neuromodulation, we hypothesize that genetically-imposed CHT capacity variation impacts the balance of bottom-up versus top-down control of visual attention. Following a brief review of the cognitive concepts relevant for this hypothesis, we describe the key results from our research in mice and humans that possess genetically-imposed changes in choline uptake capacity. CHT subcapacity is associated with poor top-down attentional control and attenuated (cholinergic) activation of right frontal regions. Conversely, mice overexpressing the CHT, and humans expressing a CHT variant hypothesized to enhance choline transporter function, are relatively resistant to challenges of visual attention performance. Genetic or environmental modulation of CHT expression and function may be associated with vulnerabilities for cognitive disorders.

What do phasic cholinergic signals do?

In addition to the neuromodulatory role of cholinergic systems, brief, temporally discrete cholinergic release events, or "transients", have been associated with the detection of cues in attention tasks. Here we review four main findings about cholinergic transients during cognitive processing. Cholinergic transients are: (1) associated with the detection of a cue and influenced by cognitive state; (2) not dependent on reward outcome, although the timing of the transient peak co-varies with the temporal relationship between detection and reward delivery; (3) correlated with the mobilization of the cue-evoked response; (4) causal mediators of shifts from monitoring to cue detection. We next discuss some of the key questions concerning the timing and occurrence of transients within the framework of available evidence including: (1) Why does the shift from monitoring to cue detection require a transient? (2) What determines whether a cholinergic transient will be generated? (3) How can cognitive state influence transient occurrence? (4) Why do cholinergic transients peak at around the time of reward delivery? (5) Is there evidence of cholinergic transients in humans? We conclude by outlining future research studies necessary to more fully understand the role of cholinergic transients in mediating cue detection.

Measuring Attention in Rodents: Comparison of a Modified Signal Detection Task and the 5-Choice Serial Reaction Time Task

Neuropsychiatric research has utilized cognitive testing in rodents to improve our understanding of cognitive deficits and for preclinical drug development. However, more sophisticated cognitive tasks have not been as widely exploited due to low throughput and the extensive training time required. We developed a modified signal detection task (SDT) based on the growing body of literature aimed at improving cognitive testing in rodents. This study directly compares performance on the modified SDT with a traditional test for measuring attention, the 5-choice serial reaction time task (5CSRTT). Adult male Sprague-Dawley rats were trained on either the 5CSRTT or the SDT. Briefly, the 5CSRTT required rodents to pay attention to a spatial array of five apertures and respond with a nose poke when an aperture was illuminated. The SDT required the rat to attend to a light panel and respond either left or right to indicate the presence of a signal. In addition, modifications were made to the reward delivery, timing, control of body positioning, and the self-initiation of trials. It was found that less training time was required for the SDT, with both sessions to criteria and daily session duration significantly reduced. Rats performed with a high level of accuracy (>87%) on both tasks, however omissions were far more frequent on the 5CSRTT. The signal duration was reduced on both tasks as a manipulation of task difficulty relevant to attention and a similar pattern of decreasing accuracy was observed on both tasks. These results demonstrate some of the advantages of the SDT over the traditional 5CSRTT as being higher throughput with reduced training time, fewer omission responses and their body position was controlled at stimulus onset. In addition, rats performing the SDT had comparable high levels of accuracy. These results highlight the differences and similarities between the 5CSRTT and a modified SDT as tools for assessing attention in preclinical animal models.

Attentional performance, impulsivity, and related neurotransmitter systems in apoE2, apoE3, and apoE4 female transgenic mice

RATIONALE

The apolipoprotein E (apoE) genotype influences cognitive performance in humans depending on age and sex. While the detrimental role of the apoE4 isoform on spatial learning and memory has been well-established in humans and rodents, less is known on its impact on the executive functions.

OBJECTIVES

We aimed to evaluate the effect of apoE isoforms (apoE2, apoE3, apoE4) on visuospatial attention and inhibitory control performance in female transgenic mice, and to determine the neurochemical and neuropharmacological basis of this potential relationship.

METHODS

Female mice carrying apoE2, apoE3, and apoE4 were trained in the five-choice serial reaction time task (5-CSRTT). Upon a stable performance, we manipulated the inter-trial interval and the stimulus duration to elicit impulsive responding and engage attention respectively. We further performed a pharmacological challenge by administering cholinergic and GABAergic agents. Finally, we analyzed the levels of brain amino acids and monoamines by using reversed phase high-performance liquid chromatography (HPLC).

RESULTS

ApoE4 mice showed a deficient inhibitory control as revealed by increased perseveration and premature responding. When attention was challenged, apoE4 mice also showed a higher drop in accuracy. The adverse effect of scopolamine on the task was attenuated in apoE4 mice compared to apoE2 and apoE3. Furthermore, apoE4 mice showed less dopamine in the frontal cortex than apoE2 mice.

CONCLUSIONS

We confirmed that the apoE genotype influences attention and inhibitory control in female transgenic mice. The influence of apoE isoforms in the brain neuromodulatory system may explain the cognitive and behavioral differences attributable to the genotype.

Rats that sign-track are resistant to Pavlovian but not instrumental extinction

Individuals vary in the extent to which they attribute incentive salience to a discrete cue (conditioned stimulus; CS) that predicts reward delivery (unconditioned stimulus; US), which results in some individuals approaching and interacting with the CS (sign-trackers; STs) more than others (goal-trackers; GTs). Here we asked how periods of non-reinforcement influence conditioned responding in STs vs. GTs, in both Pavlovian and instrumental tasks. After classifying rats as STs or GTs by pairing a retractable lever (the CS) with the delivery of a food pellet (US), we introduced periods of non-reinforcement, first by simply withholding the US (i.e., extinction training; experiment 1), then by signaling alternating periods of reward (R) and non-reward (NR) within the same session (experiments 2 and 3). We also examined how alternating R and NR periods influenced instrumental responding for food (experiment 4). STs and GTs did not differ in their ability to discriminate between R and NR periods in the instrumental task. However, in Pavlovian settings STs and GTs responded to periods of non-reward very differently. Relative to STs, GTs very rapidly modified their behavior in response to periods of non-reward, showing much faster extinction and better and faster discrimination between R and NR conditions. These results highlight differences between Pavlovian and instrumental extinction learning, and suggest that if a Pavlovian CS is strongly attributed with incentive salience, as in STs, it may continue to bias attention toward it, and to facilitate persistent and relatively inflexible responding, even when it is no longer followed by reward.

Dissociable deficits of executive function caused by gestational adversity are linked to specific transcriptional changes in the prefrontal cortex

Poor-quality maternal diet during pregnancy, and subsequent gestational growth disturbances in the offspring, have been implicated in the etiology of multiple neurodevelopmental disorders, including ADHD, schizophrenia, and autism. These disorders are characterized, in part, by abnormalities in responses to reward and errors of executive function. Here, we demonstrate dissociable deficits in reward processing and executive function in male and female mice, solely due to maternal malnutrition via high-fat or low-protein diets. Gestational exposure to a high-fat diet delayed acquisition of a fixed ratio response, and decreased motivation as assessed by progressive ratio. In contrast, offspring of a low-protein diet displayed no deficits in operant learning, but were more prone to assign salience to a cue that predicts reward (sign-tracking) in a Pavlovian-conditioned approach task. In the 5-choice serial reaction time task (5-CSRTT), gestational exposure to a high-fat diet promoted impulsivity, whereas exposure to a low-protein diet led to marked inattention. These dissociable executive function deficits are known to be mediated by the medial prefrontal cortex (PFC), which displays markers of epigenetic dysregulation in neurodevelopmental disorders. Following behavioral characterization, we assayed PFC gene expression using a targeted PCR array and found that both maternal diets increased overall transcription in PFC. Cluster analysis of the relationships between individual transcripts and behavioral outcomes revealed a cluster of primarily epigenetic modulators, whose overexpression was linked to executive function deficits. The overexpression of four genes, DNA methyltransferase 1 (DNMT1), δ-opioid receptor (OPRD1), cannabinoid receptor 1 (CNR1), and catechol-o-methyltransferase (COMT), was strongly associated with overall poor performance. All 5-CSRTT deficits were associated with DNMT1 upregulation, whereas impulsive behavior could be dissociated from inattention by overexpression of OPRD1 or COMT, respectively, as well as a distinct cluster of epigenetic regulators. These data provide molecular support for dissociable domains of executive function.

Optogenetic studies of nicotinic contributions to cholinergic signaling in the central nervous system

Molecular manipulations and targeted pharmacological studies provide a compelling picture of which nicotinic receptor subtypes are where in the central nervous system (CNS) and what happens if one activates or deletes them. However, understanding the physiological contribution of nicotinic receptors to endogenous acetylcholine (ACh) signaling in the CNS has proven a more difficult problem to solve. In this review, we provide a synopsis of the literature on the use of optogenetic approaches to control the excitability of cholinergic neurons and to examine the role of CNS nicotinic ACh receptors (nAChRs). As is often the case, this relatively new technology has answered some questions and raised others. Overall, we believe that optogenetic manipulation of cholinergic excitability in combination with some rigorous pharmacology will ultimately advance our understanding of the many functions of nAChRs in the brain.

Chronic cocaine disrupts mesocortical learning mechanisms

The addictive power of drugs of abuse such as cocaine comes from their ability to hijack natural reward and plasticity mechanisms mediated by dopamine signaling in the brain. Reward learning involves burst firing of midbrain dopamine neurons in response to rewards and cues predictive of reward. The resulting release of dopamine in terminal regions is thought to act as a teaching signaling to areas such as the prefrontal cortex and striatum. In this review, we posit that a pool of extrasynaptic dopaminergic D1-like receptors activated in response to dopamine neuron burst firing serve to enable synaptic plasticity in the prefrontal cortex in response to rewards and their cues. We propose that disruptions in these mechanisms following chronic cocaine use contribute to addiction pathology, in part due to the unique architecture of the mesocortical pathway. By blocking dopamine reuptake in the cortex, cocaine elevates dopamine signaling at these extrasynaptic receptors, prolonging D1-receptor activation and the subsequent activation of intracellular signaling cascades, and thus inducing long-lasting maladaptive plasticity. These cellular adaptations may account for many of the changes in cortical function observed in drug addicts, including an enduring vulnerability to relapse. Therefore, understanding and targeting these neuroadaptations may provide cognitive benefits and help prevent relapse in human drug addicts.

High locomotor reactivity to novelty is associated with an increased propensity to choose saccharin over cocaine: new insights into the vulnerability to addiction

Drug addiction is associated with a relative devaluation of natural or socially-valued reinforcers that are unable to divert addicts from seeking and consuming the drug. Before protracted drug exposure, most rats prefer natural rewards, such as saccharin, over cocaine. However, a subpopulation of animals prefer cocaine over natural rewards and are thought to be vulnerable to addiction. Specific behavioral traits have been associated with different dimensions of drug addiction. For example, anxiety predicts loss of control over drug intake whereas sensation seeking and sign-tracking are markers of a greater sensitivity to the rewarding properties of the drug. However, how these behavioral traits predict the disinterest for natural reinforcers remains unknown. In a population of rats, we identified sensation seekers (HR) on the basis of elevated novelty-induced locomotor reactivity, high anxious rats (HA) based on the propensity to avoid open arms in an elevated-plus maze and sign-trackers (ST) that are prone to approach, and interaction with, reward-associated stimuli. Rats were then tested on their preference for saccharin over cocaine in a discrete-trial choice procedure. We show that HR rats display a greater preference for saccharin over cocaine compared with ST and HA whereas the motivation for the drug was comparable between the three groups. The present data suggest that high locomotor reactivity to novelty, or sensation seeking, by predisposing to an increased choice toward non-drug rewards at early stages of drug use history, may prevent the establishment of chronic cocaine use.

Interpreting chemical neurotransmission in vivo: techniques, time scales, and theories

Monitoring neurotransmitter levels is a major research strategy for determining the functions of neuronal systems, specifically the ascending neuromodulator systems. In this Viewpoint, we consider the impact of different methods for recording extracellular neurotransmitter levels in vivo on theories concerning the signaling mode(s) and functions of these neuronal systems. As exemplified by evidence from experiments using different methods to measure acetylcholine (ACh) signaling, both neuromodulatory and deterministic functions have been attributed to cholinergic activity. Technical and experimental advances now allow determination of the validity of such dual-signaling theories.

Behavioral-Cognitive Targets for Cholinergic Enhancement

Cholinergic mechanisms have long been considered a promising target for enhancing cognitive functions. Two distinct yet interacting components of cholinergic activity have been proposed to mediate specific cognitive functions. Transient spikes in cholinergic activity mediate the detection of cues in situations involving attentional mode shifts. More slowly changing cholinergic neuromodulation of cortical circuitry regulates task compliance specifically in response to performance challenges. Increases in cholinergic neuromodulation enhances the generation of cholinergic transients via stimulation of α4β2* nicotinic acetylcholine receptors. Stimulation of these receptors stabilizes attentional performance and increases cue detection rates. Adjunctive treatment with agonists or modulators at these receptors is predicted to benefit unstable attentional performance and low cue detection rates that are common to several brain disorders.

Attention and the Cholinergic System: Relevance to Schizophrenia

Traditional methods of drug discovery often rely on a unidirectional, "bottom-up" approach: A search for molecular compounds that target a particular neurobiological substrate (e.g., a receptor type), the refinement of those compounds, testing in animal models using high-throughput behavioral screening methods, and then human testing for safety and effectiveness. Many attempts have found the "effectiveness" criterion to be a major stumbling block, and we and others have suggested that success may be improved by an alternative approach that considers the neural circuits mediating the effects of genetic and molecular manipulations on behavior and cognition. We describe our efforts to understand the cholinergic system's role in attention using parallel approaches to test main hypotheses in both rodents and humans as well as generating converging evidence using methods and levels of analysis tailored to each species. The close back-and-forth between these methods has enhanced our understanding of the cholinergic system's role in attention both "bottom-up" and "top-down"-that is, the basic neuroscience identifies potential neuronal circuit-based mechanisms of clinical symptoms, and the patient and genetic populations serve as natural experiments to test and refine hypotheses about its contribution to specific processes. Together, these studies have identified (at least) two major and potentially independent contributions of the cholinergic system to attention: a neuromodulatory component that influences cognitive control in response to challenges from distractors that either make detection more difficult or draw attention away from the distractor, and a phasic or transient cholinergic signal that instigates a shift from ongoing behavior and the activation of cue-associated response. Right prefrontal cortex appears to play a particularly important role in the neuromodulatory component integrating motivational and cognitive influences for top-down control across populations, whereas the transient cholinergic signal involves orbitofrontal regions associated with shifts between internal and external attention. Understanding how these two modes of cholinergic function interact and are perturbed in schizophrenia will be an important prerequisite for developing effective treatments.

Nicotinic receptors and attention

Facilitation of different attentional functions by nicotinic acetylcholine receptor (nAChR) agonists may be of therapeutic potential in disease conditions such as Alzheimer's disease or schizophrenia. For this reason, the neuronal mechanisms underlying these effects have been the focus of research in humans and in preclinical models. Attention-enhancing effects of the nonselective nAChR agonist nicotine can be observed in human nonsmokers and in laboratory animals, suggesting that benefits go beyond a reversal of withdrawal deficits in smokers. The ultimate aim is to develop compounds acting with greater selectivity than nicotine at a subset of nAChRs, with an effects profile narrowly matching the targeted cognitive deficits and minimizing unwanted effects. To date, compounds tested clinically target the nAChR subtypes most abundant in the brain. To help pinpoint more selectively expressed subtypes critical for attention, studies have aimed at identifying the secondary neurotransmitter systems whose stimulation mediates the attention-enhancing properties of nicotine. Evidence indicates that noradrenaline and glutamate, but not dopamine release, are critical mediators. Thus, attention-enhancing nAChR agents could spare the system central to nicotine dependence. Neuroimaging studies suggest that nAChR agonists act on a variety of brain systems by enhancing activation, reducing activation, and enhancing deactivation by attention tasks. This supports the notion that effects on different attentional functions may be mediated by distinct central mechanisms, consistent with the fact that nAChRs interact with a multitude of brain sites and neurotransmitter systems. The challenge will be to achieve the optimal tone at the right subset of nAChR subtypes to modulate specific attentional functions, employing not just direct agonist properties, but also positive allosteric modulation and low-dose antagonism.

A critical review of the literature on attentional bias in cocaine use disorder and suggestions for future research

Cocaine use disorder (CUD) continues to be an important public health problem, and novel approaches are needed to improve the effectiveness of treatments for CUD. Recently, there has been increased interest in the role of automatic cognition such as attentional bias (AB) in addictive behaviors, and AB has been proposed to be a cognitive marker for addictions. Automatic cognition may be particularly relevant to CUD, as there is evidence for particularly robust AB to cocaine cues and strong relationships to craving for cocaine and other illicit drugs. Further, the wide-ranging cognitive deficits (e.g., in response inhibition and working memory) evinced by many cocaine users enhance the potential importance of interventions targeting automatic cognition in this population. In the current article, we discuss relevant addiction theories, followed by a review of studies that examined AB in CUD. We then consider the neural substrates of AB, including human neuroimaging, neurobiological, and pharmacological studies. We conclude with a discussion of research gaps and future directions for AB in CUD.

A cocaine context renews drug seeking preferentially in a subset of individuals

Addiction is characterized by a high propensity for relapse, in part because cues associated with drugs can acquire Pavlovian incentive motivational properties, and acting as incentive stimuli, such cues can instigate and invigorate drug-seeking behavior. There is, however, considerable individual variation in the propensity to attribute incentive salience to reward cues. Discrete and localizable reward cues act as much more effective incentive stimuli in some rats ('sign-trackers', STs), than others ('goal-trackers', GTs). We asked whether similar individual variation exists for contextual cues associated with cocaine. Cocaine context conditioned motivation was quantified in two ways: (1) the ability of a cocaine context to evoke conditioned hyperactivity and (2) the ability of a context in which cocaine was previously self-administered to renew cocaine-seeking behavior. Finally, we assessed the effects of intra-accumbens core flupenthixol, a nonselective dopamine receptor antagonist, on context renewal. In contrast to studies using discrete cues, a cocaine context spurred greater conditioned hyperactivity, and more robustly renewed extinguished cocaine seeking in GTs than STs. In addition, cocaine context renewal was blocked by antagonism of dopamine receptors in the accumbens core. Thus, contextual cues associated with cocaine preferentially acquire motivational control over behavior in different individuals than do discrete cues, and in these individuals the ability of a cocaine context to create conditioned motivation for cocaine requires dopamine in the core of the nucleus accumbens. We speculate that different individuals may be preferentially sensitive to different 'triggers' of relapse.

Impulsivity, risk-taking, and distractibility in rats exhibiting robust conditioned orienting behaviors

When a neutral cue is followed by a significant event such as food delivery, some animals become engaged with the cue itself and acquire cue-directed behaviors. One type of cue-directed behavior is observed following insertion of a lever used as a conditioned stimulus (CS). Rats showing robust approach behavior to the lever also display impulsivity and altered attention, as compared to rats showing behavior directed toward the reward delivery location. The current study used a light CS to categorize rats' propensity for cue-directed behavior, and assessed whether individual differences in impulsivity and related behaviors still emerged. During the light-food pairings, some rats displayed enhanced rearing or orienting to the light (Orienters) prior to showing food cup approach behavior, while other rats only showed food cup approach behavior (Nonorienters). Our results showed that Orienters made more impulsive and risky decisions in two different choice tasks, and were quicker to leave a familiar dark environment to enter a novel bright field. Orienters also showed less accurate target detection when a visual distractor was introduced during an attentional challenge. Our current study suggests that light CS-induced rearing/orienting behavior might not necessarily share an identical mechanism with lever CS-approach behavior in predicting impulsivity-related behaviors.

Acetylcholine functionally reorganizes neocortical microcircuits

Sensory information is processed and transmitted through the synaptic structure of local cortical circuits, but it is unclear how modulation of this architecture influences the cortical representation of sensory stimuli. Acetylcholine (ACh) promotes attention and arousal and is thought to increase the signal-to-noise ratio of sensory input in primary sensory cortices. Using high-speed two-photon calcium imaging in a thalamocortical somatosensory slice preparation, we recorded action potential activity of up to 900 neurons simultaneously and compared local cortical circuit activations with and without bath presence of ACh. We found that ACh reduced weak pairwise relationships and excluded neurons that were already unreliable during circuit activity. Using action potential activity from the imaged population, we generated functional wiring diagrams based on the statistical dependencies of activity between neurons. ACh pruned weak functional connections from spontaneous circuit activations and yielded a more modular and hierarchical circuit structure, which biased activity to flow in a more feedforward fashion. Neurons that were active in response to thalamic input had reduced pairwise dependencies overall, but strong correlations were conserved. This coincided with a prolonged period during which neurons showed temporally precise responses to thalamic input. Our results demonstrate that ACh reorganizes functional circuit structure in a manner that may enhance the integration and discriminability of thalamic afferent input within local neocortical circuitry.

Nicotine self-administration induces CB1-dependent LTP in the bed nucleus of the stria terminalis

Nicotine addiction is characterized by repetitive drug taking and drug seeking, both tightly controlled by cannabinoid CB1 receptors. The responsiveness of neurons of the bed nucleus of the stria terminalis (BNST) to infralimbic cortex (ILCx) excitatory inputs is increased in rats with active, but not passive, nicotine taking. Therefore, we hypothesize that acquisition of the learned association between nicotine infusion and a paired cue light permits the strengthening of the ILCx-BNST synapses after ILCx tetanic stimulation. We exposed rats to intravenous nicotine self-administration for 2 months. Using a combination of in vivo protocols (electrical stimulations, extracellular recordings, and pharmacological manipulations), we characterized the effects of 10 Hz stimulation of the ILCx on BNST excitatory responses, under different conditions of exposure to nicotine. In addition, we tested whether the effects of the stimulation were CB1 receptor-dependent. The results show that nicotine self-administration supports the induction of evoked spike potentiation in the BNST in response to 10 Hz stimulation of ILCx afferents. Although not altered by nicotine abstinence, this cellular adaptation was blocked by CB1 receptor antagonism. Moreover, blockade of BNST CB1 receptors prevented increases in time-out responding subsequent to ILCx stimulation and decreased cue-induced reinstatement. Thus, the synaptic potentiation within the BNST in response to ILCx stimulation seems to contribute to the cue-elicited responding associated with nicotine self-administration and is tightly controlled by CB1 receptors.

Where attention falls: Increased risk of falls from the converging impact of cortical cholinergic and midbrain dopamine loss on striatal function

Falls are a major source of hospitalization, long-term institutionalization, and death in older adults and patients with Parkinson's disease (PD). Limited attentional resources are a major risk factor for falls. In this review, we specify cognitive-behavioral mechanisms that produce falls and map these mechanisms onto a model of multi-system degeneration. Results from PET studies in PD fallers and findings from a recently developed animal model support the hypothesis that falls result from interactions between loss of basal forebrain cholinergic projections to the cortex and striatal dopamine loss. Striatal dopamine loss produces inefficient, low-vigor gait, posture control, and movement. Cortical cholinergic deafferentation impairs a wide range of attentional processes, including monitoring of gait, posture and complex movements. Cholinergic cell loss reveals the full impact of striatal dopamine loss on motor performance, reflecting loss of compensatory attentional supervision of movement. Dysregulation of dorsomedial striatal circuitry is an essential, albeit not exclusive, mediator of falls in this dual-system model. Because cholinergic neuromodulatory activity influences cortical circuitry primarily via stimulation of α4β2* nicotinic acetylcholine receptors, and because agonists at these receptors are known to benefit attentional processes in animals and humans, treating PD fallers with such agonists, as an adjunct to dopaminergic treatment, is predicted to reduce falls. Falls are an informative behavioral endpoint to study attentional-motor integration by striatal circuitry.

Resting state functional connectivity of the basal nucleus of Meynert in humans: in comparison to the ventral striatum and the effects of age

The basal nucleus of Meynert (BNM) provides the primary cholinergic inputs to the cerebral cortex. Loss of neurons in the BNM is linked to cognitive deficits in Alzheimer's disease and other degenerative conditions. Numerous animal studies described cholinergic and non-cholinergic neuronal responses in the BNM; however, work in humans has been hampered by the difficulty of defining the BNM anatomically. Here, on the basis of a previous study that delineated the BNM of post-mortem human brains in a standard stereotaxic space, we sought to examine functional connectivity of the BNM, as compared to the nucleus accumbens (or ventral striatum, VS), in a large resting state functional magnetic resonance imaging data set. The BNM and VS shared but also showed a distinct pattern of cortical and subcortical connectivity. Compared to the VS, the BNM showed stronger positive connectivity with the putamen, pallidum, thalamus, amygdala and midbrain, as well as the anterior cingulate cortex, supplementary motor area and pre-supplementary motor area, a network of brain regions that respond to salient stimuli and orchestrate motor behavior. In contrast, compared to the BNM, the VS showed stronger positive connectivity with the ventral caudate and medial orbitofrontal cortex, areas implicated in reward processing and motivated behavior. Furthermore, the BNM and VS each showed extensive negative connectivity with visual and lateral prefrontal cortices. Together, the distinct cerebral functional connectivities support the role of the BNM in arousal, saliency responses and cognitive motor control and the VS in reward related behavior. Considering the importance of BNM in age-related cognitive decline, we explored the effects of age on BNM and VS connectivities. BNM connectivity to the visual and somatomotor cortices decreases while connectivity to subcortical structures including the midbrain, thalamus, and pallidum increases with age. These findings of age-related changes of cerebral functional connectivity of the BNM may facilitate research of the neural bases of cognitive decline in health and illness.

A potential role for the paraventricular nucleus of the thalamus in mediating individual variation in Pavlovian conditioned responses

There is ample evidence to suggest that the paraventricular nucleus of the thalamus (PVT) mediates cue-reward learning, especially as it relates to drug-seeking behavior. However, its exact role in these complex processes remains unknown. Here we will present and discuss data from our own laboratory which suggests that the PVT plays a role in multiple forms of stimulus-reward learning, and does so via distinct neurobiological systems. Using an animal model that captures individual variation in response to reward-associated cues, we are able to parse the incentive from the predictive properties of reward cues and to elucidate the neural circuitry underlying these different forms of cue-reward learning. When rats are exposed to a classical Pavlovian conditioning paradigm, wherein a cue predicts food reward, some rats, termed sign-trackers, approach and manipulate the cue upon its presentation. This behavior is indicative of attributing incentive salience to the cue. That is, the cue gains excessive control over behavior for sign-trackers. In contrast, other rats, termed goal-trackers, treat the cue as a mere predictor, and upon its presentation go to the location of reward delivery. Based on our own data utilizing this model, we hypothesize that the PVT represents a common node, but differentially regulates the sign- vs. goal-tracking response. We postulate that the PVT regulates sign-tracking behavior, or the attribution of incentive salience, via subcortical, dopamine-dependent mechanisms. In contrast, we propose that goal-tracking behavior, or the attribution of predictive value, is the product of “top-down” glutamatergic processing between the prelimbic cortex (PrL) and the PVT. Together, data from our laboratory and others support a role for the PVT in cue-motivated behaviors and suggest that it may be an important locus within the neural circuitry that goes awry in addiction and related disorders.

Deterministic functions of cortical acetylcholine

Traditional descriptions of the basal forebrain cholinergic projection system to the cortex have focused on neuromodulatory influences, that is, mechanisms that modulate cortical information processing but are not necessary for mediating discrete behavioral responses and cognitive operations. This review summarises and conceptualises the evidence in support of more deterministic contributions of cholinergic projections to cortical information processing. Through presynaptic receptors expressed on cholinergic terminals, thalamocortical and corticocortical projections can evoke brief cholinergic release events. These acetylcholine (ACh) release events occur on a fast, sub-second to seconds-long time scale ('transients'). In rats performing a task requiring the detection of cues as well as the report of non-cue events cholinergic transients mediate the detection of cues specifically in trials that involve a shift from a state of monitoring for cues to cue-directed responding. Accordingly, ill-timed cholinergic transients, generated using optogenetic methods, force false detections in trials without cues. We propose that the evidence is consistent with the hypothesis that cholinergic transients reduce detection uncertainty in such trials. Furthermore, the evidence on the functions of the neuromodulatory component of cholinergic neurotransmission suggests that higher levels of neuromodulation favor staying-on-task over alternative action. In other terms, higher cholinergic neuromodulation reduces opportunity costs. Evidence indicating a similar integration of other ascending projection systems, including noradrenergic and serotonergic systems, into cortical circuitry remains sparse, largely because of the limited information about local presynaptic regulation and the limitations of current techniques in measuring fast and transient neurotransmitter release events in these systems.

The effects of clinically relevant doses of amphetamine and methylphenidate on signal detection and DRL in rats

Low dose amphetamine (AMPH) and methylphenidate (MPH, Ritalin(®)) are the most widely prescribed and most effective pharmacotherapy for attention-deficit/hyperactivity disorder (ADHD). Certain low, clinically relevant doses of MPH improve sustained attention and working memory in normal rats, in contrast to higher doses that impair cognitive ability and induce locomotor activity. However, the effects of AMPH of MPH on sustained attention and behavioral inhibition remain poorly characterized. The present experiments examined the actions of AMPH (0.1 and 0.25 mg/kg) and MPH (0.5 and 1.0 mg/kg) in a rat model of 1) sustained attention, where signal and blank trials were interspersed randomly and occurred at unpredictable times, and 2) behavioral inhibition, using a differential reinforcement of low rate (DRL) schedule. In a signal detection paradigm, both 0.5 mg/kg and 1.0 mg/kg MPH and 0.25 mg/kg AMPH improve sustained attention, however neither AMPH nor MPH improve behavioral inhibition on DRL. Taken together with other recent studies, it appears that clinically-relevant doses of AMPH and MPH may preferentially improve attention-related behavior while having little effect on behavioral inhibition. These observations provide additional insight into the basic behavioral actions of low-dose psychostimulants and further suggest that the use of sustained attention tasks may be important in the development of novel pharmacological treatments for ADHD.