Phasic activation of individual neurons in the locus ceruleus/subceruleus complex of monkeys reflects rewarded decisions to go but not stop

Toward a computational role for locus coeruleus/norepinephrine arousal systems

Brain and behavior undergo measurable changes in their underlying state and neuromodulators are thought to contribute to these fluctuations. Why do we undergo such changes, and what function could the underlying neuromodulatory systems perform? Here we examine theoretical answers to these questions with respect to the locus coeruleus/norepinephrine system focusing on peripheral markers for arousal, such as pupil diameter, that are thought to provide a window into brain wide noradrenergic signaling. We explore a computational role for arousal systems in facilitating internal state transitions that facilitate credit assignment and promote accurate perceptions in non-stationary environments. We summarize recent work that supports this idea and highlight open questions as well as alternative views of how arousal affects cognition.

Locus coeruleus norepinephrine contributes to visual-spatial attention by selectively enhancing perceptual sensitivity

Selectively focusing on a behaviorally relevant stimulus while ignoring irrelevant stimuli improves perception. Enhanced neuronal response gain is thought to support attention-related improvements in detection and discrimination. However, understanding of the neuronal pathways regulating perceptual sensitivity remains limited. Here, we report that responses of norepinephrine (NE) neurons in the locus coeruleus (LC) of non-human primates to behaviorally relevant sensory stimuli promote visual discrimination in a spatially selective way. LC-NE neurons spike in response to a visual stimulus appearing in the contralateral hemifield only when that stimulus is attended. This spiking is associated with enhanced behavioral sensitivity, is independent of motor control, and is absent on error trials. Furthermore, optogenetically activating LC-NE neurons selectively improves monkeys' contralateral stimulus detection without affecting motor criteria, supporting NE's causal role in granular cognitive control of selective attention at a cellular level, beyond its known diffuse and non-selective functions.

Juxtacellular recordings from identified neurons in the mouse locus coeruleus

The locus coeruleus (LC) is the primary source of noradrenergic transmission in the mammalian central nervous system. This small pontine nucleus consists of a densely packed nuclear core-which contains the highest density of noradrenergic neurons-embedded within a heterogeneous surround of non-noradrenergic cells. This local heterogeneity, together with the small size of the LC, has made it particularly difficult to infer noradrenergic cell identity based on extracellular sampling of in vivo spiking activity. Moreover, the relatively high cell density, background activity and synchronicity of LC neurons have made spike identification and unit isolation notoriously challenging. In this study, we aimed at bridging these gaps by performing juxtacellular recordings from single identified neurons within the mouse LC complex. We found that noradrenergic neurons (identified by tyrosine hydroxylase, TH, expression; TH-positive) and intermingled putatively non-noradrenergic (TH-negative) cells displayed similar morphologies and responded to foot shock stimuli with excitatory responses; however, on average, TH-positive neurons exhibited more prominent foot shock responses and post-activation firing suppression. The two cell classes also displayed different spontaneous firing rates, spike waveforms and temporal spiking properties. A logistic regression classifier trained on spontaneous electrophysiological features could separate the two cell classes with 76% accuracy. Altogether, our results reveal in vivo electrophysiological correlates of TH-positive neurons, which can be useful for refining current approaches for the classification of LC unit activity.

Phase synchrony between prefrontal noradrenergic and cholinergic signals indexes inhibitory control

Inhibitory control is a critical executive function that allows animals to suppress their impulsive behavior in order to achieve certain goals or avoid punishment. We investigated norepinephrine (NE) and acetylcholine (ACh) dynamics and population neuronal activity in the prefrontal cortex during inhibitory control. Using fluorescent sensors to measure extracellular levels of NE and ACh, we simultaneously recorded the dynamics of prefrontal NE and ACh in mice performing an inhibitory control task. The prefrontal NE and ACh signals exhibited strong coherence at 0.4-0.8 Hz. Chemogenetic inhibition of locus coeruleus (LC) neurons that project to the basal forebrain region reduced inhibitory control performance to chance levels. However, this manipulation did not diminish the difference in NE/ACh signals between successful and failed trials; instead, it abolished the difference in NE-ACh phase synchrony between the successful and failed trials, indicating that NE-ACh phase synchrony is a task-relevant neuromodulatory feature. Chemogenetic inhibition of cholinergic neurons that project to the LC region did not impair the inhibitory control performance, nor did it abolish the difference in NE-ACh phase synchrony between successful or failed trials, further confirming the relevance of NE-ACh phase synchrony to inhibitory control. To understand the possible effect of NE-ACh synchrony on prefrontal population activity, we employed Neuropixels to record from the prefrontal cortex with and without inhibiting LC neurons that project to the basal forebrain during inhibitory control. The LC inhibition reduced the number of prefrontal neurons encoding inhibitory control. Demixed principal component analysis (dPCA) further revealed that population firing patterns representing inhibitory control were impaired by the LC inhibition. Disparities in NE-ACh phase synchrony relevant to inhibitory control occurred only in the prefrontal cortex, but not in the parietal cortex, somatosensory cortex, and the somatosensory thalamus. Taken together, these findings suggest that the LC modulates inhibitory control through its collective effect with cholinergic systems on population activity in the prefrontal cortex. Our results further revealed that NE-ACh phase synchrony is a critical neuromodulatory feature with important implications for cognitive control.

Eye movements reveal age differences in how arousal modulates saliency priority but not attention processing speed

The arousal-biased competition theory posits that inducing arousal increases attentional priority of salient stimuli while reducing priority of non-pertinent stimuli. However, unlike in young adults, older adults rarely exhibit shifts in priority under increased arousal, and prior studies have proposed different neural mechanisms to explain how arousal differentially modulates selective attention in older adults. Therefore, we investigated how the threat of unpredictable shock differentially modulates attentional control mechanisms in young and older adults by observing eye movements. Participants completed two oculomotor search tasks in which the salient distractor was typically captured by attention (singleton search) or proactively suppressed (feature search). We found that arousal did not modulate attentional priority for any stimulus among older adults nor affect the speed of attention processing in either age group. Furthermore, we observed that arousal modulated pupil sizes and found a correlation between evoked pupil responses and oculomotor function. Our findings suggest age differences in how the locus coeruleus-noradrenaline system interacts with neural networks of attention and oculomotor function.

The effect of target detection task on memory encoding varies in different stimulus onset asynchronies

The attentional boost effect (ABE) and action-induced memory enhancement (AIME) suggest that memory performance for target-paired items is superior to that for distractor-paired items when participants performed a target detection task and a memory encoding task simultaneously. Though the memory enhancement has been well established, the temporal dynamics of how the target detection task influenced memory encoding remains unclear. To investigate this, we manipulated the stimulus onset asynchrony (SOA) between detection stimuli and the words to be memorized using a remember/know study-test paradigm, and we focused primarily on memory performance for the words that appeared after the detection response. The results showed that target-paired memory enhancement was robust from SOA = 0 s to SOA = 0.75 s, but was not significant when examined by itself in Experiment 1A or weakened in Experiment 2 and the conjoint analysis when SOA = 1 s, which were only observed in R responses. The post-response memory enhancement still existed when there was no temporal overlap between the word and target, similar to the magnitude of memory enhancement observed with temporal overlap. These results supported the view that target-paired memory enhancement (recollection rather than familiarity) occurred irrespective of whether the items appeared simultaneously with the targets or within a short period after the response, and the temporal overlap of the word and target was not necessary for post-response memory enhancement.

The locus coeruleus as a global model failure system

Predictive processing models posit that brains constantly attempt to predict their sensory inputs. Prediction errors signal when these predictions are incorrect and are thought to be instructive signals that drive corrective plasticity. Recent findings support the idea that the locus coeruleus (LC) - a brain-wide neuromodulatory system - signals several types of prediction error. I discuss how these findings support models proposing that the LC signals global model failures: instances where predictions about the world are strongly violated. Focusing on the cortex, I explore the utility of this signal in learning rate control, how the LC circuit may compute the signal, and how this view may aid our understanding of neurodivergence.

Atomoxetine and reward size equally improve task engagement and perceptual decisions but differently affect movement execution

Our ability to engage and perform daily activities relies on balancing the associated benefits and costs. Rewards, as benefits, act as powerful motivators that help us stay focused for longer durations. The noradrenergic (NA) system is thought to play a significant role in optimizing our performance. Yet, the interplay between reward and the NA system in shaping performance remains unclear, particularly when actions are driven by external incentives (reward). To explore this interaction, we tested four female rhesus monkeys performing a sustained Go/NoGo task under two reward sizes (low/high) and three pharmacological conditions (saline and two doses of atomoxetine, a NA reuptake inhibitor: ATX-0.5 mg/kg and ATX-1 mg/kg). We found that increasing either reward or NA levels equally enhanced the animal's engagement in the task compared to low reward saline; the animals also responded faster and more consistently under these circumstances. Notably, we identified differences between reward size and ATX. When combined with ATX, high reward further reduced the occurrence of false alarms (i.e., incorrect go trials on distractors), implying that it helped further suppress impulsive responses. In addition, ATX (but not reward size) consistently increased movement duration dose-dependently, while high reward did not affect movement duration but decreased its variability. We conclude that noradrenaline and reward modulate performance, but their effects are not identical, suggesting differential underlying mechanisms. Reward might energize/invigorate decisions and action, while ATX might help regulate energy expenditure, depending on the context, through the NA system.

Age-dependent dysregulation of locus coeruleus firing in a transgenic rat model of Alzheimer's disease

Hyperphosphorylated tau in the locus coeruleus (LC) is ubiquitous in prodromal Alzheimer's disease (AD), and LC neurons degenerate as AD progresses. Hyperphosphorylated tau alters firing rates in other brain regions, but its effects on LC neurons are unknown. We assessed single unit LC activity in anesthetized wild-type (WT) and TgF344-AD rats at 6 months, which represents a prodromal stage when LC neurons are the only cells containing hyperphosphorylated tau in TgF344-AD animals, and at 15 months when amyloid-β (Aβ) and tau pathology are both abundant in the forebrain. At baseline, LC neurons from TgF344-AD rats were hypoactive at both ages compared to WT littermates but showed elevated spontaneous bursting properties. Differences in footshock-evoked LC firing depended on age, with 6-month TgF344-AD rats demonstrating aspects of hyperactivity, and 15-month transgenic rats showing hypoactivity. Early LC hyperactivity is consistent with appearance of prodromal neuropsychiatric symptoms and is followed by LC hypoactivity which contributes to cognitive impairment. These results support further investigation into disease stage-dependent noradrenergic interventions for AD.

Whole-brain afferent input mapping to functionally distinct brainstem noradrenaline cell types

The locus coeruleus (LC) is a small region in the pons and the main source of noradrenaline (NA) to the forebrain. While traditional models suggested that all LC-NA neurons project indiscriminately throughout the brain, accumulating evidence indicates that these cells can be heterogeneous based on their anatomical connectivity and behavioral functionality and exhibit distinct coding modes. How LC-NA neuronal subpopulations are endowed with unique functional properties is unclear. Here, we used a viral-genetic approach for mapping anatomical connectivity at different levels of organization based on inputs and outputs of defined cell classes. Specifically, we studied the whole-brain afferent inputs onto two functionally distinct LC-NA neuronal subpopulations which project to amygdala or medial prefrontal cortex (mPFC). We found that the global input distribution is similar for both LC-NA neuronal subpopulations. However, finer analysis demonstrated important differences in inputs from specific brain regions. Moreover, sex related differences were apparent, but only in inputs to amygdala-projecting LC-NA neurons. These findings reveal a cell type and sex specific afferent input organization which could allow for context dependent and target specific control of NA outflow to forebrain structures involved in emotional control and decision making.

Pupil Dilation During Encoding, But Not Type of Auditory Stimulation, Predicts Recognition Success in Face Memory

We encounter and process information from multiple sensory modalities in our daily lives, and research suggests that learning can be more efficient when contexts are multisensory. In this study, we were interested in whether face identity recognition memory might be improved in multisensory learning conditions, and to explore associated changes in pupil dilation during encoding and recognition. In two studies participants completed old/new face recognition tasks wherein visual face stimuli were presented in the context of sounds. Faces were learnt alongside no sound, low arousal sounds (Experiment 1), high arousal non-face relevant, or high arousal face relevant (Experiment 2) sounds. We predicted that the presence of sounds during encoding would improve later recognition accuracy, however, the results did not support this with no effect of sound condition on memory. Pupil dilation, however, was found to predict later successful recognition both at encoding and during recognition. While these results do not provide support to the notion that face learning is improved under multisensory conditions relative to unisensory conditions, they do suggest that pupillometry may be a useful tool to further explore face identity learning and recognition.

Voluntary self-initiation of the stimuli onset improves working memory and accelerates visual and attentional processing

The ability of an organism to voluntarily control the stimuli onset modulates perceptual and attentional functions. Since stimulus encoding is an essential component of working memory (WM), we conjectured that controlling the initiation of the perceptual process would positively modulate WM. To corroborate this proposition, we tested twenty-five healthy subjects in a modified-Sternberg WM task under three stimuli presentation conditions: an automatic presentation of the stimuli, a self-initiated presentation of the stimuli (through a button press), and a self-initiated presentation with random-delay stimuli onset. Concurrently, we recorded the subjects' electroencephalographic signals during WM encoding. We found that the self-initiated condition was associated with better WM accuracy, and earlier latencies of N1, P2 and P3 evoked potential components representing visual, attentional and mental review of the stimuli processes, respectively. Our work demonstrates that self-initiated stimuli enhance WM performance and accelerate early visual and attentional processes deployed during WM encoding. We also found that self-initiated stimuli correlate with an increased attentional state compared to the other two conditions, suggesting a role for temporal stimuli predictability. Our study remarks on the relevance of self-control of the stimuli onset in sensory, attentional and memory updating processing for WM.

Rule-based and stimulus-based cues bias auditory decisions via different computational and physiological mechanisms

Expectations, such as those arising from either learned rules or recent stimulus regularities, can bias subsequent auditory perception in diverse ways. However, it is not well understood if and how these diverse effects depend on the source of the expectations. Further, it is unknown whether different sources of bias use the same or different computational and physiological mechanisms. We examined how rule-based and stimulus-based expectations influenced behavior and pupil-linked arousal, a marker of certain forms of expectation-based processing, of human subjects performing an auditory frequency-discrimination task. Rule-based cues consistently biased choices and response times (RTs) toward the more-probable stimulus. In contrast, stimulus-based cues had a complex combination of effects, including choice and RT biases toward and away from the frequency of recently presented stimuli. These different behavioral patterns also had: 1) distinct computational signatures, including different modulations of key components of a novel form of a drift-diffusion decision model and 2) distinct physiological signatures, including substantial bias-dependent modulations of pupil size in response to rule-based but not stimulus-based cues. These results imply that different sources of expectations can modulate auditory processing via distinct mechanisms: one that uses arousal-linked, rule-based information and another that uses arousal-independent, stimulus-based information to bias the speed and accuracy of auditory perceptual decisions.

Prior information about upcoming stimuli can bias our perception of those stimuli. Whether different sources of prior information bias perception in similar or distinct ways is not well understood. We compared the influence of two kinds of prior information on tone-frequency discrimination: rule-based cues, in the form of explicit information about the most-likely identity of the upcoming tone; and stimulus-based cues, in the form of sequences of tones presented before the to-be-discriminated tone. Although both types of prior information biased auditory decision-making, they demonstrated distinct behavioral, computational, and physiological signatures. Our results suggest that the brain processes prior information in a form-specific manner rather than utilizing a general-purpose prior. Such form-specific processing has implications for understanding decision biases real-world contexts, in which prior information comes from many different sources and modalities.

Regulation of cocaine seeking behavior by locus coeruleus noradrenergic activity in the ventral tegmental area is time- and contingency-dependent

Substance use disorder is linked to impairments in the ventral tegmental area (VTA) dopamine (DA) reward system. Noradrenergic (NA) inputs from locus coeruleus (LC) into VTA have been shown to modulate VTA neuronal activity, and are implicated in psychostimulant effects. Phasic LC activity controls time- and context-sensitive processes: decision making, cognitive flexibility, motivation and attention. However, it is not yet known how such temporally-distinct LC activity contributes to cocaine seeking. In a previous study we demonstrated that pharmacological inhibition of NA signaling in VTA specifically attenuates cocaine-seeking. Here, we used virally-delivered opsins to target LC neurons for inhibition or excitation, delivered onto afferents in VTA of male rats seeking cocaine under extinction conditions. Optogenetic stimulation or inhibition was delivered in distinct conditions: upon active lever press, contingently with discreet cues; or non-contingently, i.e., throughout the cocaine seeking session. Non-contingent inhibition of LC noradrenergic terminals in VTA attenuated cocaine seeking under extinction conditions. In contrast, contingent inhibition increased, while contingent stimulation reduced cocaine seeking. These findings were specific for cocaine, but not natural reward (food) seeking. Our results show that NA release in VTA drives behavior depending on timing and contingency between stimuli – context, discreet conditioned cues and reinforcer availability. We show that, depending on those factors, noradrenergic signaling in VTA has opposing roles, either driving CS-induced drug seeking, or contributing to behavioral flexibility and thus extinction.

The eyes reflect an internal cognitive state hidden in the population activity of cortical neurons

Decades of research have shown that global brain states such as arousal can be indexed by measuring the properties of the eyes. The spiking responses of neurons throughout the brain have been associated with the pupil, small fixational saccades, and vigor in eye movements, but it has been difficult to isolate how internal states affect the eyes, and vice versa. While recording from populations of neurons in the visual and prefrontal cortex (PFC), we recently identified a latent dimension of neural activity called "slow drift," which appears to reflect a shift in a global brain state. Here, we asked if slow drift is correlated with the action of the eyes in distinct behavioral tasks. We recorded from visual cortex (V4) while monkeys performed a change detection task, and PFC, while they performed a memory-guided saccade task. In both tasks, slow drift was associated with the size of the pupil and the microsaccade rate, two external indicators of the internal state of the animal. These results show that metrics related to the action of the eyes are associated with a dominant and task-independent mode of neural activity that can be accessed in the population activity of neurons across the cortex.

The Neuromodulatory Role of the Noradrenergic and Cholinergic Systems and Their Interplay in Cognitive Functions: A Focused Review

The noradrenergic and cholinergic modulation of functionally distinct regions of the brain has become one of the primary organizational principles behind understanding the contribution of each system to the diversity of neural computation in the central nervous system. Decades of work has shown that a diverse family of receptors, stratified across different brain regions, and circuit-specific afferent and efferent projections play a critical role in helping such widespread neuromodulatory systems obtain substantial heterogeneity in neural information processing. This review briefly discusses the anatomical layout of both the noradrenergic and cholinergic systems, as well as the types and distributions of relevant receptors for each system. Previous work characterizing the direct and indirect interaction between these two systems is discussed, especially in the context of higher order cognitive functions such as attention, learning, and the decision-making process. Though a substantial amount of work has been done to characterize the role of each neuromodulator, a cohesive understanding of the region-specific cooperation of these two systems is not yet fully realized. For the field to progress, new experiments will need to be conducted that capitalize on the modular subdivisions of the brain and systematically explore the role of norepinephrine and acetylcholine in each of these subunits and across the full range of receptors expressed in different cell types in these regions.

Spatiotemporal dynamics of noradrenaline during learned behaviour

Noradrenaline released from the locus coeruleus (LC) is a ubiquitous neuromodulator^1-4 that has been linked to multiple functions including arousal^5-8, action and sensory gain^9-11, and learning^12-16. Whether and how activation of noradrenaline-expressing neurons in the LC (LC-NA) facilitates different components of specific behaviours is unknown. Here we show that LC-NA activity displays distinct spatiotemporal dynamics to enable two functions during learned behaviour: facilitating task execution and encoding reinforcement to improve performance accuracy. To examine these functions, we used a behavioural task in mice with graded auditory stimulus detection and task performance. Optogenetic inactivation of the LC demonstrated that LC-NA activity was causal for both task execution and optimization. Targeted recordings of LC-NA neurons using photo-tagging, two-photon micro-endoscopy and two-photon output monitoring showed that transient LC-NA activation preceded behavioural execution and followed reinforcement. These two components of phasic activity were heterogeneously represented in LC-NA cortical outputs, such that the behavioural response signal was higher in the motor cortex and facilitated task execution, whereas the negative reinforcement signal was widely distributed among cortical regions and improved response sensitivity on the subsequent trial. Modular targeting of LC outputs thus enables diverse functions, whereby some noradrenaline signals are segregated among targets, whereas others are broadly distributed.

Neuromodulation and Neurophysiology on the Timescale of Learning and Decision-Making

Nervous systems evolved to effectively navigate the dynamics of the environment to achieve their goals. One framework used to study this fundamental problem arose in the study of learning and decision-making. In this framework, the demands of effective behavior require slow dynamics-on the scale of seconds to minutes-of networks of neurons. Here, we review the phenomena and mechanisms involved. Using vignettes from a few species and areas of the nervous system, we view neuromodulators as key substrates for temporal scaling of neuronal dynamics. Expected final online publication date for the Annual Review of Neuroscience, Volume 45 is July 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Pupil diameter is not an accurate real-time readout of locus coeruleus activity

Pupil diameter is often treated as a noninvasive readout of activity in the locus coeruleus (LC). However, how accurately it can be used to index LC activity is not known. To address this question, we established a graded relationship between pupil size changes and LC spiking activity in mice, where pupil dilation increased monotonically with the number of LC spikes. However, this relationship exists with substantial variability such that pupil diameter can only be used to accurately predict a small fraction of LC activity on a moment-by-moment basis. In addition, pupil exhibited large session-to-session fluctuations in response to identical optical stimulation in the LC. The variations in the pupil–LC relationship were strongly correlated with decision bias-related behavioral variables. Together, our data show that substantial variability exists in an overall graded relationship between pupil diameter and LC activity, and further suggest that the pupil–LC relationship is dynamically modulated by brain states, supporting and extending our previous findings (Yang et al., 2021).

Context-dependent relationships between locus coeruleus firing patterns and coordinated neural activity in the anterior cingulate cortex

Ascending neuromodulatory projections from the locus coeruleus (LC) affect cortical neural networks via the release of norepinephrine (NE). However, the exact nature of these neuromodulatory effects on neural activity patterns in vivo is not well understood. Here, we show that in awake monkeys, LC activation is associated with changes in coordinated activity patterns in the anterior cingulate cortex (ACC). These relationships, which are largely independent of changes in firing rates of individual ACC neurons, depend on the type of LC activation: ACC pairwise correlations tend to be reduced when ongoing (baseline) LC activity increases but enhanced when external events evoke transient LC responses. Both relationships covary with pupil changes that reflect LC activation and arousal. These results suggest that modulations of information processing that reflect changes in coordinated activity patterns in cortical networks can result partly from ongoing, context-dependent, arousal-related changes in activation of the LC-NE system.

The role of lumbosacral innervating noradrenergic neurons in micturition control

A long-standing observation is that the micturition reflex receives supraspinal descending control. Although one supraspinal nucleus (Barrington's nucleus) is identified as the pontine micturition center, it remains largely unknown whether and how other supraspinal tracts are involved in micturition control. Here, we focused on the role of lumbosacral projecting neurons located in the Locus Coeruleus (LC) in modulating micturition, since previous studies indicated that the LC is involved in controlling bladder contraction. First, by performing an AAV mediated retrograde labeling using a TH-iCre mouse line, we demonstrated specific targeting of LC noradrenergic neurons innervating the lumbosacral spinal cord with high efficiency. Next, by lumbosacral injection of a retro-AAV carrying Cre-dependent human diphtheria toxin receptors (DTR), we achieved specific ablation of LC NA⁺ neurons with lumbosacral projections upon the administration of diphtheria toxin. Our results showed that specific ablation of theseneurons led to overflow incontinence leaks and lower void efficiency. Mechanistically, by performing the urodynamics analysis, we showed that ablation of lumbosacral innervating NAneurons resulted in detrusor-sphincter dyssynergia. Taken together, our study provided novel insights into the underlying mechanisms of supraspinal control of micturition reflex and thus shed light on developing novel treatment to improve micturition control in patients with SCI or lower urinary tract symptoms.

Locus coeruleus neurons encode the subjective difficulty of triggering and executing actions

The brain stem noradrenergic nucleus locus coeruleus (LC) is involved in various costly processes: arousal, stress, and attention. Recent work has pointed toward an implication in physical effort, and indirect evidence suggests that the LC could be also involved in cognitive effort. To assess the dynamic relation between LC activity, effort production, and difficulty, we recorded the activity of 193 LC single units in 5 monkeys performing 2 discounting tasks (a delay discounting task and a force discounting task), as well as a simpler target detection task where conditions were matched for difficulty and only differed in terms of sensory-motor processes. First, LC neurons displayed a transient activation both when monkeys initiated an action and when exerting force. Second, the magnitude of the activation scaled with the associated difficulty, and, potentially, the corresponding amount of effort produced, both for decision and force production. Indeed, at action initiation in both discounting tasks, LC activation increased in conditions associated with lower average engagement rate, i.e., those requiring more cognitive control to trigger the response. Decision-related activation also scaled with response time (RT), over and above task parameters, in line with the idea that it reflects the amount of resources (here time) spent on the decision process. During force production, LC activation only scaled with the amount of force produced in the force discounting task, but not in the control target detection task, where subjective difficulty was equivalent across conditions. Our data show that LC neurons dynamically track the amount of effort produced to face both cognitive and physical challenges with a subsecond precision. This works provides key insight into effort processing and the contribution of the noradrenergic system, which is affected in several pathologies where effort is impaired, including Parkinson disease and depression.

The modulation of brain network integration and arousal during exploration

There is growing interest in how neuromodulators shape brain networks. Recent neuroimaging studies provide evidence that brainstem arousal systems, such as the locus coeruleus-norepinephrine system (LC-NE), influence functional connectivity and brain network topology, suggesting they have a role in flexibly reconfiguring brain networks in order to adapt behavior and cognition to environmental demands. To date, however, the relationship between brainstem arousal systems and functional connectivity has not been assessed within the context of a task with an established relationship between arousal and behavior, with most prior studies relying on incidental variations in arousal or pharmacological manipulation and static brain networks constructed over long periods of time. These factors have likely contributed to a heterogeneity of effects across studies. To address these issues, we took advantage of the association between LC-NE-linked arousal and exploration to probe the relationships between exploratory choice, arousal—as measured indirectly via pupil diameter—and brain network dynamics. Exploration in a bandit task was associated with a shift toward fewer, more weakly connected modules that were more segregated in terms of connectivity and topology but more integrated with respect to the diversity of cognitive systems represented in each module. Functional connectivity strength decreased, and changes in connectivity were correlated with changes in pupil diameter, in line with the hypothesis that brainstem arousal systems influence the dynamic reorganization of brain networks. More broadly, we argue that carefully aligning dynamic network analyses with task designs can increase the temporal resolution at which behaviorally- and cognitively-relevant modulations can be identified, and offer these results as a proof of concept of this approach.

Acoustic stimulation increases implicit adaptation in sensorimotor adaptation

Sensorimotor adaptation is an important part of our ability to perform novel motor tasks (i.e., learning of motor skills). Efforts to improve adaptation in healthy and clinical patients using non-invasive brain stimulation methods have been hindered by inter-individual and intra-individual variability in brain susceptibility to stimulation. Here, we explore unpredictable loud acoustic stimulation as an alternative method of modulating brain excitability to improve sensorimotor adaptation. In two experiments, participants moved a cursor towards targets, and adapted to a 30º rotation of cursor feedback, either with or without unpredictable acoustic stimulation. Acoustic stimulation improved initial adaptation to sensory prediction errors in Study 1, and improved overnight retention of adaptation in Study 2. Unpredictable loud acoustic stimulation might thus be a potent method of modulating sensorimotor adaptation in healthy adults.

Locus Coeruleus Norepinephrine in Learned Behavior: Anatomical Modularity and Spatiotemporal Integration in Targets

The locus coeruleus (LC), a small brainstem nucleus, is the primary source of the neuromodulator norepinephrine (NE) in the brain. The LC receives input from widespread brain regions, and projects throughout the forebrain, brainstem, cerebellum, and spinal cord. LC neurons release NE to control arousal, but also in the context of a variety of sensory-motor and behavioral functions. Despite its brain-wide effects, much about the role of LC-NE in behavior and the circuits controlling LC activity is unknown. New evidence suggests that the modular input-output organization of the LC could enable transient, task-specific modulation of distinct brain regions. Future work must further assess whether this spatial modularity coincides with functional differences in LC-NE subpopulations acting at specific times, and how such spatiotemporal specificity might influence learned behaviors. Here, we summarize the state of the field and present new ideas on the role of LC-NE in learned behaviors.

Locus coeruleus spiking differently correlates with S1 cortex activity and pupil diameter in a tactile detection task

We examined the relationships between activity in the locus coeruleus (LC), activity in the primary somatosensory cortex (S1), and pupil diameter in mice performing a tactile detection task. While LC spiking consistently preceded S1 membrane potential depolarization and pupil dilation, the correlation between S1 and pupil was more heterogeneous. Furthermore, the relationships between LC, S1, and pupil varied on timescales of sub-seconds to seconds within trials. Our data suggest that pupil diameter can be dissociated from LC spiking and cannot be used as a stationary index of LC activity.

Coordination of Pupil and Saccade Responses by the Superior Colliculus

The appearance of a salient stimulus evokes saccadic eye movements and pupil dilation as part of the orienting response. Although the role of the superior colliculus (SC) in saccade and pupil dilation has been established separately, whether and how these responses are coordinated remains unknown. The SC also receives global luminance signals from the retina, but whether global luminance modulates saccade and pupil responses coordinated by the SC remains unknown. Here, we used microstimulation to causally determine how the SC coordinates saccade and pupil responses and whether global luminance modulates these responses by varying stimulation frequency and global luminance in male monkeys. Stimulation frequency modulated saccade and pupil responses, with trial-by-trial correlations between the two responses. Global luminance only modulated pupil, but not, saccade responses. Our results demonstrate an integrated role of the SC on coordinating saccade and pupil responses, characterizing luminance independent modulation in the SC, together elucidating the differentiated pathways underlying this behavior.

Pharmacological evidence for the implication of noradrenaline in effort

The trade-off between effort and reward is one of the main determinants of behavior, and its alteration is at the heart of major disorders such as depression or Parkinson's disease. Monoaminergic neuromodulators are thought to play a key role in this trade-off, but their relative contribution remains unclear. Rhesus monkeys (Macaca mulatta) performed a choice task requiring a trade-off between the volume of fluid reward and the amount of force to be exerted on a grip. In line with a causal role of noradrenaline in effort, decreasing noradrenaline levels with systemic clonidine injections (0.01 mg/kg) decreased exerted force and enhanced the weight of upcoming force on choices, without any effect on reward sensitivity. Using computational modeling, we showed that a single variable ("effort") could capture the amount of resources necessary for action and control both choices (as a variable for decision) and force production (as a driving force). Critically, the multiple effects of noradrenaline manipulation on behavior could be captured by a specific modulation of this single variable. Thus, our data strongly support noradrenaline's implication in effort processing.

Regulation of vocal precision by noradrenergic modulation of a motor nucleus

Norepinephrine (NE) function is often implicated in regulating arousal levels. Recent theory suggests that the noradrenergic system also regulates the optimization of behavior with respect to reward maximization by controlling a switch between exploration and exploitation of the specific actions that yield greatest utility. We show in the songbird that NE can act directly on a cortical motor area and cause a switch between exploratory and exploitative behavior.

Temporal dynamics of amygdala response to emotion- and action-relevance

It has been proposed that the human amygdala may not only encode the emotional value of sensory events, but more generally mediate the appraisal of their relevance for the individual's goals, including relevance for action or task-based needs. However, emotional and non-emotional/action-relevance might drive amygdala activity through distinct neural signals, and the relative timing of both kinds of responses remains undetermined. Here, we recorded intracranial event-related potentials from nine amygdalae of patients undergoing epilepsy surgery, while they performed variants of a Go/NoGo task with faces and abstract shapes, where emotion- and action-relevance were orthogonally manipulated. Our results revealed early amygdala responses to emotion facial expressions starting ~ 130 ms after stimulus-onset. Importantly, the amygdala responded to action-relevance not only with face stimuli but also with abstract shapes (squares), and these relevance effects consistently occurred in later time-windows (starting ~ 220 ms) for both faces and squares. A similar dissociation was observed in gamma activity. Furthermore, whereas emotional responses habituated over time, the action-relevance effect increased during the course of the experiment, suggesting progressive learning based on the task needs. Our results support the hypothesis that the human amygdala mediates a broader relevance appraisal function, with the processing of emotion-relevance preceding temporally that of action-relevance.

Pupil Size as a Window on Neural Substrates of Cognition

Cognitively driven pupil modulations reflect certain underlying brain functions. What do these reflections tell us? Here, we review findings that have identified key roles for three neural systems: cortical modulation of the pretectal olivary nucleus (PON), which controls the pupillary light reflex; the superior colliculus (SC), which mediates orienting responses, including pupil changes to salient stimuli; and the locus coeruleus (LC)-norepinephrine (NE) neuromodulatory system, which mediates relationships between pupil-linked arousal and cognition. We discuss how these findings can inform the interpretation of pupil measurements in terms of activation of these neural systems. We also highlight caveats, open questions, and key directions for future experiments for improving these interpretations in terms of the underlying neural dynamics throughout the brain.

Locus coeruleus-norepinephrine: basic functions and insights into Parkinson's disease

The locus coeruleus is a pontine nucleus that produces much of the brain's norepinephrine. Despite its small size, the locus coeruleus is critical for a myriad of functions and is involved in many neurodegenerative and neuropsychiatric disorders. In this review, we discuss the physiology and anatomy of the locus coeruleus system and focus on norepinephrine's role in synaptic plasticity. We highlight Parkinson's disease as a disorder with motor and neuropsychiatric symptoms that may be understood as aberrations in the normal functions of locus coeruleus.

Bidirectional pharmacological perturbations of the noradrenergic system differentially affect tactile detection

The brain neuromodulatory systems heavily influence behavioral and cognitive processes. Previous work has shown that norepinephrine (NE), a classic neuromodulator mainly derived from the locus coeruleus (LC), enhances neuronal responses to sensory stimuli. However, the role of the LC-NE system in modulating perceptual task performance is not well understood. In addition, systemic perturbation of NE signaling has often been proposed to specifically target the LC in functional studies, yet the assumption that localized (specific) and systemic (nonspecific) perturbations of LC-NE have the same behavioral impact remains largely untested. In this study, we trained mice to perform a head-fixed, quantitative tactile detection task, and administered an α2 adrenergic receptor agonist or antagonist to pharmacologically down- or up-regulate LC-NE activity, respectively. We addressed the outstanding question of how bidirectional perturbations of LC-NE activity affect tactile detection, and tested whether localized and systemic drug treatments exert the same behavioral effects. We found that both localized and systemic suppression of LC-NE impaired tactile detection by reducing motivation. Surprisingly, while locally activating LC-NE enabled mice to perform in a near-optimal regime, systemic activation impaired behavior by promoting impulsivity. Our results demonstrate that localized silencing and activation of LC-NE differentially affect tactile detection, and that localized and systemic NE activation induce distinct behavioral changes.

Noradrenergic But Not Dopaminergic Neurons Signal Task State Changes and Predict Reengagement After a Failure

The two catecholamines, noradrenaline and dopamine, have been shown to play comparable roles in behavior. Both noradrenergic and dopaminergic neurons respond to cues predicting reward availability and novelty. However, even though both are thought to be involved in motivating actions, their roles in motivation have seldom been directly compared. We therefore examined the activity of putative noradrenergic neurons in the locus coeruleus and putative midbrain dopaminergic neurons in monkeys cued to perform effortful actions for rewards. The activity in both regions correlated with engagement with a presented option. By contrast, only noradrenaline neurons were also (i) predictive of engagement in a subsequent trial following a failure to engage and (ii) more strongly activated in nonrepeated trials, when cues indicated a new task condition. This suggests that while both catecholaminergic neurons are involved in promoting action, noradrenergic neurons are sensitive to task state changes, and their influence on behavior extends beyond the immediately rewarded action.

A neural network for information seeking

Humans and other animals often show a strong desire to know the uncertain rewards their future has in store, even when they cannot use this information to influence the outcome. However, it is unknown how the brain predicts opportunities to gain information and motivates this information-seeking behavior. Here we show that neurons in a network of interconnected subregions of primate anterior cingulate cortex and basal ganglia predict the moment of gaining information about uncertain rewards. Spontaneous increases in their information prediction signals are followed by gaze shifts toward objects associated with resolving uncertainty, and pharmacologically disrupting this network reduces the motivation to seek information. These findings demonstrate a cortico-basal ganglia mechanism responsible for motivating actions to resolve uncertainty by seeking knowledge about the future.

Animals resolve uncertainty by seeking knowledge about the future. How the brain controls this is unclear. The authors show that a network including primate anterior cingulate cortex and basal ganglia encodes opportunities to gain information about uncertain rewards and mediates information seeking.

Locus coeruleus-norepinephrine modulation of sensory processing and perception: A focused review

The locus coeruleus-norepinephrine (LC-NE) system is involved in many brain functions and neurological disorders. In this review we discuss how LC-NE signaling affects the activity of cortical and subcortical sensory neurons, and how it influences perception-driven behaviors associated with mammalian somatosensory, visual, auditory, and olfactory systems. We summarize the consistent as well as seemingly inconsistent findings across brain areas and sensory modalities and propose a framework to understand these phenomena from the perspective of adrenergic receptor expression, dose-dependent physiology and excitation-inhibition balance. We also discuss potential future research directions in this field.

Action boosts episodic memory encoding in humans via engagement of a noradrenergic system

We are constantly interacting with our environment whilst we encode memories. However, how actions influence memory formation remains poorly understood. Goal-directed movement engages the locus coeruleus (LC), the main source of noradrenaline in the brain. Noradrenaline is also known to enhance episodic encoding, suggesting that action could improve memory via LC engagement. Here we demonstrate, across seven experiments, that action (Go-response) enhances episodic encoding for stimuli unrelated to the action itself, compared to action inhibition (NoGo). Functional magnetic resonance imaging, and pupil diameter as a proxy measure for LC-noradrenaline transmission, indicate increased encoding-related LC activity during action. A final experiment, replicated in two independent samples, confirmed a novel prediction derived from these data that emotionally aversive stimuli, which recruit the noradrenergic system, modulate the mnemonic advantage conferred by Go-responses relative to neutral stimuli. We therefore provide converging evidence that action boosts episodic memory encoding via a noradrenergic mechanism.

Behavioral correlates of activity of optogenetically identified locus coeruleus noradrenergic neurons in rats performing T-maze tasks

The nucleusLocus Coeruleus (LC) is the major source of forebrain norepinephrine. LC is implicated in arousal, response to novelty, and cognitive functions, including decision-making and behavioral flexibility. One hypothesis is that LC activation promotes rapid shifts in cortical attentional networks following changes in environmental contingencies. Recent recordings further suggest LC is critical for mobilizing resources to deal with challenging situations. In the present study optogenetically identified LC neuronal activity was recorded in rats in a self-paced T-maze. Rats were trained on visual discrimination; then place-reward contingencies were instated. In the session where the animal shifted tasks the first time, the LC firing rate after visual cue onset increased significantly, even as the animal adhered to the previous rule. Firing rate also increased prior to crossing photodetectors that controlled stimulus onset and offset, and this was positively correlated with accelerations, consistent with a role in mobilizing effort. The results contribute to the growing evidence that the noradrenergic LC is essential for behavioral adaptation by promoting cognitive flexibility and mobilizing effort in face of changing environmental contingencies.

Encoding prediction signals during appetitive and aversive Pavlovian conditioning in the primate lateral hypothalamus

The lateral hypothalamus (LH), which plays a role in homeostatic functions such as appetite regulation, is also linked to arousal and motivational behavior. However, little is known about how these components are encoded in the LH. Thus cynomolgus monkeys were conditioned with two distinct contexts, i.e., an appetitive context with available rewards and an aversive context with predicted air puffs. Different LH neuron groups encoded different degrees of expectation, predictability, and risks of rewards in a specific manner. A nearly equal number of one-third of the recorded LH neurons showed a positive or negative correlation between their response to visual conditioned stimuli (CS) that predicted the probabilistic delivery of rewards (0%, 50%, and 100%) and the associative values. For another one-third of recorded neurons, a nearly equal number showed a positive or negative correlation between their responses to rewards [appetitive unconditioned stimulus (US)] and reward predictability. Some neurons exhibited their highest or lowest trace-period responses in the 50% reward trials. These response modulations were represented independently and overlaid on a consistent excitatory or inhibitory response across the conditioning events. LH neurons also showed consistent responses in the aversive context. However, the responses to aversive conditioning events depending on the air puff value and predictability were less common. The multifaceted modulation of consistent activity related to outcome predictions may reflect motivational and arousal signals. Furthermore, it may underlie the role the LH plays in the integration and relay of signals to cortices for adaptive and goal-directed physiological and behavioral responses to environmental changes.

NEW & NOTEWORTHY The lateral hypothalamus (LH) is implicated in motivational and arousal behavior; however, the detailed information carried by single LH neurons remains unclear. We demonstrate that primate LH neurons encode multiple combinations of signals concerning different degrees of expectation, appreciation, and uncertainty of rewards in consistent responses across conditioning events and between different contexts. This multifaceted modulation of activity may underlie the role of the LH as a critical node integrating motivational signals with arousal signals.

Locus Coeruleus tracking of prediction errors optimises cognitive flexibility: An Active Inference model

The locus coeruleus (LC) in the pons is the major source of noradrenaline (NA) in the brain. Two modes of LC firing have been associated with distinct cognitive states: changes in tonic rates of firing are correlated with global levels of arousal and behavioural flexibility, whilst phasic LC responses are evoked by salient stimuli. Here, we unify these two modes of firing by modelling the response of the LC as a correlate of a prediction error when inferring states for action planning under Active Inference (AI). We simulate a classic Go/No-go reward learning task and a three-arm ‘explore/exploit’ task and show that, if LC activity is considered to reflect the magnitude of high level ‘state-action’ prediction errors, then both tonic and phasic modes of firing are emergent features of belief updating. We also demonstrate that when contingencies change, AI agents can update their internal models more quickly by feeding back this state-action prediction error–reflected in LC firing and noradrenaline release–to optimise learning rate, enabling large adjustments over short timescales. We propose that such prediction errors are mediated by cortico-LC connections, whilst ascending input from LC to cortex modulates belief updating in anterior cingulate cortex (ACC). In short, we characterise the LC/ NA system within a general theory of brain function. In doing so, we show that contrasting, behaviour-dependent firing patterns are an emergent property of the LC that translates state-action prediction errors into an optimal balance between plasticity and stability.

The brain uses sensory information to build internal models and make predictions about the world. When errors of prediction occur, models must be updated to ensure desired outcomes are still achieved. Neuromodulator chemicals provide a possible pathway for triggering such changes in brain state. One such neuromodulator, noradrenaline, originates predominantly from a cluster of neurons in the brainstem—the locus coeruleus (LC)—and plays a key role in behaviour, for instance, in determining the balance between exploiting or exploring the environment. Here we use Active Inference (AI), a mathematical model of perception and action, to formally describe LC function. We propose that LC activity is triggered by errors in prediction and that the subsequent release of noradrenaline alters the rate of learning about the environment. Biologically, this describes an LC-cortex feedback loop promoting behavioural flexibility in times of uncertainty. We model LC output as a simulated animal performs two tasks known to elicit archetypal responses. We find that experimentally observed ‘phasic’ and ‘tonic’ patterns of LC activity emerge naturally, and that modulation of learning rates improves task performance. This provides a simple, unified computational account of noradrenergic computational function within a general model of behaviour.

Atomoxetine modulates the relationship between perceptual abilities and response bias

Elucidation of how neuromodulators influence motivated behaviors is a major challenge of neuroscience research. It has been proposed that the locus-cœruleus-norepinephrine system promotes behavioral flexibility and provides resources required to face challenges in a wide range of cognitive processes. Both theoretical models and computational models suggest that the locus-cœruleus-norepinephrine system tunes neural gain in brain circuits to optimize behavior. However, to the best of our knowledge, empirical proof demonstrating the role of norepinephrine in performance optimization is scarce. Here, we modulated norepinephrine transmission in monkeys performing a Go/No-Go discrimination task using atomoxetine, a norepinephrine-reuptake inhibitor. We tested the optimization hypothesis by assessing perceptual sensitivity, response bias, and their functional relationship within the framework of the signal detection theory. We also manipulated the contingencies of the task (level of stimulus discriminability, target stimulus frequency, and decision outcome values) to modulate the relationship between sensitivity and response bias. We found that atomoxetine increased the subject's perceptual sensitivity to discriminate target stimuli regardless of the task contingency. Atomoxetine also improved the functional relationship between sensitivity and response bias, leading to a closer fit with the optimal strategy in different contexts. In addition, atomoxetine tended to reduce reaction time variability. Taken together, these findings support a role of norepinephrine transmission in optimizing response strategy.

Locus Coeruleus tracking of prediction errors optimises cognitive flexibility: An Active Inference model

The locus coeruleus (LC) in the pons is the major source of noradrenaline (NA) in the brain. Two modes of LC firing have been associated with distinct cognitive states: changes in tonic rates of firing are correlated with global levels of arousal and behavioural flexibility, whilst phasic LC responses are evoked by salient stimuli. Here, we unify these two modes of firing by modelling the response of the LC as a correlate of a prediction error when inferring states for action planning under Active Inference (AI). We simulate a classic Go/No-go reward learning task and a three-arm 'explore/exploit' task and show that, if LC activity is considered to reflect the magnitude of high level 'state-action' prediction errors, then both tonic and phasic modes of firing are emergent features of belief updating. We also demonstrate that when contingencies change, AI agents can update their internal models more quickly by feeding back this state-action prediction error-reflected in LC firing and noradrenaline release-to optimise learning rate, enabling large adjustments over short timescales. We propose that such prediction errors are mediated by cortico-LC connections, whilst ascending input from LC to cortex modulates belief updating in anterior cingulate cortex (ACC). In short, we characterise the LC/ NA system within a general theory of brain function. In doing so, we show that contrasting, behaviour-dependent firing patterns are an emergent property of the LC that translates state-action prediction errors into an optimal balance between plasticity and stability.

The Locus Coeruleus Is a Complex and Differentiated Neuromodulatory System

Diffuse projections of locus coeruleus (LC) neurons and evidence of synchronous spiking have long been perceived as features of global neuromodulation. Recent studies demonstrated the possibility of targeted modulation by subsets of LC neurons. Non-global neuromodulation depends on target specificity and the differentiated spatiotemporal dynamics within LC. Here, we characterized interactions between 3,164 LC cell pairs in the rat LC under urethane anesthesia. Spike count correlations were near zero and only a small proportion of unit pairs had synchronized spontaneous (15%) or evoked (16%) discharge. We identified infra-slow (0.01-1 Hz) fluctuations of LC unit spike rate, which were also asynchronous across the population. Despite overall sparse population synchrony, we report the existence of LC ensembles and relate them to forebrain projection targets. We also show that spike waveform width was related to ensemble membership, propensity for synchronization, and interactions with cortex. Our findings suggest a partly differentiated and target-specific noradrenergic signal.

Dynamic Lateralization of Pupil Dilation Evoked by Locus Coeruleus Activation Results from Sympathetic, Not Parasympathetic, Contributions

Pupil size is collectively controlled by the sympathetic dilator and parasympathetic sphincter muscles. Locus coeruleus (LC) activation has been shown to evoke pupil dilation, but how the sympathetic and parasympathetic pathways contribute to this dilation remains unknown. We examined pupil dilation elicited by LC activation in lightly anesthetized rats. Unilateral LC activation evoked bilateral but lateralized pupil dilation; i.e., the ipsilateral dilation was significantly larger than the contralateral dilation. Surgically blocking the ipsilateral, but not contralateral, sympathetic pathway significantly reduced lateralization, suggesting that lateralization is mainly due to sympathetic contribution. Moreover, we found that sympathetic, but not parasympathetic, contribution is correlated with LC activation frequency. Together, our results unveil the frequency-dependent contributions of the sympathetic and parasympathetic pathways to LC activation-evoked pupil dilation and suggest that lateralization in task-evoked pupil dilations may be used as a biomarker for autonomic tone.

Central Noradrenergic Interactions with Alcohol and Regulation of Alcohol-Related Behaviors

Alcohol use disorder (AUD) results from disruption of a number of neural systems underlying motivation, emotion, and cognition. Patients with AUD exhibit not only elevated motivation for alcohol but heightened stress and anxiety, and disruptions in cognitive domains such as decision-making. One system at the intersection of these functions is the central norepinephrine (NE) system. This catecholaminergic neuromodulator, produced by several brainstem nuclei, plays profound roles in a wide range of behaviors and functions, including arousal, attention, and other aspects of cognition, motivation, emotional regulation, and control over basic physiological processes. It has been known for some time that NE has an impact on alcohol seeking and use, but the mechanisms of its influence are still being revealed. This chapter will discuss the influence of NE neuron activation and NE release at alcohol-relevant targets on behaviors and disruptions underlying alcohol motivation and AUD. Potential NE-based pharmacotherapies for AUD treatment will also be discussed. Given the basic properties of NE function, the strong relationship between NE and alcohol use, and the effectiveness of current NE-related treatments, the studies presented here indicate an encouraging direction for the development of precise and efficacious future therapies for AUD.