Reward expectation, orientation of attention and locus coeruleus-medial frontal cortex interplay during learning

Toward a computational role for locus coeruleus/norepinephrine arousal systems

Brain and behavior undergo measurable changes in their underlying state and neuromodulators are thought to contribute to these fluctuations. Why do we undergo such changes, and what function could the underlying neuromodulatory systems perform? Here we examine theoretical answers to these questions with respect to the locus coeruleus/norepinephrine system focusing on peripheral markers for arousal, such as pupil diameter, that are thought to provide a window into brain wide noradrenergic signaling. We explore a computational role for arousal systems in facilitating internal state transitions that facilitate credit assignment and promote accurate perceptions in non-stationary environments. We summarize recent work that supports this idea and highlight open questions as well as alternative views of how arousal affects cognition.

Pupil dilation reflects the social and motion content of faces

Human facial features (eyes, nose, and mouth) allow us to communicate with others. Observing faces triggers physiological responses, including pupil dilation. Still, the relative influence of social and motion content of a visual stimulus on pupillary reactivity has never been elucidated. A total of 30 adults aged 18-33 years old were recorded with an eye tracker. We analysed the event-related pupil dilation in response to stimuli distributed along a gradient of social salience (non-social to social, going from objects to avatars to real faces) and dynamism (static to micro- to macro-motion). Pupil dilation was larger in response to social (faces and avatars) compared to non-social stimuli (objects), with surprisingly a larger response for avatars. Pupil dilation was also larger in response to macro-motion compared to static. After quantifying each stimulus' real quantity of motion, we found that the higher the quantity of motion, the larger the pupil dilated. However, the slope of this relationship was not higher for social stimuli. Overall, pupil dilation was more sensitive to the real quantity of motion than to the social component of motion, highlighting the relevance of ecological stimulations. Physiological response to faces results from specific contributions of both motion and social processing.

Effects of Phasic Activation of Locus Ceruleus on Cortical Neural Activity and Auditory Discrimination Behavior

Although the locus ceruleus (LC) is recognized as a crucial modulator for attention and perception by releasing norepinephrine into various cortical regions, the impact of LC-noradrenergic (LC-NE) modulation on auditory discrimination behavior remains elusive. In this study, we firstly recorded local field potential and single-unit activity in multiple cortical regions associated with auditory-motor processing, including the auditory cortex, posterior parietal cortex, secondary motor cortex, anterior cingulate cortex, prefrontal cortex, and orbitofrontal cortex (OFC), in response to optogenetic activation (40 Hz and 0.5 s) of the LC-NE neurons in awake mice (male). We found that phasic LC stimulation induced a persistent high gamma oscillation (50-80 Hz) in the OFC. Phasic activation of LC-NE neurons also resulted in a corresponding increase in norepinephrine levels in the OFC, accompanied by a pupillary dilation response. Furthermore, when mice were performing a go/no-go auditory discrimination task, we optogeneticaly activated the neural projections from LC to OFC and revealed a shortened latency in behavioral responses to sound stimuli and an increased false alarm rate. These impulsive behavioral responses may be associated with the gamma neural activity in the OFC. These findings have broadened our understanding of the neural mechanisms involved in the role of LC in auditory-motor processing.

Event boundaries drive norepinephrine release and distinctive neural representations of space in the rodent hippocampus

Episodic memories are temporally segmented around event boundaries that tend to coincide with moments of environmental change. During these times, the state of the brain should change rapidly, or reset, to ensure that the information encountered before and after an event boundary is encoded in different neuronal populations. Norepinephrine (NE) is thought to facilitate this network reorganization. However, it is unknown whether event boundaries drive NE release in the hippocampus and, if so, how NE release relates to changes in hippocampal firing patterns. The advent of the new GRABNE sensor now allows for the measurement of NE binding with sub-second resolution. Using this tool in mice, we tested whether NE is released into the dorsal hippocampus during event boundaries defined by unexpected transitions between spatial contexts and presentations of novel objections. We found that NE binding dynamics were well explained by the time elapsed after each of these environmental changes, and were not related to conditioned behaviors, exploratory bouts of movement, or reward. Familiarity with a spatial context accelerated the rate in which phasic NE binding decayed to baseline. Knowing when NE is elevated, we tested how hippocampal coding of space differs during these moments. Immediately after context transitions we observed relatively unique patterns of neural spiking which settled into a modal state at a similar rate in which NE returned to baseline. These results are consistent with a model wherein NE release drives hippocampal representations away from a steady-state attractor. We hypothesize that the distinctive neural codes observed after each event boundary may facilitate long-term memory and contribute to the neural basis for the primacy effect.

Neural circuit-selective, multiplexed pharmacological targeting of prefrontal cortex-projecting locus coeruleus neurons drives antinociception

Selective manipulation of neural circuits using optogenetics and chemogenetics holds great translational potential but requires genetic access to neurons. Here, we demonstrate a general framework for identifying genetic tool-independent, pharmacological strategies for neural circuit-selective modulation. We developed an economically accessible calcium imaging-based approach for large-scale pharmacological scans of endogenous receptor-mediated neural activity. As a testbed for this approach, we used the mouse locus coeruleus due to the combination of its widespread, modular efferent neural circuitry and its wide variety of endogenously expressed GPCRs. Using machine learning-based action potential deconvolution and retrograde tracing, we identified an agonist cocktail that selectively inhibits medial prefrontal cortex-projecting locus coeruleus neurons. In vivo , this cocktail produces synergistic antinociception, consistent with selective pharmacological blunting of this neural circuit. This framework has broad utility for selective targeting of other neural circuits under different physiological and pathological states, facilitating non-genetic translational applications arising from cell type-selective discoveries.

Frontal Norepinephrine Represents a Threat Prediction Error Under Uncertainty

BACKGROUND

To adapt to threats in the environment, animals must predict them and engage in defensive behavior. While the representation of a prediction error signal for reward has been linked to dopamine, a neuromodulatory prediction error for aversive learning has not been identified.

METHODS

We measured and manipulated norepinephrine release during threat learning using optogenetics and a novel fluorescent norepinephrine sensor.

RESULTS

We found that norepinephrine response to conditioned stimuli reflects aversive memory strength. When delays between auditory stimuli and footshock are introduced, norepinephrine acts as a prediction error signal. However, temporal difference prediction errors do not fully explain norepinephrine dynamics. To explain noradrenergic signaling, we used an updated reinforcement learning model with uncertainty about time and found that it explained norepinephrine dynamics across learning and variations in temporal and auditory task structure.

CONCLUSIONS

Norepinephrine thus combines cognitive and affective information into a predictive signal and links time with the anticipation of danger.

The Projection-Specific Noradrenergic Modulation of Perseverative Spatial Behavior in Adult Male Rats

Adaptive behavior relies on efficient cognitive control. The anterior cingulate cortex (ACC) is a key node within the executive prefrontal network. The reciprocal connectivity between the locus ceruleus (LC) and ACC is thought to support behavioral reorganization triggered by the detection of an unexpected change. We transduced LC neurons with either excitatory or inhibitory chemogenetic receptors in adult male rats and trained rats on a spatial task. Subsequently, we altered LC activity and confronted rats with an unexpected change of reward locations. In a new spatial context, rats with decreased noradrenaline (NA) in the ACC entered unbaited maze arms more persistently which was indicative of perseveration. In contrast, the suppression of the global NA transmission reduced perseveration. Neither chemogenetic manipulation nor inactivation of the ACC by muscimol affected the rate of learning, possibly due to partial virus transduction of the LC neurons and/or the compensatory engagement of other prefrontal regions. Importantly, we observed behavioral deficits in rats with LC damage caused by virus injection. The latter finding highlights the importance of careful histological assessment of virus-transduced brain tissue as inadvertent damage of the targeted cell population due to virus neurotoxicity or other factors might cause unwanted side effects. Although the specific role of ACC in the flexibility of spatial behavior has not been convincingly demonstrated, our results support the beneficial role of noradrenergic transmission for an optimal function of the ACC. Overall, our findings suggest the LC exerts the projection-specific modulation of neural circuits mediating the flexibility of spatial behavior.

Functional states of prelimbic and related circuits during the acquisition of a GO/noGO task in rats

GO/noGO tasks enable assessing decision-making processes and the ability to suppress a specific action according to the context. Here, rats had to discriminate between 2 visual stimuli (GO or noGO) shown on an iPad screen. The execution (for GO) or nonexecution (for noGO) of the selected action (to touch or not the visual display) were reinforced with food. The main goal was to record and to analyze local field potentials collected from cortical and subcortical structures when the visual stimuli were shown on the touch screen and during the subsequent activities. Rats were implanted with recording electrodes in the prelimbic cortex, primary motor cortex, nucleus accumbens septi, basolateral amygdala, dorsolateral and dorsomedial striatum, hippocampal CA1, and mediodorsal thalamic nucleus. Spectral analyses of the collected data demonstrate that the prelimbic cortex was selectively involved in the cognitive and motivational processing of the learning task but not in the execution of reward-directed behaviors. In addition, the other recorded structures presented specific tendencies to be involved in these 2 types of brain activity in response to the presentation of GO or noGO stimuli. Spectral analyses, spectrograms, and coherence between the recorded brain areas indicate their specific involvement in GO vs. noGO tasks.

Functional locus coeruleus imaging to investigate an ageing noradrenergic system

The locus coeruleus (LC), our main source of norepinephrine (NE) in the brain, declines with age and is a potential epicentre of protein pathologies in neurodegenerative diseases (ND). In vivo measurements of LC integrity and function are potentially important biomarkers for healthy ageing and early ND onset. In the present study, high-resolution functional MRI (fMRI), a reversal reinforcement learning task, and dedicated post-processing approaches were used to visualise age differences in LC function (N = 50). Increased LC responses were observed during emotionally and task-related salient events, with subsequent accelerations and decelerations in reaction times, respectively, indicating context-specific adaptive engagement of the LC. Moreover, older adults exhibited increased LC activation compared to younger adults, indicating possible compensatory overactivation of a structurally declining LC in ageing. Our study shows that assessment of LC function is a promising biomarker of cognitive aging.

Adaptive Responding to Stimulus-Outcome Associations Requires Noradrenergic Transmission in the Medial Prefrontal Cortex

A dynamic environment, such as the one we inhabit, requires organisms to continuously update their knowledge of the setting. While the prefrontal cortex is recognized for its pivotal role in regulating such adaptive behavior, the specific contribution of each prefrontal area remains elusive. In the current work, we investigated the direct involvement of two major prefrontal subregions, the medial prefrontal cortex (mPFC, A32D + A32V) and the orbitofrontal cortex (OFC, VO + LO), in updating pavlovian stimulus-outcome (S-O) associations following contingency degradation in male rats. Specifically, animals had to learn that a particular cue, previously fully predicting the delivery of a specific reward, was no longer a reliable predictor. First, we found that chemogenetic inhibition of mPFC, but not of OFC, neurons altered the rats' ability to adaptively respond to degraded and non-degraded cues. Next, given the growing evidence pointing at noradrenaline (NA) as a main neuromodulator of adaptive behavior, we decided to investigate the possible involvement of NA projections to the two subregions in this higher-order cognitive process. Employing a pair of novel retrograde vectors, we traced NA projections from the locus ceruleus (LC) to both structures and observed an equivalent yet relatively segregated amount of inputs. Then, we showed that chemogenetic inhibition of NA projections to the mPFC, but not to the OFC, also impaired the rats' ability to adaptively respond to the degradation procedure. Altogether, our findings provide important evidence of functional parcellation within the prefrontal cortex and point at mPFC NA as key for updating pavlovian S-O associations.

Simultaneous oscillatory encoding of "hot" and "cold" information during social interactions in the monkey medial prefrontal cortex

Social interactions in primates require social cognition abilities such as anticipating the partner's future choices as well as pure cognitive skills involving processing task-relevant information. The medial prefrontal cortex (mPFC) has been implicated in these cognitive processes. Here, we investigated the neural oscillations underlying the complex social behaviors involving the interplay of social roles (Actor vs. Observer) and interaction types (whether working with a "Good" or "Bad" partner). We found opposite power modulations of the beta and gamma bands by social roles, indicating dedicated processing for task-related information. Concurrently, the interaction type was conveyed by lower frequencies, which are commonly associated with neural circuits linked to performance and reward monitoring. Thus, the mPFC exhibits parallel coding of both "cold" processes (purely cognitive) and "hot" processes (reward and social-related). This allocation of neural resources gives the mPFC a key neural node, flexibly integrating multiple sources of information during social interactions.

Phasic locus coeruleus activity enhances trace fear conditioning by increasing dopamine release in the hippocampus

Locus coeruleus (LC) projections to the hippocampus play a critical role in learning and memory. However, the precise timing of LC-hippocampus communication during learning and which LC-derived neurotransmitters are important for memory formation in the hippocampus are currently unknown. Although the LC is typically thought to modulate neural activity via the release of norepinephrine, several recent studies have suggested that it may also release dopamine into the hippocampus and other cortical regions. In some cases, it appears that dopamine release from LC into the hippocampus may be more important for memory than norepinephrine. Here, we extend these data by characterizing the phasic responses of the LC and its projections to the dorsal hippocampus during trace fear conditioning in mice. We find that the LC and its projections to the hippocampus respond to task-relevant stimuli and that amplifying these responses with optogenetic stimulation can enhance long-term memory formation. We also demonstrate that LC activity increases both norepinephrine and dopamine content in the dorsal hippocampus and that the timing of hippocampal dopamine release during trace fear conditioning is similar to the timing of LC activity. Finally, we show that hippocampal dopamine is important for trace fear memory formation, while norepinephrine is not.

Locus Ceruleus Dynamics Are Suppressed during Licking and Enhanced Postlicking Independent of Taste Novelty

Attending to salient sensory attributes of food, such as tastes that are new, displeasing, or unexpected, allows the procurement of nutrients without food poisoning. Exposure to new tastes is known to increase norepinephrine (NE) release in taste processing forebrain areas, yet the central source for this release is unknown. Locus ceruleus norepinephrine neurons (LC-NE) emerge as a candidate in signaling salient information about taste, as other salient sensory stimuli (e.g., visual, auditory, somatosensation) are known to activate LC neurons. To determine if LC neurons are sensitive to features of taste novelty, we used fiber photometry to record LC-NE activity in water-restricted mice that voluntarily licked either novel or familiar substances of differential palatability (saccharine, citric acid). We observed that LC-NE activity was suppressed during lick bursts and transiently activated upon the termination of licking and that these dynamics were independent of the familiarity of the substance consumed. We next recorded LC dynamics during brief and unexpected consumption of tastants and found no increase in LC-NE activity, despite their responsiveness to visual and auditory stimuli, revealing selectivity in LC's responses to salient sensory information. Our findings suggest that LC activity during licking is not influenced by taste novelty, implicating a possible role for non-LC noradrenergic nuclei in signaling critical information about taste.

Noradrenergic regulation of cue-guided decision making and impulsivity is doubly dissociable across frontal brain regions

RATIONALE

Win-paired stimuli can promote risk taking in experimental gambling paradigms in both rats and humans. We previously demonstrated that atomoxetine, a noradrenaline reuptake inhibitor, and guanfacine, a selective α2A adrenergic receptor agonist, reduced risk taking on the cued rat gambling task (crGT), a rodent assay of risky choice in which wins are accompanied by salient cues. Both compounds also decreased impulsive premature responding.

OBJECTIVE

The key neural loci mediating these effects were unknown. The lateral orbitofrontal cortex (lOFC) and the medial prefrontal cortex (mPFC), which are highly implicated in risk assessment, action selection, and impulse control, receive dense noradrenergic innervation. We therefore infused atomoxetine and guanfacine directly into either the lOFC or prelimbic (PrL) mPFC prior to task performance.

RESULTS

When infused into the lOFC, atomoxetine improved decision making score and adaptive lose-shift behaviour in males, but not in females, without altering motor impulsivity. Conversely, intra-PrL atomoxetine improved impulse control in risk preferring animals of both sexes, but did not alter decision making. Guanfacine administered into the PrL, but not lOFC, also altered motor impulsivity in all subjects, though in the opposite direction to atomoxetine.

CONCLUSIONS

These data highlight a double dissociation between the behavioural effects of noradrenergic signaling across frontal regions with respect to risky choice and impulsive action. Given that the influence of noradrenergic manipulations on motor impulsivity could depend on baseline risk preference, these data also suggest that the noradrenaline system may function differently in subjects that are susceptible to the risk-promoting lure of win-associated cues.

Optogenetic stimulation of the locus coeruleus enhances appetitive extinction in rats

Extinction is a specific example of learning where a previously reinforced stimulus or response is no longer reinforced, and the previously learned behaviour is no longer necessary and must be modified. Current theories suggest extinction is not the erasure of the original learning but involves new learning that acts to suppress the original behaviour. Evidence for this can be found when the original behaviour recovers following the passage of time (spontaneous recovery) or reintroduction of the reinforcement (i.e. reinstatement). Recent studies have shown that pharmacological manipulation of noradrenaline (NA) or its receptors can influence appetitive extinction; however, the role and source of endogenous NA in these effects are unknown. Here, we examined the role of the locus coeruleus (LC) in appetitive extinction. Specifically, we tested whether optogenetic stimulation of LC neurons during extinction of a food-seeking behaviour would enhance extinction evidenced by reduced spontaneous recovery in future tests. LC stimulation during extinction trials did not change the rate of extinction but did serve to reduce subsequent spontaneous recovery, suggesting that stimulation of the LC can augment reward-related extinction. Optogenetic inhibition of the LC during extinction trials reduced responding during the trials where it was applied, but no long-lasting changes in the retention of extinction were observed. Since not all LC cells expressed halorhodopsin, it is possible that more complete LC inhibition or pathway-specific targeting would be more effective at suppressing extinction learning. These results provide further insight into the neural basis of appetitive extinction, and in particular the role of the LC. A deeper understanding of the physiological bases of extinction can aid development of more effective extinction-based therapies.

The locus coeruleus as a global model failure system

Predictive processing models posit that brains constantly attempt to predict their sensory inputs. Prediction errors signal when these predictions are incorrect and are thought to be instructive signals that drive corrective plasticity. Recent findings support the idea that the locus coeruleus (LC) - a brain-wide neuromodulatory system - signals several types of prediction error. I discuss how these findings support models proposing that the LC signals global model failures: instances where predictions about the world are strongly violated. Focusing on the cortex, I explore the utility of this signal in learning rate control, how the LC circuit may compute the signal, and how this view may aid our understanding of neurodivergence.

The gene expression landscape of the human locus coeruleus revealed by single-nucleus and spatially-resolved transcriptomics

Norepinephrine (NE) neurons in the locus coeruleus (LC) make long-range projections throughout the central nervous system, playing critical roles in arousal and mood, as well as various components of cognition including attention, learning, and memory. The LC-NE system is also implicated in multiple neurological and neuropsychiatric disorders. Importantly, LC-NE neurons are highly sensitive to degeneration in both Alzheimer's and Parkinson's disease. Despite the clinical importance of the brain region and the prominent role of LC-NE neurons in a variety of brain and behavioral functions, a detailed molecular characterization of the LC is lacking. Here, we used a combination of spatially-resolved transcriptomics and single-nucleus RNA-sequencing to characterize the molecular landscape of the LC region and the transcriptomic profile of LC-NE neurons in the human brain. We provide a freely accessible resource of these data in web-accessible and downloadable formats.

Prefrontal dynamics and encoding of flexible rule switching

Behavioral flexibility, the ability to adjust behavioral strategies in response to changing environmental contingencies and internal demands, is fundamental to cognitive functions. Despite a large body of pharmacology and lesion studies, the underlying neurophysiological correlates and mechanisms that support flexible rule switching remain elusive. To address this question, we trained mice to distinguish complex sensory cues comprising different perceptual dimensions (set shifting). Endoscopic calcium imaging revealed that medial prefrontal cortex (mPFC) neurons represented multiple task-related events and exhibited pronounced dynamic changes during rule switching. Notably, prominent encoding capacity in the mPFC was associated with switching across, but not within perceptual dimensions. We then showed the involvement of the ascending modulatory input from the locus coeruleus (LC), as inhibiting the LC impaired rule switching behavior and impeded mPFC dynamic processes and encoding. Our results highlight the pivotal role of the mPFC in set shifting processes and demonstrate the profound impact of ascending neuromodulation on shaping prefrontal neural dynamics and behavioral flexibility.

Noradrenergic projections regulate the acquisition of classically conditioned eyelid responses in wild-type and are impaired in kreisler mice

During embryonic development, heterozygous mutant kreisler mice undergo ectopic expression of the Hoxa3 gene in the rostral hindbrain, affecting the opioid and noradrenergic systems. In this model, we have investigated behavioral and cognitive processes in their adulthood. We confirmed that pontine and locus coeruleus neuronal projections are impaired, by using startle and pain tests and by analyzing immunohistochemical localization of tyrosine hydroxylase. Our results showed that, even if kreisler mice are able to generate eyelid reflex responses, there are differences with wild-types in the first component of the response (R1), modulated by the noradrenergic system. The acquisition of conditioned motor responses is impaired in kreisler mice when using the trace but not the delay paradigm, suggesting a functional impairment in the hippocampus, subsequently confirmed by reduced quantification of alpha2a receptor mRNA expression in this area but not in the cerebellum. Moreover, we demonstrate the involvement of adrenergic projection in eyelid classical conditioning, as clonidine prevents the appearance of eyelid conditioned responses in wild-type mice. In addition, hippocampal motor learning ability was restored in kreisler mice by administration of adrenergic antagonist drugs, and a synergistic effect was observed following simultaneous administration of idazoxan and naloxone.

Basal Forebrain Modulation of Olfactory Coding In Vivo

Sensory perception is one of the most fundamental brain functions, allowing individuals to properly interact and adapt to a constantly changing environment. This process requires the integration of bottom-up and topdown neuronal activity, which is centrally mediated by the basal forebrain, a brain region that has been linked to a series of cognitive processes such as attention and alertness. Here, we review the latest research using optogenetic approaches in rodents and in vivo electrophysiological recordings that are shedding light on the role of this region, in regulating olfactory processing and decisionmaking. Moreover, we summarize evidence highlighting the anatomical and physiological differences in the basal forebrain of individuals with autism spectrum disorder, which could underpin the sensory perception abnormalities they exhibit, and propose this research line as a potential opportunity to understand the neurobiological basis of this disorder.

The locus coeruleus broadcasts prediction errors across the cortex to promote sensorimotor plasticity

Prediction errors are differences between expected and actual sensory input and are thought to be key computational signals that drive learning related plasticity. One way that prediction errors could drive learning is by activating neuromodulatory systems to gate plasticity. The catecholaminergic locus coeruleus (LC) is a major neuromodulatory system involved in neuronal plasticity in the cortex. Using two-photon calcium imaging in mice exploring a virtual environment, we found that the activity of LC axons in the cortex correlated with the magnitude of unsigned visuomotor prediction errors. LC response profiles were similar in both motor and visual cortical areas, indicating that LC axons broadcast prediction errors throughout the dorsal cortex. While imaging calcium activity in layer 2/3 of the primary visual cortex, we found that optogenetic stimulation of LC axons facilitated learning of a stimulus-specific suppression of visual responses during locomotion. This plasticity - induced by minutes of LC stimulation - recapitulated the effect of visuomotor learning on a scale that is normally observed during visuomotor development across days. We conclude that prediction errors drive LC activity, and that LC activity facilitates sensorimotor plasticity in the cortex, consistent with a role in modulating learning rates.

Heterogeneous organization of Locus coeruleus: An intrinsic mechanism for functional complexity

Locus coeruleus (LC) is a small nucleus located deep in the brainstem that contains the majority of central noradrenergic neurons, which provide the primary source of noradrenaline (NA) throughout the entire central nervous system (CNS).The release of neurotransmitter NA is considered to modulate arousal, sensory processing, attention, aversive and adaptive stress responses as well as high-order cognitive function and memory, with the highly ramified axonal arborizations of LC-NA neurons sending wide projections to the targeted brain areas. For over 30 years, LC was thought to be a homogeneous nucleus in structure and function due to the widespread uniform release of NA by LC-NA neurons and simultaneous action in several CNS regions, such as the prefrontal cortex, hippocampus, cerebellum, and spinal cord. However, recent advances in neuroscience tools have revealed that LC is probably not so homogeneous as we previous thought and exhibits heterogeneity in various aspects. Accumulating studies have shown that the functional complexity of LC may be attributed to its heterogeneity in developmental origin, projection patterns, topography distribution, morphology and molecular organization, electrophysiological properties and sex differences. This review will highlight the heterogeneity of LC and its critical role in modulating diverse behavioral outcomes.

Sleep disturbances in autism spectrum disorder: Animal models, neural mechanisms, and therapeutics

Sleep is crucial for brain development. Sleep disturbances are prevalent in children with autism spectrum disorder (ASD). Strikingly, these sleep problems are positively correlated with the severity of ASD core symptoms such as deficits in social skills and stereotypic behavior, indicating that sleep problems and the behavioral characteristics of ASD may be related. In this review, we will discuss sleep disturbances in children with ASD and highlight mouse models to study sleep disturbances and behavioral phenotypes in ASD. In addition, we will review neuromodulators controlling sleep and wakefulness and how these neuromodulatory systems are disrupted in animal models and patients with ASD. Lastly, we will address how the therapeutic interventions for patients with ASD improve various aspects of sleep. Together, gaining mechanistic insights into the neural mechanisms underlying sleep disturbances in children with ASD will help us to develop better therapeutic interventions.

From pupil to the brain: New insights for studying cortical plasticity through pupillometry

Pupil size variations have been associated with changes in brain activity patterns related with specific cognitive factors, such as arousal, attention, and mental effort. The locus coeruleus (LC), a key hub in the noradrenergic system of the brain, is considered to be a key regulator of cognitive control on pupil size, with changes in pupil diameter corresponding to the release of norepinephrine (NE). Advances in eye-tracking technology and open-source software have facilitated accurate pupil size measurement in various experimental settings, leading to increased interest in using pupillometry to track the nervous system activation state and as a potential biomarker for brain disorders. This review explores pupillometry as a non-invasive and fully translational tool for studying cortical plasticity starting from recent literature suggesting that pupillometry could be a promising technique for estimating the degree of residual plasticity in human subjects. Given that NE is known to be a critical mediator of cortical plasticity and arousal, the review includes data revealing the importance of the LC-NE system in modulating brain plasticity and pupil size. Finally, we will review data suggesting that pupillometry could provide a quantitative and complementary measure of cortical plasticity also in pre-clinical studies.

Inhibition of noradrenergic signalling in rodent orbitofrontal cortex impairs the updating of goal-directed actions

In a constantly changing environment, organisms must track the current relationship between actions and their specific consequences and use this information to guide decision-making. Such goal-directed behaviour relies on circuits involving cortical and subcortical structures. Notably, a functional heterogeneity exists within the medial prefrontal, insular, and orbitofrontal cortices (OFC) in rodents. The role of the latter in goal-directed behaviour has been debated, but recent data indicate that the ventral and lateral subregions of the OFC are needed to integrate changes in the relationships between actions and their outcomes. Neuromodulatory agents are also crucial components of prefrontal functions and behavioural flexibility might depend upon the noradrenergic modulation of the prefrontal cortex. Therefore, we assessed whether noradrenergic innervation of the OFC plays a role in updating action-outcome relationships in male rats. We used an identity-based reversal task and found that depletion or chemogenetic silencing of noradrenergic inputs within the OFC rendered rats unable to associate new outcomes with previously acquired actions. Silencing of noradrenergic inputs in the prelimbic cortex or depletion of dopaminergic inputs in the OFC did not reproduce this deficit. Together, our results suggest that noradrenergic projections to the OFC are required to update goal-directed actions.

Carbachol increases locus coeruleus activation by targeting noradrenergic neurons, inhibitory interneurons and inhibitory synaptic transmission

The locus coeruleus (LC) consists of noradrenergic (NA) neurons and plays an important role in controlling behaviours. Although much of the knowledge regarding LC functions comes from studying behavioural outcomes upon administration of muscarinic acetylcholine receptor (mAChR) agonists into the nucleus, the exact mechanisms remain unclear. Here, we report that the application of carbachol (CCh), an mAChR agonist, increased the spontaneous action potentials (sAPs) of both LC-NA neurons and local inhibitory interneurons (LC I-INs) in acute brain slices by activating M1/M3 mAChRs (m_1/3 AChRs). Optogenetic activation of LC I-INs evoked inhibitory postsynaptic currents (IPSCs) in LC-NA neurons that were mediated by γ-aminobutyric acid type A (GABA_A ) and glycine receptors, and CCh application decreased the IPSC amplitude through a presynaptic mechanism by activating M4 mAChRs (m₄ AChRs). LC-NA neurons also exhibited spontaneous phasic-like activity (sPLA); CCh application increased the incidence of this activity. This effect of CCh application was not observed with blockade of GABA_A and glycine receptors, suggesting that the sPLA enhancement occurred likely because of the decreased synaptic transmission of LC I-INs onto LC-NA neurons by the m₄ AChR activation and/or increased spiking rate of LC I-INs by the m_1/3 AChR activation, which could lead to fatigue of the synaptic transmission. In conclusion, we report that CCh application, while inhibiting their synaptic transmission, increases sAP rates of LC-NA neurons and LC I-INs. Collectively, these effects provide insight into the cellular mechanisms underlying the behaviour modulations following the administration of muscarinic receptor agonists into the LC reported by the previous studies.

Pupillary dynamics of mice performing a Pavlovian delay conditioning task reflect reward-predictive signals

Pupils can signify various internal processes and states, such as attention, arousal, and working memory. Changes in pupil size have been associated with learning speed, prediction of future events, and deviations from the prediction in human studies. However, the detailed relationships between pupil size changes and prediction are unclear. We explored pupil size dynamics in mice performing a Pavlovian delay conditioning task. A head-fixed experimental setup combined with deep-learning-based image analysis enabled us to reduce spontaneous locomotor activity and to track the precise dynamics of pupil size of behaving mice. By setting up two experimental groups, one for which mice were able to predict reward in the Pavlovian delay conditioning task and the other for which mice were not, we demonstrated that the pupil size of mice is modulated by reward prediction and consumption, as well as body movements, but not by unpredicted reward delivery. Furthermore, we clarified that pupil size is still modulated by reward prediction even after the disruption of body movements by intraperitoneal injection of haloperidol, a dopamine D2 receptor antagonist. These results suggest that changes in pupil size reflect reward prediction signals. Thus, we provide important evidence to reconsider the neuronal circuit involved in computing reward prediction error. This integrative approach of behavioral analysis, image analysis, pupillometry, and pharmacological manipulation will pave the way for understanding the psychological and neurobiological mechanisms of reward prediction and the prediction errors essential to learning and behavior.

Reward expectation extinction restructures and degrades CA1 spatial maps through loss of a dopaminergic reward proximity signal

Hippocampal place cells support reward-related spatial memories by forming a cognitive map that over-represents reward locations. The strength of these memories is modulated by the extent of reward expectation during encoding. However, the circuit mechanisms underlying this modulation are unclear. Here we find that when reward expectation is extinguished in mice, they remain engaged with their environment, yet place cell over-representation of rewards vanishes, place field remapping throughout the environment increases, and place field trial-to-trial reliability decreases. Interestingly, Ventral Tegmental Area (VTA) dopaminergic axons in CA1 exhibit a ramping reward-proximity signal that depends on reward expectation and inhibiting VTA dopaminergic neurons largely replicates the effects of extinguishing reward expectation. We conclude that changing reward expectation restructures CA1 cognitive maps and determines map reliability by modulating the dopaminergic VTA-CA1 reward-proximity signal. Thus, internal states of high reward expectation enhance encoding of spatial memories by reinforcing hippocampal cognitive maps associated with reward.

The locus coeruleus mediates behavioral flexibility

Behavioral flexibility is the ability to adjust behavioral strategies in response to changing environmental contingencies. A major hypothesis in the field posits that the activity of neurons in the locus coeruleus (LC) plays an important role in mediating behavioral flexibility. To test this hypothesis, we developed a tactile-based rule-shift detection task in which mice responded to left and right whisker deflections in a context-dependent manner and exhibited varying degrees of switching behavior. Recording spiking activity from optogenetically tagged neurons in the LC at millisecond precision during task performance revealed a prominent graded correlation between baseline LC activity and behavioral flexibility, where higher baseline activity following a rule change was associated with faster behavioral switching to the new rule. Increasing baseline LC activity with optogenetic activation accelerated task switching and improved task performance. Overall, our study provides important evidence to reveal the link between LC activity and behavioral flexibility.

Probing the structure and function of locus coeruleus projections to CNS motor centers

The brainstem nucleus locus coeruleus (LC) sends projections to the forebrain, brainstem, cerebellum and spinal cord and is a source of the neurotransmitter norepinephrine (NE) in these areas. For more than 50 years, LC was considered to be homogeneous in structure and function such that NE would be released uniformly and act simultaneously on the cells and circuits that receive LC projections. However, recent studies have provided evidence that LC is modular in design, with segregated output channels and the potential for differential release and action of NE in its projection fields. These new findings have prompted a radical shift in our thinking about LC operations and demand revision of theoretical constructs regarding impact of the LC-NE system on behavioral outcomes in health and disease. Within this context, a major gap in our knowledge is the relationship between the LC-NE system and CNS motor control centers. While we know much about the organization of the LC-NE system with respect to sensory and cognitive circuitries and the impact of LC output on sensory guided behaviors and executive function, much less is known about the role of the LC-NE pathway in motor network operations and movement control. As a starting point for closing this gap in understanding, we propose using an intersectional recombinase-based viral-genetic strategy TrAC (Tracing Axon Collaterals) as well as established ex vivo electrophysiological assays to characterize efferent connectivity and physiological attributes of mouse LC-motor network projection neurons. The novel hypothesis to be tested is that LC cells with projections to CNS motor centers are scattered throughout the rostral-caudal extent of the nucleus but collectively display a common set of electrophysiological properties. Additionally, we expect to find these LC projection neurons maintain an organized network of axon collaterals capable of supporting selective, synchronous release of NE in motor circuitries for the purpose of coordinately regulating operations across networks that are responsible for balance and movement dynamics. Investigation of this hypothesis will advance our knowledge of the role of the LC-NE system in motor control and provide a basis for treating movement disorders resulting from disease, injury, or normal aging.

Spatiotemporal dynamics of noradrenaline during learned behaviour

Noradrenaline released from the locus coeruleus (LC) is a ubiquitous neuromodulator^1-4 that has been linked to multiple functions including arousal^5-8, action and sensory gain^9-11, and learning^12-16. Whether and how activation of noradrenaline-expressing neurons in the LC (LC-NA) facilitates different components of specific behaviours is unknown. Here we show that LC-NA activity displays distinct spatiotemporal dynamics to enable two functions during learned behaviour: facilitating task execution and encoding reinforcement to improve performance accuracy. To examine these functions, we used a behavioural task in mice with graded auditory stimulus detection and task performance. Optogenetic inactivation of the LC demonstrated that LC-NA activity was causal for both task execution and optimization. Targeted recordings of LC-NA neurons using photo-tagging, two-photon micro-endoscopy and two-photon output monitoring showed that transient LC-NA activation preceded behavioural execution and followed reinforcement. These two components of phasic activity were heterogeneously represented in LC-NA cortical outputs, such that the behavioural response signal was higher in the motor cortex and facilitated task execution, whereas the negative reinforcement signal was widely distributed among cortical regions and improved response sensitivity on the subsequent trial. Modular targeting of LC outputs thus enables diverse functions, whereby some noradrenaline signals are segregated among targets, whereas others are broadly distributed.

Neural, physiological, and psychological markers of appetitive conditioning in anorexia nervosa: a study protocol

BACKGROUND

Anorexia nervosa (AN) is a chronic and disabling psychiatric condition characterized by low hedonic drive towards food, and is thought to be inclusive of altered dimensions of reward processing. Whether there exists a fundamental aberrancy in the capacity to acquire and maintain de novo hedonic associations-a critical component of hedonic responding-has never been studied in AN.

METHODS

This multi-modal study will employ a 2-day Pavlovian appetitive conditioning paradigm to interrogate the (1) acquisition, (2) extinction, (3) spontaneous recovery and (4) reinstatement of appetitive learning in adolescents and young adults with AN. Participants will be 30 currently ill, underweight individuals with AN; 30 weight-restored individuals with AN; and 30 age-matched healthy controls, all aged 12-22 years. All subjects will undergo clinical assessment, followed by the 2-day appetitive conditioning task during which fMRI, pupillometry, heart rate deceleration, and subjective ratings will be acquired.

DISCUSSION

This study will be the first to interrogate appetitive conditioning in AN-a disorder characterized by altered hedonic responding to food. Results will help establish objective biomarkers of appetitive conditioning in AN and lay the groundwork for developing novel lines of treatment for AN and other psychiatric disorders involving diminished ability to experience pleasure and reward.

TRIAL REGISTRATION

Pending.

INTENDED REGISTRY

Clinicaltrials.gov.

Neuromodulation and Neurophysiology on the Timescale of Learning and Decision-Making

Nervous systems evolved to effectively navigate the dynamics of the environment to achieve their goals. One framework used to study this fundamental problem arose in the study of learning and decision-making. In this framework, the demands of effective behavior require slow dynamics-on the scale of seconds to minutes-of networks of neurons. Here, we review the phenomena and mechanisms involved. Using vignettes from a few species and areas of the nervous system, we view neuromodulators as key substrates for temporal scaling of neuronal dynamics. Expected final online publication date for the Annual Review of Neuroscience, Volume 45 is July 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

A neurobiological perspective on social influence: Serotonin and social adaptation

Humans are inherently social beings. Being suggestible to each other's expectations enables pro-social skills that are crucial for social learning and adaptation. Despite its high relevance for psychiatry, the neurobiological mechanisms underlying social adaptation are still not well understood. This review therefore provides a conceptual framework covering various distinct mechanisms underlying social adaptation and explores the neuropharmacology - in particular the role of the serotonin (5-HT) system - modulating these mechanisms. This article therefore reviews empirical results on social influence processing and reconciles them with recent findings from psychedelic research on social processing to elucidate neurobiological and neuropharmacological underpinnings of social adaptation. Various computational, neurobiological, and neurochemical processes are involved in distinct mechanisms underlying social adaptation such as the multisensory process of social information integration that is crucial for the forming of self-representation and representations of social norms. This is again associated with self- and other-perception during social interactions as well as value-based decision making that guides our behaviour in daily interactions. We highlight the critical role of 5-HT in these processes and suggest that 5-HT can facilitate social learning and may represent an important target for treating psychiatric disorders characterized by impairments in social functioning. This framework also has important implications for psychedelic-assisted therapy as well as for the development of novel treatment approaches and future research directions.

Neural Correlates of Successful Costly Punishment in the Ultimatum Game on a Trial-by-Trial Basis

Costly punishment describes decisions of an interaction partner to punish an opponent for violating rules of fairness at the expense of personal costs. Here, we extend the interaction process by investigating the impact of a socio-emotional reaction of the opponent in response to the punishment that indicates whether punishment was successful or not. In a modified Ultimatum game, emotional facial expressions of the proposer in response to the decision of the responder served as feedback stimuli. We found that both honored reward following acceptance of an offer (smiling compared to neutral facial expression) and successful punishment (sad compared to neutral facial expression) elicited a reward positivity, indicating that punishment was the intended outcome. By comparing the pattern of results with a probabilistic learning task, we show that the reward positivity on sad facial expressions was specific for the context of costly punishment. Additionally, acceptance rates on a trial-by-trial basis were altered according to P3 amplitudes in response to the emotional facial reaction of the proposer. Our results are in line with the concept of costly punishment as an intentional act following norm-violating behavior. Socio-emotional stimuli have an important influence on the perception and behavior in economic bargaining.

Context-dependent relationships between locus coeruleus firing patterns and coordinated neural activity in the anterior cingulate cortex

Ascending neuromodulatory projections from the locus coeruleus (LC) affect cortical neural networks via the release of norepinephrine (NE). However, the exact nature of these neuromodulatory effects on neural activity patterns in vivo is not well understood. Here, we show that in awake monkeys, LC activation is associated with changes in coordinated activity patterns in the anterior cingulate cortex (ACC). These relationships, which are largely independent of changes in firing rates of individual ACC neurons, depend on the type of LC activation: ACC pairwise correlations tend to be reduced when ongoing (baseline) LC activity increases but enhanced when external events evoke transient LC responses. Both relationships covary with pupil changes that reflect LC activation and arousal. These results suggest that modulations of information processing that reflect changes in coordinated activity patterns in cortical networks can result partly from ongoing, context-dependent, arousal-related changes in activation of the LC-NE system.

Locus coeruleus neurons encode the subjective difficulty of triggering and executing actions

The brain stem noradrenergic nucleus locus coeruleus (LC) is involved in various costly processes: arousal, stress, and attention. Recent work has pointed toward an implication in physical effort, and indirect evidence suggests that the LC could be also involved in cognitive effort. To assess the dynamic relation between LC activity, effort production, and difficulty, we recorded the activity of 193 LC single units in 5 monkeys performing 2 discounting tasks (a delay discounting task and a force discounting task), as well as a simpler target detection task where conditions were matched for difficulty and only differed in terms of sensory-motor processes. First, LC neurons displayed a transient activation both when monkeys initiated an action and when exerting force. Second, the magnitude of the activation scaled with the associated difficulty, and, potentially, the corresponding amount of effort produced, both for decision and force production. Indeed, at action initiation in both discounting tasks, LC activation increased in conditions associated with lower average engagement rate, i.e., those requiring more cognitive control to trigger the response. Decision-related activation also scaled with response time (RT), over and above task parameters, in line with the idea that it reflects the amount of resources (here time) spent on the decision process. During force production, LC activation only scaled with the amount of force produced in the force discounting task, but not in the control target detection task, where subjective difficulty was equivalent across conditions. Our data show that LC neurons dynamically track the amount of effort produced to face both cognitive and physical challenges with a subsecond precision. This works provides key insight into effort processing and the contribution of the noradrenergic system, which is affected in several pathologies where effort is impaired, including Parkinson disease and depression.

Return of the Righting Reflex Does Not Portend Recovery of Cognitive Function in Anesthetized Rats

As the number of individuals undergoing general anesthesia rises globally, it becomes increasingly important to understand how consciousness and cognition are restored after anesthesia. In rodents, levels of consciousness are traditionally captured by physiological responses such as the return of righting reflex (RORR). However, tracking the recovery of cognitive function is comparatively difficult. Here we use an operant conditioning task, the 5-choice serial reaction time task (5-CSRTT), to measure sustained attention, working memory, and inhibitory control in male and female rats as they recover from the effects of several different clinical anesthetics. In the 5-CSRTT, rats learn to attend to a five-windowed touchscreen for the presentation of a stimulus. Rats are rewarded with food pellets for selecting the correct window within the time limit. During each session we tracked both the proportion of correct (accuracy) and missed (omissions) responses over time. Cognitive recovery trajectories were assessed after isoflurane (2% for 1 h), sevoflurane (3% for 20 min), propofol (10 mg/kg I.V. bolus), ketamine (50 mg/kg I.V. infusion over 10 min), and dexmedetomidine (20 and 35 μg/kg I.V. infusions over 10 min) for up to 3 h following RORR. Rats were classified as having recovered accuracy performance when four of their last five responses were correct, and as having recovered low omission performance when they missed one or fewer of their last five trials. Following isoflurane, sevoflurane, and propofol anesthesia, the majority (63-88%) of rats recovered both accuracy and low omission performance within an hour of RORR. Following ketamine, accuracy performance recovers within 2 h in most (63%) rats, but low omission performance recovers in only a minority (32%) of rats within 3 h. Finally, following either high or low doses of dexmedetomidine, few rats (25-32%) recover accuracy performance, and even fewer (0-13%) recover low omission performance within 3 h. Regardless of the anesthetic, RORR latency is not correlated with 5-CSRTT performance, which suggests that recovery of neurocognitive function cannot be inferred from changes in levels of consciousness. These results demonstrate how operant conditioning tasks can be used to assess real-time recovery of neurocognitive function following different anesthetic regimens.

A Bridge between the Breath and the Brain: Synchronization of Respiration, a Pupillometric Marker of the Locus Coeruleus, and an EEG Marker of Attentional Control State

Yogic and meditative traditions have long held that the fluctuations of the breath and the mind are intimately related. While respiratory modulation of cortical activity and attentional switching are established, the extent to which electrophysiological markers of attention exhibit synchronization with respiration is unknown. To this end, we examined (1) frontal midline theta-beta ratio (TBR), an indicator of attentional control state known to correlate with mind wandering episodes and functional connectivity of the executive control network; (2) pupil diameter (PD), a known proxy measure of locus coeruleus (LC) noradrenergic activity; and (3) respiration for evidence of phase synchronization and information transfer (multivariate Granger causality) during quiet restful breathing. Our results indicate that both TBR and PD are simultaneously synchronized with the breath, suggesting an underlying oscillation of an attentionally relevant electrophysiological index that is phase-locked to the respiratory cycle which could have the potential to bias the attentional system into switching states. We highlight the LC’s pivotal role as a coupling mechanism between respiration and TBR, and elaborate on its dual functions as both a chemosensitive respiratory nucleus and a pacemaker of the attentional system. We further suggest that an appreciation of the dynamics of this weakly coupled oscillatory system could help deepen our understanding of the traditional claim of a relationship between breathing and attention.

When and How Does the Auditory Cortex Influence Subcortical Auditory Structures? New Insights About the Roles of Descending Cortical Projections

For decades, the corticofugal descending projections have been anatomically well described but their functional role remains a puzzling question. In this review, we will first describe the contributions of neuronal networks in representing communication sounds in various types of degraded acoustic conditions from the cochlear nucleus to the primary and secondary auditory cortex. In such situations, the discrimination abilities of collicular and thalamic neurons are clearly better than those of cortical neurons although the latter remain very little affected by degraded acoustic conditions. Second, we will report the functional effects resulting from activating or inactivating corticofugal projections on functional properties of subcortical neurons. In general, modest effects have been observed in anesthetized and in awake, passively listening, animals. In contrast, in behavioral tasks including challenging conditions, behavioral performance was severely reduced by removing or transiently silencing the corticofugal descending projections. This suggests that the discriminative abilities of subcortical neurons may be sufficient in many acoustic situations. It is only in particularly challenging situations, either due to the task difficulties and/or to the degraded acoustic conditions that the corticofugal descending connections bring additional abilities. Here, we propose that it is both the top-down influences from the prefrontal cortex, and those from the neuromodulatory systems, which allow the cortical descending projections to impact behavioral performance in reshaping the functional circuitry of subcortical structures. We aim at proposing potential scenarios to explain how, and under which circumstances, these projections impact on subcortical processing and on behavioral responses.

Navigating for reward

An organism's survival can depend on its ability to recall and navigate to spatial locations associated with rewards, such as food or a home. Accumulating research has revealed that computations of reward and its prediction occur on multiple levels across a complex set of interacting brain regions, including those that support memory and navigation. However, how the brain coordinates the encoding, recall and use of reward information to guide navigation remains incompletely understood. In this Review, we propose that the brain's classical navigation centres - the hippocampus and the entorhinal cortex - are ideally suited to coordinate this larger network by representing both physical and mental space as a series of states. These states may be linked to reward via neuromodulatory inputs to the hippocampus-entorhinal cortex system. Hippocampal outputs can then broadcast sequences of states to the rest of the brain to store reward associations or to facilitate decision-making, potentially engaging additional value signals downstream. This proposal is supported by recent advances in both experimental and theoretical neuroscience. By discussing the neural systems traditionally tied to navigation and reward at their intersection, we aim to offer an integrated framework for understanding navigation to reward as a fundamental feature of many cognitive processes.

Over-representation of fundamental decision variables in the prefrontal cortex underlies decision bias

The brain is organized into anatomically distinct structures consisting of a variety of projection neurons. While such evolutionarily conserved neural circuit organization underlies the innate ability of animals to swiftly adapt to environments, they can cause biased cognition and behavior. Although recent studies have begun to address the causal importance of projection-neuron types as distinct computational units, it remains unclear how projection types are functionally organized in encoding variables during cognitive tasks. This review focuses on the neural computation of decision making in the prefrontal cortex and discusses what decision variables are encoded by single neurons, neuronal populations, and projection type, alongside how specific projection types constrain decision making. We focus particularly on "over-representations" of distinct decision variables in the prefrontal cortex that reflect the biological and subjective significance of the variables for the decision makers. We suggest that task-specific over-representation in the prefrontal cortex involves the refinement of the given decision making, while generalized over-representation of fundamental decision variables is associated with suboptimal decision biases, including pathological ones such as those in patients with psychiatric disorders. Such over-representation of the fundamental decision variables in the prefrontal cortex appear to be tightly constrained by afferent and efferent connections that can be optogenetically intervened on. These ideas may provide critical insights into potential therapeutic targets for psychiatric disorders, including addiction and depression.

Locus Coeruleus Norepinephrine in Learned Behavior: Anatomical Modularity and Spatiotemporal Integration in Targets

The locus coeruleus (LC), a small brainstem nucleus, is the primary source of the neuromodulator norepinephrine (NE) in the brain. The LC receives input from widespread brain regions, and projects throughout the forebrain, brainstem, cerebellum, and spinal cord. LC neurons release NE to control arousal, but also in the context of a variety of sensory-motor and behavioral functions. Despite its brain-wide effects, much about the role of LC-NE in behavior and the circuits controlling LC activity is unknown. New evidence suggests that the modular input-output organization of the LC could enable transient, task-specific modulation of distinct brain regions. Future work must further assess whether this spatial modularity coincides with functional differences in LC-NE subpopulations acting at specific times, and how such spatiotemporal specificity might influence learned behaviors. Here, we summarize the state of the field and present new ideas on the role of LC-NE in learned behaviors.

Real-world stress resilience is associated with the responsivity of the locus coeruleus

Individuals may show different responses to stressful events. Here, we investigate the neurobiological basis of stress resilience, by showing that neural responsitivity of the noradrenergic locus coeruleus (LC-NE) and associated pupil responses are related to the subsequent change in measures of anxiety and depression in response to prolonged real-life stress. We acquired fMRI and pupillometry data during an emotional-conflict task in medical residents before they underwent stressful emergency-room internships known to be a risk factor for anxiety and depression. The LC-NE conflict response and its functional coupling with the amygdala was associated with stress-related symptom changes in response to the internship. A similar relationship was found for pupil-dilation, a potential marker of LC-NE firing. Our results provide insights into the noradrenergic basis of conflict generation, adaptation and stress resilience.

Neural substrates of appetitive and aversive prediction error

Prediction error, defined by the discrepancy between real and expected outcomes, lies at the core of associative learning. Behavioural investigations have provided evidence that prediction error up- and down-regulates associative relationships, and allocates attention to stimuli to enable learning. These behavioural advances have recently been followed by investigations into the neurobiological substrates of prediction error. In the present paper, we review neuroscience data obtained using causal and recording neural methods from a variety of key behavioural designs. We explore the neurobiology of both appetitive (reward) and aversive (fear) prediction error with a focus on the mesolimbic dopamine system, the amygdala, ventrolateral periaqueductal gray, hippocampus, cortex and locus coeruleus noradrenaline. New questions and avenues for research are considered.

Dopamine, Prediction Error and Beyond

A large body of work has linked dopaminergic signaling to learning and reward processing. It stresses the role of dopamine in reward prediction error signaling, a key neural signal that allows us to learn from past experiences, and that facilitates optimal choice behavior. Latterly, it has become clear that dopamine does not merely code prediction error size but also signals the difference between the expected value of rewards, and the value of rewards actually received, which is obtained through the integration of reward attributes such as the type, amount, probability and delay. More recent work has posited a role of dopamine in learning beyond rewards. These theories suggest that dopamine codes absolute or unsigned prediction errors, playing a key role in how the brain models associative regularities within its environment, while incorporating critical information about the reliability of those regularities. Work is emerging supporting this perspective and, it has inspired theoretical models of how certain forms of mental pathology may emerge in relation to dopamine function. Such pathology is frequently related to disturbed inferences leading to altered internal models of the environment. Thus, it is critical to understand the role of dopamine in error-related learning and inference.

Does surprise enhance infant memory? Assessing the impact of the encoding context on subsequent object recognition

A discrepancy between what was predicted and what is observed has been linked to increased looking times, changes in brain electrical activity, and increased pupil dilation in infants. These processes associated with heightened attention and readiness to learn might enhance the encoding and memory consolidation of the surprising object, as suggested by both the infant and the adult literature. We therefore investigated whether the presence of surprise during the encoding context enhances subsequent encoding and recognition memory processes for the items that violated infants' expectations. Seventeen-month-olds viewed 20 familiar objects, half of which were labeled correctly, while the other half were mislabeled. Subsequently, infants were presented with a silent recognition memory test where the previously labeled objects appeared along with new images. Pupil dilation was measured, with more dilated pupils indicating (1) surprise during those labeling events where the item was mislabeled and (2) successful retrieval processes during the memory test. Infants responded with more pupil dilation to mislabeling compared to correct labeling. Importantly, despite the presence of a surprise response during mislabeling, infants only differentiated between the previously seen and unseen items at the memory test, offering no evidence that surprise had facilitated the encoding of the mislabeled items.

Integration of value and action in medial prefrontal neural systems

The rodent medial prefrontal cortex (mPFC) plays a key role in regulating cognition, emotion, and behavior. mPFC neurons are activated in diverse experimental paradigms, raising the questions of whether there are specific task elements or dimensions encoded by mPFC neurons, and whether these encoded parameters are selective to neurons in particular mPFC subregions or networks. Here, we consider the role of mPFC neurons in processing appetitive and aversive cues, outcomes, and related behaviors. mPFC neurons are strongly activated in tasks probing value and outcome-associated actions, but these responses vary across experimental paradigms. Can we identify specific categories of responses (e.g., positive or negative value), or do mPFC neurons exhibit response properties that are too heterogeneous/complex to cluster into distinct conceptual groups? Based on a review of relevant studies, we consider what has been done and what needs to be further explored in order to address these questions.

Differential attentional control mechanisms by two distinct noradrenergic coeruleo-frontal cortical pathways

The attentional control of behavior is a higher-order cognitive function that operates through attention and response inhibition. The locus coeruleus (LC), the main source of norepinephrine in the brain, is considered to be involved in attentional control by modulating the neuronal activity of the prefrontal cortex (PFC). However, evidence for the causal role of LC activity in attentional control remains elusive. Here, by using behavioral and optogenetic techniques, we investigate the effect of LC neuron activation or inhibition in operant tests measuring attention and response inhibition (i.e., a measure of impulsive behavior). We show that LC neuron stimulation increases goal-directed attention and decreases impulsivity, while its suppression exacerbates distractibility and increases impulsive responding. Remarkably, we found that attention and response inhibition are under the control of two divergent projections emanating from the LC: one to the dorso-medial PFC and the other to the ventro-lateral orbitofrontal cortex, respectively. These findings are especially relevant for those pathological conditions characterized by attention deficits and elevated impulsivity.