Locus coeruleus neurons encode the subjective difficulty of triggering and executing actions

Pupillary response to cognitive control in depression-prone individuals

Revealing the pupillary correlates of depression-prone individuals is conducive to the early intervention and treatment of depression. This study recruited 31 depression-prone and 31 healthy individuals. They completed an emotional task-switching task combined with a go/no-go task, and task-evoked pupillary responses (TEPR) were recorded. Behavioral results showed no significant differences in behavioral performance in terms of cognitive flexibility and inhibition between the depression-prone group and the healthy control group. The pupillary results revealed that (1) the depression-prone group showed slightly lower TEPRs to positive stimuli than the healthy controls during cue presentation; (2) during target presentation, the depression-prone group did not show an effect of emotional valence on the pupillary response in the task-repeat trials; and (3) compared to the healthy controls, the depression-prone group showed significantly smaller TEPRs to negative no-go stimuli and had a longer latency of the second peak of pupil dilation in no-go trials. These results imply that depression-prone individuals may have slower neural responses in cognitive control tasks and emotion-specific weakened cognitive control than healthy individuals.

Pupil dilation reflects effortful action invigoration in overcoming aversive Pavlovian biases

"Pavlovian" or "motivational" biases describe the phenomenon that the valence of prospective outcomes modulates action invigoration: Reward prospect invigorates action, whereas punishment prospect suppresses it. The adaptive role of these biases in decision-making is still unclear. One idea is that they constitute a fast-and-frugal decision strategy in situations characterized by high arousal, e.g., in presence of a predator, which demand a quick response. In this pre-registered study (N = 35), we tested whether such a situation-induced via subliminally presented angry versus neutral faces-leads to increased reliance on Pavlovian biases. We measured trial-by-trial arousal by tracking pupil diameter while participants performed an orthogonalized Motivational Go/NoGo Task. Pavlovian biases were present in responses, reaction times, and even gaze, with lower gaze dispersion under aversive cues reflecting "freezing of gaze." The subliminally presented faces did not affect responses, reaction times, or pupil diameter, suggesting that the arousal manipulation was ineffective. However, pupil dilations reflected facets of bias suppression, specifically the physical (but not cognitive) effort needed to overcome aversive inhibition: Particularly strong and sustained dilations occurred when participants managed to perform Go responses to aversive cues. Conversely, no such dilations occurred when they managed to inhibit responses to Win cues. These results suggest that pupil diameter does not reflect response conflict per se nor the inhibition of prepotent responses, but specifically effortful action invigoration as needed to overcome aversive inhibition. We discuss our results in the context of the "value of work" theory of striatal dopamine.

Atomoxetine and reward size equally improve task engagement and perceptual decisions but differently affect movement execution

Our ability to engage and perform daily activities relies on balancing the associated benefits and costs. Rewards, as benefits, act as powerful motivators that help us stay focused for longer durations. The noradrenergic (NA) system is thought to play a significant role in optimizing our performance. Yet, the interplay between reward and the NA system in shaping performance remains unclear, particularly when actions are driven by external incentives (reward). To explore this interaction, we tested four female rhesus monkeys performing a sustained Go/NoGo task under two reward sizes (low/high) and three pharmacological conditions (saline and two doses of atomoxetine, a NA reuptake inhibitor: ATX-0.5 mg/kg and ATX-1 mg/kg). We found that increasing either reward or NA levels equally enhanced the animal's engagement in the task compared to low reward saline; the animals also responded faster and more consistently under these circumstances. Notably, we identified differences between reward size and ATX. When combined with ATX, high reward further reduced the occurrence of false alarms (i.e., incorrect go trials on distractors), implying that it helped further suppress impulsive responses. In addition, ATX (but not reward size) consistently increased movement duration dose-dependently, while high reward did not affect movement duration but decreased its variability. We conclude that noradrenaline and reward modulate performance, but their effects are not identical, suggesting differential underlying mechanisms. Reward might energize/invigorate decisions and action, while ATX might help regulate energy expenditure, depending on the context, through the NA system.

Effort Foraging Task reveals positive correlation between individual differences in the cost of cognitive and physical effort in humans

Effort-based decisions, in which people weigh potential future rewards against effort costs required to achieve those rewards involve both cognitive and physical effort, though the mechanistic relationship between them is not yet understood. Here, we use an individual differences approach to isolate and measure the computational processes underlying effort-based decisions and test the association between cognitive and physical domains. Patch foraging is an ecologically valid reward rate maximization problem with well-developed theoretical tools. We developed the Effort Foraging Task, which embedded cognitive or physical effort into patch foraging, to quantify the cost of both cognitive and physical effort indirectly, by their effects on foraging choices. Participants chose between harvesting a depleting patch, or traveling to a new patch that was costly in time and effort. Participants' exit thresholds (reflecting the reward they expected to receive by harvesting when they chose to travel to a new patch) were sensitive to cognitive and physical effort demands, allowing us to quantify the perceived effort cost in monetary terms. The indirect sequential choice style revealed effort-seeking behavior in a minority of participants (preferring high over low effort) that has apparently been missed by many previous approaches. Individual differences in cognitive and physical effort costs were positively correlated, suggesting that these are perceived and processed in common. We used canonical correlation analysis to probe the relationship of task measures to self-reported affect and motivation, and found correlations of cognitive effort with anxiety, cognitive function, behavioral activation, and self-efficacy, but no similar correlations with physical effort.

Effort cost of harvest affects decisions and movement vigor of marmosets during foraging

Our decisions are guided by how we perceive the value of an option, but this evaluation also affects how we move to acquire that option. Why should economic variables such as reward and effort alter the vigor of our movements? In theory, both the option that we choose and the vigor with which we move contribute to a measure of fitness in which the objective is to maximize rewards minus efforts, divided by time. To explore this idea, we engaged marmosets in a foraging task in which on each trial they decided whether to work by making saccades to visual targets, thus accumulating food, or to harvest by licking what they had earned. We varied the effort cost of harvest by moving the food tube with respect to the mouth. Theory predicted that the subjects should respond to the increased effort costs by choosing to work longer, stockpiling food before commencing harvest, but reduce their movement vigor to conserve energy. Indeed, in response to an increased effort cost of harvest, marmosets extended their work duration, but slowed their movements. These changes in decisions and movements coincided with changes in pupil size. As the effort cost of harvest declined, work duration decreased, the pupils dilated, and the vigor of licks and saccades increased. Thus, when acquisition of reward became effortful, the pupils constricted, the decisions exhibited delayed gratification, and the movements displayed reduced vigor.

A Multi-task Platform for Profiling Cognitive and Motivational Constructs in Humans and Nonhuman Primates

Background

Understanding the neurobiological substrates of psychiatric disorders requires comprehensive evaluations of cognitive and motivational functions in preclinical research settings. The translational validity of such evaluations will be supported by (1) tasks with high construct validity that are engaging and easy to teach to human and nonhuman participants, (2) software that enables efficient switching between multiple tasks in single sessions, (3) software that supports tasks across a broad range of physical experimental setups, and (4) by platform architectures that are easily extendable and customizable to encourage future optimization and development.

New Method

We describe the Multi-task Universal Suite for Experiments ( M-USE ), a software platform designed to meet these requirements. It leverages the Unity video game engine and C# programming language to (1) support immersive and engaging tasks for humans and nonhuman primates, (2) allow experimenters or participants to switch between multiple tasks within-session, (3) generate builds that function across computers, tablets, and websites, and (4) is freely available online with documentation and tutorials for users and developers. M-USE includes a task library with seven pre-existing tasks assessing cognitive and motivational constructs of perception, attention, working memory, cognitive flexibility, motivational and affective self-control, relational long-term memory, and visuo-spatial problem solving.

Results

M-USE was used to test NHPs on up to six tasks per session, all available as part of the Task Library, and to extract performance metrics for all major cognitive and motivational constructs spanning the Research Domain Criteria (RDoC) of the National Institutes of Mental Health.

Comparison with Existing Methods

Other experiment design and control systems exist, but do not provide the full range of features available in M-USE, including a pre-existing task library for cross-species assessments; the ability to switch seamlessly between tasks in individual sessions; cross-platform build capabilities; license-free availability; and its leveraging of video-engine capabilities used to gamify tasks.

Conclusions

The new multi-task platform facilitates cross-species translational research for understanding the neurobiological substrates of higher cognitive and motivational functions.

Noradrenergic alpha-2a Receptor Stimulation Enhances Prediction Error Signaling in Anterior Cingulate Cortex and Striatum

The noradrenergic system is implicated to support behavioral flexibility by increasing exploration during periods of uncertainty and by enhancing working memory for goal-relevant stimuli. Possible sources mediating these pro-cognitive effects are α2A adrenoceptors (α2AR) in prefrontal cortex or the anterior cingulate cortex facilitating fronto-striatal learning processes. We tested this hypothesis by selectively stimulating α2ARs using Guanfacine during feature-based attentional set shifting in nonhuman primates. We found that α2A stimulation improved learning from errors and facilitates updating the target feature of an attentional set. Neural recordings in the anterior cingulate cortex (ACC), the dorsolateral prefrontal cortex (dlPFC), and the striatum showed that α2A stimulation selectively enhanced the neural representation of negative reward prediction errors in neurons of the ACC and of positive prediction errors in the striatum, but not in dlPFC. This modulation was accompanied by enhanced encoding of the feature and location of the attended target across the fronto-striatal network. Enhanced learning was paralleled by enhanced encoding of outcomes in putative fast-spiking interneurons in the ACC, dlPFC, and striatum but not in broad spiking cells, pointing to an interneuron mediated mechanism of α2AR action. These results illustrate that α2A receptors causally support the noradrenergic enhancement of updating attention sets through an enhancement of prediction error signaling in the ACC and the striatum.

Effort cost of harvest affects decisions and movement vigor of marmosets during foraging

Our decisions are guided by how we perceive the value of an option, but this evaluation also affects how we move to acquire that option. Why should economic variables such as reward and effort alter the vigor of our movements? In theory, both the option that we choose and the vigor with which we move contribute to a measure of fitness in which the objective is to maximize rewards minus efforts, divided by time. To explore this idea, we engaged marmosets in a foraging task in which on each trial they decided whether to work by making saccades to visual targets, thus accumulating food, or to harvest by licking what they had earned. We varied the effort cost of harvest by moving the food tube with respect to the mouth. Theory predicted that the subjects should respond to the increased effort costs by choosing to work longer, stockpiling food before commencing harvest, but reduce their movement vigor to conserve energy. Indeed, in response to an increased effort cost of harvest, marmosets extended their work duration, but slowed their movements. These changes in decisions and movements coincided with changes in pupil size. As the effort cost of harvest declined, work duration decreased, the pupils dilated, and the vigor of licks and saccades increased. Thus, when acquisition of reward became effortful, the pupils constricted, the decisions exhibited delayed gratification, and the movements displayed reduced vigor.

Significance statement

Our results suggest that as the brainstem neuromodulatory circuits that control pupil size respond to effort costs, they alter computations in the brain regions that control decisions, encouraging work and delaying gratification, and the brain regions that control movements, reducing vigor and suppressing energy expenditure. This coordinated response suggests that decisions and actions are part of a single control policy that aims to maximize a variable relevant to fitness: the capture rate.

Whole-brain afferent input mapping to functionally distinct brainstem noradrenaline cell types

The locus coeruleus (LC) is a small region in the pons and the main source of noradrenaline (NA) to the forebrain. While traditional models suggested that all LC-NA neurons project indiscriminately throughout the brain, accumulating evidence indicates that these cells can be heterogeneous based on their anatomical connectivity and behavioral functionality and exhibit distinct coding modes. How LC-NA neuronal subpopulations are endowed with unique functional properties is unclear. Here, we used a viral-genetic approach for mapping anatomical connectivity at different levels of organization based on inputs and outputs of defined cell classes. Specifically, we studied the whole-brain afferent inputs onto two functionally distinct LC-NA neuronal subpopulations which project to amygdala or medial prefrontal cortex (mPFC). We found that the global input distribution is similar for both LC-NA neuronal subpopulations. However, finer analysis demonstrated important differences in inputs from specific brain regions. Moreover, sex related differences were apparent, but only in inputs to amygdala-projecting LC-NA neurons. These findings reveal a cell type and sex specific afferent input organization which could allow for context dependent and target specific control of NA outflow to forebrain structures involved in emotional control and decision making.

Levodopa responsive freezing of gait is associated with reduced norepinephrine transporter binding in Parkinson's disease

BACKGROUND

Freezing of gait (FOG) is a major cause of falling in Parkinson's disease (PD) and can be responsive or unresponsive to levodopa. Pathophysiology is poorly understood.

OBJECTIVE

To examine the link between noradrenergic systems, the development of FOG in PD and its responsiveness to levodopa.

METHODS

We examined norepinephrine transporter (NET) binding via brain positron emission tomography (PET) to evaluate changes in NET density associated with FOG using the high affinity selective NET antagonist radioligand [¹¹C]MeNER (2S,3S)(2-[α-(2-methoxyphenoxy)benzyl]morpholine) in 52 parkinsonian patients. We used a rigorous levodopa challenge paradigm to characterize PD patients as non-freezing (NO-FOG, N = 16), levodopa responsive freezing (OFF-FOG, N = 10), and levodopa-unresponsive freezing (ONOFF-FOG, N = 21), and also included a non-PD FOG group, primary progressive freezing of gait (PP-FOG, N = 5).

RESULTS

Linear mixed models identified significant reductions in whole brain NET binding in the OFF-FOG group compared to the NO-FOG group (-16.8%, P = 0.021) and regionally in the frontal lobe, left and right thalamus, temporal lobe, and locus coeruleus, with the strongest effect in right thalamus (P = 0.038). Additional regions examined in a post hoc secondary analysis including the left and right amygdalae confirmed the contrast between OFF-FOG and NO-FOG (P = 0.003). A linear regression analysis identified an association between reduced NET binding in the right thalamus and more severe New FOG Questionnaire (N-FOG-Q) score only in the OFF-FOG group (P = 0.022).

CONCLUSION

This is the first study to examine brain noradrenergic innervation using NET-PET in PD patients with and without FOG. Based on the normal regional distribution of noradrenergic innervation and pathological studies in the thalamus of PD patients, the implications of our findings suggest that noradrenergic limbic pathways may play a key role in OFF-FOG in PD. This finding could have implications for clinical subtyping of FOG as well as development of therapies.

Natural locus coeruleus dynamics during feeding

Recent data demonstrate that noradrenergic neurons of the locus coeruleus (LC-NE) are required for fear-induced suppression of feeding, but the role of endogenous LC-NE activity in natural, homeostatic feeding remains unclear. Here, we found that LC-NE activity was suppressed during food consumption, and the magnitude of this neural response was attenuated as mice consumed more pellets throughout the session, suggesting that LC responses to food are modulated by satiety state. Visual-evoked LC-NE activity was also attenuated in sated mice, suggesting that satiety state modulates LC-NE encoding of multiple behavioral states. We also found that food intake could be attenuated by brief or longer durations of LC-NE activation. Last, we found that activation of the LC to the lateral hypothalamus pathway suppresses feeding and enhances avoidance and anxiety-like responding. Our findings suggest that LC-NE neurons modulate feeding by integrating both external cues (e.g., anxiogenic environmental cues) and internal drives (e.g., satiety).

Sensory suppression and increased neuromodulation during actions disrupt memory encoding of unpredictable self-initiated stimuli

Actions modulate sensory processing by attenuating responses to self- compared to externally generated inputs, which is traditionally attributed to stimulus-specific motor predictions. Yet, suppression has been also found for stimuli merely coinciding with actions, pointing to unspecific processes that may be driven by neuromodulatory systems. Meanwhile, the differential processing for self-generated stimuli raises the possibility of producing effects also on memory for these stimuli; however, evidence remains mixed as to the direction of the effects. Here, we assessed the effects of actions on sensory processing and memory encoding of concomitant, but unpredictable sounds, using a combination of self-generation and memory recognition task concurrently with EEG and pupil recordings. At encoding, subjects performed button presses that half of the time generated a sound (motor-auditory; MA) and listened to passively presented sounds (auditory-only; A). At retrieval, two sounds were presented and participants had to respond which one was present before. We measured memory bias and memory performance by having sequences where either both or only one of the test sounds were presented at encoding, respectively. Results showed worse memory performance - but no differences in memory bias -, attenuated responses, and larger pupil diameter for MA compared to A sounds. Critically, the larger the sensory attenuation and pupil diameter, the worse the memory performance for MA sounds. Nevertheless, sensory attenuation did not correlate with pupil dilation. Collectively, our findings suggest that sensory attenuation and neuromodulatory processes coexist during actions, and both relate to disrupted memory for concurrent, albeit unpredictable sounds.

Spatiotemporal dynamics of noradrenaline during learned behaviour

Noradrenaline released from the locus coeruleus (LC) is a ubiquitous neuromodulator^1-4 that has been linked to multiple functions including arousal^5-8, action and sensory gain^9-11, and learning^12-16. Whether and how activation of noradrenaline-expressing neurons in the LC (LC-NA) facilitates different components of specific behaviours is unknown. Here we show that LC-NA activity displays distinct spatiotemporal dynamics to enable two functions during learned behaviour: facilitating task execution and encoding reinforcement to improve performance accuracy. To examine these functions, we used a behavioural task in mice with graded auditory stimulus detection and task performance. Optogenetic inactivation of the LC demonstrated that LC-NA activity was causal for both task execution and optimization. Targeted recordings of LC-NA neurons using photo-tagging, two-photon micro-endoscopy and two-photon output monitoring showed that transient LC-NA activation preceded behavioural execution and followed reinforcement. These two components of phasic activity were heterogeneously represented in LC-NA cortical outputs, such that the behavioural response signal was higher in the motor cortex and facilitated task execution, whereas the negative reinforcement signal was widely distributed among cortical regions and improved response sensitivity on the subsequent trial. Modular targeting of LC outputs thus enables diverse functions, whereby some noradrenaline signals are segregated among targets, whereas others are broadly distributed.

Covariations between pupil diameter and supplementary eye field activity suggest a role in cognitive effort implementation

In both human and nonhuman primates (NHP), the medial prefrontal region, defined as the supplementary eye field (SEF), can indirectly influence behavior selection through modulation of the primary selection process in the oculomotor structures. To perform this oculomotor control, SEF integrates multiple cognitive signals such as attention, memory, reward, and error. As changes in pupil responses can assess these cognitive efforts, a better understanding of the precise dynamics by which pupil diameter and medial prefrontal cortex activity interact requires thorough investigations before, during, and after changes in pupil diameter. We tested whether SEF activity is related to pupil dynamics during a mixed pro/antisaccade oculomotor task in 2 macaque monkeys. We used functional ultrasound (fUS) imaging to examine temporal changes in brain activity at the 0.1-s time scale and 0.1-mm spatial resolution concerning behavioral performance and pupil dynamics. By combining the pupil signals and real-time imaging of NHP during cognitive tasks, we were able to infer localized cerebral blood volume (CBV) responses within a restricted part of the dorsomedial prefrontal cortex, referred to as the SEF, an area in which antisaccade preparation activity is also recorded. Inversely, SEF neurovascular activity measured by fUS imaging was found to be a robust predictor of specific variations in pupil diameter over short and long-time scales. Furthermore, we directly manipulated pupil diameter and CBV in the SEF using reward modulations. These results bring a novel understanding of the physiological links between pupil and SEF, but it also raises questions about the role of anterior cingulate cortex (ACC), as CBV variations in the ACC seems to be negligible compared to CBV variations in the SEF.

Ultrafast functional imaging reveals short- and long-term covariations between pupil diameter and activity in the Supplementary Eye Field (SEF) of awake behaving non-human primates, yielding a novel understanding of the physiological links between the pupil and SEF.