Neuroscience of Reward, Motivation, and Drive

Effects of social housing on alcohol intake in mice depend on the non-social environment

Background

Excessive alcohol consumption leads to serious health problems. Mechanisms regulating the consumption of alcohol are insufficiently understood. Previous preclinical studies suggested that non-social environmental and social environmental complexities can regulate alcohol consumption in opposite directions. However, previous studies did not include all conditions and/or did not include female rodents. Therefore, in this study, we examined the effects of social versus single housing in standard versus non-standard housing conditions in male and female mice.

Methods

Adult C57BL/6 J mice were housed in either standard shoebox cages or in automated Herdsman 2 (HM2) cages and exposed to a two-bottle choice procedure with 3% or 6% ethanol versus water for 5 days. The HM2 cages use radiotracking devices to measure the fluid consumption of individual mice in an undisturbed and automated manner. In both housing conditions, mice were housed either at one or at four per cage.

Results

In standard cages, group housing of animals decreased alcohol consumption and water consumption. In HM2 cages, group housing significantly increased ethanol preference and decreased water intake. There were no significant differences in these effects between male and female animals. These observations were similar for 3 and 6% ethanol solutions but were more pronounced for the latter. The effects of social environment on ethanol preference in HM2 cages were accompanied by an increase in the number of approaches to the ethanol solution and a decrease in the number of approaches to water. The differences in ethanol intake could not be explained by differences in locomotor or exploratory activity as socially housed mice showed fewer non-consummatory visits to the ethanol solutions than single-housed animals. In addition, we observed that significant changes in behaviors measuring the approach to the fluid were not always accompanied by significant changes in fluid consumption, and vice versa, suggesting that it is important to assess both measures of motivation to consume alcohol.

Conclusion

Our results indicate that the direction of the effects of social environment on alcohol intake in mice depends on the non-social housing environment. Understanding mechanisms by which social and non-social housing conditions modulate alcohol intake could suggest approaches to counteract environmental factors enhancing hazardous alcohol consumption.

Aesthetic experience models human learning

Aesthetic experiences have the potential to promote learning and creativity by enhancing the ability to understand complexity and to integrate novel or disparate information. Offering a theoretical framework for understanding the cognitive benefits of aesthetic experiences, this paper argues they are the necessary outcome of human learning, in which natural objects or artworks are evaluated in a multi-dimensional preference space shaped by Bayesian prediction. In addition, it contends that the brain-states underlying aesthetic experiences harness configurations of the apex three transmodal neural systems-the default mode network, the central executive network, and the salience network-that may offer information-processing advantages by recruiting the brain's high-power communication hubs, thus enhancing potential for learning gain.

Medial prefrontal transcranial alternating current stimulation for apathy in Huntington's disease

We investigated the effects of transcranial alternating current stimulation (tACS) targeted to the bilateral medial prefrontal cortex (mPFC) and administered at either delta or alpha frequencies, on brain activity and apathy in people with Huntington's disease (HD) (n = 17). Given the novelty of the protocol, neurotypical controls (n = 20) were also recruited. All participants underwent three 20-min sessions of tACS; one session at alpha frequency (Individualised Alpha Frequency (IAF), or 10 Hz when an IAF was not detected); one session at delta frequency (2 Hz); and a session of sham tACS. Participants completed the Monetary Incentive Delay (MID) task with simultaneous recording of EEG immediately before and after each tACS condition. The MID task presents participants with cues signalling potential monetary gains or losses that increase activity in key regions of the cortico-basal ganglia-thalamocortical networks, with dysfunction of the latter network being implicated in the pathophysiology of apathy. We used the P300 and Contingent Negative Variation (CNV) event-related potentials elicited during the MID task as markers of mPFC engagement. HD participants' CNV amplitude significantly increased in response to alpha-tACS, but not delta-tACS or sham. Neurotypical controls' P300 and CNV were not modulated by any of the tACS conditions, but they did demonstrate a significant decrease in post-target response times following alpha-tACS. We present this as preliminary evidence of the ability of alpha-tACS to modulate brain activity associated with apathy in HD.

Motivationally salient cue processing measured using the monetary incentive delay (MID) task with electroencephalography (EEG): A potential marker of apathy in Huntington's disease

We explored the utility of the Monetary Incentive Delay (MID) task with concurrent encephalography (EEG) as a marker of apathy in people with Huntington's disease (HD) as well as neurotypical controls. Specifically, we assessed between and within-group differences in the amplitude of the P300 and Contingent Negative Variation (CNV) event-related potentials as a function of motivational salience. In contrast to neurotypical controls, HD participants' ERP amplitudes were not differentially modulated by motivationally salient cues (i.e., signalling potential 'gain' or 'loss') compared to 'neutral' cues. Difference waves isolating amplitude specific to the motivationally salient cues were calculated for the P300 and CNV. Only the difference waves for ERPs elicited by 'gain' cues differentiated the groups. The CNV difference wave was also significantly correlated with clinical measures of apathy and processing speed in the HD group. These findings provide initial support for the use of the MID with EEG as a marker of apathy in HD, and its potential as a sensitive outcome measure for novel treatment development.

Neurofeedback and neural self-regulation: a new perspective based on allostasis

The field of neurofeedback training (NFT) has seen growing interest and an expansion of scope, resulting in a steadily increasing number of publications addressing different aspects of NFT. This development has been accompanied by a debate about the underlying mechanisms and expected outcomes. Recent developments in the understanding of psychophysiological regulation have cast doubt on the validity of control systems theory, the principal framework traditionally used to characterize NFT. The present article reviews the theoretical and empirical aspects of NFT and proposes a predictive framework based on the concept of allostasis. Specifically, we conceptualize NFT as an adaptation to changing contingencies. In an allostasis four-stage model, NFT involves (a) perceiving relations between demands and set-points, (b) learning to apply collected patterns (experience) to predict future output, (c) determining efficient set-points, and (d) adapting brain activity to the desired ("set") state. This model also identifies boundaries for what changes can be expected from a neurofeedback intervention and outlines a time frame for such changes to occur.

Developmental Trajectories of Anhedonia in Preclinical Models

This chapter discusses how the complex concept of anhedonia can be operationalized and studied in preclinical models. It provides information about the development of anhedonia in the context of early-life adversity, and the power of preclinical models to tease out the diverse molecular, epigenetic, and network mechanisms that are responsible for anhedonia-like behaviors.Specifically, we first discuss the term anhedonia, reviewing the conceptual components underlying reward-related behaviors and distinguish anhedonia pertaining to deficits in motivational versus consummatory behaviors. We then describe the repertoire of experimental approaches employed to study anhedonia-like behaviors in preclinical models, and the progressive refinement over the past decade of both experimental instruments (e.g., chemogenetics, optogenetics) and conceptual constructs (salience, valence, conflict). We follow with an overview of the state of current knowledge of brain circuits, nodes, and projections that execute distinct aspects of hedonic-like behaviors, as well as neurotransmitters, modulators, and receptors involved in the generation of anhedonia-like behaviors. Finally, we discuss the special case of anhedonia that arises following early-life adversity as an eloquent example enabling the study of causality, mechanisms, and sex dependence of anhedonia.Together, this chapter highlights the power, potential, and limitations of using preclinical models to advance our understanding of the origin and mechanisms of anhedonia and to discover potential targets for its prevention and mitigation.

Prior Reward Conditioning Dampens Hippocampal and Striatal Responses during an Associative Memory Task

Offering reward during encoding typically leads to better memory [Adcock, R. A., Thangavel, A., Whitfield-Gabrieli, S.,Knutson, B., & Gabrieli, J. D. E. Reward-motivated learning: Mesolimbic activation precedes memory formation. Neuron, 50, 507-517, 2006]. Whether such memory benefit persists when tested in a different task context remains, however, largely understudied [Wimmer, G. E., & Buechel, C. Reactivation of reward-related patterns from single past episodes supports memory-based decision making. Journal of Neuroscience, 36, 2868-2880, 2016]. Here, we ask whether reward at encoding leads to a generalized advantage across learning episodes, a question of high importance for any everyday life applications, from education to patient rehabilitation. Although we confirmed that offering monetary reward increased responses in the ventral striatum and pleasantness judgments for pictures used as stimuli, this immediate beneficial effect of reward did not carry over to a subsequent and different picture-location association memory task during which no reward was delivered. If anything, a trend for impaired memory accuracy was observed for the initially high-rewarded pictures as compared to low-rewarded ones. In line with this trend in behavioral performance, fMRI activity in reward (i.e., ventral striatum) and in memory (i.e., hippocampus) circuits was reduced during the encoding of new associations using previously highly rewarded pictures (compared to low-reward pictures). These neural effects extended to new pictures from same, previously highly rewarded semantic category. Twenty-four hours later, delayed recall of associations involving originally highly rewarded items was accompanied by decreased functional connectivity between the hippocampus and two brain regions implicated in value-based learning, the ventral striatum and the ventromedial PFC. We conclude that acquired reward value elicits a downward value-adjustment signal in the human reward circuit when reactivated in a novel nonrewarded context, with a parallel disengagement of memory-reward (hippocampal-striatal) networks, likely to undermine new associative learning. Although reward is known to promote learning, here we show how it may subsequently hinder hippocampal and striatal responses during new associative memory formation.

Shared striatal activity in decisions to satisfy curiosity and hunger at the risk of electric shocks

Curiosity is often portrayed as a desirable feature of human faculty. However, curiosity may come at a cost that sometimes puts people in harmful situations. Here, using a set of behavioural and neuroimaging experiments with stimuli that strongly trigger curiosity (for example, magic tricks), we examine the psychological and neural mechanisms underlying the motivational effect of curiosity. We consistently demonstrate that across different samples, people are indeed willing to gamble, subjecting themselves to electric shocks to satisfy their curiosity for trivial knowledge that carries no apparent instrumental value. Also, this influence of curiosity shares common neural mechanisms with that of hunger for food. In particular, we show that acceptance (compared to rejection) of curiosity-driven or incentive-driven gambles is accompanied by enhanced activity in the ventral striatum when curiosity or hunger was elicited, which extends into the dorsal striatum when participants made a decision.

The Puzzling Relationship between Attention and Motivation: Do Motor Biases Matter?

The relationship between attention and incentive motivation has been mostly examined by administering Posner style cueing tasks in humans and varying monetary stakes. These studies found that higher incentives improved performance independently of spatial attention. However, the ability of the cueing task to measure actual attentional orienting has been debated by several groups that have highlighted the function of the motor system in affecting the behavioral features that are commonly attributed to spatial attention. To determine the impact of motor influences on the interplay between attention and motivation, we administered 2 reaching versions of a cueing task to monkeys in various motor scenarios. In both tasks, a central stimulus indicated the reward stake and predicted the stimulus target location in 80% of trials. In Experiment 1, subjects were requested to report the detection of a target stimulus in each trial. In Experiment 2, the task was modified to fit a paradigm of Go/NoGo target identification. We found that attention and motivation interacted exclusively in Experiment 2, wherein anticipated motor activation was discouraged and more demanding visual processing was imposed. Consequently, we suggest a protocol that provides novel insights into the study of the relationship between spatial attention and motivation and highlights the influence of the arm motor system in the estimation of the deployment of spatial attention.

Testosterone and Corticosterone in the Mesocorticolimbic System of Male Rats: Effects of Gonadectomy and Caloric Restriction

Steroid hormones can modulate motivated behaviors through the mesocorticolimbic system. Gonadectomy (GDX) is a common method to determine how steroids influence the mesocorticolimbic system, and caloric restriction (CR) is often used to invigorate motivated behaviors. A common assumption is that the effects of these manipulations on brain steroid levels reflects circulating steroid levels. We now know that the brain regulates local steroid levels in a region-specific manner; however, previous studies have low spatial resolution. Using ultrasensitive liquid chromatography tandem mass spectrometry, we examined steroids in microdissected regions of the mesocorticolimbic system (ventral tegmental area, nucleus accumbens, medial prefrontal cortex). We examined whether GDX or CR influences systemic and local steroids, particularly testosterone (T) and steroidogenic enzyme transcripts. Adult male rats underwent a GDX surgery and/or CR for either 2 or 6 weeks. Levels of T, the primary steroid of interest, were higher in all brain regions than in the blood, whereas corticosterone (CORT) was lower in the brain than in the blood. Importantly, GDX completely eliminated T in the blood and lowered T in the brain. Yet, T remained present in the brain, even 6 weeks after GDX. CR decreased both T and CORT in the blood and brain. Steroidogenic enzyme (Cyp17a1, 3β-hydroxysteroid dehydrogenase, aromatase) transcripts and androgen receptor transcripts were expressed in the mesocorticolimbic system and differentially affected by GDX and CR. Together, these results suggest that T is synthesized within the mesocorticolimbic system. These results provide a foundation for future studies examining how neurosteroids influence behaviors mediated by the mesocorticolimbic system.

The Emerging Neuroscience of Intrinsic Motivation: A New Frontier in Self-Determination Research

Intrinsic motivation refers to people’s spontaneous tendencies to be curious and interested, to seek out challenges and to exercise and develop their skills and knowledge, even in the absence of operationally separable rewards. Over the past four decades, experimental and field research guided by self-determination theory (SDT; Ryan and Deci, 2017) has found intrinsic motivation to predict enhanced learning, performance, creativity, optimal development and psychological wellness. Only recently, however, have studies begun to examine the neurobiological substrates of intrinsic motivation. In the present article, we trace the history of intrinsic motivation research, compare and contrast intrinsic motivation to closely related topics (flow, curiosity, trait plasticity), link intrinsic motivation to key findings in the comparative affective neurosciences, and review burgeoning neuroscience research on intrinsic motivation. We review converging evidence suggesting that intrinsically motivated exploratory and mastery behaviors are phylogenetically ancient tendencies that are subserved by dopaminergic systems. Studies also suggest that intrinsic motivation is associated with patterns of activity across large-scale neural networks, namely, those that support salience detection, attentional control and self-referential cognition. We suggest novel research directions and offer recommendations for the application of neuroscience methods in the study of intrinsic motivation.