Dopamine signals for reward value and risk: basic and recent data

Delay Discounting and BMI in Hypertensives: Serial Mediations of Self-Efficacy, Physical Activity and Sedentary Behavior

Objective

Our study aimed to examine the association between delay discounting (DD) and body mass index (BMI) in individuals with hypertension. Additionally, we sought to explore and compare the potential mediating effects of self-efficacy, physical activity and sedentary behavior in this association.

Methods

A cross-sectional survey was conducted in two cities in the Jiangsu province of China, specifically Nanjing and Yangzhou, from March to June 2023. A total of 972 hypertensive patients completed the questionnaire (M age = 64.7 years, SD age = 8.2 years, 54.2% female). Participants engaged in a money choice experiment on computers, provided their height and weight, and completed the International Physical Activity Questionnaire-Short Form (IPAQ-SF) and General Self-Efficacy Scale (GSES). The experimental program was generated using the programming software E-Prime version 2.0. Multiple hierarchical regression analysis was conducted to identify potential covariates. Two serial mediation models were conducted using PROCESS macro 4.1 in SPSS 27.0. Physical activity and sedentary behavior were designated as M2 to investigate and contrast their respective mediating effects in the association between delay discounting and body mass index.

Results

Self-efficacy, physical activity, and sedentary behavior served as mediators in the relationship between delay discounting and BMI. Self-efficacy accounted for 14.9% and 14.3% of the total effect in Models 1 and 2, respectively, while physical activity and sedentary behavior each accounted for 14.9% and 9.5% of the total effect, respectively. The serial mediation effects of self-efficacy and physical activity, as well as self-efficacy and sedentary behavior, were significant (B = 0.01, 95% CI [0.01, 0.02]; B = 0.01, 95% CI [0.002, 0.01]), collectively contributing 2.1% and 2.4% of the total effect. Sedentary behavior played a smaller mediating role compared to physical activity in this association.

Conclusion

The results indicated that self-efficacy, physical activity and sedentary behavior could act as mediators in the association between delay discounting and BMI, thus potentially mitigating the risk of obesity in hypertensive individuals.

Astrocytes enhance plasticity response during reversal learning

Astrocytes play a key role in the regulation of synaptic strength and are thought to orchestrate synaptic plasticity and memory. Yet, how specifically astrocytes and their neuroactive transmitters control learning and memory is currently an open question. Recent experiments have uncovered an astrocyte-mediated feedback loop in CA1 pyramidal neurons which is started by the release of endocannabinoids by active neurons and closed by astrocytic regulation of the D-serine levels at the dendrites. D-serine is a co-agonist for the NMDA receptor regulating the strength and direction of synaptic plasticity. Activity-dependent D-serine release mediated by astrocytes is therefore a candidate for mediating between long-term synaptic depression (LTD) and potentiation (LTP) during learning. Here, we show that the mathematical description of this mechanism leads to a biophysical model of synaptic plasticity consistent with the phenomenological model known as the BCM model. The resulting mathematical framework can explain the learning deficit observed in mice upon disruption of the D-serine regulatory mechanism. It shows that D-serine enhances plasticity during reversal learning, ensuring fast responses to changes in the external environment. The model provides new testable predictions about the learning process, driving our understanding of the functional role of neuron-glia interaction in learning.

Reinforcement Learning May Demystify the Limited Human Motor Learning Efficacy Due to Visual-Proprioceptive Mismatch

Vision and proprioception have fundamental sensory mismatches in delivering locational information, and such mismatches are critical factors limiting the efficacy of motor learning. However, it is still not clear how and to what extent this mismatch limits motor learning outcomes. To further the understanding of the effect of sensory mismatch on motor learning outcomes, a reinforcement learning algorithm and the simplified biomechanical elbow joint model were employed to mimic the motor learning process in a computational environment. By applying a reinforcement learning algorithm to the motor learning of elbow joint flexion task, simulation results successfully explained how visual-proprioceptive mismatch limits motor learning outcomes in terms of motor control accuracy and task completion speed. The larger the perceived angular offset between the two sensory modalities, the lower the motor control accuracy. Also, the more similar the peak reward amplitude of the two sensory modalities, the lower the motor control accuracy. In addition, simulation results suggest that insufficient exploration rate limits task completion speed, and excessive exploration rate limits motor control accuracy. Such a speed-accuracy trade-off shows that a moderate exploration rate could serve as another important factor in motor learning.

Dynamic aberrances of substantia nigra-relevant coactivation patterns in first-episode treatment-naïve patients with schizophrenia

BACKGROUND

Although dopaminergic disturbances are well-known in schizophrenia, the understanding of dopamine-related brain dynamics remains limited. This study investigates the dynamic coactivation patterns (CAPs) associated with the substantia nigra (SN), a key dopaminergic nucleus, in first-episode treatment-naïve patients with schizophrenia (FES).

METHODS

Resting-state fMRI data were collected from 84 FES and 94 healthy controls (HCs). Frame-wise clustering was implemented to generate CAPs related to SN activation or deactivation. Connectome features of each CAP were derived using an edge-centric method. The occurrence for each CAP and the balance ratio for antagonistic CAPs were calculated and compared between two groups, and correlations between temporal dynamic metrics and symptom burdens were explored.

RESULTS

Functional reconfigurations in CAPs exhibited significant differences between the activation and deactivation states of SN. During SN activation, FES more frequently recruited a CAP characterized by activated default network, language network, control network, and the caudate, compared to HCs (F = 8.54, FDR-p = 0.030). Moreover, FES displayed a tilted balance towards a CAP featuring SN-coactivation with the control network, caudate, and thalamus, as opposed to its antagonistic CAP (F = 7.48, FDR-p = 0.030). During SN deactivation, FES exhibited increased recruitment of a CAP with activated visual and dorsal attention networks but decreased recruitment of its opposing CAP (F = 6.58, FDR-p = 0.034).

CONCLUSION

Our results suggest that neuroregulatory dysfunction in dopaminergic pathways involving SN potentially mediates aberrant time-varying functional reorganizations in schizophrenia. This finding enriches the dopamine hypothesis of schizophrenia from the perspective of brain dynamics.

Rethinking dopamine-guided action sequence learning

As opposed to those requiring a single action for reward acquisition, tasks necessitating action sequences demand that animals learn action elements and their sequential order and sustain the behaviour until the sequence is completed. With repeated learning, animals not only exhibit precise execution of these sequences but also demonstrate enhanced smoothness and efficiency. Previous research has demonstrated that midbrain dopamine and its major projection target, the striatum, play crucial roles in these processes. Recent studies have shown that dopamine from the substantia nigra pars compacta (SNc) and the ventral tegmental area (VTA) serve distinct functions in action sequence learning. The distinct contributions of dopamine also depend on the striatal subregions, namely the ventral, dorsomedial and dorsolateral striatum. Here, we have reviewed recent findings on the role of striatal dopamine in action sequence learning, with a focus on recent rodent studies.

Individual differences in the boldness of female zebrafish are associated with alterations in serotonin function

One of the most prevalent axes of behavioral variation in both humans and animals is risk taking, where individuals that are more willing to take risk are characterized as bold while those that are more reserved are regarded as shy. Brain monoamines (i.e. serotonin, dopamine and noradrenaline) have been found to play a role in a variety of behaviors related to risk taking. Using zebrafish, we investigated whether there was a relationship between monoamine function and boldness behavior during exploration of a novel tank. We found a correlation between serotonin metabolism (5-HIAA:5-HT ratio) and boldness during the initial exposure to the tank in female animals. The DOPAC:DA ratio correlated with boldness behavior on the third day in male fish. There was no relationship between boldness and noradrenaline. To probe differences in serotonergic function in bold and shy fish, we administered a selective serotonin reuptake inhibitor, escitalopram, and assessed exploratory behavior. We found that escitalopram had opposing effects on thigmotaxis in bold and shy female animals: the drug caused bold fish to spend more time near the center of the tank and shy fish spent more time near the periphery. Taken together, our findings indicate that variation in serotonergic function has sex-specific contributions to individual differences in risk-taking behavior.

Dopamine neuron activity evoked by sucrose and sucrose-predictive cues is augmented by peripheral and central manipulations of glucose availability

Food deprivation drives eating through multiple signals and circuits. Decreased glucose availability (i.e., cytoglucopenia) drives eating and also increases the value of sucrose. Ventral tegmental area (VTA) dopamine neurons (DANs) contribute to the evaluation of taste stimuli, but their role in integrating glucoprivic signals remains unknown. We monitored VTA DAN activity via Cre-dependent expression of a calcium indicator with in vivo fibre photometry. In ad libitum fed rats, intraoral sucrose evoked a phasic increase in DAN activity. To manipulate glucose availability, we administered (intraperitoneal, lateral or fourth ventricular) the antiglycolytic agent 5-thio-D-glucose (5TG), which significantly augmented the phasic DAN activity to sucrose. 5TG failed to alter DAN activity to water or saccharin, suggesting the response was selective for caloric stimuli. 5TG enhancement of sucrose-evoked DAN activity was stronger after fourth ventricular administration, suggesting a critical node of action within the hindbrain. As 5TG also increases blood glucose, in a separate study, we used peripheral insulin, which stimulates eating, to decrease blood glucose-which was associated with increased DAN activity to intraoral sucrose. DAN activity developed to a cue predictive of intraoral sucrose. While 5TG augmented cue-evoked DAN activity, its action was most potent when delivered to the lateral ventricle. Together, the studies point to central glucose availability as a key modulator of phasic DAN activity to food and food-cues. As glucose sensing neurons are known to populate the hypothalamus and brainstem, results suggest differential modulation of cue-evoked and sucrose-evoked DAN activity.

Predicting COVID-19 Vaccination Uptake Using a Small and Interpretable Set of Judgment and Demographic Variables: Cross-Sectional Cognitive Science Study

BACKGROUND

Despite COVID-19 vaccine mandates, many chose to forgo vaccination, raising questions about the psychology underlying how judgment affects these choices. Research shows that reward and aversion judgments are important for vaccination choice; however, no studies have integrated such cognitive science with machine learning to predict COVID-19 vaccine uptake.

OBJECTIVE

This study aims to determine the predictive power of a small but interpretable set of judgment variables using 3 machine learning algorithms to predict COVID-19 vaccine uptake and interpret what profile of judgment variables was important for prediction.

METHODS

We surveyed 3476 adults across the United States in December 2021. Participants answered demographic, COVID-19 vaccine uptake (ie, whether participants were fully vaccinated), and COVID-19 precaution questions. Participants also completed a picture-rating task using images from the International Affective Picture System. Images were rated on a Likert-type scale to calibrate the degree of liking and disliking. Ratings were computationally modeled using relative preference theory to produce a set of graphs for each participant (minimum R2>0.8). In total, 15 judgment features were extracted from these graphs, 2 being analogous to risk and loss aversion from behavioral economics. These judgment variables, along with demographics, were compared between those who were fully vaccinated and those who were not. In total, 3 machine learning approaches (random forest, balanced random forest [BRF], and logistic regression) were used to test how well judgment, demographic, and COVID-19 precaution variables predicted vaccine uptake. Mediation and moderation were implemented to assess statistical mechanisms underlying successful prediction.

RESULTS

Age, income, marital status, employment status, ethnicity, educational level, and sex differed by vaccine uptake (Wilcoxon rank sum and chi-square P<.001). Most judgment variables also differed by vaccine uptake (Wilcoxon rank sum P<.05). A similar area under the receiver operating characteristic curve (AUROC) was achieved by the 3 machine learning frameworks, although random forest and logistic regression produced specificities between 30% and 38% (vs 74.2% for BRF), indicating a lower performance in predicting unvaccinated participants. BRF achieved high precision (87.8%) and AUROC (79%) with moderate to high accuracy (70.8%) and balanced recall (69.6%) and specificity (74.2%). It should be noted that, for BRF, the negative predictive value was <50% despite good specificity. For BRF and random forest, 63% to 75% of the feature importance came from the 15 judgment variables. Furthermore, age, income, and educational level mediated relationships between judgment variables and vaccine uptake.

CONCLUSIONS

The findings demonstrate the underlying importance of judgment variables for vaccine choice and uptake, suggesting that vaccine education and messaging might target varying judgment profiles to improve uptake. These methods could also be used to aid vaccine rollouts and health care preparedness by providing location-specific details (eg, identifying areas that may experience low vaccination and high hospitalization).

Temporally organized representations of reward and risk in the human brain

The value and uncertainty associated with choice alternatives constitute critical features relevant for decisions. However, the manner in which reward and risk representations are temporally organized in the brain remains elusive. Here we leverage the spatiotemporal precision of intracranial electroencephalography, along with a simple card game designed to elicit the unfolding computation of a set of reward and risk variables, to uncover this temporal organization. Reward outcome representations across wide-spread regions follow a sequential order along the anteroposterior axis of the brain. In contrast, expected value can be decoded from multiple regions at the same time, and error signals in both reward and risk domains reflect a mixture of sequential and parallel encoding. We further highlight the role of the anterior insula in generalizing between reward prediction error and risk prediction error codes. Together our results emphasize the importance of neural dynamics for understanding value-based decisions under uncertainty.

Lateral entorhinal cortex subpopulations represent experiential epochs surrounding reward

During goal-directed navigation, 'what' information, describing the experiences occurring in periods surrounding a reward, can be combined with spatial 'where' information to guide behavior and form episodic memories. This integrative process likely occurs in the hippocampus, which receives spatial information from the medial entorhinal cortex; however, the source of the 'what' information is largely unknown. Here, we show that mouse lateral entorhinal cortex (LEC) represents key experiential epochs during reward-based navigation tasks. We discover separate populations of neurons that signal goal approach and goal departure and a third population signaling reward consumption. When reward location is moved, these populations immediately shift their respective representations of each experiential epoch relative to reward, while optogenetic inhibition of LEC disrupts learning the new reward location. Therefore, the LEC contains a stable code of experiential epochs surrounding and including reward consumption, providing reward-centric information to contextualize the spatial information carried by the medial entorhinal cortex.

Feeding predictability as a cognitive enrichment protects brain function and physiological status in rainbow trout: a multidisciplinary approach to assess fish welfare

Cognitive enrichment is a promising but understudied type of environmental enrichment that aims to stimulate the cognitive abilities of animals by providing them with more opportunities to interact with (namely, to predict events than can occur) and to control their environment. In a previous study, we highlighted that farmed rainbow trout can predict daily feedings after two weeks of conditioning, the highest conditioned response being elicited by the combination of both temporal and signalled predictability. In the present study, we tested the feeding predictability that elicited the highest conditioned response in rainbow trout (both temporal and signalled by bubbles, BUBBLE + TIME treatment) as a cognitive enrichment strategy to improve their welfare. We thus analysed the long-term effects of this feeding predictability condition as compared with an unpredictable feeding condition (RANDOM treatment) on the welfare of rainbow trout, including the markers in the modulation of brain function, through a multidisciplinary approach. To reveal the brain regulatory pathways and networks involved in the long-term effects of feeding predictability, we measured gene markers of cerebral activity and plasticity, neurotransmitter pathways and physiological status of fish (oxidative stress, inflammatory status, cell type and stress status). After almost three months under these predictability conditions of feeding, we found clear evidence of improved welfare in fish from BUBBLE + TIME treatment. Feeding predictability allowed for a food anticipatory activity and resulted in fewer aggressive behaviours, burst of accelerations, and jumps before mealtime. BUBBLE + TIME fish were also less active between meals, which is in line with the observed decreased expression of transcripts related to the dopaminergic system. BUBBLE + TIME fish tented to present fewer eroded dorsal fin and infections to the pathogen Flavobacterium psychrophilum. Decreased expression of most of the studied mRNA involved in oxidative stress and immune responses confirm these tendencies else suggesting a strong role of feeding predictability on fish health status and that RANDOM fish may have undergone chronic stress. Fish emotional reactivity while isolated in a novel-tank as measured by fear behaviour and plasma cortisol levels were similar between the two treatments, as well as fish weight and size. To conclude, signalled combined with temporal predictability of feeding appears to be a promising approach of cognitive enrichment to protect brain function via the physiological status of farmed rainbow trout in the long term.

Individual differences in the boldness of female zebrafish are associated with alterations in serotonin function

One of the most prevalent axes of behavioral variation in both humans and animals is risk taking, where individuals that are more willing to take risk are characterized as bold while those that are more reserved as shy. Brain monoamines (i.e., serotonin, dopamine, and norepinephrine) have been found to play a role in a variety of behaviors related to risk taking. Genetic variation related to monoamine function have also been linked to personality in both humans and animals. Using zebrafish, we investigated the relationship between monoamine function and boldness behavior during exploration of a novel tank. We found a sex-specific correlation between serotonin metabolism (5-HIAA:5-HT ratio) and boldness that was limited to female animals; there were no relationships between boldness and dopamine or norepinephrine. To probe differences in serotonergic function, we administered a serotonin reuptake inhibitor, escitalopram, to bold and shy fish, and assessed their exploratory behavior. We found that escitalopram had opposing effects on thigmotaxis in female animals with bold fish spending more time near the center of the tank and shy fish spent more time near the periphery. Taken together, our findings suggest that variation in serotonergic function makes sex-specific contributions to individual differences in risk taking behavior.

Predictive neural computations in the cerebellum contribute to motor planning and faster behavioral responses in larval zebrafish

The ability to predict the future based on past experience lies at the core of the brain's ability to adapt behavior. However, the neural mechanisms that participate in generating and updating predictions are not clearly understood. Further, the evolutionary antecedents and the prevalence of predictive processing among vertebrates are even less explored. Here, we show evidence of predictive processing via the involvement of cerebellar circuits in larval zebrafish. We presented stereotyped optic flow stimuli to larval zebrafish to evoke swims and discovered that lesioning the cerebellum abolished prediction-dependent modulation of swim latency. When expectations of optic flow direction did not match with reality, error signals arrive at Purkinje cells via the olivary climbing fibers, whereas granule cells and Purkinje cells encode signals of expectation. Strong neural representations of expectation correlate with faster swim responses and vice versa. In sum, our results show evidence for predictive processing in nonmammalian vertebrates with the involvement of cerebellum, an evolutionarily conserved brain structure.

A multi-stage anticipated surprise model with dynamic expectation for economic decision-making

There are many modeling works that aim to explain people's behaviors that violate classical economic theories. However, these models often do not take into full account the multi-stage nature of real-life problems and people's tendency in solving complicated problems sequentially. In this work, we propose a descriptive decision-making model for multi-stage problems with perceived post-decision information. In the model, decisions are chosen based on an entity which we call the 'anticipated surprise'. The reference point is determined by the expected value of the possible outcomes, which we assume to be dynamically changing during the mental simulation of a sequence of events. We illustrate how our formalism can help us understand prominent economic paradoxes and gambling behaviors that involve multi-stage or sequential planning. We also discuss how neuroscience findings, like prediction error signals and introspective neuronal replay, as well as psychological theories like affective forecasting, are related to the features in our model. This provides hints for future experiments to investigate the role of these entities in decision-making.

Environmental levels of azoxystrobin disturb male zebrafish behavior: Possible roles of oxidative stress, cholinergic system, and dopaminergic system

A widely applied pesticide of azoxystrobin, is increasingly detected in the water environment. Concern has been raised against its potential detriment to aquatic ecosystems. It has been shown that exposure to azoxystrobin interfere with the locomotor behavior of zebrafish larvae. This study aims to investigate whether exposure to environmental levels of azoxystrobin (2 μg/L, 20 μg/L, and 200 μg/L) changes the behavior of male adult zebrafish. Herein, we evaluated behavioral response (locomotor, anxiety-like, and exploratory behaviors), histopathology, biochemical indicators, and gene expression in male adult zebrafish upon azoxystrobin exposure. The study showed that exposure to azoxystrobin for 42 days remarkably increased the locomotor ability of male zebrafish, resulted in anxiety-like behavior, and inhibited exploratory behavior. After treatment with 200 μg/L azoxystrobin, vasodilatation, and congestion were observed in male zebrafish brains. Exposure to 200 μg/L azoxystrobin notably elevated ROS level, MDA concentration, CAT activity, and AChE activity, while inhibiting SOD activity, GPx activity, ACh concentration, and DA concentration in male zebrafish brains. Moreover, the expression levels of genes related to the antioxidant, cholinergic, and dopaminergic systems were significantly changed. This suggests that azoxystrobin may interfere with the homeostasis of neurotransmitters by causing oxidative stress in male zebrafish brains, thus affecting the behavioral response of male zebrafish.

Quantitative and qualitative sex difference in habenula-induced inhibition of midbrain dopamine neurons in the rat

Introduction

Clinically relevant sex differences have been noted in a number of affective, behavioral, cognitive, and neurological health disorders. Midbrain dopamine neurons are implicated in several of these same disorders and consequently are under investigation for their potential role in the manifestation of these sex differences. The lateral habenula exerts significant inhibitory control over dopamine neuronal firing, yet little is known about sex differences in this particular neurocircuit.

Methods

We performed in vivo, single unit, extracellular recordings of dopamine neurons in female and male anesthetized rats in response to single pulse stimulation of the lateral habenula. In addition, we assessed baseline firing properties of lateral habenula neurons and, by immunochemical means, assessed the distribution of estrogen receptor alpha cells in the lateral habenula.

Results

Habenula-induced inhibition of dopamine neuronal firing is reduced in female rats relative to male rats. In addition, male rats had a higher prevalence of rebound excitation. Furthermore, the firing pattern of lateral habenula neurons was less variable in female rats, and female rats had a higher density of estrogen receptor alpha positive cells in the lateral habenula.

Discussion

We found that the dopamine neuronal response to habenular stimulation is both qualitatively and quantitatively different in female and male rats. These novel findings together with reports in the contemporary literature lead us to posit that the sex difference in dopamine inhibition seen here relate to differential firing properties of lateral habenula neurons resulting from the presence of sex hormones. Further work is needed to test this hypothesis, which may have implications for understanding the etiology of several mental health disorders including depression, schizophrenia, and addiction.

Acute stress selectively blunts reward anticipation but not consumption: An ERP study

Stress-induced dysfunction of reward processing is documented to be a critical factor associated with mental illness. Although many studies have attempted to clarify the relationship between stress and reward, few studies have investigated the effect of acute stress on the temporal dynamics of reward processing. The present study applied event-related potentials (ERP) to examine how acute stress differently influences reward anticipation and consumption. In this study, seventy-eight undergraduates completed a two-door reward task following a Trier Social Stress Task (TSST) or a placebo task. The TSST group showed higher cortisol levels, perceived stress, anxiety, and negative affect than the control group. For the control group, a higher magnitude of reward elicited a reduced cue-N2 but increased stimulus-preceding negativity (SPN), suggesting that controls were sensitive to reward magnitude. In contrast, these effects were absent in the stress group, suggesting that acute stress reduces sensitivity to reward magnitude during the anticipatory phase. However, the reward positivity (RewP) and P3 of both groups showed similar patterns, which suggests that acute stress has no impact on reward responsiveness during the consummatory phase. These findings suggest that acute stress selectively blunts sensitivity to reward magnitude during the anticipatory rather than the consummatory phase.

Pre- and postnatal exposure to legacy environmental contaminants and sensation seeking in Inuit adolescents from Nunavik

Despite extensive evidence from cohort studies linking exposure to lead (Pb), mercury (Hg) and polychlorinated biphenyls (PCBs) to numerous cognitive outcomes in children and adolescents, very few studies addressed reward sensitivity, a key dimension of emotional regulation. The present study aimed to examine associations between pre- and postnatal exposure to these environmental neurotoxicants and sensation seeking, a behavioral feature of reward. A total of 207 Inuit adolescents (mean age = 18.5, SD = 1.2) from Nunavik, Canada, completed the Brief Sensation Seeking Scale (BSSS-4) and Sensation Seeking- 2 (SS-2), two self-report questionnaires assessing proneness to sensation seeking. Prenatal, childhood and adolescent exposure to Pb, Hg and PCBs were measured in cord blood at birth and blood samples at 11 years of age and at time of testing. Multiple linear regression models were performed, potential confounders including participants' sociodemographic characteristics and nutrient fish intake were considered. Results showed that higher child blood levels of Pb (b = -0.18, p = 0.01) and PCB-153 (b = -0.16, p = 0.06) were associated with lower BSSS-4 total scores, while cord and adolescent blood PCB-153 levels were significantly related to lower SS2 total scores (b = -0.15, p = 0.04; b = -0.24, p = 0.004). Such associations persisted after further adjustment for co-exposure to concurrent contaminants. These associations were influenced by self-report positive affect and marginally moderated by sex. Sex differences were only observed for child PCB exposure, with the association for risk-taking sensation seeking observed only in girls but not in boys. Further research is warranted to assess the extent to which reduced sensation seeking in chronically exposed individuals affects their behaviors, well-being, and emotional regulation.

Lateral entorhinal cortex subpopulations represent experiential epochs surrounding reward

During goal-directed navigation, "what" information, which describes the experiences occurring in periods surrounding a reward, can be combined with spatial "where" information to guide behavior and form episodic memories1,2. This integrative process is thought to occur in the hippocampus3, which receives spatial information from the medial entorhinal cortex (MEC)4; however, the source of the "what" information and how it is represented is largely unknown. Here, by establishing a novel imaging method, we show that the lateral entorhinal cortex (LEC) of mice represents key experiential epochs during a reward-based navigation task. We discover a population of neurons that signals goal approach and a separate population of neurons that signals goal departure. A third population of neurons signals reward consumption. When reward location is moved, these populations immediately shift their respective representations of each experiential epoch relative to reward, while optogenetic inhibition of LEC disrupts learning of the new reward location. Together, these results indicate the LEC provides a stable code of experiential epochs surrounding and including reward consumption, providing reward-centric information to contextualize the spatial information carried by the MEC. Such parallel representations are well-suited for generating episodic memories of rewarding experiences and guiding flexible and efficient goal-directed navigation5-7.

Enhanced decision-making in nicotine dependent individuals who abstain: A computational analysis using Hierarchical Drift Diffusion Modeling

BACKGROUND

Variability in decision-making capacity and reward responsiveness may underlie differences in the ability to abstain from smoking. Computational modeling of choice behavior, as with the Hierarchical Drift Diffusion Model (HDDM), can help dissociate reward responsiveness from underlying components of decision-making. Here we used the HDDM to identify which decision-making or reward-related parameters, extracted from data acquired in a reward processing task, contributed to the ability of people who smoke that are not seeking treatment to abstain from cigarettes during a laboratory task.

METHODS

80 adults who smoke cigarettes completed the Probabilistic Reward Task (PRT) - a signal detection task with a differential reinforcement schedule - following smoking as usual, and the Relapse Analogue Task (RAT) - a task in which participants could earn money for delaying smoking up to 50min - after a period of overnight abstinence. Two cohorts were defined by the RAT; those who waited either 0-min (n=36) or the full 50-min (n=44) before smoking.

RESULTS

PRT signal detection metrics indicated all subjects learned the task contingencies, with no differences in response bias or discriminability between the two groups. However, HDDM analyses indicated faster drift rates in 50-min vs. 0-min waiters.

CONCLUSIONS

Relative to those who did not abstain, computational modeling indicated that people who abstained from smoking for 50min showed faster evidence accumulation during reward-based decision-making. These results highlight the importance of decision-making mechanisms to smoking abstinence, and suggest that focusing on the evidence accumulation process may yield new targets for treatment.

Pushing the Frontiers: Optogenetics for Illuminating the Neural Pathophysiology of Bipolar Disorder

Bipolar disorder (BD), a disabling mental disorder, is featured by the oscillation between episodes of depression and mania, along with disturbance in the biological rhythms. It is on an urgent demand to identify the intricate mechanisms of BD pathophysiology. Based on the continuous progression of neural science techniques, the dysfunction of circuits in the central nervous system was currently thought to be tightly associated with BD development. Yet, challenge exists since it depends on techniques that can manipulate spatiotemporal dynamics of neuron activity. Notably, the emergence of optogenetics has empowered researchers with precise timing and local manipulation, providing a possible approach for deciphering the pathological underpinnings of mental disorders. Although the application of optogenetics in BD research remains preliminary due to the scarcity of valid animal models, this technique will advance the psychiatric research at neural circuit level. In this review, we summarized the crucial aberrant brain activity and function pertaining to emotion and rhythm abnormities, thereby elucidating the underlying neural substrates of BD, and highlighted the importance of optogenetics in the pursuit of BD research.

The neurophysiological Behavioral Perspective Model of consumer choice and its contribution to the intentional behaviorist research programme

Cognitive explanations raise epistemological problems not faced by accounts confined to observable variables. Many explanatory components of cognitive models are unobservable: beliefs, attitudes, and intentions, for instance, must be made empirically available to the researcher in the form of measures of observable behavior from which the latent variables are inferred. The explanatory variables are abstract and theoretical and rely, if they are to enter investigations and explanations, on reasoned agreement on how they can be captured by proxy variables derived from what people say and how they behave. Psychometrics must be founded upon a firm, intersubjective agreement among researchers and users of research on the relationship of behavioral measures to the intentional constructs to which they point and the latent variables they seek to operationalize. Only if these considerations are adequately addressed can we arrive at consistent interpretations of the data. This problem provides the substance of the intentional behaviorist research programme which seeks to provide a rationale for the cognitive explanation. Within this programme, two versions of the Behavioral Perspective Model (BPM), an extensional portrayal of socioeconomic behavior and a corresponding intentional approach, address the task of identifying where intentional explanation becomes necessary and the form it should take. This study explores a third version, based on neurophysiological substrates of consumer choice as a contributor to this task. The nature of "value" is closely related to the rationale for a neurophysiological model of consumer choice. The variables involved are operationally specified and measured with high intersubjective agreement. The intentional model (BPM-I), depicting consumer action in terms of mental processes such as perception, deliberation, and choice, extends the purview of the BPM to new situations and areas of explanation.

Neurobiological mechanisms of dialectical behavior therapy and Morita therapy, two psychotherapies inspired by Zen

Psychotherapy is a learning process. Updating the prediction models of the brain may be the mechanism underlying psychotherapeutic changes. Although developed in different eras and cultures, dialectical behavior therapy (DBT) and Morita therapy are influenced by Zen principles, and both emphasize the acceptance of reality and suffering. This article reviews these two treatments, their common and distinct therapeutic factors, and their neuroscientific implications. Additionally, it proposes a framework that includes the predictive function of the mind, constructed emotions, mindfulness, therapeutic relationship, and changes enabled via reward predictions. Brain networks, including the Default Mode Network (DMN), amygdala, fear circuitry, and reward pathways, contribute to the constructive process of brain predictions. Both treatments target the assimilation of prediction errors, gradual reorganization of predictive models, and creation of a life with step-by-step constructive rewards. By elucidating the possible neurobiological mechanisms of these psychotherapeutic techniques, this article is expected to serve as the first step towards filling the cultural gap and creating more teaching methods based on these concepts.

Physical activity for cognitive health promotion: An overview of the underlying neurobiological mechanisms

Physical activity is one of the modifiable factors of cognitive decline and dementia with the strongest evidence. Although many influential reviews have illustrated the neurobiological mechanisms of the cognitive benefits of physical activity, none of them have linked the neurobiological mechanisms to normal exercise physiology to help the readers gain a more advanced, comprehensive understanding of the phenomenon. In this review, we address this issue and provide a synthesis of the literature by focusing on five most studied neurobiological mechanisms. We show that the body's adaptations to enhance exercise performance also benefit the brain and contribute to improved cognition. Specifically, these adaptations include, 1), the release of growth factors that are essential for the development and growth of neurons and for neurogenesis and angiogenesis, 2), the production of lactate that provides energy to the brain and is involved in the synthesis of glutamate and the maintenance of long-term potentiation, 3), the release of anti-inflammatory cytokines that reduce neuroinflammation, 4), the increase in mitochondrial biogenesis and antioxidant enzyme activity that reduce oxidative stress, and 5), the release of neurotransmitters such as dopamine and 5-HT that regulate neurogenesis and modulate cognition. We also discussed several issues relevant for prescribing physical activity, including what intensity and mode of physical activity brings the most cognitive benefits, based on their influence on the above five neurobiological mechanisms. We hope this review helps readers gain a general understanding of the state-of-the-art knowledge on the neurobiological mechanisms of the cognitive benefits of physical activity and guide them in designing new studies to further advance the field.

Nanoplastics promote arsenic-induced ROS accumulation, mitochondrial damage and disturbances in neurotransmitter metabolism of zebrafish (Danio rerio)

As a carrier, nanoplastics (NPs) can adsorb other toxic substances and thus modify their biological toxicity. Numerous studies have investigated the neurotoxic of high concentrations of arsenic (As, 2.83 mg/L-5 mg/L). However, it is still unknown whether the relatively low environmentally relevant concentrations of As (200 μg/L) can damage the structure and function of fish brains with the presence of NPs. In this study, zebrafish were exposed to polystyrene NPs, As and their mixture for 30 days respectively. Firstly, we found that the presence of NPs promoted the accumulation of As in zebrafish brains. Thereby the co-exposure of NPs and As further promoted the production of reactive oxygen species (ROS) in zebrafish brains compared with the single exposure of NPs or As, resulting in severe oxidative stress. Moreover, accumulated ROS directly damaged the mitochondrial membrane and mtDNA in zebrafish brains. Moreover, the mitochondrial damage was further aggravated due to inhibited mitochondrial fusion and activated mitochondrial division and mitophagy. Ultimately, the co-exposure led to mitochondrial damage in the zebrafish brain. Damaged mitochondria may not meet the high energy metabolic requirement for neuronal function. As a result, the normal function of nerve cells was adversely affected and eventually cell apoptosis may occur. Besides, the co-exposure caused more significant structural alterations in zebrafish brain tissue. Finally, the co-exposure of NPs and As caused abnormal biosynthesis and degradation of dopamine and acetylcholine. These resulted in decreased dopamine levels and increased acetylcholine levels in zebrafish brains. In conclusion, the presence of NPs promoted the accumulation of As, thereby inducing severe oxidative stress, which caused structural alterations and mitochondrial damage in the zebrafish brain, thus disordering neuromodulation, which may ultimately cause neurological dysfunction in zebrafish. This study will provide a risk assessment for evaluating the biotoxicity of NPs and As to fish and even other animals.

Fatty Acid-Binding Protein 5 Gene Deletion Enhances Nicotine-Conditioned Place Preference: Illuminating the Putative Gateway Mechanisms

Emerging evidence indicates that the endogenous cannabinoid system modulates the behavioral and physiological effects of nicotine. Fatty acid-binding proteins (FABPs) are among the primary intracellular trafficking mechanisms of endogenous cannabinoids, such as anandamide. To this end, changes in FABP expression may similarly impact the behavioral manifestations associated with nicotine, particularly its addictive properties. FABP5 ^+/+ and FABP5 ^-/- mice were tested for nicotine-conditioned place preference (CPP) at two different doses (0.1 or 0.5 mg/kg). The nicotine-paired chamber was assigned as their least preferred chamber during preconditioning. Following 8 days of conditioning, the mice were injected with either nicotine or saline. The mice were allowed to access to all the chambers on the test day, and their times spent in the drug chamber on the preconditioning versus the test days were used to examine the drug preference score. The CPP results showed that the FABP5 ^-/- mice displayed a higher place preference for 0.1 mg/kg nicotine than the FABP5 ^+/+ mice, while no CPP difference was observed for 0.5 mg/kg nicotine between the genotypes. In conclusion, FABP5 plays an important role in regulating nicotine place preference. Further research is warranted to identify the precise mechanisms. The results suggest that dysregulated cannabinoid signaling may impact nicotine-seeking behavior.

Sleep-mediated regulation of reward circuits: implications in substance use disorders

Our modern society suffers from both pervasive sleep loss and substance abuse-what may be the indications for sleep on substance use disorders (SUDs), and could sleep contribute to the individual variations in SUDs? Decades of research in sleep as well as in motivated behaviors have laid the foundation for us to begin to answer these questions. This review is intended to critically summarize the circuit, cellular, and molecular mechanisms by which sleep influences reward function, and to reveal critical challenges for future studies. The review also suggests that improving sleep quality may serve as complementary therapeutics for treating SUDs, and that formulating sleep metrics may be useful for predicting individual susceptibility to SUDs and other reward-associated psychiatric diseases.

Involvement of Lateral Habenula Dysfunction in Repetitive Mild Traumatic Brain Injury-Induced Motivational Deficits

Affective disorders including depression (characterized by reduced motivation, social withdrawal, and anhedonia), anxiety, and irritability are frequently reported as long-term consequences of mild traumatic brain injury (mTBI) in addition to cognitive deficits, suggesting a possible dysregulation within mood/motivational neural circuits. One of the important brain regions that control motivation and mood is the lateral habenula (LHb), whose hyperactivity is associated with depression. Here, we used a repetitive closed-head injury mTBI model that is associated with social deficits in adult male mice and explored the possible long-term alterations in LHb activity and motivated behavior 10-18 days post-injury. We found that mTBI increased the proportion of spontaneous tonically active LHb neurons yet decreased the proportion of LHb neurons displaying bursting activity. Additionally, mTBI diminished spontaneous glutamatergic and GABAergic synaptic activity onto LHb neurons, while synaptic excitation and inhibition (E/I) balance was shifted toward excitation through a greater suppression of GABAergic transmission. Behaviorally, mTBI increased the latency in grooming behavior in the sucrose splash test suggesting reduced self-care motivated behavior following mTBI. To show whether limiting LHb hyperactivity could restore motivational deficits in grooming behavior, we then tested the effects of Gi (hM4Di)-DREADD-mediated inhibition of LHb activity in the sucrose splash test. We found that chemogenetic inhibition of LHb glutamatergic neurons was sufficient to reverse mTBI-induced delays in grooming behavior. Overall, our study provides the first evidence for persistent LHb neuronal dysfunction due to an altered synaptic integration as causal neural correlates of dysregulated motivational states by mTBI.

The rostral zona incerta: a subcortical integrative hub and potential DBS target for OCD

BACKGROUND

The zona incerta (ZI) is involved in mediating survival behaviors and is connected to a wide range of cortical and subcortical structures, including key basal ganglia nuclei. Based on these connections and their links to behavioral modulation, we propose that the ZI is a connectional hub for mediating between top-down and bottom-up control and a possible target for deep brain stimulation for obsessive-compulsive disorder.

METHODS

We analyzed the trajectory of cortical fibers to the ZI in nonhuman and human primates based on tracer injections in monkeys and high-resolution diffusion magnetic resonance imaging in humans. The organization of cortical and subcortical connections within the ZI were identified in the nonhuman primate studies.

RESULTS

Monkey anatomical data and human diffusion magnetic resonance imaging data showed a similar trajectory of fibers/streamlines to the ZI. Prefrontal cortex/anterior cingulate cortex terminals all converged within the rostral ZI, with dorsal and lateral areas being most prominent. Motor areas terminated caudally. Dense subcortical reciprocal connections included the thalamus, medial hypothalamus, substantia nigra/ventral tegmental area, reticular formation, and pedunculopontine nucleus and a dense nonreciprocal projection to the lateral habenula. Additional connections included the amygdala, dorsal raphe nucleus, and periaqueductal gray.

CONCLUSIONS

Dense connections with dorsal and lateral prefrontal cortex/anterior cingulate cortex cognitive control areas and the lateral habenula and the substantia nigra/ventral tegmental area, coupled with inputs from the amygdala, hypothalamus, and brainstem, suggest that the rostral ZI is a subcortical hub positioned to modulate between top-down and bottom-up control. A deep brain stimulation electrode placed in the rostral ZI would not only involve connections common to other deep brain stimulation sites but also capture several critically distinctive connections.

Neither Too Easy Nor Too Difficult: Effects of Different Success Criteria on Motor Skill Acquisition in Children

The purpose of this study was to examine the effects of different success criteria on motor learning in children. Forty-eight children threw soft-golf balls toward a circular target using their nondominant arm. On Day 1, they performed six blocks of 12 trials from 5.5 m. On Day 3, they performed a 12-trial retention test followed by a 12-trial transfer test. Participants were randomly assigned to one of four groups: difficult criteria for success, relatively easy criteria for success (RES), easy criteria for success, and control. Results demonstrated that there was a significant difference between the RES and control groups in their throwing accuracy on the retention and transfer tests, and the RES group had the highest score compared with the other two groups. This research suggests that providing relatively easy criteria facilitates motor skill acquisition in children.

Association of Polymorphism within the Putative miRNA Target Site in the 3'UTR Region of the DRD2 Gene with Neuroticism in Patients with Substance Use Disorder

The study aims at looking into associations between the polymorphism rs6276 that occurs in the putative miRNA target site in the 3'UTR region of the DRD2 gene in patients with substance use disorder (SUD) comorbid with a maniacal syndrome (SUD MANIA). In our study, we did not state any essential difference in DRD2 rs6276 genotype frequencies in the studied samples of SUD MANIA, SUD, and control subjects. A significant result was found for the SUD MANIA group vs. SUD vs. controls on the Neuroticism Scale of NEO FFI test, and DRD2 rs6276 (p = 0.0320) accounted for 1.7% of the variance. The G/G homozygous variants were linked with lower results on the neuroticism scale in the SUD MANIA group because G/G alleles may serve a protective role in the expression of neuroticism in patients with SUD MANIA. So far, there have been no data in the literature on the relationship between the miRSNP rs6276 region in the DRD2 gene and neuroticism (personal traits) in patients with a diagnosis of substance use disorder comorbid with the affective, maniacal type disturbances related to SUD. This is the first report on this topic.

Parkinson's Disease and Sugar Intake-Reasons for and Consequences of a Still Unclear Craving

Lately, studies have shown that patients with Parkinson’s disease (PD) report a strong craving for sweets and consume significantly more fast-acting carbohydrates than healthy controls. Consuming food with a high-sugar content is assumed to lead to an increase in insulin concentration, which could positively influence dopamine concentration in the brain and unconsciously be used by patients as kind of “self-medication” to compensate for a lack of dopamine in PD. On the other hand, high-sugar intake could also lead to insulin resistance and diabetes, which is discussed as a causative factor for progressive neurodegeneration in PD. In this critical appraisal, we discuss the role of sugar intake and insulin on dopamine metabolism in patients with PD and how this could influence the potential neurodegeneration mediated by insulin resistance.

Neural signals implicated in the processing of appetitive and aversive events in social and non-social contexts

In 2014, we participated in a special issue of Frontiers examining the neural processing of appetitive and aversive events. Specifically, we reviewed brain areas that contribute to the encoding of prediction errors and value versus salience, attention and motivation. Further, we described how we disambiguated these cognitive processes and their neural substrates by using paradigms that incorporate both appetitive and aversive stimuli. We described a circuit in which the orbitofrontal cortex (OFC) signals expected value and the basolateral amygdala (BLA) encodes the salience and valence of both appetitive and aversive events. This information is integrated by the nucleus accumbens (NAc) and dopaminergic (DA) signaling in order to generate prediction and prediction error signals, which guide decision-making and learning via the dorsal striatum (DS). Lastly, the anterior cingulate cortex (ACC) is monitoring actions and outcomes, and signals the need to engage attentional control in order to optimize behavioral output. Here, we expand upon this framework, and review our recent work in which within-task manipulations of both appetitive and aversive stimuli allow us to uncover the neural processes that contribute to the detection of outcomes delivered to a conspecific and behaviors in social contexts. Specifically, we discuss the involvement of single-unit firing in the ACC and DA signals in the NAc during the processing of appetitive and aversive events in both social and non-social contexts.

Cocaine's effects on the reactivity of the medial prefrontal cortex to ventral tegmental area stimulation: optical imaging study in mice

BACKGROUND AND AIMS

The prefrontal cortex (PFC) is modulated by dopaminergic and glutamatergic neurons that project from the ventral tegmental area (VTA) and disruption of this modulation might facilitate impulsive behaviors during cocaine intoxication. Here, we assessed the effects of acute cocaine (30 mg/kg, i.p.) on the reactivity of the PFC to VTA stimulation.

METHODS

Using a genetically encoded calcium indicator (GCaMP6f), we optically imaged the neuronal Ca2+ reactance in medial PFC (mPFC) in response to 'tonic-like' (5 Hz) and 'phasic-like' (50 Hz) electrical VTA stimulation. The high temporal and spatial resolutions of our optical system allowed us to capture single Ca2+ neuronal transients from individual stimuli with 'tonic-like' stimulation and to visualize single neuronal activation evoked by 'phasic-like' VTA stimulation.

RESULTS

'Tonic-like' VTA stimulation induced a rapid increase in mean neuronal Ca2+ in mPFC followed by a plateau and recovery upon termination of stimulation. After cocaine, the mPFC sensitivity to 'tonic-like' VTA stimulation was attenuated, with a 50.4% reduction (P = 0.03) in the number of Ca2+ transients corresponding to single electrical stimuli but the recovery time was lengthened (4.30 ± 0.25 sec to 5.41 ± 0.24 sec, P = 0.03). 'Phasic-like' stimulation evoked a rapid Ca2+ fluorescence increase in mPFC with an immediate decay process, and while cocaine did not affect the peak response (7.17 ± 1.07% versus 7.13 ± 0.96%, P = 0.98) it shortened the recovery time to baseline (3.27 ± 0.11 sec versus 2.38 ± 0.23 sec, P = 0.005).

CONCLUSIONS

Acute cocaine impairs reactivity of medial prefrontal cortex (mPFC) to ventral tegmental area stimulation, decreasing its sensitivity to 'tonic-like' stimulation and lengthening the recovery time to return to baseline while shortening it for phasic stimulation. These changes in mPFC might contribute to cocaine binging during intoxication.

Digital Addiction and Sleep

In 2020, the World Health Organization formally recognized addiction to digital technology (connected devices) as a worldwide problem, where excessive online activity and internet use lead to inability to manage time, energy, and attention during daytime and produce disturbed sleep patterns or insomnia during nighttime. Recent studies have shown that the problem has increased in magnitude worldwide during the COVID-19 pandemic. The extent to which dysfunctional sleep is a consequence of altered motivation, memory function, mood, diet, and other lifestyle variables or results from excess of blue-light exposure when looking at digital device screens for long hours at day and night is one of many still unresolved questions. This article offers a narrative overview of some of the most recent literature on this topic. The analysis provided offers a conceptual basis for understanding digital addiction as one of the major reasons why people, and adolescents in particular, sleep less and less well in the digital age. It discusses definitions as well as mechanistic model accounts in context. Digital addiction is identified as functionally equivalent to all addictions, characterized by the compulsive, habitual, and uncontrolled use of digital devices and an excessively repeated engagement in a particular online behavior. Once the urge to be online has become uncontrollable, it is always accompanied by severe sleep loss, emotional distress, depression, and memory dysfunction. In extreme cases, it may lead to suicide. The syndrome has been linked to the known chronic effects of all drugs, producing disturbances in cellular and molecular mechanisms of the GABAergic and glutamatergic neurotransmitter systems. Dopamine and serotonin synaptic plasticity, essential for impulse control, memory, and sleep function, are measurably altered. The full spectrum of behavioral symptoms in digital addicts include eating disorders and withdrawal from outdoor and social life. Evidence pointing towards dysfunctional melatonin and vitamin D metabolism in digital addicts should be taken into account for carving out perspectives for treatment. The conclusions offer a holistic account for digital addiction, where sleep deficit is one of the key factors.

The Cost of Imagined Actions in a Reward-Valuation Task

Growing evidence suggests that humans and other animals assign value to a stimulus based not only on its inherent rewarding properties, but also on the costs of the action required to obtain it, such as the cost of time. Here, we examined whether such cost also occurs for mentally simulated actions. Healthy volunteers indicated their subjective value for snack foods while the time to imagine performing the action to obtain the different stimuli was manipulated. In each trial, the picture of one food item and a home position connected through a path were displayed on a computer screen. The path could be either large or thin. Participants first rated the stimulus, and then imagined moving the mouse cursor along the path from the starting position to the food location. They reported the onset and offset of the imagined movements with a button press. Two main results emerged. First, imagery times were significantly longer for the thin than the large path. Second, participants liked significantly less the snack foods associated with the thin path (i.e., with longer imagery time), possibly because the passage of time strictly associated with action imagery discounts the value of the reward. Importantly, such effects were absent in a control group of participants who performed an identical valuation task, except that no action imagery was required. Our findings hint at the idea that imagined actions, like real actions, carry a cost that affects deeply how people assign value to the stimuli in their environment.

Reward magnitude enhances early attentional processing of auditory stimuli

Reward associations are known to shape the brain's processing of visual stimuli, but relatively less is known about how reward associations impact the processing of auditory stimuli. We leveraged the high-temporal resolution of electroencephalography (EEG) and event-related potentials (ERPs) to investigate the influence of low- and high-magnitude stimulus-reward associations in an auditory oddball task. We associated fast, correct detection of certain auditory target stimuli with larger monetary rewards, and other auditory targets with smaller rewards. We found enhanced attentional processing of the more highly rewarded target stimuli, as evidenced by faster behavioral detection of those stimuli compared with lower-rewarded stimuli. Neurally, higher-reward associations enhanced the early sensory processing of auditory targets. Targets associated with higher-magnitude rewards had higher amplitude N1 and mismatch negativity (MMN) ERP components than targets associated with lower-magnitude rewards. Reward did not impact the latency of these early components. Higher-reward magnitude also decreased the latency and increased the amplitude of the longer-latency P3 component, suggesting that reward also can enhance the final processing stages of auditory target stimuli. These results provide insight into how the sensory and attentional neural processing of auditory stimuli is modulated by stimulus-reward associations and the magnitude of those associations, with higher-magnitude reward associations yielding enhanced auditory processing at both early and late stages compared with lower-magnitude reward associations.

Behavioral Engagement With Playable Objects Resolves Stress-Induced Adaptive Changes by Reshaping the Reward System

BACKGROUND

The reward system regulates motivated behavior, and repeated practice of specific motivated behavior might conversely modify the reward system. However, the detailed mechanisms by which they reciprocally regulate each other are not clearly understood.

METHODS

Mice subjected to chronic restraint stress show long-lasting depressive-like behavior, which is rescued by continual engagement with playable objects. A series of molecular, pharmacological, genetic, and behavioral analyses, combined with microarray, liquid chromatography, and chemogenetic tools, are used to investigate the neural mechanisms of antidepressive effects of playable objects.

RESULTS

Here, we show that repeated restraint induces dopamine surges into the nucleus accumbens-lateral shell (NAc-lSh), which cause upregulation of the neuropeptide PACAP in the NAc-lSh. As repeated stress is continued, the dopamine surge by stressors is adaptively suppressed without restoring PACAP upregulation, and the resulting enhanced PACAP inputs from NAc-lSh neurons to the ventral pallidum facilitate depressive-like behaviors. Continual engagement with playable objects in mice subjected to chronic stress remediates reduced dopamine response to new stressors, enhanced PACAP upregulation, and depressive-like behaviors. Overactivation of dopamine D₁ receptors over the action of D₂ receptors in the NAc-lSh promotes depressive-like behaviors. Conversely, inhibition of D₁ receptors or PACAP upregulation in the NAc-lSh confers resilience to chronic stress-induced depressive-like behaviors. Histochemical and chemogenetic analyses reveal that engagement with playable objects produces antidepressive effects by reshaping the ventral tegmental area-to-NAc-lSh and NAc-lSh-to-ventral pallidum circuits.

CONCLUSIONS

These results suggest that behavioral engagement with playable objects remediates depressive-like behaviors by resolving stress-induced maladaptive changes in the reward system.

The role of state uncertainty in the dynamics of dopamine

Reinforcement learning models of the basal ganglia map the phasic dopamine signal to reward prediction errors (RPEs). Conventional models assert that, when a stimulus predicts a reward with fixed delay, dopamine activity during the delay should converge to baseline through learning. However, recent studies have found that dopamine ramps up before reward in certain conditions even after learning, thus challenging the conventional models. In this work, we show that sensory feedback causes an unbiased learner to produce RPE ramps. Our model predicts that when feedback gradually decreases during a trial, dopamine activity should resemble a "bump," whose ramp-up phase should, furthermore, be greater than that of conditions where the feedback stays high. We trained mice on a virtual navigation task with varying brightness, and both predictions were empirically observed. In sum, our theoretical and experimental results reconcile the seemingly conflicting data on dopamine behaviors under the RPE hypothesis.

Lateral Habenula Beyond Avoidance: Roles in Stress, Memory, and Decision-Making With Implications for Psychiatric Disorders

In this Perspective review, we highlight some of the less explored aspects of lateral habenula (LHb) function in contextual memory, sleep, and behavioral flexibility. We provide evidence that LHb is well-situated to integrate different internal state and multimodal sensory information from memory-, stress-, motivational-, and reward-related circuits essential for both survival and decision making. We further discuss the impact of early life stress (ELS) on LHb function as an example of stress-induced hyperactivity and dysregulation of neuromodulatory systems within the LHb that promote anhedonia and motivational deficits following ELS. We acknowledge that recent technological advancements in manipulation and recording of neural circuits in simplified and well-controlled behavioral paradigms have been invaluable in our understanding of the critical role of LHb in motivation and emotional regulation as well as the involvement of LHb dysfunction in stress-induced psychopathology. However, we also argue that the use of ethologically-relevant behaviors with consideration of complex aspects of decision-making is warranted for future studies of LHb contributions in a wide range of psychiatric illnesses. We conclude this Perspective with some of the outstanding issues for the field to consider where a multi-systems approach is needed to investigate the complex nature of LHb circuitry interactions with environmental stimuli that predisposes psychiatric disorders.

Fetal programming of human energy homeostasis brain networks: Issues and considerations

In this paper, we present a transdisciplinary framework and testable hypotheses regarding the process of fetal programming of energy homeostasis brain circuitry. Our model proposes that key aspects of energy homeostasis brain circuitry already are functional by the time of birth (with substantial interindividual variation); that this phenotypic variation at birth is an important determinant of subsequent susceptibility for energy imbalance and childhood obesity risk; and that this brain circuitry exhibits developmental plasticity, in that it is influenced by conditions during intrauterine life, particularly maternal-placental-fetal endocrine, immune/inflammatory, and metabolic processes and their upstream determinants. We review evidence that supports the scientific premise for each element of this formulation, identify future research directions, particularly recent advances that may facilitate a better quantification of the ontogeny of energy homeostasis brain networks, highlight animal and in vitro-based approaches that may better address the determinants of interindividual variation in energy homeostasis brain networks, and discuss the implications of this formulation for the development of strategies targeted towards the primary prevention of childhood obesity.

GABAA receptor subtypes and benzodiazepine use, misuse, and abuse

Benzodiazepines have been in use for over half a century. While they remain highly prescribed, their unfavorable side-effect profile and abuse liability motivated a search for alternatives. Most of these efforts focused on the development of benzodiazepine-like drugs that are selective for specific GABA_A receptor subtypes. While there is ample evidence that subtype-selective GABA_A receptor ligands have great potential for providing symptom relief without typical benzodiazepine side-effects, it is less clear whether subtype-selective targeting strategies can also reduce misuse and abuse potential. This review focuses on the three benzodiazepine properties that are relevant to the DSM-5-TR criteria for Sedative, Hypnotic, or Anxiolytic Use Disorder, namely, reinforcing properties of benzodiazepines, maladaptive behaviors related to benzodiazepine use, and benzodiazepine tolerance and dependence. We review existing evidence regarding the involvement of different GABA_A receptor subtypes in each of these areas. The reviewed studies suggest that α1-containing GABA_A receptors play an integral role in benzodiazepine-induced plasticity in reward-related brain areas and might be involved in the development of tolerance and dependence to benzodiazepines. However, a systematic comparison of the contributions of all benzodiazepine-sensitive GABA_A receptors to these processes, a mechanistic understanding of how the positive modulation of each receptor subtype might contribute to the brain mechanisms underlying each of these processes, and a definitive answer to the question of whether specific chronic modulation of any given subtype would result in some or all of the benzodiazepine effects are currently lacking from the literature. Moreover, how non-selective benzodiazepines might lead to the maladaptive behaviors listed in DSM and how different GABA_A receptor subtypes might be involved in the development of these behaviors remains unexplored. Considering the increasing burden of benzodiazepine abuse, the common practice of benzodiazepine misuse that leads to severe dependence, and the current efforts to generate side-effect free benzodiazepine alternatives, there is an urgent need for systematic, mechanistic research that provides a better understanding of the brain mechanisms of benzodiazepine misuse and abuse, including the involvement of specific GABA_A receptor subtypes in these processes, to establish an informed foundation for preclinical and clinical efforts.

The Effect of Large Visual Illusion and External Focus of Attention on Gaze Behavior and Learning of Dart Throw Skill

Research has shown that large visual illusions and an external focus of attention can improve novice’s motor learning. However, the combined effects of these approaches and the underlying mechanisms have yet to be studied. Therefore, the present study examined the effects of a large visual illusion and an external focus on the learning of a dart throwing task in novices and measured the perceptual mechanisms underpinning learning using quiet eye. Forty novice participants were randomly divided into four groups: large visual illusion, external focus of attention, combined large visual illusion and external focus of attention, and control group. The study consisted of a pretest, a practice phase, an immediate retention test, a 24-hr retention test, and a transfer test. Results revealed that all groups increased throwing accuracy and quiet eye duration from pretest to immediate retention. In the immediate retention, 24-hr retention, and transfer test, large visual illusion had greater accuracy and longer quiet eye duration than the control group. In addition, there were no significant differences between the visual illusion and external focus groups for throwing accuracy and quiet eye duration. The findings suggest that combining large visual illusion and external focus can independently improve motor learning but combining these manipulations does not have additive benefits.

Anhedonia and Suicide

Suicide is a leading cause of death, and presently, there is no definitive clinical indicator of future suicide behaviors. Anhedonia, a transdiagnostic symptom reflecting diminished ability to experience pleasure, has recently emerged as a risk factor for suicidal thoughts and behaviors (STBs). This overview, therefore, has the following aims. First, prior research relating anhedonia to STBs will be reviewed, with a particular focus on clarifying whether anhedonia is more closely associated with suicidal thoughts versus behaviors. Second, the National Institute of Mental Health's Research Domain Criteria Positive Valence Systems provide a useful heuristic to probe anhedonia across different units of analysis, including clinical symptoms, behaviors, neural mechanisms, and molecular targets. Accordingly, anhedonia-related constructs linked to STBs will be detailed as well as promising next steps for future research. Third, although anhedonia is not directly addressed in leading suicide theories, this review will provide potential inroads to explore anhedonia within diathesis-stress and interpersonal suicide frameworks. Last, novel approaches to treat anhedonia as a means of reducing STBs will be examined.

Potentiation of glutamatergic synaptic transmission onto lateral habenula neurons following early life stress and intravenous morphine self-administration in rats

Early life stress presents an important risk factor for drug addiction and comorbid depression and anxiety through persistent effects on the mesolimbic dopamine pathways. Using an early life stress model for child neglect (a single 24 h episode of maternal deprivation, MD) in rats, recent published works from our lab show that MD induces dysfunction in the ventral tegmental area and its negative controller, the lateral habenula (LHb). MD-induced potentiation of glutamatergic synaptic transmission onto LHb neurons shifts the coordination of excitation/inhibition (E/I) balance towards excitation, resulting in an increase in the overall spontaneous neuronal activity with elevation in bursting and tonic firing, and in the intrinsic excitability of LHb neurons in early adolescent male rats. Here, we explored how MD affects intravenous morphine self-administration (MSA) acquisition and sucrose preference as well as glutamatergic synaptic function in LHb neurons of adult male rats self-administering morphine. We found that MD-induced increases in LHb neuronal and glutamatergic synaptic activity and E/I ratio persisted into adulthood. Moreover, MD significantly reduced morphine intake, triggered anhedonia-like behaviour in the sucrose preference test and was associated with persistent glutamatergic potentiation 24 h after the last MSA session. MSA also altered the decay time kinetics of α-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid (AMPA) receptor (AMPAR) currents in LHb neurons of control rats during this time period. Our data highlight that early life stress-induced glutamatergic plasticity in LHb may dampen the positive reinforcing and motivational properties of both natural rewards and opioids, and may contribute to the development of anhedonia and dysphoric states associated with opioids.

Two-Month administration of Methylphenidate improves olfactory sensitivity and suppresses appetite in individuals with obesity

INTRODUCTION

Olfaction contributes to feeding behaviour and is modulated by changes in dopamine levels. Methylphenidate (MPH) increases brain dopamine levels and has been shown to reduce appetite and promote weight loss in patients with attention deficit hyperactivity disorder. The objectives of this study were to test the effect of MPH on olfaction, appetite, energy intake and body weight on individuals with obesity.

METHODS

In a randomized, double-blind study, 12 participants (age 28.9±6.7 yrs) (BMI 36.1±4.5 kg/m2) were assigned to MPH (0.5mg/kg) (n=5) or Placebo (n=7) twice daily for 2 months. Appetite (Visual Analog Scale), odour threshold (Sniffin' Sticks®), energy intake (food menu), and body weight (DEXA scan) were measured at day 1 and day 60.

RESULTS

MPH intake significantly increased odour threshold scores (6.3±1.4 vs. 9.4±2.1 and 7.9±2.3 vs. 7.8±1.9, respectively; p=0.029) vs. Placebo. There was a significantly greater suppression of appetite sensations (desire to eat (p=0.001), hunger (p=0.008), and prospective food consumption (p=0.003)) and an increase in fullness (p=0.028) over time in the MPH vs. Placebo.

CONCLUSIONS

MPH suppressed appetite and improved olfactory sensitivity in individuals with obesity. These data provide novel findings on the favourable effects of MPH on appetite and weight regulation in individuals living with obesity.

Dopamine release during psychological stress in euthymic bipolar I disorder: a Positron Emission Tomography study with [11C]raclopride

BACKGROUND

Neurochemical mechanisms underlying stress induced relapse of mood episodes in Bipolar I Disorder (BD) remain unknown. This study investigated whether euthymic BD patients have a greater dopamine release in ventral striatum, caudate and putamen in response to psychological stress using Positron Emission Tomography (PET) scanning with the radiotracer [¹¹C]raclopride.

METHODS

Euthymic patients with BD (n = 10) and 10 matched healthy controls underwent two [¹¹C]raclopride PET scans, one during a "stress" and the other in a "no stress" condition separated by at least 24 h. Montreal Imaging Stress Test (MIST) was used to induce stress during stress condition. Participants received an injection of [¹¹C]raclopride over one minute followed by PET scan for 60 min. Participants were assessed for mood symptom severity at baseline, and before and after each scan. The reduction in [¹¹C]raclopride binding in stress condition compared with non-stress rest condition for each subject provided an estimate of dopamine release due to stress.

RESULTS

There was a significant effect of stress in reducing the [¹¹C]raclopride binding in the ventral striatum, caudate and putamen; however, no significant effects of group or condition x group interaction were found.

LIMITATIONS

Small sample size and recruitment of euthymic patients who may be less vulnerable to stress may limit the generalizability of findings.

CONCLUSIONS

Our findings showed that psychological stress led to dopamine release in the basal ganglia for all participants but the magnitude of dopamine release during a stress task was not different between euthymic BD patients and healthy controls.

The Aversion Function of the Limbic Dopaminergic Neurons and Their Roles in Functional Neurological Disorders

The Freudian theory of conversion suggested that the major symptoms of functional neurological disorders (FNDs) are due to internal conflicts at motivation, especially at the sex drive or libido. FND patients might behave properly at rewarding situations, but they do not know how to behave at aversive situations. Sex drive is the major source of dopamine (DA) release in the limbic area; however, the neural mechanism involved in FND is not clear. Dopaminergic (DAergic) neurons have been shown to play a key role in processing motivation-related information. Recently, DAergic neurons are found to be involved in reward-related prediction error, as well as the prediction of aversive information. Therefore, it is suggested that DA might change the rewarding reactions to aversive reactions at internal conflicts of FND. So DAergic neurons in the limbic areas might induce two major motivational functions: reward and aversion at internal conflicts. This article reviewed the recent advances on studies about DAergic neurons involved in aversive stimulus processing at internal conflicts and summarizes several neural pathways, including four limbic system brain regions, which are involved in the processing of aversion. Then the article discussed the vital function of these neural circuits in addictive behavior, depression treatment, and FNDs. In all, this review provided a prospect for future research on the aversion function of limbic system DA neurons and the therapy of FNDs.

Pharmacotherapy for Neuropsychiatric Symptoms in Frontotemporal Dementia

Despite significant progress in the understanding of the frontotemporal dementias (FTDs), there remains no disease-modifying treatment for these conditions, and limited effective symptomatic treatment. Behavioural variant frontotemporal dementia (bvFTD) is the most common FTD syndrome, and is characterized by severe impairments in behaviour, personality and cognition. Neuropsychiatric symptoms are common features of bvFTD but are present in the other FTD syndromes. Current treatment strategies therefore focus on ameliorating the neuropsychiatric features. Here we review the rationale for current treatments related to each of the main neuropsychiatric symptoms forming the diagnostic criteria for bvFTD relevant to all FTD subtypes, and two additional symptoms not currently part of the diagnostic criteria: lack of insight and psychosis. Given the paucity of effective treatments for these symptoms, we highlight how contributing mechanisms delineated in cognitive neuroscience may inform future approaches to clinical trials and more precise symptomatic treatments for FTDs.