Mesolimbic functional magnetic resonance imaging activations during reward anticipation correlate with reward-related ventral striatal dopamine release

Learning and memory processes in behavioural addiction: A systematic review

Similar to addictive substances, addictive behaviours such as gambling and gaming are associated with maladaptive modulation of key brain areas and functional networks implicated in learning and memory. Therefore, this review sought to understand how different learning and memory processes relate to behavioural addictions and to unravel their underlying neural mechanisms. Adhering to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, we systematically searched four databases - PsycINFO, PubMed, Scopus, and Web of Science using the agreed-upon search string. Findings suggest altered executive function-dependent learning processes and enhanced habit learning in behavioural addiction. Whereas the relationship between working memory and behavioural addiction is influenced by addiction type, working memory aspect, and task nature. Additionally, long-term memory is incoherent in individuals with addictive behaviours. Consistently, neurophysiological evidence indicates alterations in brain areas and networks implicated in learning and memory processes in behavioural addictions. Overall, the present review argues that, like substance use disorders, alteration in learning and memory processes may underlie the development and maintenance of behavioural addictions.

Effects of acute stress on reward processing: A comprehensive meta-analysis of rodent and human studies

Stressors can initiate a cascade of central and peripheral changes that modulate mesocorticolimbic dopaminergic circuits and, ultimately, behavioral response to rewards. Driven by the absence of conclusive evidence on this topic and the Research Domain Criteria framework, random-effects meta-analyses were adopted to quantify the effects of acute stressors on reward responsiveness, valuation, and learning in rodent and human subjects. In rodents, acute stress reduced reward responsiveness (g = -1.43) and valuation (g = -0.32), while amplifying reward learning (g = 1.17). In humans, acute stress had marginal effects on valuation (g = 0.25), without affecting responsiveness and learning. Moderation analyses suggest that acute stress neither has unitary effects on reward processing in rodents nor in humans and that the duration of the stressor and specificity of reward experience (i.e., food vs drugs) may produce qualitatively and quantitatively different behavioral endpoints. Subgroup analyses failed to reduce heterogeneity, which, together with the presence of publication bias, pose caution on the conclusions that can be drawn and point to the need of guidelines for the conduction of future studies in the field.

Potential Mechanism Linking Peer Relationships and Adolescent Prosocial Behavior: Mediation of Cognitive Empathy and Moderations of OXTR and DRD2

Peers are important socializers of adolescent prosocial behavior. Still, the proximal cognitive and emotional process underlying this link and the sources of individual differences in sensitivity to peer influence have yet to be explored. Utilizing the gene-gene-environment (G × G × E) approach and multi-informant measurement, this study investigated how peer relationships operate to influence adolescent prosocial behavior by examining the mediating role of cognitive and emotional empathy, and the moderating role of the OXTR and DRD2 genes. The study utilized longitudinal data from a community sample of Chinese adolescents (N = 1080, Mage = 13.32 years at T1). Results showed that cognitive empathy rather than emotional empathy mediated the link between peer acceptance/rejection and prosocial behavior. Furthermore, the association among peer acceptance, cognitive empathy, and prosocial behavior was moderated by OXTR and DRD2. Specifically, adolescents with the combinations of AA/AA or G/G genotypes of OXTR/DRD2 benefited more from peer acceptance compared to their counterparts carrying other combined genotypes. The findings highlight cognitive empathy as a proximal process linking peer interaction to prosocial behavior and lend support to the interaction between oxytocinergic and dopaminergic systems on environmental sensitivity.

Effect of positive social comparative feedback on the resting state connectivity of dopaminergic neural pathways: A preliminary investigation

Positive social comparative feedback is hypothesized to generate a dopamine response in the brain, similar to reward, by enhancing expectancies to support motor skill learning. However, no studies have utilized neuroimaging to examine this hypothesized dopaminergic mechanism. Therefore, the aim of this preliminary study was to investigate the effect of positive social comparative feedback on dopaminergic neural pathways measured by resting state connectivity. Thirty individuals practiced an implicit, motor sequence learning task and were assigned to groups that differed in feedback type. One group received feedback about their actual response time to complete the task (RT ONLY), while the other group received feedback about their response time with positive social comparison (RT + POS). Magnetic resonance imaging was acquired at the beginning and end of repetitive motor practice with feedback to measure practice-dependent changes in resting state brain connectivity. While both groups showed improvements in task performance and increases in performance expectancies, ventral tegmental area and the left nucleus accumbens (mesolimbic dopamine pathway) resting state connectivity increased in the RT + POS group but not in the RT ONLY group. Instead, the RT ONLY group showed increased connectivity between ventral tegmental area and primary motor cortex. Positive social comparative feedback during practice of a motor sequence task may induce a dopaminergic response in the brain along the mesolimbic pathway. However, given that absence of effects on expectancies and motor learning, more robust and individualized approaches may be needed to provide beneficial psychological and behavioral effects.

Dopamine signaling enriched striatal gene set predicts striatal dopamine synthesis and physiological activity in vivo

The polygenic architecture of schizophrenia implicates several molecular pathways involved in synaptic function. However, it is unclear how polygenic risk funnels through these pathways to translate into syndromic illness. Using tensor decomposition, we analyze gene co-expression in the caudate nucleus, hippocampus, and dorsolateral prefrontal cortex of post-mortem brain samples from 358 individuals. We identify a set of genes predominantly expressed in the caudate nucleus and associated with both clinical state and genetic risk for schizophrenia that shows dopaminergic selectivity. A higher polygenic risk score for schizophrenia parsed by this set of genes predicts greater dopamine synthesis in the striatum and greater striatal activation during reward anticipation. These results translate dopamine-linked genetic risk variation into in vivo neurochemical and hemodynamic phenotypes in the striatum that have long been implicated in the pathophysiology of schizophrenia.

Fractional amplitude of low-frequency fluctuations associated with μ-opioid and dopamine receptor distributions in the central nervous system after high-intensity exercise bouts

Introduction

Dopaminergic, opiod and endocannabinoid neurotransmission are thought to play an important role in the neurobiology of acute exercise and, in particular, in mediating positive affective responses and reward processes. Recent evidence indicates that changes in fractional amplitude of low-frequency fluctuations (zfALFF) in resting-state functional MRI (rs-fMRI) may reflect changes in specific neurotransmitter systems as tested by means of spatial correlation analyses.

Methods

Here, we investigated this relationship at different exercise intensities in twenty young healthy trained athletes performing low-intensity (LIIE), high-intensity (HIIE) interval exercises, and a control condition on three separate days. Positive And Negative Affect Schedule (PANAS) scores and rs-fMRI were acquired before and after each of the three experimental conditions. Respective zfALFF changes were analyzed using repeated measures ANOVAs. We examined the spatial correspondence of changes in zfALFF before and after training with the available neurotransmitter maps across all voxels and additionally, hypothesis-driven, for neurotransmitter maps implicated in the neurobiology of exercise (dopaminergic, opiodic and endocannabinoid) in specific brain networks associated with "reward" and "emotion."

Results

Elevated PANAS Positive Affect was observed after LIIE and HIIE but not after the control condition. HIIE compared to the control condition resulted in differential zfALFF decreases in precuneus, temporo-occipital, midcingulate and frontal regions, thalamus, and cerebellum, whereas differential zfALFF increases were identified in hypothalamus, pituitary, and periaqueductal gray. The spatial alteration patterns in zfALFF during HIIE were positively associated with dopaminergic and μ-opioidergic receptor distributions within the 'reward' network.

Discussion

These findings provide new insight into the neurobiology of exercise supporting the importance of reward-related neurotransmission at least during high-intensity physical activity.

Impact of movie and video game elements on tic manifestation in children

BACKGROUND AND PURPOSE

Children in developed countries spend a significant portion of their waking hours engaging with audiovisual content and video games. The impact of media consumption on children's health and well-being has been widely studied, including its effects on tic disorders. Previous studies have shown that tic frequency can both increase and decrease during activities like gaming and television watching, resulting in mixed findings.

METHODS

To better understand the impact of audiovisual media on tics, we conducted a fine-grained tic manifestation analysis. We focused on the effects of the impact of a movie scene with suspensful elements and a video game designed to heighten anticipation, thought to stimulate phasic and striatal dopamine release. We closely monitored tic frequency throuhghout these experiences based on moment-to-moment tic annotation. The study included 20 participants (19 males aged 7-16) diagnosed with tic disorders (Yale Global Tic Severity Scale≥8), and we tested the replicability of our findings with an independent group of 36 children (15 females, aged 7-15) with tic disorders.

RESULTS

During film viewing, we observed significant synchronization in the temporal tic patterns of various individuals despite diversity in their tic profiles. Furthermore, employing a video game developed for our study, we found that tic frequency increases during anticipation of a pending reward. This finding was replicated in a second experiment with an independent cohort.

CONCLUSIONS

Our results indicate that tic frequency is affected by media elements in the short-term, and call for further investigation of the long-term impacts of exposure to such tic triggers.

Advances in functional MRI research in bipolar disorder: from the perspective of mood states

Bipolar disorder is characterised by recurrent and alternating episodes of mania/hypomania and depression. Current breakthroughs in functional MRI techniques have uncovered the functional neuroanatomy of bipolar disorder. However, the pathophysiology underlying mood instability, mood switching and the development of extreme mood states is less well understood. This review presents a comprehensive overview of current evidence from functional MRI studies from the perspective of mood states. We first summarise the disrupted brain activation patterns and functional connectivity that have been reported in bipolar disorder, irrespective of the mood state. We next focus on research that solely included patients in a single mood state for a better understanding of the pathophysiology of bipolar disorder and research comparing patients with different mood states to dissect mood state-related effects. Finally, we briefly summarise current theoretical models and conclude this review by proposing potential avenues for future research. A comprehensive understanding of the pathophysiology with consideration of mood states could not only deepen our understanding of how acute mood episodes develop at a neurophysiological level but could also facilitate the identification of biological targets for personalised treatment and the development of new interventions for bipolar disorder.

The road not taken: Common and distinct neural correlates of regret and relief

Humans anticipate and evaluate both obtained and counterfactual outcomes - outcomes that could have been had an alternate decision been taken - and experience associated emotions of regret and relief. Although many functional magnetic resonance imaging (fMRI) studies have examined the neural correlates of these emotions, there is substantial heterogeneity in their results. We conducted coordinate-based ALE and network-based ANM meta-analysis of fMRI studies of experienced regret and relief to examine commonalities and differences in their neural correlates. Regionally, we observed that the experience of both regret and relief was associated with greater activation in the right ventral striatum (VS), which is implicated in tracking reward prediction error. At the network level, regret and relief shared the reward-sensitive mesocorticolimbic network with preferential activation of the medial orbitofrontal cortex (mOFC) for regret processing and medial cingulate cortex (MCC) for relief processing. Our research identified shared and separable brain systems subserving regret and relief experience, which may inform the treatment of regret-related mood disorders.

Depression recurrence is accompanied by longer periods in default mode and more frequent attentional and reward processing dynamic brain-states during resting-state activity

Recurrence in major depressive disorder (MDD) is common, but neurobiological models capturing vulnerability for recurrences are scarce. Disturbances in multiple resting-state networks have been linked to MDD, but most approaches focus on stable (vs. dynamic) network characteristics. We investigated how the brain's dynamical repertoire changes after patients transition from remission to recurrence of a new depressive episode. Sixty two drug-free, MDD-patients with ≥2 episodes underwent a baseline resting-state fMRI scan when in remission. Over 30-months follow-up, 11 patients with a recurrence and 17 matched-remitted MDD-patients without a recurrence underwent a second fMRI scan. Recurrent patterns of functional connectivity were characterized by applying Leading Eigenvector Dynamics Analysis (LEiDA). Differences between baseline and follow-up were identified for the 11 non-remitted patients, while data from the 17 matched-remitted patients was used as a validation dataset. After the transition into a depressive state, basal ganglia-anterior cingulate cortex (ACC) and visuo-attentional networks were detected significantly more often, whereas default mode network activity was found to have a longer duration. Additionally, the fMRI signal in the basal ganglia-ACC areas underlying the reward network, were significantly less synchronized with the rest of the brain after recurrence (compared to a state of remission). No significant changes were observed in the matched-remitted patients who were scanned twice while in remission. These findings characterize changes that may be associated with the transition from remission to recurrence and provide initial evidence of altered dynamical exploration of the brain's repertoire of functional networks when a recurrent depressive episode occurs.

Neurocognitive predictors of food memory in healthy adults - A preregistered analysis

Memory processes have long been known to determine food choices (Rozin & Zellner, 1985) but recognition memory of food and its cognitive, homeostatic and neuroanatomical predictors are still largely understudied. 60 healthy, overweight, non-restrictive eating adults (20 females) took part in a food wanting and subsequent food recognition and lure discrimination task at four time points after a standardized breakfast shake. With advanced tractography of 3 T diffusion-weighted imaging data, we investigated the influence of the uncinate fasciculus' (UF) brain microstructure on the interplay of food wanting and memory processes. The analysis was preregistered in detail and conducted with Bayesian multilevel regression modeling. Target recognition (d') and lure discrimination (LDI) performance of food tended to be higher than of art images while single image food memory accuracy evidently dominated art memory. On this single item level, wanting enhanced recognition accuracy and caloric content enhanced food memory accuracy. The enhancement by reward anticipation was most pronounced during memory encoding. Subjective hunger level did not predict performance on the memory task. The microstructure of the UF did neither evidently affect memory performance outcomes nor moderate the wanting enhancement of the recognition accuracy. Interestingly, female participants outperformed males on the memory task, and individuals with stronger neuroticism showed poorer memory performance. We shed light on to date understudied processes in food decision-making: reward anticipation influenced recognition accuracy and food memory was enhanced by higher caloric content, both effects might shape food decisions. Our findings indicate that brain microstructure does not affect food decision processes in adult populations with overweight. We suggest extending investigation of this interplay to brain activity as well as to populations with eating behaviour disorders.

Using latent profile analyses to classify subjects with anhedonia based on reward-related measures obtained in the FAST-MAS study

BACKGROUND

Growing evidence indicates that anhedonia is a multifaceted construct. This study examined the possibility of identifying subgroups of people with anhedonia using multiple reward-related measures to provide greater understanding the Research Domain Criteria's Positive Valence Systems Domain and pathways for developing treatments.

METHODS

Latent profile analysis of baseline data from a study that examined the effects of a novel kappa opioid receptor (KOR) antagonist drug on measures and biomarkers associated with anhedonia was used to identify subgroups. Measures included ventral striatal activation during the Monetary Incentive Delay task, response bias in the Probabilistic Reward Task, reward valuation scores from the Effort-Expenditure for Rewards Task, and scores from reward-related self-report measures.

RESULTS

Two subgroups were identified, which differed on self-report measures of reward. Participants in the subgroup reporting more anhedonia also reported more depression and had greater illness severity and functional impairments. Graphs of change with treatment showed a trend for the less severe subgroup to demonstrate higher response to KOR antagonist treatment on the neuroimaging measure, probabilistic reward task, and ratings of functioning; the subgroup with greater severity showed a trend for higher treatment response on reward-related self-report measures.

LIMITATIONS

The main limitations include the small sample size and exploratory nature of analyses.

CONCLUSIONS

Evidence of possible dissociation between self-reported measures of anhedonia and other measures with respect to treatment response emerged. These results highlight the importance for future research to consider severity of self-reported reward-related deficits and how the relationship across measurement methods may vary with severity.

Dopamine and schizophrenia from bench to bedside: Discovery of a striatal co-expression risk gene set that predicts in vivo measures of striatal function

Schizophrenia (SCZ) is characterized by a polygenic risk architecture implicating diverse molecular pathways important for synaptic function. However, how polygenic risk funnels through these pathways to translate into syndromic illness is unanswered. To evaluate biologically meaningful pathways of risk, we used tensor decomposition to characterize gene co-expression in post-mortem brain (of neurotypicals: N=154; patients with SCZ: N=84; and GTEX samples N=120) from caudate nucleus (CN), hippocampus (HP), and dorsolateral prefrontal cortex (DLPFC). We identified a CN-predominant gene set showing dopaminergic selectivity that was enriched for genes associated with clinical state and for genes associated with SCZ risk. Parsing polygenic risk score for SCZ based on this specific gene set (parsed-PRS), we found that greater pathway-specific SCZ risk predicted greater in vivo striatal dopamine synthesis capacity measured by [ 18 F]-FDOPA PET in three independent cohorts of neurotypicals and patients (total N=235) and greater fMRI striatal activation during reward anticipation in two additional independent neurotypical cohorts (total N=141). These results reveal a 'bench to bedside' translation of dopamine-linked genetic risk variation in driving in vivo striatal neurochemical and hemodynamic phenotypes that have long been implicated in the pathophysiology of SCZ.

Impulse control disorder in Parkinson's disease is associated with abnormal frontal value signalling

Dopaminergic medication is well established to boost reward- versus punishment-based learning in Parkinson's disease. However, there is tremendous variability in dopaminergic medication effects across different individuals, with some patients exhibiting much greater cognitive sensitivity to medication than others. We aimed to unravel the mechanisms underlying this individual variability in a large heterogeneous sample of early-stage patients with Parkinson's disease as a function of comorbid neuropsychiatric symptomatology, in particular impulse control disorders and depression. One hundred and ninety-nine patients with Parkinson's disease (138 ON medication and 61 OFF medication) and 59 healthy controls were scanned with functional MRI while they performed an established probabilistic instrumental learning task. Reinforcement learning model-based analyses revealed medication group differences in learning from gains versus losses, but only in patients with impulse control disorders. Furthermore, expected-value related brain signalling in the ventromedial prefrontal cortex was increased in patients with impulse control disorders ON medication compared with those OFF medication, while striatal reward prediction error signalling remained unaltered. These data substantiate the hypothesis that dopamine's effects on reinforcement learning in Parkinson's disease vary with individual differences in comorbid impulse control disorder and suggest they reflect deficient computation of value in medial frontal cortex, rather than deficient reward prediction error signalling in striatum. See Michael Browning (https://doi.org/10.1093/brain/awad248) for a scientific commentary on this article.

Effects of Adult Age and Functioning of the Locus Coeruleus Norepinephrinergic System on Reward-Based Learning

Age-related impairments in value representations and updating during decision-making and reward-based learning are often related to age-related attenuation in the catecholamine system such as dopamine (DA) and norepinephrine (NE). However, it is unclear to what extent age-related declines in NE functioning in humans affect reward-based decision-making. We conducted a probabilistic decision-making task and applied a Q-learning model to investigate participants' anticipatory values and value sensitivities. Task-related pupil dilations and locus coeruleus (LC) magnetic resonance imaging (MRI) contrast, which served as a potential window of the LC-NE functions, were assessed in younger and older adults. Results showed that in both choice and feedback phases, younger adults' (N = 42, 22 males) pupil dilations negatively correlated with anticipatory values, indicating uncertainty about outcome probabilities. Uncertainty-evoked pupil dilations in older adults (N = 41, 27 males) were smaller, indicating age-related impairments in value estimation and updating. In both age groups, participants who showed a larger uncertainty-evoked pupil dilation exhibited a higher value sensitivity as reflected in the β parameter of the reinforcement Q-learning model. Furthermore, older adults (N = 34, 29 males) showed a lower LC-MRI contrast than younger adults (N = 25, 15 males). The LC-MRI contrast positively correlated with value sensitivity only in older but not in younger adults. These findings suggest that task-related pupillary responses can reflect age-related deficits in value estimation and updating during reward-based decision-making. Our evidence with the LC-MRI contrast further showed the age-related decline of the LC structure in modulating value representations during reward-based learning.SIGNIFICANCE STATEMENT Age-related impairments in value representation and updating during reward-based learning are associated with declines in the catecholamine modulation with age. However, it is unclear how age-related declines in the LC-NE system may affect reward-based learning. Here, we show that compared with younger adults, older adults exhibited reduced uncertainty-induced pupil dilations, suggesting age-related deficits in value estimation and updating. Older adults showed a lower structural MRI of the LC contrast than younger adults, indicating age-related degeneration of the LC structure. The association between the LC-MRI contrast and value sensitivity was only observed in older adults. Our findings may demonstrate a pioneering model to unravel the role of the LC-NE system in reward-based learning in aging.

Graph Theoretical Network Structures Underlie Age-Related Differences in the Functional Connectome During Rest and Music Listening

Aging is associated with decreased functional connectivity within the default mode network, as well as auditory and reward systems which are involved in music listening. Understanding how music listening affects network organization of the aging brain, both globally and specific to the brain networks, will have implications for designing lifestyle interventions that tap into distinct networks in the brain. Here we apply graph-theory metrics of modularity, global efficiency, clustering coefficients, degrees, and betweenness centrality to compare younger and older adults (YA/OA, N=24 per group) in fMRI connectivity during rest and a music listening task. Results show a less modular but more globally efficient connectome in OAs, especially during music listening, resulting in main effects of group and task, as well as group-by-task interactions. ROI analyses indicated that the posterior cingulate is more centrally located than the medial prefrontal cortex in OAs. Overall, reduced modularity and increased global efficiency with age is in keeping with previously-observed functional reorganizations, and interaction effects show that age-related differences in baseline network organization are reflected in, potentially magnified by, music listening.

Visual Sequence Encoding is Enhanced by Predictable Music Pairing via Modulating Medial Temporal Lobe and Its Connectivity with Frontostriatal Loops

Listening to music during cognitive activities, such as reading and studying, is very common in human daily life. Therefore, it is important to understand how music interacts with concurrent cognitive functions, particularly memory. Current literature has presented mixed results for whether music can benefit learning in other modalities. Evidence is needed for what neural mechanisms music can tap into to enhance concurrent memory processing. This fMRI study aimed to begin filling this gap by investigating how music of varying predictability levels influences parallel visual sequence encoding performance. Behavioral results suggest that overall, predictable music enhances visual sequential encoding, and this effect increases with the structural regularity and familiarity of music. fMRI results indicate that during visual sequence encoding, music activates traditional music-processing and motor-related areas, but decreases parahippocampal and striatal engagement. This deactivation may indicate a more efficient encoding of visual information when music is present. By comparing music conditions of different structural predictability and familiarity, we probed how this occurs. We demonstrate improved encoding with increased syntactical regularity, which was associated with decreased activity in default mode network and increased activity in inferior temporal gyrus. Furthermore, the temporal schema provided by music familiarity may influence encoding through altered functional connectivity between the prefrontal cortex, medial temporal lobe and striatum. Overall, we propose that pairing music with learning might facilitate memory by reducing neural demands for visual encoding and simultaneously strengthening the connectivity between the medial temporal lobe and frontostriatal loops important for sequencing information.

Significance Statement

There is considerable interest in what mechanisms can be tapped to improve human memory. Music provides a potential modulator, but few studies have investigated music effects on encoding episodic memory. This study used a novel design to examine how music can influence concurrent visual item sequence encoding. We provided neural data to better understand mechanisms behind potential benefits of music for learning. Our results demonstrated predictable music may help guide parallel learning of sequences in another modality. We found that music might facilitate processing in neural systems associated with visual declarative long-term and working memory, and familiar music might modulate reward circuits and provide a temporal schema which facilitates better encoding of the temporal structure of new non-music information.

Striatal dopamine in anhedonia: A simultaneous [11C]raclopride positron emission tomography and functional magnetic resonance imaging investigation

BACKGROUND

Anhedonia is hypothesized to be associated with blunted mesocorticolimbic dopamine (DA) functioning in samples with major depressive disorder. The purpose of this study was to examine linkages between striatal DA, reward circuitry functioning, anhedonia, and, in an exploratory fashion, self-reported stress, in a transdiagnostic anhedonic sample.

METHODS

Participants with (n = 25) and without (n = 12) clinically impairing anhedonia completed a reward-processing task during simultaneous positron emission tomography and magnetic resonance (PET-MR) imaging with [11C]raclopride, a DA D2/D3 receptor antagonist that selectively binds to striatal DA receptors.

RESULTS

Relative to controls, the anhedonia group exhibited decreased task-related DA release in the left putamen, caudate, and nucleus accumbens and right putamen and pallidum. There were no group differences in task-related brain activation (fMRI) during reward processing after correcting for multiple comparisons. General functional connectivity (GFC) findings revealed blunted fMRI connectivity between PET-derived striatal seeds and target regions in the anhedonia group. Associations were identified between anhedonia severity and the magnitude of task-related DA release to rewards in the left putamen, but not mesocorticolimbic GFC.

CONCLUSIONS

Results provide evidence for reduced striatal DA functioning during reward processing and blunted mesocorticolimbic network functional connectivity in a transdiagnostic sample with clinically significant anhedonia.

Reward processing in schizophrenia and its relation to Mu opioid receptor availability and negative symptoms: A [11C]-carfentanil PET and fMRI study

BACKGROUND

Reward processing deficits are a core feature of schizophrenia and are thought to underlie negative symptoms. Pre-clinical evidence suggests that opioid neurotransmission is linked to reward processing. However, the contribution of Mu Opioid Receptor (MOR) signalling to the reward processing abnormalities in schizophrenia is unknown. Here, we examined the association between MOR availability and the neural processes underlying reward anticipation in patients with schizophrenia using multimodal neuroimaging.

METHOD

37 subjects (18 with Schizophrenia with moderate severity negative symptoms and 19 age and sex-matched healthy controls) underwent a functional MRI scan while performing the Monetary Incentive Delay (MID) task to measure the neural response to reward anticipation. Participants also had a [11C]-carfentanil PET scan to measure MOR availability.

RESULTS

Reward anticipation was associated with increased neural activation in a widespread network of brain regions including the striatum. Patients with schizophrenia had both significantly lower MOR availability in the striatum as well as striatal hypoactivation during reward anticipation. However, there was no association between MOR availability and striatal neural activity during reward anticipation in either patient or controls (Pearson's Correlation, controls df = 17, r = 0.321, p = 0.18, patients df = 16, r = 0.295, p = 0.24). There was no association between anticipation-related neural activation and negative symptoms (r = -0.120, p = 0.14) or anhedonia severity (social r = -0.365, p = 0.14 physical r = -0.120, p = 0.63).

CONCLUSIONS

Our data suggest reduced MOR availability in schizophrenia might not underlie striatal hypoactivation during reward anticipation in patients with established illness. Therefore, other mechanisms, such as dopamine dysfunction, warrant further investigation as treatment targets for this aspect of the disorder.

Dissociation of basolateral and central amygdala effective connectivity predicts the stability of emotion-related impulsivity in adolescents and emerging adults with borderline personality symptoms: a resting-state fMRI study

BACKGROUND

Borderline personality disorder (BPD) is associated with altered activity in the prefrontal cortex (PFC) and amygdala, yet no studies have examined fronto-limbic circuitry in borderline adolescents and emerging adults. Here, we examined the contribution of fronto-limbic effective connectivity (EC) to the longitudinal stability of emotion-related impulsivity, a key feature of BPD, in symptomatic adolescents and young adults.

METHODS

We compared resting-state EC in 82 adolescents and emerging adults with and without clinically significant borderline symptoms (n BPD = 40, ages 13-30). Group-specific directed networks were estimated amongst fronto-limbic nodes including PFC, ventral striatum (VS), central amygdala (CeN), and basolateral amygdala (BLA). We examined the association of directed centrality metrics with initial levels and rates of change in emotion-related impulsivity symptoms over a one-year follow-up using latent growth curve models (LGCMs).

RESULTS

In controls, ventromedial prefrontal cortex (vmPFC) and dorsal ACC had a directed influence on CeN and VS, respectively. In the BPD group, bilateral BLA had a directed influence on CeN, whereas in the healthy group CeN influenced BLA. LGCMs indicated that emotion-related impulsivity was stable across a one-year follow-up in the BPD group. Further, higher EC of R CeN to other regions in controls was associated with stronger within-person decreases in emotion-related impulsivity.

CONCLUSIONS

Functional inputs from BLA and vmPFC appear to play competing roles in influencing CeN activity. In borderline adolescents and young adults, BLA may predominate over CeN activity, while in controls the ability of CeN to influence BLA activity predicted more rapid reductions in emotion-related impulsivity.

D2/3 Agonist during Learning Potentiates Cued Risky Choice

Impulse control and/or gambling disorders can be triggered by dopamine agonist therapies used to treat Parkinson's disease, but the cognitive and neurobiological mechanisms underlying these adverse effects are unknown. Recent data show that adding win-paired sound and light cues to the rat gambling task (rGT) potentiates risky decision-making and impulsivity via the dopamine system, and that changing dopaminergic tone has a greater influence on behavior while subjects are learning task contingencies. Dopamine agonist therapy may therefore be potentiating risk-taking by amplifying the behavioral impact of gambling-related cues on novel behavior. Here, we show that ropinirole treatment in male rats transiently increased motor impulsivity but robustly and progressively increased choice of the high-risk/high-reward options when administered during acquisition of the cued but not uncued rGT. Early in training, ropinirole increased win-stay behavior after large unlikely wins on the cued rGT, indicative of enhanced model-free learning, which mediated the drug's effect on later risk preference. Ex vivo cFos imaging showed that both chronic ropinirole and the addition of win-paired cues suppressed the activity of dopaminergic midbrain neurons. The ratio of midbrain:prefrontal cFos+ neurons was lower in animals with suboptimal choice patterns and tended to predict risk preference across all rats. Network analyses further suggested that ropinirole induced decoupling of the dopaminergic cells of the VTA and nucleus accumbens but only when win-paired cues were present. Frontostriatal activity uninformed by the endogenous dopaminergic teaching signal therefore appeared to perpetuate risky choice, and ropinirole exaggerated this disconnect in synergy with reward-paired cues.SIGNIFICANCE STATEMENT D2/3 receptor agonists, used to treat Parkinson's disease, can cause gambling disorder through an unknown mechanism. Ropinirole increased risky decision-making in rats, but only when wins were paired with casino-inspired sounds and lights. This was mediated by increased win-stay behavior after large unlikely wins early in learning, indicating enhanced model-free learning. cFos imaging showed that ropinirole suppressed activity of midbrain dopamine neurons, an effect that was mimicked by the addition of win-paired cues. The degree of risky choice rats exhibited was uniquely predicted by the ratio of midbrain dopamine:PFC activity. Depriving the PFC of the endogenous dopaminergic teaching signal may therefore drive risky decision-making on-task, and ropinirole acts synergistically with win-paired cues to amplify this.

The role of opioid transmission in music-induced pleasure

Studies conducted in rodents indicate a crucial role of the opioid circuit in mediating objective hedonic reactions to primary rewards. However, it remains unclear whether opioid transmission is also essential to experience pleasure with more abstract rewards, such as music. We addressed this question using a double-blind within-subject pharmacological design in which opioid levels were up- and downregulated by administering an opioid agonist (oxycodone) and antagonist (naltrexone), respectively, before healthy participants (n = 21) listened to music. Participants also performed a monetary incentive delay (MID) task to control for the effectiveness of the treatment and the specificity of the effects. Our results revealed that the pharmacological intervention did not modulate subjective reports of pleasure, nor the occurrence of chills. On the contrary, psychophysiological (objective) measures of emotional arousal, such as skin conductance responses (SCRs), were bidirectionally modulated in both the music and MID tasks. This modulation specifically occurred during reward consumption, with greater pleasure-related SCR following oxycodone than naltrexone. These findings indicate that opioid transmission does not modulate subjective evaluations but rather affects objective reward-related psychophysiological responses. These findings raise new caveats about the role of the opioidergic system in the modulation of pleasure for more abstract or cognitive forms of rewarding experiences, such as music.

Reward, motivation and brain imaging in human healthy participants - A narrative review

Over the past 20 years there has been an increasing number of brain imaging studies on the mechanisms underlying reward motivation in humans. This narrative review describes studies on the neural mechanisms associated with reward motivation and their relationships with cognitive function in healthy human participants. The brain's meso-limbic dopamine reward circuitry in humans is known to control reward-motivated behavior in humans. The medial and lateral Pre-Frontal Cortex (PFC) integrate motivation and cognitive control during decision-making and the dorsolateral PFC (dlPFC) integrates and transmits signals of reward to the mesolimbic and meso-cortical dopamine circuits and initiates motivated behavior. The thalamus and insula influence incentive processing in humans and the motor system plays a role in response to action control. There are reciprocal relationships between reward motivation, learning, memory, imagery, working memory, and attention. The most common method of assessing reward motivation is the monetary incentive delay task (DMRT) and there are several meta-analyses of this paradigm. Genetics modulates motivation reward, and dopamine provides the basis for the interaction between motivational and cognitive control. There is some evidence that male adolescents take more risky decisions than female adolescents and that the lateralization of reward-related DA release in the ventral striatum is confined to men. These studies have implications for our understanding of natural reward and psychiatric conditions like addiction, depression and ADHD. Furthermore, the association between reward and memory can help develop treatment techniques for drug addiction that interfere with consolidation of memory. Finally, there is a lack of research on reward motivation, genetics and sex differences and this can improve our understanding of the relationships between reward, motivation and the brain.

Prefrontal modulation of anxiety through a lens of noradrenergic signaling

Anxiety disorders are the most common class of mental illness in the U.S., affecting 40 million individuals annually. Anxiety is an adaptive response to a stressful or unpredictable life event. Though evolutionarily thought to aid in survival, excess intensity or duration of anxiogenic response can lead to a plethora of adverse symptoms and cognitive dysfunction. A wealth of data has implicated the medial prefrontal cortex (mPFC) in the regulation of anxiety. Norepinephrine (NE) is a crucial neuromodulator of arousal and vigilance believed to be responsible for many of the symptoms of anxiety disorders. NE is synthesized in the locus coeruleus (LC), which sends major noradrenergic inputs to the mPFC. Given the unique properties of LC-mPFC connections and the heterogeneous subpopulation of prefrontal neurons known to be involved in regulating anxiety-like behaviors, NE likely modulates PFC function in a cell-type and circuit-specific manner. In working memory and stress response, NE follows an inverted-U model, where an overly high or low release of NE is associated with sub-optimal neural functioning. In contrast, based on current literature review of the individual contributions of NE and the PFC in anxiety disorders, we propose a model of NE level- and adrenergic receptor-dependent, circuit-specific NE-PFC modulation of anxiety disorders. Further, the advent of new techniques to measure NE in the PFC with unprecedented spatial and temporal resolution will significantly help us understand how NE modulates PFC function in anxiety disorders.

Hippocampal convergence during anticipatory midbrain activation promotes subsequent memory formation

The hippocampus has been a focus of memory research since H.M's surgery abolished his ability to form new memories, yet its mechanistic role in memory remains debated. Here, we identify a candidate memory mechanism: an anticipatory hippocampal "convergence state", observed while awaiting valuable information, and which predicts subsequent learning. During fMRI, participants viewed trivia questions eliciting high or low curiosity, followed seconds later by its answer. We reasoned that encoding success requires a confluence of conditions, so that hippocampal states more conducive to memory formation should converge in state space. To operationalize convergence of neural states, we quantified the typicality of multivoxel patterns in the medial temporal lobes during anticipation and encoding of trivia answers. We found that the typicality of anticipatory hippocampal patterns increased during high curiosity. Crucially, anticipatory hippocampal pattern typicality increased with dopaminergic midbrain activation and uniquely accounted for the association between midbrain activation and subsequent recall. We propose that hippocampal convergence states may complete a cascade from motivation and midbrain activation to memory enhancement, and may be a general predictor of memory formation.

A review of functional brain differences predicting relapse in substance use disorder: Actionable targets for new methods of noninvasive brain stimulation

Neuroimaging studies have identified a variety of brain regions whose activity predicts substance use (i.e., relapse) in patients with substance use disorder (SUD), suggesting that malfunctioning brain networks may exacerbate relapse. However, this knowledge has not yet led to a marked improvement in treatment outcomes. Noninvasive brain stimulation (NIBS) has shown some potential for treating SUDs, and a new generation of NIBS technologies offers the possibility of selectively altering activity in both superficial and deep brain structures implicated in SUDs. The goal of the current review was to identify deeper brain structures involved in relapse to SUD and give an account of innovative methods of NIBS that might be used to target them. Included studies measured fMRI in currently abstinent SUD patients and tracked treatment outcomes, and fMRI results were organized with the framework of the Addictions Neuroclinical Assessment (ANA). Four brain structures were consistently implicated: the anterior and posterior cingulate cortices, ventral striatum and insula. These four deeper brain structures may be appropriate future targets for the treatment of SUD using these innovative NIBS technologies.

Sensitization-based risk for substance abuse in vulnerable individuals with ADHD: Review and re-examination of evidence

Evidence of sensitization following stimulants administration in humans is just emerging, which prevents reaching more definitive conclusions in favor or against a purported protective role of stimulant treatments for ADHD for the development of substance use disorders. Existing evidence from both animal and human research suggest that stimulants produce neurophysiological changes in the brain reward system, some of which could be persistent. This could be relevant in choosing optimal treatments for young patients with ADHD who have additional clinical risk factors for substance abuse (e.g. conduct disorder (CD) and/or familial addictions). Here we stipulate that, while the majority of youth with ADHD greatly benefit from treatments with stimulants, there might be a subpopulation of individuals whose neurobiological profiles may confer risk for heightened vulnerability to the effects of stimulants on the responsiveness of the brain reward system. We propose that focused human research is needed to elucidate the unknown effects of prolonged stimulant exposure on the neurophysiology of the brain reward system in young patients with ADHD.

Reward During Arm Training Improves Impairment and Activity After Stroke: A Randomized Controlled Trial

BACKGROUND

Learning and learning-related neuroplasticity in motor cortex are potential mechanisms mediating recovery of movement abilities after stroke. These mechanisms depend on dopaminergic projections from midbrain that may encode reward information. Likewise, therapist experience confirms the role of feedback/reward for training efficacy after stroke.

OBJECTIVE

To test the hypothesis that rehabilitative training can be enhanced by adding performance feedback and monetary rewards.

METHODS

This multicentric, assessor-blinded, randomized controlled trial used the ArmeoSenso virtual reality rehabilitation system to train 37 first-ever subacute stroke patients in arm-reaching to moving targets. The rewarded group (n = 19) trained with performance feedback (gameplay) and contingent monetary reward. The control group (n = 18) used the same system without monetary reward and with graphically minimized performance feedback. Primary outcome was the change in the two-dimensional reaching space until the end of the intervention period. Secondary clinical assessments were performed at baseline, after 3 weeks of training (15 1-hour sessions), and at 3 month follow-up. Duration and intensity of the interventions as well as concomitant therapy were comparable between groups.

RESULTS

The two-dimensional reaching space showed an overall improvement but no difference between groups. The rewarded group, however, showed significantly greater improvements from baseline in secondary outcomes assessing arm activity (Box and Block Test at post-training: 6.03±2.95, P = .046 and 3 months: 9.66±3.11, P = .003; Wolf Motor Function Test [Score] at 3 months: .63±.22, P = .007) and arm impairment (Fugl-Meyer Upper Extremity at 3 months: 8.22±3.11, P = .011).

CONCLUSIONS

Although neutral in its primary outcome, the trial signals a potential facilitating effect of reward on training-mediated improvement of arm paresis.

TRIAL REGISTRATION

ClinicalTrials.gov (ID: NCT02257125).

Real-Time Functional MRI in the Treatment of Mental Health Disorders

Multiple mental disorders have been associated with dysregulation of precise brain processes. However, few therapeutic approaches can correct such specific patterns of brain activity. Since the late 1960s and early 1970s, many researchers have hoped that this feat could be achieved by closed-loop brain imaging approaches, such as neurofeedback, that aim to modulate brain activity directly. However, neurofeedback never gained mainstream acceptance in mental health, in part due to methodological considerations. In this review, we argue that, when contemporary methodological guidelines are followed, neurofeedback is one of the few intervention methods in psychology that can be assessed in double-blind placebo-controlled trials. Furthermore, using new advances in machine learning and statistics, it is now possible to target very precise patterns of brain activity for therapeutic purposes. We review the recent literature in functional magnetic resonance imaging neurofeedback and discuss current and future applications to mental health.

Expected final online publication date for the Annual Review of Clinical Psychology, Volume 18 is May 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Ventral Striatal-Hippocampus Coupling During Reward Processing as a Stratification Biomarker for Psychotic Disorders

BACKGROUND

Altered ventral striatal (vST) activation to reward expectancy is a well-established intermediate phenotype for psychiatric disorders, specifically schizophrenia (SZ). Preclinical research suggests that striatal alterations are related to a reduced inhibition by the hippocampal formation, but its role in human transdiagnostic reward-network dysfunctions is not well understood.

METHODS

We performed functional magnetic resonance imaging during reward processing in 728 individuals including healthy control subjects (n = 396), patients (SZ: n = 46; bipolar disorder: n = 45; major depressive disorder: n = 60), and unaffected first-degree relatives (SZ: n = 46; bipolar disorder: n = 50; major depressive disorder: n = 85). We assessed disorder-specific differences in functional vST-hippocampus coupling and transdiagnostic associations with dimensional measures of positive, negative, and cognitive symptoms. We also probed the genetic underpinning using polygenic risk scores for SZ in a subset of healthy participants (n = 295).

RESULTS

Functional vST-hippocampus coupling was 1) reduced in patients with SZ and bipolar disorder (p_FWE < .05, small-volume corrected [SVC]); 2) associated transdiagnostically to dimensional measures of positive (p_FWE = .01, SVC) and cognitive (p_FWE = .02, SVC), but not negative, (p_FWE > .05, SVC) symptoms; and 3) reduced in first-degree relatives of patients with SZ (p_FWE = .017, SVC) and linked to the genetic risk for SZ in healthy participants (p = .035).

CONCLUSIONS

We provide evidence that reduced vST-hippocampus coupling during reward processing is an endophenotype for SZ linked to positive and cognitive symptoms, supporting current preclinical models of the emergence of psychosis. Moreover, our data indicate that vST-hippocampus coupling is familial and linked to polygenic scores for SZ, supporting the use of this measure as an intermediate phenotype for psychotic disorders.

Consumer altruism and risk taking: why do altruistic consumers take more risks?

This research studies an interesting and counter-intuitive relationship between consumer altruism and risk taking. While these two constructs have been studied extensively by extant research, there is scant research which has studied the relationship between them – perhaps due to the expectation that individuals who are chronically more altruistic are very different from those who are more risk taking. This research tests this expectation by formally studying the relationship between altruism and risk taking using a mixture of survey-based and experimental methodology. First four studies test the relationship between altruism and risk-taking using survey-based methodology involving some of the most prominent scales for measuring trait altruism and risk taking. The final study investigates the influence of trait altruism on situational social risk taking. Trait altruism and risk taking are found to be significantly positively correlated with each other, with the relationship being the strongest for social risk taking. Further, the relationship is not significant for ethical risk taking. Additionally, it was found that trait optimism could be the underlying cause for the relationship. Further, it was also found that trait altruism was significantly positively correlated with situational social risk taking. Contributions emerge for the literatures on consumer altruism, risk taking, and optimism by filling an important theoretical gap related to the inter-relationships between these three constructs. Additionally, this research has important implications for practice by informing nonprofit organizations about an erstwhile unknown facet of altruistic people – their tendency to take risks. This opens new avenues for nonprofit practitioners to explore when looking to expand the scope and size of their initiatives, and to innovate on their current offerings in a variety of ways. Additionally, it provides insights that can help for-profit marketers to increase participation in their activities.

Neural Circuitry of Salience and Reward Processing in Psychosis

The processing of salient and rewarding stimuli is integral to engaging our attention, stimulating anticipation for future events, and driving goal-directed behaviors. Widespread impairments in these processes are observed in psychosis, which may be associated with worse functional outcomes or mechanistically linked to the development of symptoms. Here, we summarize the current knowledge of behavioral and functional neuroimaging in salience, prediction error, and reward. Although each is a specific process, they are situated in multiple feedback and feedforward systems integral to decision making and cognition more generally. We argue that the origin of salience and reward processing dysfunctions may be centered in the subcortex during the earliest stages of psychosis, with cortical abnormalities being initially more spared but becoming more prominent in established psychotic illness/schizophrenia. The neural circuits underpinning salience and reward processing may provide targets for delaying or preventing progressive behavioral and neurobiological decline.

Brain opioid segments and striatal patterns of dopamine release induced by naloxone and morphine

Opioid receptors are expressed throughout the brain and play a major role in regulating striatal dopamine (DA) release. Clinical studies have shown that naloxone (NAL, a nonspecific opioid antagonist) in individuals with opioid use disorder and morphine (MRP, a nonspecific opioid agonist) in healthy controls, resulted in DA release in the dorsal and ventral striatum, respectively. It is not known whether the underlying patterns of striatal DA release are associated with the striatal distribution of opioid receptors. We leveraged previously published PET datasets (collected in independent cohorts) to study the brain‐wide distribution of opioid receptors and to compare striatal opioid receptor availability with striatal DA release patterns. We identified three major gray matter segments based on availability maps of DA and opioid receptors: striatum, and primary and secondary opioid segments with high and intermediate opioid receptor availability, respectively. Patterns of DA release induced by NAL and MRP were inversely associated and correlated with kappa (NAL: r(68) = −0.81, MRP: r(68) = 0.54), and mu (NAL: r(68) = −0.62, MRP: r(68) = 0.46) opioid receptor availability. Kappa opioid receptor availability accounted for a unique part of variance in NAL‐ and MRP‐DA release patterns (ΔR² >0.14, p <.0001). In sum, distributions of opioid receptors distinguished major cortical and subcortical regions. Patterns of NAL‐ and MRP‐induced DA release had inverse associations with striatal opioid receptor availability. Our approach provides a pattern‐based characterization of drug‐induced DA targets and is relevant for modeling the role of opioid receptors in modulating striatal DA release.

Substantia nigra iron affects functional connectivity networks modifying working memory performance in younger adults

Brain iron affects working memory (WM) but the impact of iron content in deep grey matter nuclei on WM networks is unknown. We aimed to test whether deep grey matter nuclei iron concentration can affect resting-state functional connectivity (rsFC) within brain networks modifying WM performance. An N-back WM paradigm was applied in a hundred healthy younger adults. The participants then underwent a resting-state functional magnetic resonance imaging (fMRI) for brain network analysis and quantitative susceptibility mapping (QSM) imaging for assessment of deep grey matter nuclei iron concentration. Higher substantia nigra (SN) iron concentration was associated with lower rsFC between SN and brain regions of the temporal/frontal lobe but with better WM performance after controlling for age, gender and education. A follow-up mediation analysis also indicated that functional connectivity may mediate the link between SN iron and WM performance. Our results suggest that high SN iron concentration may affect communication between the SN and temporal/frontal lobe and is associated with strengthened WM performance in younger adults.

Functional dynamics of dopamine synthesis during monetary reward and punishment processing

The assessment of dopamine release with the PET competition model is thoroughly validated but entails disadvantages for the investigation of cognitive processes. We introduce a novel approach incorporating 6-[¹⁸F]FDOPA uptake as index of the dynamic regulation of dopamine synthesis enzymes by neuronal firing. The feasibility of this approach is demonstrated by assessing widely described sex differences in dopamine neurotransmission. Reward processing was behaviorally investigated in 36 healthy participants, of whom 16 completed fPET and fMRI during the monetary incentive delay task. A single 50 min fPET acquisition with 6-[¹⁸F]FDOPA served to quantify task-specific changes in dopamine synthesis. In men monetary gain induced stronger increases in ventral striatum dopamine synthesis than loss. Interestingly, the opposite effect was discovered in women. These changes were further associated with reward (men) and punishment sensitivity (women). As expected, fMRI showed robust task-specific neuronal activation but no sex difference. Our findings provide a neurobiological basis for known behavioral sex differences in reward and punishment processing, with important implications in psychiatric disorders showing sex-specific prevalence, altered reward processing and dopamine signaling. The high temporal resolution and magnitude of task-specific changes make fPET a promising tool to investigate functional neurotransmitter dynamics during cognitive processing and in brain disorders.

Age-Related Changes in the Role of Social Motivation: Implications for Healthy Aging

Prior research has established the importance of social relations and social embeddedness for motivation in healthy aging. Thus, social orientation appears to be essential for understanding healthy aging. This article focuses particularly on age-related changes in goals concerning social orientation, such as increased prioritization of emotional goals, increased prosociality/altruistic motives, generativity, and ego transcendence. We then consider open questions regarding gaps in the links between goals related to social orientation and healthy aging, as well as the implications of theories and research on social goals for leveraging motivation to promote healthy aging. In particular, interventions to promote healthy behavior in late life may be most effective when they match the themes of older adults' strivings to find meaning and purpose in their personal goals.

Multi-scale neural decoding and analysis

Objective.

Complex spatiotemporal neural activity encodes rich information related to behavior and cognition. Conventional research has focused on neural activity acquired using one of many different measurement modalities, each of which provides useful but incomplete assessment of the neural code. Multi-modal techniques can overcome tradeoffs in the spatial and temporal resolution of a single modality to reveal deeper and more comprehensive understanding of system-level neural mechanisms. Uncovering multi-scale dynamics is essential for a mechanistic understanding of brain function and for harnessing neuroscientific insights to develop more effective clinical treatment.

Approach.

We discuss conventional methodologies used for characterizing neural activity at different scales and review contemporary examples of how these approaches have been combined. Then we present our case for integrating activity across multiple scales to benefit from the combined strengths of each approach and elucidate a more holistic understanding of neural processes.

Main results.

We examine various combinations of neural activity at different scales and analytical techniques that can be used to integrate or illuminate information across scales, as well the technologies that enable such exciting studies. We conclude with challenges facing future multi-scale studies, and a discussion of the power and potential of these approaches.

Significance.

This roadmap will lead the readers toward a broad range of multi-scale neural decoding techniques and their benefits over single-modality analyses. This Review article highlights the importance of multi-scale analyses for systematically interrogating complex spatiotemporal mechanisms underlying cognition and behavior.

Brain activations associated with anticipation and delivery of monetary reward: A systematic review and meta-analysis of fMRI studies

BACKGROUND

While multiple studies have examined the brain functional correlates of reward, meta-analyses have either focused on studies using the monetary incentive delay (MID) task, or have adopted a broad strategy, combining data from studies using both monetary and non-monetary reward, as probed using a wide range of tasks.

OBJECTIVE

To meta-analyze fMRI studies that used monetary reward and in which there was a definable cue-reward contingency. Studies were limited to those using monetary reward in order to avoid potential heterogeneity from use of other rewards, especially social rewards. Studies using gambling or delay discounting tasks were excluded on the grounds that reward anticipation is not easily quantifiable.

STUDY ELIGIBILITY

English-language fMRI studies (i) that reported fMRI findings on healthy adults; (ii) that used monetary reward; and (iii) in which a cue that was predictive of reward was compared to a no win (or lesser win) condition. Only voxel-based studies were included; those where brain coverage was incomplete were excluded.

DATA SOURCES

Ovid, Medline and PsycInfo, from 2000 to 2020, plus checking of review articles and meta-analyses.

DATA SYNTHESIS

Data were pooled using Seed-based d Mapping with Permutation of Subject Images (SDM-PSI). Heterogeneity among studies was examined using the I2 statistic. Publication bias was examined using funnel plots and statistical examination of asymmetries. Moderator variables including whether the task was pre-learnt, sex distribution, amount of money won and width of smoothing kernel were examined.

RESULTS

Pooled data from 45 studies of reward anticipation revealed activations in the ventral striatum, the middle cingulate cortex/supplementary motor area and the insula. Pooled data from 28 studies of reward delivery again revealed ventral striatal activation, plus cortical activations in the anterior and posterior cingulate cortex. There was relatively little evidence of publication bias. Among moderating variables, only whether the task was pre-learnt exerted an influence.

CONCLUSIONS

According to this meta-analysis monetary reward anticipation and delivery both activate the ventral but not the dorsal striatum, and are associated with different patterns of cortical activation.

A network of phosphatidylinositol (4,5)-bisphosphate (PIP2) binding sites on the dopamine transporter regulates amphetamine behavior in Drosophila Melanogaster

Reward modulates the saliency of a specific drug exposure and is essential for the transition to addiction. Numerous human PET-fMRI studies establish a link between midbrain dopamine (DA) release, DA transporter (DAT) availability, and reward responses. However, how and whether DAT function and regulation directly participate in reward processes remains elusive. Here, we developed a novel experimental paradigm in Drosophila melanogaster to study the mechanisms underlying the psychomotor and rewarding properties of amphetamine (AMPH). AMPH principally mediates its pharmacological and behavioral effects by increasing DA availability through the reversal of DAT function (DA efflux). We have previously shown that the phospholipid, phosphatidylinositol (4, 5)-bisphosphate (PIP₂), directly interacts with the DAT N-terminus to support DA efflux in response to AMPH. In this study, we demonstrate that the interaction of PIP₂ with the DAT N-terminus is critical for AMPH-induced DAT phosphorylation, a process required for DA efflux. We showed that PIP₂ also interacts with intracellular loop 4 at R443. Further, we identified that R443 electrostatically regulates DA efflux as part of a coordinated interaction with the phosphorylated N-terminus. In Drosophila, we determined that a neutralizing substitution at R443 inhibited the psychomotor actions of AMPH. We associated this inhibition with a decrease in AMPH-induced DA efflux in isolated fly brains. Notably, we showed that the electrostatic interactions of R443 specifically regulate the rewarding properties of AMPH without affecting AMPH aversion. We present the first evidence linking PIP₂, DAT, DA efflux, and phosphorylation processes with AMPH reward.

Altered neural activity in the reward-related circuit and executive control network associated with amelioration of anhedonia in major depressive disorder by electroconvulsive therapy

Anhedonia is a core characteristic of depression, the amelioration of which accounts for depressive symptom improvement. Electroconvulsive therapy (ECT) has been shown remarkable antidepressive effect, however, less is known about the effect of ECT on anhedonia and its underlying neural mechanism. Herein, we investigated local and global intrinsic brain functional alterations during the resting state in 46 patients with pre- and post-ECT major depressive disorder using the amplitude of low-frequency fluctuations (ALFF) and degree centrality (DC) approach. Functional connectivity (FC) was also calculated between nodes with significant local and global intrinsic brain functional alterations. The severity of anhedonia and depression was assessed with the Temporal Experience of Pleasure Scale and Hamilton Depression Rating Scale, respectively. The relationship between the change in anhedonia and depressive symptoms and brain functional alterations was determined. Increased ALFF and DC were observed in the bilateral dorsal medial prefrontal cortex (dmPFC), right dorsal lateral prefrontal cortex (dlPFC), left orbitofrontal cortex, and right orbitofrontal cortex (ROFC) after ECT. Correlational analysis between the change in anhedonia and ALFF had positive results in the dmPFC. Similarly, there was a positive correlation between the change in anhedonia and change in DC in the dmPFC, right dlPFC, ROFC, and middle frontal gyrus. Furthermore, there was a significant relationship between the change in anhedonia and altered dmPFC-dlPFC FC. These results revealed that amelioration of anhedonia may be associated with intrinsic neural activity alteration in the reward-related circuit and executive control network following ECT.

Frontostriatal Projections Regulate Innate Avoidance Behavior

The dorsomedial prefrontal cortex (dmPFC) has been linked to avoidance and decision-making under conflict, key neural computations altered in anxiety disorders. However, the heterogeneity of prefrontal projections has obscured identification of specific top-down projections involved. While the dmPFC-amygdala circuit has long been implicated in controlling reflexive fear responses, recent work suggests that dmPFC-dorsomedial striatum (DMS) projections may be more important for regulating avoidance. Using fiber photometry recordings in both male and female mice during the elevated zero maze task, we show heightened neural activity in frontostriatal but not frontoamygdalar projection neurons during exploration of the anxiogenic open arms. Additionally, using optogenetics, we demonstrate that this frontostriatal projection preferentially excites postsynaptic D1 receptor-expressing neurons in the DMS and causally controls innate avoidance behavior. These results support a model for prefrontal control of defensive behavior in which the dmPFC-amygdala projection controls reflexive fear behavior and the dmPFC-striatum projection controls anxious avoidance behavior.SIGNIFICANCE STATEMENT The medial prefrontal cortex has been extensively linked to several behavioral symptom domains related to anxiety disorders, with much of the work centered around reflexive fear responses. Comparatively little is known at the mechanistic level about anxious avoidance behavior, a core feature across anxiety disorders. Recent work has suggested that the striatum may be an important hub for regulating avoidance behaviors. Our work uses optical circuit dissection techniques to identify a specific corticostriatal circuit involved in encoding and controlling avoidance behavior. Identifying neural circuits for avoidance will enable the development of more targeted symptom-specific treatments for anxiety disorders.

Transdiagnostic neuroimaging of reward system phenotypes in ADHD and comorbid disorders

ADHD is a disorder characterized by changes in the reward system and which is highly comorbid with other mental disorders, suggesting common neurobiological pathways. Transdiagnostic neuroimaging findings could help to understand whether a dysregulated reward pathway might be the actual link between ADHD and its comorbidities. We here synthesize ADHD neuroimaging findings on the reward system with findings in obesity, depression, and substance use disorder including their comorbid appearance regarding neuroanatomical features (structural MRI) and activation patterns (resting-state and functional MRI). We focus on findings from monetary-incentive-delay (MID) and delay-discounting (DD) tasks and then review data on striatal connectivity and volumetry. Next, for better understanding of comorbidity in adult ADHD, we discuss these neuroimaging features in ADHD, obesity, depression and substance use disorder and ask whether ADHD heterogeneity and comorbidity are reflected by a common dysregulation in the reward system. Finally, we highlight conceptual issues related to heterogeneous paradigms, different phenotyping, longitudinal prediction and highlight some promising future directions for using striatal reward functioning as a clinical biomarker.

Neural reward circuit dysfunction as a risk factor for bipolar spectrum disorders and substance use disorders: A review and integration

Bipolar spectrum disorders (BSDs) and substance use disorders (SUDs) are associated with neural reward dysfunction. However, it is unclear what pattern of neural reward function underlies pre-existing vulnerability to BSDs and SUDs, or whether neural reward function explains their high co-occurrence. The current paper provides an overview of the separate literatures on neural reward sensitivity in BSDs and SUDs. We provide a systematic review of 35 studies relevant to identifying neural reward function vulnerability to BSDs and SUDs. These studies include those examining neural reward processing on a monetary reward task with prospective designs predicting initial onset of SUDs, familial risk studies that examine unaffected offspring or first-degree relatives of family members with BSDs or SUDs, and studies that examine individuals with BSDs or SUDs who are not currently in an episode of the disorder. Findings from the review highlight that aberrant responding and connectivity across neural regions associated with reward and cognitive control confers risk for the development of BSDs and SUDs. Discussion focuses on limitations of the extant literature. We conclude with an integration and theoretical model for understanding how aberrant neural reward responding may constitute a vulnerability to the development of both BSDs and SUDs.

Neural underpinnings of valence-action interactions triggered by cues and targets in a rewarded approach/avoidance task

Incentive-valence signals have a large impact on our actions in everyday life. While it is intuitive (and most often beneficial) to approach positive and avoid negative stimuli, these prepotent response tendencies can also be maladaptive, as exemplified by clinical conditions such as overeating or pathological gambling. We have recently shown that targets associated with monetary incentives can trigger such valence-action biases (target condition), and that these are absent when valence and action information are provided by advance cues (cue condition). Here, we explored the neural correlates underlying the absence of the behavioral bias in this condition using fMRI. Specifically, we tested in how far valence and action information are integrated at all in the cue condition (where no behavioral biases are observed), assessing activity at the moment of the cue (mainly preparation) and the target (mainly implementation). The cue-locked data was dominated by main effects of valence with increased activity for incentive versus no-incentive cues in a network including anterior insula, premotor cortex, (mostly ventral) striatum (voxel-wise analysis), and across five predefined regions of interest (ROI analysis). Only one region, the anterior cingulate cortex, featured a valence-action interaction, with increased activity for win-approach compared to no-incentive-approach cues. The target-locked data revealed a different interaction pattern with increased activity in loss-approach as compared to win-approach targets in the cerebellum (voxel-wise) and across all ROIs. For comparison, the uncued target condition (target-locked data only) featured valence and action main effects (incentive > no-incentive targets; approach > avoid targets), but no interactions. The results resonate with the common observations that performance benefits after incentive-valence cues are promoted by increased preparatory control. Moreover, the data provide support for the idea that valence and action information are integrated according to an evolutionary benefit (cue-locked), requiring additional neural resources to implement non-intuitive valence-action mappings (target-locked).

Neurochemistry of Visual Attention

Visual attention is the cognitive process that mediates the selection of important information from the environment. This selection is usually controlled by bottom-up and top-down attentional biasing. Since for most humans vision is the dominant sense, visual attention is critically important for higher-order cognitive functions and related deficits are a core symptom of many neuropsychiatric and neurological disorders. Here, we summarize the importance and relative contributions of different neuromodulators and neurotransmitters to the neural mechanisms of top-down and bottom-up attentional control. We will not only review the roles of widely accepted neuromodulators, such as acetylcholine, dopamine and noradrenaline, but also the contributions of other modulatory substances. In doing so, we hope to shed some light on the current understanding of the role of neurochemistry in shaping neuron properties contributing to the allocation of attention in the visual field.

Sex differences in dopamine integrity and brain structure among healthy older adults: Relationships to episodic memory

Normal brain aging is a multidimensional process that includes deterioration in various brain structures and functions, with large heterogeneity in patterns and rates of decline. Sex differences have been reported for various cognitive and brain parameters, but little is known in relation to neuromodulatory aspects of brain aging. We examined sex differences in dopamine D2-receptor (D2DR) availability in relation to episodic memory, but also, grey-matter volumes, white-matter lesions, and cerebral perfusion in healthy older adults (n = 181, age: 64-68 years) from the Cognition, Brain, and Aging study. Women had higher D2DR availability in midbrain and left caudate and putamen, as well as superior episodic memory performance. Controlling for left caudate D2DR availability attenuated sex differences in memory performance. In men, lower left caudate D2DR levels were associated with lower cortical perfusion and higher burden of white-matter lesions, as well as with episodic memory performance. However, sex was not a significant moderator of the reported links to D2DR levels. Our findings suggest that sex differences in multiple associations among DA receptor availability, vascular factors, and structural connectivity contribute to sex differences in episodic memory. Future longitudinal studies need to corroborate these patterns by lead-lag associations. This manuscript is part of the Special Issue entitled 'Cognitive Neuroscience of Healthy and Pathological Aging' edited by Drs. M. N. Rajah, S. Belleville, and R. Cabeza. This article is part of the Virtual Special Issue titled COGNITIVE NEUROSCIENCE OF HEALTHY AND PATHOLOGICAL AGING. The full issue can be found on ScienceDirect at https://www.sciencedirect.com/journal/neurobiology-of-aging/special-issue/105379XPWJP.

Gaze towards my choice: Noneconomic social interaction changes interpersonal trust only with positive feedback

Trust is a crucial foundation of human society, dynamically changing along with interpersonal interactions. Previous research suggested that both gaze behaviors and affective states might influence our trust evaluation. Here, we created an uncertain decision-making environment to investigate how these two aspects change interpersonal trust during social interactions. Specifically, participants made a forced choice between two price-matched goods to determine which one was more expensive. After participants made a choice, the face in the center of the screen would gaze towards or away from the participants' choice, and then participants would receive timely feedback informing whether their choice was correct or not. In Experiment 1 (N = 34), we found people increased their trust ratings for gaze-followers but reduced them for gaze-unfollowers when they received positive feedback, but stayed with their initial judgments when receiving negative feedback. Experiment 2 (N = 20) and Experiment S1 (N = 20) further revealed the same change patterns on participants' trust investments in different conditions. These results suggest that gaze-following behavior can change people's trust evaluations as well as trust behaviors, while affective states induced by different feedback modulate this process in a flexible manner.

A neuroimaging investigation into the role of peripheral metabolic biomarkers in the anticipation of reward in alcohol use

BACKGROUND

The relationship between alcohol use and metabolism has focused on the effects of alcohol use on metabolic factors. Metabolic factors, such as triglycerides, cholesterol, and glucose, have been shown to be associated with increased risk for heavy alcohol consumption and alcohol use disorder (AUD). It's been suggested that changes in metabolic factors may play a role in reward seeking behaviors and pathways. Studies on feeding behavior and obesity revealed the role of triglycerides in neural response to food cues in neurocircuitry regulating reward and feeding behaviors. This study aimed to explore the relationship of peripheral metabolism, alcohol use, and reward processing in individuals that use alcohol.

METHODS

Ninety participants from a previously collected dataset were included in the analysis. Participants were treatment seeking, detoxified individuals with AUD and healthy individuals without AUD, with the following metabolic biomarkers: triglyceride, glucose, high- and low-density cholesterol, and HbA1c levels. Participants completed a neuroimaging version of the Monetary Incentive Delay task (MID).

RESULTS

Correlations on peripheral metabolic biomarkers, alcohol use, and neural activity during reward anticipation and outcome during the MID task were not significant. Mediation models revealed triglycerides and high-density cholesterol had significant effects on left anterior insula during anticipation of potential monetary loss and this effect was not mediated by alcohol use.

CONCLUSION

Limbic recruitment by anticipation of monetary rewards revealed an independent relationship with peripheral metabolism and was not affected by individual differences in alcohol use, despite the effects of alcohol use on metabolic markers and reward processing neural circuitry.

The effect of risperidone on reward-related brain activity is robust to drug-induced vascular changes

Dopamine (DA) mediated brain activity is intimately linked to reward‐driven cerebral responses, while aberrant reward processing has been implicated in several psychiatric disorders. fMRI has been a valuable tool in understanding the mechanism by which DA modulators alter reward‐driven responses and how they may exert their therapeutic effect. However, the potential effects of a pharmacological compound on aspects of neurovascular coupling may cloud the interpretability of the BOLD contrast. Here, we assess the effects of risperidone on reward driven BOLD signals produced by reward anticipation and outcome, while attempting to control for potential drug effects on regional cerebral blood flow (CBF) and cerebrovascular reactivity (CVR). Healthy male volunteers (n = 21) each received a single oral dose of either 0.5 mg, 2 mg of risperidone or placebo in a double‐blind, placebo‐controlled, randomised, three‐period cross‐over study design. Participants underwent fMRI scanning while performing the widely used Monetary Incentive Delay (MID) task to assess drug impact on reward function. Measures of CBF (Arterial Spin Labelling) and breath‐hold challenge induced BOLD signal changes (as a proxy for CVR) were also acquired and included as covariates. Risperidone produced divergent, dose‐dependent effects on separate phases of reward processing, even after controlling for potential nonneuronal influences on the BOLD signal. These data suggest the D2 antagonist risperidone has a wide‐ranging influence on DA‐mediated reward function independent of nonneuronal factors. We also illustrate that assessment of potential vascular confounds on the BOLD signal may be advantageous when investigating CNS drug action and advocate for the inclusion of these additional measures into future study designs.

The ups and downs of relating nondrug reward activation to substance use risk in adolescents

Purpose of review

A wealth of epidemiological and cohort research, together with a healthy dose of anecdote, has characterized late-adolescence and emerging adulthood as a time of increased substance use and other risky behaviors. This review will address whether differences between adolescents or between adolescents and other age groups in dopaminergic mesolimbic recruitment by (non-drug) rewards inferred from functional magnetic resonance imaging (fMRI) could partially explain morbidity and mortality from risky-behavior-related causes in adolescents.

Recent findings

Recent findings do not suggest a definitive directionality with regard to whether increased vs decreased mesolimbic responsiveness to nondrug rewards correlates with real-world risk-taking. Inconsistent relationships between reward-activation and real-world risky behavior in these reports reflect in part methodological differences as well as conceptual differences between populations in terms of whether tepid mesolimbic recruitment by rewards is a marker of psychiatric health.

Summary

There are several potential reasons why the directionality of relationships between reward-elicited brain activation and substance use risk (specifically) might differ. These factors include differences between adolescents in histories/exposure of substance use, motivation for substance use, the component of the instrumental behavior being studied, and the cognitive demands of the incentive tasks. Systematic manipulation of these discrepant study factors might offer a way forward to clarify how motivational neurocircuit function relates to addiction risk in adolescents.