Neural Activities Underlying the Feedback Express Salience Prediction Errors for Appetitive and Aversive Stimuli

Decreased reward circuit connectivity during reward anticipation in major depression

An important symptom of major depressive disorder (MDD) is the inability to experience pleasure, possibly due to a dysfunction of the reward system. Despite promising insights regarding impaired reward-related processing in MDD, circuit-level abnormalities remain largely unexplored. Furthermore, whereas studies contrasting experimental conditions from incentive tasks have revealed important information about reward processing, temporal difference modeling of reward-related prediction error (PE) signals might give a more accurate representation of the reward system. We used a monetary incentive delay task during functional MRI scanning to explore PE-related striatal and ventral tegmental area (VTA) activation in response to anticipation and delivery of monetary rewards in 24 individuals with MDD versus 24 healthy controls (HCs). Furthermore, we investigated group differences in temporal difference related connectivity with a generalized psychophysiological interaction (gPPI) analysis with the VTA, ventral striatum (VS) and dorsal striatum (DS) as seeds during reward versus neutral, both in anticipation and delivery. Relative to HCs, MDD patients displayed a trend-level (p = 0.052) decrease in temporal difference-related activation in the VS during reward anticipation and delivery combined. Moreover, gPPI analyses revealed that during reward anticipation, MDD patients exhibited decreased functional connectivity between the VS and anterior cingulate cortex / medial prefrontal cortex, anterior cingulate gyrus, angular/middle orbital gyrus, left insula, superior/middle frontal gyrus (SFG/MFG) and precuneus/superior occipital gyrus/cerebellum compared to HC. Moreover, MDD patients showed decreased functional connectivity between the VTA and left insula compared to HC during reward anticipation. Exploratory analysis separating medication free patients from patients using antidepressant revealed that these decreased functional connectivity patterns were mainly apparent in the MDD group that used antidepressants. These results suggest that MDD is characterized by alterations in reward circuit connectivity rather than isolated activation impairments. These findings represent an important extension of the existing literature since improved understanding of neural pathways underlying depression-related reward dysfunctions, may help currently unmet diagnostic and therapeutic efforts.

Neurobiological mechanisms of social cognition treatment in high-functioning adults with autism spectrum disorder

BACKGROUND

The promise of precision medicine for autism spectrum disorder (ASD) hinges on developing neuroscience-informed individualized interventions. Taking an important step in this direction, we investigated neuroplasticity in response to an ecologically-valid, computer-based social-cognitive training (SCOTT).

METHODS

In an active control group design, 48 adults with ASD were randomly assigned to a 3-month SCOTT or non-social computer training. Participants completed behavioral tasks, a functional and structural magnetic resonance imaging session before and after the training period.

RESULTS

The SCOTT group showed social-cognitive improvements on close and distant generalization tasks. The improvements scaled with reductions in functional activity and increases in cortical thickness in prefrontal regions.

CONCLUSION

In sum, we provide evidence for the sensitivity of neuroscientific methods to reflect training-induced social-cognitive improvements in adults with ASD. These results encourage the use of neuroimaging data to describe and quantify treatment-related changes more broadly.

The impact of elevated body mass on brain responses during appetitive prediction error in postpartum women

Repeated exposure to highly palatable foods and elevated weight promote: 1) insensitivity to punishment in striatal regions and, 2) increased willingness to work for food. We hypothesized that BMI would be positively associated with negative prediction error BOLD response in the occipital cortex. Additionally, we postulated that food reinforcement value would be negatively associated with negative prediction error BOLD response in the orbital frontal cortex and amygdala. Postpartum women (n = 47; BMI = 25.5 ± 5.1) were 'trained' to associate specific cues paired to either a highly palatable milkshake or a sub-palatable milkshake. We then violated these cue-taste pairings in 40% of the trials by showing a palatable cue followed by the sub-palatable taste (negative prediction error). Contrary to our hypotheses, during negative prediction error (mismatched cue-taste) versus matched palatable cue-taste, women showed increased BOLD response in the central operculum (pFWE = 0.002; k = 1680; MNI: -57, -7,14) and postcentral gyrus (pFWE = 0.006, k = 1219; MNI: 62, -8,18). When comparing the matched sub-palatable cue-taste to the negative prediction error trials, BOLD response increased in the postcentral gyrus (r = -0.60, pFWE = 0.008), putamen (r = -0.55, pFWE = 0.02), and insula (r = -0.50, pFWE = 0.01). Similarly, viewing the palatable cue vs sub-palatable cue was related to BOLD response in the putamen (pFWE = 0.025, k = 53; MNI: -20, 6, -8) and the insula (pFWE = 0.04, k = 19, MNI:38, -12, -6). Neither BMI at 6-month postpartum nor food reinforcement value was related to BOLD response. The insula and putamen appear to encode for visual food cue processing, and the gustatory and somatosensory cortices appear to encode negative prediction errors. Differential response in the somatosensory cortex to the matched cue-taste pairs to negative prediction error may indicate that a palatable cue may dull aversive qualities in the stimulus.

Impaired reward prediction error encoding and striatal-midbrain connectivity in depression

Anhedonia (hyposensitivity to rewards) and negative bias (hypersensitivity to punishments) are core features of major depressive disorder (MDD), which could stem from abnormal reinforcement learning. Emerging evidence highlights blunted reward learning and reward prediction error (RPE) signaling in the striatum in MDD, although inconsistencies exist. Preclinical studies have clarified that ventral tegmental area (VTA) neurons encode RPE and habenular neurons encode punishment prediction error (PPE), which are then transmitted to the striatum and cortex to guide goal-directed behavior. However, few studies have probed striatal activation, and functional connectivity between VTA-striatum and VTA-habenula during reward and punishment learning respectively, in unmedicated MDD. To fill this gap, we acquired fMRI data from 25 unmedicated MDD and 26 healthy individuals during a monetary instrumental learning task and utilized a computational modeling approach to characterize underlying neural correlates of RPE and PPE. Relative to controls, MDD individuals showed impaired reward learning, blunted RPE signal in the striatum and overall reduced VTA-striatal connectivity to feedback. Critically, striatal RPE signal was increasingly blunted with more major depressive episodes (MDEs). No group differences emerged in PPE signals in the habenula and VTA or in connectivity between these regions. However, PPE signals in the habenula correlated positively with number of MDEs. These results highlight impaired reward learning, disrupted RPE signaling in the striatum (particularly among individuals with more lifetime MDEs) as well as reduced VTA-striatal connectivity in MDD. Collectively, these findings highlight reward-related learning deficits in MDD and their underlying pathophysiology.

Development, Initial Testing and Challenges of an Ecologically Valid Reward Prediction Error FMRI Task for Alcoholism

Aims

To advance translational studies of the role of reward prediction error (PE) in alcohol use disorder, the present study sought to develop and conduct an initial test of an alcohol-specific PE task paradigm using functional magnetic resonance imaging in humans.

Methods

Alcohol dependent or social drinkers received small tastes of their preferred alcohol beverage or control beverage, with preceding visual cues indicating whether alcohol (or water) would be delivered. To assess both positive and negative PE signals, expectancies were systematically violated in both positive (i.e. expecting water and receiving alcohol) and negative (i.e. expecting alcohol and receiving water) directions. Exploratory trial-by-trial analyses were conducted to explore temporal fluctuations of activation within a priori-defined regions of interest that have been implicated in cue reactivity and PE processing.

Results

Across the entire sample of participants, positive PE-related brain activation was found in a large cluster comprised of frontal lobe regions, as well as insular cortex, and motor/sensory cortices. Compared to social drinking subjects, alcohol dependent subjects had greater positive PE-related brain activity in left superior parietal lobule, lateral occipital cortex and postcentral gyrus. Exploratory trial-by-trial analyses indicated differences in activation specific to type of taste, mostly at earlier trials.

Conclusions

This task-development oriented pilot study found that PE signaling may not be detected in expected brain regions when image analyses average across all PE trials of the task. Rather, a trial-by-trial analysis approach may help detect sparse, temporally distinct PE signaling in expected reward processing regions.

Short Summary

This fMRI study of reward prediction error found greater positive prediction error-related activity (i.e. expecting water taste, receiving alcohol taste) in alcohol dependent individuals relative to social drinkers in parietal and occipital cortices. Trial-by-trial analyses may be able to better detect sparse prediction error signaling in expected reward processing regions.

A Computational Account of Optimizing Social Predictions Reveals That Adolescents Are Conservative Learners in Social Contexts

As adolescents transition to the complex world of adults, optimizing predictions about others' preferences becomes vital for successful social interactions. Mounting evidence suggests that these social learning processes are affected by ongoing brain development across adolescence. A mechanistic understanding of how adolescents optimize social predictions and how these learning strategies are implemented in the brain is lacking. To fill this gap, we combined computational modeling with functional neuroimaging. In a novel social learning task, male and female human adolescents and adults predicted the preferences of peers and could update their predictions based on trial-by-trial feedback about the peers' actual preferences. Participants also rated their own preferences for the task items and similar additional items. To describe how participants optimize their inferences over time, we pitted simple reinforcement learning models against more specific "combination" models, which describe inferences based on a combination of reinforcement learning from past feedback and participants' own preferences. Formal model comparison revealed that, of the tested models, combination models best described how adults and adolescents update predictions of others. Parameter estimates of the best-fitting model differed between age groups, with adolescents showing more conservative updating. This developmental difference was accompanied by a shift in encoding predictions and the errors thereof within the medial prefrontal and fusiform cortices. In the adolescent group, encoding of own preferences and prediction errors scaled with parent-reported social traits, which provides additional external validity for our learning task and the winning computational model. Our findings thus help to specify adolescent-specific social learning processes.SIGNIFICANCE STATEMENT Adolescence is a unique developmental period of heightened awareness about other people. Here we probe the suitability of various computational models to describe how adolescents update their predictions of others' preferences. Within the tested model space, predictions of adults and adolescents are best described by the same learning model, but adolescents show more conservative updating. Compared with adults, brain activity of adolescents is modulated less by predictions themselves and more by prediction errors per se, and this relationship scales with adolescents' social traits. Our findings help specify social learning across adolescence and generate hypotheses about social dysfunctions in psychiatric populations.

Avoidant Responses to Interpersonal Provocation Are Associated with Increased Amygdala and Decreased Mentalizing Network Activity

When intentionally pushed or insulted, one can either flee from the provoker or retaliate. The implementation of such fight-or-flight decisions is a central aspect in the genesis and evolution of aggression episodes, yet it is usually investigated only indirectly or in nonsocial situations. In the present fMRI study, we aimed to distinguish brain regions associated with aggressive and avoidant responses to interpersonal provocation in humans. Participants (thirty-six healthy young women) could either avoid or face a highly (HP) and a lowly (LP) provoking opponent in a competitive reaction time task: the fight-or-escape (FOE) paradigm. Subjects avoided the HP more often, but retaliated when facing her. Moreover, they chose to fight the HP more quickly, and showed increased heart rate (HR) right before confronting her. Orbitofrontal cortex (OFC) and sensorimotor cortex were more active when participants decided to fight, whereas the mentalizing network was engaged when deciding to avoid. Importantly, avoiding the HP relative to the LP was associated with both higher activation in the right basolateral amygdala and lower relative activity in several mentalizing regions [e.g., medial and inferior frontal gyrus (IFG), temporal-parietal junction (TPJ)]. These results suggest that avoidant responses to provocation might result from heightened threat anticipation and are associated with reduced perspective taking. Furthermore, our study helps to reconcile conflicting findings on the role of the mentalizing network, the amygdala, and the OFC in aggression.