Opposing roles for amygdala and vmPFC in the return of appetitive conditioned responses in humans

Bad habits-good goals? Meta-analysis and translation of the habit construct to alcoholism

Excessive alcohol consumption remains a global public health crisis, with millions suffering from alcohol use disorder (AUD, or simply "alcoholism"), leading to significantly reduced life expectancy. This review examines the interplay between habitual and goal-directed behaviors and the associated neurobiological changes induced by chronic alcohol exposure. Contrary to a strict habit-goal dichotomy, our meta-analysis of the published animal experiments combined with a review of human studies reveals a nuanced transition between these behavioral control systems, emphasizing the need for refined terminology to capture the probabilistic nature of decision biases in individuals with a history of chronic alcohol exposure. Furthermore, we distinguish habitual responding from compulsivity, viewing them as separate entities with diverse roles throughout the stages of the addiction cycle. By addressing species-specific differences and translational challenges in habit research, we provide insights to enhance future investigations and inform strategies for combatting AUD.

Elevated Amygdala Responses During De Novo Pavlovian Conditioning in Alcohol Use Disorder Are Associated With Pavlovian-to-Instrumental Transfer and Relapse Latency

Background

Contemporary learning theories of drug addiction ascribe a key role to Pavlovian learning mechanisms in the development, maintenance, and relapse of addiction. In fact, cue-reactivity research has demonstrated the power of alcohol-associated cues to activate the brain's reward system, which has been linked to craving and subsequent relapse. However, whether de novo Pavlovian conditioning is altered in alcohol use disorder (AUD) has rarely been investigated.

Methods

To characterize de novo Pavlovian conditioning in AUD, 62 detoxified patients with AUD and 63 matched healthy control participants completed a Pavlovian learning task as part of a Pavlovian-to-instrumental transfer paradigm during a functional magnetic resonance imaging session. Patients were followed up for 12 months to assess drinking behavior and relapse status.

Results

While patients and healthy controls did not differ in their ability to explicitly acquire the contingencies between conditioned and unconditioned stimuli, patients with AUD displayed significantly stronger amygdala responses toward Pavlovian cues, an effect primarily driven by stronger blood oxygen level-dependent differentiation during learning from reward compared with punishment. Moreover, in patients compared with controls, differential amygdala responses during conditioning were positively related to the ability of Pavlovian stimuli to influence ongoing instrumental choice behavior measured during a subsequent Pavlovian-to-instrumental transfer test. Finally, patients who relapsed within the 12-month follow-up period showed an inverse association between amygdala activity during conditioning and relapse latency.

Conclusions

We provide evidence of altered neural correlates of de novo Pavlovian conditioning in patients with AUD, especially for appetitive stimuli. Thus, heightened processing of Pavlovian cues might constitute a behaviorally relevant mechanism in alcohol addiction.

Brain functional and structural magnetic resonance imaging of obesity and weight loss interventions

Obesity has tripled over the past 40 years to become a major public health issue, as it is linked with increased mortality and elevated risk for various physical and neuropsychiatric illnesses. Accumulating evidence from neuroimaging studies suggests that obesity negatively affects brain function and structure, especially within fronto-mesolimbic circuitry. Obese individuals show abnormal neural responses to food cues, taste and smell, resting-state activity and functional connectivity, and cognitive tasks including decision-making, inhibitory-control, learning/memory, and attention. In addition, obesity is associated with altered cortical morphometry, a lowered gray/white matter volume, and impaired white matter integrity. Various interventions and treatments including bariatric surgery, the most effective treatment for obesity in clinical practice, as well as dietary, exercise, pharmacological, and neuromodulation interventions such as transcranial direct current stimulation, transcranial magnetic stimulation and neurofeedback have been employed and achieved promising outcomes. These interventions and treatments appear to normalize hyper- and hypoactivations of brain regions involved with reward processing, food-intake control, and cognitive function, and also promote recovery of brain structural abnormalities. This paper provides a comprehensive literature review of the recent neuroimaging advances on the underlying neural mechanisms of both obesity and interventions, in the hope of guiding development of novel and effective treatments.

The relationship between sleep and appetitive conditioning: A systematic review and meta-analysis

This systematic review and meta-analysis (PROSPERO registration animal/human studies: CRD42021234793/CRD42021234790) examined the relationship between sleep and appetitive conditioning. Inclusion criteria included: a) appetitive conditioning paradigm; b) measure of conditioning; c) sleep measurement and/or sleep loss; d) human and/etor non-human animal samples; and e) written in English. Searches of seven databases returned 3777 publications. The final sample consisted of 42 studies using primarily animal samples and involving food- and drug-related conditioning tasks. We found sleep loss disrupted appetitive conditioning of food rewards (p < 0.001) but potentiated appetitive conditioning of drug rewards (p < 0.001). Furthermore, sleep loss negatively impacted extinction learning irrespective of the reward type. Post-learning sleep was associated with increases in REM sleep (p = 0.02). Findings suggest sleep loss potentiates the impact of psychoactive substances in a manner likely to produce an increased risk of problematic substance use. In obese/overweight populations, sleep loss may be associated with deficits in the conditioning and extinction of reward-related behaviours. Further research should assess the relationship between sleep and appetitive conditioning in humans.

Mesial Prefrontal Cortex and Alcohol Misuse: Dissociating Cross-sectional and Longitudinal Relationships in UK Biobank

BACKGROUND

Alcohol misuse is a major global public health issue. The disorder is characterized by aberrant neural networks interacting with environment and genetics. Dissecting the neural substrates and functional networks that relate to longitudinal changes in alcohol use from those that relate to alcohol misuse cross-sectionally is important to elucidate therapeutic approaches.

METHODS

To assess how neuroimaging data, including T1, resting-state functional magnetic resonance imaging, and diffusion-weighted imaging, relate to alcohol misuse cross-sectionally and longitudinally in the UK Biobank, this study analyzed range of alcohol misuse in a population-based normative sample of 24,784 participants, ages 45 to 81 years old, in a cross-sectional analysis and a sample of 3070 participants in a longitudinal analysis 2 years later.

RESULTS

Cross-sectional analysis showed that alcohol use is associated with a reduction in dorsal anterior cingulate cortex and dorsomedial prefrontal cortex gray matter concentration and functional resting-state connectivity (nodal degree: t_24,422 = -12.99, p < 1 × 10^-17). Reduced dorsal anterior cingulate cortex/dorsomedial prefrontal cortex functional connections to the ventrolateral prefrontal cortex, amygdala, and striatum relate to greater alcohol use. In a longitudinal analysis, higher resting-state nodal degree (t₃₀₃₆ = -3.27, p = .0011) and T1 gray matter concentration in the ventromedial prefrontal cortex relate to reduced alcohol intake frequency 2 years later. Higher ventromedial prefrontal cortex and frontoparietal executive network functional connectivity is associated with lower subsequent drinking longitudinally.

CONCLUSIONS

Dorsal versus ventromedial prefrontal regions are differentially related to alcohol misuse cross-sectionally or longitudinally in a large UK Biobank normative dataset. Our study provides a comprehensive understanding of the neurobiological substrates of alcohol use as a state or prospectively, thereby providing potential targets for clinical treatment.

Functional Connectivity of the Chemosenses: A Review

Functional connectivity approaches have long been used in cognitive neuroscience to establish pathways of communication between and among brain regions. However, the use of these analyses to better understand how the brain processes chemosensory information remains nascent. In this review, we conduct a literature search of all functional connectivity papers of olfaction, gustation, and chemesthesis, with 103 articles discovered in total. These publications largely use approaches of seed-based functional connectivity and psychophysiological interactions, as well as effective connectivity approaches such as Granger Causality, Dynamic Causal Modeling, and Structural Equation Modeling. Regardless of modality, studies largely focus on elucidating neural correlates of stimulus qualities such as identity, pleasantness, and intensity, with task-based paradigms most frequently implemented. We call for further "model free" or data-driven approaches in predictive modeling to craft brain-behavior relationships that are free from a priori hypotheses and not solely based on potentially irreproducible literature. Moreover, we note a relative dearth of resting-state literature, which could be used to better understand chemosensory networks with less influence from motion artifacts induced via gustatory or olfactory paradigms. Finally, we note a lack of genomics data, which could clarify individual and heritable differences in chemosensory perception.

A systematic review of neural, cognitive, and clinical studies of anger and aggression

Anger and aggression have large impact on people's safety and the society at large. In order to provide an intervention to minimise aggressive behaviours, it is important to understand the neural and cognitive aspects of anger and aggression. In this systematic review, we investigate the cognitive and neural aspects of anger-related processes, including anger-related behaviours and anger reduction. Using this information, we then review prior existing methods on the treatment of anger-related disorders as well as anger management, including mindfulness and cognitive behavioural therapy. At the cognitive level, our review that anger is associated with excessive attention to anger-related stimuli and impulsivity. At the neural level, anger is associated with abnormal functioning of the amygdala and ventromedial prefrontal cortex. In conclusions, based on cognitive and neural studies, we here argue that mindfulness based cognitive behavioural therapy may be better at reducing anger and aggression than other behavioural treatments, such as cognitive behavioural therapy or mindfulness alone. We provide key information on future research work and best ways to manage anger and reduce aggression. Importantly, future research should investigate how anger related behaviours is acquired and how stress impacts the development of anger.

Early Auditory Event Related Potentials Distinguish Higher-Order From First-Order Aversive Conditioning

Stimuli in reality rarely co-occur with primary reward or punishment to allow direct associative learning of value. Instead, value is thought to be inferred through complex higher-order associations. Rodent research has demonstrated that the formation and maintenance of first-order and higher-order associations are supported by distinct neural substrates. In this study, we explored whether this pattern of findings held true for humans. Participants underwent first-order and subsequent higher-order conditioning using an aversive burst of white noise or neutral tone as the unconditioned stimuli. Four distinct tones, initially neutral, served as first-order and higher-order conditioned stimuli. Autonomic and neural responses were indexed by pupillometry and evoked response potentials (ERPs) respectively. Conditioned aversive values of first-order and higher-order stimuli led to increased autonomic responses, as indexed by pupil dilation. Distinct temporo-spatial auditory evoked response potentials were elicited by first-order and high-order conditioned stimuli. Conditioned first-order responses peaked around 260 ms and source estimation suggested a primary medial prefrontal and amygdala source. Conversely, conditioned higher-order responses peaked around 120 ms with an estimated source in the medial temporal lobe. Interestingly, pupillometry responses to first-order conditioned stimuli were diminished after higher order training, possibly signifying concomitant incidental extinction, while responses to higher-order stimuli remained. This suggests that once formed, higher order associations are at least partially independent of first order conditioned representations. This experiment demonstrates that first-order and higher-order conditioned associations have distinct neural signatures, and like rodents, the medial temporal lobe may be specifically involved with higher-order conditioning.

Cardiac response in aversive and appetitive olfactory conditioning: Evidence for a valence-independent CS-elicited bradycardia

While the examination of conditioned cardiac responses is well established in human fear conditioning research, comparable studies using less-aversive or rather appetitive unconditioned stimuli (UCS) are sparse and results are mixed. Therefore, the aim of this study was a systematic analysis of cardiac reactions in aversive and appetitive conditioning. Olfactory stimuli were used as unconditioned stimuli as they are suitable reinforcers in both an aversive and an appetitive conditioning offering the opportunity for a comparison between conditioned responses. In total, n = 86 participants took part in both an aversive and an appetitive differential conditioning task with a counterbalanced order across participants. Aversive or appetitive odors, respectively, served as UCS and neutral geometrical figures as CS. Subjective ratings, skin conductance response (SCRs), and evoked cardiac reactions were analyzed and compared between tasks. Conditioned responses in subjective ratings could be observed in both aversive conditioning and appetitive conditioning, while SCRs discriminated between CS+ and CS- in aversive conditioning only. Regarding conditioned cardiac responses, the deceleration for the CS+ was longer than for the CS- in both tasks. In addition, a higher deceleration magnitude and a shorter acceleration for the CS+ as compared to the CS- were found in aversive but not in appetitive conditioning. There were medium-size correlations between aversive and appetitive CRs for subjective ratings and none for physiological responses. The results suggest similarities between cardiac response patterns in aversive and appetitive conditioning, which implies that bradycardia in conditioning might not be fear-specific but presents a valence-independent CS-elicited bradycardia.

Instrumental and Pavlovian Mechanisms in Alcohol Use Disorder

Purpose of Review

Current theories of alcohol use disorders (AUD) highlight the importance of Pavlovian and instrumental learning processes mainly based on preclinical animal studies. Here, we summarize available evidence for alterations of those processes in human participants with AUD with a focus on habitual versus goal-directed instrumental learning, Pavlovian conditioning, and Pavlovian-to-instrumental transfer (PIT) paradigms.

Recent Findings

The balance between habitual and goal-directed control in AUD participants has been studied using outcome devaluation or sequential decision-making procedures, which have found some evidence of reduced goal-directed/model-based control, but little evidence for stronger habitual responding. The employed Pavlovian learning and PIT paradigms have shown considerable differences regarding experimental procedures, e.g., alcohol-related or conventional reinforcers or stimuli.

Summary

While studies of basic learning processes in human participants with AUD support a role of Pavlovian and instrumental learning mechanisms in the development and maintenance of drug addiction, current studies are characterized by large variability regarding methodology, sample characteristics, and results, and translation from animal paradigms to human research remains challenging. Longitudinal approaches with reliable and ecologically valid paradigms of Pavlovian and instrumental processes, including alcohol-related cues and outcomes, are warranted and should be combined with state-of-the-art imaging techniques, computational approaches, and ecological momentary assessment methods.

Associative processes in addiction relapse models: A review of their Pavlovian and instrumental mechanisms, history, and terminology

Animal models of relapse to drug-seeking have borrowed heavily from associative learning approaches. In studies of relapse-like behaviour, animals learn to self-administer drugs then receive a period of extinction during which they learn to inhibit the operant response. Several triggers can produce a recovery of responding which form the basis of a variety of models. These include the passage of time (spontaneous recovery), drug availability (rapid reacquisition), extinction of an alternative response (resurgence), context change (renewal), drug priming, stress, and cues (reinstatement). In most cases, the behavioural processes driving extinction and recovery in operant drug self-administration studies are similar to those in the Pavlovian and behavioural literature, such as context effects. However, reinstatement in addiction studies have several differences with Pavlovian reinstatement, which have emerged over several decades, in experimental procedures, associative mechanisms, and terminology. Interestingly, in cue-induced reinstatement, drug-paired cues that are present during acquisition are omitted during lever extinction. The unextinguished drug-paired cue may limit the model’s translational relevance to cue exposure therapy and renders its underlying associative mechanisms ambiguous. We review major behavioural theories that explain recovery phenomena, with a particular focus on cue-induced reinstatement because it is a widely used model in addiction. We argue that cue-induced reinstatement may be explained by a combination of behavioural processes, including reacquisition of conditioned reinforcement and Pavlovian to Instrumental Transfer. While there are important differences between addiction studies and the behavioural literature in terminology and procedures, it is clear that understanding associative learning processes is essential for studying relapse.

Relationship of estrogen synthesis capacity in the brain with obesity and self-control in men and women

Gonadal hormones are linked to mechanisms that govern appetitive behavior and its suppression. Estrogens are synthesized from androgens by the enzyme aromatase, highly expressed in the ovaries of reproductive-aged women and in the brains of men and women of all ages. We measured aromatase availability in the amygdala using positron emission tomography (PET) with the aromatase inhibitor [¹¹C]vorozole in a sample of 43 adult, normal-weight, overweight, or obese men and women. A subsample of 27 also completed personality measures to examine the relationship between aromatase and personality traits related to self-regulation and inhibitory control. Results indicated that aromatase availability in the amygdala was negatively associated with body mass index (BMI) (in kilograms per square meter) and positively correlated with scores of the personality trait constraint independent of sex or age. Individual variations in the brain's capacity to synthesize estrogen may influence the risk of obesity and self-control in men and women.

Augmenting extinction learning with D-cycloserine reduces return of fear: a randomized, placebo-controlled fMRI study

D-cycloserine (DCS), a partial NMDA-receptor agonist, seems to be a promising enhancer for exposure therapy in anxiety disorders. It has been tested successfully in animal models of fear extinction, where DCS enhanced extinction learning. Applied in clinical studies, results of DCS-augmented exposure therapy remain ambiguous, calling for a deeper understanding of the underlying mechanisms of DCS and its exact effect on extinction learning and return of fear (ROF) in humans. In the present study, we investigated the effect of DCS-augmented extinction learning on behavioral, psychophysiological, and neural indices of ROF during a 24-h delayed recall test. Thirty-seven participants entered a randomized, placebo-controlled, double-blind, 3-day fear conditioning and delayed extinction fMRI design. One hour before extinction training, participants received an oral dose of 50 mg of DCS or a placebo. Behavioral arousal ratings revealed a generalized ROF during extinction recall in the placebo but not DCS group. Furthermore, participants receiving DCS compared to placebo showed attenuated differential BOLD responses in left posterior hippocampus and amygdala from extinction learning to extinction recall, due to increased hippocampal recruitment in placebo and trendwise decreased amygdala responding in DCS subjects. Our finding that DCS reduces ROF in arousal ratings and neural structures subserving defensive reactions support a role for NMDA receptors in extinction memory consolidation and encourage further translational research.

Investigations into ventral prefrontal cortex using mediation models

The ventral prefrontal cortex (vPFC) is a major focus of investigation in neuroscience, particularly in the studies of emotion and emotion-cognition integration. A crucial question concerning the regulatory function of vPFC is how it is recruited, especially how the function maps onto the structure and determines appropriate behavior. In social exclusion studies, mediation model analyses suggest that vPFC regulates distress by disrupting anterior cingulate cortex (ACC) activities, whereas I recently report (Hu, 2018; Neuropsychologia) that ventral medial prefrontal cortex appears to defend the organism from acute stress by activating ACC. In this review, I synthesize and highlight functional imaging research with mediation analysis that over the past decades has begun to offer new insights into the brain mechanisms underlying vPFC. Toward this end, the first section of the paper outlines a model of the processes and neural systems involved in the interaction of emotion and cognition. The second and third sections survey recent research on emotional regulation with negative and positive pathways, respectively, emanating from vPFC. The fourth section summarizes the current dynamic network findings. Functional mediation analysis helps to identify signals within vPFC and others that are common and/or specific to particular information processing. Finally, I provide a personal perspective of the adoption of mediation model analysis in the investigations into vPFC.

Pupil dilation as an implicit measure of appetitive Pavlovian learning

Appetitive Pavlovian conditioning is a learning mechanism of fundamental biological and pathophysiological significance. Nonetheless, its exploration in humans remains sparse, which is partly attributed to the lack of an established psychophysiological parameter that aptly represents conditioned responding. This study evaluated pupil diameter and other ocular response measures (gaze dwelling time, blink duration and count) as indices of conditioning. Additionally, a learning model was used to infer participants' learning progress on the basis of their pupil dilation. Twenty-nine healthy volunteers completed an appetitive differential delay conditioning paradigm with a primary reward, while the ocular response measures along with other psychophysiological (heart rate, electrodermal activity, postauricular and eyeblink reflex) and behavioral (ratings, contingency awareness) parameters were obtained to examine the relation among different measures. A significantly stronger increase in pupil diameter, longer gaze duration and shorter eyeblink duration was observed in response to the reward-predicting cue compared to the control cue. The Pearce-Hall attention model best predicted the trial-by-trial pupil diameter. This conditioned response was corroborated by a pronounced heart rate deceleration to the reward-predicting cue, while no conditioning effect was observed in the electrodermal activity or startle responses. There was no discernible correlation between the psychophysiological response measures. These results highlight the potential value of ocular response measures as sensitive indices for representing appetitive conditioning.

Event boundaries do not cause the immediate extinction deficit after Pavlovian fear conditioning in rats

Recent work reveals that the extinction of conditioned fear depends upon the interval between conditioning and extinction. Extinction training that takes place within minutes to hours after fear conditioning fails to produce a long-term extinction memory, a phenomenon known as the immediate extinction deficit (IED). Neurobiological evidence suggests that the IED results from stress-induced dysregulation of prefrontal cortical circuits involved in extinction learning. However, a recent study in humans suggests that an "event boundary" between fear conditioning and extinction protects the conditioning memory from interference by the extinction memory, resulting in high levels of fear during a retrieval test. Here, we contrast these hypotheses in rats by arranging extinction trials to follow conditioning trials with or without an event boundary; in both cases, extinction trials are delivered in proximity to shock-elicited stress. After fear conditioning, rats either received extinction trials 60-sec after the last conditioning trial (continuous, no event boundary) or 15-minutes after conditioning (segmented, a standard "immediate" extinction procedure associated with an event boundary). Both groups of animals showed decreases in conditional freezing to the auditory conditioned stimulus (CS) during extinction and exhibited an equivalent IED relative to non-extinguished controls when tested 48 hours later. Thus, eliminating the event boundary between conditioning and extinction with the continuous extinction procedure did not prevent the IED. These data suggest that the IED is the result of shock-induced stress, rather than boundary-induced reductions in memory interference.