Agency and the Calibration of Motivated Behavior

Ventral hippocampus mediates inter-trial responding in signaled active avoidance

The hippocampus has a central role in regulating contextual processes in memory. We have shown that pharmacological inactivation of ventral hippocampus (VH) attenuates the context-dependence of signaled active avoidance (SAA) in rats. Here, we explore whether the VH mediates intertrial responses (ITRs), which are putative unreinforced avoidance responses that occur between trials. First, we examined whether VH inactivation would affect ITRs. Male rats underwent SAA training and subsequently received intra-VH infusions of saline or muscimol before retrieval tests in the training context. Rats that received muscimol performed significantly fewer ITRs, but equivalent avoidance responses, compared to controls. Next, we asked whether chemogenetic VH activation would increase ITR vigor. In male and female rats expressing excitatory (hM3Dq) DREADDs, systemic CNO administration produced a robust ITR increase that was not due to nonspecific locomotor effects. Then, we examined whether chemogenetic VH activation potentiated ITRs in an alternate (non-training) test context and found it did. Finally, to determine if context-US associations mediate ITRs, we exposed rats to the training context for three days after SAA training to extinguish the context. Rats submitted to context extinction did not show a reliable decrease in ITRs during a retrieval test, suggesting that context-US associations are not responsible for ITRs. Collectively, these results reveal an important role for the VH in context-dependent ITRs during SAA. Further work is required to explore the neural circuits and associative basis for these responses, which may be underlie pathological avoidance that occurs in humans after threat has passed.

Sensitivity to the Instrumental Value of Choice Increases Across Development

Across development, people tend to demonstrate a preference for contexts in which they have the opportunity to make choices. However, it is not clear how children, adolescents, and adults learn to calibrate this preference based on the costs and benefits of agentic choice. Here, in both a primary, in-person, reinforcement-learning experiment (N = 92; age range = 10-25 years) and a preregistered online replication study (N = 150; age range = 8-25 years), we found that participants overvalued agentic choice but also calibrated their agency decisions to the reward structure of the environment, increasingly selecting agentic choice when choice had greater instrumental value. Regression analyses and computational modeling of participant choices revealed that participants' bias toward agentic choice-reflecting its intrinsic value-remained consistent across age, whereas sensitivity to the instrumental value of agentic choice increased from childhood to early adulthood.

Acute stress yields a sex-dependent facilitation of signaled active avoidance in rats

Post-traumatic stress disorder (PTSD) is a debilitating disorder characterized by excessive fear, hypervigilance, and avoidance of thoughts, situations or reminders of the trauma. Among these symptoms, relatively little is known about the etiology of pathological avoidance. Here we sought to determine whether acute stress influences avoidant behavior in adult male and female rats. We used a stress procedure (unsignaled footshock) that is known to induce long-term sensitization of fear and potentiate aversive learning. Rats were submitted to the stress procedure and, one week later, underwent two-way signaled active avoidance conditioning (SAA). In this task, rats learn to prevent an aversive outcome (shock) by performing a shuttling response when exposed to a warning signal (tone). We found that acute stress significantly enhanced SAA acquisition rate in females, but not males. Female rats exhibited significantly greater avoidance responding on the first day of training relative to controls, reaching similar levels of performance by the second day. Males that underwent the stress procedure showed similar rates of acquisition to controls but exhibited resistance to extinction. This was manifest as both elevated avoidance and intertrial responding across extinction days relative to non-stressed controls, an effect that was not observed in females. In a second experiment, acute stress sensitized footshock unconditioned responses in males, not females. However, males and females exhibited similar levels of stress-enhanced fear learning (SEFL), which was expressed as sensitized freezing to a shock-paired context. Together, these results reveal that acute stress facilitates SAA performance in both male and female rats, though the nature of this effect is different in the two sexes. We did not observe sex differences in SEFL, suggesting that the stress-induced sex difference in performance was selective for instrumental avoidance. Future work will elucidate the neurobiological mechanisms underlying the differential effect of stress on instrumental avoidance in male and female rats.

Ventral hippocampus mediates inter-trial responding in signaled active avoidance

The hippocampus has a central role in regulating contextual processes in memory. We have shown that pharmacological inactivation of ventral hippocampus (VH) attenuates the context-dependence of signaled active avoidance (SAA) in rats. Here, we explore whether the VH mediates intertrial responses (ITRs), which are putative unreinforced avoidance responses that occur between trials. First, we examined whether VH inactivation would affect ITRs. Male rats underwent SAA training and subsequently received intra-VH infusions of saline or muscimol before retrieval tests in the training context. Rats that received muscimol performed significantly fewer ITRs, but equivalent avoidance responses, compared to controls. Next, we asked whether chemogenetic VH activation would increase ITR vigor. In male and female rats expressing excitatory (hM3Dq) DREADDs, systemic CNO administration produced a robust ITR increase that was not due to nonspecific locomotor effects. Then, we examined whether chemogenetic VH activation potentiated ITRs in an alternate (non-training) test context and found it did. Finally, to determine if context-US associations mediate ITRs, we exposed rats to the training context for three days after SAA training to extinguish the context. Rats submitted to context extinction did not show a reliable decrease in ITRs during a retrieval test, suggesting that context-US associations are not responsible for ITRs. Collectively, these results reveal an important role for the VH in context-dependent ITRs during SAA. Further work is required to explore the neural circuits and associative basis for these responses, which may be underlie pathological avoidance that occurs in humans after threat has passed.

Fear in action: Fear conditioning and alleviation through body movements

Fear memories enhance survival especially when the memories guide defensive movements to minimize harm. Accordingly, fear memories and body movements have tight relationships in animals: Fear memory acquisition results in adapting reactive defense movements, while training active defense movements reduces fear memory. However, evidence in humans is scarce because their movements are typically suppressed in experiments. Here, we tracked adult participants' body motions while they underwent ecologically valid fear conditioning in a 3D virtual space. First, with body motion tracking, we revealed that distinct spatiotemporal body movement patterns emerge through fear conditioning. Second, subsequent training to actively avoid threats with naturalistic defensive actions led to a long-term (24 h) reduction of physiological and embodied conditioned responses, while extinction or vicarious training only transiently reduced the responses. Together, our results highlight the role of body movements in human fear memory and its intervention.

The effect of social media upward comparison on Chinese adolescent learning engagement: a moderated multiple mediation model

To investigate the mechanisms and boundary conditions of social media upward comparison on adolescents' learning engagement, this study utilized two separate approaches. In research 1, a convenience sampling method was employed to conduct a questionnaire survey among 609 adolescents. The aim was to explore the influence of social media's upward comparative tendency on learning engagement. In research 2, real social media platforms were utilized to select short videos as experimental materials. These materials were used to manipulate instantaneous social media upward comparison and examine its impact on learning engagement. The research 1's result indicated that the mediating effect of the sense of agency was significant, as well as the moderating effect of growth mindset. However, the mediating effect of positive-negative emotions was found to be insignificant.Regarding instantaneous social media upward comparison and learning engagement, positive and negative emotions were found to play a complete mediating role. However, the mediating role of agency and the moderating role of growth mindset were not significant.This study offers practical insights for educators, enabling them to develop a correct understanding and effectively regulate adolescents' use of social media.

Adolescents flexibly adapt action selection based on controllability inferences

From early in life, we encounter both controllable environments, in which our actions can causally influence the reward outcomes we experience, and uncontrollable environments, in which they cannot. Environmental controllability is theoretically proposed to organize our behavior. In controllable contexts, we can learn to proactively select instrumental actions that bring about desired outcomes. In uncontrollable environments, Pavlovian learning enables hard-wired, reflexive reactions to anticipated, motivationally salient events, providing "default" behavioral responses. Previous studies characterizing the balance between Pavlovian and instrumental learning systems across development have yielded divergent findings, with some studies observing heightened expression of Pavlovian learning during adolescence and others observing a reduced influence of Pavlovian learning during this developmental stage. In this study, we aimed to investigate whether a theoretical model of controllability-dependent arbitration between learning systems might explain these seemingly divergent findings in the developmental literature, with the specific hypothesis that adolescents' action selection might be particularly sensitive to environmental controllability. To test this hypothesis, 90 participants, aged 8-27, performed a probabilistic-learning task that enables estimation of Pavlovian influence on instrumental learning, across both controllable and uncontrollable conditions. We fit participants' data with a reinforcement-learning model in which controllability inferences adaptively modulate the dominance of Pavlovian versus instrumental control. Relative to children and adults, adolescents exhibited greater flexibility in calibrating the expression of Pavlovian bias to the degree of environmental controllability. These findings suggest that sensitivity to environmental reward statistics that organize motivated behavior may be heightened during adolescence.

The enhancement of temporal binding effect after negative social feedback

The present study investigated the effect of social feedback on the experiences of our actions and the outcomes (e.g. temporal binding between an action and its outcome, reflecting individuals' causal beliefs modulated by their agency judgments). In Experiment 1a, participants freely decided (voluntary action) their action timing to cause an outcome, which was followed by social feedback. A larger temporal binding (TB) following negative vs. positive events was found. This effect appeared neither in the random context where the causal belief between the action and outcome was absent (Experiment 1b) nor in the involuntary action context where participants' action timing was instructed (Experiment 1c). Experiments 2a and 2b examined the effect when the action-outcome was occluded, including reversing the order of outcome and feedback in Experiment 2b. Experiments 3a and 3b investigated the effect with only social feedback or only action-outcome presented. Results revealed that the effect found in Experiment 1 was driven by social feedback and independent of the availability of the action-outcome and the position of social feedback. Our findings demonstrate a stronger temporal integration of the action and its outcome following negative social feedback, reflecting fluctuations in sense of agency when faced with social feedback.

Characterizing experiential elements of early-life stress to inform resilience: Buffering effects of controllability and predictability and the importance of their timing

Key theoretical frameworks have proposed that examining the impact of exposure to specific dimensions of stress at specific developmental periods is likely to yield important insight into processes of risk and resilience. Utilizing a sample of N = 549 young adults who provided a detailed retrospective history of their lifetime exposure to numerous dimensions of traumatic stress and ratings of their current trauma-related symptomatology via completion of an online survey, here we test whether an individual's perception of their lifetime stress as either controllable or predictable buffered the impact of exposure on trauma-related symptomatology assessed in adulthood. Further, we tested whether this moderation effect differed when evaluated in the context of early childhood, middle childhood, adolescence, and young adulthood stress. Consistent with hypotheses, results highlight both stressor controllability and stressor predictability as buffering the impact of traumatic stress exposure on trauma-related symptomatology and suggest that the potency of this buffering effect varies across unique developmental periods. Leveraging dimensional ratings of lifetime stress exposure to probe heterogeneity in outcomes following stress - and, critically, considering interactions between dimensions of exposure and the developmental period when stress occurred - is likely to yield increased understanding of risk and resilience following traumatic stress.

Anxiety associated with perceived uncontrollable stress enhances expectations of environmental volatility and impairs reward learning

Unavoidable stress can lead to perceived lack of control and learned helplessness, a risk factor for depression. Avoiding punishment and gaining rewards involve updating the values of actions based on experience. Such updating is however useful only if action values are sufficiently stable, something that a lack of control may impair. We examined whether self-reported stress uncontrollability during the first wave of the COVID-19 pandemic predicted impaired reward-learning. In a preregistered study during the first-wave of the COVID-19 pandemic, we used self-reported measures of depression, anxiety, uncontrollable stress, and COVID-19 risk from 427 online participants to predict performance in a three-armed-bandit probabilistic reward learning task. As hypothesised, uncontrollable stress predicted impaired learning, and a greater proportion of probabilistic errors following negative feedback for correct choices, an effect mediated by state anxiety. A parameter from the best-fitting hidden Markov model that estimates expected beliefs that the identity of the optimal choice will shift across images, mediated effects of state anxiety on probabilistic errors and learning deficits. Our findings show that following uncontrollable stress, anxiety promotes an overly volatile representation of the reward-structure of uncertain environments, impairing reward attainment, which is a potential path to anhedonia in depression.

Freedom of choice boosts midfrontal theta power during affective feedback processing of goal-directed actions

Sense of agency, the feeling of being in control of one's actions and their effects, is particularly relevant during goal-directed actions. During feedback learning, action effects provide information about the best course of action to reinforce positive and prevent negative outcomes. However, it is unclear whether agency experience selectively affects the processing of negative or positive feedback during the performance of goal-directed actions. As an important marker of feedback processing, we examined agency-related changes in midfrontal oscillatory activity in response to performance feedback using electroencephalography. Thirty-three participants completed a reinforcement learning task during which they received positive (monetary gain) or negative (monetary loss) feedback following item choices made either by themselves (free-choice) or by the computer (forced-choice). Independent of choice context, midfrontal theta activity was more enhanced for negative than positive feedback. In addition, free, compared to forced choices increased midfrontal theta power for both gain and loss feedback. These results indicate that freedom of choice in a motivationally salient learning task leads to a general enhancement in the processing of affective action outcomes. Our findings contribute to an understanding of the neuronal mechanisms underlying agency-related changes during action regulation and indicate midfrontal theta activity as a neurophysiological marker important for the monitoring of affective action outcomes, irrespective of feedback valence.

Rewarded Maze Training Increases Approach Behavior in Rats Through Neurogenesis-Dependent Growth of Ventral Hippocampus-Prelimbic Circuits

Background

Learning complex navigation routes increases hippocampal volume in humans, but it is not clear whether this growth impacts behaviors outside the learning situation or what cellular mechanisms are involved.

Methods

We trained rats with pharmacogenetic suppression of adult neurogenesis and littermate controls in 3 mazes over 3 weeks and tested novelty approach behavior several days after maze exposure. We then measured hippocampus and prelimbic cortex volumes using magnetic resonance imaging and assessed neuronal and astrocyte morphology. Finally, we investigated the activation and behavioral role of the ventral CA1 (vCA1)-to-prelimbic pathway using immediate-early genes and DREADDs (designer receptors exclusively activated by designer drugs).

Results

Maze training led to volume increase of both the vCA1 region of the hippocampus and the prelimbic region of the neocortex compared with rats that followed fixed paths. Growth was also apparent in individual neurons and astrocytes in these 2 regions, and behavioral testing showed increased novelty approach in maze-trained rats in 2 different tests. Suppressing adult neurogenesis prevented the effects on structure and approach behavior after maze training without affecting maze learning itself. The vCA1 neurons projecting to the prelimbic area were more activated by novelty in maze-trained animals, and suppression of this pathway decreased approach behavior.

Conclusions

Rewarded navigational learning experiences induce volumetric and morphologic growth in the vCA1 and prelimbic cortex and enhance activation of the circuit connecting these 2 regions. Both the structural and behavioral effects of maze training require ongoing adult neurogenesis, suggesting a role for new neurons in experience-driven increases in novelty exploration.

Exploring expected reward and efficacy in enhancing cognitive control in patients with depression

BACKGROUND

Depression is associated with impairments in cognitive control. Considering the lack of mechanistic models accounting for cognitive control deficits in depression, the expected value of control (EVC) theory offers a mechanistic view for allocating cognitive control emphasizing motivational components (efficacy, value). Efficacy refers to the possibility that an effort leads to a special outcome and reward refers to the value (amount) associated with the outcome. This study aimed to examine the role of the EVC in depression.

METHOD

This study used a within-between-subject design. Participants with depression (n = 36) and healthy controls (n = 31) completed a clinical diagnostic interview, the Beck Depression Inventory-II, the General Health Questionnaire-12, and a computer-based incentivized Stroop Color-Word Paradigm in which levels of efficacy (high vs. low) and the amount of rewards (high vs. low) were presented as cues before target stimuli.

RESULTS

We found significant interaction effects of group × efficacy and efficacy × reward in terms of reaction time in the Stroop Paradigm. Follow-up analyses indicated the Depressed group were significantly slower than Controls on high efficacy trials, but the two groups did not differ significantly on low efficacy trials. Additionally, on high efficacy trials, reward did not influence performance, but on low efficacy trials, high reward improved performance in both groups.

LIMITATION

Lack of neurological measures and eye tracking techniques.

CONCLUSION

Overall, our findings suggest that reward and efficacy may jointly improve cognitive control allocation and highlight the need for further research examining EVC theory as a mechanistic account of cognitive control deficits in depression.

A sex-specific role for the bed nucleus of the stria terminalis in proactive defensive behavior

The bed nucleus of the stria terminalis (BNST) is a forebrain region implicated in aversive responses to uncertain threat. Much of the work on the role of BNST in defensive behavior has used Pavlovian paradigms in which the subject reacts to aversive stimuli delivered in a pattern determined entirely by the experimenter. Here, we explore the contribution of BNST to a task in which subjects learn a proactive response that prevents the delivery of an aversive outcome. To this end, male and female rats were trained to shuttle during a tone to avoid shock in a standard two-way signaled active avoidance paradigm. Chemogenetic inhibition (hM4Di) of BNST attenuated the expression of the avoidance response in male but not female rats. Inactivation of the neighboring medial septum in males produced no effect on avoidance, demonstrating that our effect was specific to BNST. A follow up study comparing hM4Di inhibition to hM3Dq activation of BNST in males replicated the effect of inhibition and demonstrated that activation of BNST extended the period of tone-evoked shuttling. These data support the novel conclusion that BNST mediates two-way avoidance behavior in male rats and suggest the intriguing possibility that the systems underlying proactive defensive behavior are sex-specific.

Early adversity and the development of explore-exploit tradeoffs

Childhood adversity can have wide-ranging and long-lasting effects on later life. But what are the mechanisms that are responsible for these effects? This article brings together the cognitive science literature on explore-exploit tradeoffs, the empirical literature on early adversity, and the literature in evolutionary biology on 'life history' to explain how early experience influences later life. We propose one potential mechanism: early experiences influence 'hyperparameters' that determine the balance between exploration and exploitation. Adversity might accelerate a shift from exploration to exploitation, with broad and enduring effects on the adult brain and mind. These effects may be produced by life-history adaptations that use early experience to tailor development and learning to the likely future states of an organism and its environment.

Towards a neurocomputational account of social controllability: From models to mental health

Controllability, or the influence one has over their surroundings, is crucial for decision-making and mental health. Traditionally, controllability is operationalized in sensorimotor terms as one's ability to exercise their actions to achieve an intended outcome (also termed "agency"). However, recent social neuroscience research suggests that humans also assess if and how they can exert influence over other people (i.e., their actions, outcomes, beliefs) to achieve desired outcomes ("social controllability"). In this review, we will synthesize empirical findings and neurocomputational frameworks related to social controllability. We first introduce the concepts of contextual and perceived controllability and their respective relevance for decision-making. Then, we outline neurocomputational frameworks that can be used to model social controllability, with a focus on behavioral economic paradigms and reinforcement learning approaches. Finally, we discuss the implications of social controllability for computational psychiatry research, using delusion and obsession-compulsion as examples. Taken together, we propose that social controllability could be a key area of investigation in future social neuroscience and computational psychiatry research.

Early Social Adversity, Altered Brain Functional Connectivity, and Mental Health

Early adverse environmental exposures during brain development are widespread risk factors for the onset of severe mental disorders and strong and consistent predictors of stress-related mental and physical illness and reduced life expectancy. Current evidence suggests that early negative experiences alter plasticity processes during developmentally sensitive time windows and affect the regular functional interaction of cortical and subcortical neural networks. This, in turn, may promote a maladapted development with negative consequences on the mental and physical health of exposed individuals. In this review, we discuss the role of functional magnetic resonance imaging-based functional connectivity phenotypes as potential biomarker candidates for the consequences of early environmental exposures-including but not limited to-childhood maltreatment. We take an expanded concept of developmentally relevant adverse experiences from infancy over childhood to adolescence as our starting point and focus our review of functional connectivity studies on a selected subset of functional magnetic resonance imaging-based phenotypes, including connectivity in the limbic and within the frontoparietal as well as default mode networks, for which we believe there is sufficient converging evidence for a more detailed discussion in a developmental context. Furthermore, we address specific methodological challenges and current knowledge gaps that complicate the interpretation of early stress effects on functional connectivity and deserve particular attention in future studies. Finally, we highlight the forthcoming prospects and challenges of this research area with regard to establishing functional connectivity measures as validated biomarkers for brain developmental processes and individual risk stratification and as target phenotypes for mechanism-based interventions.

Learning when effort matters: neural dynamics underlying updating and adaptation to changes in performance efficacy

To determine how much cognitive control to invest in a task, people need to consider whether exerting control matters for obtaining rewards. In particular, they need to account for the efficacy of their performance-the degree to which rewards are determined by performance or by independent factors. Yet it remains unclear how people learn about their performance efficacy in an environment. Here we combined computational modeling with measures of task performance and EEG, to provide a mechanistic account of how people (i) learn and update efficacy expectations in a changing environment and (ii) proactively adjust control allocation based on current efficacy expectations. Across 2 studies, subjects performed an incentivized cognitive control task while their performance efficacy (the likelihood that rewards are performance-contingent or random) varied over time. We show that people update their efficacy beliefs based on prediction errors-leveraging similar neural and computational substrates as those that underpin reward learning-and adjust how much control they allocate according to these beliefs. Using computational modeling, we show that these control adjustments reflect changes in information processing, rather than the speed-accuracy tradeoff. These findings demonstrate the neurocomputational mechanism through which people learn how worthwhile their cognitive control is.

Neural effects of controllability as a key dimension of stress exposure

Cross-species evidence suggests that the ability to exert control over a stressor is a key dimension of stress exposure that may sensitize frontostriatal-amygdala circuitry to promote more adaptive responses to subsequent stressors. The present study examined neural correlates of stressor controllability in young adults. Participants (N = 56; M_age = 23.74, range = 18-30 years) completed either the controllable or uncontrollable stress condition of the first of two novel stressor controllability tasks during functional magnetic resonance imaging (fMRI) acquisition. Participants in the uncontrollable stress condition were yoked to age- and sex-matched participants in the controllable stress condition. All participants were subsequently exposed to uncontrollable stress in the second task, which is the focus of fMRI analyses reported here. A whole-brain searchlight classification analysis revealed that patterns of activity in the right dorsal anterior insula (dAI) during subsequent exposure to uncontrollable stress could be used to classify participants' initial exposure to either controllable or uncontrollable stress with a peak of 73% accuracy. Previous experience of exerting control over a stressor may change the computations performed within the right dAI during subsequent stress exposure, shedding further light on the neural underpinnings of stressor controllability.

Beyond Fear, Extinction, and Freezing: Strategies for Improving the Translational Value of Animal Conditioning Research

Translational neuroscience for anxiety has had limited success despite great progress in understanding the neurobiology of Pavlovian fear conditioning and extinction. This chapter explores the idea that conditioning paradigms have had a modest impact on translation because studies in animals and humans are misaligned in important ways. For instance, animal conditioning studies typically use imminent threats to assess short-duration fear states with single behavioral measures (e.g., freezing), whereas human studies typically assess weaker or more prolonged anxiety states with physiological (e.g., skin conductance) and self-report measures. A path forward may be more animal research on conditioned anxiety phenomena measuring dynamic behavioral and physiological responses in more complex environments. Exploring transitions between defensive brain states during extinction, looming threats, and post-threat recovery may be particularly informative. If care is taken to align paradigms, threat levels, and measures, this strategy may reveal stable patterns of non-conscious defense in animals and humans that correlate better with conscious anxiety. This shift in focus is also warranted because anxiety is a bigger problem than fear, even in disorders defined by dysfunctional fear or panic reactions.

An experimental test of the effects of acute sleep deprivation on affect and avoidance

BACKGROUND AND OBJECTIVES

Avoidance and sleep have been identified as mechanisms involved in the development and maintenance of many mental health disorders. However, there has been little research into the relation between sleep and avoidance.

METHODS

To address this, a randomized controlled experiment using behavioral and self-report measures of affect and avoidance was conducted. Compared to a control group, we hypothesized that sleep-deprived individuals would demonstrate increased negative, and decreased positive, affectivity, more avoidance behavior toward a negatively valenced stimulus, as well as increased self-reported avoidance. Fifty-two healthy individuals ages 18-30 years old were randomly assigned to a full night of sleep deprivation or normal sleep. They completed a baseline and post-manipulation behavioral avoidance task (BAT) using a disgusting stimulus and self-reports of avoidance and state affect.

RESULTS

Repeated measures ANOVAs demonstrated negative affectivity and self-reported avoidance increased, and positive affectivity decreased, from pre-to post-manipulation in the sleep loss condition as expected. However, there were no effects of sleep deprivation on avoidance behaviors.

LIMITATIONS

This study emphasized internal validity over generalizability. Additionally, the at-home sleep deprivation limited researcher control over the overnight activities of participants.

CONCLUSIONS

Results replicate prior work on the affective consequences of sleep deprivation and highlight a discrepancy between the effect of sleep deprivation on behavioral avoidance toward a specific stimulus compared to self-reported cognitive and social avoidance behaviors.

Anterior cingulate cortex causally supports flexible learning under motivationally challenging and cognitively demanding conditions

Anterior cingulate cortex (ACC) and striatum (STR) contain neurons encoding not only the expected values of actions, but also the value of stimulus features irrespective of actions. Values about stimulus features in ACC or STR might contribute to adaptive behavior by guiding fixational information sampling and biasing choices toward relevant objects, but they might also have indirect motivational functions by enabling subjects to estimate the value of putting effort into choosing objects. Here, we tested these possibilities by modulating neuronal activity in ACC and STR of nonhuman primates using transcranial ultrasound stimulation while subjects learned the relevance of objects in situations with varying motivational and cognitive demands. Motivational demand was indexed by varying gains and losses during learning, while cognitive demand was varied by increasing the uncertainty about which object features could be relevant during learning. We found that ultrasound stimulation of the ACC, but not the STR, reduced learning efficiency and prolonged information sampling when the task required averting losses and motivational demands were high. Reduced learning efficiency was particularly evident at higher cognitive demands and when subjects experienced loss of already attained tokens. These results suggest that the ACC supports flexible learning of feature values when loss experiences impose a motivational challenge and when uncertainty about the relevance of objects is high. Taken together, these findings provide causal evidence that the ACC facilitates resource allocation and improves visual information sampling during adaptive behavior.

More engagement in inefficient avoidance through partial reinforcement

BACKGROUND AND OBJECTIVES

In anxiety-related disorders, excessive avoidance often coexists with an impaired sense of control over external threats. In contrast, lab studies have shown that avoidance responding increase with higher objective controllability over threat, accompanied with more confidence in the effectiveness of the avoidance response. One reason for this divergence could be that those lab studies are overly simplistic with a single, avoidable threat.

METHODS

We conducted an experiment that additionally included a completely uncontrollable threat, and we manipulated the reinforcement rate of the avoidance response to the (semi-)controllable threat (75% versus 100%).

RESULTS

The 100% group showed increased avoidance to the controllable threat and decreased avoidance to the unavoidable threat over learning. Interestingly, compared to the 100% group, the 75% group displayed less confidence in their avoidance to the controllable threat and they avoided the uncontrollable threat more often.

LIMITATIONS

Only two reinforcement rates of effective avoidance were included, which may limit the generalizability of the current findings. Perceived control was not directly measured.

CONCLUSIONS

Lower reinforcement rates create ambiguity between effective and ineffective situations of avoidance, which engenders generalization of unpredictability from effective to ineffective situation, thereby driving up ineffective avoidance rates. Partially reinforced effective avoidance responses and elevated ineffective avoidance responses together lead to more exposure to uncontrollable threat, weakening the sense of control over the threat, which could further increase avoidance behaviors. Controllability is often overlooked in avoidance research but can be key to understanding the development of maladaptive avoidance behaviors.

Group differences in agency modulate error monitoring

Mistakes can lead to aversive outcomes. Error monitoring may help prevent mistakes, but it might be maladaptive for individuals who lack control over aversive outcomes, as it consumes cognitive processing resources that could be allocated elsewhere. Here, we examined the effect of agency (i.e., control over punishment) on error monitoring using the error-related negativity (ERN), an event-related potential measure of error monitoring and error rate. Ninety unselected participants performed a flanker task in which they were shocked according to their own errors (controllable punishment, n = 47) or were shocked in accordance with another participant's errors (uncontrollable punishment, n = 43). Participants without agency over punishment showed smaller ERNs and higher error rates compared with participants with agency. Furthermore, punishment only reduced error rates for participants with agency. Together, these results provide the first experimental evidence that agency modulates error monitoring and suggest an adaptive process in which error monitoring is increased/decreased depending on its utility.

The effect of obstructed action efficacy on reward-based decision-making in healthy adolescents: a novel functional MRI task to assay frustration

Frustration is common in adolescence and often interferes with executive functioning, particularly reward-based decision-making, and yet very little is known about how incidental frustrating events (independent of task-based feedback) disrupt the neural circuitry of reward processing in this important age group. While undergoing functional magnetic resonance imaging (fMRI), 45 healthy adolescents played a card game in which they had to guess between two options to earn points, in low- and high-stake conditions. Functioning of button presses through which they made decisions was intermittently blocked, thereby increasing frustration potential. Neural deactivation of the precuneus, a Default Mode Network region, was observed during obstructed action blocks across stake conditions, but less so on high- relative to low-stake trials. Moreover, less deactivation in goal-directed reward processing regions (i.e., caudate), frontoparietal "task control" regions, and interoceptive processing regions (i.e., somatosensory cortex, thalamus) were observed on high-stake relative to low-stake trials. These findings are consistent with less disruption of goal-directed reward seeking during blocked action efficacy in high-stake conditions among healthy adolescents. These results provide a roadmap of neural systems critical to the processing of frustrating events during reward-based decision-making in youths and could help to characterize how frustration regulation is altered in a range of pediatric psychopathologies.

Developmental shifts in computations used to detect environmental controllability

Accurate assessment of environmental controllability enables individuals to adaptively adjust their behavior—exploiting rewards when desirable outcomes are contingent upon their actions and minimizing costly deliberation when their actions are inconsequential. However, it remains unclear how estimation of environmental controllability changes from childhood to adulthood. Ninety participants (ages 8–25) completed a task that covertly alternated between controllable and uncontrollable conditions, requiring them to explore different actions to discover the current degree of environmental controllability. We found that while children were able to distinguish controllable and uncontrollable conditions, accuracy of controllability assessments improved with age. Computational modeling revealed that whereas younger participants’ controllability assessments relied on evidence gleaned through random exploration, older participants more effectively recruited their task structure knowledge to make highly informative interventions. Age-related improvements in working memory mediated this qualitative shift toward increased use of an inferential strategy. Collectively, these findings reveal an age-related shift in the cognitive processes engaged to assess environmental controllability. Improved detection of environmental controllability may foster increasingly adaptive behavior over development by revealing when actions can be leveraged for one’s benefit.

The ability to determine when one’s actions are consequential organizes learning and decision making across the lifespan. However, few studies have examined how the ability to detect control over our environment changes from childhood to adulthood. Here, we leveraged a computational modeling framework to characterize the component learning processes underlying controllability assessment in children, adolescents, and adults. We observed age-related improvements in controllability assessment that stemmed from an increasing ability to represent contingencies between states and actions and to use that knowledge to make informative interventions that yield diagnostic evidence of the current degree of control. Increasing ability to accurately assess environmental controllability may confer greater recognition of opportunities to adaptively pursue rewards through goal-directed action across development.

Sex Differences in Fearful Personality Traits Are Mediated by Physical Strength

Across cultures, women reliably exhibit higher levels of Neuroticism than men. Recent work shows that this sex difference, particularly in Neuroticism’s anxiety facet, is partly mediated by the sex difference in physical strength. We build on this finding by testing pre-registered predictions of mediation by physical strength of the sex differences in HEXACO Emotionality and its Anxiety and Fearfulness facets (HEXACO stands for the factors of honesty–humility, emotionality, extraversion, agreeableness, conscientiousness, and openness to experience). Facultative calibration models predict that levels of these two facets, but not necessarily Emotionality’s other facets, will be adaptively adjusted during ontogeny to a person’s relative physical formidability. Results from five samples of U.S. undergraduates (total N = 1,399) showed that strength mediated the sex difference (women > men) in Emotionality and all its facets, but that the mediation effect was strongest for Fearfulness and weakest for Sentimentality. Overall, findings are consistent with the hypothesis that physical strength explains sex differences found in fearful and anxious personality traits.

Acting with awareness moderates the association between lifetime exposure to interpersonal traumatic events and craving via trauma symptoms: a moderated indirect effects model

BACKGROUND

History of exposure to traumatic events (ETE) is common among women in substance use disorder (SUD) treatment and is related to craving. We examined whether ETE (i.e., emotional, physical, sexual abuse) in childhood, adulthood, or both is related to craving via trauma symptoms and how trait mindfulness might attenuate this association.

METHODS

Baseline data from a larger randomized clinical trial of a mindfulness-based intervention for women (N = 245) in SUD treatment were used. Inclusion criteria were: 18-65 years of age, SUD diagnosis, English fluency, no cognitive impairment, and willingness to be audio recorded and provide consent. Demographics and validated measures of ETE, posttraumatic stress symptoms, trait mindfulness, and substance use craving were collected via in-person interviews. Descriptive statistics, correlational analysis, and relative direct, indirect, and conditional indirect effects models were run.

RESULTS

Most participants identified as Hispanic (58.5%), had at least a high school education (52.2%), with a mean age of 32.2. Women reported ETE in childhood only (20.4%), adulthood only (17.5%), both childhood and adulthood (50.0%), and never (11.4%). Compared to women with ETE in both childhood and adulthood, those with exposure in adulthood only (β = -.10, 95% CI = -.20, -.02) or no exposure (β = -.11, 95% CI = -.23, -.03; [∆R2= .347, F(8, 245) = 15.7, p < .001) had lower craving via lower trauma symptomatology but no difference when compared to those with ETE only in childhood. Acting with awareness moderated this indirect effect (∆R2 = .04, F(3, 245) = 4.66, p = .004. At low levels of awareness, women with ETE during both childhood and adulthood reported higher craving via trauma symptomatology than women with no exposure or only adulthood exposure.

CONCLUSIONS

Low levels of acting with awareness may worsen trauma symptoms after ETE, which in turn may lead to more craving for women in substance use treatment. Despite a small moderating effect size, acting with awareness may have clinical significance due to the prevalence of trauma symptoms among women in SUD treatment.

Stress-sensitive inference of task controllability

Estimating the controllability of the environment enables agents to better predict upcoming events and decide when to engage controlled action selection. How does the human brain estimate controllability? Trial-by-trial analysis of choices, decision times and neural activity in an explore-and-predict task demonstrate that humans solve this problem by comparing the predictions of an 'actor' model with those of a reduced 'spectator' model of their environment. Neural blood oxygen level-dependent responses within striatal and medial prefrontal areas tracked the instantaneous difference in the prediction errors generated by these two statistical learning models. Blood oxygen level-dependent activity in the posterior cingulate, temporoparietal and prefrontal cortices covaried with changes in estimated controllability. Exposure to inescapable stressors biased controllability estimates downward and increased reliance on the spectator model in an anxiety-dependent fashion. Taken together, these findings provide a mechanistic account of controllability inference and its distortion by stress exposure.

A Case for Translation From the Clinic to the Laboratory

Laboratory procedures have been used for decades as analogues for clinical processes with the goal of improving our understanding of psychological treatments for emotional disorders and identifying strategies to make treatments more effective. This research has often focused on translation from the laboratory to the clinic. Although this approach has notable successes, it has not been seamless. There are many examples of strategies that work in the laboratory that fail to lead to improved outcomes when applied clinically. One possible reason for this gap between experimental and clinical research is a failure to focus on translation from the clinic to the laboratory. Here, we discuss potential benefits of translation from the clinic to the laboratory and provide examples of how this might be implemented. We first consider two well-established laboratory analogues (extinction and cognitive reappraisal), identify critical aspects of the related clinical procedures (exposure and cognitive restructuring) that are missing from these analogues, and propose variations to better capture the clinical process. Second, we discuss two clinical procedures that have more recently been brought into the laboratory (eye-movement desensitization and reprocessing and imagery rescripting). We conclude by highlighting potential implications of this proposed shift in focus for translational research.

Deconstructing and reconstructing behaviour relevant to mental health disorders: The benefits of a psychological approach, with a focus on addiction

RUTHERFORD, L.G. and Milton, A.L. Deconstructing and reconstructing behaviour relevant to mental health disorders: what can psychology offer? NEUROSCI BIOBEHAV REV XX(X)XXX-XXX, 2021. - Current treatments for mental health disorders are successful only for some patients, and there is an unmet clinical need for new treatment development. One challenge for treatment development has been how best to model complex human conditions in animals, where mechanism can be more readily studied with a range of neuroscientific techniques. We suggest that an approach to modelling based on associative animal learning theory provides a good framework for deconstructing complex mental health disorders such that they can be studied in animals. These individual simple models can subsequently be used in combination to 'reconstruct' a more complex model of the mental health disorder of interest. Using examples primarily from the field of drug addiction, we explore the 'psychological approach' and suggest that in addition to facilitating translation and backtranslation of tasks between animal models and patients, it is also highly concordant with the concept of triangulation.

Distributed and Multifaceted Effects of Threat and Safety

In the present fMRI study, we examined how anxious apprehension is processed in the human brain. A central goal of the study was to test the prediction that a subset of brain regions would exhibit sustained response profiles during threat periods, including the anterior insula, a region implicated in anxiety disorders. A second important goal was to evaluate the responses in the amygdala and the bed nucleus of the stria terminals, regions that have been suggested to be involved in more transient and sustained threat, respectively. A total of 109 participants performed an experiment in which they encountered "threat" or "safe" trials lasting approximately 16 sec. During the former, they experienced zero to three highly unpleasant electrical stimulations, whereas in the latter, they experienced zero to three benign electrical stimulations (not perceived as unpleasant). The timing of the stimulation during trials was randomized, and as some trials contained no stimulation, stimulation delivery was uncertain. We contrasted responses during threat and safe trials that did not contain electrical stimulation, but only the potential that unpleasant (threat) or benign (safe) stimulation could occur. We employed Bayesian multilevel analysis to contrast responses to threat and safe trials in 85 brain regions implicated in threat processing. Our results revealed that the effect of anxious apprehension is distributed across the brain and that the temporal evolution of the responses is quite varied, including more transient and more sustained profiles, as well as signal increases and decreases with threat.

Extinction trial spacing across days differentially impacts fear regulation in adult and adolescent male mice

Fear regulation changes as a function of age and adolescence is a key developmental period for the continued maturation of fear neural circuitry. A consistent finding in the literature is diminished extinction retention in adolescents. However, these studies often directly compare adolescents to adults using a single protocol and therefore provide little insight into learning parameters that improve adolescent fear regulation. Studies in adults highlight the benefits of spaced learning over massed learning. These findings have been extended to fear regulation, with adult rodents exhibiting improved extinction learning and retention when cues are distributed over days versus a single session. However, similar studies have not been performed in adolescents. Here, we systematically examine the impact of trial spacing across days on fear regulation. Adolescent or adult male mice were exposed to one of three extinction paradigms that presented the same number of trials but differed in the temporal distribution of trials across days (one day, two days, or four days). We found that introducing consolidation events into the protocol improves adult extinction learning and short-term extinction retention but these effects disappear after two weeks. For adolescents, all three protocols were comparably effective in reducing freezing across extinction training and improved retention at both short-term and long-term fear recall time points relative to extinction-naive mice. These findings suggest that extinction protocols that incorporate consolidation events are optimal for adults but additional booster training may be required for enduring efficacy. In contrast, protocols incorporating either massed or spaced presentations show immediate and enduring benefits for adolescents.

Neurocomputational mechanism of controllability inference under a multi-agent setting

Controllability perception significantly influences motivated behavior and emotion and requires an estimation of one’s influence on an environment. Previous studies have shown that an agent can infer controllability by observing contingency between one’s own action and outcome if there are no other outcome-relevant agents in an environment. However, if there are multiple agents who can influence the outcome, estimation of one’s genuine controllability requires exclusion of other agents’ possible influence. Here, we first investigated a computational and neural mechanism of controllability inference in a multi-agent setting. Our novel multi-agent Bayesian controllability inference model showed that other people’s action-outcome contingency information is integrated with one’s own action-outcome contingency to infer controllability, which can be explained as a Bayesian inference. Model-based functional MRI analyses showed that multi-agent Bayesian controllability inference recruits the temporoparietal junction (TPJ) and striatum. Then, this inferred controllability information was leveraged to increase motivated behavior in the vmPFC. These results generalize the previously known role of the striatum and vmPFC in single-agent controllability to multi-agent controllability, and this generalized role requires the TPJ in addition to the striatum of single-agent controllability to integrate both self- and other-related information. Finally, we identified an innate positive bias toward the self during the multi-agent controllability inference, which facilitated behavioral adaptation under volatile controllability. Furthermore, low positive bias and high negative bias were associated with increased daily feelings of guilt. Our results provide a mechanism of how our sense of controllability fluctuates due to other people in our lives, which might be related to social learned helplessness and depression.

How we perceive controllability over an outcome if there are multiple other agents who can simultaneously influence that outcome? Previous ‘single-agent’ studies showed that an agents’ inferred controllability depends on contingency between its own action and following outcome and this inference involves striatum. Here, we show that in a multi-agent setting, other people’s action-outcome contingency information is integrated with one’s own action-outcome contingency to infer controllability, which was explained as a biased Bayesian inference. Notably, bias in inference played an adaptive role under volatile controllability and was associated with a perception of guilt. Striatum and temporoparietal junction (TPJ) were involved in this multi-agent Bayesian controllability inference and this controllability information was leveraged to increase motivated behavior in the vmPFC. Our results first provide a neurocomputational mechanism of multi-agent controllability inference.

Don't stress, it's under control: Neural correlates of stressor controllability in humans

Animal research has repeatedly shown that control is a key variable in the brain's stress response. Uncontrollable stress triggers a release of monoamines, impairing prefrontal functions while enhancing subcortical circuits. Conversely, control over an adverse event involves prefrontally mediated downregulation of monoamine nuclei and is considered protective. However, it remains unclear to what extent these findings translate to humans. During functional magnetic resonance imaging, we subjected participants to controllable and uncontrollable aversive but non-painful electric stimuli, as well as to a control condition without aversive stimulation. In each trial, a symbol signalled whether participants could terminate the stressor through correct performance in a button-matching task or whether the stressor would be randomly terminated, i.e., uncontrollable. Along with neural responses, we assessed participants' accuracy, reaction times, and heart rate. To relate neural activations and subjective experience, we asked participants to rate perceived control, helplessness, and stress. Results were largely in line with our hypotheses. The vmPFC was generally deactivated by aversive stimulation, but this effect was attenuated when participants could terminate the stressor compared to when their responses had no effect. Furthermore, activation in stress-responsive regions, including the bilateral insula, was reduced during controllable trials. Under uncontrollable aversive stimulation, greater vmPFC recruitment was linked to reduced feelings of helplessness. An investigation of condition-dependant differences in vmPFC connectivity yielded no significant results. Our findings further corroborate animal research and emphasise the role of the vmPFC in controllability-dependant regulation of stress responses. Based on the results, we discuss future directions in the context of resilience research and mental health promotion.

Occupational Depression, Cognitive Performance, and Task Appreciation: A Study Based on Raven's Advanced Progressive Matrices

The Occupational Depression Inventory (ODI) was recently developed to assess depressive symptoms that individuals specifically attribute to their work. Research on the criterion validity of the instrument is still in its infancy. In this study, we examined whether the ODI predicted performance on, and appreciation of, a cognitively challenging test. In light of the link established between clinical depression and neuropsychological impairment, and considering that individuals with depressive symptoms are more likely to feel helpless under challenging circumstances, we hypothesized that occupational depression would be associated with poorer cognitive performance and a darkened appreciation of the task undertaken. We relied on a sample of 1,359 educational staff members. We used an abridged version of Raven's Advanced Progressive Matrices (RAPMs) as a cognitively challenging task and measure of cognitive performance. RAPMs assess so-called eductive ability (meaning-making and problem-solving abilities) through items of various degrees of difficulty. Transient mood was assessed with a three-item measure before RAPMs were administered. Task appreciation was assessed with a single-item measure after the completion of RAPMs. We found occupational depression to be negatively linked to cognitive performance. A two-step cluster analysis, in which ODI and RAPMs scores were used as classifiers, revealed two profiles of respondents. The first profile was characterized by relatively low levels of depressive symptoms and high levels of cognitive performance; the second profile, by relatively high levels of depressive symptoms and low levels of cognitive performance. The two profiles differed strongly from one another, as indexed by Cohen's ds of 2.492 regarding depressive symptoms and 1.263 regarding cognitive performance. As anticipated, occupational depression predicted a darkened appreciation of the test. The association remained statistically significant, and largely unchanged, controlling for pretest mood and test performance. The highest levels of depressive symptoms were observed among individuals evaluating the task as "frustrating" and "discouraging." Our study suggests that occupational depression predicts poorer cognitive performance and a negativized experience of cognitive challenge. Such features may be part of a self-sustaining loop fostering the maintenance of depressive symptoms. The extent to which the ODI predicts performance in the work context needs to be investigated.

The Interplay Between Affective Processing and Sense of Agency During Action Regulation: A Review

Sense of agency is the feeling of being in control of one's actions and their perceivable effects. Most previous research identified cognitive or sensory determinants of agency experience. However, it has been proposed that sense of agency is also bound to the processing of affective information. For example, during goal-directed actions or instrumental learning we often rely on positive feedback (e.g., rewards) or negative feedback (e.g., error messages) to determine our level of control over the current task. Nevertheless, we still lack a scientific model which adequately explains the relation between affective processing and sense of agency. In this article, we review current empirical findings on how affective information modulates agency experience, and, conversely, how sense of agency changes the processing of affective action outcomes. Furthermore, we discuss in how far agency-related changes in affective processing might influence the ability to enact cognitive control and action regulation during goal-directed behavior. A preliminary model is presented for describing the interplay between sense of agency, affective processing, and action regulation. We propose that affective processing could play a role in mediating the influence between subjective sense of agency and the objective ability to regulate one's behavior. Thus, determining the interrelation between affective processing and sense of agency will help us to understand the potential mechanistic basis of agency experience, as well as its functional significance for goal-directed behavior.

Decomposing the motivation to exert mental effort

Achieving most goals demands cognitive control, yet people vary widely in their success at meeting these demands. While motivation is known to be fundamental to determining these successes, what determines one's motivation to perform a given task remains poorly understood. Here, we describe recent efforts towards addressing this question using the Expected Value of Control model, which simulates the process by which people weigh the costs and benefits of exerting mental effort. By functionally decomposing this cost-benefit analysis, this model has been used to fill gaps in our understanding of the mechanisms of mental effort and to generate novel predictions about the sources of variability in real-world performance. We discuss the opportunities the model provides for formalizing hypotheses about why people vary in their motivation to perform tasks, as well as for understanding limitations in our ability to test these hypotheses based on a given measure of performance.

The lesser evil: Pavlovian-instrumental transfer & aversive motivation

While our understanding of appetitive motivation includes accounts of rich cognitive phenomena, such as choice, sensory-specificity and outcome valuation, the same is not true in aversive processes. A highly sophisticated picture has emerged of Pavlovian fear conditioning and extinction, but progress in aversive motivation has been somewhat limited to these fundamental behaviors. Many differences between appetitive and aversive stimuli permit different kinds of analyses; a widely used procedure in appetitive studies that can expand the scope of aversive motivation is Pavlovian-instrumental transfer (PIT). Recently, this motivational transfer effect has been used to examine issues pertaining to sensory-specificity and the nature of defensive control in avoidance learning. Given enduring controversies and unresolved criticisms surrounding avoidance research, PIT offers a valuable, well-controlled procedure with which to similarly probe this form of motivation. Furthermore, while avoidance itself can be criticized as artificial, PIT can be an effective model for how skills learned through avoidance can be practically applied to encounters with threatening or fearful stimuli and stress. Despite sensory-related challenges presented by the limited aversive unconditioned stimuli typically used in research, transfer testing can nevertheless provide valuable information on the psychological nature of this historically controversial phenomenon.

Ventral hippocampus mediates the context-dependence of two-way signaled avoidance in male rats

Considerable work indicates that instrumental responding is context-dependent, but the neural mechanisms underlying this phenomenon are poorly understood. Given the important role for the hippocampal formation in contextual processing, we hypothesized that reversible inactivation of the hippocampus would impair the context-dependence of active avoidance. To test this hypothesis, we used a two-way signaled active avoidance (SAA) task that requires rats to shuttle across a divided chamber during a tone CS in order to avoid a footshock US. After training, avoidance responding was assessed in an extinction test in both the training context and a novel context in a counterbalanced order. Rats performed significantly more avoidance responses in the training context than in the novel context, demonstrating the context-dependence of shuttle avoidance behavior. To examine the role of the hippocampus in the context-dependence of SAA, we reversibly inactivated either the dorsal (DH) or ventral hippocampus (VH) prior to testing. Inactivation of the VH eliminated the context-dependence of SAA and elevated avoidance responding in the novel context to levels similar to that expressed in the training context. In contrast, DH inactivation had no effect on avoidance in either context, and neither manipulation affected freezing behavior. Therefore, the integrity of the VH, but not DH, is required for the expression of the context-dependence of avoidance behavior.

A Decision Architecture for Safety Computations

Accurately estimating safety is critical to pursuing nondefensive survival behaviors. However, little attention has been paid to how the human brain computes safety. We conceptualize a model that consists of two components: (i) threat-oriented evaluations that focus on threat value, imminence, and predictability; and (ii) self-oriented evaluations that focus on the agent's experience, strategies, and ability to control the situation. Our model points to the dynamic interaction between these two components as a mechanism of safety estimation. Based on a growing body of human literature, we hypothesize that distinct regions of the ventromedial prefrontal cortex (vmPFC) respond to threat and safety to facilitate survival decisions. We suggest safety is not an inverse of danger, but reflects independent computations that mediate defensive circuits and behaviors.

Social vulnerabilities for substance use: Stressors, socially toxic environments, and discrimination and racism

Applying a social determinants of health framework, this review brings attention to evidence from social sciences and neuroscience on the role of selected social factors in individual and population-level vulnerability to substance use and substance use disorders (SUDs). The understanding that social vulnerability to substance use and SUDs is multifaceted and occurs across different levels of influence (individual, interpersonal, community, and societal) is underscored. We propose that socially based stressors play a critical role in creating vulnerability to substance use and SUDs, and as such, deserve greater empirical attention to further understand how they "get under the skin." Current knowledge from social sciences and neuroscience on the relationships among vulnerability to substance use resulting from stressors, exposure to socially toxic childhood environments, and racism and discrimination are summarized and discussed, as are implications for future research, practice, and policy. Specifically, we propose using a top-down approach to the examination of known, yet often unexplored, relationships between vulnerability to substance use and SUDs, related inequities, and potential differential effects across demographic groups. Finally, research gaps and promising areas of research, practice, and policy focused on ameliorating social vulnerabilities associated with substance use and SUDs across the lifespan are presented. This article is part of the special issue on 'Vulnerabilities to Substance Abuse'.

Situation selection and modification in social inhibition: a person-centered approach

OBJECTIVES

The current study aimed to identify patterns of situation selection and modification behaviors using a person-centered approach, and to examine to what extent the trait social inhibition (SI) is associated with these patterns of situation-targeted emotion regulation.

METHODS

The sample comprised 504 participants (M_age= 21.5, SD = 8.2; 82% women), who completed questionnaires on situation selection and modification behaviors, and the social inhibition questionnaire (SIQ15). A three-step latent profile analysis (LPA) was performed to (A) identify existing latent profiles of situation avoidance and approach and situation modification behaviors, and (B) to examine the association of SI and facets with the latent class posteriors.

RESULTS

LPA revealed the presence of four profiles that differed in how situation selection and modification were applied. SI, behavioral inhibition, and social withdrawal were significantly associated with a higher odds of belonging to the profile characterized by avoidance selection and modification. Interpersonal sensitivity was associated with using more conversational modification behaviors, which may illustrate that interpersonal sensitive individuals are motivated to approach, but use avoidance behaviors to prevent confrontation.

CONCLUSIONS

SI individuals particularly rely on avoidance selection and modification behaviors, which may be considered maladaptive emotion regulation.

Prediction or Causation? Towards a Redefinition of Task Controllability

As research investigating controllability perception gains momentum, the algorithmic definition of controllability must be updated to avoid confusion between controllability and predictability. Reframing controllable environments as environments that allow agents to exert causal influences over state transitions can circumvent the confounding influence of predictability when designing cognitive tasks.

Expectations of reward and efficacy guide cognitive control allocation

The amount of mental effort we invest in a task is influenced by the reward we can expect if we perform that task well. However, some of the rewards that have the greatest potential for driving these efforts are partly determined by factors beyond one's control. In such cases, effort has more limited efficacy for obtaining rewards. According to the Expected Value of Control theory, people integrate information about the expected reward and efficacy of task performance to determine the expected value of control, and then adjust their control allocation (i.e., mental effort) accordingly. Here we test this theory's key behavioral and neural predictions. We show that participants invest more cognitive control when this control is more rewarding and more efficacious, and that these incentive components separately modulate EEG signatures of incentive evaluation and proactive control allocation. Our findings support the prediction that people combine expectations of reward and efficacy to determine how much effort to invest.

Neural Computations of Threat

A host of learning, memory, and decision-making processes form the individual's response to threat and may be disrupted in anxiety and post-trauma psychopathology. Here we review the neural computations of threat, from the first encounter with a dangerous situation, through learning, storing, and updating cues that predict it, to making decisions about the optimal course of action. The overview highlights the interconnected nature of these processes and their reliance on shared neural and computational mechanisms. We propose an integrative approach to the study of threat-related processes, in which specific computations are studied across the various stages of threat experience rather than in isolation. This approach can generate new insights about the evolution, diagnosis, and treatment of threat-related psychopathology.

Controllability over stressor decreases responses in key threat-related brain areas

Controllability over stressors has major impacts on brain and behavior. In humans, however, the effect of controllability on responses to stressors is poorly understood. Using functional magnetic resonance imaging (fMRI), we investigated how controllability altered responses to a shock-plus-sound stressor with a between-group yoked design, where participants in controllable and uncontrollable groups experienced matched stressor exposure. Employing Bayesian multilevel analysis at the level of regions of interest and voxels in the insula, and standard voxelwise analysis, we found that controllability decreased stressor-related responses across threat-related regions, notably in the bed nucleus of the stria terminalis and anterior insula. Posterior cingulate cortex, posterior insula, and possibly medial frontal gyrus showed increased responses during control over stressor. Our findings support the idea that the aversiveness of stressors is reduced when controllable, leading to decreased responses across key regions involved in anxiety-related processing, even at the level of the extended amygdala.

The rational use of causal inference to guide reinforcement learning strengthens with age

Beliefs about the controllability of positive or negative events in the environment can shape learning throughout the lifespan. Previous research has shown that adults' learning is modulated by beliefs about the causal structure of the environment such that they update their value estimates to a lesser extent when the outcomes can be attributed to hidden causes. This study examined whether external causes similarly influenced outcome attributions and learning across development. Ninety participants, ages 7 to 25 years, completed a reinforcement learning task in which they chose between two options with fixed reward probabilities. Choices were made in three distinct environments in which different hidden agents occasionally intervened to generate positive, negative, or random outcomes. Participants' beliefs about hidden-agent intervention aligned with the true probabilities of the positive, negative, or random outcome manipulation in each of the three environments. Computational modeling of the learning data revealed that while the choices made by both adults (ages 18-25) and adolescents (ages 13-17) were best fit by Bayesian reinforcement learning models that incorporate beliefs about hidden-agent intervention, those of children (ages 7-12) were best fit by a one learning rate model that updates value estimates based on choice outcomes alone. Together, these results suggest that while children demonstrate explicit awareness of the causal structure of the task environment, they do not implicitly use beliefs about the causal structure of the environment to guide reinforcement learning in the same manner as adolescents and adults.

Motivational factors underlying aversive Pavlovian-instrumental transfer

While interest in active avoidance has recently been resurgent, many concerns relating to the nature of this form of learning remain unresolved. By separating stimulus and response acquisition, aversive Pavlovian-instrumental transfer can be used to measure the effect of avoidance learning on threat processing with more control than typical avoidance procedures. However, the motivational substrates that contribute to the aversive transfer effect have not been thoroughly examined. In three studies using rodents, the impact of a variety of aversive signals on shock-avoidance responding (i.e., two-way shuttling) was evaluated. Fox urine, as well as a tone paired with the delivery of the predator odor were insufficient modulatory stimuli for the avoidance response. Similarly, a signal for the absence of food did not generate appropriate aversive motivation to enhance shuttling. Only conditioned Pavlovian stimuli that had been paired with unconditioned threats were capable of augmenting shock-avoidance responding. This was true whether the signaled outcome was the same (e.g., shock) or different (e.g., klaxon) from the avoidance outcome (i.e., shock). These findings help to characterize the aversive transfer effect and provide a more thorough analysis of its generalization to warning signals for different kinds of threats. This feature of aversive motivation has not been demonstrated using conventional avoidance procedures and could be potentially useful for applying avoidance in treatment settings.