Early-life stress is associated with a preponderance of habitual responding in a novel instrumental avoidance learning paradigm

Social experience in adolescence shapes prefrontal cortex structure and function in adulthood

During adolescence, the prefrontal cortex (PFC) undergoes dramatic reorganization. PFC development is profoundly influenced by the social environment, disruptions to which may prime the emergence of psychopathology across the lifespan. We investigated the neurobehavioral consequences of isolation experienced in adolescence in mice, and in particular, the long-term consequences that were detectable even despite normalization of the social milieu. Isolation produced biases toward habit-like behavior at the expense of flexible goal seeking, plus anhedonic-like reward deficits. Behavioral phenomena were accompanied by neuronal dendritic spine over-abundance and hyper-excitability in the ventromedial PFC (vmPFC), which was necessary for the expression of isolation-induced habits and sufficient to trigger behavioral inflexibility in socially reared controls. Isolation activated cytoskeletal regulatory pathways otherwise suppressed during adolescence, such that repression of constituent elements prevented long-term isolation-induced neurosequelae. Altogether, our findings unveil an adolescent critical period and multi-model mechanism by which social experiences facilitate prefrontal cortical maturation.

Devaluation of response-produced safety signals reveals circuits for goal-directed versus habitual avoidance in dorsal striatum

Active avoidance responses (ARs) are instrumental behaviors that prevent harm. Adaptive ARs may contribute to active coping, whereas maladaptive avoidance habits are implicated in anxiety and obsessive-compulsive disorders. The AR learning mechanism has remained elusive, as successful avoidance trials produce no obvious reinforcer. We used a novel outcome-devaluation procedure in rats to show that ARs are positively reinforced by response-produced feedback (FB) cues that develop into safety signals during training. Males were sensitive to FB-devaluation after moderate training, but not overtraining, consistent with a transition from goal-directed to habitual avoidance. Using chemogenetics and FB-devaluation, we also show that goal-directed vs. habitual ARs depend on dorsomedial vs. dorsolateral striatum, suggesting a significant overlap between the mechanisms of avoidance and rewarded instrumental behavior. Females were insensitive to FB-devaluation due to a remarkable context-dependence of counterconditioning. However, degrading the AR-FB contingency suggests that both sexes rely on safety signals to perform goal-directed ARs.

Childhood adversity and mind wandering: the mediating role of cognitive flexibility and habitual tendencies

ABSTRACTBackground: Initial evidence proposes that exposure to childhood adversity may induce avoidance or withdrawal behaviour. However, it remains unclear whether childhood adversity results in avoidance from externally directed thinking to both deliberate and spontaneous mind wandering, i.e. intentionally or unintentionally diverting attention from ongoing task to task-independent thoughts.Objective: To assess the associations between childhood adversity, and mind wandering, and to evaluate the mediating roles of cognitive flexibility, and habit tendencies.Methods: A total of 601 Chinese subjects (378 females, Mage = 19.37) participated in the current study. The participants completed a series of questionnaires including demographics, childhood maltreatment, cognitive flexibility, habitual tendencies, and mind wandering.Results: Hierarchical regression analyses showed childhood adversity, the control facet of cognitive flexibility, and the automaticity facet of habitual tendencies had significant contributions to deliberate mind wandering (β = 0.10, β = -0.40, and β = 0.06) and spontaneous mind wandering (β = 0.09, β = -0.28, and β = 0.07). Serial mediation analyses revealed that the control and automaticity partially mediated associations between childhood adversity and mind wandering (deliberate mind wandering: 95% CIs = [0.037 0.078], and spontaneous mind wandering: 95% CIs = [0.023, 0.062]).Conclusions: The findings underscore the pivotal role of mediators in delineating the relationship between childhood adversity and mind wandering in everyday life. Interventions geared toward augmenting the control component of cognitive flexibility and regulating the automatic component of habitual tendencies show the potential to ameliorate the propensity of individuals affected by childhood adversity to disengage cognitively from the present moment.

Childhood unpredictability and the development of exploration

Early in development, the process of exploration helps children gather new information that fosters learning about the world. Yet, it is unclear how childhood experiences may influence the way humans approach new learning. What influences decisions to exploit known, familiar options versus trying a novel alternative? We found that childhood unpredictability, characterized by unpredictable caregiving and unstable living environments, was associated with reduced exploratory behavior. This effect holds while controlling for individual differences, including anxiety and stress. Individuals who perceived their childhoods as unpredictable explored less and were instead more likely to repeat previous choices (habitual responding). They were also more sensitive to uncertainty than to potential rewards, even when the familiar options yielded lower rewards. We examined these effects across multiple task contexts and via both in-person (N = 78) and online replication (N = 84) studies among 10- to 13-y-olds. Results are discussed in terms of the potential cascading effects of unpredictable environments on the development of decision-making and the effects of early experience on subsequent learning.

Effects of early-life stress on probabilistic reversal learning and response perseverance in young adults

Early life stress (ELS), including experiences with abuse and neglect, are related to several negative health outcomes in adulthood. One area that has received attention is the increased rate of substance abuse disorder in individuals who had experienced ELS. Given the critical role habitual behavior in the development of substance abuse, ELS may affect the trajectory of neural development such that habitual responding is more dominant than in individuals who did not experience ELS. Here, we examine learning of a probabilistic classification task (the Weather Prediction Task) in healthy young adults who reported significant ELS and those that did not. This task can be learned in a declarative, model-based manner, or in a more habitual, stimulus-response manner. Participants learned to choose the outcome (sun or rain) that was probabilistically associated with each cue combination through reinforcement on each trial. After 100 trials, the probabilities were reversed, and we conceptualized habitual behavior as perseverating responses based on the old probabilities. We also collected information about subjective socio-economic status (sSES), anxiety, depression, and substance use from participants. Using multiple regression, we found that our measure of habitual responding was correlated with reported alcohol use, suggesting that our measure of habit has validity for health behaviors. Furthermore, we found that some forms of early life stress led to greater response perseverance after contingencies were reversed. Overall, the results suggest that childhood adversity may contribute to the development of habit.

A dual-pathway architecture enables chronic stress to promote habit formation

Chronic stress can change how we learn and, thus, how we make decisions by promoting the formation of inflexible, potentially maladaptive, habits. Here we investigated the neuronal circuit mechanisms that enable this. Using a multifaceted approach in male and female mice, we reveal a dual pathway, amygdala-striatal, neuronal circuit architecture by which a recent history of chronic stress shapes learning to disrupt flexible goal-directed behavior in favor of inflexible habits. Chronic stress inhibits activity of basolateral amygdala projections to the dorsomedial striatum to impede the action-outcome learning that supports flexible, goal-directed decisions. Stress also increases activity in direct central amygdala projections to the dorsomedial striatum to promote the formation of rigid, inflexible habits. Thus, stress exerts opposing effects on two amygdala-striatal pathways to promote premature habit formation. These data provide neuronal circuit insights into how chronic stress shapes learning and decision making, and help understand how stress can lead to the disrupted decision making and pathological habits that characterize substance use disorders and other psychiatric conditions.

Stress, associative learning, and decision-making

Exposure to acute and chronic stress has significant effects on the basic mechanisms of associative learning and memory. Stress can both impair and enhance associative learning depending on type, intensity, and persistence of the stressor, the subject's sex, the context that the stress and behavior is experienced in, and the type of associative learning taking place. In some cases, stress can cause or exacerbate the maladaptive behavior that underlies numerous psychiatric conditions including anxiety disorders, obsessive-compulsive disorder, post-traumatic stress disorder, substance use disorder, and others. Therefore, it is critical to understand how the varied effects of stress, which may normally facilitate adaptive behavior, can also become maladaptive and even harmful. In this review, we highlight several findings of associative learning and decision-making processes that are affected by stress in both human and non-human subjects and how they are related to one another. An emerging theme from this work is that stress biases behavior towards less flexible strategies that may reflect a cautious insensitivity to changing contingencies. We consider how this inflexibility has been observed in different associative learning procedures and suggest that a goal for the field should be to clarify how factors such as sex and previous experience influence this inflexibility.

Sex-dependent effects of early life stress on reinforcement learning and limbic cortico-striatal functional connectivity

Major depressive disorder (MDD) is a stress-related condition hypothesized to involve aberrant reinforcement learning (RL) with positive and negative stimuli. The present study investigated whether repeated early maternal separation (REMS) stress, a procedure widely recognized to cause depression-like behaviour, affects how subjects learn from positive and negative feedback. The REMS procedure was implemented by separating male and female rats from their dam for 6 h each day from post-natal day 5-19. Control rat offspring were left undisturbed during this period. Rats were tested as adults for behavioral flexibility and feedback sensitivity on a probabilistic reversal learning task. A computational approach based on RL theory was used to derive latent behavioral variables related to reward learning and flexibility. To assess underlying brain substrates, a seed-based functional MRI connectivity analysis was applied both before and after an additional adulthood stressor in control and REMS rats. Female but not male rats exposed to REMS stress showed increased response 'stickiness' (repeated responses regardless of reward outcome). Following repeated adulthood stress, reduced functional connectivity from the basolateral amygdala (BLA) to the dorsolateral striatum (DLS), cingulate cortex (Cg), and anterior insula (AI) cortex was observed in females. By contrast, control male rats exposed to the second stressor showed impaired learning from negative feedback (i.e., non-reward) and reduced functional connectivity from the BLA to the DLS and AI compared to maternally separated males. RL in male rats exposed to REMS was unaffected. The fMRI data further revealed that connectivity between the mOFC and other prefrontal cortical and subcortical structures was positively correlated with response 'stickiness'. These findings reveal differences in how females and males respond to early life adversity and subsequent stress. These effects may be mediated by functional divergence in resting-state connectivity between the basolateral amygdala and fronto-striatal brain regions.

Chronic corticosterone administration in adolescence enhances dorsolateral striatum-dependent learning in adulthood

Previous evidence indicates a link between early life stress (ELS) in humans and a predisposition to psychopathologies that are characterized in part by maladaptive habitual behaviors. Stress and anxiety influence the relative use of mammalian memory systems implicated in these disorders. Specifically, cognitive memory functions of the hippocampus are typically impaired by stress/anxiety, whereas habit memory functions of the dorsolateral striatum (DLS) are enhanced. A stress/anxiety bias toward habit memory has largely been demonstrated in adult rodents and humans, and the effects of ELS on the later use of DLS-dependent habit memory in adult rodents have not been extensively examined. The present study addressed this question by chronically elevating corticosterone (CORT) during adolescence, and investigated the effects of this treatment on DLS-dependent habit learning in adulthood. In experiment 1, adolescent rats received a single daily injection of either CORT (5 mg/kg) or vehicle (cVEH) over 5 days and then matured undisturbed before training as adults in a DLS-dependent water plus-maze task. Rats administered CORT injections during adolescence displayed a strong trend toward enhanced learning during adulthood relative to vehicle-treated rats. Adolescent CORT administration also increased anxiety-like behavior in adulthood in an elevated plus-maze. In experiment 2, adolescent CORT administration enhanced task acquisition in adulthood, and this effect was blocked by concurrent administration of the glucocorticoid antagonist mifepristone (30 mg/kg). Taken together, these findings suggest that chronic elevation of glucocorticoids during adolescence are sufficient to facilitate habit learning in adulthood, and indicate that glucocorticoid function may be a potential underlying mechanism by which ELS influences subsequent habitual behaviors.