The ontogeny of learned inhibition

Serotonin 1B receptor effects on response inhibition are independent of inhibitory learning

Impulsivity is defined in terms of deficits in instrumental response inhibition, when the inability to withhold an action produces a negative outcome. However, there are many behavioral and cognitive constructs which theoretically could contribute to disordered impulsivity, including Pavlovian responding, which few studies have considered in this context. In the present set of studies, we examine Pavlovian inhibitory learning and excitatory responding in a mouse model for dysregulated impulsivity, specifically, mice lacking the serotonin 1B receptor (5-HT_1BR). Consistent with previous results, we show that these mice display increased impulsivity as measured by premature responding in the operant 5-choice serial reaction time test. In a Pavlovian conditioned inhibition paradigm, they also show a decreased ability to withhold responding, but importantly have an intact ability to learn inhibitory associations. In a Pavlovian appetitive conditioning experiment, 5-HT_1BR knockout mice show normal responding under a positive contingency schedule, however, they display increased responding to cues presented on an independent schedule from reinforcement in a zero contingency schedule. Interestingly this difference does not occur when the cues are explicitly unpaired in a negative contingency schedule, nor during a 25% reinforcement schedule. Overall, while our results show that the deficits in operant response inhibition in mice lacking 5-HT_1BR are likely not due to Pavlovian inhibitory or excitatory learning, it is relevant to consider associative learning in the context of dysregulated impulsive behavior.

The effects of age, sex, and handling on behavioral parameters in the multivariate concentric square field™ test

The multivariate concentric square field™ (MCSF) is a complex and ethologically relevant apparatus that is designed to measure several behavioral parameters within the same test session including risk-taking, risk-assessment, shelter-seeking (anxiety relieving), exploration, and general activity. While several studies have behaviorally and pharmacologically validated the use of the MCSF in adults, far fewer have used adolescents. Given the well-established link between adolescence and risk-taking, it is important to validate use of the MCSF in adolescence. The present study compared the effects of age, sex, and handling on behavioral categories in the MCSF. In addition, principal component analyses were used to compare the underlying behavioral components in adolescent and adult Sprague-Dawley rats. Results revealed that handling increased risk-taking and reduced shelter-seeking. Females were more exploratory than males, but no compelling age differences in risk-taking or risk-assessment were found. Principal component analyses revealed six major principal components for both adolescents and adults with the first and second components consisting mainly of center/center circle, risk-assessment, and shelter-seeking variables in adolescence, and general activity and center/center circle variables in adults. These results confirm age differences in the underlying behavioral components in the MCSF.

Adolescent but not adult Sprague-Dawley rats display goal-directed responding after reward devaluation

Alcohol drinking is typically initiated in adolescence, with use sometimes escalating to problematic levels. Escalation of drinking is often associated with a shift in drinking motives, with goal-directed initial use later transitioning to more habitual behavior. This study assessed whether adolescents are more sensitive than adults to habit formation when indexed via insensitivity to reward devaluation in an operant task for food reward. Adolescent and adult Sprague-Dawley rats were trained on either a random ratio (RR) or random interval (RI) schedule before undergoing devaluation. Adolescent animals on both schedules increased the number of lever presses across all training days. In contrast, adults in the RR group increased the number of lever presses across days whereas RI adults remained relatively stable. In response to pellet devaluation, only adolescents exhibited reduced responding, suggestive of goal-directed behavior, whereas no age differences were evident following control (home cage chow) devaluation. Contrary to our hypothesis, adolescents (but not adults) displayed goal-directed responding indexed via sensitivity to reward devaluation. These findings suggest that adolescents are not necessarily more likely to develop habits than adults, and hence other factors may contribute to the greater propensity of adolescents to engage in and escalate alcohol use.

Increased sign-tracking behavior in adolescent rats

An autoshaping procedure was used to test the notion that conditioned stimuli (CSs) gain greater incentive salience during adolescence than young adulthood under conditions of social isolation rearing and food restriction. Rats were single-housed and placed on food restriction during 10 daily training sessions in which a lever (CS⁺ ) was presented then followed immediately by a food unconditioned stimulus (US). A second lever (CS^- ) was presented on intermixed trials and was not reinforced. Despite the fact that food delivery was not contingent on the rats' behavior, all rats exhibited behaviors directed towards the lever (i.e., sign-tracking). In the adolescent group, the rate of lever pressing and the percentage of trials with a lever press were higher than in young adults. Initially, group differences were observed when rats were retrained when the adolescents had reached young adulthood. These findings support the hypothesis that cues that come to predict reward become imbued with excessive motivational value in adolescents, perhaps contributing to the hyper-responsiveness to reward-related stimuli typically observed during this period of development.

Setting the occasion for adolescent inhibitory control

During adolescence, individuals experience a broad range of dynamic environments as they strive to establish independence. Learning to respond appropriately in both new and previously encountered environments requires that an individual identify and learn the meaning of cues indicating that a behavior is appropriate, or alternatively, that it should be altered or inhibited. Although the ability to regulate goal-directed behavior continues to develop across adolescence, the specific circumstances under which adolescents experience difficulty with inhibitory control remain unclear. Here we review recent findings in our laboratory that address how adolescents learn to proactively inhibit a response. Much of our research has utilized a negative occasion setting paradigm, in which one cue (a feature) gates the meaning of a second cue (a target). The feature provides information that resolves the ambiguity of the target and indicates the appropriate behavioral response to the target. As such, we have been able to determine how adolescents learn about ambiguous stimuli, such as those whose meaning changes in accordance with other features of the surrounding environment. We consider why adolescents in particular exhibit difficulty in negative occasion setting compared to either pre-adolescents or adults. In addition, we review findings indicating that a balance in neural activity between orbitofrontal cortex and nucleus accumbens is necessary to support normal negative occasion setting. Finally, we consider aspects of associative learning that may contribute to adolescent inhibitory control, as well as provide insight into adolescent behavior as a whole.

Age differences in appetitive Pavlovian conditioning and extinction in rats

Mounting evidence indicates that adolescents exhibit heightened sensitivity to rewards and reward-related cues compared to adults, and that adolescents are often unable to exert behavioral control in the face of such cues. Moreover, differences in reward processing during adolescence have been linked to heightened risk taking and impulsivity. However, little is known about the processes by which adolescents learn about the appetitive properties of environmental stimuli that signal reward. To address this, Pavlovian conditioning procedures were used to test for differences in excitatory conditioning between adult and adolescent rats using various schedules of reinforcement. Specifically, separate cohorts of adult and adolescent rats were trained under conditions of consistent (continuous) or intermittent (partial) reinforcement. We found that the acquisition of anticipatory responding to a continuously-reinforced cue proceeded similarly in adolescents and adults. In contrast, responding increased at a greater rate in adolescents compared to adults during presentations of a partially-reinforced cue. We subsequently compared the ability of adolescent and adult rats to dynamically adjust the representation of a reward-predictive cue during extinction trials, in which a secondary inhibitory representation is acquired for the previously-reinforced stimulus. We observed significant age differences in the ability to flexibly update cue representations during extinction, in that the appetitive properties of cues with a history of either continuous or partial reinforcement persisted to a greater extent in adolescents relative to adults.

Adolescent transitions in reflexive and non-reflexive behavior: Review of fear conditioning and impulse control in rodent models

Adolescence is a time of critical brain changes that pave the way for adult learning processes. However, the extent to which learning in adolescence is best characterized as a transitional linear progression from childhood to adulthood, or represents a period that differs from earlier and later developmental stages, remains unclear. Here we examine behavioral literature on associative fear conditioning and complex choice behavior with rodent models. Many aspects of fear conditioning are intact by adolescence and do not differ from adult patterns. Sufficient evidence, however, suggests that adolescent learning cannot be characterized simply as an immature precursor to adulthood. Across different paradigms assessing choice behavior, literature suggests that adolescent animals typically display more impulsive patterns of responding compared to adults. The extent to which the development of basic conditioning processes serves as a scaffold for later adult decision making is an additional research area that is important for theory, but also has widespread applications for numerous psychological conditions.

Imbalanced Activity in the Orbitofrontal Cortex and Nucleus Accumbens Impairs Behavioral Inhibition

Contemporary models of behavioral regulation maintain that balanced activity between cognitive control areas (prefrontal cortex, PFC) and subcortical reward-related regions (nucleus accumbens, NAC) mediates the selection of appropriate behavioral responses, whereas imbalanced activity (PFC < NAC) results in maladaptive behavior [1-6]. Imbalance can arise from reduced engagement of PFC (via fatigue or stress [7]) or from excessive activity in NAC [8]. Additionally, a concept far less researched is that an imbalance can result from simultaneously low PFC activity and high NAC activity. This occurs during adolescence, when the maturation of PFC lags behind that of NAC and NAC is more functionally active compared to adulthood or pre-adolescence [2, 5, 9, 10]. Accordingly, activity is disproportionately higher in NAC than in PFC, which may contribute to impulsivity and risk-taking exhibited by adolescents [5, 6, 10-12]. Despite having explanatory value, support for this notion has been solely correlational. Here, we causally tested this using chemogenetics to simultaneously decrease neural activity in the orbitofrontal cortex (OFC) and increase activity in NAC in adult rats, mimicking the imbalance during adolescence. We tested the effects on negative occasion setting, an important yet understudied form of inhibitory learning that may be particularly relevant during adolescence. Rats with combined manipulation of OFC and NAC were impaired in learning to use environmental cues to withhold a response, an effect that was greater than that of either manipulation alone. These findings provide direct evidence that simultaneous underactivity in OFC and overactivity in NAC can negatively impact behavioral control and provide insight into the neural systems that underlie inhibitory learning.

Neural and behavioral mechanisms of proactive and reactive inhibition

Response inhibition is an important component of adaptive behavior. Substantial prior research has focused on reactive inhibition, which refers to the cessation of a motor response that is already in progress. More recently, a growing number of studies have begun to examine mechanisms underlying proactive inhibition, whereby preparatory processes result in a response being withheld before it is initiated. It has become apparent that proactive inhibition is an essential component of the overall ability to regulate behavior and has implications for the success of reactive inhibition. Moreover, successful inhibition relies on learning the meaning of specific environmental cues that signal when a behavioral response should be withheld. Proactive inhibitory control is mediated by stopping goals, which reflect the desired outcome of inhibition and include information about how and when inhibition should be implemented. However, little is known about the circuits and cellular processes that encode and represent features in the environment that indicate the necessity for proactive inhibition or how these representations are implemented in response inhibition. In this article, we will review the brain circuits and systems involved in implementing inhibitory control through both reactive and proactive mechanisms. We also comment on possible cellular mechanisms that may contribute to inhibitory control processes, noting that substantial further research is necessary in this regard. Furthermore, we will outline a number of ways in which the temporal dynamics underlying the generation of the proactive inhibitory signal may be particularly important for parsing out the neurobiological correlates that contribute to the learning processes underlying various aspects of inhibitory control.

Negative occasion setting in juvenile rats

Prior findings indicate that adolescent rats exhibit difficulty using negative occasion setters to guide behavior compared to adult rats (Meyer and Bucci, 2014). Here, additional groups of juvenile rats were trained in the same negative occasion setting procedure to further define the development of negative occasion setting. Beginning on either postnatal day (PND) 30, 40, or 50, rats received daily training sessions in which a tone was paired with food reinforcement on some trials, while on other trials a light preceded the tone and no reinforcement was delivered. We found that rats that began training on PND 50 required 10 training sessions to discriminate between the two types of trials, consistent with prior findings with young adult rats. Interestingly, rats in the PND 30 group (pre-adolescents) also required just 10 training sessions, in stark contrast to adolescent rats that began training on PND 35 (adolescents) and required 18 sessions (Meyer and Bucci, 2014). Rats that began training on PND 40 (adolescents) also required more sessions than the PND 30 group. These data indicate that the development of negative occasion setting is non-linear and have direct bearing on understanding the behavioral and neural substrates that underlie suboptimal behavioral control in adolescents.

Nicotine administration enhances negative occasion setting in adolescent rats

Substantial research has established that exposure to nicotine during adolescence can lead to long-term changes in neural circuitry and behavior. However, relatively few studies have considered the effects of nicotine use on cognition during this critical stage of brain development. This is significant because the influence of nicotine on cognitive performance during adolescence may contribute to the development of regular nicotine use. For example, improvements in cognitive functioning may increase the perceived value of smoking and facilitate impulses to smoke. To address this, the present research tested the effects of nicotine on a form of inhibitory learning during adolescence. Specifically, adolescent rats were exposed to nicotine as they were trained in a negative occasion setting paradigm, in which successful performance depends on learning the conditions under which it is, or is not, appropriate to respond to a target stimulus. Here, we found that nicotine administration enhances negative occasion setting in adolescents. In addition, nicotine increased the amount of orienting behavior directed toward the inhibitory stimulus, suggesting that improvements in this form of behavioral inhibition may be attributed to nicotine-induced increases in attentional processing. These results may help elucidate the factors that contribute to the onset as well as continued use of products containing nicotine during adolescence and provide insight to increase the effectiveness of interventions targeted at reducing the prevalence of adolescent smoking.

The contribution of medial prefrontal cortical regions to conditioned inhibition

Few studies have considered the process by which individuals learn to omit a response, which is an essential aspect of adaptive behavior. Several lines of evidence indicate that two regions of the medial prefrontal cortex have disparate roles in behavioral flexibility. In particular, the prelimbic cortex (PL) is thought to facilitate the generation of a strategy to inhibit a prepotent response, whereas the infralimbic cortex (IL) appears to be more important for maintaining extensively trained inhibitory behaviors. The present experiments were designed to elucidate the contributions of PL and IL to the acquisition and maintenance of Pavlovian conditioned inhibition. In Experiment 1, damage to PL before training in a compound feature negative discrimination task impaired inhibitory learning. By comparison, lesions of IL had little effect. In Experiment 2, lesions of PL or IL occurred after overtraining, and damage to IL significantly impaired subsequent performance in the task, suggesting that this region is involved in the continued expression of Pavlovian conditioned inhibition after thorough training. PL may also be involved in maintaining inhibition, as evidenced by a marginally significant lesion-induced performance deficit. These data support the notion that PL and IL have distinguishable roles in modulating inhibition, while contributing important information about the specific role for PL in acquisition of an inhibitory response and IL in performance.

Present simple and continuous: emergence of self-regulation and contextual sophistication in adolescent decision-making

Sophisticated, intentional decision-making is a hallmark of mature, self-aware behaviour. Although neural, psychological, interpersonal, and socioeconomic elements that contribute to such adaptive, foresighted behaviour mature and/or change throughout the life-span, here we concentrate on relevant maturational processes that take place during adolescence, a period of disproportionate developmental opportunity and risk. A brief, eclectic overview is presented of recent evidence, new challenges, and current thinking on the fundamental mechanisms that mature throughout adolescence to support adaptive, self-controlled decision-making. This is followed by a proposal for the putative contribution of frontostriatal mechanisms to the moment-to-moment assembly of evaluative heuristics that mediate increased decision-making sophistication, promoting the maturation of self-regulated behaviour through adolescence and young adulthood.