Enhanced avoidance learning in behaviorally inhibited young men and women

Risk avoidance and social anxiety in adolescence: Examination of event-related potentials and theta-dynamics on the Balloon Risk Avoidance Task

Adolescents are at relatively high-risk for developing anxiety, particularly social anxiety. A primary hallmark of social anxiety is the impulse to avoid situations that introduce risk. Here, we examined the neural and behavioral correlates of risk avoidance in adolescents (N=59) 11 to 19 years of age. The Balloon Risk Avoidance Task was used with concurrent electroencephalography to measure event-related potentials (frontal P2; late slow-wave; N2, feedback-related negativity, FRN; posterior P3) and oscillatory dynamics (midfrontal theta, 4-7 Hz) in response to unsuccessful and successful risk avoidance conditions. Social anxiety was measured using the Social Phobia and Anxiety Inventory for Children. Results indicated that, across the whole sample, youth exhibited smaller P3, larger FRN, and larger theta responses to unsuccessful risk avoidance. Youth reporting high (compared to low) levels of social anxiety exhibited larger P2, slow-wave, and FRN responses to unsuccessful, compared to successful, risk avoidance. Further, greater social anxiety was associated with reduced theta responses to successful avoidance. Youth with higher levels of social anxiety showed smaller theta responses to both conditions compared to those with low levels of social anxiety. Taken together, the ERP-component differences and weakened theta power in socially anxious youth following unsuccessful avoidance are informative neural correlates for socially anxious youth during risk avoidance.

Weaker situations: Uncertainty reveals individual differences in learning: Implications for PTSD

Few individuals who experience trauma develop posttraumatic stress disorder (PTSD). Therefore, the identification of individual differences that signal increased risk for PTSD is important. Lissek et al. (2006) proposed using a weak rather than a strong situation to identify individual differences. A weak situation involves less-salient cues as well as some degree of uncertainty, which reveal individual differences. A strong situation involves salient cues with little uncertainty, which produce consistently strong responses. Results from fear conditioning studies that support this hypothesis are discussed briefly. This review focuses on recent findings from three learning tasks: classical eyeblink conditioning, avoidance learning, and a computer-based task. These tasks are interpreted as weaker learning situations in that they involve some degree of uncertainty. Individual differences in learning based on behavioral inhibition, which is a risk factor for PTSD, are explored. Specifically, behaviorally inhibited individuals and rodents (i.e., Wistar Kyoto rats), as well as individuals expressing PTSD symptoms, exhibit enhanced eyeblink conditioning. Behaviorally inhibited rodents also demonstrate enhanced avoidance responding (i.e., lever pressing). Both enhanced eyeblink conditioning and avoidance are most evident with schedules of partial reinforcement. Behaviorally inhibited individuals also performed better on reward and punishment trials than noninhibited controls in a probabilistic category learning task. Overall, the use of weaker situations with uncertain relationships may be more ecologically valid than learning tasks in which the aversive event occurs on every trial and may provide more sensitivity for identifying individual differences in learning for those at risk for, or expressing, PTSD symptoms.

Mechanisms Underlying Unconscious Processing and Their Alterations in Post-traumatic Stress Disorder: Neuroimaging of Zero Monetary Outcomes Contextually Framed as "No Losses" vs. "No Gains"

Although unconscious processing is a key element of mental operation, its neural correlates have not been established. Also, clinical observations suggest that unconscious processing may be involved in the pathophysiology of post-traumatic stress disorder (PTSD), but the neurobiological mechanisms underlying such impairments remain unknown. The purpose of the present study was to examine putative mechanisms underlying unconscious processing by healthy participants and to determine whether these mechanisms may be altered in PTSD patients. Twenty patients with PTSD and 27 healthy individuals were administered a validated wheel of fortune-type gambling task during functional magnetic resonance imaging (fMRI). Unconscious processing was elicited using unconscious contextual framing of the zero monetary outcomes as "no loss," "no gain" or as "neutral." Brief passive visual processing of the "no loss" vs. "no gain" contrast by healthy participants yielded bilateral frontal-, temporal- and insular cortices and striatal activations. Between-group comparison revealed smaller activity in the left anterior prefrontal-, left dorsolateral prefrontal-, right temporal- and right insular cortices and in bilateral striatum in PTSD patients with the left dorsolateral prefrontal cortex activity been more pronounced in those with greater PTSD severity. These observations implicate frontal-, temporal-, and insular cortices along with the striatum in the putative mechanisms underlying unconscious processing of the monetary outcomes. Additionally, our results support the hypothesis that PTSD is associated with primary cortical and subcortical alterations involved in the above processes and that these alterations may be related to some aspects of PTSD symptomatology.

Mnemonic discrimination is associated with individual differences in anxiety vulnerability

Increased generalization between fear-inducing stimuli (e.g., looking over the edge of a tall building) and perceptually-similar neutral stimuli (e.g., an aerial photograph) is observed in all subtypes of anxiety disorders, leading to avoidance behaviors that feed forward from the feared stimulus to other, seemingly unrelated stimuli. However, recent research suggests a much more nuanced relationship between generalization, discrimination, and behavior. This study seeks to extend current understanding by using a mnemonic discrimination task to explore the relationship between risk for anxiety and differences in mnemonic discrimination abilities. Participants self-reported trait anxiety and behavioral inhibition (a temperamental construct linked to risk for anxiety), and also completed a memory task. After incidental encoding of color photographs of neutral everyday objects, participants performed a surprise recognition task, where they categorized each test image as "old" (identical to a previously viewed image), "similar" (new but perceptually-similar to a studied image, with half the images being highly similar and the other half being less similar to the studied images), or "new" (new and perceptually-dissimilar to studied images). We found that those with high behavioral inhibition are more successful at discriminating between previously seen "old" items from highly similar items. In contrast, those with high trait anxiousness are less successful at the same kind of discrimination. Interestingly, these relationships were not apparent in low similarity items. Our data suggest that behavioral inhibition and trait anxiety may be associated with unique aspects of individual differences in mnemonic discrimination abilities.

Social inhibition and approach-avoidance tendencies towards facial expressions

This study examined how different manifestations of social inhibition (behavioral inhibition, interpersonal sensitivity, and social withdrawal) are related to automatic approach/avoidance behaviors in a social context. A sample of 115 undergraduate students and 20 adults from the general population (M_age = 24.8, SD = 11.4; 75% women) were assessed with the 15-item Social Inhibition Questionnaire (SIQ15). During a facial expression version of the Approach-Avoidance Task (AAT), participants reacted to images of emotional facial expressions (angry, happy, and neutral) or to control images (neutral objects) in portrait or landscape formats by pulling a joystick towards themselves (approach) or pushing it away from themselves (avoidance). The superordinate social inhibition construct was not associated with approach/avoidance tendencies. However, individuals high in the interpersonal sensitivity domain of social inhibition showed stronger approach tendencies for happy and neutral facial expressions compared to neutral objects, which may relate to their focus on seeking the approval of others.

Prospective intolerance of uncertainty is associated with maladaptive temporal distribution of avoidance responses: An extension of Flores, López, Vervliet, and Cobos (2018)

BACKGROUND AND OBJECTIVES

Excessive maladaptive avoidance has been claimed to be one of the mechanisms through which intolerance of uncertainty (IU) may play its causal role in the development and maintenance of several anxiety and compulsive disorders. Consistently, Flores et al. (2018) found that individuals with higher Prospective IU (P-IU), a specific IU subfactor, display excessive avoidance response repetitions in a free-operant discriminative task to avoid an aversive noise. In the present study we tested the hypothesis that P-IU not only predicts the amount of avoidance responses but also how well the temporal distribution of such responses fits the temporal distribution of threats.

METHODS

Further correlation and hierarchical regression analysis of Flores et al.'s (2018) data served to test this hypothesis. We evaluated two aspects of the temporal distribution of responses: a) for how long participants were performing the responses; b) the behavioral discrimination between threatening and safe time periods.

RESULTS

The results showed that scoring high in P-IU was positively associated with longer periods of time dedicated to avoiding and with worse behavioral discrimination between threatening and safe time periods. Hierarchical regression analyses indicated that later addition of inhibitory intolerance of uncertainty and trait anxiety did not significantly improved the explained variance.

LIMITATIONS

Our results are exclusively based on the use of a low-cost avoidance response, and the present study does not clarify the precise mechanisms that lead high P-IU people to engage in non-optimal avoidance response distribution through time.

CONCLUSIONS

These results suggest that excessive avoidance is also driven by uncertainty of threat timing and highlight the relevance of P-IU as a vulnerability factor for excessive and outspread avoidance behaviors.

A parent-report scale of behavioral inhibition: Validation and application to preschool-age children who do and do not stutter

PURPOSE

This two-part (i.e., Study 1, Study 2) study investigated behavioral inhibition (BI) in preschool-age children who do (CWS) and do not (CWNS) stutter. The purpose of Study 1 was to develop the Short Behavioral Inhibition Scale (SBIS), a parent-report scale of BI. The purpose of Study 2 was to determine, based on the SBIS, differences in BI between CWS and CWNS, and associations between BI and CWS's stuttering frequency, stuttering severity, speech-associated attitudes, and stuttering-related consequences/reactions.

METHOD

Participants in Study 1 were 225 CWS and 243 CWNS with the majority of them being included in Study 2. In Study 2, a speech sample was obtained for the calculation of stuttering frequency and severity, and the parents of a subset of CWS completed the Communication Attitude Test for Preschool and Kindergarten Children Who Stutter (Vanryckeghem & Brutten, 2007), and the Test of Childhood Stuttering Disfluency-Related Consequences Rating Scale (Gillam, Logan, & Pearson, 2009).

RESULTS

Study 1 analyses indicated that SBIS is a valid and reliable tool whose items assess a single, relatively homogeneous construct. In Study 2, CWS exhibited greater mean and extreme BI tendencies than CWNS. Also CWS with higher, compared to CWS with lower, BI presented with greater stuttering frequency, more severe stuttering, greater stuttering-related consequences, and more negative communication attitudes (for CWS older than 4 years of age).

CONCLUSION

Findings were taken to suggest that BI is associated with early childhood stuttering and that the SBIS could be included as part of a comprehensive evaluation of stuttering.

Social inhibition in population-based and cardiac patient samples: Robustness of inhibition, sensitivity and withdrawal as distinct facets

OBJECTIVE

Behavioral inhibition plays a key role in animal stress research and developmental research in children. Therefore, we examined the robustness of our multifaceted model of adult social inhibition that comprises behavioral inhibition, interpersonal sensitivity, and social withdrawal components.

METHOD

A total of 899 adults completed the 15-item Social Inhibition Questionnaire (SIQ15) and measures of emotional distress. Confirmatory Factor Analysis (CFA), reliability estimates, and correlational and second-order factor analyses were used to examine the robustness of our model.

RESULTS

CFA (RMSEA = 0.052; NFI = 0.938; CFI = 0.957) and Cronbach's α estimates ≥0.87 confirmed the robustness of our multi-facet social inhibition model based on three correlated inhibition, sensitivity, and withdrawal factors in 560 adults from the general population and in 194 undergraduate students. Inhibition, sensitivity, and withdrawal were stable over time (3-month test-retest correlations ≥ 0.78), and were closely related to the Gest Behavioral Inhibition and PID-5 Withdrawal measures in a clinical sample of 145 cardiac patients. Of note, male cardiac patients reported more inhibition and withdrawal than female patients. Across samples, social inhibition was distinctly different from negative affectivity.

CONCLUSIONS

Our 3-facet model of inhibition, sensitivity and withdrawal was robust across samples, and may promote research on adult social inhibition in population-based and clinical studies.

The multidimensional nature of adult social inhibition: Inhibition, sensitivity and withdrawal facets of the SIQ15

BACKGROUND

Social inhibition may promote emotional problems in children, but little is known about this disposition in adults. Our research builds on a theory-based model to suggest that adult social inhibition involves distinct behavioral (inhibition), cognitive (sensitivity), and affective (withdrawal) characteristics.

METHODS

A total of 1385 adults completed measures of social inhibition, emotional distress, and social stress. Factor analyses, reliability estimates and regression analyses were used to examine the robustness of our model, and the validity of the 15-item Social Inhibition Questionnaire (SIQ15).

RESULTS

In Study 1 (N = 1180; M_age 46.9 years; 52% women), factor analysis confirmed that behavioral inhibition, interpersonal sensitivity, and social withdrawal reflected distinct facets of social inhibition. Next, we developed the SIQ15 that covers these facets with 5 items each; e.g. has difficulty making contact; expects negative reactions from others; keeps others at a distance. Study 2 (N = 209; M_age 20.3 years; 77% women) showed that the SIQ15 and its 5-item Inhibition, Sensitivity and Withdrawal facet scales were internally consistent (Cronbach's α between 0.86/0.94) and stable over time (test-retest between r = 0.73/0.78). The SIQ15 facets differentially predicted related inhibition (Behavioral Inhibition Scale), rumination (Penn State Worry Questionnaire) and withdrawal (Personality Inventory for DSM-5) scores at 6 months follow-up. Younger age and having no partner were associated with more social inhibition.

LIMITATIONS

Findings are based on self-report; experimental and prospective studies are needed to further validate our inhibition model.

CONCLUSIONS

Inhibition, sensitivity, and withdrawal are distinct manifestations of adult social inhibition that can be reliably assessed with the SIQ15. Research needs to examine how this multidimensional nature of social inhibition has an effect on stress, health, and wellbeing.

Beyond Behavioral Inhibition: A Computer Avatar Task Designed to Assess Behavioral Inhibition Extends to Harm Avoidance

Personality factors such as behavioral inhibition (BI), a temperamental tendency for avoidance in the face of unfamiliar situations, have been identified as risk factors for anxiety disorders. Personality factors are generally identified through self-report inventories. However, this tendency to avoid may affect the accuracy of these self-report inventories. Previously, a computer based task was developed in which the participant guides an on-screen "avatar" through a series of onscreen events; performance on the task could accurately predict participants' BI, measured by a standard paper and pencil questionnaire (Adult Measure of Behavioral Inhibition, or AMBI). Here, we sought to replicate this finding as well as compare performance on the avatar task to another measure related to BI, the harm avoidance (HA) scale of the Tridimensional Personality Questionnaire (TPQ). The TPQ includes HA scales as well as scales assessing reward dependence (RD), novelty seeking (NS) and persistence. One hundred and one undergraduates voluntarily completed the avatar task and the paper and pencil inventories in a counter-balanced order. Scores on the avatar task were strongly correlated with BI assessed via the AMBI questionnaire, which replicates prior findings. Females exhibited higher HA scores than males, but did not differ on scores on the avatar task. There was a strong positive relationship between scores on the avatar task and HA scores. One aspect of HA, fear of uncertainty was found to moderately mediate the relationship between AMBI scores and avatar scores. NS had a strong negative relationship with scores on the avatar task, but there was no significant relationship between RD and scores on the avatar task. These findings indicate the effectiveness of the avatar task as a behavioral alternative to self-report measures to assess avoidance. In addition, the use of computer based behavioral tasks are a viable alternative to paper and pencil self-report inventories, particularly when assessing anxiety and avoidance.

Differential sensitivity to learning from positive and negative outcomes in cocaine users

BACKGROUND

Altered sensitivity to positive and negative outcomes may be linked to the maladaptive choices characteristic of substance use disorders. Few studies have determined the distinct roles that positive and negative outcomes play in stimulus-response learning in cocaine users. The purpose of the present study was to investigate sensitivity to learning from positive and negative outcomes on a probabilistic learning task in cocaine users employing human laboratory and crowdsourcing techniques.

METHODS

Individuals who reported cocaine use were recruited for a laboratory study (Experiment 1) or an online study on Amazon.com's Mechanical Turk (mTurk) (Experiment 2). All participants completed a feedback-based probabilistic learning task in which images were classified into categories (A versus B). Positive and negative outcomes were provided in a probabilistic manner on separate trials. Proportion of optimal responses and response times were recorded.

RESULTS

Active cocaine users were less sensitive to learning from positive relative to negative outcomes. These effects were consistent across image type and session in the laboratory sample. Similarly, reduced sensitivity to learning from positive outcomes was observed in cocaine users on mTurk. Control participants did not show suboptimal performance following positive or negative outcomes.

CONCLUSIONS

This study extends the limited research on feedback-based learning in drug users by demonstrating reduced sensitivity to positive outcomes in cocaine users recruited in the human laboratory and online. Future studies on the clinical significance and mechanisms underlying this bias are needed to understand its relevance as a target for intervention development.

Acquisition of Conditioning between Methamphetamine and Cues in Healthy Humans

Environmental stimuli repeatedly paired with drugs of abuse can elicit conditioned responses that are thought to promote future drug seeking. We recently showed that healthy volunteers acquired conditioned responses to auditory and visual stimuli after just two pairings with methamphetamine (MA, 20 mg, oral). This study extended these findings by systematically varying the number of drug-stimuli pairings. We expected that more pairings would result in stronger conditioning. Three groups of healthy adults were randomly assigned to receive 1, 2 or 4 pairings (Groups P1, P2 and P4, Ns = 13, 16, 16, respectively) of an auditory-visual stimulus with MA, and another stimulus with placebo (PBO). Drug-cue pairings were administered in an alternating, counterbalanced order, under double-blind conditions, during 4 hr sessions. MA produced prototypic subjective effects (mood, ratings of drug effects) and alterations in physiology (heart rate, blood pressure). Although subjects did not exhibit increased behavioral preference for, or emotional reactivity to, the MA-paired cue after conditioning, they did exhibit an increase in attentional bias (initial gaze) toward the drug-paired stimulus. Further, subjects who had four pairings reported "liking" the MA-paired cue more than the PBO cue after conditioning. Thus, the number of drug-stimulus pairings, varying from one to four, had only modest effects on the strength of conditioned responses. Further studies investigating the parameters under which drug conditioning occurs will help to identify risk factors for developing drug abuse, and provide new treatment strategies.

The Personality Trait of Intolerance to Uncertainty Affects Behavior in a Novel Computer-Based Conditioned Place Preference Task

Recent work has found that personality factors that confer vulnerability to addiction can also affect learning and economic decision making. One personality trait which has been implicated in vulnerability to addiction is intolerance to uncertainty (IU), i.e., a preference for familiar over unknown (possibly better) options. In animals, the motivation to obtain drugs is often assessed through conditioned place preference (CPP), which compares preference for contexts where drug reward was previously received. It is an open question whether participants with high IU also show heightened preference for previously rewarded contexts. To address this question, we developed a novel computer-based CPP task for humans in which participants guide an avatar through a paradigm in which one room contains frequent reward (i.e., rich) and one contains less frequent reward (i.e., poor). Following exposure to both contexts, subjects are assessed for preference to enter the previously rich and previously poor room. Individuals with low IU showed little bias to enter the previously rich room first, and instead entered both rooms at about the same rate which may indicate a foraging behavior. By contrast, those with high IU showed a strong bias to enter the previously rich room first. This suggests an increased tendency to chase reward in the intolerant group, consistent with previously observed behavior in opioid-addicted individuals. Thus, the personality factor of high IU may produce a pre-existing cognitive bias that provides a mechanism to promote decision-making processes that increase vulnerability to addiction.

Extinction of Conditioned Responses to Methamphetamine-Associated Stimuli in Healthy Humans

RATIONALE

Contextual stimuli present during drug experiences become associated with the drug through Pavlovian conditioning and are thought to sustain drug-seeking behavior. Thus, extinction of conditioned responses is an important target for treatment. To date, acquisition and extinction to drug-paired cues have been studied in animal models or drug-dependent individuals, but rarely in non-drug users.

OBJECTIVE

We have recently developed a procedure to study acquisition of conditioned responses after single doses of methamphetamine (MA) in healthy volunteers. Here, we examined extinction of these responses and their persistence after conditioning.

METHODS

Healthy adults (18-35 years; N = 20) received two pairings of audio-visual stimuli with MA (20 mg oral) or placebo. Responses to stimuli were assessed before and after conditioning, using three tasks: behavioral preference, attentional bias, and subjective "liking."

RESULTS

Subjects exhibited behavioral preference for the drug-paired stimuli at the first post-conditioning test, but this declined rapidly on subsequent extinction tests. They also exhibited a bias to initially look towards the drug-paired stimuli at the first post-test session, but not thereafter. Subjects who experienced more positive subjective drug effects during conditioning exhibited a smaller decline in preference during the extinction phase. Further, longer inter-session intervals during the extinction phase were associated with less extinction of the behavioral preference measure.

CONCLUSIONS

Conditioned responses after two pairings with MA extinguish quickly, and are influenced by both subjective drug effects and the extinction interval. Characterizing and refining this conditioning procedure will aid in understanding the acquisition and extinction processes of drug-related conditioned responses in humans.

The personality trait of behavioral inhibition modulates perceptions of moral character and performance during the trust game: behavioral results and computational modeling

Decisions based on trust are critical for human social interaction. We judge the trustworthiness of partners in social interactions based on a number of partner characteristics as well as experiences with those partners. These decisions are also influenced by personality. The current study examined how the personality trait of behavioral inhibition, which involves the tendency to avoid or withdraw from novelty in both social and non-social situations, is related to explicit ratings of trustworthiness as well as decisions made in the trust game. In the game, healthy young adults interacted with three fictional partners who were portrayed as trustworthy, untrustworthy or neutral through biographical information. Participants could choose to keep $1 or send $3 of virtual money to a partner. The partner could then choose to send $1.5 back to the participant or to keep the entire amount. On any trial in which the participant chose to send, the partner always reciprocated with 50% probability, irrespective of how that partner was portrayed in the biography. Behavioral inhibition was assessed through a self-report questionnaire. Finally, a reinforcement learning computational model was fit to the behavior of each participant. Self-reported ratings of trust confirmed that all participants, irrespective of behavioral inhibition, perceived differences in the moral character of the three partners (trustworthiness of good > neutral > bad partner). Decisions made in the game showed that inhibited participants tended to trust the neutral partner less than uninhibited participants. In contrast, this was not reflected in the ratings of the neutral partner (either pre- or post-game), indicating a dissociation between ratings of trustworthiness and decisions made by inhibited participants. Computational modeling showed that this was due to lower initial trust of the neutral partner rather than a higher learning rate associated with loss, suggesting an implicit bias against the neutral partner. Overall, the results suggest inhibited individuals may be predisposed to interpret neutral or ambiguous information more negatively which could, at least in part, account for the tendency to avoid unfamiliar people characteristic of behaviorally inhibited temperament, as well as its relationship to anxiety disorders.

Watch what I do, not what I say I do: Computer-based avatars to assess behavioral inhibition, a vulnerability factor for anxiety disorders

Behavioral inhibition (BI), a tendency to withdraw from or avoid novel social and non-social situations, is a personality trait which can confer risk for anxiety disorders. Like many personality traits, BI is often assessed via self-report questionnaires where respondents rate themselves for frequency of certain behaviors or feelings. However, questionnaires have inherent limitations, particularly in psychiatric populations where there may be unawareness of deficit. A viable alternative may be virtual environments, in which the participant guides an on-screen "avatar" through a series of onscreen events meant to simulate real-world situations. Here, we report on initial development of such an assessment tool, involving several onscreen scenarios with choice points where the participant can select from response options corresponding to inhibited or uninhibited behaviors. In two experiments involving over 300 college students, scores on the computer-based task were strongly correlated with BI scores attained through self-report questionnaire (r>.780, p<.001); this relationship held regardless of participant gender and experience with computer games. The results suggest that virtual environments may hold promise as alternative formats for assessment of personality traits in populations unsuited to traditional paper-and-pencil questionnaire formats due to psychopathology, limited attention span, or poor vocabulary and/or literacy skills.

The Role of Informative and Ambiguous Feedback in Avoidance Behavior: Empirical and Computational Findings

Avoidance behavior is a critical component of many psychiatric disorders, and as such, it is important to understand how avoidance behavior arises, and whether it can be modified. In this study, we used empirical and computational methods to assess the role of informational feedback and ambiguous outcome in avoidance behavior. We adapted a computer-based probabilistic classification learning task, which includes positive, negative and no-feedback outcomes; the latter outcome is ambiguous as it might signal either a successful outcome (missed punishment) or a failure (missed reward). Prior work with this task suggested that most healthy subjects viewed the no-feedback outcome as strongly positive. Interestingly, in a later version of the classification task, when healthy subjects were allowed to opt out of (i.e. avoid) responding, some subjects (“avoiders”) reliably avoided trials where there was a risk of punishment, but other subjects (“non-avoiders”) never made any avoidance responses at all. One possible interpretation is that the “non-avoiders” valued the no-feedback outcome so positively on punishment-based trials that they had little incentive to avoid. Another possible interpretation is that the outcome of an avoided trial is unspecified and that lack of information is aversive, decreasing subjects’ tendency to avoid. To examine these ideas, we here tested healthy young adults on versions of the task where avoidance responses either did or did not generate informational feedback about the optimal response. Results showed that provision of informational feedback decreased avoidance responses and also decreased categorization performance, without significantly affecting the percentage of subjects classified as “avoiders.” To better understand these results, we used a modified Q-learning model to fit individual subject data. Simulation results suggest that subjects in the feedback condition adjusted their behavior faster following better-than-expected outcomes, compared to subjects in the no-feedback condition. Additionally, in both task conditions, “avoiders” adjusted their behavior faster following worse-than-expected outcomes, and treated the ambiguous no-feedback outcome as less rewarding, compared to non-avoiders. Together, results shed light on the important role of ambiguous and informative feedback in avoidance behavior.

Probabilistic reward- and punishment-based learning in opioid addiction: Experimental and computational data

Addiction is the continuation of a habit in spite of negative consequences. A vast literature gives evidence that this poor decision-making behavior in individuals addicted to drugs also generalizes to laboratory decision making tasks, suggesting that the impairment in decision-making is not limited to decisions about taking drugs. In the current experiment, opioid-addicted individuals and matched controls with no history of illicit drug use were administered a probabilistic classification task that embeds both reward-based and punishment-based learning trials, and a computational model of decision making was applied to understand the mechanisms describing individuals' performance on the task. Although behavioral results showed that opioid-addicted individuals performed as well as controls on both reward- and punishment-based learning, the modeling results suggested subtle differences in how decisions were made between the two groups. Specifically, the opioid-addicted group showed decreased tendency to repeat prior responses, meaning that they were more likely to "chase reward" when expectancies were violated, whereas controls were more likely to stick with a previously-successful response rule, despite occasional expectancy violations. This tendency to chase short-term reward, potentially at the expense of developing rules that maximize reward over the long term, may be a contributing factor to opioid addiction. Further work is indicated to better understand whether this tendency arises as a result of brain changes in the wake of continued opioid use/abuse, or might be a pre-existing factor that may contribute to risk for addiction.

The influence of trial order on learning from reward vs. punishment in a probabilistic categorization task: experimental and computational analyses

Previous research has shown that trial ordering affects cognitive performance, but this has not been tested using category-learning tasks that differentiate learning from reward and punishment. Here, we tested two groups of healthy young adults using a probabilistic category learning task of reward and punishment in which there are two types of trials (reward, punishment) and three possible outcomes: (1) positive feedback for correct responses in reward trials; (2) negative feedback for incorrect responses in punishment trials; and (3) no feedback for incorrect answers in reward trials and correct answers in punishment trials. Hence, trials without feedback are ambiguous, and may represent either successful avoidance of punishment or failure to obtain reward. In Experiment 1, the first group of subjects received an intermixed task in which reward and punishment trials were presented in the same block, as a standard baseline task. In Experiment 2, a second group completed the separated task, in which reward and punishment trials were presented in separate blocks. Additionally, in order to understand the mechanisms underlying performance in the experimental conditions, we fit individual data using a Q-learning model. Results from Experiment 1 show that subjects who completed the intermixed task paradoxically valued the no-feedback outcome as a reinforcer when it occurred on reinforcement-based trials, and as a punisher when it occurred on punishment-based trials. This is supported by patterns of empirical responding, where subjects showed more win-stay behavior following an explicit reward than following an omission of punishment, and more lose-shift behavior following an explicit punisher than following an omission of reward. In Experiment 2, results showed similar performance whether subjects received reward-based or punishment-based trials first. However, when the Q-learning model was applied to these data, there were differences between subjects in the reward-first and punishment-first conditions on the relative weighting of neutral feedback. Specifically, early training on reward-based trials led to omission of reward being treated as similar to punishment, but prior training on punishment-based trials led to omission of reward being treated more neutrally. This suggests that early training on one type of trials, specifically reward-based trials, can create a bias in how neutral feedback is processed, relative to those receiving early punishment-based training or training that mixes positive and negative outcomes.

Testing the role of reward and punishment sensitivity in avoidance behavior: a computational modeling approach

Exaggerated avoidance behavior is a predominant symptom in all anxiety disorders and its degree often parallels the development and persistence of these conditions. Both human and non-human animal studies suggest that individual differences as well as various contextual cues may impact avoidance behavior. Specifically, we have recently shown that female sex and inhibited temperament, two anxiety vulnerability factors, are associated with greater duration and rate of the avoidance behavior, as demonstrated on a computer-based task closely related to common rodent avoidance paradigms. We have also demonstrated that avoidance is attenuated by the administration of explicit visual signals during "non-threat" periods (i.e., safety signals). Here, we use a reinforcement-learning network model to investigate the underlying mechanisms of these empirical findings, with a special focus on distinct reward and punishment sensitivities. Model simulations suggest that sex and inhibited temperament are associated with specific aspects of these sensitivities. Specifically, differences in relative sensitivity to reward and punishment might underlie the longer avoidance duration demonstrated by females, whereas higher sensitivity to punishment might underlie the higher avoidance rate demonstrated by inhibited individuals. Simulations also suggest that safety signals attenuate avoidance behavior by strengthening the competing approach response. Lastly, several predictions generated by the model suggest that extinction-based cognitive-behavioral therapies might benefit from the use of safety signals, especially if given to individuals with high reward sensitivity and during longer safe periods. Overall, this study is the first to suggest cognitive mechanisms underlying the greater avoidance behavior observed in healthy individuals with different anxiety vulnerabilities.

Acquisition and extinction of human avoidance behavior: attenuating effect of safety signals and associations with anxiety vulnerabilities

While avoidance behavior is often an adaptive strategy, exaggerated avoidance can be detrimental and result in the development of psychopathologies, such as anxiety disorders. A large animal literature shows that the acquisition and extinction of avoidance behavior in rodents depends on individual differences (e.g., sex, strain) and might be modulated by the presence of environmental cues. However, there is a dearth of such reports in human literature, mainly due to the lack of adequate experimental paradigms. In the current study, we employed a computer-based task, where participants control a spaceship and attempt to gain points by shooting an enemy spaceship that appears on the screen. Warning signals predict on-screen aversive events; the participants can learn a protective response to escape or avoid these events. This task has been recently used to reveal facilitated acquisition of avoidance behavior in individuals with anxiety vulnerability due to female sex or inhibited personality. Here, we extended the task to include an extinction phase, and tested the effect of signals that appeared during “safe” periods. Healthy young adults (n = 122) were randomly assigned to a testing condition with or without such signals. Results showed that the addition of safety signals during the acquisition phase impaired acquisition (in females) and facilitated extinction of the avoidance behavior. We also replicated our recent finding of an association between female sex and longer avoidance duration and further showed that females continued to demonstrate more avoidance behavior even on extinction trials when the aversive events no longer occurred. This study is the first to show sex differences on the acquisition and extinction of human avoidance behavior and to demonstrate the role of safety signals in such behavior, highlighting the potential relevance of safety signals for cognitive therapies that focus on extinction learning to treat anxiety symptoms.

Behaviourally inhibited temperament and female sex, two vulnerability factors for anxiety disorders, facilitate conditioned avoidance (also) in humans

Acquisition and maintenance of avoidance behaviour is a key feature of all human anxiety disorders. Animal models have been useful in understanding how anxiety vulnerability could translate into avoidance learning. For example, behaviourally inhibited temperament and female sex, two vulnerability factors for clinical anxiety, are associated with faster acquisition of avoidance responses in rodents. However, to date, the translation of such empirical data to human populations has been limited since many features of animal avoidance paradigms are not typically captured in human research. Here, using a computer-based task that captures many features of rodent escape-avoidance learning paradigms, we investigated whether avoidance learning would be faster in humans with inhibited temperament and/or female sex and, if so, whether this facilitation would take the same form. Results showed that, as in rats, both vulnerability factors were associated with facilitated acquisition of avoidance behaviour in humans. Specifically, inhibited temperament was associated with higher rate of avoidance responding, while female sex was associated with longer avoidance duration. These findings strengthen the direct link between animal avoidance work and human anxiety vulnerability, further motivating the study of animal models while also providing a simple testbed for a direct human testing.

Learning to obtain reward, but not avoid punishment, is affected by presence of PTSD symptoms in male veterans: empirical data and computational model

Post-traumatic stress disorder (PTSD) symptoms include behavioral avoidance which is acquired and tends to increase with time. This avoidance may represent a general learning bias; indeed, individuals with PTSD are often faster than controls on acquiring conditioned responses based on physiologically-aversive feedback. However, it is not clear whether this learning bias extends to cognitive feedback, or to learning from both reward and punishment. Here, male veterans with self-reported current, severe PTSD symptoms (PTSS group) or with few or no PTSD symptoms (control group) completed a probabilistic classification task that included both reward-based and punishment-based trials, where feedback could take the form of reward, punishment, or an ambiguous “no-feedback” outcome that could signal either successful avoidance of punishment or failure to obtain reward. The PTSS group outperformed the control group in total points obtained; the PTSS group specifically performed better than the control group on reward-based trials, with no difference on punishment-based trials. To better understand possible mechanisms underlying observed performance, we used a reinforcement learning model of the task, and applied maximum likelihood estimation techniques to derive estimated parameters describing individual participants’ behavior. Estimations of the reinforcement value of the no-feedback outcome were significantly greater in the control group than the PTSS group, suggesting that the control group was more likely to value this outcome as positively reinforcing (i.e., signaling successful avoidance of punishment). This is consistent with the control group’s generally poorer performance on reward trials, where reward feedback was to be obtained in preference to the no-feedback outcome. Differences in the interpretation of ambiguous feedback may contribute to the facilitated reinforcement learning often observed in PTSD patients, and may in turn provide new insight into how pathological behaviors are acquired and maintained in PTSD.

Facilitated acquisition of eyeblink conditioning in those vulnerable to anxiety disorders

Behavioral inhibition (BI) increases vulnerability to develop anxiety disorders and is typified by avoidance and withdrawal from novel objects, people, and situations. The present study considered the relationship between BI and temperamental risk factors, such as trait anxiety and acquisition rate of a classically conditioned eyeblink response. One-hundred seventy-four healthy undergraduate students (mean age 20.3 years, 71.8% female) were given the State-Trait Anxiety Inventory and a battery of self-report measures of BI consisting of the Adult and Retrospective Measures of Behavioral Inhibition (AMBI/RMBI) and the Concurrent and Retrospective Self Report of Inhibition (CSRI/RSRI). Participants then underwent standard delay classical eyeblink conditioning consisting of 45 trials with a 500-ms CS overlapping and co-terminating with a 10-ms airpuff US. Individuals with higher scores on the AMBI and Trait Anxiety Inventory, but not the other measures, showed faster acquisition of a conditioned eyeblink response than individuals with lower scores. Results support a relationship between facilitated acquisition of inter-stimulus relationships and risk for anxiety, and suggest that some measures assessing anxiety vulnerability better capture this relationship than others.