Dataset of active avoidance in Wistar-Kyoto and Sprague Dawley rats: Experimental data and reinforcement learning model code and output

Data were collected from 40 Wistar-Kyoto (WKY) and 40 Sprague Dawley (SD) rats during an active escape-avoidance experiment. Footshock could be avoided by pressing a lever during a danger period prior to onset of shock. If avoidance did not occur, a series of footshocks was administered, and the rat could press a lever to escape (terminate shocks). For each animal, data were simplified to the presence or absence of lever press and stimuli in each 12-second time frame. Using the pre-processed dataset, a reinforcement learning (RL) model, based on an actor-critic architecture, was utilized to estimate several different model parameters that best characterized each rat's behaviour during the experiment. Once individual model parameters were determined for all 80 rats, behavioural recovery simulations were run using the RL model with each animal's "best-fit" parameters; the simulated behaviour generated avoidance data (percent of trials avoided during a given experimental session) that could be compared across simulated rats, as is customarily done with empirical data. The datasets representing both the experimental data and the model-generated data can be interpreted in various ways to gain further insight into rat behaviour during avoidance and escape learning. Furthermore, the estimated parameters for each individual rat can be compared across groups. Thus, possible between-strain differences in model parameters can be detected, which might provide insights into strain differences in learning. The software implementing the RL model can also be applied to or serve as a template for other experiments involving acquisition learning. Reference for Co-Submission: K.M. Spiegler, J. Palmieri, K.C.H. Pang, C.E. Myers, A reinforcement-learning model of active avoidance behavior: Differences between Sprague-Dawley and Wistar-Kyoto rats. Behav. Brain Res. (2020 Jun 22[epub ahead of print])  doi: 10.1016/j.bbr.2020.112784.

A reinforcement-learning model of active avoidance behavior: Differences between Sprague Dawley and Wistar-Kyoto rats

Avoidance behavior is a typically adaptive response performed by an organism to avert harmful situations. Individuals differ remarkably in their tendency to acquire and perform new avoidance behaviors, as seen in anxiety disorders where avoidance becomes pervasive and inappropriate. In rodent models of avoidance, the inbred Wistar-Kyoto (WKY) rat demonstrates increased learning and expression of avoidance compared to the outbred Sprague Dawley (SD) rat. However, underlying mechanisms that contribute to these differences are unclear. Computational modeling techniques can help identify factors that may not be easily decipherable from behavioral data alone. Here, we utilize a reinforcement learning (RL) model approach to better understand strain differences in avoidance behavior. An actor-critic model, with separate learning rates for action selection (in the actor) and state evaluation (in the critic), was applied to individual data of avoidance acquisition from a large cohort of WKY and SD rats. Latent parameters were extracted, such as learning rate and subjective reinforcement value of foot shock, that were then compared across groups. The RL model was able to accurately represent WKY and SD avoidance behavior, demonstrating that the model could simulate individual performance. The model determined that the perceived negative value of foot shock was significantly higher in WKY than SD rats, whereas learning rate in the actor was lower in WKY than SD rats. These findings demonstrate the utility of computational modeling in identifying underlying processes that could promote strain differences in behavioral performance.

Circulating Agonist Autoantibody to 5-Hydroxytryptamine 2A Receptor in Lean and Diabetic Fatty Zucker Rat Strains

AIMS

Circulating neurotoxic autoantibodies to the 5-hydroxytryptamine 2A receptor were increased in older adult type 2 diabetes in association with certain neurodegenerative complications. The male Zucker diabetic fatty (ZDF) rat is a model system for studies of obese, type 2 diabetes mellitus. The aim of the current study was to test for (and compare) circulating neurotoxic autoantibodies to the 5-hydroxytryptamine 2A receptor in the Zucker diabetic fatty rat and age-matched lean Zucker rat strains.

METHODS

Plasma from lean and Zucker diabetic fatty rat (obtained at different developmental stages) was subjected to protein G affinity chromatography. The resulting immunoglobulin G fraction was tested for neurotoxicity (acute neurite retraction, accelerated neuron loss) in N2A mouse neuroblastoma cells and for binding to a linear synthetic peptide corresponding to the second extracellular loop of the 5-hydroxytryptamine 2A receptor.

RESULTS

The male Zucker diabetic fatty rat (fa/fa) and two Zucker lean strains (+/?) and (fa/+) harbored autoantibodies to the 5-hydroxytryptamine 2A receptor which appeared spontaneously around 7-8.5 weeks of age. The circulating autoantibodies persisted until at least 25 weeks of age in the Zucker diabetic fatty rat and in the Zucker heterozygote (fa/+), but were no longer detectable in 25-week-old lean (+/?) Zucker rats. Autoantibody-induced acute neurite retraction and accelerated loss in mouse neuroblastoma N2A cells was dose-dependently prevented by selective antagonists of the 5-hydroxytryptamine 2A receptor. It was also substantially prevented by co-incubation with antagonists of RhoA/Rho kinase-mediated signaling (Y27632) or Gq11/phospholipase C/inositol triphosphate receptor-coupled signaling.

CONCLUSIONS

These data suggest that neurotoxic 5-hydroxytryptamine 2A receptor-targeting autoantibodies increase in the aging male Zucker diabetic fatty rat and in male Zucker lean rats harboring a heterozygous mutation, but not in age-matched, older Zucker lean rats lacking a known leptin receptor mutation. The Zucker genetic strain may be useful in studies of the role of humoral and/or innate immunity in late neurodegeneration.

Distinct cellular mediators drive the Janus faces of toll-like receptor 4 regulation of network excitability which impacts working memory performance after brain injury

The mechanisms by which the neurophysiological and inflammatory responses to brain injury contribute to memory impairments are not fully understood. Recently, we reported that the innate immune receptor, toll-like receptor 4 (TLR4) enhances AMPA receptor (AMPAR) currents and excitability in the dentate gyrus after fluid percussion brain injury (FPI) while limiting excitability in controls. Here, we examine the cellular mediators underlying TLR4 regulation of dentate excitability and its impact on memory performance. In ex vivo slices, astrocytic and microglial metabolic inhibitors selectively abolished TLR4 antagonist modulation of excitability in controls, but not in rats after FPI, demonstrating that glial signaling contributes to TLR4 regulation of excitability in controls. In glia-depleted neuronal cultures from naïve mice, TLR4 ligands bidirectionally modulated AMPAR charge transfer consistent with neuronal TLR4 regulation of excitability, as observed after brain injury. In vivo TLR4 antagonism reduced early post-injury increases in mediators of MyD88-dependent and independent TLR4 signaling without altering expression in controls. Blocking TNFα, a downstream effector of TLR4, mimicked effects of TLR4 antagonist and occluded TLR4 agonist modulation of excitability in slices from both control and FPI rats. Functionally, transiently blocking TLR4 in vivo improved impairments in working memory observed one week and one month after FPI, while the same treatment impaired memory function in uninjured controls. Together these data identify that distinct cellular signaling mechanisms converge on TNFα to mediate TLR4 modulation of network excitability in the uninjured and injured brain and demonstrate a role for TLR4 in regulation of working memory function.

Biological links between traumatic brain injury and Parkinson's disease

Parkinson's Disease (PD) is a progressive neurodegenerative disorder with no cure. Clinical presentation is characterized by postural instability, resting tremors, and gait problems that result from progressive loss of A9 dopaminergic neurons in the substantia nigra pars compacta. Traumatic brain injury (TBI) has been implicated as a risk factor for several neurodegenerative diseases, but the strongest evidence is linked to development of PD. Mild TBI (mTBI), is the most common and is defined by minimal, if any, loss of consciousness and the absence of significant observable damage to the brain tissue. mTBI is responsible for a 56% higher risk of developing PD in U.S. Veterans and the risk increases with severity of injury. While the mounting evidence from human studies suggests a link between TBI and PD, fundamental questions as to whether TBI nucleates PD pathology or accelerates PD pathology in vulnerable populations remains unanswered. Several promising lines of research point to inflammation, metabolic dysregulation, and protein accumulation as potential mechanisms through which TBI can initiate or accelerate PD. Amyloid precursor protein (APP), alpha synuclein (α-syn), hyper-phosphorylated Tau, and TAR DNA-binding protein 43 (TDP-43), are some of the most frequently reported proteins upregulated following a TBI and are also closely linked to PD. Recently, upregulation of Leucine Rich Repeat Kinase 2 (LRRK2), has been found in the brain of mice following a TBI. Subset of Rab proteins were identified as biological substrates of LRRK2, a protein also extensively linked to late onset PD. Inhibition of LRRK2 was found to be neuroprotective in PD and TBI models. The goal of this review is to survey current literature concerning the mechanistic overlap between TBI and PD with a particular focus on inflammation, metabolic dysregulation, and aforementioned proteins. This review will also cover the application of rodent TBI models to further our understanding of the relationship between TBI and PD.

Anhedonia following mild traumatic brain injury in rats: A behavioral economic analysis of positive and negative reinforcement

Psychiatric disorders affect nearly 50% of individuals who have experienced a traumatic brain injury (TBI). Anhedonia is a major symptom of numerous psychiatric disorders and is a diagnostic criterion for depression. It has recently been appreciated that reinforcement may be separated into consummatory (hedonic), motivational and decisional components, all of which may be affected differently in disease. Although anhedonia is typically assessed using positive reinforcement, the importance of stress in psychopathology suggests the study of negative reinforcement (removal or avoidance of aversive events) may be equally important. The present study investigated positive and negative reinforcement following a rat model of mild TBI (mTBI) using lateral fluid percussion. Hedonic value and motivation for reinforcement was determined by behavioral economic analyses. Following mTBI, the hedonic value of avoiding foot shock was reduced. In contrast, the hedonic value of escaping foot shock or obtaining a sucrose pellet was not altered by mTBI. Moreover, motivation to avoid or escape foot shock or to acquire sucrose was not altered by mTBI. Our results suggest that individuals experiencing mTBI find avoidance of aversive events less reinforcing, and therefore are less apt to utilize proactive control of stress.

Inhibited Personality Temperaments Translated Through Enhanced Avoidance and Associative Learning Increase Vulnerability for PTSD

Although many individuals who experience a trauma go on to develop post-traumatic stress disorder (PTSD), the rate of PTSD following trauma is only about 15-24%. There must be some pre-existing conditions that impart increased vulnerability to some individuals and not others. Diathesis models of PTSD theorize that pre-existing vulnerabilities interact with traumatic experiences to produce psychopathology. Recent work has indicated that personality factors such as behavioral inhibition (BI), harm avoidance (HA), and distressed (Type D) personality are vulnerability factors for the development of PTSD and anxiety disorders. These personality temperaments produce enhanced acquisition or maintenance of associations, especially avoidance, which is a criterion symptom of PTSD. In this review, we highlight the evidence for a relationship between these personality types and enhanced avoidance and associative learning, which may increase risk for the development of PTSD. First, we provide the evidence confirming a relationship among BI, HA, distressed (Type D) personality, and PTSD. Second, we present recent findings that BI is associated with enhanced avoidance learning in both humans and animal models. Third, we will review evidence that BI is also associated with enhanced eyeblink conditioning in both humans and animal models. Overall, data from both humans and animals suggest that these personality traits promote enhanced avoidance and associative learning, as well as slowing of extinction in some training protocols, which all support the learning diathesis model. These findings of enhanced learning in vulnerable individuals can be used to develop objective behavioral measures to pre-identify individuals who are more at risk for development of PTSD following traumatic events, allowing for early (possibly preventative) intervention, as well as suggesting possible therapies for PTSD targeted on remediating avoidance or associative learning. Future work should explore the neural substrates of enhanced avoidance and associative learning for behaviorally inhibited individuals in both the animal model and human participants.

Experimental traumatic brain injury results in estrous cycle disruption, neurobehavioral deficits, and impaired GSK3β/β-catenin signaling in female rats

An estimated 2.8 million traumatic brain injuries (TBI) occur within the United States each year. Approximately 40% of new TBI cases are female, however few studies have investigated the effects of TBI on female subjects. In addition to typical neurobehavioral sequelae observed after TBI, such as poor cognition, impaired behavior, and somatic symptoms, women with TBI report amenorrhea or irregular menstrual cycles suggestive of disruptions in the hypothalamic-pituitary-gonadal (HPG) axis. HPG dysfunction following TBI has been linked to poor functional outcome in men and women, but the mechanisms by which this may occur or relate to behavior has not been fully developed or ascertained. The present study determined if TBI resulted in HPG axis perturbations in young adult female Sprague Dawley rats, and whether TBI was associated with cognitive and sensorimotor deficits. Following lateral fluid percussion injury, injured females spent significantly more time in diestrus compared to sham females, consistent with a persistent low sex-steroid hormone state. Injured females displayed significantly reduced 17β-estradiol (E2) and luteinizing hormone levels. Concomitantly, injured females were impaired in spatial working memory compared to shams. Impaired GSK3β/β-catenin signaling related to synaptic changes was evident one-week post-injury in the hippocampus among injured females compared to sham females, and this impairment paralleled the deficits in spatial working memory. Sensorimotor function, as evidenced by suppression of the acoustic startle response, was chronically impaired even after normal estrous cycling resumed. These data demonstrate that TBI results in estrous cycle impairments, memory dysfunction, and perturbations in GSK3β/β-catenin signaling, suggesting a potential mechanism for HPG-mediated cognitive impairment following TBI.

Differential use of danger and safety signals in an animal model of anxiety vulnerability: The behavioral economics of avoidance

Differential processing of danger and safety signals may underlie symptoms of anxiety disorders and posttraumatic stress disorder. One symptom common to these disorders is pathological avoidance. The present study examined whether danger and safety signals influence avoidance differently in anxiety-vulnerable Wistar-Kyoto (WKY) rats and Sprague Dawley (SD) rats. SD and WKY rats were tested in a novel progressive ratio avoidance task with and without danger or safety signals. Two components of reinforcement, hedonic value and motivation, were determined by fitting an exponentiated demand equation to the data. Hedonic value of avoidance did not differ between SD and WKY rats, but WKY rats had greater motivation to avoid than SD rats. Removal of the safety signal reduced motivation to avoid in SD, but not WKY, rats. Removal of the danger signal did not alter avoidance in either strain. When danger and safety signals were presented simultaneously, WKY rats responded to the danger signals, whereas SD rats responded to the safety signal. The results provide evidence that 1) safety signals enhance motivation to avoid in SD rats, 2) both danger and safety signals influence motivation in WKY rats, and 3) danger signals take precedence over safety signals when presented simultaneously in WKY rats. Thus, anxiety vulnerability is associated with preferential use of danger signals to motivate avoidance. The differential use of danger and safety signals has important implications for the etiology and treatment of pathological avoidance in anxiety disorders and posttraumatic stress disorder.

Corrigendum: Use of the Exponential and Exponentiated Demand Equations to Assess the Behavioral Economics of Negative Reinforcement

[This corrects the article on p. 77 in vol. 11, PMID: 28270744.].

Startle suppression after mild traumatic brain injury is associated with an increase in pro-inflammatory cytokines, reactive gliosis and neuronal loss in the caudal pontine reticular nucleus

Mild traumatic brain injury (mTBI) can produce somatic symptoms such as headache, dizziness, fatigue, sleep disturbances and sensorimotor dysfunction. Sensorimotor function can be measured by tests such as the acoustic startle reflex (ASR), an evolutionarily conserved defensive response to a brief yet sharp acoustic stimulus. mTBI produces a long-lasting suppression of ASR in rodents and humans; however, the mechanism of this suppression is unknown. The present study examined whether inflammatory processes in the brainstem (particularly the caudal pontine reticular nucleus, PnC) could account for the suppression of ASR after mTBI, because the PnC is an essential nucleus of the ASR circuit. Furthermore, while inflammation after mTBI is commonly observed in brain regions proximal to the site of impact (cortex and hippocampus), the effects of mTBI in brainstem structures remains largely understudied. The present study demonstrated a suppression of ASR one day after injury and lasting at least three weeks after an mTBI, replicating previous findings. Within the PnC, transient elevations of IL-1β and TNF-α mRNA were observed at one day after injury, while IL-1α mRNA exhibited a delayed increase at three weeks after injury. Reactive gliosis (via IBA-1-ir for microglia and GFAP-ir for astrocytes) were also observed in the PnC, at one day and seven days after injury, respectively. Finally, the number of giant neurons (the major functional cell population in the PnC) was decreased three weeks after injury. The results indicate that glial activation precedes neuronal loss in the PnC, and correlates with the behavioral suppression of the ASR. The results also raise implications for brainstem involvement in the development of post-traumatic symptoms.

Use of the Exponential and Exponentiated Demand Equations to Assess the Behavioral Economics of Negative Reinforcement

Abnormal motivation and hedonic assessment of aversive stimuli are symptoms of anxiety and depression. Symptoms influenced by motivation and anhedonia predict treatment success or resistance. Therefore, a translational approach to the study of negatively motivated behaviors is needed. We describe a novel use of behavioral economics demand curve analysis to investigate negative reinforcement in animals that separates hedonic assessment of footshock termination (i.e., relief) from motivation to escape footshock. In outbred Sprague Dawley (SD) rats, relief increased as shock intensity increased. Likewise, motivation to escape footshock increased as shock intensity increased. To demonstrate the applicability to anxiety disorders, hedonic and motivational components of negative reinforcement were investigated in anxiety vulnerable Wistar Kyoto (WKY) rats. WKY rats demonstrated increased motivation for shock cessation with no difference in relief as compared to control SD rats, consistent with a negative bias for motivation in anxiety vulnerability. Moreover, motivation was positively correlated with relief in SD, but not in WKY. This study is the first to assess the hedonic and motivational components of negative reinforcement using behavioral economic analysis. This procedure can be used to investigate positive and negative reinforcement in humans and animals to gain a better understanding of the importance of motivated behavior in stress-related disorders.

Brain and Serum Androsterone Is Elevated in Response to Stress in Rats with Mild Traumatic Brain Injury

Exposure to lateral fluid percussion (LFP) injury consistent with mild traumatic brain injury (mTBI) persistently attenuates acoustic startle responses (ASRs) in rats. Here, we examined whether the experience of head trauma affects stress reactivity. Male Sprague-Dawley rats were matched for ASRs and randomly assigned to receive mTBI through LFP or experience a sham surgery (SHAM). ASRs were measured post injury days (PIDs) 1, 3, 7, 14, 21, and 28. To assess neurosteroids, rats received a single 2.0 mA, 0.5 s foot shock on PID 34 (S34), PID 35 (S35), on both days (2S), or the experimental context (CON). Levels of the neurosteroids pregnenolone (PREG), allopregnanolone (ALLO), and androsterone (ANDRO) were determined for the prefrontal cortex, hippocampus, and cerebellum. For 2S rats, repeated blood samples were obtained at 15, 30, and 60 min post-stressor for determination of corticosterone (CORT) levels after stress or context on PID 34. Similar to earlier work, ASRs were severely attenuated in mTBI rats without remission for 28 days after injury. No differences were observed between mTBI and SHAM rats in basal CORT, peak CORT levels or its recovery. In serum and brain, ANDRO levels were the most stress-sensitive. Stress-induced ANDRO elevations were greater than those in mTBI rats. As a positive allosteric modulator of gamma-aminobutyric acid (GABA_A) receptors, increased brain ANDRO levels are expected to be anxiolytic. The impact of brain ANDRO elevations in the aftermath of mTBI on coping warrants further elaboration.

Paired-housing selectively facilitates within-session extinction of avoidance behavior, and increases c-Fos expression in the medial prefrontal cortex, in anxiety vulnerable Wistar-Kyoto rats

OBJECTIVE

The perseveration of avoidance behavior, even in the absence of once threatening stimuli, is a key feature of anxiety and related psychiatric conditions. This phenomenon can be observed in the Wistar-Kyoto (WKY) rat which, in comparison to outbred controls, demonstrates impaired extinction of avoidance behavior. Also characteristic of the WKY rat is abnormalities of the neurocircuitry and neuroplasticity of the medial prefrontal cortex (mPFC). One means of reducing physiological responses to anxiety, and conditioned fear, in social species is the presence of a conspecific animal. The current study investigates whether or not pair-housed WKY rats would show facilitated extinction of avoidance in comparison to individual-housed WKY rats, and whether or not pair-housing influences mPFC activation during lever-press avoidance.

METHODS

Male WKY rats were assigned to individual-housed and pair-housed conditions. Rats were trained in lever-press avoidance. Each session of lever-press avoidance consisted of 20 trials, where pressing a lever in response to a warning tone prevented foot-shocks. Rats received 12 acquisition sessions over 4weeks; followed by 6 extinction sessions over 2weeks, where foot-shocks ceased to be delivered. Brains were harvested 90min after trials 1 and 10 of extinction sessions 1 and 6, and mPFC sections underwent c-Fos staining as a measure of activation.

RESULTS

Pair-housed rats showed facilitated lever-press avoidance extinction rates, but the main cause for this overall difference was a selective facilitation of within-session extinction. Similar to individual-housed rats, pair-housed rats continued to avoid during trial 1 of extinction even when the avoidance responding had been significantly reduced by the end of the previous session. Pair-housed rats sacrificed on trial 1 showed greater c-Fos expression in the anterior cingulate cortex and prelimbic cortex subregions of the mPFC compared individual-housed rats sacrificed on trial 1.

CONCLUSION

This data shows pair-housing to facilitate the extinction of avoidance, and to influence activity of the mPFC, in WKY rats. Despite this environmental manipulation, the pair-housed WKY rats continued to show avoidance responding on trial 1 of extinction sessions. This demonstrates that within-session extinction can be dissociated from between-session extinction-resistance in WKY rats. Furthermore, it suggests the individual-housing of WKY rats selectively slows within-session extinction, possibly by reducing neuronal activity of the mPFC during the testing situation.

Leukemia Inhibitory Factor Haplodeficiency Desynchronizes Glial Reactivity and Exacerbates Damage and Functional Deficits after a Concussive Brain Injury

Reactions of both astrocytes and microglia to central nervous system injury can be beneficial or detrimental to recovery. To gain insights into the functional importance of gliosis, we developed a new model of adolescent closed-head injury (CHI) and interrogated the behavioral, physiological, and cellular outcomes after a concussive CHI in leukemia inhibitory factor (LIF) haplodeficient mice. These mice were chosen because LIF is important for astrocyte and microglial activation. Behaviorally, the LIF haplodeficient animals were equally impaired 4 h after the injury, but in the subsequent 2 weeks, the LIF haplodeficient mice acquired more severe motor and sensory deficits, compared with wild type mice. The prolonged accumulation of neurological impairment was accompanied by desynchronization of the gliotic response, increased cell death, axonal degeneration, diminished callosal compound action potential, and hypomyelination. Our results clearly show that LIF is an essential injury-induced cytokine that is required to prevent the propagation of secondary neurodegeneration.

Altered activity of the medial prefrontal cortex and amygdala during acquisition and extinction of an active avoidance task

Altered medial prefrontal cortex (mPFC) and amygdala function is associated with anxiety-related disorders. While the mPFC-amygdala pathway has a clear role in fear conditioning, these structures are also involved in active avoidance. Given that avoidance perseveration represents a core symptom of anxiety disorders, the neural substrate of avoidance, especially its extinction, requires better understanding. The present study was designed to investigate the activity, particularly, inhibitory neuronal activity in mPFC and amygdala during acquisition and extinction of lever-press avoidance in rats. Neural activity was examined in the mPFC, intercalated cell clusters (ITCs) lateral (LA), basal (BA) and central (CeA) amygdala, at various time points during acquisition and extinction, using induction of the immediate early gene product, c-Fos. Neural activity was greater in the mPFC, LA, BA, and ITC during the extinction phase as compared to the acquisition phase. In contrast, the CeA was the only region that was more activated during acquisition than during extinction. Our results indicate inhibitory neurons are more activated during late phase of acquisition and extinction in the mPFC and LA, suggesting the dynamic involvement of inhibitory circuits in the development and extinction of avoidance response. Together, these data start to identify the key brain regions important in active avoidance behavior, areas that could be associated with avoidance perseveration in anxiety disorders.

Using signals associated with safety in avoidance learning: computational model of sex differences

Avoidance behavior involves learning responses that prevent upcoming aversive events; these responses typically extinguish when the aversive events stop materializing. Stimuli that signal safety from aversive events can paradoxically inhibit extinction of avoidance behavior. In animals, males and females process safety signals differently. These differences help explain why women are more likely to be diagnosed with an anxiety disorder and exhibit differences in symptom presentation and course compared to men. In the current study, we extend an existing model of strain differences in avoidance behavior to simulate sex differences in rats. The model successfully replicates data showing that the omission of a signal associated with a period of safety can facilitate extinction in females, but not males, and makes novel predictions that this effect should depend on the duration of the period, the duration of the signal itself, and its occurrence within that period. Non-reinforced responses during the safe period were also found to be important in the expression of these patterns. The model also allowed us to explore underlying mechanisms for the observed sex effects, such as whether safety signals serve as occasion setters for aversive events, to determine why removing them can facilitate extinction of avoidance. The simulation results argue against this account, and instead suggest the signal may serve as a conditioned reinforcer of avoidance behavior.

Avoidance expression in rats as a function of signal-shock interval: strain and sex differences

Inbred Wistar Kyoto (WKY) rats express inhibited temperament, increased sensitivity to stress, and exaggerated expressions of avoidance. A long-standing observation for lever press escape/avoidance learning in rats is the duration of the warning signal (WS) determines whether avoidance is expressed over escape. Outbred female Sprague-Dawley (SD) rats trained with a 10-s WS efficiently escaped, but failed to exhibit avoidance; avoidance was exhibited to a high degree with WSs longer than 20-s. We examined this longstanding WS duration function and extended it to male SD and male and female WKY rats. A cross-over design with two WS durations (10 or 60 s) was employed. Rats were trained (20 trials/session) in four phases: acquisition (10 sessions), extinction (10 sessions), re-acquisition (8 sessions) and re-extinction (8 sessions). Consistent with the literature, female and male SD rats failed to express avoidance to an appreciable degree with a 10-s WS. When these rats were switched to a 60-s WS, performance levels in the initial session of training resembled the peak performance of rats trained with a 60-s WS. Therefore, the avoidance relationship was acquired, but not expressed at 10-s WS. Further, poor avoidance at 10-s does not adversely affect expression at 60-s. Failure to express avoidance with a 10-s WS likely reflects contrasting reinforcement value of avoidance, not a reduction in the amount of time available to respond or competing responses. In contrast, WKY rats exhibited robust avoidance with a 10-s WS, which was most apparent in female WKY rats. Exaggerated expression of avoidances by WKY rats, especially female rats, further confirms this inbred strain as a model of anxiety vulnerability.

Long-lasting suppression of acoustic startle response after mild traumatic brain injury

Acoustic startle response (ASR) is a defensive reflex that is largely ignored unless greatly exaggerated. ASR is suppressed after moderate and severe traumatic brain injury (TBI), but the effect of mild TBI (mTBI) on ASR has not been investigated. Because the neural circuitry for ASR resides in the pons in all mammals, ASR may be a good measure of brainstem function after mTBI. The present study assessed ASR in Sprague-Dawley rats after mTBI using lateral fluid percussion and compared these effects to those on spatial working memory. mTBI caused a profound, long-lasting suppression of ASR. Both probability of emitting a startle and startle amplitude were diminished. ASR suppression was observed as soon as 1 day after injury and remained suppressed for the duration of the study (21 days after injury). No indication of recovery was observed. mTBI also impaired spatial working memory. In contrast to the suppression of ASR, working memory impairment was transient; memory was impaired 1 and 7 days after injury, but recovered by 21 days. The long-lasting suppression of ASR suggests long-term dysfunction of brainstem neural circuits at a time when forebrain neural circuits responsible for spatial working memory have recovered. These results have important implications for return-to-activity decisions because recovery of cognitive impairments plays an important role in these decisions.

Investigating the Role of Hippocampal BDNF in Anxiety Vulnerability Using Classical Eyeblink Conditioning

Dysregulation of brain-derived neurotrophic factor (BDNF), behavioral inhibition temperament (BI), and small hippocampal volume have been linked to anxiety disorders. Individuals with BI show facilitated acquisition of the classically conditioned eyeblink response (CCER) as compared to non-BI individuals, and a similar pattern is seen in an animal model of BI, the Wistar-Kyoto (WKY) rat. The present study examined the role of hippocampal BDNF in the facilitated delay CCER of WKY rats. Consistent with earlier work, acquisition was facilitated in WKY rats compared to the Sprague Dawley (SD) rats. Facilitated acquisition was associated with increased BDNF, TrkB, and Arc mRNA in the dentate gyrus of SD rats, but learning-induced increases in BDNF and Arc mRNA were significantly smaller in WKY rats. To determine whether reduced hippocampal BDNF in WKY rats was a contributing factor for their facilitated CCER, BDNF or saline infusions were given bilaterally into the dentate gyrus region 1 h prior to training. BDNF infusion did not alter the acquisition of SD rats, but significantly dampened the acquisition of CCER in the WKY rats, such that acquisition was similar to SD rats. Together, these results suggest that inherent differences in the BDNF system play a critical role in the facilitated associative learning exhibited by WKY rats, and potentially individuals with BI. Facilitated associative learning may represent a vulnerability factor in the development of anxiety disorders.

Acquired equivalence in U.S. veterans with symptoms of posttraumatic stress: reexperiencing symptoms are associated with greater generalization

The severity and number of reexperiencing symptoms (e.g., flashbacks) show considerable variability across individuals with posttraumatic stress disorder (PTSD). One interpretation of reexperiencing symptoms invokes generalization: Specifically, the traumatic memory may be stored in such a way that neutral stimuli that only vaguely resemble some feature of the traumatic event are sufficient to trigger the memory. If this is the case, then individuals with higher levels of reexperiencing symptoms might show greater generalization, even in contexts unrelated to trauma. In the current study, an acquired equivalence test was used to assess associative learning and generalization in 114 U.S. veterans who were also given a test of declarative memory. PTSD symptoms were rated by the veteran. After adjusting for demographic variables, psychoactive medication use, and initial learning, regression analyses showed that the number of PTSD reexperiencing symptoms significantly improved the model for generalization (β = -.23, R(2) = .34) but not associative learning or declarative memory. The results support the idea that generalization is linked to reexperiencing symptoms, is not limited to learning about traumatic events, and can emerge even in a relatively innocuous computer-based learning task.

ITI-Signals and Prelimbic Cortex Facilitate Avoidance Acquisition and Reduce Avoidance Latencies, Respectively, in Male WKY Rats

As a model of anxiety disorder vulnerability, male Wistar-Kyoto (WKY) rats acquire lever-press avoidance behavior more readily than outbred Sprague-Dawley rats, and their acquisition is enhanced by the presence of a discrete signal presented during the inter-trial intervals (ITIs), suggesting that it is perceived as a safety signal. A series of experiments were conducted to determine if this is the case. Additional experiments investigated if the avoidance facilitation relies upon processing through medial prefrontal cortex (mPFC). The results suggest that the ITI-signal facilitates acquisition during the early stages of the avoidance acquisition process, when the rats are initially acquiring escape behavior and then transitioning to avoidance behavior. Post-avoidance introduction of the visual ITI-signal into other associative learning tasks failed to confirm that the visual stimulus had acquired the properties of a conditioned inhibitor. Shortening the signal from the entirety of the 3 min ITI to only the first 5 s of the 3 min ITI slowed acquisition during the first four sessions, suggesting the flashing light (FL) is not functioning as a feedback signal. The prelimbic (PL) cortex showed greater activation during the period of training when the transition from escape responding to avoidance responding occurs. Only combined PL + infralimbic cortex lesions modestly slowed avoidance acquisition, but PL-cortex lesions slowed avoidance response latencies. Thus, the FL ITI-signal is not likely perceived as a safety signal nor is it serving as a feedback signal. The functional role of the PL-cortex appears to be to increase the drive toward responding to the threat of the warning signal. Hence, avoidance susceptibility displayed by male WKY rats may be driven, in part, both by external stimuli (ITI signal) as well as by enhanced threat recognition to the warning signal via the PL cortex.

Avoidance as expectancy in rats: sex and strain differences in acquisition

Avoidance is a core feature of anxiety disorders and factors which increase avoidance expression or its resistance represent a source of vulnerability for anxiety disorders. Outbred female Sprague Dawley (SD) rats and inbred male and female Wistar-Kyoto (WKY) rats expressing behaviorally inhibited (BI) temperament learn avoidance faster than male SD rats. The training protocol used in these studies had a longstanding interpretive flaw: a lever-press had two outcomes, termination of the warning signal (WS) and prevention of foot shock. To disambiguate between these two explanations, we conducted an experiment in which: (a) a lever-press terminated the WS and prevented shock, and (b) a lever-press only prevented shock, but did not influence the duration of the WS. Thus, a 2 × 2 × 2 (Strain × Sex × Training) design was employed to assess the degree to which the response contingency of the WS termination influenced acquisition. Male and female SD and WKY rats were matched on acoustic startle reactivity within strain and sex and randomly assigned to the training procedures. In addition, we assessed whether the degree of avoidance acquisition affected estrus cycling in female rats. Consistent with earlier work, avoidance performance of female rats was generally superior to males and WKY rats were superior to SD rats. Moreover, female SD and male WKY rats were roughly equivalent. Female sex and BI temperament were confirmed as vulnerability factors in faster acquisition of avoidance behavior. Avoidance acquisition disrupted estrus cycling with female WKY rats recovering faster than female SD rats. Although termination of the WS appears to be reinforcing, male and female WKY rats still achieved a high degree (greater than 80% asymptotic performance) of avoidance in the absence of the WS termination contingency. Such disambiguation will facilitate determination of the neurobiological basis for avoidance learning and its extinction.

Effects of psychotropic agents on extinction of lever-press avoidance in a rat model of anxiety vulnerability

Avoidance and its perseveration represent key features of anxiety disorders. Both pharmacological and behavioral approaches (i.e., anxiolytics and extinction therapy) have been utilized to modulate avoidance behavior in patients. However, the outcome has not always been desirable. Part of the reason is attributed to the diverse neuropathology of anxiety disorders. Here, we investigated the effect of psychotropic drugs that target various monoamine systems on extinction of avoidance behavior using lever-press avoidance task. Here, we used the Wistar-Kyoto (WKY) rat, a unique rat model that exhibits facilitated avoidance and extinction resistance along with malfunction of the dopamine (DA) system. Sprague Dawley (SD) and WKY rats were trained to acquire lever-press avoidance. WKY rats acquired avoidance faster and to a higher level compared to SD rats. During pharmacological treatment, bupropion and desipramine (DES) significantly reduced avoidance response selectively in WKY rats. However, after the discontinuation of drug treatment, only those WKY rats that were previously treated with DES exhibited lower avoidance response compared to the control group. In contrast, none of the psychotropic drugs facilitated avoidance extinction in SD rats. Instead, DES impaired avoidance extinction and increased non-reinforced response in SD rats. Interestingly, paroxetine, a widely used antidepressant and anxiolytic, exhibited the weakest effect in WKY rats and no effects at all in SD rats. Thus, our data suggest that malfunctions in brain catecholamine system could be one of the underlying etiologies of anxiety-like behavior, particularly avoidance perseveration. Furthermore, pharmacological manipulation targeting DA and norepinephrine may be more effective to facilitate extinction learning in this strain. The data from the present study may shed light on new pharmacological approaches to treat patients with anxiety disorders who are not responding to serotonin re-uptake inhibitors.

The role of the hippocampus in avoidance learning and anxiety vulnerability

The hippocampus has been implicated in anxiety disorders and post-traumatic stress disorder (PTSD); human studies suggest that a dysfunctional hippocampus may be a vulnerability factor for the development of PTSD. In the current study, we examined the effect of hippocampal damage in avoidance learning, as avoidance is a core symptom of all anxiety disorders. First, the effect of hippocampal damage on avoidance learning was investigated in outbred Sprague Dawley (SD) rats. Second, the function of the hippocampus in Wistar-Kyoto (WKY) rats was compared to SD rats. The WKY rat is an animal model of behavioral inhibition, a risk factor for anxiety, and demonstrates abnormal avoidance learning, marked by facilitated avoidance acquisition and resistance to extinction. The results of the current study indicate that hippocampal damage in SD rats leads to impaired extinction of avoidance learning similar to WKY rats. Furthermore, WKY rats have reduced hippocampal volume and impaired hippocampal synaptic plasticity as compared to SD rats. These results suggest that hippocampal dysfunction enhances the development of persistent avoidance responding and, thus, may confer vulnerability to the development of anxiety disorders and PTSD.

Behaviourally inhibited temperament and female sex, two vulnerability factors for anxiety disorders, facilitate conditioned avoidance (also) in humans

Acquisition and maintenance of avoidance behaviour is a key feature of all human anxiety disorders. Animal models have been useful in understanding how anxiety vulnerability could translate into avoidance learning. For example, behaviourally inhibited temperament and female sex, two vulnerability factors for clinical anxiety, are associated with faster acquisition of avoidance responses in rodents. However, to date, the translation of such empirical data to human populations has been limited since many features of animal avoidance paradigms are not typically captured in human research. Here, using a computer-based task that captures many features of rodent escape-avoidance learning paradigms, we investigated whether avoidance learning would be faster in humans with inhibited temperament and/or female sex and, if so, whether this facilitation would take the same form. Results showed that, as in rats, both vulnerability factors were associated with facilitated acquisition of avoidance behaviour in humans. Specifically, inhibited temperament was associated with higher rate of avoidance responding, while female sex was associated with longer avoidance duration. These findings strengthen the direct link between animal avoidance work and human anxiety vulnerability, further motivating the study of animal models while also providing a simple testbed for a direct human testing.

Learning to obtain reward, but not avoid punishment, is affected by presence of PTSD symptoms in male veterans: empirical data and computational model

Post-traumatic stress disorder (PTSD) symptoms include behavioral avoidance which is acquired and tends to increase with time. This avoidance may represent a general learning bias; indeed, individuals with PTSD are often faster than controls on acquiring conditioned responses based on physiologically-aversive feedback. However, it is not clear whether this learning bias extends to cognitive feedback, or to learning from both reward and punishment. Here, male veterans with self-reported current, severe PTSD symptoms (PTSS group) or with few or no PTSD symptoms (control group) completed a probabilistic classification task that included both reward-based and punishment-based trials, where feedback could take the form of reward, punishment, or an ambiguous “no-feedback” outcome that could signal either successful avoidance of punishment or failure to obtain reward. The PTSS group outperformed the control group in total points obtained; the PTSS group specifically performed better than the control group on reward-based trials, with no difference on punishment-based trials. To better understand possible mechanisms underlying observed performance, we used a reinforcement learning model of the task, and applied maximum likelihood estimation techniques to derive estimated parameters describing individual participants’ behavior. Estimations of the reinforcement value of the no-feedback outcome were significantly greater in the control group than the PTSS group, suggesting that the control group was more likely to value this outcome as positively reinforcing (i.e., signaling successful avoidance of punishment). This is consistent with the control group’s generally poorer performance on reward trials, where reward feedback was to be obtained in preference to the no-feedback outcome. Differences in the interpretation of ambiguous feedback may contribute to the facilitated reinforcement learning often observed in PTSD patients, and may in turn provide new insight into how pathological behaviors are acquired and maintained in PTSD.

Activation of extracellular signal-regulated kinase (ERK) and ΔFosB in emotion-associated neural circuitry after asymptotic levels of active avoidance behavior are attained

Avoidance susceptibility may constitute a vulnerability to develop anxiety disorders, and Wistar-Kyoto (WKY) rats exhibit unique features in their acquisition of avoidance behavior that appear to promote susceptibility to this form of learning, namely the absence of the commonly observed "warm-up" effect. The present study sought to determine if strain differences in acquired avoidance behavior, between WKY and Sprague Dawley rats, could be attributed to differences in dopamine-related plasticity, represented by extracellular signal-regulated kinase (ERK) activity, and prolonged neuronal activation, represented by ΔFosB accumulation, in three key areas of the brain: the medial prefrontal cortex (mPFC), dorsal striatum (DS), and basolateral amygdala (BLA). Consistent with earlier work, WKY rats exhibited a higher level of asymptotic performance of avoidance behavior, which included an absence of warm-up in the first few trials of later training sessions, and they exhibited more non-reinforced anticipatory responses in the single minute prior to the initiation of the first warning signal presentation of each training session. In the brain, phosyphorylated ERK2 (pERK2) activation was higher in avoidance trained rats in both the mPFC and DS, although the difference in DS was mostly observed in WKY rats. Avoidance-training was associated with higher levels of ΔFosB expression in the mPFC of SD rats, but not WKY rats. The strain differences in pERK2 activation in the DS and ΔFosB levels in the mPFC may underlie the strain-specific differences observed in warm-up, the emission of non-reinforced anticipatory responses, and general differences in asymptotic performance of active avoidance behavior. The mPFC and DS require further study as potential neural targets for understanding avoidance susceptibility and, as a result, anxiety vulnerability.

GABAergic neurons in the medial septum-diagonal band of Broca (MSDB) are important for acquisition of the classically conditioned eyeblink response

The medial septum and diagonal band of Broca (MSDB) influence hippocampal function through cholinergic, GABAergic, and glutamatergic septohippocampal neurons. Non-selective damage of the MSDB or intraseptal scopolamine impairs classical conditioning of the eyeblink response (CCER). Scopolamine preferentially inhibits GABAergic MSDB neurons suggesting that these neurons may be an important modulator of delay CCER, a form of CCER not dependent on the hippocampus. The current study directly examined the importance of GABAergic MSDB neurons in acquisition of delay CCER. Adult male Sprague-Dawley rats received either a sham (PBS) or GABAergic MSDB lesion using GAT1-saporin (SAP). Rats were given two consecutive days of delay eyeblink conditioning with 100 conditioned stimulus-unconditioned stimulus paired trials. Intraseptal GAT1-SAP impaired acquisition of CCER. The impairment was observed on the first day with sham and lesion groups reaching similar performance by the end of the second day. Our results provide evidence that GABAergic MSDB neurons are an important modulator of delay CCER. The pathways by which MSDB neurons influence the neural circuits necessary for delay CCER are discussed.

Why trace and delay conditioning are sometimes (but not always) hippocampal dependent: a computational model

A recurrent-network model provides a unified account of the hippocampal region in mediating the representation of temporal information in classical eyeblink conditioning. Much empirical research is consistent with a general conclusion that delay conditioning (in which the conditioned stimulus CS and unconditioned stimulus US overlap and co-terminate) is independent of the hippocampal system, while trace conditioning (in which the CS terminates before US onset) depends on the hippocampus. However, recent studies show that, under some circumstances, delay conditioning can be hippocampal-dependent and trace conditioning can be spared following hippocampal lesion. Here, we present an extension of our prior trial-level models of hippocampal function and stimulus representation that can explain these findings within a unified framework. Specifically, the current model includes adaptive recurrent collateral connections that aid in the representation of intra-trial temporal information. With this model, as in our prior models, we argue that the hippocampus is not specialized for conditioned response timing, but rather is a general-purpose system that learns to predict the next state of all stimuli given the current state of variables encoded by activity in recurrent collaterals. As such, the model correctly predicts that hippocampal involvement in classical conditioning should be critical not only when there is an intervening trace interval, but also when there is a long delay between CS onset and US onset. Our model simulates empirical data from many variants of classical conditioning, including delay and trace paradigms in which the length of the CS, the inter-stimulus interval, or the trace interval is varied. Finally, we discuss model limitations, future directions, and several novel empirical predictions of this temporal processing model of hippocampal function and learning.

Behaviorally inhibited temperament is associated with severity of post-traumatic stress disorder symptoms and faster eyeblink conditioning in veterans

Prior studies have sometimes demonstrated facilitated acquisition of classically conditioned responses and/or resistance to extinction in post-traumatic stress disorder (PTSD). However, it is unclear whether these behaviors are acquired as a result of PTSD or exposure to trauma, or reflect preexisting risk factors that confer vulnerability for PTSD. Here, we examined classical eyeblink conditioning and extinction in veterans self-assessed for current PTSD symptoms, exposure to combat, and the personality trait of behavioral inhibition (BI), a risk factor for PTSD. A total of 128 veterans were recruited (mean age 51.2 years; 13.3% female); 126 completed self-assessment, with 25.4% reporting a history of exposure to combat and 30.9% reporting current, severe PTSD symptoms (PTSS). The severity of PTSS was correlated with current BI (R(2) = 0.497) and PTSS status could be predicted based on current BI and combat history (80.2% correct classification). A subset of the veterans (n = 87) also completed the eyeblink conditioning study. Among veterans without PTSS, childhood BI was associated with faster acquisition; veterans with PTSS showed delayed extinction, under some conditions. These data demonstrate a relationship between current BI and PTSS, and indicate that the facilitated conditioning sometimes observed in patients with PTSD may partially reflect personality traits such as childhood BI that pre-date and contribute to vulnerability for PTSD.

Vulnerability factors in anxiety: Strain and sex differences in the use of signals associated with non-threat during the acquisition and extinction of active-avoidance behavior

Rats that exhibit a behaviorally inhibited temperament acquire active-avoidance behaviors quicker, and extinguish them slower, than normal outbred rats. Here we explored the contribution of stimuli that signal periods of non-threat (i.e. safety signals) in the process of acquiring active-avoidance behavior. Utilizing a discrete lever-press escape-avoidance protocol, outbred Sprague-Dawley (SD) rats and inbred, behaviorally inhibited, Wistar-Kyoto (WKY) rats were tested under conditions where a flashing light was either presented or not during periods of non-threat (the inter-trial interval, ITI). For males, we found the absence of the ITI-signal slowed the acquisition of avoidance behavior selectively in WKY rats. However, extinction of the avoidance behavior was not influenced by training with or without the ITI-signal; WKY males extinguished slower than SD males. For females, the presence of the ITI-signal did not affect acquisition in either strain. However, after training with the ITI-signal, females of both strains extinguished quicker in its absence than in its presence. In order to determine if facilitated acquisition of avoidance learning in male WKY rats was due to a paradigm-independent influence of the visual stimulus used as ITI-signal upon associative learning, we conducted eyeblink conditioning in the presence or absence of a similar visual stimulus. No differences in acquisition, as a function of this visual stimulus, were observed within the male WKY rats, but, as was observed in avoidance learning, male WKY rats extinguished slower than male SD rats. Thus, avoidance susceptibility for male WKY rats may be tied both to the presence of non-threat signals as well as a resistance to extinguish Pavlovian-conditioned associations. Female susceptibility to resist extinguishing avoidant behavior is discussed with respect to the possible role of stimuli serving as occasion setters for threat contexts.

Avoidance perseveration during extinction training in Wistar-Kyoto rats: an interaction of innate vulnerability and stressor intensity

Given that avoidance is a core feature of anxiety disorders, Wistar-Kyoto (WKY) rats may be a good model of anxiety vulnerability for their hypersensitivity to stress and trait behavioral inhibition. Here, we examined the influence of strain and shock intensity on avoidance acquisition and extinction. Accordingly, we trained WKY and Sprague-Dawley (SD) rats in lever-press avoidance using either 1.0-mA or 2.0-mA foot-shock. After extinction, neuronal activation was visualized by c-Fos for overall activity and parvalbumin immunoreactivity for gamma-aminobutyric acid (GABA) neuron in brain areas linked to anxiety (medial prefrontal cortex and amygdala). Consistent with earlier work, WKY rats acquired lever-press avoidance faster and to a greater extent than SD rats. However, the intensity of foot shock did not differentially affect acquisition. Although there were no differences during extinction in SD rats, avoidance responses of WKY rats trained with the higher foot shock perseverated during extinction compared to those WKY rats trained with lower foot shock intensity or SD rats. WKY rats trained with 2.0-mA shock exhibited less GABAergic activation in the basolateral amygdala after extinction. These findings suggest that inhibitory modulation in amygdala is important to ensure successful extinction learning. Deficits in avoidance extinction secondary to lower GABAergic activation in baslolateral amygdala may contribute to anxiety vulnerability in this animal model of inhibited temperament.

Dividing time: concurrent timing of auditory and visual events by young and elderly adults

This article examines age differences in individual's ability to produce the durations of learned auditory and visual target events either in isolation (focused attention) or concurrently (divided attention). Young adults produced learned target durations equally well in focused and divided attention conditions. Older adults, in contrast, showed an age-related increase in timing variability in divided attention conditions that tended to be more pronounced for visual targets than for auditory targets. Age-related impairments were associated with a decrease in working memory span; moreover, the relationship between working memory and timing performance was largest for visual targets in divided attention conditions.

Classical and instrumental conditioning of eyeblink responses in Wistar-Kyoto and Sprague-Dawley rats

Wistar-Kyoto (WKY) rats, an animal model of anxiety vulnerability, acquire lever-press avoidance faster than outbred Sprague-Dawley (SD) rats. Faster avoidance acquisition may reflect an inherent ability to acquire cue-outcome associations, response-outcome associations or both. To evaluate cue-outcome learning, acquisition of classically conditioned eyeblink response was compared in SD and WKY rats using a delay-type paradigm (500-ms conditioned stimulus (CS) coterminating with a 10-ms unconditional stimulus (US)). WKY rats demonstrated enhanced classical conditioning, with both faster acquisition and greater asymptotic performance in delay-type training than SD rats. To evaluate response-outcome learning, separate SD and WKY rats were given control over US delivery through imposition of an omission contingency into delay-type training (emitting a conditioned response (CR) prevented delivery of the US). The schedule of US delivery derived by these rats became the training regimen for a separate group of SD and WKY rats, yoked within strain. In SD rats, no differences in acquisition were detected between those given control over US delivery and those trained with the same partial reinforcement schedule. Acquisition rates of those WKY rats with control exceeded those trained with a yoked-schedule of US presentation. Collectively, WKY rats exhibit enhanced classical conditioning and sensitivity to schedules of reinforcement compared to outbred SD rats. Anxiety vulnerability, in particular inhibited temperament, may be traced to active processes in the prediction and control of aversive events.

Deficient proactive interference of eyeblink conditioning in Wistar-Kyoto rats

Wistar-Kyoto (WKY) rats exhibit behavioral inhibition and model anxiety vulnerability. Although WKY rats exhibit faster active avoidance acquisition, simple associative learning or the influence of proactive interference (PI) has not been adequately assessed in this strain. Therefore, we assessed eyeblink conditioning and PI in WKY and outbred Sprague-Dawley (SD) rats. Rats were pre-exposed to either the experimental context, the conditioned stimulus (CS), the unconditional stimulus (US), or the CS & US in an explicitly unpaired (EUP) manner, to examine latent inhibition (LI), US pre-exposure effect, or learned irrelevance (LIRR), respectively. Immediately following pre-exposures, rats were trained in a delay-type paradigm (500 ms CS coterminating with a 10-ms US) for one session. During training SD rats exhibited LI and inhibition from US pre-exposures without evidence of LIRR. PI was less evident in WKY rats; LI was absent in WKY rats. Even in the context of reduced PI to CS-alone and US-alone pre-exposures, LIRR was not apparent in WKY rats. The more normal acquisition rates exhibited by WKY rats, under conditions which degrade performance in SD rats, increases the overall likelihood for WKY rats to acquire defensive responses. Enhanced acquisition of defensive responses is a means by which anxiety vulnerability (e.g., behavioral inhibition) is translated to anxiety psychopathology.

Damage of GABAergic neurons in the medial septum impairs spatial working memory and extinction of active avoidance: effects on proactive interference

The medial septum and diagonal band (MSDB) are important in spatial learning and memory. On the basis of the excitotoxic damage of GABAergic MSDB neurons, we have recently suggested a role for these neurons in controlling proactive interference. Our study sought to test this hypothesis in different behavioral procedures using a new GABAergic immunotoxin. GABA-transporter-saporin (GAT1-SAP) was administered into the MSDB of male Sprague-Dawley rats. Following surgery, rats were trained in a reference memory water maze procedure for 5 days, followed by a working memory (delayed match to position) water maze procedure. Other rats were trained in a lever-press avoidance procedure after intraseptal GAT1-SAP or sham surgery. Intraseptal GAT1-SAP extensively damaged GABAergic neurons while sparing most cholinergic MSDB neurons. Rats treated with GAT1-SAP were not impaired in acquiring a spatial reference memory, learning the location of the escape platform as rapidly as sham rats. In contrast, GAT1-SAP rats were slower than sham rats to learn the platform location in a delayed match to position procedure, in which the platform location was changed every day. Moreover, GAT1-SAP rats returned to previous platform locations more often than sham rats. In the active avoidance procedure, intraseptal GAT1-SAP impaired extinction but not acquisition of the avoidance response. Using a different neurotoxin and behavioral procedures than previous studies, the results of this study paint a similar picture that GABAergic MSDB neurons are important for controlling proactive interference.

Wistar-Kyoto rats as an animal model of anxiety vulnerability: support for a hypervigilance hypothesis

Inbred Wistar-Kyoto (WKY) rats have been proposed as a model of anxiety vulnerability as they display behavioral inhibition and a constellation of learning and reactivity abnormalities relative to outbred Sprague-Dawley (SD) rats. Together, the behaviors of the WKY rat suggest a hypervigilant state that may contribute to its anxiety vulnerability. To test this hypothesis, open-field behavior, acoustic startle, pre-pulse inhibition and timing behavior were assessed in WKY and Sprague-Dawley (SD) rats. Timing behavior was evaluated using a modified version of the peak-interval timing procedure. Training and testing of timing first occurred without audio-visual (AV) interference. Following this initial test, AV interference was included on some trials. Overall, WKY rats took much longer to leave the center of the arena, made fewer line crossings, and reared less, than did SD rats. WKY rats showed much greater startle responses to acoustic stimuli and significantly greater pre-pulse inhibition than did the SD rats. During timing conditions without AV interference, timing accuracy for both strains was similar; peak times for WKY and SD rats were not different. During interference conditions, however, the timing behavior of the two strains was very different. Whereas peak times for SD rats were similar between non-interference and interference conditions, peak times for WKY rats were shorter and response rates higher in interference conditions than in non-interference conditions. The enhanced acoustic startle response, greater prepulse inhibition and altered timing behavior with audio-visual interference supports a characterization of WKY strain as hypervigilant and provides further evidence for the use of the WKY strain as a model of anxiety vulnerability.

Noncholinergic lesions of the medial septum impair sequential learning of different spatial locations

The medial septum and diagonal band of Broca (MSDB) are major afferents to the hippocampus and are important for learning, memory, and hippocampal theta rhythm. In the present study, we assessed the effect of cholinergic or noncholinergic MSDB lesions on the sequential learning of different goal locations in the same environment, a type of task that is proposed to require hippocampal theta rhythm. Rats were administered saline, 192-IgG saporin (SAP), or kainic acid (KA) into the MSDB and then behaviorally tested. On any day, a single arm of a radial maze was rewarded with food, but the location of this rewarded arm changed between days. As in previous studies, intraseptal SAP reduced the number of cholinergic neurons although sparing GABAergic septohippocampal neurons. KA had the reverse effect, reducing GABAergic septohippocampal neurons and sparing cholinergic neurons. KA, but not SAP, impaired performance on the repeated acquisition task. Saline and SAP rats showed rapid within-session learning, whereas KA rats were much slower to learn the goal location. Performance on a 30 min retention trial was also impaired, although this may be attributable to incomplete acquisition. These findings provide evidence that noncholinergic, but not cholinergic, MSDB neurons are important in helping the animal deal with high loads of memory interference, and provides partial support for the idea that hippocampal theta rhythm is involved.

Modeling the effects of the NMDA receptor antagonist MK-801 on timing in rats

The NMDA receptor antagonist MK-801 produces different effects on timing tasks. In particular, MK-801 produces an underestimation of duration when animals are tested with the differential reinforcement of low rate of responding (DRL) schedule and an overestimation of duration when animals are tested with the peak-interval (PI) procedure. The goal of this study was to develop a model-based explanation for this discrepancy. Two computer simulations were conducted via an implementation of scalar expectancy theory (SET). In Simulation 1, SET was used to provide a quantitative account of PI timing data. Simulation 2 used parameter estimates from Simulation 1 to predict effects of MK-801 on the DRL task. DRL predictions provided a close match to previous empirical data. Results of the simulations suggest that differences in the literature are likely due to inherent differences between PI and DRL tasks, rather than fundamental differences in timing. Overall, the role of NMDA receptors in timing appears to be multifaceted, impacting perception, memory, and decision processes.

Age-related disruptions of circadian rhythm and memory in the senescence-accelerated mouse (SAMP8)

Common complaints of the elderly involve impaired cognitive abilities, such as loss of memory and inability to attend. Although much research has been devoted to these cognitive impairments, other factors such as disrupted sleep patterns and increased daytime drowsiness may contribute indirectly to impaired cognitive abilities. Disrupted sleep-wake cycles may be the result of age-related changes to the internal (circadian) clock. In this article, we review recent research on aging and circadian rhythms with a focus on the senescence-accelerated mouse (SAM) as a model of aging. We explore some of the neurobiological mechanisms that appear to be responsible for our aging clock, and consider implications of this work for age-related changes in cognition.

Effects of the NMDA receptor antagonist MK-801 on short-interval timing in rats

Effects of MK-801, an N-methyl-D-aspartate antagonist, on short-interval timing were examined using the peak-interval (PI) and PI-gap procedures. Fisher 344 rats were given daily injections of 0.025 mg/kg, 0.05 mg/kg, and 0.2 mg/kg MK-801. The main results were (a) 0.2 mg/kg MK-801 produced an immediate overestimation of the criterion time; (b) MK-801 increased peak rate of responding; (c) 0.2 mg/kg MK-801 produced an increase in variability; (d) during the PI-gap procedure, a reset pattern was observed for all rats (MK-801 and saline). Results suggest that MK-801 has at least 2 effects. First, MK-801 interferes with short-interval timing by producing an overestimation of time and a nonscalar increase in variability. Second, MK-801 increases response rate, suggesting a decrease in response inhibition.

Involvement of GABAergic and cholinergic medial septal neurons in hippocampal theta rhythm

Hippocampal theta rhythm (HPCtheta) may be important for various phenomena, including attention and acquisition of sensory information. Two types of HPCtheta (types I and II) exist based on pharmacological, behavioral, and electrophysiological characteristics. Both types occur during locomotion, whereas only type II (atropine-sensitive) is present under urethane anesthesia. The circuit of HPCtheta synchronization includes the medial septum-diagonal band of Broca (MSDB), with cholinergic and gamma-aminobutyric acid (GABA)ergic neurons comprising the two main projections from MSDB to HPC. The primary aim of the present study was to assess the effects of GABAergic MSDB lesions on urethane- and locomotion-related HPCtheta, and compare these effects to those of cholinergic MSDB lesions. Saline, kainic acid (KA), or 192 IgG-saporin (SAP) was injected into MSDB before recording. KA preferentially destroys GABAergic MSDB neurons, whereas SAP selectively eliminates cholinergic MSDB neurons. A fixed recording electrode was placed in the dentate mid-molecular layer, and stimulating electrodes were placed in the posterior hypothalamus (PH), and medial perforant path (PP). Under urethane anesthesia, HPCtheta was induced by tail pinch, PH stimulation, and systemic physostigmine; none of the rats with KA or SAP showed HPCtheta in any of these conditions. During locomotion, HPCtheta was attenuated, but not eliminated, in rats with KA or SAP lesions. Intraseptal KA in combination with either intraseptal SAP or PP lesions reduced locomotion-related HPCtheta beyond that observed with each lesion alone, virtually eliminating HPCtheta. In contrast, intraseptal SAP combined with PP lesions did not reduce HPCtheta beyond the effect of each lesion alone. We conclude that both GABAergic and cholinergic MSDB neurons are necessary for HPCtheta under urethane, and that each of these septohippocampal projections contributes to HPCtheta during locomotion.

Orexin-saporin lesions of the medial septum impair spatial memory

The medial septum and diagonal band of Broca (MSDB) provide a major input to the hippocampus and are important for spatial learning and memory. Although electrolytic MSDB lesions have prominent memory impairing effects, selective lesions of either cholinergic or GABAergic MSDB neurons do not or only mildly impair spatial memory. MSDB neurons are targets of orexin-containing neurons from the hypothalamus. At present, the functional significance of orexin afferents to MSDB is unclear, and the present study investigated a possible involvement of orexin innervation of the MSDB in spatial memory. Orexin-saporin, a toxin that damages neurons containing the hypocretin-2 receptor, was administered into the MSDB of rats. Rats were subsequently tested on a water maze to assess spatial reference memory and a plus maze to assess spatial working memory. At 100 ng/microl, orexin-saporin destroyed primarily GABAergic septohippocampal neurons, sparing the majority of cholinergic neurons. At 200 ng/microl, orexin-saporin almost totally eliminated GABAergic septohippocampal neurons and destroyed many cholinergic neurons. Spatial reference memory was impaired at both concentrations of orexin-saporin with a dramatic impairment observed for 24-h retention. Short-term reference memory was also impaired at both concentrations. Rats treated with 200 ng/microl, but not 100 ng/microl, of orexin-saporin were also impaired on a spontaneous alternation task, showing a deficit in spatial working memory. Our results, together with previous studies, suggest that orexin innervation of the MSDB may modulate spatial memory by acting on both GABAergic and cholinergic septohippocampal neurons.

Spontaneous fos expression in the suprachiasmatic nucleus of young and old mice

The senescence-accelerated mouse (SAMP8) is an animal model of aging that displays an array of circadian rhythm disruptions as early as 7 months of age. The present study explored the physiological basis for age-related changes in circadian rhythms by measuring c-Fos immunostaining. Cellular activity in the SCN "core" and "shell" was examined for 2-, 7-, and 12-month-old SAMP8 at circadian times (CTs) 2 and 14. Consistent with previous studies in rats, we observed higher levels of cellular activity at CT2 than at CT14, and higher levels of activity in the "shell" than in the "core" of the SCN. However, there was no effect of age on the pattern of cellular activity in either the "core" or the "shell" of the SCN. These results are discussed in the context of current research on spontaneous and light-induced c-Fos expression in the SCN of rodents.

Circadian rhythms in SAMP8: a longitudinal study of the effects of age and experience

Age-related effects on circadian rhythms include reductions of rhythm amplitude, alterations in re-entrainment, and increased fragmentation. Currently, the pattern of these changes across an individuals' lifespan is unknown. The present study used a cross-sequential experimental design to determine the pattern of circadian rhythm changes, identify predictors of later circadian rhythm disruption, and assess the effect of prior run-wheel experience on circadian rhythms. Run-wheel activity was assessed in senescence-accelerated mice (SAMP8) at 2, 7, and 12 months of age. Age-related changes included decrease of run-wheel activity, decrease in circadian rhythm amplitude, increase in proportion of light activity, and increase in split activity rhythms. Proportion of light activity at 2 months was a good predictor of circadian rhythm disruption at 7 months. Run-wheel experience increased overall activity and decreased proportion of light activity, but did not alter rhythm amplitude or period. These results demonstrate that aging produces several patterns of circadian rhythm changes, describe predictive measures of future rhythm disruptions, and suggest an intervention to reduce circadian rhythm disruptions.

Age-Related Changes in the Spontaneous Motor Rhythms of theSenescence-Accelerated Mouse (SAMP8)

The present study examined the effect of age on the spontaneous motor rhythms of mice during wheel running. The spontaneous motor tempo (SMT) of wheel running was measured for the P8 strain of the senescence-accelerated mouse (SAMP8) by recording the sequence of time intervals (measured in milliseconds) for successive revolutions ofa run-wheel over the course of 16 days. Analyses of the distribution of interrevolution intervals of 2-, 7-, and 12-month-old SAMP8 revealed an age-related slowing of wheel running and a corresponding increase in variability consistent with Weber's law. All three age groups also demonstrated a practice effect over the course of testing best described by a power law. These findings provide evidence of age-related changes in the spontaneous motor rhythms of the SAMP8 that occur as early as 7 months of age. The results are consistent with age-related changes in human subjects and suggest that spontaneous wheel-running behavior in rodents may be a good model for studying SMT.

Intrahippocampal connections in the pigeon (Columba livia) as revealed by stimulation evoked field potentials

The hippocampal formation (HF) of mammals and birds is crucial for spatial learning and memory. However, although the underlying synaptic organization and connectivity of the mammalian HF are well characterized, comparatively little is known about the avian HF. Localized regions of the homing pigeon HF were stimulated at 400-600 microA while evoked field potentials (EFPs) were recorded from adjacent and more distant HF areas relative to the stimulation site. The shortest discernible EFP latency was 12.2 msec. The emerging connectivity profile (using the location of peak EFP amplitude after stimulation and making no determination of the number of intervening synapses) was characterized by projections from the dorsolateral (DL) HF to the dorsomedial (DM) HF (15-msec latency) at the same anterior/posterior (A/P) level, DM to ventrolateral (VL) and ventromedial (VM; 15 msec) HF across A/P levels, VM to VL (12 msec) and contralateral VM (15 msec) at the same A/P level, and VL to ventral DL (DLv; 15 msec) across A/P levels posterior to the stimulation site. Using these data as a first approximation, connectivity through the avian HF appears to be characterized by a discernible feed-forward network starting with a projection from DL to DM, DM to VL, VM, and contralateral VM, VM to VL, and VL to posterior ventral DLv. Although still speculative, the results suggest that the internal connectivity of the avian HF is similar to that of the mammalian HF, despite the large evolutionary divergence between the two taxa.

Age-related disruptions in circadian timing: evidence for "split" activity rhythms in the SAMP8

In the senescence-accelerated mouse of the P8 line (SAMP8), age-related changes in circadian timing include a decrease in amplitude of the rhythm, a slower rate of re-entrainment following a phase advance, and a longer free-running period (tau). The present study extends previous research by investigating possible split activity rhythms in the SAMP8. Running wheel activity was examined in 2-, 7-, and 12-month SAMP8. Consistent with previous research, rhythms of older SAMP8 were decreased in amplitude and showed high levels of activity during the light phase of the light-dark cycle. Contrary to previous reports, lengthening of tau in constant darkness was not observed. Additionally, activity rhythms were "split" in older SAMP8, demonstrated by 1) the appearance of a secondary peak in the periodogram at approximately half the value of tau and 2) the perceptual classification of actograms by naïve observers. This result differs from previous studies in hamsters demonstrating an age-related decrease in the incidence of rhythm splitting. Overall, the present findings provide further evidence for age-related disruption of circadian timing in SAMP8.