Motor learning changes the axon initial segment of the spinal motoneuron

We are studying the mechanisms of H-reflex operant conditioning, a simple form of learning. Modelling studies in the literature and our previous data suggested that changes in the axon initial segment (AIS) might contribute. To explore this, we used blinded quantitative histological and immunohistochemical methods to study in adult rats the impact of H-reflex conditioning on the AIS of the spinal motoneuron that produces the reflex. Successful, but not unsuccessful, H-reflex up-conditioning was associated with greater AIS length and distance from soma; greater length correlated with greater H-reflex increase. Modelling studies in the literature suggest that these increases may increase motoneuron excitability, supporting the hypothesis that they may contribute to H-reflex increase. Up-conditioning did not affect AIS ankyrin G (AnkG) immunoreactivity (IR), p-p38 protein kinase IR, or GABAergic terminals. Successful, but not unsuccessful, H-reflex down-conditioning was associated with more GABAergic terminals on the AIS, weaker AnkG-IR, and stronger p-p38-IR. More GABAergic terminals and weaker AnkG-IR correlated with greater H-reflex decrease. These changes might potentially contribute to the positive shift in motoneuron firing threshold underlying H-reflex decrease; they are consistent with modelling suggesting that sodium channel change may be responsible. H-reflex down-conditioning did not affect AIS dimensions. This evidence that AIS plasticity is associated with and might contribute to H-reflex conditioning adds to evidence that motor learning involves both spinal and brain plasticity, and both neuronal and synaptic plasticity. AIS properties of spinal motoneurons are likely to reflect the combined influence of all the motor skills that share these motoneurons. KEY POINTS: Neuronal action potentials normally begin in the axon initial segment (AIS). AIS plasticity affects neuronal excitability in development and disease. Whether it does so in learning is unknown. Operant conditioning of a spinal reflex, a simple learning model, changes the rat spinal motoneuron AIS. Successful, but not unsuccessful, H-reflex up-conditioning is associated with greater AIS length and distance from soma. Successful, but not unsuccessful, down-conditioning is associated with more AIS GABAergic terminals, less ankyrin G, and more p-p38 protein kinase. The associations between AIS plasticity and successful H-reflex conditioning are consistent with those between AIS plasticity and functional changes in development and disease, and with those predicted by modelling studies in the literature. Motor learning changes neurons and synapses in spinal cord and brain. Because spinal motoneurons are the final common pathway for behaviour, their AIS properties probably reflect the combined impact of all the behaviours that use these motoneurons.

Social reinforcement guides operant behaviour and auditory learning in a songbird

Motivation to seek social interactions is inherent to all social species. For instance, even with risk of disease transmission in a recent pandemic, humans sought out frequent in-person social interactions. In other social animals, socialization can be prioritized even over water or food consumption. Zebra finches, Taeniopygia guttata, are highly gregarious songbirds widely used in behavioural and physiological research. Songbirds, like humans, are vocal learners during development, which rely on intense auditory learning. Aside from supporting song learning, auditory learning further supports individual identification, mate choice and outcome associations in songbirds. To study auditory learning in a laboratory setting, studies often employ operant paradigms with food restriction and reinforcement and require complete social isolation, which can result in stress and other unintended physiological consequences for social species. Thus, in this work, we designed an operant behavioural method leveraging the sociality of zebra finches for goal-directed behaviours. Our approach relies on visual social reinforcement, without depriving the animals of food or social contact. Using this task, we found that visual social reinforcement was a strong motivational drive for operant behaviour. Motivation was sensitive to familiarity towards the stimulus animal and higher when engaging with a familiar versus a novel individual. We further show that this tool can be used to assess auditory discrimination learning using either songs or synthetic pure tones as stimuli. As birds gained experience in the task, they developed a strategy to maximize reward acquisition in spite of receiving more punishment, i.e. liberal response bias. Our operant paradigm provides an alternative to tasks using food reinforcement and could be applied to a variety of highly social species, such as rodents and nonhuman primates.

Two roads leading to the same evaluative conditioning effect? Stimulus-response binding versus operant conditioning

Evaluative Conditioning (EC) refers to changes in our liking or disliking of a stimulus due to its pairing with other positive or negative stimuli. In addition to stimulus-based mechanisms, recent research has shown that action-based mechanisms can also lead to EC effects. Research, based on action control theories, has shown that pairing a positive or negative action with a neutral stimulus results in EC effects (Stimulus-Response binding). Similarly, research studies using Operant Conditioning (OC) approaches have also observed EC effects. The aim of the present study is to directly compare EC effects elicited by two different response-based approaches - S-R bindings and OC. To this end, participants were randomly assigned to an S-R binding procedure and an OC procedure. EC effects were measured in conditions and compared. Implications for EC theory are discussed.

Acute Aromatase Inhibition Impairs Neural and Behavioral Auditory Scene Analysis in Zebra Finches

Auditory perception can be significantly disrupted by noise. To discriminate sounds from noise, auditory scene analysis (ASA) extracts the functionally relevant sounds from acoustic input. The zebra finch communicates in noisy environments. Neurons in their secondary auditory pallial cortex (caudomedial nidopallium, NCM) can encode song from background chorus, or scenes, and this capacity may aid behavioral ASA. Furthermore, song processing is modulated by the rapid synthesis of neuroestrogens when hearing conspecific song. To examine whether neuroestrogens support neural and behavioral ASA in both sexes, we retrodialyzed fadrozole (aromatase inhibitor, FAD) and recorded in vivo awake extracellular NCM responses to songs and scenes. We found that FAD affected neural encoding of songs by decreasing responsiveness and timing reliability in inhibitory (narrow-spiking), but not in excitatory (broad-spiking) neurons. Congruently, FAD decreased neural encoding of songs in scenes for both cell types, particularly in females. Behaviorally, we trained birds using operant conditioning and tested their ability to detect songs in scenes after administering FAD orally or injected bilaterally into NCM. Oral FAD increased response bias and decreased correct rejections in females, but not in males. FAD in NCM did not affect performance. Thus, FAD in the NCM impaired neuronal ASA but that did not lead to behavioral disruption suggesting the existence of resilience or compensatory responses. Moreover, impaired performance after systemic FAD suggests involvement of other aromatase-rich networks outside the auditory pathway in ASA. This work highlights how transient estrogen synthesis disruption can modulate higher-order processing in an animal model of vocal communication.

Does phasic dopamine release cause policy updates?

Phasic dopamine activity is believed to both encode reward-prediction errors (RPEs) and to cause the adaptations that these errors engender. If so, a rat working for optogenetic stimulation of dopamine neurons will repeatedly update its policy and/or action values, thus iteratively increasing its work rate. Here, we challenge this view by demonstrating stable, non-maximal work rates in the face of repeated optogenetic stimulation of midbrain dopamine neurons. Furthermore, we show that rats learn to discriminate between world states distinguished only by their history of dopamine activation. Comparison of these results to reinforcement learning simulations suggests that the induced dopamine transients acted more as rewards than RPEs. However, pursuit of dopaminergic stimulation drifted upwards over a time scale of days and weeks, despite its stability within trials. To reconcile the results with prior findings, we consider multiple roles for dopamine signalling.

A reinforcement learning model with choice traces for a progressive ratio schedule

The progressive ratio (PR) lever-press task serves as a benchmark for assessing goal-oriented motivation. However, a well-recognized limitation of the PR task is that only a single data point, known as the breakpoint, is obtained from an entire session as a barometer of motivation. Because the breakpoint is defined as the final ratio of responses achieved in a PR session, variations in choice behavior during the PR task cannot be captured. We addressed this limitation by constructing four reinforcement learning models: a simple Q-learning model, an asymmetric model with two learning rates, a perseverance model with choice traces, and a perseverance model without learning. These models incorporated three behavioral choices: reinforced and non-reinforced lever presses and void magazine nosepokes, because we noticed that male mice performed frequent magazine nosepokes during PR tasks. The best model was the perseverance model, which predicted a gradual reduction in amplitudes of reward prediction errors (RPEs) upon void magazine nosepokes. We confirmed the prediction experimentally with fiber photometry of extracellular dopamine (DA) dynamics in the ventral striatum of male mice using a fluorescent protein (genetically encoded GPCR activation-based DA sensor: GRABDA2m). We verified application of the model by acute intraperitoneal injection of low-dose methamphetamine (METH) before a PR task, which increased the frequency of magazine nosepokes during the PR session without changing the breakpoint. The perseverance model captured behavioral modulation as a result of increased initial action values, which are customarily set to zero and disregarded in reinforcement learning analysis. Our findings suggest that the perseverance model reveals the effects of psychoactive drugs on choice behaviors during PR tasks.

Role modeling of safety-leadership behaviors in the construction industry: A two-wave longitudinal study

BACKGROUND

The construction industry is heavily affected by occupational accidents, and it is important to investigate how leadership behaviors promoting safety on construction sites are fostered among construction-site managers.

OBJECTIVE

The overall aim of this study was to investigate how safety-leadership behaviors can be developed in the construction industry, specifically focusing on managerial role modeling.

METHODS

A two-wave longitudinal cohort study with approximately four months between measurement occasions was conducted among construction-site supervisors in Sweden (n = 51). Supervisors' ratings of their site managers' and their own generic and safety-specific contingent reward (CR) leadership behaviors were obtained by means of questionnaires. Cross-lagged panel models were tested within a path model framework to test the hypothesis that site managers' leadership behaviors prospectively influence supervisors' leadership behaviors.

RESULTS

Site managers' CR behaviors prospectively influenced supervisors' CR behaviors, both generic CR behaviors (β= 0.29, p = 0.01) and safety-specific CR behaviors (β= 0.22, p = 0.04). For safety-specific CR behaviors, a reversed effect (β= 0.26, p = 0.03) was also found, implying that supervisors' behaviors prospectively influenced site managers' behaviors.

CONCLUSION

Site managers act as role models for supervisors when it comes to developing safety-leadership behaviors on construction sites. The results also indicate that site managers are influenced by their subordinate supervisors' safety-leadership behaviors. Hence, there seems to be reciprocal interaction between site managers and supervisors in which they influence each other and together shape safety-leadership practices at their construction sites.

Nucleus accumbens and dorsal medial striatal dopamine and neural activity are essential for action sequence performance

Separable striatal circuits have unique functions in Pavlovian and instrumental behaviors but how these roles relate to performance of sequences of actions with and without associated cues are less clear. Here, we tested whether dopamine transmission and neural activity more generally in three striatal subdomains are necessary for performance of an action chain leading to reward delivery. Male and female Long-Evans rats were trained to press a series of three spatially distinct levers to receive reward. We assessed the contribution of neural activity or dopamine transmission within each striatal subdomain when progression through the action sequence was explicitly cued and in the absence of cues. Behavior in both task variations was substantially impacted following microinfusion of the dopamine antagonist, flupenthixol, into nucleus accumbens core (NAc) or dorsomedial striatum (DMS), with impairments in sequence timing and numbers of rewards earned after NAc flupenthixol. In contrast, after pharmacological inactivation to suppress overall activity, there was minimal impact on total rewards earned. Instead, inactivation of both NAc and DMS impaired sequence timing and led to sequence errors in the uncued, but not cued task. There was no impact of dopamine antagonism or reversible inactivation of dorsolateral striatum on either cued or uncued action sequence completion. These results highlight an essential contribution of NAc and DMS dopamine systems in motivational and performance aspects of chains of actions, whether cued or internally generated, as well as the impact of intact NAc and DMS function for correct sequence performance.

Slow-rising and fast-falling dopaminergic dynamics jointly adjust negative prediction error in the ventral striatum

The greater the reward expectations are, the more different the brain's physiological response will be. Although it is well-documented that better-than-expected outcomes are encoded quantitatively via midbrain dopaminergic (DA) activity, it has been less addressed experimentally whether worse-than-expected outcomes are expressed quantitatively as well. We show that larger reward expectations upon unexpected reward omissions are associated with the preceding slower rise and following larger decrease (DA dip) in the DA concentration at the ventral striatum of mice. We set up a lever press task on a fixed ratio (FR) schedule requiring five lever presses as an effort for a food reward (FR5). The mice occasionally checked the food magazine without a reward before completing the task. The percentage of this premature magazine entry (PME) increased as the number of lever presses approached five, showing rising expectations with increasing proximity to task completion, and hence greater reward expectations. Fibre photometry of extracellular DA dynamics in the ventral striatum using a fluorescent protein (genetically encoded GPCR activation-based DA sensor: GRABDA2m ) revealed that the slow increase and fast decrease in DA levels around PMEs were correlated with the PME percentage, demonstrating a monotonic relationship between the DA dip amplitude and degree of expectations. Computational modelling of the lever press task implementing temporal difference errors and state transitions replicated the observed correlation between the PME frequency and DA dip amplitude in the FR5 task. Taken together, these findings indicate that the DA dip amplitude represents the degree of reward expectations monotonically, which may guide behavioural adjustment.

Acute but not long-lasting antidepressant-like effect of psilocybin in differential reinforcement of low-rate 72 schedule in rats

BACKGROUND

In clinical studies, psychedelics including psilocybin and D-lysergic acid diethylamide (LSD) demonstrate rapid and persistent antidepressant effects. Since the effective treatment with psychedelics is usually provided with psychotherapy, it is debatable whether their prolonged efficacy can be observed in infrahuman species. Preclinical reports on psychedelics' effects most often address their acute actions, and different tests and models provide inconsistent results. The goal of this study was to examine whether the treatment with psilocybin and/or LSD would demonstrate immediate and/or sustained antidepressant-like effects in the differential reinforcement of low-rate responding (DRL) schedule in rats. In contrast to the antidepressant screening tools, the DRL 72s test is known to detect antidepressants with high predictive validity as it differentiates clinically effective antidepressants from other psychoactive drugs in non-stressed animals.

METHODS

Adult male Sprague Dawley rats were injected over three consecutive days with psilocybin (1 mg/kg), LSD (0.08 mg/kg), or saline and then tested in DRL 72s for the following 4 weeks.

RESULTS

Treatment with psilocybin but not LSD demonstrated an immediate antidepressant-like effect, manifested as an increased number of reinforced presses and response efficiency. By contrast, neither of the drugs showed a long-term (up to 4 weeks following administration) antidepressant-like effect.

CONCLUSIONS

Using DRL 72s schedule of reinforcement, we demonstrated the acute antidepressant-like effect of psilocybin but not of LSD, and failed to detect their persistent antidepressant-like efficacy. The present study suggests that the detection of long-lasting antidepressant-like activity in rats could be challenging and may require entirely novel behavioral methods.

Associative learning in the box jellyfish Tripedalia cystophora

Associative learning, such as classical or operant conditioning, has never been unequivocally associated with animals outside bilatarians, e.g., vertebrates, arthropods, or mollusks. Learning modulates behavior and is imperative for survival in the vast majority of animals. Obstacle avoidance is one of several visually guided behaviors in the box jellyfish, Tripedalia cystophora Conant, 1897 (Cnidaria: Cubozoa), and it is intimately associated with foraging between prop roots in their mangrove habitat. The obstacle avoidance behavior (OAB) is a species-specific defense reaction (SSDR) for T. cystophora, so identifying such SSDR is essential for testing the learning capacity of a given animal. Using the OAB, we show that box jellyfish performed associative learning (operant conditioning). We found that the rhopalial nervous system is the learning center and that T. cystophora combines visual and mechanical stimuli during operant conditioning. Since T. cystophora has a dispersed central nervous system lacking a conventional centralized brain, our work challenges the notion that associative learning requires complex neuronal circuitry. Moreover, since Cnidaria is the sister group to Bilateria, it suggests the intriguing possibility that advanced neuronal processes, like operant conditioning, are a fundamental property of all nervous systems.

Genes Upregulated by Operant Conditioning of Escape Behavior in the Pond Snail Lymnaea stagnalis

The pond snail Lymnaea stagnalis is capable of learning by both classical conditioning and operant conditioning. Although operant conditioning related to escape behavior with punishment has been examined by some research groups, the molecular mechanisms are not known. In the present study, we examined changes in the expression levels of cAMP-response element binding protein 1 (CREB1), CREB2, CREB-binding protein (CBP), and monoamine oxidase (MAO) in the Lymnaea central nervous system (CNS) using real-time PCR following operant conditioning of escape behavior. CREB1 and CREB2 are transcription factors involved in long-term memory in Lymnaea; CBP is a coactivator with CREB1; and MAO is a degrading enzyme for monoamines (e.g., serotonin) with important roles in learning and memory in Lymnaea. In operant conditioning, the punishment cohort, in which snails escaping from the container encountered aversive KCl, exhibited significantly fewer escape attempts than the control cohort, in which snails escaping from the container encountered distilled water, during both the training and memory test periods. After the operant conditioning, CREB1 and CREB2 were upregulated, and the ratio of CREB1/CREB2 was also increased, suggesting that the operant conditioning of escape behavior involves these factors. MAO was also upregulated, suggesting that the content of monoamines such as serotonin in the CNS decreased. The upregulated genes identified in the present study will help to further elucidate learning and memory mechanisms in Lymnaea.

Food Restriction Level and Reinforcement Schedule Differentially Influence Behavior during Acquisition and Devaluation Procedures in Mice

Behavioral strategies are often classified based on whether reinforcer value controls reinforcement. Value-sensitive behaviors, in which animals update their actions when reinforcer value is changed, are classified as goal-directed; conversely, value-insensitive actions, where behavior remains consistent when the reinforcer is removed or devalued, are considered habitual. Basic reinforcement schedules can help to bias behavior toward either process: random ratio (RR) schedules are thought to promote the formation of goal-directed behaviors while random intervals (RIs) promote habitual control. However, how the schedule-specific features of these tasks interact with other factors that influence learning to control behavior has not been well characterized. Using male and female mice, we asked how distinct food restriction levels, a strategy often used to increase task engagement, interact with RR and RI schedules to control performance during task acquisition and devaluation procedures. We determined that food restriction level has a stronger effect on the behavior of mice following RR schedules compared with RI schedules, and that it promotes a decrease in response rate during devaluation procedures that is best explained by the effects of extinction rather than devaluation. Surprisingly, food restriction accelerated the decrease in response rates observed following devaluation across sequential extinction sessions, but not within a single session. Our results support the idea that the relationships between schedules and behavioral control strategies are not clear-cut and suggest that an animal's engagement in a task must be accounted for, together with the structure of reinforcement schedules, to appropriately interpret the cognitive underpinnings of behavior.

The Role of Genetically Distinct Central Amygdala Neurons in Appetitive and Aversive Responding Assayed with a Novel Dual Valence Operant Conditioning Paradigm

To survive, animals must meet their biological needs while simultaneously avoiding danger. However, the neurobiological basis of appetitive and aversive survival behaviors has historically been studied using separate behavioral tasks. While recent studies in mice have quantified appetitive and aversive conditioned responses simultaneously (Jikomes et al., 2016; Heinz et al., 2017), these tasks required different behavioral responses to each stimulus. As many brain regions involved in survival behavior process stimuli of opposite valence, we developed a paradigm in which mice perform the same response (nose poke) to distinct auditory cues to obtain a rewarding outcome (palatable food) or avoid an aversive outcome (mild footshoock). This design allows for both within-subject and between-subject comparisons as animals respond to appetitive and aversive cues. The central nucleus of the amygdala (CeA) is implicated in the regulation of responses to stimuli of either valence. Considering its role in threat processing (Wilensky et al., 2006; Haubensak et al., 2010) and regulation of incentive salience (Warlow and Berridge, 2021), it is important to examine the contribution of the CeA to mechanisms potentially underlying comorbid dysregulation of avoidance and reward (Sinha, 2008; Bolton et al., 2009). Using this paradigm, we tested the role of two molecularly defined CeA subtypes previously linked to consummatory and defensive behaviors. Significant strain differences in the acquisition and performance of the task were observed. Bidirectional chemogenetic manipulation of CeA somatostatin (SOM) neurons altered motivation for reward and perseveration of reward-seeking responses on avoidance trials. Manipulation of corticotropin-releasing factor neurons (CRF) had no significant effect on food reward consumption, motivation, or task performance. This paradigm will facilitate investigations into the neuronal mechanisms controlling motivated behavior across valences.

Dopaminergic D2 receptor modulation of striatal cholinergic interneurons contributes to sequence learning

Learning action sequences is necessary for normal daily activities. Medium spiny neurons (MSNs) in the dorsal striatum (dStr) encode action sequences through changes in firing at the start and/or stop of action sequences or sustained changes in firing throughout the sequence. Acetylcholine (ACh), released from cholinergic interneurons (ChIs), regulates striatal function by modulating MSN and interneuron excitability, dopamine and glutamate release, and synaptic plasticity. Cholinergic neurons in dStr pause their tonic firing during the performance of learned action sequences. Activation of dopamine type-2 receptors (D2Rs) on ChIs is one mechanism of ChI pausing. In this study we show that deleting D2Rs from ChIs by crossing D2-floxed with ChAT-Cre mice (D2Flox-ChATCre), which inhibits dopamine-mediated ChI pausing and leads to deficits in an operant action sequence task and lower breakpoints in a progressive ratio task. These data suggest that D2Flox-ChATCre mice have reduced motivation to work for sucrose reward, but show no generalized motor skill deficits. D2Flox-ChATCre mice perform similarly to controls in a simple reversal learning task, indicating normal behavioral flexibility, a cognitive function associated with ChIs. In vivo electrophysiological recordings show that D2Flox-ChatCre mice have deficits in sequence encoding, with fewer dStr MSNs encoding entire action sequences compared to controls. Thus, ChI D2R deletion appears to impair a neural substrate of action chunking. Virally replacing D2Rs in dStr ChIs in adult mice improves action sequence learning, but not the lower breakpoints, further suggesting that D2Rs on ChIs in the dStr are critical for sequence learning, but not for driving the motivational aspects of the task.

CPT1C is required for synaptic plasticity and oscillatory activity that supports motor, associative and non-associative learning

Carnitine palmitoyltransferase 1c (CPT1C) is a neuron-specific protein widely distributed throughout the CNS and highly expressed in discrete brain areas including the hypothalamus, hippocampus, amygdala and different motor regions. Its deficiency has recently been shown to disrupt dendritic spine maturation and AMPA receptor synthesis and trafficking in the hippocampus, but its contribution to synaptic plasticity and cognitive learning and memory processes remains mostly unknown. Here, we aimed to explore the molecular, synaptic, neural network and behavioural role of CPT1C in cognition-related functions by using CPT1C knockout (KO) mice. CPT1C-deficient mice showed extensive learning and memory deficits. The CPT1C KO animals exhibited impaired motor and instrumental learning that seemed to be related, in part, to locomotor deficits and muscle weakness but not to mood alterations. In addition, CPT1C KO mice showed detrimental hippocampus-dependent spatial and habituation memory, most probably attributable to inefficient dendritic spine maturation, impairments in long-term plasticity at the CA3-CA1 synapse and aberrant cortical oscillatory activity. In conclusion, our results reveal that CPT1C is not only crucial for motor function, coordination and energy homeostasis, but also has a crucial role in the maintenance of learning and memory cognitive functions. KEY POINTS: CPT1C, a neuron-specific interactor protein involved in AMPA receptor synthesis and trafficking, was found to be highly expressed in the hippocampus, amygdala and various motor regions. CPT1C-deficient animals exhibited energy deficits and impaired locomotion, but no mood changes were found. CPT1C deficiency disrupts hippocampal dendritic spine maturation and long-term synaptic plasticity and reduces cortical γ oscillations. CPT1C was found to be crucial for motor, associative and non-associative learning and memory.

Strain-specific changes in nucleus accumbens transcriptome and motivation for palatable food reward in mice exposed to maternal separation

Introduction

In humans, adversity in childhood exerts enduring effects on brain and increases the vulnerability to psychiatric diseases. It also leads to a higher risk of eating disorders and obesity. Maternal separation (MS) in mice has been used as a proxy of stress during infancy. We hypothesized that MS in mice affects motivation to obtain palatable food in adulthood and changes gene expression in reward system.

Methods

Male and female pups from C57Bl/6J and C3H/HeN mice strains were subjected to a daily MS protocol from postnatal day (PND) 2 to PND14. At adulthood, their motivation for palatable food reward was assessed in operant cages.

Results

Compared to control mice, male and female C3H/HeN mice exposed to MS increased their instrumental response for palatable food, especially when the effort required to obtain the reward was high. Importantly, this effect is shown in animals fed ad libitum. Transcriptional analysis revealed 375 genes differentially expressed in the nucleus accumbens of male MS C3H/HeN mice compared to the control group, some of these being associated with the regulation of the reward system (e.g., Gnas, Pnoc). Interestingly, C57Bl/6J mice exposed to MS did not show alterations in their motivation to obtain a palatable reward, nor significant changes in gene expression in the nucleus accumbens.

Conclusion

MS produces long-lasting changes in motivation for palatable food in C3H/HeN mice, but has no impact in C57Bl/6J mice. These behavioral alterations are accompanied by drastic changes in gene expression in the nucleus accumbens, a key structure in the regulation of motivational processes.

The Role of Preventative Medicine Programs in Animal Welfare and Wellbeing in Zoological Institutions

The overarching goal of a preventative medicine program is to minimize the chances of health problems developing and to maximize the chances of detecting health problems early, in a manner that best benefits the animals and the organization. The traditional paradigms of animal welfare, stemming from the five freedoms and being progressively fleshed out to five domains, the 24/7 approach and so forth do not apply perfectly to zoological collections and less so to animals undergoing veterinary treatments. The physiology and behaviour of animals undergoing veterinary treatments, including therapeutic, quarantine and preventative medicine, are derailed from their normal states and their choices and comfort are de facto limited. A paradigm separating animal wellbeing from animal welfare is necessary to instil clarity of thought and to guide actions in regard to the welfare of animals under human care. Using such a model, preventative medicine programs emerge as a cornerstone of zoo and aquarium animal welfare, all the more if it incorporates modern veterinary and husbandry techniques, including operant conditioning.

A comprehensive assay of social motivation reveals sex-specific roles of autism-associated genes and oxytocin

Social motivation is critical to the development of typical social functioning. Social motivation, specifically one or more of its components (e.g., social reward seeking or social orienting), could be relevant for understanding phenotypes related to autism. We developed a social operant conditioning task to quantify effort to access a social partner and concurrent social orienting in mice. We established that mice will work for access to a social partner, identified sex differences, and observed high test-retest reliability. We then benchmarked the method with two test-case manipulations. Shank3B mutants exhibited reduced social orienting and failed to show social reward seeking. Oxytocin receptor antagonism decreased social motivation, consistent with its role in social reward circuitry. Overall, we believe that this method provides a valuable addition to the assessment of social phenotypes in rodent models of autism and the mapping of potentially sex-specific social motivation neural circuits.

Environmental enrichment improves cognitive flexibility in rainbow trout in a visual discrimination task: first insights

Research on fish cognition provides strong evidence that fish are endowed with high level cognitive skills. However, most studies on cognitive flexibility and generalization abilities, two key adaptive traits for captive animals, focused on model species, and farmed fish received too little attention. Environmental enrichment was shown to improve learning abilities in various fish species, but its influence on cognitive flexibility and generalization abilities is still unknown. We studied farmed rainbow trout (Oncorhynchus mykiss) as an aquaculture model to study how environmental enrichment impacts their cognitive abilities. Using an operant conditioning device, allowing the expression of a motivated choice, we measured fish cognitive flexibility with serial reversal learning tests, after a successful acquisition phase based on two colors discrimination (2-alternative forced choice, 2-AFC), and their ability to generalize a rewarded color to any shape. Eight fish were divided into two groups: Condition E (fish reared from fry stages under enriched conditions with plants, rocks and pipes for ~9 months); Condition B (standard barren conditions). Only one fish (condition E) failed in the habituation phase of the device and one fish (condition B) failed in the 2-AFC task. We showed that after a successful acquisition phase in which the fish correctly discriminated two colors, they all succeeded in four reversal learnings, supporting evidence for cognitive flexibility in rainbow trout. They were all successful in the generalization task. Interestingly, fish reared in an enriched environment performed better in the acquisition phase and in the reversal learning (as evidenced by fewer trials needed to reach the learning criterion), but not in the generalization task. We assume that color-based generalization may be a simpler cognitive process than discriminative learning and cognitive flexibility, and does not seem to be influenced by environmental conditions. Given the small number of individuals tested, our results may be considered as first insights into cognitive flexibility in farmed fish using an operant conditioning device, but they pave the way for future studies. We conclude that farming conditions should take into account the cognitive abilities of fish, in particular their cognitive flexibility, by allowing them to live in an enriched environment.

Generalization of Costly Pain-Related Avoidance Based on Real-Life Categorical Knowledge

Avoiding activities posing bodily threat is adaptive. However, spreading of avoidance to safe activities may cause functional disability in people with chronic pain. We investigated whether costly pain-related avoidance would generalize from one activity to another on the basis of real-life categorical knowledge in 40 pain-free people (30 female; mean age = 25 years; university students and public of Maastricht, The Netherlands). In a computer task, participants moved a joystick to complete activities from two categories (gardening and cleaning). During activities from the avoidance category, pain could be avoided at the cost of task efficiency by deviating from a short, pain-associated joystick movement. Activities from the safe category were never painful. Subsequently, we tested generalization of avoidance to novel pain-free activities from both categories. Participants generalized avoidance to novel activities from the avoidance category despite the novel activities not being paired with pain and despite avoidance costs, suggesting that costly (pain-related) avoidance generalizes from one activity to another on the basis of category knowledge and can thus be wide reaching, creating detrimental consequences.

From Prediction to Action: Dissociable Roles of Ventral Tegmental Area and Substantia Nigra Dopamine Neurons in Instrumental Reinforcement

Reward seeking requires the coordination of motor programs to achieve goals. Midbrain dopamine neurons are critical for reinforcement, and their activation is sufficient for learning about cues, actions, and outcomes. Here we examine in detail the mechanisms underlying the ability of ventral tegmental area (VTA) and substantia nigra (SNc) dopamine neurons to support instrumental learning. By exploiting numerous behavioral tasks in combination with time-limited optogenetic manipulations in male and female rats, we reveal that VTA and SNc dopamine neurons generate reinforcement through separable psychological processes. VTA dopamine neurons imbue actions and their associated cues with motivational value that allows flexible and persistent pursuit, whereas SNc dopamine neurons support time-limited, precise, action-specific learning that is nonscalable and inflexible. This architecture is reminiscent of actor-critic reinforcement learning models with VTA and SNc instructing the critic and actor, respectively. Our findings indicate that heterogeneous dopamine systems support unique forms of instrumental learning that ultimately result in disparate reward-seeking strategies.SIGNIFICANCE STATEMENT Dopamine neurons in the midbrain are essential for learning, motivation, and movement. Here we describe in detail the ability of VTA and SNc dopamine neurons to generate instrumental reinforcement, a process where an agent learns about actions they can emit to earn reward. While rats will avidly work and learn to respond for activation of VTA and SNc dopamine neurons, we find that only VTA dopamine neurons imbue actions and their associated cues with motivational value that spur continued pursuit of reward. Our data support a hypothesis that VTA and SNc dopamine neurons engage distinct psychological processes that have consequences for our understanding of these neurons in health and disease.

A Pilot Study on Behavioural and Physiological Indicators of Emotions in Donkeys

Recognizing animal emotions is critical to their welfare and can lead to a better relationship with humans and the environment, especially in a widespread species like the donkey, which is often prone to welfare issues. This study aims to assess the emotional response of donkeys through an operant conditioning task with two presumed different emotional contents. Specifically, a within-subject design including positive and negative conditions was conducted, collecting behavioural and physiological (heart rate variability and HRV) parameters. Facial expressions, postures, and movements were analysed by principal component analysis and behavioural diversity indexes (frequencies, activity budgets, richness, Shannon and Gini-Simpson). During the positive condition, both ears were held high and sideways (left: r = -0.793, p < 0.0001; right: r = -0.585, p = 0.011), while the ears were frontally erected (left: r = 0.924, p < 0.0001; right: r = 0.946, p < 0.0001) during the negative one. The latter was also associated with an increased tendency to walk (r = 0.709, p = 0.001), walk away (r = 0.578, p = 0.012), more frequent changes in the body position (V_{Body position} = 0, p = 0.022), and greater behavioural complexity (V_{Gini-Simpson Index} = 4, p = 0.027). As for HRV analysis, the root mean square of successive beat-to-beat differences (rMSSD) was significantly lower after the negative condition. These non-invasive parameters could be considered as possible indicators of donkeys' emotional state.

Generalization of pain-related avoidance behavior based on de novo categorical knowledge

ABSTRACT

People with chronic pain often fear and avoid movements and activities that were never paired with pain. Safe movements may be avoided if they share some semantic relationship with an actual pain-associated movement. This study investigated whether pain-associated operant responses (movements) can become categorically associated with perceptually dissimilar responses, thus motivating avoidance of new classes of safe movements-a phenomenon known as category-based avoidance generalization. Using a robotic arm, 2 groups were trained to categorize arm movements in different ways. Subsequently, the groups learned through operant conditioning that an arm movement from one of the categories was paired with a high probability of pain, whereas the others were paired with either a medium probability of pain or no pain (acquisition phase). Self-reported pain-related fear and pain expectancy were collected as indices of fear learning. During a final generalization test phase, the movements categorically related to those from the acquisition phase were made available but in the absence of pain. Results showed that the generalization of outcome measures depended on the categorical connections between arm movements, ie, the groups avoided and feared the novel generalization movement categorically related to the pain-associated acquisition movement, depending on how they had previously learned to categorize the movements. This suggests that operant pain-related avoidance can generalize to safe behaviors, which are not perceptually, but categorically, similar to a pain-associated behavior. This form of pain-related avoidance generalization is problematic because category-based relations can be extremely wide reaching and idiosyncratic. Thus, category-based generalization of operant pain-related avoidance merits further investigation.

Biomarkers for rapid H-reflex operant conditioning among females

Operant conditioning of a spinal monosynaptic pathway using the Hoffman reflex (H-reflex) is well established in animal and human studies. There is a subset within the human population (∼20% nonresponders) who are unable to up train this pathway suggesting some distinct or unique identifying characteristics. Importantly, females, who have a nine times higher rate of injury during human performance activities than men, have been understudied in areas of CNS neuroplasticity. Our long-term goal is to understand if innate ability to rapidly up train the H-reflex is predictive of future performance-based injury among females. In this study, we primarily determined whether healthy, young females could rapidly increase the H-reflex within a single session of operant conditioning and secondarily determined if electro-physiological, humoral, cognitive, anthropometric, or anxiety biomarkers distinguished the responders from nonresponders. Eighteen females (mean age: 24) participated in the study. Overall, females showed a group main effect for up training the H-reflex (P < 0.05). Of the cohort, 10 of 18 females met the criteria for up training the H-reflex (responders). The responders showed lower levels of estradiol (P < 0.05). A multivariate stepwise regression model supported that extracellular to intracellular water ratio (ECW/ICW) and H-max/M-max ratio explained 60% of the variation in up training among females. These findings support that females can acutely upregulate the H-reflex with training and that electro-physiological and hormonal factors may be associated with the up training.NEW & NOTEWORTHY Young females who acutely increase their H-reflexes with operant conditioning had lower levels of estradiol. However, the best predictors of those who could up-train the H-reflex were baseline H-reflex excitability (H-max/M-max) and extracellular to intracellular water ratio (ECW/ICW). Future studies are warranted to understand the complex relationship between operant conditioning, human performance, and injury among active young females.

Corrigendum: Image discrimination reversal learning is impaired by sleep deprivation in rats: Cognitive rigidity or fatigue?

[This corrects the article DOI: 10.3389/fnsys.2022.1052441.].

Male Stressed Mice Having Behavioral Control Exhibit Escalations in Dorsal Dentate Adult-Born Neurons and Spatial Memory

An escapable (ES)/inescapable stress (IS) paradigm was used to study whether behavioral control and repeated footshock stressors may affect adult neurogenesis and related cognitive function. Male stressed mice having behavioral control (ES) had a short-term escalation in dorsal dentate gyrus (DG) neurogenesis, while similarly stressed mice having no such control had unaltered neurogenesis as compared to control mice receiving no stressors. Paradoxically, ES and IS mice had comparable stress-induced corticosterone elevations throughout the stress regimen. Appetitive operant conditioning and forced running procedures were used to model learning and exercise effects in this escapable/inescapable paradigm. Further, conditioning and running procedures did not seem to affect the mice's corticosterone or short-term neurogenesis. ES and IS mice did not show noticeable long-term changes in their dorsal DG neurogenesis, gliogenesis, local neuronal density, apoptosis, autophagic flux, or heterotypic stress responses. ES mice were found to have a greater number of previously labeled and functionally integrated DG neurons as compared to IS and control mice 6 weeks after the conclusion of the stressor regimen. Likewise, ES mice outperformed IS and non-stressed control mice for the first two, but not the remaining two, trials in the object location task. Compared to non-stressed controls, temozolomide-treated ES and IS mice having a lower number of dorsal DG 6-week-old neurons display poor performance in their object location working memory. These results, taken together, prompt us to conclude that repeated stressors, albeit their corticosterone secretion-stimulating effect, do not necessary affect adult dorsal DG neurogenesis. Moreover, stressed animals having behavioral control may display adult neurogenesis escalation in the dorsal DG. Furthermore, the number of 6-week-old and functionally-integrated neurons in the dorsal DG seems to confer the quality of spatial location working memory. Finally, these 6-week-old, adult-born neurons seem to contribute spatial location memory in a use-dependent manner.

The gold-standard treatment for social anxiety disorder: A roadmap for the future

Exposure therapy (ET), which follows the Pavlovian extinction model, is regarded as the gold-standard treatment for social anxiety disorder (SAD). The prospect of virtual reality in lieu of a traditional laboratory setting for the treatment of SAD has not been rigorously explored. The aim of the review was to summarize, find gaps in the current literature, and formulate future research direction by identifying two broad research questions: the comparative efficacy between in vivo ET and virtual reality exposure therapy (VRET) and the effectiveness of the Pavlovian extinction model in treating SAD. The criteria for effectiveness were effect size, relapse prevention, attrition rate and ecological validity. A literature search on recent randomized controlled trials yielded a total of 6 original studies (N=358), excluding duplication and overlapping participants. All studies supported that VRET was as effective as in vivo ET. Behavioral therapy that follows classical conditioning principles has a high attrition and relapse rate. Comparisons were drawn between the efficacy of the Pavlovian extinction model and other existing models, including third-wave approaches. The neural markers are suggested to be included as efficacy measures in treating SAD. The gold-standard treatment for SAD requires a paradigm shift through rigorous longitudinal comparative studies.

Behavioral responses to baited enclosure method that activates habituation in stray dogs

Background and Aim

The behavioral mechanism of stray dog occurrence is associated with domestication process. This study aimed to investigate the population and demographic relationship of stray dogs from our ecological habitat. We tested whether baited enclosure method could be used as an operant conditioning treat-ment to activate habituation behavior in stray dogs.

Materials and Methods

The first investigation determined the population and demographic characteristics of stray dogs in the metropolitan city of Bangkok using the mark and recapture procedure. In the second investigation, a large cage equipped with a digital camera was used as the feeding and habituation area. Food was provided at four corners for 2 h. The approach behaviors and eating patterns were recorded during this period for 7 days.

Results

The average number of stray dogs calculated within each cluster was 24 ± 6 dogs. For the natural small habitat, the density of stray dogs was 662 dogs per km². This indicated that the number of dogs is underestimated using the mark and recapture procedure because of undetected puppies and shifts in the sex ratio in adult dogs. In the second investigation, we demonstrated that food was a potent positive reinforcer for stray dogs. The average onset of cage entry after offering the food was 17 min. The onset of cage entry and the reduction in the first meal duration suggested that the habituation process could be achieved within 1 week.

Conclusion

The results revealed the possibility of using a large cage as a novel enclosure for food offered as the positive reinforcer for TNR program trapping procedures. We suggest that this humane trapping procedure could be used to activate habituation behavior in stray dogs.

Disruptions in network plasticity precede deficits in memory following inhibition of retinoid signaling

Retinoic acid, the active metabolite of vitamin A, is important for vertebrate cognition and hippocampal plasticity, but few studies have examined its role in invertebrate learning and memory, and its actions in the invertebrate central nervous system are currently unknown. Using the mollusc Lymnaea stagnalis, we examined operant conditioning of the respiratory behavior, controlled by a well-defined central pattern generator (CPG), and used citral to inhibit retinoic acid signaling. Both citral- and vehicle-treated animals showed normal learning, but citral-treated animals failed to exhibit long-term memory at 24 h. Cohorts of citral- or vehicle-treated animals were dissected into semi-intact preparations, either 1 h after training, or after the memory test 24 h later. Simultaneous electrophysiological recordings from the CPG pacemaker cell (right pedal dorsal 1; RPeD1) and an identified motorneuron (VI) were made while monitoring respiratory activity (pneumostome opening). Activity of the CPG pneumostome opener interneuron (input 3 interneuron; IP3) was also monitored indirectly. Vehicle-treated conditioned preparations showed significant changes in network parameters immediately after learning, such as reduced motorneuron bursting activity (from IP3 input), delayed pneumostome opening, and decoupling of coincident IP3 input within the network. However, citral-treated preparations failed to exhibit these network changes and more closely resembled naïve preparations. Importantly, these citral-induced differences were manifested immediately after training and before any overt changes in the behavioral response (memory impairment). These studies shed light on where and when retinoid signaling might affect a central pattern-generating network to promote memory formation during conditioning of a homeostatic behavior.NEW & NOTEWORTHY We provide novel evidence for how conditioning-induced changes in a CPG network are disrupted when retinoid signaling is inhibited. Inhibition of retinoic acid signaling prevents long-term memory formation following operant conditioning, but has no effect on learning. Simultaneous electrophysiological and behavioral analyses indicate network changes immediately following learning, but these changes are prevented with inhibition of retinoid signaling, before any overt changes in behavior. These data suggest sites for retinoid actions during memory formation.

Image discrimination reversal learning is impaired by sleep deprivation in rats: Cognitive rigidity or fatigue?

Introduction

Insufficient sleep is pervasive worldwide, and its toll on health and safety is recapitulated in many settings. It is thus important to understand how poor sleep affects the brain and decision making. A robust literature documents the adverse effects of sleep deprivation on cognitive processes including cognitive flexibility, which is the capacity to appraise new feedback and make behavioral adjustments to respond appropriately. Animal models are often used to unravel the molecules, genes and neural circuits that are altered by sleep loss. Herein we take a translational approach to model the effects of sleep deprivation on cognitive rigidity, i.e., impaired cognitive flexibility in rats.

Methods

There are several approaches to assess cognitive rigidity; in the present study, we employ a pairwise discrimination reversal task. To our knowledge this is the first time this paradigm has been used to investigate sleep deprivation. In this touchscreen operant platform, we trained rats to select one of two images to claim a sucrose pellet reward. If the non-rewarded image was selected the rats proceeded to a correction trial where both images were presented in the same position as before. This image presentation continued until the rat selected the correct image. Once rats reached performance criteria, the reward contingencies were reversed. In one group of rats the initial reversal session was preceded by 10 h of sleep deprivation. We compared those rats to controls with undisturbed sleep on the number of sessions to reach performance criteria, number of trials per session, response latencies, correct responses, errors, perseverative errors and perseveration bouts in the initial training and reversal phases.

Results

We report that on reversal session one, sleep deprived rats completed a fraction of the trials completed by controls. On subsequent reversal sessions, the sleep deprived rats struggled to adapt to the reversed contingencies despite completing a similar number of trials, suggesting an effect of cognitive rigidity separate from fatigue.

Discussion

We discuss the delayed performance dynamics incurred by sleep loss in the context of fatigue and the implications of using pairwise discrimination reversal as a model to further examine the effects of sleep loss on adaptive decision making.

When shared pain is not half the pain: enhanced central nervous system processing and verbal reports of pain in the presence of a solicitous spouse

ABSTRACT

The experience of pain and pain behaviors is not only determined by physiological but also psychosocial factors. In this context, the learning history of the individual and specifically operant reinforcement related to spouse responses might play an important role. We investigated the effect of a solicitous and habitually pain-reinforcing spouse for the processing of pain in patients with chronic pain. Using multichannel electroencephalography, pain behaviors, and self-reports of pain, we examined 20 patients with chronic back pain (10 with solicitous and 10 with nonsolicitous spouses) and 10 matched healthy controls. The participants received a series of painful and nonpainful electrical stimuli applied to the site of pain (back) and a control area (finger) in the presence vs absence of the spouse. The global field power of the electroencephalogram with a focus in the frontal region was enhanced in patients with chronic back pain who had a solicitous spouse compared to those with a nonsolicitous spouse and the healthy controls. This was specific for the painful stimulation at the back and occurred only in the presence but not the absence of the spouse. Pain ratings of intensity and unpleasantness were also higher in the patients with solicitous spouses when the spouse was present during painful stimulation. These data suggest that significant other responses indicative of operant reinforcement may have a direct effect on the cerebral processing of pain and related pain perception.

Know Your Movements: Poorer Proprioceptive Accuracy is Associated With Overprotective Avoidance Behavior

Pain-related avoidance of movements that are actually safe (ie, overprotective behavior) plays a key role in chronic pain disability. Avoidance is reinforced through operant learning: after learning that a certain movement elicits pain, movements that prevent pain are more likely to be performed. Proprioceptive accuracy importantly contributes to motor learning and memory. Interestingly, reduced accuracy has been documented in various chronic pain conditions, prompting the question whether this relates to avoidance becoming excessive. Using robotic arm-reaching movements, we tested the hypothesis that poor proprioceptive accuracy is associated with excessive pain-related avoidance in pain-free participants. Participants first performed a task to assess proprioceptive accuracy, followed by an operant avoidance training during which a pain stimulus was presented when they performed one movement trajectory, but not when they performed another trajectory. During a test phase, movements were no longer restricted to 2 trajectories, but participants were instructed to avoid pain. Unbeknownst to the participants, the pain stimulus was never presented during this phase. Results supported our hypothesis. Furthermore, exploratory analyses indicated a reduction in proprioceptive accuracy after avoidance learning, which was associated with excessive avoidance and higher trait fear of pain. PERSPECTIVE: This study is the first to show that poorer proprioceptive accuracy is associated with excessive pain-related avoidance. This finding is especially relevant for chronic pain conditions, as reduced accuracy has been documented in these populations, and points toward the need for research on training accuracy to tackle excessive avoidance.

Operant down-conditioning of the soleus H-reflex in people after stroke

Through operant conditioning, spinal reflex behaviors can be changed. Previous studies in rats indicate that the sensorimotor cortex and corticospinal tract are essential in inducing and maintaining reflex changes induced through conditioning. In people with incomplete spinal cord injury (SCI), an operant down-conditioning protocol decreased the soleus H-reflex size and improved walking speed and symmetry, suggesting that a partially preserved spinal cord can support conditioning-induced plasticity and benefit from it. This study examined whether down-conditioning can decrease the soleus H-reflex in people with supraspinal injury (i.e., cortical or subcortical stroke). Operant down-conditioning was applied to the soleus H-reflex in a cohort of 12 stroke people with chronic spastic hemiparesis (>12 months from stroke onset of symptoms). Each participant completed 6 baseline and 30 conditioning sessions over 12 weeks. In each baseline session, 225 control H-reflexes were elicited without any feedback on H-reflex size. In each conditioning session, 225 conditioned H-reflexes were elicited while the participant was asked to decrease H-reflex size and was given visual feedback as to whether the resulting H-reflex was smaller than a criterion value. In six of 12 participants, the conditioned H-reflex became significantly smaller by 30% on average, whereas in other 6 participants, it did not. The difference between the subgroups was largely attributable to the difference in across-session control reflex change. Ten-meter walking speed was increased by various extent (+0.04 to +0.35, +0.14 m/s on average) among the six participants whose H-reflex decreased, whereas the change was 0.00 m/s on average for the rest of participants. Although less than what was seen in participants with SCI, the fact that conditioning succeeded in 50% of stroke participants supports the feasibility of reflex down-conditioning in people after stroke. At the same time, the difference in across-session control reflex change and conditioning success rate may reflect a critical role of supraspinal activity in producing long-term plasticity in the spinal cord, as previous animal studies suggested.

Effects of Noise Exposure and Aging on Behavioral Tone Detection in Quiet and Noise by Mice

Aging leads to degeneration of the peripheral and central auditory systems, hearing loss, and difficulty understanding sounds in noise. Aging is also associated with changes in susceptibility to or recovery from damaging noise exposures, although the effects of the interaction between acute noise exposure and age on the perception of sounds are not well studied. We tested these effects in the CBA/CaJ mouse model of age-related hearing loss using operant conditioning procedures before and after noise exposure and longitudinally measured changes in their sensitivity for detecting tones in quiet or noise backgrounds. Cochleae from a subset of the behaviorally tested mice were immunolabeled to examine organ of Corti damage relative to what is expected based on aging alone. Mice tested in both quiet and noise background conditions experienced worse behavioral sensitivity immediately after noise exposure, but mice exposed at older ages generally showed greater threshold shifts and reduced recovery over time. Surprisingly, day-to-day stability in thresholds was markedly higher for mice detecting signals in the presence of a noise masker compared with detection in quiet conditions. Cochlear analysis revealed decreases in the total number of outer hair cells (OHCs) and the number of ribbons per inner cell in high-frequency regions in aged, noise-exposed mice relative to aging alone. Our findings build on previous work showing interactions between age and noise exposure and add that background noise can increase the stability of behavioral hearing sensitivity after noise damage.

Alike, But Not Quite: Comparing the Generalization of Pain-Related Fear and Pain-Related Avoidance

Pain-related fear and -avoidance crucially contribute to pain chronification. People with chronic pain may adopt costly avoidance strategies above and beyond what is necessary, aligning with experimental findings of excessive fear generalization to safe movements in these populations. Furthermore, recent evidence suggests that, when avoidance is costly, it can dissociate from fear. Here, we investigated whether concurrently measured pain-related fear and costly avoidance generalization correspond in one task. We also explored whether healthy participants avoid excessively despite associated costs, and if avoidance would decrease as a function of dissimilarity from a pain-associated movement. In a robotic arm-reaching task, participants could avoid a low-cost, pain-associated movement trajectory (T+), by choosing a high-cost non-painful movement trajectory (T-), at opposite ends of a movement plane. Subsequently, in the absence of pain, we introduced three movement trajectories (G1-3) between T+ and T-, and one movement trajectory on the side of T- opposite to T+ (G4), linearly increasing in costs from T+ to G4. Avoidance was operationalized as maximal deviation from T+, and as trajectory choice. Fear learning was measured using self-reported pain-expectancy, pain-related fear, and startle eye-blink electromyography. Self-reports generalized, both decreasing with increasing distance from T+. In contrast, all generalization trajectories were chosen equally, suggesting that avoidance-costs and previous pain balanced each other out. No effects emerged in the electromyography. These results add to a growing body of literature showing that (pain-related) avoidance, especially when costly, can dissociate from fear, calling for a better understanding of the factors motivating, and mitigating, disabling avoidance. PERSPECTIVE: This article presents a comparison of pain-related fear- and avoidance generalization, and an exploration of excessive avoidance in healthy participants. Our findings show that pain-related avoidance can dissociate from fear, especially when avoidance is costly, calling for a better understanding of the factors motivating and mitigating disabling avoidance.

Detailed mapping of behavior reveals the formation of prelimbic neural ensembles across operant learning

The prelimbic cortex (PrL) is involved in the organization of operant behaviors, but the relationship between longitudinal PrL neural activity and operant learning and performance is unknown. Here, we developed deep behavior mapping (DBM) to identify behavioral microstates in video recordings. We combined DBM with longitudinal calcium imaging to quantify behavioral tuning in PrL neurons as mice learned an operant task. We found that a subset of PrL neurons were strongly tuned to highly specific behavioral microstates, both task and non-task related. Overlapping neural ensembles were tiled across consecutive microstates in the response-reinforcer sequence, forming a continuous map. As mice learned the operant task, weakly tuned neurons were recruited into new ensembles, with a bias toward behaviors similar to their initial tuning. In summary, our data suggest that the PrL contains neural ensembles that jointly encode a map of behavioral states that is fine grained, is continuous, and grows during operant learning.

Sex differences in the reward value of familiar mates in prairie voles

The rewarding properties of social interactions facilitate relationship formation and maintenance. Prairie voles are one of the few laboratory species that form selective relationships, manifested as "partner preferences" for familiar partners versus strangers. While both sexes exhibit strong partner preferences, this similarity in outward behavior likely results from sex-specific neurobiological mechanisms. We recently demonstrated that in operant trials, females worked hardest for access to familiar conspecifics of either sex, while males worked equally hard for access to any female, indicating a sex difference in social motivation. As tests were performed with one social target at a time, males might have experienced a ceiling effect, and familiar females might be more relatively rewarding in a choice scenario. Here we performed an operant social choice task in which voles lever-pressed to gain temporary access to either the chamber containing their mate or one containing a novel opposite-sex vole. Females worked hardest to access their mate, while males pressed at similar rates for either female. Individual male behavior was heterogeneous, congruent with multiple mating strategies in the wild. Voles exhibited preferences for favorable over unfavorable environments in a non-social operant task, indicating that lack of social preference does not reflect lack of discrimination. Natural variation in oxytocin receptor genotype at the intronic single nucleotide polymorphism NT213739 was associated with oxytocin receptor density, and predicted individual variation in stranger-directed aggressive behavior. These findings suggest that convergent preference behavior in male and female voles results from sex-divergent pathways, particularly in the realm of social motivation.

High-throughput automated methods for classical and operant conditioning of Drosophila larvae

Learning which stimuli (classical conditioning) or which actions (operant conditioning) predict rewards or punishments can improve chances of survival. However, the circuit mechanisms that underlie distinct types of associative learning are still not fully understood. Automated, high-throughput paradigms for studying different types of associative learning, combined with manipulation of specific neurons in freely behaving animals, can help advance this field. The Drosophila melanogaster larva is a tractable model system for studying the circuit basis of behaviour, but many forms of associative learning have not yet been demonstrated in this animal. Here, we developed a high-throughput (i.e. multi-larva) training system that combines real-time behaviour detection of freely moving larvae with targeted opto- and thermogenetic stimulation of tracked animals. Both stimuli are controlled in either open- or closed-loop, and delivered with high temporal and spatial precision. Using this tracker, we show for the first time that Drosophila larvae can perform classical conditioning with no overlap between sensory stimuli (i.e. trace conditioning). We also demonstrate that larvae are capable of operant conditioning by inducing a bend direction preference through optogenetic activation of reward-encoding serotonergic neurons. Our results extend the known associative learning capacities of Drosophila larvae. Our automated training rig will facilitate the study of many different forms of associative learning and the identification of the neural circuits that underpin them.

Custom-Built Operant Conditioning Setup for Calcium Imaging and Cognitive Testing in Freely Moving Mice

Operant chambers are widely used in animal research to study cognition, motivation, and learning processes. Paired with the rapidly developing technologies for brain imaging and manipulations of brain activity, operant conditioning chambers are a powerful tool for neuroscience research. The behavioral testing and imaging setups that are commercially available are often quite costly. Here, we present a custom-built operant chamber that can be constructed in a few days by an unexperienced user with relatively inexpensive, widely available materials. The advantages of our operant setup compared with other open-source and closed-source solutions are its relatively low cost, its support of complex behavioral tasks, its user-friendly setup, and its validated functionality with video imaging of behavior and calcium imaging using the UCLA Miniscope. Using this setup, we replicate our previously published findings showing that mice exposed to social defeat stress in adolescence have inhibitory control impairments in the Go/No-Go task when they reach adulthood. We also present calcium imaging data of medial prefrontal cortex (mPFC) neuronal activity acquired during Go/No-Go testing in freely moving mice and show that neuronal population activity increases from day 1 to day 14 of the task. We propose that our operant chamber is a cheaper alternative to its commercially available counterparts and offers a better balance between versatility and user-friendly setup than other open-source alternatives.

Paternal alcohol exposure reduces acquisition of operant alcohol self-administration and affects Bdnf DNA methylation in male and female offspring

Familial transmission of alcohol use disorder reflects genetic and environmental factors. Paternal alcohol exposure may affect rodent offspring via epigenetic modifications transmitted through the male germ line. While such exposure alters alcohol sensitivity in mouse offspring, no studies examined if it impacts the development of operant alcohol self-administration in rats. We exposed male (sires) Wistar rats to chronic intermittent ethanol in vapour chambers (16 h/day; 5 days/week) or to air for 6 weeks. Eight weeks later, rats were mated with alcohol-naive females. Adult alcohol- and control-sired F1 offspring were assessed in acquisition of alcohol self-administration in which increasing alcohol concentrations (2.5%, 5% and 10%, v/v) were delivered after one lever press (fixed ratio 1 or FR1). Prior to alcohol sessions, rats were trained to lever press for food delivery under an FR1 schedule of reinforcement. DNA methylation levels of the brain derived neurotrophic factor (Bdnf) gene were measured in sperm, nucleus accumbens (NAc) and medial prefrontal cortex (mPFC) in sires and in offspring. Alcohol-exposed sires had lower Bdnf DNA methylation levels in NAc and greater methylation levels in mPFC. Although this pattern was not recapitulated in offspring, alcohol-sired offspring of both sexes did show aberrant Bdnf DNA methylation patterns compared to control-sired offspring. Alcohol-sired offspring self-administered less alcohol (5% and 10%) with no group differences in food responding. Results indicate that paternal alcohol exposure prior to conception protects against alcohol's initial reinforcing effects but the pattern of dysregulated Bdnf methylation in reward-related circuitry did not mimic changes seen in sires.

Deprivation of direct adult contact during development affects social representation in a songbird

Social cognition involves a wide array of skills that are built largely through interactions with conspecifics and therefore depend upon early social experience. Motivation for social stimuli is a key feature of social behavior and an operant conditioning task showed that isolated wild-caught adult starlings (Sturnus vulgaris) are highly motivated to access pictures of other starlings. Here, we show that hand-raised adult starlings maintained in groups of peers throughout development but without any contact with adult models were not or only poorly motivated to access pictures of conspecifics. Moreover, they did not prefer pictures of starlings to pictures of landscapes, unlike birds wild-caught as adults. These results raise questions about the role of social experience during development, particularly with adult models, in the development of social motivation and of social representation in general.

When do physicians perceive the success of a new care model differently?

BACKGROUND

The health care innovation "MamBo - people with multimorbidity in outpatient care: patient-focused and needs-oriented healthcare management" aims to improve the efficiency and quality of care for multimorbid patients by delegating tasks (e.g. taking over house calls or coordinating specialist appointments) to a monitoring and coordination assistant (MoniKa). Participating physicians are very important for the success of the health care innovation due to their direct involvement as practitioners and their task of enrolling patients. The aim of this part of the evaluation study is therefore to identify the physicians' personal values, which influence the individual perception of the project's advantages and thus possibly the acceptance and sustainable implementation of new care structures.

METHODS

Two Focus groups (n = 4; n = 6) and three individual interviews with general practitioners and specialists who decided to implement the health care innovation within the first year were conducted. The semi-structured guidelines were developed by the research team. The interviews were analysed according to the content analysis by Mayring. We used the learning model of operant conditioning to place our study results in a theoretical context.

RESULT

Two central personal values of the participants, which determine the desired advantages of the health care innovation were identified: More patient-oriented and more economic-oriented values. Participants with more patient-oriented values quickly perceived advantages, which seems to be beneficial for the acceptance of the new care structures. Economic-oriented participants tended to be more critical. The benefits of the health care innovation, which was expressed, for example, in an improvement of the practice routine, has not yet been perceived by this group, or only to a limited extent.

CONCLUSIONS

The results suggest that the respective values of the participants define the individual perceived advantages and thus, the assessment of the success of the health care innovation in general. These findings could be used in the implementation process by increasing the motivation of the project participants through typified supervision.

TRIAL REGISTRATION

The study has been registered in the German Clinical Trials Register ( DRKS00014047 ).

When Do We Not Face Our Fears? Investigating the Boundary Conditions of Costly Pain-Related Avoidance Generalization

Excessive generalization of fear and avoidance are hallmark symptoms of chronic pain disability, yet research focusing on the mechanisms underlying generalization of avoidance specifically, is scarce. Two experiments investigated the boundary conditions of costly pain-related avoidance generalization in healthy participants who learned to avoid pain by performing increasingly effortful (in terms of deviation and force) arm-movements using a robot-arm (acquisition). During generalization, novel, but similar arm-movements, without pain, were tested. Experiment 1 (N = 64) aimed to facilitate generalization to these movements by reducing visual contextual changes between acquisition and generalization, whereas Experiment 2 (N = 70) aimed to prevent extinction by increasing pain uncertainty. Both experiments showed generalization of pain-expectancies and pain-related fear. However, Experiment 2 was the first and only to also demonstrate generalization of avoidance, ie, choosing the novel effortful arm-movements in the absence of pain. These results suggest that uncertainty about the occurrence of pain may delay recovery, due to reduced disconfirmation of threat beliefs when exploring, resulting in persistent avoidance. PERSPECTIVE: This article demonstrates generalization of instrumentally acquired costly pain-related avoidance in healthy people under conditions of uncertainty. The results suggest that targeting pain-related uncertainty may be a useful tool for clinicians adopting a psychological approach to treating excessive pain-related avoidance in chronic pain.

Dairy Heifer Motivation for Access to a Shaded Area

We used an operant conditioning paradigm to test the motivation of non-pregnant dairy heifers to access shade during the summer and autumn months (January to June) in southern Brazil. Dairy heifers (n = 18) were trained to push a weighted gate to access either an experimental area containing both a shaded (simple tree shade and shade cloth) and unshaded area (WITH SHADE) or an experimental area with no shade (BARREN). The latency to push the weighted gate, and the maximum weight pushed by each heifer, were recorded in both the summer and the autumn. Temperature and humidity were recorded continuously for the duration of the study and were used to calculate the heat index. The maximum weight pushed to enter the WITH SHADE area was greater in summer than in autumn, and was inversely related to the latency to push the weighted gate. Heifers refused to work for access to the BARREN environment. As expected, both the maximum ambient temperatures and heat index were higher in summer than in autumn, and also higher in the non-shaded areas than under the shade in both seasons. Heifers of higher social rank displaced other heifers more often, and spent more time in the shaded areas, particularly in the area with trees plus a shade cloth, than the intermediate and subordinate heifers. We conclude that shade is an important and valued resource for heifers reared on pasture-based systems in sub-tropical environments, particularly during the hot summer months.

Midbrain-Level Neural Correlates of Behavioral Tone-in-Noise Detection: Dependence on Energy and Envelope Cues

Hearing in noise is a problem often assumed to depend on encoding of energy level by channels tuned to target frequencies, but few studies have tested this hypothesis. The present study examined neural correlates of behavioral tone-in-noise (TIN) detection in budgerigars (Melopsittacus undulatus, either sex), a parakeet species with human-like behavioral sensitivity to many simple and complex sounds. Behavioral sensitivity to tones in band-limited noise was assessed using operant-conditioning procedures. Neural recordings were made in awake animals from midbrain-level neurons in the inferior colliculus, the first processing stage of the ascending auditory pathway with pronounced rate-based encoding of stimulus amplitude modulation. Budgerigar TIN detection thresholds were similar to human thresholds across the full range of frequencies (0.5-4 kHz) and noise levels (45-85 dB SPL) tested. Also as in humans, thresholds were minimally affected by a challenging roving-level condition with random variation in background-noise level. Many midbrain neurons showed a decreasing response rate as TIN signal-to-noise ratio (SNR) was increased by elevating the tone level, a pattern attributable to amplitude-modulation tuning in these cells and the fact that higher SNR tone-plus-noise stimuli have flatter amplitude envelopes. TIN thresholds of individual neurons were as sensitive as behavioral thresholds under most conditions, perhaps surprisingly even when the unit's characteristic frequency was tuned an octave or more away from the test frequency. A model that combined responses of two cell types enhanced TIN sensitivity in the roving-level condition. These results highlight the importance of midbrain-level envelope encoding and off-frequency neural channels for hearing in noise.SIGNIFICANCE STATEMENT Detection of target sounds in noise is often assumed to depend on energy-level encoding by neural processing channels tuned to the target frequency. In contrast, we found that tone-in-noise sensitivity in budgerigars was often greatest in midbrain neurons not tuned to the test frequency, underscoring the potential importance of off-frequency channels for perception. Furthermore, the results highlight the importance of envelope processing for hearing in noise, especially under challenging conditions with random variation in background noise level over time.

Strepsirrhine Primate Training Programs in North American Institutions: Status and Implications for Future Welfare Assessment

Simple Summary

Training techniques are based on operant conditioning learning (the behavior is modified by its consequences). In many nonhuman primate species, they have been used to influence animals to perform specific behaviors voluntarily and cooperate with routine husbandry and veterinary procedures. However, the information regarding the suborder of strepsirrhine primates (lemurs, lorises, and galagos) is scarce. We assessed the development and current status of training programs with these species in North American institutions through an online survey. We collected information related to training program details; animals, behaviors, and techniques; the evaluation process; and the impact of training. Seventy-one organizations completed the survey, with results showing that 97% trained their strepsirrhines with the main objectives of husbandry and veterinary care (around 80%). Sixty-eight percent of organizations did not report any risk in training these species. The benefits reported include increases in positive human–animal interactions, psychological well-being, and staff awareness of animal behaviors, supporting the success of these programs in providing optimal care for these nonhuman primates. However, we need to improve our understanding of the impact of training on the welfare of strepsirrhine primates, and we hope that the data offered in this survey can help in this future assessment.

Abstract

Many articles have shown the benefits of operant conditioning training techniques in the care and welfare of several species of nonhuman primates; however, the information regarding their use in strepsirrhine species is scarce. We assessed the development and current status of training programs with these species in North American institutions. An online survey was distributed through members of the Association of Zoos and Aquariums using a multiple-choice format. We collected information related to training program details; animals, behaviors, and techniques; the evaluation process; and the impact of training. Seventy-one organizations completed the survey, with the results showing that 97% of respondents trained their strepsirrhines with the main objective of husbandry and veterinary care (around 80%). Sixty-eight percent of organizations did not report any risk in training these species. The benefits reported include increases in positive human–animal interactions (97%), psychological well-being (88%), and staff awareness of animal behaviors (90%). However, a multi-dimensional approach to measure the efficacy of training could provide a deeper understanding of its impact on the welfare of strepsirrhine primates. We hope that the data offered in this survey can help in this future assessment.

Rest Is Required to Learn an Appetitively-Reinforced Operant Task in Drosophila

Maladaptive operant conditioning contributes to development of neuropsychiatric disorders. Candidate genes have been identified that contribute to this maladaptive plasticity, but the neural basis of operant conditioning in genetic model organisms remains poorly understood. The fruit fly Drosophila melanogaster is a versatile genetic model organism that readily forms operant associations with punishment stimuli. However, operant conditioning with a food reward has not been demonstrated in flies, limiting the types of neural circuits that can be studied. Here we present the first sucrose-reinforced operant conditioning paradigm for flies. In the paradigm, flies walk along a Y-shaped track with reward locations at the terminus of each hallway. When flies turn in the reinforced direction at the center of the track, they receive a sucrose reward at the end of the hallway. Only flies that rest early in training learn the reward contingency normally. Flies rewarded independently of their behavior do not form a learned association but have the same amount of rest as trained flies, showing that rest is not driven by learning. Optogenetically-induced sleep does not promote learning, indicating that sleep itself is not sufficient for learning the operant task. We validated the sensitivity of this assay to detect the effect of genetic manipulations by testing the classic learning mutant dunce. Dunce flies are learning-impaired in the Y-Track task, indicating a likely role for cAMP in the operant coincidence detector. This novel training paradigm will provide valuable insight into the molecular mechanisms of disease and the link between sleep and learning.

Involvement of Cerebellar Neural Circuits in Active Avoidance Conditioning in Zebrafish

When animals repeatedly receive a combination of neutral conditional stimulus (CS) and aversive unconditional stimulus (US), they learn the relationship between CS and US, and show conditioned fear responses after CS. They show passive responses such as freezing or panic movements (classical or Pavlovian fear conditioning), or active behavioral responses to avoid aversive stimuli (active avoidance). Previous studies suggested the roles of the cerebellum in classical fear conditioning but it remains elusive whether the cerebellum is involved in active avoidance conditioning. In this study, we analyzed the roles of cerebellar neural circuits during active avoidance in adult zebrafish. When pairs of CS (light) and US (electric shock) were administered to wild-type zebrafish, about half of them displayed active avoidance. The expression of botulinum toxin, which inhibits the release of neurotransmitters, in cerebellar granule cells (GCs) or Purkinje cells (PCs) did not affect conditioning-independent swimming behaviors, but did inhibit active avoidance conditioning. Nitroreductase (NTR)-mediated ablation of PCs in adult zebrafish also impaired active avoidance. Furthermore, the inhibited transmission of GCs or PCs resulted in reduced fear-conditioned Pavlovian fear responses. Our findings suggest that the zebrafish cerebellum plays an active role in active avoidance conditioning.

Fos-expressing neuronal ensemble in rat ventromedial prefrontal cortex encodes cocaine seeking but not food seeking in rats

Neuronal ensembles in ventromedial prefrontal cortex (vmPFC) play a role in both cocaine and palatable food seeking. However, it is unknown whether similar or different vmPFC neuronal ensembles mediate food and cocaine seeking. Here, we used the Daun02 inactivation procedure to assess whether the neuronal ensembles mediating food and cocaine seeking can be functionally distinguished. We trained male and female Fos-LacZ rats to self-administer palatable food pellets and cocaine on alternating days for 18 days. We then exposed the rats to a brief nonreinforced food- or cocaine-seeking test to induce Fos and β-gal in neuronal ensembles associated with food or cocaine seeking, respectively and infused Daun02 into vmPFC to ablate the β-gal-expressing ensembles. Two days later, we tested the rats for food or cocaine seeking under extinction conditions. Although inactivation of the food-seeking ensemble did not influence food or cocaine seeking, inactivation of the cocaine-seeking ensemble reduced cocaine seeking but not food seeking. Results indicate that the neuronal ensemble activated by cocaine seeking in vmPFC is functionally separate from the ensemble activated by food seeking.