Fos-expressing neuronal ensemble in rat ventromedial prefrontal cortex encodes cocaine seeking but not food seeking in rats

Neuronal ensembles in ventromedial prefrontal cortex (vmPFC) play a role in both cocaine and palatable food seeking. However, it is unknown whether similar or different vmPFC neuronal ensembles mediate food and cocaine seeking. Here, we used the Daun02 inactivation procedure to assess whether the neuronal ensembles mediating food and cocaine seeking can be functionally distinguished. We trained male and female Fos-LacZ rats to self-administer palatable food pellets and cocaine on alternating days for 18 days. We then exposed the rats to a brief nonreinforced food- or cocaine-seeking test to induce Fos and β-gal in neuronal ensembles associated with food or cocaine seeking, respectively and infused Daun02 into vmPFC to ablate the β-gal-expressing ensembles. Two days later, we tested the rats for food or cocaine seeking under extinction conditions. Although inactivation of the food-seeking ensemble did not influence food or cocaine seeking, inactivation of the cocaine-seeking ensemble reduced cocaine seeking but not food seeking. Results indicate that the neuronal ensemble activated by cocaine seeking in vmPFC is functionally separate from the ensemble activated by food seeking.

Food-Seeking Behavior Is Mediated by Fos-Expressing Neuronal Ensembles Formed at First Learning in Rats

Neuronal ensembles in the infralimbic cortex (IL) develop after prolonged food self-administration training. However, rats demonstrate evidence of learning the food self-administration response as early as day 1, with responding quickly increasing to asymptotic levels. Since the contribution of individual brain regions to task performance shifts over the course of training, it remains unclear whether IL ensembles are gradually formed and refined over the course of extensive operant training, or whether functionally-relevant ensembles might be recruited and formed as early as the initial acquisition of food self-administration behavior. Here, we aimed to determine the role of IL ensembles at the earliest possible point after demonstrable learning of a response-outcome association. We first allowed rats to lever press for palatable food pellets and stopped training rats once their behavior evidenced the response-outcome association (learners). We compared their food-seeking behavior and neuronal activation (Fos protein expression) to similarly trained rats that did not form this association (non-learners). Learners had greater food-seeking behavior and neuronal activation within the medial prefrontal cortex (mPFC), suggesting that mPFC subregions might encode initial food self-administration memories. To test the functional relevance of mPFC Fos-expressing ensembles to subsequent food seeking, we tested region-wide inactivation of the IL using muscimol+baclofen and neuronal ensemble-specific ablation using the Daun02 inactivation procedure. Both region-wide inactivation and ensemble-specific inactivation of the IL significantly decreased food seeking. These data suggest that IL neuronal ensembles form during initial learning of food self-administration behavior, and furthermore, that these ensembles play a functional role in food seeking.

6-Month-Old Infants' Sensitivity to Contingency in a Variant of the Mobile Paradigm With Proximal Stimulation Studied at Fine Temporal Resolution in the Laboratory

Infants' ability to monitor "sensorimotor contingencies," i.e., the sensory effects of their own actions, is an important mechanism underlying learning. One method that has been used to investigate this is the "mobile paradigm," in which a mobile above an infant's crib is activated by motion of one of the infant's limbs. Although successfully used in numerous experiments performed in infants' homes to investigate memory and other types of learning, the paradigm seems less robust for demonstrating sensitivity to sensorimotor contingencies when used in the laboratory. One purpose of the present work was to show that certain changes to the mobile paradigm would make it easier for infants to show their sensitivity to the contingency in the lab. In particular, we used proximal stimulation on infants' wrists instead of the usual mobile, and our stimulation was coincident with the limbs that caused it. Our stimulation was either on or off, i.e., not modulated by the amount the infant moved. Finally, we used a "shaping" procedure to help the infant discover the contingency. In addition to these changes in the paradigm, by analyzing infants' limb activity at 10-s resolution instead of the usual 1-min resolution, we were able to show that infants' sensitivity to the contingency became apparent already within the first minute of establishment of the contingency. Finally, we showed how two alternate measures of sensitivity to contingency based on probability of repeated movements and on "stop and go" motion strategies may be of interest for future work.

Phase-Specific Microstimulation Differentially Modulates Beta Oscillations and Affects Behavior

It is widely accepted that Beta-band oscillations play a role in sensorimotor behavior. To further explore this role, we developed a hybrid platform to combine neural operant conditioning and phase-specific intracortical microstimulation (ICMS). We trained monkeys, implanted with 96 electrode arrays in the motor cortex, to volitionally enhance local field potential (LFP) Beta-band (20-30 Hz) activity at selected sites using a brain-machine interface. We find that Beta oscillations of LFP and single-unit spiking activity increase dramatically with brain-machine interface training and that pre-movement Beta power is anti-correlated with task performance. We also find that phase-specific ICMS modulates the power and phase of oscillations, shifting local networks between oscillatory and non-oscillatory states. Furthermore, ICMS induces phase-dependent effects in animal reaction times and success rates. These findings contribute to unraveling the functional role of cortical oscillations and to the future development of clinical tools for ameliorating abnormal neuronal activities in brain disease.

Operant conditioning reveals task-specific responses of single neurons in a brain-machine interface

OBJECTIVE

Volitional modulation of single cortical neurons holds great potential for the implementation of brain-machine interfaces (BMIs) because it can induce a rapid acquisition of arbitrary associations between machines and neural activity. It can also be used as a framework to study the limits of single-neuron control in BMIs.

APPROACH

We tested the control of a one-dimensional actuator in two BMI tasks which differed only in the neural contingency that determined when a reward was dispensed. A thresholded activity task, commonly implemented in single-neuron BMI control, consisted of reaching or exceeding a neuron activity level, while the second task consisted of reaching and maintaining a narrow neuron activity level (i.e. windowed activity task).

MAIN FINDINGS

Single neurons in layer V of the motor cortex of rats improved performance during both the thresholded activity and windowed activity BMI tasks. However, correct performance during the windowed activity task was accompanied by activation of neighboring neurons, not in direct control of the BMI. In contrast, only neurons in direct control of the BMI were active at the time of reward during the thresholded activity task.

SIGNIFICANCE

These results suggest that thresholded activity single-neuron BMI implementations are more appropriate compared to windowed activity BMI tasks to capitalize on the adaptability of cortical circuits to acquire novel arbitrary skills.

The Fallacy of Sham-Controlled Neurofeedback Trials: A Reply to Thibault and Colleagues (2018)

Background: Sham-controlled neurofeedback (NFB) trials consistently find no separation on ADHD outcome measures leading many to conclude that NFB's beneficial effects are due to placebo. Method: We deconstruct the NFB training methodology and findings of six sham-controlled trials that assessed for evidence of learning. Results: All six studies found no evidence NFB subjects learned to self-modulate the targeted electroencephalogram (EEG). Careful analyses revealed these studies' training methodologies were antithetical to the established science of operant conditioning thereby preventing subjects from learning to self-modulate. These findings are in marked contrast to NFB studies whose methodology mirror the best practices of operant conditioning. Conclusion: The premise that NFB's beneficial effects are due to placebo phenomenon is unproven as these studies compared two forms of false-feedback, not operant conditioning of the EEG. Because these studies are highly cited and considered the gold standard in scientific rigor, a reappraisal of the evidence is urgently needed.

Ants Can Anticipate the Following Quantity in an Arithmetic Sequence

Workers of the ant Myrmica sabuleti have been previously shown to be able to add and subtract numbers of elements and to expect the time and location of the next food delivery. We wanted to know if they could anticipate the following quantity of elements present near their food when the number of these elements increases or decreases over time according to an arithmetic sequence. Two experiments were therefore carried out, one with an increasing sequence, the other with a decreasing sequence. Each experiment consisted of two steps, one for the ants to learn the numbers of elements successively present near their food, the other to test their choice when they were simultaneously in the presence of the numbers from a previously learned sequence and the following quantity. The ants anticipated the following quantity in each presented numerical sequence. This forethinking of the next quantity applies to numerosity, thus, to concrete items. This anticipatory behavior may be explained by associative learning and by the ants’ ability to memorize events and to estimate the elapsing time.

Normal Tone-In-Noise Sensitivity in Trained Budgerigars despite Substantial Auditory-Nerve Injury: No Evidence of Hidden Hearing Loss

Loss of auditory-nerve (AN) afferent cochlear innervation is a prevalent human condition that does not affect audiometric thresholds and therefore remains largely undetectable with standard clinical tests. AN loss is widely expected to cause hearing difficulties in noise, known as "hidden hearing loss," but support for this hypothesis is controversial. Here, we used operant conditioning procedures to examine the perceptual impact of AN loss on behavioral tone-in-noise (TIN) sensitivity in the budgerigar (Melopsittacus undulatus; of either sex), an avian animal model with complex hearing abilities similar to humans. Bilateral kainic acid (KA) infusions depressed compound AN responses by 40-70% without impacting otoacoustic emissions or behavioral tone sensitivity in quiet. Surprisingly, animals with AN damage showed normal thresholds for tone detection in noise (0.1 ± 1.0 dB compared to control animals; mean difference ± SE), even under a challenging roving-level condition with random stimulus variation across trials. Furthermore, decision-variable correlations (DVCs) showed no difference for AN-damaged animals in their use of energy and envelope cues to perform the task. These results show that AN damage has less impact on TIN detection than generally expected, even under a difficult roving-level condition known to impact TIN detection in individuals with sensorineural hearing loss (SNHL). Perceptual deficits could emerge for different perceptual tasks or with greater AN loss but are potentially minor compared with those caused by SNHL.SIGNIFICANCE STATEMENT Loss of auditory-nerve (AN) cochlear innervation is a common problem in humans that does not affect audiometric thresholds on a clinical hearing test. AN loss is widely expected to cause hearing problems in noise, known as "hidden hearing loss," but existing studies are controversial. Here, using an avian animal model with complex hearing abilities similar to humans, we examined for the first time the impact of an experimentally induced AN lesion on behavioral tone sensitivity in noise. Surprisingly, AN-lesioned animals showed no difference in hearing performance in noise or detection strategy compared with controls. These results show that perceptual deficits from AN damage are smaller than generally expected, and potentially minor compared with those caused by sensorineural hearing loss (SNHL).

Equine Responses to Acceleration and Deceleration Cues May Reflect Their Exposure to Multiple Riders

Simple Summary

Successful horse training depends on riders giving clear and consistent cues. When cues are inconsistent, the horse may become confused, frustrated, or unresponsive. It is likely that each rider or horse trainer differs in the way they deliver training cues because humans vary in their weight, height, riding style, handedness, experience, and skill level. This study explored relationships between the number of people to ride or handle a horse and the horse’s response to training cues. Data describing 1819 horses and ponies were obtained from the Equine Behavior Assessment and Research Questionnaire (E-BARQ), an online global survey of horse owners and caregivers. The number of riders or handlers showed a significant relationship with two behavioural indices. Specifically, as the number of riders or handlers increased, horses were more difficult to accelerate and less difficult to decelerate compared to horses with fewer riders or handlers. This could indicate that an increase in rider or handler numbers is associated with those horses becoming relatively more unresponsive to leg and whip cues than to rein cues.

Abstract

It is logical to assume that horses with multiple riders encounter variation in application of training cues. When training cues are inconsistent, we expect to see a decrease in trained responses or an increase in conflict behaviours. This study investigated the relationship between the number of people that regularly ride or handle a horse and the horse’s response to operant cues. Data on 1819 equids were obtained from the Equine Behavior Assessment and Research Questionnaire (E-BARQ), an online global survey of horse owners and caregivers. Three mutually independent indices (acceleration, deceleration, and responsiveness) were derived from a parallel analysis of E-BARQ items related to acceleration and deceleration cues. These indices were then subjected to multivariable modelling against a range of dependent variables including horse and human demographics, horse management, and the number of riders or handlers. The number of riders or handlers was a significant predictor for two out of three indices. As the number of riders or handlers increased, horses were more difficult to accelerate (regression coefficient = 0.0148 ± 0.0071; p = 0.0366) and less difficult to decelerate (regression coefficient = −0.017 ± 0.008; p = 0.030) than those with fewer riders or handlers. These findings suggest that horses’ responses to rein tension cues are more persistent than their responses to leg pressure or whip cues. Alternatively, horses with these responses may be actively selected for multiple rider roles. Longitudinal studies of this sort should reveal how the number of riders or handlers affects horse behaviour and could lead to safer and more humane equestrian practices.

Effects of Saccharin Consumption on Operant Responding for Sugar Reward and Incubation of Sugar Craving in Rats

Repeated experience with artificial sweeteners increases food consumption and body weight gain in rats. Saccharin consumption may reduce the conditioned satiety response to sweet-tasting food. Rats were trained to press a lever to obtain sucrose for five days. A compound cue (tone + light) was presented with every sucrose delivery. On the following day, each lever press produced only the compound cue (cue-reactivity test). Subjects were then provided with yogurt for three weeks in their home cages. The rats were divided into two groups. Rats in the saccharin group received yogurt sweetened with saccharin on some days and unsweetened yogurt on others. For the plain group, only unsweetened plain yogurt was provided. Subsequently, the cue-reactivity test was conducted again. On the following day, the rats underwent a consumption test in which each lever press was reinforced with sucrose. Chow consumption and body weight gain were larger in the saccharin group than in the plain group. Lever responses increased from the first to the second cue-reactivity tests (incubation of craving) in both groups. During the consumption test, lever responses were higher in the saccharin group than in the plain group, suggesting that the conditioned satiety response was impaired in the saccharin group.

How can Cattle be Toilet Trained? Incorporating Reflexive Behaviours into a Behavioural Chain

Simple Summary

The mixing of bovine faeces and urine leads to climate-damaging ammonia emissions. If cattle could be taught to use a latrine, this would reduce the area of emissions, the separation of excreta could easily be accomplished by mechanical means, and animal health could be improved. Attempts to train toileting in cattle have shown limited success. In children, toileting is trained mainly by (i) interrupting voiding that starts outside the toilet, then taking the child to the toilet and rewarding the resumption of excretion, or (ii) placing the child on the toilet, waiting for urination/defecation and rewarding appropriate excretory behaviour. The first method is reported to be more successful. Thus, a similar procedure was evaluated for training latrine use for urination in calves. On 95% of occasions, the calves inhibited or stopped urination when receiving a signal to move to the latrine, and on 65% of occasions, they reinitiated urination in the latrine. Furthermore, during 63% of urinations in the latrine, the calves oriented towards the reward location before any food was delivered, providing additional evidence that calves can be successfully toilet trained with food rewards.

Abstract

Untrained cattle do not defecate or urinate in defined locations. The toilet training of cattle would allow urine and faeces to be separated and stored, reducing climate-damaging emissions and improving animal health. In a proof-of-concept study, we evaluated a novel protocol for toilet training in cattle. Five heifer calves (and yoked controls) were trained in the voluntary (operant) behaviours of a toileting chain. Then, reflexive urinating responses were incorporated into the chain, with toileting signalled by a tactile (vibratory) stimulus. On 95% of occasions, the calves inhibited/interrupted urination when receiving the stimulus, and on 65% of these occasions, reinitiated urination in the latrine. Furthermore, during 63% of urinations in the latrine, the calves oriented to the reward location before any food was delivered, providing additional evidence that calves can be successfully toilet trained with food rewards. Yoked controls failed to learn most of the operant elements and all the reflexive responses of toilet training. The results show that reflexive behaviours can be incorporated into voluntary toileting sequences with cattle and extend the range of species that can be toilet trained. Future refinement of the protocol to allow training under practical farm conditions offers the potential to mitigate climate damage and improve animal health.

Self-Regulation Without Force: Can Awareness Leverage Reward to Drive Behavior Change?

To reach longer-term goals and live aligned with their values, people typically must regulate their behavior. Effortful self-control is one way to achieve this and is usually framed as a forceful struggle between lower-level impulses and higher-level cognitive control processes. For example, people may restrain themselves from eating cake in order to lose weight. An alternative avenue of self-regulation draws on autonomous motivation: Individuals eat healthfully because it is values-congruent or intrinsically satisfying. Recent advances in the understanding of reward valuation on a neural level (e.g., ventromedial prefrontal cortex/orbitofrontal cortex) and emerging treatments on a clinical level (e.g., mindfulness training) suggest a possible mechanistic convergence between brain and behavior that is consistent with a shift from forced to unforced behavior change. Here we propose how an overlooked aspect of reinforcement learning can be leveraged using a simple yet critical feature of experience that is not reliant on willpower: Bringing awareness to one's subjective experience and behavior can produce a change in valuation of learned but unhealthy behaviors, leading to self-regulatory shifts that result in sustainable behavior change without force.

The Zebrafish Dorsolateral Habenula Is Required for Updating Learned Behaviors

Operant learning requires multiple cognitive processes, such as learning, prediction of potential outcomes, and decision-making. It is less clear how interactions of these processes lead to the behavioral adaptations that allow animals to cope with a changing environment. We show that juvenile zebrafish can perform conditioned place avoidance learning, with improving performance across development. Ablation of the dorsolateral habenula (dlHb), a brain region involved in associative learning and prediction of outcomes, leads to an unexpected improvement in performance and delayed memory extinction. Interestingly, the control animals exhibit rapid adaptation to a changing learning rule, whereas dlHb-ablated animals fail to adapt. Altogether, our results show that the dlHb plays a central role in switching animals' strategies while integrating new evidence with prior experience.

Can Operant Conditioning of EMG-Evoked Responses Help to Target Corticospinal Plasticity for Improving Motor Function in People With Multiple Sclerosis?

Corticospinal pathway and its function are essential in motor control and motor rehabilitation. Multiple sclerosis (MS) causes damage to the brain and descending connections, and often diminishes corticospinal function. In people with MS, neural plasticity is available, although it does not necessarily remain stable over the course of disease progress. Thus, inducing plasticity to the corticospinal pathway so as to improve its function may lead to motor control improvements, which impact one's mobility, health, and wellness. In order to harness plasticity in people with MS, over the past two decades, non-invasive brain stimulation techniques have been examined for addressing common symptoms, such as cognitive deficits, fatigue, and spasticity. While these methods appear promising, when it comes to motor rehabilitation, just inducing plasticity or having a capacity for it does not guarantee generation of better motor functions. Targeting plasticity to a key pathway, such as the corticospinal pathway, could change what limits one's motor control and improve function. One of such neural training methods is operant conditioning of the motor-evoked potential that aims to train the behavior of the corticospinal-motoneuron pathway. Through up-conditioning training, the person learns to produce the rewarded neuronal behavior/state of increased corticospinal excitability, and through iterative training, the rewarded behavior/state becomes one's habitual, daily motor behavior. This minireview introduces operant conditioning approach for people with MS. Guiding beneficial CNS plasticity on top of continuous disease progress may help to prolong the duration of maintained motor function and quality of life in people living with MS.

Training Petting Zoo Sheep to Act Like Petting Zoo Sheep: An Empirical Evaluation of Response-Independent Schedules and Shaping with Negative Reinforcement

Simple Summary

The present study examines the use of response-independent food schedules (food delivered independent of what an animal is doing) and negative reinforcement in the form of a trainer removing themselves from the presence of an animal to effectively train approach and contact behaviors in petting zoo sheep. All sheep had previously been reported to avoid/escape the presence of zoo staff and caretakers, as well as refuse to eat in the presence of any persons. In Experiment 1, we were able to effectively use response-independent schedules to produce both approach and contact behaviors in a Hampshire sheep. In Experiment 2, a Jacob sheep was trained for approach/contact via a shaping procedure that initially rewarded approach behaviors by removing the presence of the trainer (negative reinforcement), and was later switched to rewarding responses directly with food (positive reinforcement) once the sheep began to regularly eat in the trainer’s presence. The results are discussed with respect to how both procedures are effective in examining the applied approach/avoidance behaviors with zoo animals, as well as the greater ethical considerations involved in using negative vs. positive reinforcement to train animals.

Abstract

Shaping through differential reinforcement of successive approximations to a target response has been a cornerstone procedure for the training of novel behavior. However, much of how it has traditionally been implemented occurs through informal observation, rather than any direct, systematic measurement. In the present study, we examine the use of response-independent food schedules and shaping for increasing approach and contact behaviors in petting zoo sheep. In Experiment 1, a fixed-time (FT) 15 s food schedule was used to effectively increase approach and contact behaviors in one sheep. In Experiment 2, negative reinforcement in the form of removal of the presence of a trainer was made contingent on the successful completion of approximations within a shaping procedure and later switched to food rewards. A changing-criterion design was used to empirically examine the effects of the shaping procedure during each step of the program. The result is one of the first studies to demonstrate the utility of using negative reinforcement within a shaping procedure to successfully intervene on approach/avoidance behaviors in an applied animal setting.

Using Owner Return as a Reinforcer to Operantly Treat Separation-Related Problem Behavior in Dogs

Separation-related problem behavior (SRPB) is a severe behavioral issue in which dogs engage in a variety of undesirable behaviors when the owner is absent, such as destructive behavior and excessive vocalization. Given the severity and high prevalence of SRPB, finding effective treatments is crucial. To date, most treatments have relied on habituation to increase tolerance to owner absence. Additionally, research has typically not utilized direct observations of the dog's behavior and the treatment implemented with unknown treatment integrity. We evaluated an operant approach to SRPB using owner return as the reinforcer. After collecting baseline, we enrolled five dogs for treatment. Treatment involved differential reinforcement of either absence of problem behavior or occurrence of specific desirable behaviors. Behavioral criteria for delivering reinforcement changed based on the dog's performance assessed through direct observation. We coached owners to ensure treatment integrity on each trial. From baseline, mean time to SRPB was 27.1 s. During treatment, all dogs increased their ability to stay alone without SRPB compared to baseline, indicating that contingent owner return can be a useful treatment. However, despite four training sessions, only one dog was able to stay alone for over 5 min. Our data demonstrate the slow-going progression of this SPRB treatment and the challenges of this behavioral issue.

Activation of cannabinoid type 1 receptors decreases the synchronization of local field potential oscillations in the hippocampus and entorhinal cortex and prolongs the interresponse time during a differential-reinforcement-of-low-rate task

Marijuana intoxication impairs neurocognitive functions. Common side effects of consuming cannabis include time distortion and memory loss. However, the underlying neurophysiological mechanisms involved in these effects remain unclear. We hypothesized that communication between the hippocampal CA1 region and medial entorhinal cortex (MEC) is essential for the transmission of temporal-associated information. We used a differential-reinforcement-of-low-rate (DRL) task, which requires subjects to press a lever at an optimal time point, to correlate the distributions of interresponse time (IRT) with local field potentials (LFPs) recorded in the CA1 and MEC under the effects of a cannabinoid type 1 (CB1) receptor agonist. We used a DRL 10-s schedule and trained the rats to withhold for 10 s before pressing a lever. Our data showed that the percentage of 12.4- to 14-s IRT events rose after activation of CB1 receptors in the MEC. In addition, gamma amplitude synchronization and CA1 theta phase-MEC gamma amplitude coupling decreased during the 6- to 14-s IRT events. These results suggest that activation of CB1 receptors in the MEC disrupt the functional connectivity between the CA1 and the MEC. This inefficient communication may result in increased IRT during a DRL schedule. Overall, we postulate that marijuana intoxication impairs the communication between the CA1 and MEC and influences behavioral performances that require precise timing ability.

Mediodorsal Thalamus Contributes to the Timing of Instrumental Actions

The perception of time is critical to adaptive behavior. While prefrontal cortex and basal ganglia have been implicated in interval timing in the seconds to minutes range, little is known about the role of the mediodorsal thalamus (MD), which is a key component of the limbic cortico-basal ganglia-thalamocortical loop. In this study, we tested the role of the MD in timing, using an operant temporal production task in male mice. In this task, that the expected timing of available rewards is indicated by lever pressing. Inactivation of the MD with muscimol produced rightward shifts in peak pressing on probe trials as well as increases in peak spread, thus significantly altering both temporal accuracy and precision. Optogenetic inhibition of glutamatergic projection neurons in the MD also resulted in similar changes in timing. The observed effects were found to be independent of significant changes in movement. Our findings suggest that the MD is a critical component of the neural circuit for interval timing, without playing a direct role in regulating ongoing performance.SIGNIFICANCE STATEMENT The mediodorsal nucleus (MD) of the thalamus is strongly connected with the prefrontal cortex and basal ganglia, areas which have been implicated in interval timing. Previous work has shown that the MD contributes to working memory and learning of action-outcome contingencies, but its role in behavioral timing is poorly understood. Using an operant temporal production task, we showed that inactivation of the MD significantly impaired timing behavior.

Conditionability of 'voluntary' and 'reflexive-like' behaviors, with special reference to elimination behavior in cattle

Typically, cattle urinate and defecate with little or no control over time and place. The resulting excreta contributes to a range of adverse effects on the environment and the animals themselves. These adverse effects could be substantially ameliorated if livestock could be toilet trained. Toilet training requires an animal to suppress impending voiding (a reflexive-like behavior), move to a latrine (voluntary behavior) and reinitiate voiding. Here, we review the neurophysiological processes and learning mechanisms regulating toileting. The suppression and initiation of voiding occur primarily via the coordinated activity of smooth and striated anal and urinary sphincter muscles. The autonomic and somatic nervous systems, along with central processes, regulate these muscles. In several mammalian species, voluntary control of the sphincters has been demonstrated using classical and/or operant conditioning. In this review, we demonstrate that the neurophysiological and behavioral regulation of voiding in cattle is likely to be similarly conditionable. The management of excreta deposition in cattle could have major benefits for reducing livestock greenhouse gas emissions and improving animal health/welfare.

Functional analysis and operant treatment of food guarding in a pet dog

The present study extended functional analysis (FA) methodology to human-directed resource guarding in a dog in an in-home setting. The subject underwent four conditions including control, attention, escape, and tangible, arranged in a modified FA. The results indicated multiply controlled resource guarding (i.e., escape, attention, and tangible functions). The experimenter then conducted a treatment evaluation involving three function-based treatments in a concurrent multiple baseline design. Resource guarding decreased to zero levels in treatments for each maintaining contingency. Treatment effects were maintained when the subject was tested with an owner, with an untrained handler, a highly preferred treat, in an untrained setting, as well as after 2 weeks in the absence of training. Behavior analytic techniques may hold promise for lasting behavior change for resource guarding in domestic dogs, and should be examined in other populations and with other canine problem behavior.

Task phase-specific involvement of the rat posterior parietal cortex in performance of the TUNL task

The posterior parietal cortex (PPC) participates in cognitive processes including working memory (WM), sensory evidence accumulation, and perceptually guided decision making. However, surprisingly little work has used temporally precise manipulations to dissect its role in different epochs of behavior taking place over short timespans, such as WM tasks. As a result, a consistent view of the temporally precise role of the PPC in these processes has not been described. In the present study, we investigated the temporally specific role of the PPC in the Trial-Unique, Nonmatching-to-Location (TUNL) task, a touchscreen-based, visuospatial WM task that relies on the PPC. To disrupt PPC activity in a temporally precise manner, we applied mild intracranial electrical stimulation (ICES). We found that intra-PPC ICES (100 μA) significantly impaired accuracy in TUNL without significantly altering response latency. Moreover, we found that the impairment was specific to ICES applied during the delay and test phases of TUNL. Consistent with previous reports showing delay- and choice-specific neuronal activity in the PPC, the results provide evidence that the rat PPC is required for maintaining memory representations of stimuli over a delay period as well as for making successful comparisons and choices between test stimuli. In contrast, the PPC appears not to be critical for initial encoding of sample stimuli. This pattern of results may indicate that early encoding of visual stimuli is independent of the PPC or that the PPC becomes engaged only when visual stimuli are spatially complex or involve memory or decision making.

An Examination of Shaping with an African Crested Porcupine (Hystrix cristata)

Shaping through differential reinforcement of successive approximations to a target response has been a cornerstone procedure for the training of novel behavior. However, much of how it has traditionally been implemented occurs through informal observation, rather than any direct, systematic measurement. In the following study, an African crested porcupine (Hystrix cristata) was trained to touch and hold to a target for 30 s. A changing-criterion design with one reversal was used to assess the success of the shaping procedure and empirically examine the effects of the shaping procedure during each step of the program. The study allowed for the examination of each approximation across all other approximations, as well as across aberrant (e.g., trial-terminating) responses. The design and procedure allow for a simple and systematic way to examine the effects and success of shaping procedures across a variety of settings, species, and purposes.

Anti-instinctive Learning Behavior Revealed by Locomotion-Triggered Mild Heat Stress in Drosophila

Anti-instinctive learning, an ability to modify an animal's innate behaviors in ways that go against one's innate tendency, can confer great evolutionary advantages to animals and enable them to better adapt to the changing environment. Yet, our understanding of anti-instinctive learning and its underlying mechanisms is still limited. In this work, we describe a new anti-instinctive learning behavior of fruit flies. This learning paradigm requires the fruit fly to respond to a recurring, aversive, mild heat stress by modifying its innate locomotion behavior. We found that experiencing movement-triggered mild heat stress repeatedly significantly reduced walking activity in wild type fruit flies, indicating that fruit flies are capable of anti-instinctive learning. We also report that such learning ability is reduced in dopamine 1-like receptor 1 (Dop1R1) null mutant and dopamine 2-like receptor (Dop2R) null mutant flies, suggesting that these two dopamine receptors are involved in mediating anti-instinctive learning in flies.

Troy D. Zars: a personal tribute to a scientist, colleague, and friend

I knew Troy for nearly 15 years, and in that time I don't recall hearing any childhood stories like those in seemingly every personal statement I've read from aspiring scientists or medical students. No stories about hours spent gazing at an anthill. I don't recall hearing about shelves crowded with insects collected on Styrofoam, or animal skulls kept in a shoebox under his bed. If these collected crania existed, it was more likely because Troy was a crack shot with a pellet gun than a need to know adaptations in the dentition of local squirrel populations. I don't recall hearing about science projects taken to the Iowa State Capitol to share with politely interested legislators. But I do recall hearing about spending the entirety of the daylight hours in the summer, with his brother Doug, finding where the crappie were biting. About crystal clear water on a lake in Minnesota that you didn't quite need to know the exact location of, just in case you were thinking of going and plundering the walleye within. I definitely heard about triumphs as a starting lineman not only for his high school football team, but the mighty Norse of Luther College. I heard about summer warehouse jobs in sweltering Iowa Julys. And I saw, firsthand, love and commitment and family. Troy's story demonstrates that the finest scientists are not just cultivated in narrow STEM curricula that begin at age 5. They are just as likely to be football-playing fishermen, fathers, husbands, and friends who can navigate an operant conditioning paradigm during the week, and dance a polka and produce a magnificent smoked pork shoulder on Saturday. Nature and an independent spirit and a little bit of mischief is a different kind of Magnet school. And it gave us truly one of the best.

Operant conditioning as a new mechanism of placebo effects

BACKGROUND AND OBJECTIVE

Placebo effects are considered to be learning phenomena. There is a growing body of evidence supporting the role of both classical conditioning and observational learning in the induction of placebo effects. However, the third basic learning process, operant conditioning, was not considered as a mechanism of placebo effects until very recently. Unlike classically conditioned responses, which are induced by stimuli that precede the behaviour, operant behaviours are shaped and maintained by their consequences. Thus, placebo effects may not only result from pairing an active intervention with the stimuli that accompany its administration (placebo) but also positive (e.g. the ability to perform a desired activity) or negative reinforcement (e.g. pain relief) of placebo administration may increase the frequency of taking placebos in the future. The paper reviews the evidence supporting the idea of operant conditioning as a mechanism of placebo effects and discusses it in the context of the general principles of operant conditioning, the operant conditioning account of pain modulation and research findings on the role of operant conditioning in pain modulation.

DATABASES AND DATA TREATMENT

This is a narrative review.

RESULTS

Seven lines of research are proposed to study the role of operant conditioning in producing placebo effects.

CONCLUSIONS

Operant conditioning account of placebo effects has practical implications both for routine clinical practice and the placebo arms of randomized controlled trials.

SIGNIFICANCE

The operant conditioning account of placebo effects is discussed from the theoretical perspective of the general principles of operant conditioning and the operant conditioning account of pain modulation. The paper identifies seven lines of research on the role of operant conditioning in producing placebo effects, and highlights the practical implications of the operant conditioning account of placebo effects both for routine clinical practice and the placebo arms of randomized controlled trials.