Training Rats Using Water Rewards Without Water Restriction

Sound-seeking before and after hearing loss in mice

How we move our bodies affects how we perceive sound. For instance, head movements help us to better localize the source of a sound and to compensate for asymmetric hearing loss. However, many auditory experiments are designed to restrict head and body movements. To study the role of movement in hearing, we developed a behavioral task called sound-seeking that rewarded freely moving mice for tracking down an ongoing sound source. Over the course of learning, mice more efficiently navigated to the sound. Next, we asked how sound-seeking was affected by hearing loss induced by surgical removal of the malleus from the middle ear. After bilateral hearing loss sound-seeking performance drastically declined and did not recover. In striking contrast, after unilateral hearing loss mice were only transiently impaired and then recovered their sound-seek ability over about a week. Throughout recovery, unilateral mice increasingly relied on a movement strategy of sequentially checking potential locations for the sound source. In contrast, the startle reflex (an innate auditory behavior) was preserved after unilateral hearing loss and abolished by bilateral hearing loss without recovery over time. In sum, mice compensate with body movement for permanent unilateral damage to the peripheral auditory system. Looking forward, this paradigm provides an opportunity to examine how movement enhances perception and enables resilient adaptation to sensory disorders.

Sound-seeking before and after hearing loss in mice

How we move our bodies affects how we perceive sound. For instance, we can explore an environment to seek out the source of a sound and we can use head movements to compensate for hearing loss. How we do this is not well understood because many auditory experiments are designed to limit head and body movements. To study the role of movement in hearing, we developed a behavioral task called sound-seeking that rewarded mice for tracking down an ongoing sound source. Over the course of learning, mice more efficiently navigated to the sound. We then asked how auditory behavior was affected by hearing loss induced by surgical removal of the malleus from the middle ear. An innate behavior, the auditory startle response, was abolished by bilateral hearing loss and unaffected by unilateral hearing loss. Similarly, performance on the sound-seeking task drastically declined after bilateral hearing loss and did not recover. In striking contrast, mice with unilateral hearing loss were only transiently impaired on sound-seeking; over a recovery period of about a week, they regained high levels of performance, increasingly reliant on a different spatial sampling strategy. Thus, even in the face of permanent unilateral damage to the peripheral auditory system, mice recover their ability to perform a naturalistic sound-seeking task. This paradigm provides an opportunity to examine how body movement enables better hearing and resilient adaptation to sensory deprivation.

Photobiomodulation and vitamin B treatment alleviate both thermal and mechanical orofacial pain in rats

PURPOSE

The present study investigates the efficacy of Photobiomodulation (PBM) and Vitamin B Complex (VBC) to relieve pain, both in separately and combined (PBM and VBC).

METHODS

Rats with chronic constriction injury of the right infraorbital nerve (CCI-IoN) or Sham surgery were used. PBM was administered at a wavelength of 904 nm and energy density of 6.23 J/cm2 and VBC (containing B1, B6 and B12) subcutaneously, both separately and combined. Behavioral tests were performed to assess mechanical and thermal hypersensitivity before and after CCI and after PBM, VBC, or PBM + VBC. The expression of inflammatory proteins in the trigeminal ganglion and the immunohistochemical alterations of Periaqueductal Gray (PAG) astrocytes and microglia were examined following CCI and treatments.

RESULTS

All testeds treatments reversed the painful behavior. The decrease in pain was accompanied by a decrease of Glial Fibrillary Acidic Protein (GFAP), a specific astrocytic marker, and Ionized calcium-binding adaptor molecule 1 (Iba-1), a marker of microglia, and decreased expression of Transient Receptor Potential Vanilloid 1 (TRPV1), Substance P, and Calcitonin Gene-Related Peptide (CGRP) induced by CCI-IoN in PAG and Trigeminal ganglion. Furthermore, both treatments showed a higher expression of Cannabinoid-type 1 (CB1) receptor in the trigeminal ganglion compared to CCI-IoN rats. Our results show that no difference was observed between groups.

CONCLUSION

We showed that PBM or VBC regulates neuroinflammation and reduces inflammatory protein expression. However, the combination of PBM and VBC did not enhance the effectiveness of both therapies alone.

Neuronal glutamate transporters control reciprocal inhibition and gain modulation in D1 medium spiny neurons

Understanding the function of glutamate transporters has broad implications for explaining how neurons integrate information and relay it through complex neuronal circuits. Most of what is currently known about glutamate transporters, specifically their ability to maintain glutamate homeostasis and limit glutamate diffusion away from the synaptic cleft, is based on studies of glial glutamate transporters. By contrast, little is known about the functional implications of neuronal glutamate transporters. The neuronal glutamate transporter EAAC1 is widely expressed throughout the brain, particularly in the striatum, the primary input nucleus of the basal ganglia, a region implicated with movement execution and reward. Here, we show that EAAC1 limits synaptic excitation onto a population of striatal medium spiny neurons identified for their expression of D1 dopamine receptors (D1-MSNs). In these cells, EAAC1 also contributes to strengthen lateral inhibition from other D1-MSNs. Together, these effects contribute to reduce the gain of the input-output relationship and increase the offset at increasing levels of synaptic inhibition in D1-MSNs. By reducing the sensitivity and dynamic range of action potential firing in D1-MSNs, EAAC1 limits the propensity of mice to rapidly switch between behaviors associated with different reward probabilities. Together, these findings shed light on some important molecular and cellular mechanisms implicated with behavior flexibility in mice.

Revealing abrupt transitions from goal-directed to habitual behavior

A fundamental tenet of animal behavior is that decision-making involves multiple 'controllers.' Initially, behavior is goal-directed, driven by desired outcomes, shifting later to habitual control, where cues trigger actions independent of motivational state. Clark Hull's question from 1943 still resonates today: "Is this transition abrupt, or is it gradual and progressive?"1 Despite a century-long belief in gradual transitions, this question remains unanswered2,3 as current methods cannot disambiguate goal-directed versus habitual control in real-time. Here, we introduce a novel 'volitional engagement' approach, motivating animals by palatability rather than biological need. Offering less palatable water in the home cage4,5 reduced motivation to 'work' for plain water in an auditory discrimination task when compared to water-restricted animals. Using quantitative behavior and computational modeling6, we found that palatability-driven animals learned to discriminate as quickly as water-restricted animals but exhibited state-like fluctuations when responding to the reward-predicting cue-reflecting goal-directed behavior. These fluctuations spontaneously and abruptly ceased after thousands of trials, with animals now always responding to the reward-predicting cue. In line with habitual control, post-transition behavior displayed motor automaticity, decreased error sensitivity (assessed via pupillary responses), and insensitivity to outcome devaluation. Bilateral lesions of the habit-related dorsolateral striatum7 blocked transitions to habitual behavior. Thus, 'volitional engagement' reveals spontaneous and abrupt transitions from goal-directed to habitual behavior, suggesting the involvement of a higher-level process that arbitrates between the two.

Something to Snack on: Can Dietary Modulators Boost Mind and Body?

The last decades have shown that maintaining a healthy and balanced diet can support brain integrity and functionality, while an inadequate diet can compromise it. However, still little is known about the effects and utility of so-called healthy snacks or drinks and their immediate short-term effects on cognition and physical performance. Here, we prepared dietary modulators comprising the essential macronutrients at different ratios and a controlled balanced dietary modulator. We assessed, in healthy adult mice, the short-term effects of these modulators when consumed shortly prior to tests with different cognitive and physical demands. A high-fat dietary modulator sustained increased motivation compared to a carbohydrate-rich dietary modulator (p = 0.041) which had a diminishing effect on motivation (p = 0.018). In contrast, a high-carbohydrate modulator had an initial beneficial effect on cognitive flexibility (p = 0.031). No apparent effects of any of the dietary modulators were observed on physical exercise. There is increasing public demand for acute cognitive and motor function enhancers that can improve mental and intellectual performance in daily life, such as in the workplace, studies, or sports activities. Our findings suggest such enhancers should be tailored to the cognitive demand of the task undertaken, as different dietary modulators will have distinct effects when consumed shortly prior to the task.

Enhanced perceptual task performance without deprivation in mice using medial forebrain bundle stimulation

Perceptual decision-making tasks are essential to many fields of neuroscience. Current protocols generally reward deprived animals with water. However, balancing animals' deprivation level with their well-being is challenging, and trial number is limited by satiation. Here, we present electrical stimulation of the medial forebrain bundle (MFB) as an alternative that avoids deprivation while yielding stable motivation for thousands of trials. Using licking or lever press as a report, MFB animals learnt auditory discrimination tasks at similar speed to water-deprived mice. Moreover, they more reliably reached higher accuracy in harder tasks, performing up to 4,500 trials per session without loss of motivation. MFB stimulation did not impact the underlying sensory behavior since psychometric parameters and response times are preserved. MFB mice lacked signs of metabolic or behavioral stress compared with water-deprived mice. Overall, MFB stimulation is a highly promising tool for task learning because it enhances task performance while avoiding deprivation.

Refinements to rodent head fixation and fluid/food control for neuroscience

The use of head fixation in mice is increasingly common in research, its use having initially been restricted to the field of sensory neuroscience. Head restraint has often been combined with fluid control, rather than food restriction, to motivate behaviour, but this too is now in use for both restrained and non-restrained animals. Despite this, there is little guidance on how best to employ these techniques to optimise both scientific outcomes and animal welfare. This article summarises current practices and provides recommendations to improve animal wellbeing and data quality, based on a survey of the community, literature reviews, and the expert opinion and practical experience of an international working group convened by the UK's National Centre for the Replacement, Refinement and Reduction of Animals in Research (NC3Rs). Topics covered include head fixation surgery and post-operative care, habituation to restraint, and the use of fluid/food control to motivate performance. We also discuss some recent developments that may offer alternative ways to collect data from large numbers of behavioural trials without the need for restraint. The aim is to provide support for researchers at all levels, animal care staff, and ethics committees to refine procedures and practices in line with the refinement principle of the 3Rs.

Proactive and reactive accumulation-to-bound processes compete during perceptual decisions

Standard models of perceptual decision-making postulate that a response is triggered in reaction to stimulus presentation when the accumulated stimulus evidence reaches a decision threshold. This framework excludes however the possibility that informed responses are generated proactively at a time independent of stimulus. Here, we find that, in a free reaction time auditory task in rats, reactive and proactive responses coexist, suggesting that choice selection and motor initiation, commonly viewed as serial processes, are decoupled in general. We capture this behavior by a novel model in which proactive and reactive responses are triggered whenever either of two competing processes, respectively Action Initiation or Evidence Accumulation, reaches a bound. In both types of response, the choice is ultimately informed by the Evidence Accumulation process. The Action Initiation process readily explains premature responses, contributes to urgency effects at long reaction times and mediates the slowing of the responses as animals get satiated and tired during sessions. Moreover, it successfully predicts reaction time distributions when the stimulus was either delayed, advanced or omitted. Overall, these results fundamentally extend standard models of evidence accumulation in decision making by showing that proactive and reactive processes compete for the generation of responses.

Rational regulation of water-seeking effort in rodents

We confirm that rats can act as rational economic agents, making choices about how much work to do to obtain a reward in a way that optimally trades off the value of the reward against the cost of the effort. Contrary to the notion that bigger rewards are more motivating, rats worked harder in economies where rewards were small, ensuring a sufficient minimum income of water. But they chose to earn and consume more water per day when water was “cheap” (available for little work). We present a mathematical model explaining why rats work when they do (surprisingly, not just when they are thirsty) and suggesting where in the brain animals might compute the current value of working for water.

In the laboratory, animals’ motivation to work tends to be positively correlated with reward magnitude. But in nature, rewards earned by work are essential to survival (e.g., working to find water), and the payoff of that work can vary on long timescales (e.g., seasonally). Under these constraints, the strategy of working less when rewards are small could be fatal. We found that instead, rats in a closed economy did more work for water rewards when the rewards were stably smaller, a phenomenon also observed in human labor supply curves. Like human consumers, rats showed elasticity of demand, consuming far more water per day when its price in effort was lower. The neural mechanisms underlying such “rational” market behaviors remain largely unexplored. We propose a dynamic utility maximization model that can account for the dependence of rat labor supply (trials/day) on the wage rate (milliliter/trial) and also predict the temporal dynamics of when rats work. Based on data from mice, we hypothesize that glutamatergic neurons in the subfornical organ in lamina terminalis continuously compute the instantaneous marginal utility of voluntary work for water reward and causally determine the amount and timing of work.

Three Water Restriction Schedules Used in Rodent Behavioral Tasks Transiently Impair Growth and Differentially Evoke a Stress Hormone Response without Causing Dehydration

Water restriction is commonly used to motivate rodents to perform behavioral tasks; however, its effects on hydration and stress hormone levels are unknown. Here, we report daily body weight and bi-weekly packed red blood cell volume and corticosterone (CORT) in adult male rats across 80 days for three commonly used water restriction schedules. We also assessed renal adaptation to water restriction using postmortem histologic evaluation of renal medulla. A control group received ad libitum water. After one week of water restriction, rats on all restriction schedules resumed similar levels of growth relative to the control group. Normal hydration was observed, and water restriction did not drive renal adaptation. An intermittent restriction schedule was associated with an increase in CORT relative to the control group. However, intermittent restriction evokes a stress response which could affect behavioral and neurobiological results. Our results also suggest that stable motivation in behavioral tasks may only be achieved after one week of restriction.

Treadmill-based task for assessing spatial memory in head-fixed mice

Several mouse in vivo neuronal recording techniques require head fixation. Head-fixed treadmill walking can be used to design tasks that enable the study of neural activity in the context of behavior. Here, we provide a detailed protocol for constructing a treadmill with tactile spatial cues, training mice on a rewarded behavioral task, and analyzing behavioral data. We discuss common problems and solutions we have developed to optimize training. Finally, we demonstrate how to test spatial memory performance using this task.

Citric Acid Water as an Alternative to Water Restriction for High-Yield Mouse Behavior

Powerful neural measurement and perturbation tools have positioned mice as an ideal species for probing the neural circuit mechanisms of cognition. Crucial to this success is the ability to motivate animals to perform specific behaviors. One successful strategy is to restrict their water intake, rewarding them with water during a behavioral task. However, water restriction requires rigorous monitoring of animals' health and hydration status and can be challenging for some mice. We present an alternative that allows mice more control over their water intake: free home-cage access to water, made slightly sour by a small amount of citric acid (CA). In a previous study, rats with free access to CA water readily performed a behavioral task for water rewards, although completing fewer trials than under water restriction (Reinagel, 2018). We here extend this approach to mice and confirm its robustness across multiple laboratories. Mice reduced their intake of CA water while maintaining healthy weights. Continuous home-cage access to CA water only subtly impacted their willingness to perform a decision-making task, in which they were rewarded with sweetened water. When free CA water was used instead of water restriction only on weekends, learning and decision-making behavior were unaffected. CA water is thus a promising alternative to water restriction, allowing animals more control over their water intake without interfering with behavioral performance.

An automated homecage system for multiwhisker detection and discrimination learning in mice

Automated, homecage behavioral training for rodents has many advantages: it is low stress, requires little interaction with the experimenter, and can be easily manipulated to adapt to different experimental conditions. We have developed an inexpensive, Arduino-based, homecage training apparatus for sensory association training in freely-moving mice using multiwhisker air current stimulation coupled to a water reward. Animals learn this task readily, within 1–2 days of training, and performance progressively improves with training. We examined the parameters that regulate task acquisition using different stimulus intensities, directions, and reward valence. Learning was assessed by comparing anticipatory licking for the stimulus compared to the no-stimulus (blank) trials. At high stimulus intensities (>9 psi), animals showed markedly less participation in the task. Conversely, very weak air current intensities (1–2 psi) were not sufficient to generate rapid learning behavior. At intermediate stimulus intensities (5–6 psi), a majority of mice learned that the multiwhisker stimulus predicted the water reward after 24–48 hrs of training. Both exposure to isoflurane and lack of whiskers decreased animals’ ability to learn the task. Following training at an intermediate stimulus intensity, mice were able to transfer learning behavior when exposed to a lower stimulus intensity, an indicator of perceptual learning. Mice learned to discriminate between two directions of stimulation rapidly and accurately, even when the angular distance between the stimuli was <15 degrees. Switching the reward to a more desirable reward, aspartame, had little effect on learning trajectory. Our results show that a tactile association task in an automated homecage environment can be monitored by anticipatory licking to reveal rapid and progressive behavioral change. These Arduino-based, automated mouse cages enable high-throughput training that facilitate analysis of large numbers of genetically modified mice with targeted manipulations of neural activity.

Open-source raspberry Pi-based operant box for translational behavioral testing in rodents

BACKGROUND

Rodents have been used for decades to probe neural circuits involved in behavior. Increasingly, attempts have been developed to standardize training paradigms across labs; and to use visual/auditory paradigms that can be also tested in humans. Commercially available systems are expensive and thus do not scale easily, and are not optimized for electrophysiology.

NEW METHOD

Using the rich open-source technology built around Raspberry Pi, we were able to develop an inexpensive (<$1000) visual-screen based operant chamber with electrophysiological and optogenetic compatibility. The chamber is operated within MATLAB/Simulink, a commonly used scientific programming language allowing for rapid customization.

RESULTS

Here, we describe and provide all relevant details needed to develop and produce these chambers, and show examples of behavior and electrophysiology data collected using these chambers. We also include all of the tools needed to allow readers to build and develop their own boxes (CAD models for 3D printing and laser-cutting; PCB-board design; all bill of materials for required parts and supplies, and some examples of Simulink models to operate the boxes).

COMPARISON WITH EXISTING METHODS

The new boxes are far more cost-effective than commercially available environments and allow for the combination of automated behavioral testing with electrophysiological read-outs with high temporal precision.

CONCLUSION

These open-source boxes can be used for labs interested in developing high-throughput visual/auditory behavioral assays for ∼ 10th the cost of commercial systems.

Ratbot navigation using deep brain stimulation in ventral posteromedial nucleus

Deep Brain Stimulation (DBS) is a medical-practical method and has been applied to solve many medical complications. Animal usage as sensors and actuators, mind-controlled machines, and animal navigation are some of the non-medical DBS applications. One of the brain areas used in ratbot navigation is the Ventral Posteromedial Nucleus (VPM), which creates non-volunteer head rotation. Rat training by water/food restriction can be used to create forward movement. In this study, a combination of VPM stimulation and water/food restriction has been employed to establish a complete navigation system. Five rats responded to VPM stimulations. However, with three of them, rats rotated to the same direction after the stimulations of either VPM side of the brain. Two rats rotated bilaterally, proportionate to the VPM stimulation side. These two rats were trained in a T-shape maze and became ratbots. The results of the 3-session test showed that their navigation performances were 96% and 86%, respectively. These ratbots are suitable for navigational purposes and are ready to complete the missions that are dangerous or impossible for humans.