From hand to mouth: monkeys require greater effort in motor preparation for voluntary control of vocalization than for manual actions

Voluntary control of vocal production is an essential component of the language faculty, which is thought to distinguish humans from other primates. Recent experiments have begun to reveal the capability of non-human primates to perform vocal control; however, the mechanisms underlying this ability remain unclear. Here, we revealed that Japanese macaque monkeys can learn to vocalize voluntarily through a different mechanism than that used for manual actions. The monkeys rapidly learned to touch a computer monitor when a visual stimulus was presented and showed a capacity for flexible adaptation, such that they reacted when the visual stimulus was shown at an unexpected time. By contrast, successful vocal training required additional time, and the monkeys exhibited difficulty with vocal execution when the visual stimulus appeared earlier than expected; this occurred regardless of extensive training. Thus, motor preparation before execution of an action may be a key factor in distinguishing vocalization from manual actions in monkeys; they do not exhibit a similar ability to perform motor preparation in the vocal domains. By performing direct comparisons, this study provides novel evidence regarding differences in motor control abilities between vocal and manual actions. Our findings support the suggestion that the functional expansion from hand to mouth might be a critical evolutionary event for the acquisition of voluntary control of vocalizations.

Effects of metronomic sounds on a self-paced tapping task in budgerigars and humans

The origin of rhythmic synchronization or entrainment to a musical beat in animals has been widely discussed. Parrots are suitable animals to examine the relationship between the capability of vocal learning and spontaneous rhythmic synchronization. In this study, budgerigars Melopsittacus undulatus learned to tap (peck) 2 keys alternately at a self-paced rate. Then, the metronomic sounds were played in the background during test sessions while the birds were performing the key pecking task, although they were not required to synchronize tap timing with the metronome. We found modest but significant effects of the metronome rhythms on the tap timing in some subjects. We also tested humans Homo sapiens using almost the same method. In contrast to the birds, a number of human subjects synchronized tap timing to the onset of the metronome without verbal or documented instructions. However, we failed to find an effect of the metronome on self-paced tap timing in some human subjects, although they were capable of rhythmic synchronization. This is the first report describing the effects of metronomic sounds on self-paced tapping in nonhuman vocal learners. This study introduces a new method that can be used in future research comparing birds that differ in vocal learning capacities, social structure, age, sex, hormonal status, and so on as part of examinations of the evolutionary foundations of beat processing.

Operant conditioning of the tibialis anterior motor evoked potential in people with and without chronic incomplete spinal cord injury

The activity of corticospinal pathways is important in movement control, and its plasticity is essential for motor skill learning and re-learning after central nervous system (CNS) injuries. Therefore, enhancing the corticospinal function may improve motor function recovery after CNS injuries. Operant conditioning of stimulus-induced muscle responses (e.g., reflexes) is known to induce the targeted plasticity in a targeted pathway. Thus, an operant conditioning protocol to target the corticospinal pathways may be able to enhance the corticospinal function. To test this possibility, we investigated whether operant conditioning of the tibialis anterior (TA) motor evoked potential (MEP) to transcranial magnetic stimulation can enhance corticospinal excitability in people with and without chronic incomplete spinal cord injury (SCI). The protocol consisted of 6 baseline and 24 up-conditioning/control sessions over 10 wk. In all sessions, TA MEPs were elicited at 10% above active MEP threshold while the sitting participant provided a fixed preset level of TA background electromyographic activity. During baseline sessions, MEPs were simply measured. During conditioning trials of the conditioning sessions, the participant was encouraged to increase MEP and was given immediate feedback indicating whether MEP size was above a criterion. In 5/8 participants without SCI and 9/10 with SCI, over 24 up-conditioning sessions, MEP size increased significantly to ~150% of the baseline value, whereas the silent period (SP) duration decreased by ~20%. In a control group of participants without SCI, neither MEP nor SP changed. These results indicate that MEP up-conditioning can facilitate corticospinal excitation, which is essential for enhancing motor function recovery after SCI. NEW & NOTEWORTHY We investigated whether operant conditioning of the motor evoked potential (MEP) to transcranial magnetic stimulation can systematically increase corticospinal excitability for the ankle dorsiflexor tibialis anterior (TA) in people with and without chronic incomplete spinal cord injury. We found that up-conditioning can increase the TA MEP while reducing the accompanying silent period (SP) duration. These findings suggest that MEP up-conditioning produces the facilitation of corticospinal excitation as targeted, whereas it suppresses inhibitory mechanisms reflected in SP.

Can Mindfulness Address Maladaptive Eating Behaviors? Why Traditional Diet Plans Fail and How New Mechanistic Insights May Lead to Novel Interventions

Emotional and other maladaptive eating behaviors develop in response to a diversity of triggers, from psychological stress to the endless external cues in our modern food environment. While the standard approach to food- and weight-related concerns has been weight-loss through dietary restriction, these interventions have produced little long-term benefit, and may be counterproductive. A growing understanding of the behavioral and neurobiological mechanisms that underpin habit formation may explain why this approach has largely failed, and pave the way for a new generation of non-pharmacologic interventions. Here, we first review how modern food environments interact with human biology to promote reward-related eating through associative learning, i.e., operant conditioning. We also review how operant conditioning (positive and negative reinforcement) cultivates habit-based reward-related eating, and how current diet paradigms may not directly target such eating. Further, we describe how mindfulness training that targets reward-based learning may constitute an appropriate intervention to rewire the learning process around eating. We conclude with examples that illustrate how teaching patients to tap into and act on intrinsic (e.g., enjoying healthy eating, not overeating, and self-compassion) rather than extrinsic reward mechanisms (e.g., weighing oneself), is a promising new direction in improving individuals' relationship with food.

Valence and Intensity of Video Stimuli of Dogs and Conspecifics in Sheep: Approach-Avoidance, Operant Response, and Attention

Simple Summary

Animals’ judgement of stimuli’s negativity or positivity cannot always be assumed. To assess the valence and intensity of video stimuli (dogs as negative vs. conspecifics as positive stimuli) in sheep, we used three experimental approaches: (1) an approach-avoidance paradigm; (2) operant conditioning using the videos as reinforcers; and (3) an attention test. We measured sheep’s behavioral and physiological reactions. Sheep generally reacted to the videos presented. Nevertheless, we found no support with the approach–avoidance paradigm, and the attention test for dog videos were more negative than sheep videos. However, the operant conditioning indicated that sheep were more prone to avoid videos of moving dogs. Overall, we found that standard video images may not be ideal to represent valence characteristics of stimuli to sheep.

Abstract

Stimuli are often presumed to be either negative or positive. However, animals’ judgement of their negativity or positivity cannot generally be assumed. A possibility to assess emotional states in animals elicited by stimuli is to investigate animal preferences and their motivation to gain access to these stimuli. This study’s aim was to assess the valence of social stimuli in sheep. We used silent videos of varying intensity of dogs as negative versus conspecifics as positive stimuli in three approaches: (1) an approach–avoidance paradigm; (2) operant conditioning using the video stimuli as reinforcers; and (3) an attention test. In the latter, we assessed differential attention of sheep to simultaneous projections by automatically tracking sheep head and ear postures and recording brain activity. With these approaches, it was difficult to support that the sheep’s reactions varied according to the stimuli’s presumed valence and intensity. The approach–avoidance paradigm and attention test did not support the assumption that dog videos were more negative than sheep videos, though sheep reacted to the stimuli presented. Results from the operant conditioning indicated that sheep were more prone to avoid videos of moving dogs. Overall, we found that standard video images may not be ideal to represent valence characteristics of stimuli to sheep.

Comparison of the Time-Dependent Changes in Immediate Early Gene Labeling and Spine Density Following Abstinence From Contingent or Non-contingent Chocolate Pellet Delivery

Rationale: Incubation of craving is a phenomenon whereby responding for cues associated with a reward increases over extended periods of abstinence. Both contingent and non-contingent behavioral designs have been used to study the incubation of craving phenomenon with differing results. The present study directly compares behavioral and neural changes following contingent or non-contingent administration of chocolate flavored pellets.

Objective: The current study examined whether an incubation of craving response would be observed at the behavioral and neural levels following delays of abstinence from chocolate pellets in a contingent or non-contingent reinforcement design.

Methods: Rats were trained for 10 days to bar press for chocolate pellets (contingent) or received chocolate pellets in a non-contingent design (classical conditioning). Groups were then subjected to abstinence from the reward for 24 h, 7, 14 or 28 days at which point they were tested for responding for reward associated cues. Following the test, brains from all rats were processed and assessed for c-Fos and FosB labeling as well as dendritic spine density in the nucleus accumbens (NAc).

Results: Behavioral measures during the test (lever presses, food hopper entries and locomotor activity) revealed similar behavioral outcomes across all delays indicating the lack of an incubation of craving response on both the contingent and non-contingent designs. Overall, labeling of c-Fos in the NAc was lower for the non-contingent group compared to the operant-trained and food restricted control. Compared to the operant-trained and non-trained control groups, a significantly reduced FosB labeling was noted in the NAc of the classically conditioned groups across all abstinence periods. Spine density in the NAc was elevated in both the classically and operant conditioned compared to the food-restricted, non-trained controls.

Conclusions: Chocolate pellet reward did not result in incubation of craving but did produce behavioral learning that was associated with increased spine density. This suggests that chocolate pellet administration results in long-term structural and functional changes that are present for at least 28 days following abstinence. Contingent and non-contingent administration resulted in differential immediate early gene labeling in the NAc, but the functional significance of this has yet to be elucidated.

Divergent Solutions to Visual Problem Solving across Mammalian Species

Our understanding of the neurobiological underpinnings of learning and behavior relies on the use of invasive techniques, which necessitate the use of animal models. However, when different species learn the same task, to what degree are they actually producing the same behavior and engaging homologous neural circuitry? This question has received virtually no recent attention, even as the most powerful new methodologies for measuring and perturbing the nervous system have become increasingly dependent on the use of murine species. Here, we test humans, rats, monkeys, and an evolutionarily intermediate species, tree shrews, on a three alternative, forced choice, visual contrast discrimination task. As anticipated, learning rate, peak performance, and transfer across contrasts was lower in the rat compared to the other species. More interestingly, rats exhibited two major behavioral peculiarities: while monkeys and tree shrews based their choices largely on visual information, rats tended to base their choices on past reward history. Furthermore, as the task became more difficult, rats largely disengaged from the visual stimulus, reverting to innate spatial predispositions in order to collect rewards near chance probability. Our findings highlight the limitation of muridae as models for translational research, at least in the area of visually based decision making.

Retraining Reflexes: Clinical Translation of Spinal Reflex Operant Conditioning

Neurological disorders, such as spinal cord injury, stroke, traumatic brain injury, cerebral palsy, and multiple sclerosis cause motor impairments that are a huge burden at the individual, family, and societal levels. Spinal reflex abnormalities contribute to these impairments. Spinal reflex measurements play important roles in characterizing and monitoring neurological disorders and their associated motor impairments, such as spasticity, which affects nearly half of those with neurological disorders. Spinal reflexes can also serve as therapeutic targets themselves. Operant conditioning protocols can target beneficial plasticity to key reflex pathways; they can thereby trigger wider plasticity that improves impaired motor skills, such as locomotion. These protocols may complement standard therapies such as locomotor training and enhance functional recovery. This paper reviews the value of spinal reflexes and the therapeutic promise of spinal reflex operant conditioning protocols; it also considers the complex process of translating this promise into clinical reality.

Intragastric nutrient infusion reduces motivation for food in male and female rats

The idea that gut-derived satiation signals influence food reward has recently gained traction, but this hypothesis is largely based on studies focused on neural circuitry, not the peripherally released signals. Here, we directly tested the hypothesis that intragastric (IG) nutrient infusion can suppress motivation for food. In a series of experiments, IG sucrose infusion (15 kcal) significantly and reliably reduced operant responding for a sucrose reward on a progressive ratio (PR) schedule. Moreover, food deprivation for 24 h before the test session did not prevent the suppressive effect of nutrients. The suppressive effect of IG sucrose on fixed ratio 5 (FR5) operant responding was also assessed as a comparison. The effect of IG nutrients to reduce motivation was not limited to sucrose; IG Ensure infusion (9.3 kcal) also significantly reduced PR operant responding for sucrose pellets. To verify that these effects were not secondary to the osmotic challenge of concentrated nutrients, we tested IG infusion of noncaloric saline solutions equiosmolar to 40% sucrose or Ensure and found no effect. Finally, we focused on glucagon-like peptide-1 (GLP-1) and cholecystokinin (CCK) as candidate mediators for the effect of IG nutrients. Pretreatment with exendin-9, a GLP-1 receptor antagonist, delivered intraperitoneally, significantly attenuated the ability of IG nutrients to suppress PR responding and breakpoint in males, but not in females, whereas pretreatment with devazepide, a CCK_A receptor antagonist, failed to do so in both sexes. Together, these data support the idea that nutrient-induced satiation signals influence food reward and may implicate GLP-1 in this process.

Learning and Unlearning of Pain

This review provides an overview of learning mechanisms and memory aspects for the development of chronic pain. Pain can be influenced in important ways by an individual's personality, by family, and by the sociocultural environment in which they live. Therefore, learning mechanisms can explain why pain experience and pain behavior can increase or decrease. Linking pain with positive consequences or removing negative consequences can contribute significantly to the chronification of pain. We will provide an overview of treatment options that use the characteristics of extinction. Operant extinction training and cognitive behavioral approaches show promising results for the treatment of chronic pain.

Adult neurogenesis affects motivation to obtain weak, but not strong, reward in operant tasks

Decreased motivation to seek rewards is a key feature of mood disorders that correlates with severity and treatment outcome. This anhedonia, or apathy, likely reflects impairment in reward circuitry, but the specific neuronal populations controlling motivation are unclear. Granule neurons generated in the adult hippocampus have been implicated in mood disorders, but are not generally considered as part of reward circuits. We investigated a possible role of these new neurons in motivation to work for food and sucrose rewards in operant conditioning tasks using GFAP-TK pharmacogenetic ablation of adult neurogenesis in both rats and mice. Rats and mice lacking adult neurogenesis showed normal lever press responding during fixed ratio training, reward devaluation, and Pavlovian Instrumental Transfer, suggesting no impairment in learning. However, on an exponentially progressive ratio schedule, or when regular chow was freely available in the testing chamber, TK rats and mice showed less effort to gain sucrose tablets. When working for balanced food tablets, which rats and mice of both genotypes strongly preferred over sucrose, the genotype effects on behavior were lost. This decrease in effort under conditions of low reward suggests that loss of adult neurogenesis decreases motivation to seek reward in a manner that may model behavioral apathy.

Training Rats Using Water Rewards Without Water Restriction

High-throughput behavioral training of rodents has been a transformative development for systems neuroscience. Water or food restriction is typically required to motivate task engagement. We hypothesized a gap between physiological water need and hedonic water satiety that could be leveraged to train rats for water rewards without water restriction. We show that when Citric Acid (CA) is added to water, female rats drink less, yet consume enough to maintain long term health. With 24 h/day access to a visual task with water rewards, rats with ad lib CA water performed 84% ± 18% as many trials as in the same task under water restriction. In 2-h daily sessions, rats with ad lib CA water performed 68% ± 13% as many trials as under water restriction. Using reward sizes <25 μl, rats with ad lib CA performed 804 ± 285 trials/day in live-in sessions or 364 ± 82 trials/day in limited duration daily sessions. The safety of CA water amendment was previously shown for male rats, and the gap between water need and satiety was similar to what we observed in females. Therefore, it is likely that this method will generalize to male rats, though this remains to be shown. We conclude that at least in some contexts rats can be trained using water rewards without water restriction, benefitting both animal welfare and scientific productivity.

Contrasting effects of pre-training on acquisition of operant and radial arm maze tasks in rats

Performing multiple tasks either simultaneously, in rapid alternation or in succession, is routine in daily life. Further, testing rodents in a battery of tests is common both in drug discovery and behavioral phenotyping research. However, learning of new tasks can be influenced by prior experience(s). There has been some research on 'switching cost' involved in the transition from one behavior to another. However, there has been no specific assessment of the effect of learning an operant paradigm on performance in a spatial memory task and vice versa. Accordingly, we evaluated task switching between two forms of learning paradigms, operant conditioning and radial arm maze (RAM) tasks. In experiment 1, rats were trained for operant conditioning with food reward followed by a partially baited RAM task. In experiment 2, rats were trained first on a RAM task followed by operant learning. Pre-training on the operant task, impaired the acquisition of the RAM. On the contrary, pre-training on the RAM enhanced operant performance. Our study reveals significant effects of the test order on task-switching in rats. This knowledge can be useful when framing test sequences in test batteries for drug discovery research and screening genetically modified mice.

Evaluation of visual motion perception ability in mice with knockout of the dyslexia candidate susceptibility gene Dcdc2

Developmental dyslexia is a heritable disability characterized by difficulties in learning to read and write. The neurobiological and genetic mechanisms underlying dyslexia remain poorly understood; however, several dyslexia candidate risk genes have been identified. One of these candidate risk genes-doublecortin domain containing 2 (DCDC2)-has been shown to play a role in neuronal migration and cilia function. At a behavioral level, variants of DCDC2 have been associated with impairments in phonological processing, working memory and reading speed. Additionally, a specific mutation in DCDC2 has been strongly linked to deficits in motion perception-a skill subserving reading abilities. To further explore the relationship between DCDC2 and dyslexia, a genetic knockout (KO) of the rodent homolog of DCDC2 (Dcdc2) was created. Initial studies showed that Dcdc2 KOs display deficits in auditory processing and working memory. The current study was designed to evaluate the association between DCDC2 and motion perception, as these skills have not yet been assessed in the Dcdc2 KO mouse model. We developed a novel motion perception task, utilizing touchscreen technology and operant conditioning. Dcdc2 KOs displayed deficits on the Pairwise Discrimination task specifically as motion was added to visual stimuli. Following behavioral assessment, brains were histologically prepared for neuroanatomical analysis of the lateral geniculate nucleus (LGN). The cumulative distribution showed that Dcdc2 KOs exhibited more small neurons and fewer larger neurons in the LGN. Results compliment findings that DCDC2 genetic alteration results in anomalies in visual motion pathways in a subpopulation of dyslexic patients.

Early Alterations in Operant Performance and Prominent Huntingtin Aggregation in a Congenic F344 Rat Line of the Classical CAGn51trunc Model of Huntington Disease

The transgenic rat model of Huntington disease expressing a fragment of mutant HTT (tgHD rat) has been thoroughly characterized and reproduces hallmark symptoms of human adult-onset HD. Pursuing the optimization of this model for evaluation of translational therapeutic approaches, the F344 inbred rat strain was considered as advantageous genetic background for the expression of the HD transgenic construct. In the present study, a novel congenic line of the SPRDtgHD transgenic model of HD, carrying 51 CAG repeats, was generated on the F344 rat genetic background. To assess the behavioral phenotype, classical assays investigating motor function, emotion, and sensorimotor gating were applied, along with automated screening of metabolic and activity parameters as well as operant conditioning tasks. The neuropathological phenotype was analyzed by immunohistochemistry and ex vivo magnetic resonance imaging. F344tgHD rats displayed markedly reduced anxiety-like behavior in the social interaction test and elevated impulsivity traits already at 3 months of age. Neuropathologically, reduced striatal volume and pronounced aggregation of mutant huntingtin in several brain regions were detected at later disease stage. In conclusion, the congenic F344tgHD model reproduces key aspects of the human HD phenotype, substantiating its value for translational therapeutic approaches.

Audio-Visual Integration in a Redundant Target Paradigm: A Comparison between Rhesus Macaque and Man

The mechanisms underlying multi-sensory interactions are still poorly understood despite considerable progress made since the first neurophysiological recordings of multi-sensory neurons. While the majority of single-cell neurophysiology has been performed in anesthetized or passive-awake laboratory animals, the vast majority of behavioral data stems from studies with human subjects. Interpretation of neurophysiological data implicitly assumes that laboratory animals exhibit perceptual phenomena comparable or identical to those observed in human subjects. To explicitly test this underlying assumption, we here characterized how two rhesus macaques and four humans detect changes in intensity of auditory, visual, and audio-visual stimuli. These intensity changes consisted of a gradual envelope modulation for the sound, and a luminance step for the LED. Subjects had to detect any perceived intensity change as fast as possible. By comparing the monkeys' results with those obtained from the human subjects we found that (1) unimodal reaction times differed across modality, acoustic modulation frequency, and species, (2) the largest facilitation of reaction times with the audio-visual stimuli was observed when stimulus onset asynchronies were such that the unimodal reactions would occur at the same time (response, rather than physical synchrony), and (3) the largest audio-visual reaction-time facilitation was observed when unimodal auditory stimuli were difficult to detect, i.e., at slow unimodal reaction times. We conclude that despite marked unimodal heterogeneity, similar multisensory rules applied to both species. Single-cell neurophysiology in the rhesus macaque may therefore yield valuable insights into the mechanisms governing audio-visual integration that may be informative of the processes taking place in the human brain.

How Much of Language Acquisition Does Operant Conditioning Explain?

Since the 1950s, when Chomsky argued that Skinner's arguments could not explain syntactic acquisition, psychologists have generally avoided explicitly invoking operant or instrumental conditioning as a learning mechanism for language among human children. In this article, we argue that this is a mistake. We focus on research that has been done on language learning in human infants and toddlers in order to illustrate our points. Researchers have ended up inventing learning mechanisms that, in actual practice, not only resemble but also in fact are examples of operant conditioning (OC) by any other name they select. We argue that language acquisition researchers should proceed by first ruling out OC before invoking alternative learning mechanisms. While it is possible that OC cannot explain all of the language acquisition, simple learning mechanisms that work across species may have some explanatory power in children's language learning.

Slow Breathing Can Be Operantly Conditioned in the Rat and May Reduce Sensitivity to Experimental Stressors

In humans, exercises involving slowed respiratory rate (SRR) counter autonomic sympathetic bias and reduce responses to stressors, including in individuals with various degrees of autonomic dysfunction. In the rat, we examined whether operant conditioning could lead to reductions in respiratory rate (RR) and performed preliminary studies to assess whether conditioned SRR was sufficient to decrease physiological and behavioral responsiveness to stressors. RR was continuously monitored during 20 2-h sessions using whole body plethysmography. SRR conditioned, but not yoked control rats, were able to turn off aversive visual stimulation (intermittent bright light) by slowing their breathing below a preset target of 80 breaths/min. SRR conditioned rats greatly increased the incidence of breaths below the target RR over training, with average resting RR decreasing from 92 to 81 breaths/min. These effects were significant as a group and vs. yoked controls. Preliminary studies in a subset of conditioned rats revealed behavioral changes suggestive of reduced reactivity to stressful and nociceptive stimuli. In these same rats, intermittent sessions without visual reinforcement and a post-training priming stressor (acute restraint) demonstrated that conditioned rats retained reduced RR vs. controls in the absence of conditioning. In conclusion, we present the first successful attempt to operantly condition reduced RR in an animal model. Although further studies are needed to clarify the physio-behavioral concomitants of slowed breathing, the developed model may aid subsequent neurophysiological inquiries on the role of slow breathing in stress reduction.

Cdh13 and AdipoQ gene knockout alter instrumental and Pavlovian drug conditioning

Genome-wide association studies in humans have suggested that variants of the cadherin-13 (CDH13) gene are associated with substance use disorder, subjective response to amphetamine, and attention deficit hyperactivity disorder. To examine the role of the Cdh13 and its peptide ligand adiponectin (AdipoQ) in addiction-related behaviors, we assessed Cdh13 knockout (KO) rats and AdipoQ KO mice using intravenous cocaine self-administration and conditioned place preference (CPP) paradigms. During intravenous cocaine self-administration, male Cdh13 heterozygous (+/-) and KO (-/-) rats showed increased cue-induced reinstatement compared with wild-type (WT) rats when presented with a cocaine-paired stimulus, whereas female Cdh13 rats showed no differences across genotype. Cdh13 -/- rats showed higher responding for a saccharin reinforcer and learned the choice reaction time (RT) task more slowly than WTs. However, we found no differences between Cdh13 -/- and +/+ rats in responding for sensory reinforcement, number of premature responses in the RT task, tendency to approach a Pavlovian food cue, CPP and locomotor activation to cocaine (10 or 20 mg/kg). In AdipoQ -/- mice, there was a significant increase in CPP to methamphetamine (1 mg/kg) but not to a range of d-amphetamine doses (0.5, 1, 2 and 4 mg/kg). Taken together, these data suggest that Cdh13 and AdipoQ regulate sensitivity to psychomotor stimulants and palatable rewards without producing major changes in other behaviors. In humans, these two genes may regulate sensitivity to natural and drug rewards, thus influencing susceptibility to the conditioned drug effects and relapse.

Rapid Integration of Artificial Sensory Feedback during Operant Conditioning of Motor Cortex Neurons

Neuronal motor commands, whether generating real or neuroprosthetic movements, are shaped by ongoing sensory feedback from the displacement being produced. Here we asked if cortical stimulation could provide artificial feedback during operant conditioning of cortical neurons. Simultaneous two-photon imaging and real-time optogenetic stimulation were used to train mice to activate a single neuron in motor cortex (M1), while continuous feedback of its activity level was provided by proportionally stimulating somatosensory cortex. This artificial signal was necessary to rapidly learn to increase the conditioned activity, detect correct performance, and maintain the learned behavior. Population imaging in M1 revealed that learning-related activity changes are observed in the conditioned cell only, which highlights the functional potential of individual neurons in the neocortex. Our findings demonstrate the capacity of animals to use an artificially induced cortical channel in a behaviorally relevant way and reveal the remarkable speed and specificity at which this can occur.

•

All-optical brain-machine-brain interface for neuroprosthetic control

•

Mice rapidly learn to activate single neurons under optogenetically evoked feedback

•

Population imaging reveals that learning is restricted to the conditioned neuron

•

Novel “in cerebro” learning paradigm for neural circuit dissection

Why New Spinal Cord Plasticity Does Not Disrupt Old Motor Behaviors

When new motor learning changes the spinal cord, old behaviors are not impaired; their key features are preserved by additional compensatory plasticity. To explore the mechanisms responsible for this compensatory plasticity, we transected the spinal dorsal ascending tract before or after female rats acquired a new behavior-operantly conditioned increase or decrease in the right soleus H-reflex-and examined an old behavior-locomotion. Neither spinal dorsal ascending tract transection nor H-reflex conditioning alone impaired locomotion. Nevertheless, when spinal dorsal ascending tract transection and H-reflex conditioning were combined, the rats developed a limp and a tilted posture that correlated in direction and magnitude with the H-reflex change. When the right H-reflex was increased by conditioning, the right step lasted longer than the left and the right hip was higher than the left; when the right H-reflex was decreased by conditioning, the opposite occurred. These results indicate that ascending sensory input guides the compensatory plasticity that normally prevents the plasticity underlying H-reflex change from impairing locomotion. They support the concept of the state of the spinal cord as a negotiated equilibrium that reflects the concurrent influences of all the behaviors in an individual's repertoire; and they support the new therapeutic strategies this concept introduces.SIGNIFICANCE STATEMENT The spinal cord provides a reliable final common pathway for motor behaviors throughout life. Until recently, its reliability was explained by the assumption that it is hardwired; but it is now clear that the spinal cord changes continually as new behaviors are acquired. Nevertheless, old behaviors are preserved. This study shows that their preservation depends on sensory feedback from the spinal cord to the brain: if feedback is removed, the acquisition of a new behavior may disrupt an old behavior. In sum, when a new behavior changes the spinal cord, sensory feedback to the brain guides further change that preserves old behaviors. This finding contributes to a new understanding of spinal cord function and to development of new rehabilitation therapies.

Distinct Fos-Expressing Neuronal Ensembles in the Ventromedial Prefrontal Cortex Mediate Food Reward and Extinction Memories

In operant learning, initial reward-associated memories are thought to be distinct from subsequent extinction-associated memories. Memories formed during operant learning are thought to be stored in "neuronal ensembles." Thus, we hypothesize that different neuronal ensembles encode reward- and extinction-associated memories. Here, we examined prefrontal cortex neuronal ensembles involved in the recall of reward and extinction memories of food self-administration. We first trained rats to lever press for palatable food pellets for 7 d (1 h/d) and then exposed them to 0, 2, or 7 daily extinction sessions in which lever presses were not reinforced. Twenty-four hours after the last training or extinction session, we exposed the rats to either a short 15 min extinction test session or left them in their homecage (a control condition). We found maximal Fos (a neuronal activity marker) immunoreactivity in the ventral medial prefrontal cortex of rats that previously received 2 extinction sessions, suggesting that neuronal ensembles in this area encode extinction memories. We then used the Daun02 inactivation procedure to selectively disrupt ventral medial prefrontal cortex neuronal ensembles that were activated during the 15 min extinction session following 0 (no extinction) or 2 prior extinction sessions to determine the effects of inactivating the putative food reward and extinction ensembles, respectively, on subsequent nonreinforced food seeking 2 d later. Inactivation of the food reward ensembles decreased food seeking, whereas inactivation of the extinction ensembles increased food seeking. Our results indicate that distinct neuronal ensembles encoding operant reward and extinction memories intermingle within the same cortical area.

SIGNIFICANCE STATEMENT

A current popular hypothesis is that neuronal ensembles in different prefrontal cortex areas control reward-associated versus extinction-associated memories: the dorsal medial prefrontal cortex (mPFC) promotes reward seeking, whereas the ventral mPFC inhibits reward seeking. In this paper, we use the Daun02 chemogenetic inactivation procedure to demonstrate that Fos-expressing neuronal ensembles mediating both food reward and extinction memories intermingle within the same ventral mPFC area.

Acoustic startle modification as a tool for evaluating auditory function of the mouse: Progress, pitfalls, and potential

Acoustic startle response (ASR) modification procedures, especially prepulse inhibition (PPI), are increasingly used as behavioral measures of auditory processing and sensorimotor gating in rodents due to their perceived ease of implementation and short testing times. In practice, ASR and PPI procedures are extremely variable across animals, experimental setups, and studies, and the interpretation of results is subject to numerous caveats and confounding influences. We review considerations for modification of the ASR using acoustic stimuli, and we compare the sensitivity of PPI procedures to more traditional operant psychoacoustic techniques. We also discuss non-auditory variables that must be considered. We conclude that ASR and PPI measures cannot substitute for traditional operant techniques due to their low sensitivity. Additionally, a substantial amount of pilot testing must be performed to properly optimize an ASR modification experiment, negating any time benefit over operant conditioning. Nevertheless, there are some circumstances where ASR measures may be the only option for assessing auditory behavior, such as when testing mouse strains with early-onset hearing loss or learning impairments.

A Cognition-Related Neural Oscillation Pattern, Generated in the Prelimbic Cortex, Can Control Operant Learning in Rats

The prelimbic (PrL) cortex constitutes one of the highest levels of cortical hierarchy dedicated to the execution of adaptive behaviors. We have identified a specific local field potential (LFP) pattern generated in the PrL cortex and associated with cognition-related behaviors. We used this pattern to trigger the activation of a visual display on a touch screen as part of an operant conditioning task. Rats learned to increase the presentation rate of the selected θ to β-γ (θ/β-γ) transition pattern across training sessions. The selected LFP pattern appeared to coincide with a significant decrease in the firing of PrL pyramidal neurons and did not seem to propagate to other cortical or subcortical areas. An indication of the PrL cortex's cognitive nature is that the experimental disruption of this θ/β-γ transition pattern prevented the proper performance of the acquired task without affecting the generation of other motor responses. The use of this LFP pattern to trigger an operant task evoked only minor changes in its electrophysiological properties. Thus, the PrL cortex has the capability of generating an oscillatory pattern for dealing with environmental constraints. In addition, the selected θ/β-γ transition pattern could be a useful tool to activate the presentation of external cues or to modify the current circumstances.SIGNIFICANCE STATEMENT Brain-machine interfaces represent a solution for physically impaired people to communicate with external devices. We have identified a specific local field potential pattern generated in the prelimbic cortex and associated with goal-directed behaviors. We used the pattern to trigger the activation of a visual display on a touch screen as part of an operant conditioning task. Rats learned to increase the presentation rate of the selected field potential pattern across training. The selected pattern was not modified when used to activate the touch screen. Electrical stimulation of the recording site prevented the proper performance of the task. Our findings show that the prelimbic cortex can generate oscillatory patterns that rats can use to control their environment for achieving specific goals.

Open-Source, Low Cost, Free-Behavior Monitoring, and Reward System for Neuroscience Research in Non-human Primates

We describe a low-cost system designed to document bodily movement and neural activity and deliver rewards to monkeys behaving freely in their home cage. An important application is to studying brain-machine interface (BMI) systems during free behavior, since brain signals associated with natural movement can differ significantly from those associated with more commonly used constrained conditions. Our approach allows for short-latency (<500 ms) reward delivery and behavior monitoring using low-cost off-the-shelf components. This system interfaces existing untethered recording equipment with a custom hub that controls a cage-mounted feeder. The behavior monitoring system uses a depth camera to provide real-time, easy-to-analyze, gross movement data streams. In a proof-of-concept experiment we demonstrate robust learning of neural activity using the system over 14 behavioral sessions.