Open-Source, Low Cost, Free-Behavior Monitoring, and Reward System for Neuroscience Research in Non-human Primates

We describe a low-cost system designed to document bodily movement and neural activity and deliver rewards to monkeys behaving freely in their home cage. An important application is to studying brain-machine interface (BMI) systems during free behavior, since brain signals associated with natural movement can differ significantly from those associated with more commonly used constrained conditions. Our approach allows for short-latency (<500 ms) reward delivery and behavior monitoring using low-cost off-the-shelf components. This system interfaces existing untethered recording equipment with a custom hub that controls a cage-mounted feeder. The behavior monitoring system uses a depth camera to provide real-time, easy-to-analyze, gross movement data streams. In a proof-of-concept experiment we demonstrate robust learning of neural activity using the system over 14 behavioral sessions.

Successful treatment of infertility in a female Sumatran orangutan Pongo abelii

In 2011, a female Sumatran orangutan housed at Durrell Wildlife Conservation Trust became infertile following a massive antepartum hemorrhage in labor and the delivery of a stillborn infant. The placenta was infected with Pantoea sp. Hysterosalpingography (HSG) revealed blocked fallopian tubes, and pressurized fallopian tube perfusion was used to reverse the tubal occlusion. She subsequently conceived and following an intensive training program, we were able to measure umbilical artery waveform analysis for fetal well-being and placental localization to exclude placenta previa, which could complicate pregnancy and lead to catastrophic hemorrhage. The female went on to deliver a healthy offspring. We suggest that these techniques should be considered for other infertile females in the global captive population.

Context-dependent extinction of an appetitive operant conditioned response in infant rats

The present study evaluated context-dependent learning under an operant conditioning procedure in infant rats. Preweanling rats were trained in context A during postnatal days (PDs) 16 and 17 to learn an appetitive operant conditioning task, employing milk chocolate as appetitive reinforcer. On PD18 the operant response was extinguished in context A, or in an alternative context B. The change from context A to B between acquisition and extinction did not affect the number of responses during extinction, but slightly modified the shape of the extinction curve. On PD19, a renewal test conducted in context A clearly showed ABA-renewal of the extinguished operant response. These results add to the body of evidence indicating that infants are able to acquire and retain contextual information, and support the notion that extinction during this ontogenetic period involves new learning.

Proprioceptive Feedback Facilitates Motor Imagery-Related Operant Learning of Sensorimotor β-Band Modulation

Motor imagery (MI) activates the sensorimotor system independent of actual movements and might be facilitated by neurofeedback. Knowledge on the interaction between feedback modality and the involved frequency bands during MI-related brain self-regulation is still scarce. Previous studies compared the cortical activity during the MI task with concurrent feedback (MI with feedback condition) to cortical activity during the relaxation task where no feedback was provided (relaxation without feedback condition). The observed differences might, therefore, be related to either the task or the feedback. A proper comparison would necessitate studying a relaxation condition with feedback and a MI task condition without feedback as well. Right-handed healthy subjects performed two tasks, i.e., MI and relaxation, in alternating order. Each of the tasks (MI vs. relaxation) was studied with and without feedback. The respective event-driven oscillatory activity, i.e., sensorimotor desynchronization (during MI) or synchronization (during relaxation), was rewarded with contingent feedback. Importantly, feedback onset was delayed to study the task-related cortical activity in the absence of feedback provision during the delay period. The reward modality was alternated every 15 trials between proprioceptive and visual feedback. Proprioceptive input was superior to visual input to increase the range of task-related spectral perturbations in the α- and β-band, and was necessary to consistently achieve MI-related sensorimotor desynchronization (ERD) significantly below baseline. These effects occurred in task periods without feedback as well. The increased accuracy and duration of learned brain self-regulation achieved in the proprioceptive condition was specific to the β-band. MI-related operant learning of brain self-regulation is facilitated by proprioceptive feedback and mediated in the sensorimotor β-band.

Reconsideration of Serial Visual Reversal Learning in Octopus (Octopus vulgaris) from a Methodological Perspective

Octopuses (Octopus vulgaris) are generally considered to possess extraordinary cognitive abilities including the ability to successfully perform in a serial reversal learning task. During reversal learning, an animal is presented with a discrimination problem and after reaching a learning criterion, the signs of the stimuli are reversed: the former positive becomes the negative stimulus and vice versa. If an animal improves its performance over reversals, it is ascribed advanced cognitive abilities. Reversal learning has been tested in octopus in a number of studies. However, the experimental procedures adopted in these studies involved pre-training on the new positive stimulus after a reversal, strong negative reinforcement or might have enabled secondary cueing by the experimenter. These procedures could have all affected the outcome of reversal learning. Thus, in this study, serial visual reversal learning was revisited in octopus. We trained four common octopuses (O. vulgaris) to discriminate between 2-dimensional stimuli presented on a monitor in a simultaneous visual discrimination task and reversed the signs of the stimuli each time the animals reached the learning criterion of ≥80% in two consecutive sessions. The animals were trained using operant conditioning techniques including a secondary reinforcer, a rod that was pushed up and down the feeding tube, which signaled the correctness of a response and preceded the subsequent primary reinforcement of food. The experimental protocol did not involve negative reinforcement. One animal completed four reversals and showed progressive improvement, i.e., it decreased its errors to criterion the more reversals it experienced. This animal developed a generalized response strategy. In contrast, another animal completed only one reversal, whereas two animals did not learn to reverse during the first reversal. In conclusion, some octopus individuals can learn to reverse in a visual task demonstrating behavioral flexibility even with a refined methodology.

The Role of Acetaldehyde in the Increased Acceptance of Ethanol after Prenatal Ethanol Exposure

Recent studies show that acetaldehyde, the first metabolite in the oxidation of ethanol, can be responsible for both, the appetitive and the aversive effects produced by ethanol intoxication. More specifically, it has been hypothesized that acetaldehyde produced in the periphery by the liver is responsible for the aversive effects of ethanol, while the appetitive effects relate to the acetaldehyde produced centrally through the catalase system. On the other hand, from studies in our and other laboratories, it is known that ethanol exposure during the last gestational days (GD) consistently enhances the postnatal acceptance of ethanol when measured during early ontogeny in the rat. This increased liking of ethanol is a conditioned appetitive response acquired by the fetus by the association of ethanol’s flavor and an appetitive reinforcer. Although this reinforcer has not yet been fully identified, one possibility points to acetaldehyde produced centrally in the fetus as a likely candidate. This hypothesis is supported by data showing that very early in the rat’s ontogeny brain catalases are functional, while the liver’s enzymatic system is still immature. In this study, rat dams were administered on GD 17–20 with water or ethanol, together with an acetaldehyde-sequestering agent (D-penicillamine). The offspring’s responses to ethanol was then assessed at different postnatal stages with procedures adequate for each developmental stage: on day 1, using the “odor crawling locomotion test” to measure ethanol’s odor attractiveness; on day 5, in an operant conditioning procedure with ethanol as the reinforcer; and on day 14 in an ethanol intake test. Results show that the absence of acetaldehyde during prenatal ethanol exposure impeded the observation of the increased acceptance of ethanol at any age. This seems to confirm the crucial role of acetaldehyde as a reinforcer in the appetitive learning occurring during prenatal ethanol exposure.

Inactivation of the Prelimbic Cortex Attenuates Context-Dependent Operant Responding

Operant responding in rats provides an analog to voluntary behavior in humans and is used to study maladaptive behaviors, such as overeating, drug taking, or relapse. In renewal paradigms, extinguished behavior recovers when tested outside the context where extinction was learned. Inactivation of the prelimbic (PL) region of the medial prefrontal cortex by baclofen/muscimol (B/M) during testing attenuates renewal when tested in the original acquisition context after extinction in another context (ABA renewal). Two experiments tested the hypothesis that the PL is important in context-dependent responding learned during conditioning. In the first, rats learned to lever-press for a sucrose-pellet reward. Following acquisition, animals were infused with either B/M or vehicle in the PL and tested in the acquisition context (A) and in a different context (B). All rats showed a decrement in responding when switched from Context A to Context B, but PL inactivation decreased responding only in Context A. Experiment 2a examined the effects of PL inactivation on ABC renewal in the same rats. Here, following reacquisition of the response, responding was extinguished in a new context (C). Following infusions of B/M or vehicle in the PL, responding was tested in Context C and another new context (D). The rats exhibited ACD renewal regardless of PL inactivation. Experiment 2b demonstrated that PL inactivation attenuated the ABA renewal effect in the same animals, replicating earlier results and demonstrating that cannulae were still functional. The results suggest that, rather than attenuating renewal generally, PL inactivation specifically affects ABA renewal by reducing responding in the conditioning context.SIGNIFICANCE STATEMENT Extinguished operant behavior can recover ("renew") when tested outside the extinction context. This suggests that behaviors, such as overeating or drug taking, might be especially prone to relapse following treatment. In rats, inactivation of the prelimbic cortex (PL) attenuates renewal. However, we report that PL inactivation after training attenuates responding in the context in which responding was acquired, but not in another one. A similar inactivation has no impact on renewal when testing occurs in a new, rather than the original, context following extinction. The PL thus has a more specific role in controlling contextually dependent operant behavior than has been previously reported.

Operant conditioning of neural activity in freely behaving monkeys with intracranial reinforcement

Operant conditioning of neural activity has typically been performed under controlled behavioral conditions using food reinforcement. This has limited the duration and behavioral context for neural conditioning. To reward cell activity in unconstrained primates, we sought sites in nucleus accumbens (NAc) whose stimulation reinforced operant responding. In three monkeys, NAc stimulation sustained performance of a manual target-tracking task, with response rates that increased monotonically with increasing NAc stimulation. We recorded activity of single motor cortex neurons and documented their modulation with wrist force. We conditioned increased firing rates with the monkey seated in the training booth and during free behavior in the cage using an autonomous head-fixed recording and stimulating system. Spikes occurring above baseline rates triggered single or multiple electrical pulses to the reinforcement site. Such rate-contingent, unit-triggered stimulation was made available for periods of 1-3 min separated by 3-10 min time-out periods. Feedback was presented as event-triggered clicks both in-cage and in-booth, and visual cues were provided in many in-booth sessions. In-booth conditioning produced increases in single neuron firing probability with intracranial reinforcement in 48 of 58 cells. Reinforced cell activity could rise more than five times that of non-reinforced activity. In-cage conditioning produced significant increases in 21 of 33 sessions. In-cage rate changes peaked later and lasted longer than in-booth changes, but were often comparatively smaller, between 13 and 18% above non-reinforced activity. Thus intracranial stimulation reinforced volitional increases in cortical firing rates during both free behavior and a controlled environment, although changes in the latter were more robust.NEW & NOTEWORTHY Closed-loop brain-computer interfaces (BCI) were used to operantly condition increases in muscle and neural activity in monkeys by delivering activity-dependent stimuli to an intracranial reinforcement site (nucleus accumbens). We conditioned increased firing rates with the monkeys seated in a training booth and also, for the first time, during free behavior in a cage using an autonomous head-fixed BCI.

Distinct memory engrams in the infralimbic cortex of rats control opposing environmental actions on a learned behavior

Conflicting evidence exists regarding the role of infralimbic cortex (IL) in the environmental control of appetitive behavior. Inhibition of IL, irrespective of its intrinsic neural activity, attenuates not only the ability of environmental cues predictive of reward availability to promote reward seeking, but also the ability of environmental cues predictive of reward omission to suppress this behavior. Here we report that such bidirectional behavioral modulation in rats is mediated by functionally distinct units of neurons (neural ensembles) that are concurrently localized within the same IL brain area but selectively reactive to different environmental cues. Ensemble-specific neural activity is thought to function as a memory engram representing a learned association between environment and behavior. Our findings establish the causal evidence for the concurrent existence of two distinct engrams within a single brain site, each mediating opposing environmental actions on a learned behavior.

DOI:http://dx.doi.org/10.7554/eLife.21920.001

Graded group exercise and fear avoidance behavior modification in the treatment of chronic low back pain

BACKGROUND

Approaches in the treatment of general chronic low back pain (CLBP) are multifaceted relative to specific interventions. In the past, passive interventions have commonly been employed with little evidence to support their effectiveness. Recent reviews suggest a focus on active exercises programs that includes pain education and cognitive behavioral therapy.

OBJECTIVE

To investigate the outcomes of CLBP patients and describe the approach in persons undergoing a group spinal rehabilitation program using graded exercise, and operant conditioning.

METHODS

Adult patients with CLBP participated in a twice weekly 90 minute exercise sessions for 8-weeks (n= 201). The program consisted of behavioral education, stretching, aerobic exercises, graded progressive resistance exercise, MedX isotonic strengthening, and functional bending lifting task exercises.

RESULTS

A total of 201 patient records were evaluated where the overall ODI improvement was 13.2% (± 14.0) (p< 0.001). There were significant and clinically meaningful improvements in flexibility, VAS, functional lifting tasks (p< 0.001), and lumbar extension strength (p= 0.01) at 8-week follow-up. Questionnaires were delivered via mail with a 21% return rate revealed sustained improvements.

CONCLUSION

CLBP patients undergoing an 8-week intensive exercise approach incorporating both behavioral and physical conditioning principles showed both significant and clinically significant improvements in this observational case series. Long-term benefits were also seen in both the 6 and 12 month follow-up questionnaires although further investigation is warranted due to limited survey return rate and study design.

An evolutionary behaviorist perspective on orgasm

Evolutionary explanations for sexual behavior and orgasm most often posit facilitating reproduction as the primary function (i.e. greater rate of fertilization). Other reproductive benefits of sexual pleasure and orgasm such as improved bonding of parents have also been discussed but not thoroughly. Although sex is known to be highly reinforcing, behaviorist principles are rarely invoked alongside evolutionary psychology in order to account for human sexual and social behavior. In this paper, I will argue that intense sexual pleasure, especially orgasm, can be understood as a primary reinforcer shaped by evolution to reinforce behavior that facilitates reproductive success (i.e. conception through copulation). Next, I will describe an evolutionary account of social shaping. In particular, I will focus on how humans evolved to use orgasm and sexual arousal to shape the social behavior and emotional states of others through both classical and operant conditioning and through both reproductive and non-reproductive forms of sexual behavior. Finally, I will describe how orgasm is a signal of sensitivity to reinforcement that is itself reinforcing.

Carolyn Rovee-Collier's legacy to applied psychology, intervention, and public policy

In this article, we reflect upon Carolyn Rovee-Collier's pioneering research on learning and memory in infants, especially that using the mobile conjugate reinforcement task, for our understanding of (a) cognitive development in infants born prematurely and those with Down's syndrome and (b) her prediction that infants' performance in the mobile conjugate reinforcement and similar operant tasks would predict later intellectual functioning. We then examine the implications of her research on time windows (the integration of new information into a memory) and memory reactivation (the retrieval of a forgotten memory as a result of the re-exposure to a component of the original learning experience) for early intervention programs and clinicians treating victims of early trauma. We conclude with a discussion of the value of Rovee-Collier's work for the growing field of infant/toddler science and how this science has informed public policy and program development.

The inferior olive is essential for long-term maintenance of a simple motor skill

The inferior olive (IO) is essential for operant down-conditioning of the rat soleus H-reflex, a simple motor skill. To evaluate the role of the IO in long-term maintenance of this skill, the H-reflex was down-conditioned over 50 days, the IO was chemically ablated, and down-conditioning continued for up to 102 more days. H-reflex size just before IO ablation averaged 62(±2 SE)% of its initial value (P < 0.001 vs. initial). After IO ablation, H-reflex size rose to 75-80% over ∼10 days, remained there for ∼30 days, rose over 10 days to above its initial value, and averaged 140(±14)% for the final 10 days of study (P < 0.01 vs. initial). This two-stage loss of down-conditioning maintenance correlated with IO neuronal loss (r = 0.75, P < 0.01) and was similar to the loss of down-conditioning that follows ablation of the cerebellar output nuclei dentate and interpositus. In control (i.e., unconditioned) rats, IO ablation has no long-term effect on H-reflex size. These results indicate that the IO is essential for long-term maintenance of a down-conditioned H-reflex. With previous data, they support the hypothesis that IO and cortical inputs to cerebellum combine to produce cerebellar plasticity that produces sensorimotor cortex plasticity that produces spinal cord plasticity that produces the smaller H-reflex. H-reflex down-conditioning appears to depend on a hierarchy of plasticity that may be guided by the IO and begin in the cerebellum. Similar hierarchies may underlie other motor learning.

Twelve-Day Reinforcement-Based Memory Retention in African Cichlids (Labidochromis caeruleus)

The formation of long-term memories for food sources is essential for the survival of most animals. Long-term memory formation in mammalian species has been demonstrated through a variety of conditioning tasks, however, the nature of long-term memory in fish is less known. In the current study, we explored whether African cichlids (Labidochromis caeruleus) could form memories for food-reinforced stimuli that last for 12 days. During the training sessions, fish were reinforced for approaching an upward drifting line grating. After a rest period of 12 days, fish demonstrated a significant preference for the upward drifting grating. To determine whether this preference could also be reversed, fish were then reinforced for approaching a downward drifting line grating after a 20-day rest period. When tested 12 days later, there were no significant differences in preference for either stimulus; however, following a second training period for the downward stimulus, there was a significant preference for the downward drifting grating. This suggests that cichlids are able to form reversible discrimination-based memories for food-reinforced stimuli that remain consolidated for at least 12 days.

Learning to inhibit the response during instrumental (operant) extinction

Five experiments tested implications of the idea that instrumental (operant) extinction involves learning to inhibit the learned response. All experiments used a discriminated operant procedure in which rats were reinforced for lever pressing or chain pulling in the presence of a discriminative stimulus (S), but not in its absence. In Experiment 1, extinction of the response (R) in the presence of S weakened responding in S, but equivalent nonreinforced exposure to S (without the opportunity to make R) did not. Experiment 2 replicated that result and found that extinction of R had no effect on a different R that had also been reinforced in the stimulus. In Experiments 3 and 4, rats first learned to perform several different stimulus and response combinations (S1R1, S2R1, S3R2, and S4R2). Extinction of a response in one stimulus (i.e., S1R1) transferred and weakened the same response, but not a different response, when it was tested in another stimulus (i.e., S2R1 but not S3R2). In Experiment 5, extinction still transferred between S1 and S2 when the stimuli set the occasion for R's association with different types of food pellets. The results confirm the importance of response inhibition in instrumental extinction: Nonreinforcement of the response in S causes the most effective suppression of responding, and response suppression is specific to the response but transfers and influences performance of the same response when it is occasioned by other stimuli. Theoretical and practical implications are discussed. (PsycINFO Database Record

Bone-marrow-derived mesenchymal stem cells attenuate cognitive deficits in an endothelin-1 rat model of stroke

PURPOSE

Stroke is the third leading cause of death and permanent disability in the United States, often producing long-term cognitive impairments, which are not easily recapitulated in animal models. The goals of this study were to assess whether: (1) the endothelin-1 (ET-1) model of chronic stroke produced discernable cognitive deficits; (2) a spatial operant reversal task (SORT) would accurately measure memory deficits in this model; and (3) bone-marrow-derived mesenchymal stem cells (BMMSCs) could reduce any observed deficits.

METHODS

Rats were given unilateral intracerebral injections of vehicle or ET-1, a stroke-inducing agent, near the middle cerebral artery. Seven days later, they were given intrastriatal injections of BMMSCs or vehicle, near the ischemic penumbra. The cognitive abilities of the rats were assessed on a novel SORT, which was designed to efficiently distinguish cognitive deficits from potential motoric confounds.

RESULTS

Rats given ET-1 had significantly more cognitive errors at six weeks post-stroke on the SORT, and that these deficits were attenuated by BMMSC transplants.

CONCLUSIONS

These findings indicate that: (1) the ET-1 model produces chronic cognitive deficits; (2) the SORT efficiently measures cognitive deficits that are not confounded by motoric impairment; and (3) BMMSCs may be a viable treatment for stroke-induced cognitive dysfunction.

NMDA Receptors on Dopaminoceptive Neurons Are Essential for Drug-Induced Conditioned Place Preference

Plasticity of the brain's dopamine system plays a crucial role in adaptive behavior by regulating appetitive motivation and the control of reinforcement learning. In this study, we investigated drug- and natural-reward conditioned behaviors in a mouse model in which the NMDA receptor-dependent plasticity of dopaminoceptive neurons was disrupted. We generated a transgenic mouse line with inducible selective inactivation of the NR1 subunit in neurons expressing dopamine D1 receptors (the NR1(D1CreERT2) mice). Whole-cell recordings of spontaneous EPSCs on neurons in the nucleus accumbens confirmed that a population of neurons lacked the NMDA receptor-dependent component of the current. This effect was accompanied by impaired long-term potentiation in the nucleus accumbens and in the CA1 area of the ventral, but not the dorsal, hippocampus. Mutant mice did not differ from control animals when tested for pavlovian or instrumental conditioning. However, NR1(D1CreERT2) mice acquired no preference for a context associated with administration of drugs of abuse. In the conditioned place preference paradigm, mutant mice did not spend more time in the context paired with cocaine, morphine, or ethanol, although these mice acquired a preference for sucrose jelly and an aversion to naloxone injections, as normal. Thus, we observed that the selective inducible ablation of the NMDA receptors specifically blocks drug-associated context memory with no effect on positive reinforcement in general.

Learning in Plants: Lessons from Mimosa pudica

This article provides an overview of the early Mimosa pudica literature; much of which is in journals not easily accessible to the reader. In contrast to the contemporary plant learning literature which is conducted primarily by plant biologists, this early literature was conducted by comparative psychologists whose goal was to search for the generality of learning phenomena such as habituation, and classical conditioning using experimental designs based on animal conditioning studies. In addition to reviewing the early literature, we hope to encourage collaborations between plant biologists and comparative psychologists by familiarizing the reader with issues in the study of learning faced by those working with animals. These issues include no consistent definition of learning phenomena and an overreliance on the use of cognition. We suggested that greater collaborative efforts be made between plant biologists and comparative psychologists if the study of plant learning is to be fully intergraded into the mainstream behavior theory.

Experience that Much Work Produces Many Reinforcers Makes the Sunk Cost Fallacy in Pigeons: A Preliminary Test

The sunk cost fallacy is one of the irrational choice behaviors robustly observed in humans. This fallacy can be defined as a preference for a higher-cost alternative to a lower-cost one after previous investment in a higher-cost alternative. The present study examined this irrational choice by exposing pigeons to several types of trials with differently illuminated colors. We prepared three types of non-choice trials for experiencing different outcomes after presenting same or different colors as alternatives and three types of choice trials for testing whether pigeons demonstrated irrational choice. In non-choice trials, animals experienced either of the following: (1) no reinforcement after the presentation of an unrelated colored stimulus to the alternatives used in the choice situation, (2) no reinforcement after investment in the lower-cost alternative, or (3) reinforcement or no reinforcement after investment in the higher-cost alternative. In choice trials, animals were required to choose in the following three situations: (A) higher-cost vs. lower-cost alternatives, (B) higher-cost vs. lower-cost ones after some investment in the higher-cost alternative, and (C) higher-cost vs. lower-cost alternatives after the presentation of an unrelated colored stimulus. From the definition of the sunk cost fallacy, we assumed that animals would exhibit this fallacy if they preferred the higher-cost alternative in situation (B) compared with (A) or (C). We made several conditions, each of which comprised various combinations of three types of non-choice trials and tested their preference in three choice trials. Pigeons committed the sunk cost fallacy only in the condition that contained non-choice trials (3), i.e., pigeons experienced reinforcement after investing in the higher-cost alternative. This result suggests that sunk cost fallacy might be caused by the experiences of reinforcement after investing in the higher-cost alternative.

Neural plasticity and behavior - sixty years of conceptual advances

This brief review summarizes 60 years of conceptual advances that have demonstrated a role for active changes in neuronal connectivity as a controller of behavior and behavioral change. Seminal studies in the first phase of the six-decade span of this review firmly established the cellular basis of behavior - a concept that we take for granted now, but which was an open question at the time. Hebbian plasticity, including long-term potentiation and long-term depression, was then discovered as being important for local circuit refinement in the context of memory formation and behavioral change and stabilization in the mammalian central nervous system. Direct demonstration of plasticity of neuronal circuit function in vivo, for example, hippocampal neurons forming place cell firing patterns, extended this concept. However, additional neurophysiologic and computational studies demonstrated that circuit development and stabilization additionally relies on non-Hebbian, homoeostatic, forms of plasticity, such as synaptic scaling and control of membrane intrinsic properties. Activity-dependent neurodevelopment was found to be associated with cell-wide adjustments in post-synaptic receptor density, and found to occur in conjunction with synaptic pruning. Pioneering cellular neurophysiologic studies demonstrated the critical roles of transmembrane signal transduction, NMDA receptor regulation, regulation of neural membrane biophysical properties, and back-propagating action potential in critical time-dependent coincidence detection in behavior-modifying circuits. Concerning the molecular mechanisms underlying these processes, regulation of gene transcription was found to serve as a bridge between experience and behavioral change, closing the 'nature versus nurture' divide. Both active DNA (de)methylation and regulation of chromatin structure have been validated as crucial regulators of gene transcription during learning. The discovery of protein synthesis dependence on the acquisition of behavioral change was an influential discovery in the neurochemistry of behavioral modification. Higher order cognitive functions such as decision making and spatial and language learning were also discovered to hinge on neural plasticity mechanisms. The role of disruption of these processes in intellectual disabilities, memory disorders, and drug addiction has recently been clarified based on modern genetic techniques, including in the human. The area of neural plasticity and behavior has seen tremendous advances over the last six decades, with many of those advances being specifically in the neurochemistry domain. This review provides an overview of the progress in the area of neuroplasticity and behavior over the life-span of the Journal of Neurochemistry. To organize the broad literature base, the review collates progress into fifteen broad categories identified as 'conceptual advances', as viewed by the author. The fifteen areas are delineated in the figure above. This article is part of the 60th Anniversary special issue.

Ablation of the inferior olive prevents H-reflex down-conditioning in rats

We evaluated the role of the inferior olive (IO) in acquisition of the spinal cord plasticity that underlies H-reflex down-conditioning, a simple motor skill. The IO was chemically ablated before a 50-day exposure to an operant conditioning protocol that rewarded a smaller soleus H-reflex. In normal rats, down-conditioning succeeds (i.e., H-reflex size decreases at least 20%) in 80% of animals. Down-conditioning failed in every IO-ablated rat (P< 0.001 vs. normal rats). IO ablation itself had no long-term effect on H-reflex size. These results indicate that the IO is essential for acquisition of a down-conditioned H-reflex. With previous data, they support the hypothesis that IO and cortical inputs to cerebellum enable the cerebellum to guide sensorimotor cortex plasticity that produces and maintains the spinal cord plasticity that underlies the down-conditioned H-reflex. They help to further define H-reflex conditioning as a model for understanding motor learning and as a new approach to enhancing functional recovery after trauma or disease.

An Automated Motion Detection and Reward System for Animal Training

A variety of approaches has been used to minimize head movement during functional brain imaging studies in awake laboratory animals. Many laboratories expend substantial effort and time training animals to remain essentially motionless during such studies. We could not locate an “off-the-shelf” automated training system that suited our needs. 

We developed a time- and labor-saving automated system to train animals to hold still for extended periods of time. The system uses a personal computer and modest external hardware to provide stimulus cues, monitor movement using commercial video surveillance components, and dispense rewards. A custom computer program automatically increases the motionless duration required for rewards based on performance during the training session but allows changes during sessions. This system was used to train cynomolgus monkeys (Macaca fascicularis) for awake neuroimaging studies using positron emission tomography (PET) and functional magnetic resonance imaging (fMRI).

The automated system saved the trainer substantial time, presented stimuli and rewards in a highly consistent manner, and automatically documented training sessions. We have limited data to prove the training system's success, drawn from the automated records during training sessions, but we believe others may find it useful. The system can be adapted to a range of behavioral training/recording activities for research or commercial applications, and the software is freely available for non-commercial use.

Evaluation of a Postoperative Pain-Like State on Motivated Behavior in Rats: Effects of Plantar Incision on Progressive-Ratio Food-Maintained Responding

There has been recent interest in characterizing the effects of pain-like states on motivated behaviors in order to quantify how pain modulates goal-directed behavior and the persistence of that behavior. The current set of experiments assessed the effects of an incisional postoperative pain manipulation on food-maintained responding under a progressive-ratio (PR) operant schedule. Independent variables included injury state (plantar incision or anesthesia control) and reinforcer type (grain pellet or sugar pellet); dependent variables were tactile sensory thresholds and response breakpoint. Once responding stabilized on the PR schedule, separate groups of rats received a single ventral hind paw incision or anesthesia (control condition). Incision significantly reduced breakpoints in rats responding for grain, but not sugar. In rats responding for sugar, tactile hypersensitivity recovered within 24 hr, indicating a faster recovery of incision-induced tactile hypersensitivity compared to rats responding for grain, which demonstrated recovery at PD2. The NSAID analgesic, diclofenac (5.6 mg/kg) completely restored incision-depressed PR operant responding and tactile sensitivity at 3 hr following incision. The PR schedule differentiated between sucrose and grain, suggesting that relative reinforcing efficacy may be an important determinant in detecting pain-induced changes in motivated behavior.

Laterality enhances numerical skills in the guppy, Poecilia reticulata

It has been hypothesized that cerebral lateralization can significantly enhance cognition and that this was one of the primary selective forces shaping its wide-spread evolution amongst vertebrate taxa. Here, we tested this hypothesis by examining the link between cerebral lateralization and numerical discrimination. Guppies, Poecilia reticulata, were sorted into left, right and non-lateralized groups using a standard mirror test and their numerical discrimination abilities tested in both natural shoal choice and abstract contexts. Our results show that strongly lateralized guppies have enhanced numerical abilities compared to non-lateralized guppies irrespective of context. These data provide further credence to the notion that cerebral lateralization can enhance cognitive efficiency.