Drug-seeking behavior in an invertebrate system: evidence of morphine-induced reward, extinction and reinstatement in crayfish

Recovery-from-extinction effects in an anuran amphibian: renewal effect, but no reinstatement

Recovery-from-extinction effects in which a conditioned response returns after extinction have been shown in mammals, birds and fish. Thus, these effects appear to be conserved among vertebrates; however, they have yet to be investigated in amphibians. Using prey catching conditioning in the fire-bellied toad (Bombina orientalis), we tested if renewal and reinstatement occurred after extinction when subjects were respectively re-exposed to the context or reinforcer used during conditioning. For renewal, a different context was used during extinction and thus renewal tests assessed if external contextual cues associated during conditioning stimulated prey catching performance. For reinstatement, the reinforcer withheld during extinction was simply delivered again prior to a test assessing if internal cues associated with recent prey consumption stimulated prey catching performance. Conditioning followed a fixed ratio 5 schedule of reinforcement, where five attempts to capture a cricket stimulus displayed on a computer screen were reinforced by delivery of a single live cricket. Performance was measured as the time to reach five prey catching attempts. A significant improvement in prey catching performance during conditioning followed by deterioration with extinction was seen in the experiments. Upon return to the context used for conditioning after extinction, toads showed a renewal effect whereby they displayed faster performance during testing compared to the end of extinction. Conversely, toads showed no reinstatement effect because pre-feeding of a cricket did not influence performance during the test that followed extinction. Reinstatement could have been lost in amphibian phylogeny due to secondary simplification of the nervous system.

Simple Aesthetic Sense and Addiction Emerge in Neural Relations of Cost-Benefit Decision in Foraging

A rudimentary aesthetic sense is found in the stimulus valuations and cost-benefit decisions made by primitive generalist foragers. These are based on factors governing personal economic decisions: incentive, appetite, and learning. We find that the addictive process is an extreme expression of aesthetic dynamics. An interactive, agent-based model, ASIMOV, reproduces a simple aesthetic sense from known neural relations of cost-benefit decision in foraging. In the presence of very high reward, an addiction-like process emerges. A drug-like prey provides extreme reward with no nutritive value, initiating high selectivity and prolonged cravings for drug through reward learning. Varying reward experience, caused by homeostatic changes in the neural circuitry of reward, further establishes the course of addiction, consisting of desensitization, withdrawal, resensitization, and associated changes in nutritional choice and pain sensitivity. These observations are consistent with the early evolution of addiction mechanisms in simple generalist foragers as an aesthetic sense for evaluating prey. ASIMOV is accessible to inspection, modification, and experiment, is adaptable as an educational tool, and provides insight on the possible coevolutionary origins of aesthetics and the addiction process.

Renewal of conditioned tentacle lowering by circadian contextual cues in snails Cornu aspersum

Previous experiments using tentacle lowering conditioning in terrestrial snails Cornu aspersum have shown extinction and recovery of the conditioned response (CR) as a consequence of both inserting a delay between the extinction and test (spontaneous recovery) and of re-exposing the animal to the unconditioned stimulus after extinction (reinstatement). Two experiments that examined recovery of the CR due to a change in context (renewal effect) were carried out to continue this line of research. In Experiment 1, subjects received conditioning with an odour (CS) followed by extinction in the presence of another odour (CS + C), before being exposed to the original one (CS). In Experiment 2, conditioning and extinction of an odour CS took place in the presence of different circadian contextual cues (hour of the day and presence of light). The results showed that a return to the original context of conditioned training, after the extinction in a different context, either defined by an odour (Experiment 1) or by circadian cues (Experiment 2), produce a recovery of the CR compared to suitable control groups. These results can be interpreted as an instance of ABA renewal effect and they provide information about psychological mechanisms involved in extinction processes.

Synthetic cathinones and their phenethylamine analogues produce distinct psychomotor and reward behavior in crayfish

Synthetic cathinones share potent sympathomimetic properties with amphetamines due to their shared phenethylamine backbone. Despite recent work focused on understanding the behavioral effects of synthetic cathinones, a systematic comparison of neuropharmacology, behavior, and physiological effects with other stimulants, has remained elusive. In the present study, we explore the behavioral effects of cathinones in crayfish, a model system which combines a well characterized behavioral paradigm for addiction-like behaviors, a modularly organized nervous system, the lack of a formal blood-brain barrier, and experimental tractability. The objective of this study was to characterize the psychomotor and rewarding effects of methylated cathinones (methylone, mephedrone), and their non β-ketone substituted amphetamine analogs (4-methylmethamphetamine, 4-MMA and 3,4-methylenedioxymethamphetamine MDMA) in crayfish. Our results suggest that these drugs produce psychostimulation, which sensitizes upon repeated drug administration. Furthermore, crayfish demonstrated a conditioned substrate preference for mephedrone and 4-MMA drug-pairings at a 10 μg/g dose, a preference which persisted even through a series of extinction trials. Our study indicates that synthetic cathinones and substituted amphetamine analogues produce distinct behavioral effects in an invertebrate system which consists of a relatively simple neuronal organization. The present findings provide an evolutionary context to our understanding about how drugs of abuse initiate reward at levels far beyond those specific to humans.

How evolutionary psychiatry can advance psychopharmacology

The prevailing paradigm for psychopharmacology focuses on understanding brain mechanisms as the key to finding new medications and improving clinical outcomes, but frustration with slow progress has inspired many pleas for new approaches. Evolutionary psychiatry brings in an additional basic science that poses new questions about why natural selection left us vulnerable to so many mental disorders, and new insights about how drugs work. The integration of neuroscience with evolutionary psychiatry is synergistic, going beyond reductionism to provide a model like the one used by the rest of medicine. It recognizes negative emotions as symptoms, that are, like pain and cough, useful defenses whose presence should initiate a search for causes. An integrative evolutionary approach explains why agents that block useful aversive responses are usually safe, and how to anticipate when they may cause harm. More generally, an evolutionary framework suggests novel practical strategies for finding and testing new drugs.


The crayfish model (Orconectes rusticus), epigenetics and drug addiction research

Fundamental signs of epigenetic effects are variations in the expression of genes or phenotypic traits among isogenic mates. Therefore, genetically identical animals are in high demand for epigenetic research. There are many genetically identical animals, including natural parthenogens and inbred laboratory lineages or clones. However, most parthenogenetic animal taxa are very small in combined epigenetic and drug addiction research. Orconectes rusticus has a unique phylogenetic position, with 2-3 years of life span, which undergoes metamorphosis that creates developmental stages with distinctly different morphologies, unique lifestyles, and broad behavioral traits, even among isogenic mates reared in the same environment offer novel inroads for epigenetics studies. Moreover, the establishment of crayfish as a novel system for drug addiction with evidence of an automated, operant self-administration and conditioned-reward, withdrawal, reinstatement of the conditioned drug-induced reward sets the stage to investigate epigenetic mechanisms of drug addiction. We discuss behavioral, pharmacological and molecular findings from laboratory studies that document a broad spectrum of molecular and, behavioral evidence including potential hypotheses that can be tested with the crayfish model for epigenetic study in drug addiction research.

Characterization of locomotor response to psychostimulants in the parthenogenetic marbled crayfish (Procambarus fallax forma virginalis): A promising model for studying the neural and molecular mechanisms of drug addiction

Although scientific research using mammalian models has made great strides in uncovering the enigmatic neural and molecular mechanisms orchestrating the state of drug addiction, a complete understanding has thus far eluded researchers. The complexity of the task has led to the use of invertebrate model systems to complement the research of drug-induced reward in mammalian systems. Invertebrates, such as crayfish, offer excellent model systems to help reveal the underlying mechanisms of drug addiction as they retain the ancestral neural reward circuit that is evolutionarily conserved across taxa, and they possess relatively few, large neurons, laid out in an accessible, modularly organized nervous system. Crayfish offer the benefits of delineated developmental life stages, a large body size suitable for a variety of experimental methods, and stereotyped behaviors. Unique among crayfish is the parthenogenetic marbled crayfish (Procambarus fallax forma virginalis), a species of asexually reproducing, genetically identical clones. With the benefits of reduced individual variation, high fecundity, and easy lab husbandry, the marbled crayfish would make a particularly powerful addition to the animal model repertoire. Here we characterize the locomotor response of juvenile P. f. f. virginalis exposed to the psychostimulant, d-amphetamine sulfate. Custom video-tracking software was used to record the movement patterns of juveniles exposed to water infused with varying concentrations of d-amphetamine sulfate. ANOVA demonstrated that crayfish locomotion was significantly impacted by drug concentration. These psychostimulant effects provide the foundation of P. f. f. virginalis as a model for parsing the neural and molecular mechanisms of drug addiction.

Crayfish Learning: Addiction and the Ganglionic Brain

Recognizing addiction as a phenomenon with deep evolutionary roots grants valuable new perspectives into understanding its behavioral features, as well as its underlying neural mechanisms and genetic architecture. Although now generally misbranded as "human drugs of abuse," addictive plant alkaloids originally arose as potent chemical defenses against insect herbivory. The products of this evolutionary arms race, compounds such as nicotine, cathinone, or morphine, target essential biological mechanisms for motivation and learning and act as weaponized disruptors. Human vulnerabilities to these addictive drugs may thus represent little more than collateral damage arising from deep homology, i.e., shared biological implementation of behavioral functions with taxa that trace back to the early divergence of bilateral metazoans. Consistent with such a view, invertebrate preparations exhibit a rich spectrum of behavioral and neural consequences in response to drug exposure. Although there is certainly evidence for addiction-like phenomena in many invertebrate lineages, the present review focuses attention primarily on our recent work in crayfish. Using this decapod crustacean model, we have characterized a range of amphetamines, cathinones, and opioids for evidence of unconditioned intoxication, sympathomimetic properties, psychostimulant sensitization, conditioned cue learning, and operant self-administration. Overall, our findings on drug-sensitive reward in crayfish bear striking similarities to equivalent phenomena illustrated in mammals. Experimentally tractable invertebrate models may thus provide fundamental insights into the homo- and paralogous mechanisms mediating responses to addictive drugs, while illuminating the limits of such contrasts.

Crayfish Self-Administer Amphetamine in a Spatially Contingent Task

Natural reward is an essential element of any organism’s ability to adapt to environmental variation. Its underlying circuits and mechanisms guide the learning process as they help associate an event, or cue, with the perception of an outcome’s value. More generally, natural reward serves as the fundamental generator of all motivated behavior. Addictive plant alkaloids are able to activate this circuitry in taxa ranging from planaria to humans. With modularly organized nervous systems and confirmed vulnerabilities to human drugs of abuse, crayfish have recently emerged as a compelling model for the study of the addiction cycle, including psychostimulant effects, sensitization, withdrawal, reinstatement, and drug reward in conditioned place preference paradigms. Here we extend this work with the demonstration of a spatially contingent, operant drug self-administration paradigm for amphetamine. When the animal enters a quadrant of the arena with a particular textured substrate, a computer-based control system delivers amphetamine through an indwelling fine-bore cannula. Resulting reward strength, dose-response, and the time course of operant conditioning were assessed. Individuals experiencing the drug contingent on their behavior, displayed enhanced rates of operant responses compared to that of their yoked (non-contingent) counterparts. Application of amphetamine near the supra-esophageal ganglion elicited stronger and more robust increases in operant responding than did systemic infusions. This work demonstrates automated implementation of a spatially contingent self-administration paradigm in crayfish, which provides a powerful tool to explore comparative perspectives in drug-sensitive reward, the mechanisms of learning underlying the addictive cycle, and phylogenetically conserved vulnerabilities to psychostimulant compounds.

Operant avoidance learning in crayfish, Orconectes rusticus: Computational ethology and the development of an automated learning paradigm

Research in crustaceans offers a valuable perspective for studying the neural implementation of conserved behavioral phenomena, including motivation, escape, aggression, and drug-sensitive reward. The present work adds to this literature by demonstrating that crayfish successfully learn to respond to spatially contingent cues. An integrated video-tracking system automatically delivered a mild electric shock when a test animal entered or remained on a substrate paired with punishment. Following a few instances of shock delivery, crayfish quickly learned to avoid these areas. Comparable changes in substrate preference were not exhibited by yoked controls, but locomotion differed significantly from both pre-conditioning levels and from those of their masters receiving shock in a contingent fashion. The results of this work provide valuable insights into the principles governing avoidance learning in an invertebrate system and provide a behavioral template for exploring the neural changes during associative learning. Serving as a case study, this project introduces a new computer framework for the automated control of learning paradigms. Based on routines contained within the JavaGrinders library (free download at iEthology.com), it integrates real-time video tracking with robotic interfaces, and provides a suitable framework for implementing automated learning paradigms.

The Sensitivity of the Crayfish Reward System to Mammalian Drugs of Abuse

The idea that addiction occurs when the brain is not able to differentiate whether specific reward circuits were triggered by adaptive natural rewards or falsely activated by addictive drugs exist in several models of drug addiction. The suitability of crayfish (Orconectes rusticus) for drug addiction research arises from developmental variation of growth, life span, reproduction, behavior and some quantitative traits, especially among isogenic mates reared in the same environment. This broad spectrum of traits makes it easier to analyze the effect of mammalian drugs of abuse in shaping behavioral phenotype. Moreover, the broad behavioral repertoire allows the investigation of self-reinforcing circuitries involving appetitive and exploratory motor behavior, while the step-wise alteration of the phenotype by metamorphosis allows accurate longitudinal analysis of different behavioral states. This paper reviews a series of recent experimental findings that evidence the suitability of crayfish as an invertebrate model system for the study of drug addiction. Results from these studies reveal that unconditioned exposure to mammalian drugs of abuse produces a variety of stereotyped behaviors. Moreover, if presented in the context of novelty, drugs directly stimulate exploration and appetitive motor patterns along with molecular processes for drug conditioned reward. Findings from these studies indicate the existence of drug sensitive circuitry in crayfish that facilitates exploratory behavior and appetitive motor patterns via increased incentive salience of environmental stimuli or by increasing exploratory motor patterns. This work demonstrates the potential of crayfish as a model system for research into the neural mechanisms of addiction, by contributing an evolutionary, comparative context to our understanding of natural reward as an important life-sustaining process.

Morphine addiction in ants: a new model for self-administration and neurochemical analysis

Conventional definitions of drug addiction are focused on characterizing the neurophysiological and behavioral responses of mammals. Although mammalian models have been invaluable in studying specific and complex aspects of addiction, invertebrate systems have proven advantageous in investigating how drugs of abuse corrupt the most basic motivational and neurochemical systems. It has recently been shown that invertebrates and mammals have remarkable similarities in their behavioral and neurochemical responses to drugs of abuse. However, until now only mammals have demonstrated drug seeking and self-administration without the concurrent presence of a natural reward, e.g. sucrose. Using a sucrose-fading paradigm, followed by a two-dish choice test, we establish ants as an invertebrate model of opioid addiction. The ant species Camponotus floridanus actively seeks and self-administers morphine even in the absence of caloric value or additional natural reward. Using HPLC equipped with electrochemical detection, the neurochemicals serotonin, octopamine and dopamine were identified and subsequently quantified, establishing the concurrent neurochemical response to the opioid morphine within the invertebrate brain. With this study, we demonstrate dopamine to be governing opioid addiction in the brains of ants. Thus, this study establishes ants as the first non-mammalian model of self-administration that is truly analogous to mammals.

Tissue hypoxia during ischemic stroke: adaptive clues from hypoxia-tolerant animal models

The treatment and prevention of hypoxic/ischemic brain injury in stroke patients remain a severe and global medical issue. Numerous clinical studies have resulted in a failure to develop chemical neuroprotection for acute, ischemic stroke. Over 150 estimated clinical trials of ischemic stroke treatments have been done, and more than 200 drugs and combinations of drugs for ischemic and hemorrhagic strokes have been developed. Billions of dollars have been invested for new scientific breakthroughs with only limited success. The revascularization of occluded cerebral arteries such as anti-clot treatments of thrombolysis has proven effective, but it can only be used in a 3-4.5h time frame after the onset of a stroke, and not for every patient. This review is about novel insights on how to resist tissue hypoxia from unconventional animal models. Ability to resist tissue hypoxia is an extraordinary ability that is not common in many laboratory animals such as rat and mouse models. For example, we can learn from a naked mole-rat, Chrysemys picta, how to actively regulate brain metabolic activity to defend the brain against fluctuating oxygen tension and acute bouts of oxidative stress following the onset of a stroke. Additionally, a euthermic arctic ground squirrel can teach us how the brain of a stroke patient can remain well oxygenated during tissue hypoxia with no evidence of cellular stress. In this review, we discuss how these animals provide us with a system to gain insight into the possible mechanisms of tissue hypoxia/ischemia. This issue is of clinical significance to stroke patients. We describe specific physiological and molecular adaptations employed by different animals' models of hypoxia tolerance in aquatic and terrestrial environments. We highlight how these adaptations might provide potential clues on strategies to adapt for the clinical management of tissue hypoxia during conditions such as stroke where oxygen demand fails to match the supply.

Conditioned avoidance responses survive contingency degradation in the garden slug, Lehmannia valentiana

Joint presentations of a conditioned stimulus (CS) and an unconditioned stimulus (US) strengthen the contingency between them, whereas presentations of one stimulus without the other degrade this contingency. For example, the CS can be presented without the US either before conditioning (CS-no US and then CS-US; latent inhibition) or after conditioning (CS-US and then CS-no US; extinction). In vertebrate subjects and several invertebrate species, a time lapse usually results in a return of the conditioned response, or spontaneous recovery. However, in land mollusks, spontaneous recovery from extinction has only recently been reported, and response recovery after latent inhibition has not been reported. In two experiments, using conditioned aversion to a food odor as a measure of learning and memory retention, we observed contingency degradation via latent inhibition (Experiment 1) and extinction (Experiment 2) in the common garden slug, Lehmannia valentiana. In both situations, the contingency degradation procedure successfully attenuated conditioned responding, and delaying testing by several days resulted in recovery of the conditioned response. This suggests that the CS-US association survived the degradation manipulation and was retained over an interval of several days.

Invertebrate models in addiction research

While drug addiction is a uniquely human problem, most research examining the biological mechanisms of the transition from substance use to addiction is conducted with vertebrate animal models. Many other fields of neuroscience have greatly benefitted from contributions from simple and manipulable invertebrate model systems. However, the potential of invertebrate research has yet to be fully capitalised on in the field of addiction neuroscience. This may be because of the complexity of addiction and the clinical imperative of addiction research. We argue that the homocentric diagnostic criteria of addiction are no more a hindrance to the use of invertebrate models than they are to vertebrate models. We highlight the strengths of the diversity of different invertebrate model systems in terms of neuroanatomy and molecular machinery, and stress that working with a range of different models will aid in understanding addiction and not be a disadvantage. Finally, we discuss the specific advantages of utilising invertebrate animals for addiction research and highlight key areas in which invertebrates are suited for making unique and meaningful contributions to this field.

Reinstatement in honeybees is context-dependent

During extinction animals experience that the previously learned association between a conditioned stimulus (CS) and an unconditioned stimulus (US) no longer holds true. Accordingly, the conditioned response (CR) to the CS decreases. This decrease of the CR can be reversed by presentation of the US alone following extinction, a phenomenon termed reinstatement. Reinstatement and two additional phenomena, spontaneous recovery and renewal, indicate that the original CS-US association is not lost through extinction but can be reactivated through different processes. In honeybees (Apis mellifera), spontaneous recovery, i.e., the time-dependent return of the CR, has been demonstrated, suggesting that also in these insects the original CS-US association is not lost during extinction. To support this notion, we ask whether honeybees show reinstatement after extinction. In vertebrates reinstatement is context-dependent, so we examined whether the same holds true for honeybees. We demonstrate reinstatement in restrained honeybees and show that reinstatement is context-dependent. Furthermore, we show that an alteration of the color of light illuminating the experimental setup suffices to indicate a contextual change. We conclude that in honeybees the initially formed CS-US memory is not lost after extinction. Rather, honeybees might learn about the context during extinction. This enables them to adequately retrieve one of the two opposing memories about the CS that have been formed after extinction.

d-Amphetamine stimulates unconditioned exploration/approach behaviors in crayfish: towards a conserved evolutionary function of ancestral drug reward

In mammals, rewarding properties of drugs depend on their capacity to activate a dopamine-mediated appetitive motivational seeking state--a system that allows animals to pursue and find all kinds of objects and events needed for survival. With such states strongly conserved in evolution, invertebrates have recently been developed into a powerful model in addiction research, where a shared ancestral brain system for the acquisition of reward can mediate drug addiction in many species. A conditioned place preference paradigm has illustrated that crayfish seek out environments that had previously been paired with psychostimulant and opioid administration. The present work demonstrates that the administration of D-amphetamine stimulates active explorative behaviors in crayfish through the action of the drug within their head ganglion. Crayfish, with a modularly organized and experimentally accessible, ganglionic nervous system offers a unique model to investigate (1) the fundamental, biological mechanisms of addictive drug reward; (2) how an appetitive/seeking disposition is implemented in a simple neural system, and (3) how it mediates the rewarding actions of major drugs of abuse.

Drug-sensitive reward in crayfish: an invertebrate model system for the study of SEEKING, reward, addiction, and withdrawal

In mammals, rewarding properties of drugs depend on their capacity to activate appetitive motivational states. With the underlying mechanisms strongly conserved in evolution, invertebrates have recently emerged as a powerful new model in addiction research. In crayfish natural reward has proven surprisingly sensitive to human drugs of abuse, opening an unlikely avenue of research into the basic biological mechanisms of drug addiction. In a series of studies we first examined the presence of natural reward systems in crayfish, then characterized its sensitivity to a wide range of human drugs of abuse. A conditioned place preference (CPP) paradigm was used to demonstrate that crayfish seek out those environments that had previously been paired with the psychostimulants cocaine and amphetamine, and the opioid morphine. The administration of amphetamine exerted its effects at a number of sites, including the stimulation of circuits for active exploratory behaviors (i.e., SEEKING). A further study examined morphine-induced reward, extinction and reinstatement in crayfish. Repeated intra-circulatory infusions of morphine served as a reward when paired with distinct visual or tactile cues. Morphine-induced CPP was extinguished after repeated saline injections. Following this extinction phase, morphine-experienced crayfish were once again challenged with the drug. The priming injections of morphine reinstated CPP at all tested doses, suggesting that morphine-induced CPP is unrelenting. In an exploration of drug-associated behavioral sensitization in crayfish we concurrently mapped measures of locomotion and rewarding properties of morphine. Single and repeated intra-circulatory infusions of morphine resulted in persistent locomotory sensitization, even 5 days following the infusion. Moreover, a single dose of morphine was sufficient to induce long-term behavioral sensitization. CPP for morphine and context-dependent cues could not be disrupted over a drug free period of 5 days. This work demonstrates that crayfish offer a comparative and complementary approach in addiction research. Serving as an invertebrate animal model for the exposure to mammalian drugs of abuse, modularly organized and experimentally accessible nervous systems render crayfish uniquely suited for studying (1) the basic biological mechanisms of drug effects, (2) to explore how the appetitive/seeking disposition is implemented in a simple neural system, and (3) how such a disposition is related to the rewarding action of drugs of abuse. This work aimed to contribute an evolutionary, comparative context to our understanding of a key component in learning, and of natural reward as an important life-sustaining process.

Endogenous opiates and behavior: 2009

This paper is the 32nd consecutive installment of the annual review of research concerning the endogenous opioid system. It summarizes papers published during 2009 that studied the behavioral effects of molecular, pharmacological and genetic manipulation of opioid peptides, opioid receptors, opioid agonists and opioid antagonists. The particular topics that continue to be covered include the molecular-biochemical effects and neurochemical localization studies of endogenous opioids and their receptors related to behavior (Section 2), and the roles of these opioid peptides and receptors in pain and analgesia (Section 3); stress and social status (Section 4); tolerance and dependence (Section 5); learning and memory (Section 6); eating and drinking (Section 7); alcohol and drugs of abuse (Section 8); sexual activity and hormones, pregnancy, development and endocrinology (Section 9); mental illness and mood (Section 10); seizures and neurologic disorders (Section 11); electrical-related activity and neurophysiology (Section 12); general activity and locomotion (Section 13); gastrointestinal, renal and hepatic functions (Section 14); cardiovascular responses (Section 15); respiration and thermoregulation (Section 16); and immunological responses (Section 17).