Roles of octopaminergic and dopaminergic neurons in mediating reward and punishment signals in insect visual learning

Aversive social learning with a dead conspecific is achieved by Pavlovian conditioning in crickets

Social learning, learning from other individuals, has been demonstrated in many animals, including insects, but its detailed neural mechanisms remain virtually unknown. We showed that crickets (Gryllus bimaculatus) exhibit aversive social learning with a dead conspecific. When a learner cricket was trained to observe a dead cricket on a drinking apparatus, the learner avoided the odor of that apparatus thereafter. Here we investigated the hypothesis that this social learning is achieved by first-order Pavlovian conditioning of an odor (conditioned stimulus) and a dead conspecific (unconditioned stimulus, US). Injection of a dopamine receptor antagonist (flupentixol) before training or testing impaired the learning or execution of the response to the learned odor, as we reported in aversive non-social Pavlovian conditioning in crickets. Moreover, crickets that were trained with a dead conspecific and then received revaluation of the dead conspecific by pairing it with water reward exhibited an appetitive conditioned response (CR) to the odor paired with the dead conspecific. This suggests that execution of the CR is governed by the current value of the US as in non-social Pavlovian conditioning. In addition, we previously suggested that appetitive social learning with a living conspecific is based on second-order conditioning (SOC), and here we showed that SOC is achieved when crickets experienced pairing of a dead conspecific with water reward before experiencing social learning training with a dead conspecific. We conclude that social learning with a dead conspecific is based on Pavlovian conditioning and that this learning can be extended to second-order social learning.

Visuo-spatial compound stimuli discrimination with (Gryllus pennsylvanicus) in two-choices rewarding learning tasks

This paper proposes an experimental protocol allowing Gryllus pennsylvanicus to discriminate an A-A and A-B motif pairs of compound visual stimuli. Specifically, this study consists in an operant conditioning procedure including a dichotomous Y-maze, two different pairs of compound visual colored cues and a water reward. Results are conclusive for this visuo-spatial regularities study,(Gryllus pennsylvanicus) were able to significantly discriminate between the two compound visual patterns and learned the association with the reinforcer.

Independent operations of appetitive and aversive conditioning systems lead to simultaneous production of conflicting memories in an insect

Pavlovian conditioning is a ubiquitous form of associative learning that enables animals to remember appetitive and aversive experiences. Animals possess appetitive and aversive conditioning systems that memorize and retrieve appetitive and aversive experiences. Here, we addressed a question of whether integration of competing appetitive and aversive information takes place during the encoding of the experience or during memory retrieval. We developed novel experimental procedures to address this question using crickets (Gryllus bimaculatus), which allowed selective blockade of the expression of appetitive and aversive memories by injecting octopamine and dopamine receptor antagonists. We conditioned an odour (conditioned stimulus 1, CS1) with water and then with sodium chloride solution. At 24 h after conditioning, crickets retained both appetitive and aversive memories, and the memories were integrated to produce a conditioned response (CR). Importantly, when a visual pattern (CS2) was conditioned with CS1, appetitive and aversive memories formed simultaneously. This indicates that appetitive and aversive second-order conditionings are achieved at the same time. The memories were integrated for producing a conditioned response. We conclude that appetitive and aversive conditioning systems operate independently to form parallel appetitive and aversive memories, which compete to produce learned behaviour in crickets.

Roles of octopamine neurons in the vertical lobe of the mushroom body for the execution of a conditioned response in cockroaches

Aminergic neurons mediate reward signals in mammals and insects. In crickets, we showed that blockade of synaptic transmission from octopamine neurons (OANs) impairs conditioning of an odor (conditioned stimulus, CS) with water or sucrose (unconditioned stimulus, US) and execution of a conditioned response (CR) to the CS. It has not yet been established, however, whether findings in crickets can be applied to other species of insects. In this study, we investigated the roles of OANs in conditioning of salivation, monitored by activities of salivary neurons, and in execution of the CR in cockroaches (Periplaneta americana). We showed that injection of epinastine (an OA receptor antagonist) into the head hemolymph impaired both conditioning and execution of the CR, in accordance with findings in crickets. Moreover, local injection of epinastine into the vertical lobes of the mushroom body (MB), the center for associative learning and control of the CR, impaired execution of the CR, whereas injection of epinastine into the calyces of the MB or the antennal lobes (primary olfactory centers) did not. We propose that OANs in the MB vertical lobes play critical roles in the execution of the CR in cockroaches. This is analogous to the fact that midbrain dopamine neurons govern execution of learned actions in mammals.

Octopamine neurons mediate reward signals in social learning in an insect

Social learning is found in many animals, but its mechanisms are not understood. We previously showed that a cricket that was trained to observe a conspecific staying at a drinking apparatus exhibited an increased preference for the odor of that drinking apparatus. Here we investigated a hypothesis that this learning is achieved by second-order conditioning (SOC), i.e., by associating conspecifics at a drinking bottle with water reward during group drinking in the rearing stage and then associating an odor with a conspecific in training. Injection of an octopamine receptor antagonist before training or testing impaired the learning or response to the learned odor, as we reported for SOC, thereby supporting the hypothesis. Notably, the SOC hypothesis predicts that octopamine neurons that respond to water in the group-rearing stage also respond to a conspecific in training, without the learner itself drinking water, and such mirror-like activities mediate social learning. This awaits future investigation.

Visual learning in tethered bees modifies flight orientation and is impaired by epinastine

Visual-orientation learning of a tethered flying bee was investigated using a flight simulator and a novel protocol in which orientation preference toward trained visual targets was assessed in tests performed before and after appetitive conditioning. Either a blue or a green rectangle (conditioned stimulus, CS) was associated with 30% sucrose solution (unconditioned stimulus, US), whereas the other rectangle was not paired with US. Bees were tested in a closed-looped flight simulator 5 min after ten pairings of the US and CS. Conditioned bees were preferentially oriented to the CS after such training. This increase in preference for CS was maintained for 24 h, indicating the presence of long-term memory. Because the total orienting time was not altered by conditioning, conditioning did not enhance orientation activity itself but increased the relative time for orientation to CS. When 0.4 or 4 mM epinastine (an antagonist of octopamine receptors) was injected into the bee's head 30 min prior to the experiment, both short- and long-term memory formation were significantly impaired, suggesting that octopamine, which is crucial for appetitive olfactory learning in insects, is also involved in visual orientation learning.

Octopaminergic neurons function in appetitive but not aversive olfactory learning and memory in Bactrocera dorsalis

The biogenic amine octopamine (OA, invertebrate counterpart of noradrenaline) plays critical roles in the regulation of olfactory behavior. Historically, OA has been thought to mediate appetitive but not aversive learning in honeybees, fruit flies (Drosophila), and crickets. However, this viewpoint has recently been challenged because OA activity through a β-adrenergic-like receptor drives both appetitive and aversive learning. Here, we explored the roles of OA neurons in olfactory learning and memory retrieval in Bactrocera dorsalis. We trained flies to associate an orange odor with a sucrose reward or to associate methyl eugenol, a male lure, with N,N-diethyl-3-methyl benzoyl amide (DEET) punishment. We then treated flies with OA receptor antagonists before appetitive or aversive conditioning and a memory retention test. Injection of OA receptor antagonist mianserin or epinastine into the abdomen of flies led to impaired of appetitive learning and memory retention with a sucrose reward, while aversive learning and memory retention with DEET punishment remained intact. Our results suggest that the OA signaling participates in appetitive but not aversive learning and memory retrieval in B. dorsalis through OA receptors.

State and physiology behind personality in arthropods: a review

In the endeavour to understand the causes and consequences of the variation in animal personality, a wide range of studies were carried out, utilising various aspects to make sense of this biological phenomenon. One such aspect integrated the study of physiological traits, investigating hypothesised physiological correlates of personality. Although many of such studies were carried out on vertebrates (predominantly on birds and mammals), studies using arthropods (mainly insects) as model organisms were also at the forefront of this area of research. In order to review the current state of knowledge on the relationship between personality and the most frequently studied physiological parameters in arthropods, we searched for scientific articles that investigated this relationship. In our review, we only included papers utilising a repeated-measures methodology to be conceptually and formally concordant with the study of animal personality. Based on our literature survey, metabolic rate, thermal physiology, immunophysiology, and endocrine regulation, as well as exogenous agents (such as toxins) were often identified as significant affectors shaping animal personality in arthropods. We found only weak support for state-dependence of personality when the state is approximated by singular elements (or effectors) of condition. We conclude that a more comprehensive integration of physiological parameters with condition may be required for a better understanding of state’s importance in animal personality. Also, a notable knowledge gap persists in arthropods regarding the association between metabolic rate and hormonal regulation, and their combined effects on personality. We discuss the findings published on the physiological correlates of animal personality in arthropods with the aim to summarise current knowledge, putting it into the context of current theory on the origin of animal personality.

Spontaneous recovery from overexpectation in an insect

In associative learning in mammals, it is widely accepted that learning is determined by the prediction error, i.e., the error between the actual reward and the reward predicted by the animal. However, it is unclear whether error-based learning theories are applicable to the learning occurring in other non-mammalian species. Here, we examined whether overexpectation, a phenomenon that supports error-based learning theories, occurs in crickets. Crickets were independently trained with two different conditioned stimuli (CSs), an odour and a visual pattern, that were followed by an appetitive unconditioned stimulus (US). Then the two CSs were presented simultaneously as a compound, followed by the same US. This treatment resulted in a reduced conditioned response to the odour CS when tested immediately after training. However, the response to the CS was partially recovered after 1 day. These results are the first to show overexpectation and its spontaneous recovery in an invertebrate species. While the results showing overexpectation are in agreement with the prediction by the Rescorla-Wagner model, a major form of error-based learning theories, the ones showing spontaneous recovery are not. Our results suggest that conventional error-based learning models account for some, but not for all essential features of Pavlovian conditioning in crickets.

Assessing reinforcing versus aversive consequences in a real-time secondhand smoke intervention

Few studies have examined the relative effectiveness of reinforcing versus aversive consequences at changing behavior in real-world environments. Real-time sensing devices makes it easier to investigate such questions, offering the potential to improve both intervention outcomes and theory. This research aims to describe the development of a real-time, operant theory-based secondhand smoke (SHS) intervention and compare the efficacy of aversive versus aversive plus reinforcement contingency systems. Indoor air particle monitors were placed in the households of 253 smokers for approximately three months. Participants were assigned to a measurement-only control group (N = 129) or one of the following groups: 1.) aversive only (AO, N = 71), with aversive audio/visual consequences triggered by the detection of elevated air particle measurements, or 2.) aversive plus reinforcement (AP, N = 53), with reinforcing consequences contingent on the absence of SHS added to the AO intervention. Residualized change ANCOVA analysis compared particle concentrations over time and across groups. Post-hoc pairwise comparisons were also performed. After controlling for Baseline, Post-Baseline daily particle counts (F = 6.42, p = 0.002), % of time >15,000 counts (F = 7.72, p < 0.001), and daily particle events (F = 4.04, p = 0.02) significantly differed by study group. Nearly all control versus AO/AP pair-wise comparisons were statistically significant. No significant differences were found for AO versus AP groups. The aversive feedback system reduced SHS, but adding reinforcing consequences did not further improve outcomes. The complexity of real-world environments requires the nuances of these two contingency systems continue to be explored, with this study demonstrating that real-time sensing technology can serve as a platform for such research.

What Is Learned in Pavlovian Conditioning in Crickets? Revisiting the S-S and S-R Learning Theories

In Pavlovian conditioning in mammals, two theories have been proposed for associations underlying conditioned responses (CRs). One theory, called S-S theory, assumes an association between a conditioned stimulus (CS) and internal representation of an unconditioned stimulus (US), allowing the animal to adjust the CR depending on the current value of the US. The other theory, called S-R theory, assumes an association or connection between the CS center and the CR center, allowing the CS to elicit the CR. Whether these theories account for Pavlovian conditioning in invertebrates has remained unclear. In this article, results of our studies in the cricket Gryllus bimaculatus are reviewed. We showed that after a standard amount of Pavlovian training, crickets exhibited no response to odor CS when water US was devalued by providing it until satiation, whereas after extended training, they exhibited a CR after US devaluation. An increase of behavioral automaticity by extended training has not been reported in Pavlovian conditioning in any other animals, but it has been documented in instrumental conditioning in mammals. Our pharmacological analysis suggested that octopamine neurons mediate US (water) value signals and control execution of the CR after standard training. The control, however, diminishes with extension of training and hence the CR becomes insensitive to the US value. We also found that the nature of the habitual response after extended Pavlovian training in crickets is not the same as that after extended instrumental training in mammals concerning the context specificity. Adaptive significance and evolutionary implications for our findings are discussed.

Manipulating monoamines reduces exploration and boldness of Mediterranean field crickets

Despite the prevalence and research interest of animal personality, its underlying mechanisms are not yet fully understood. Due to the essential role of monoamines in modulating behaviour, we manipulated the monoaminergic systems of Mediterranean field crickets (Gryllus bimaculatus) to explore whether this altered behavioural responses commonly used to describe animal personality. Previous work has shown that both serotonin and dopamine manipulations can alter cricket behaviour, although results differ depending on the drug in focus. Here, we investigate the effect of Fluphenazine, a dopamine antagonist which also interacts with serotonin receptors, on activity, exploration, boldness, and aggression. These results are compared with those of our earlier work that investigated the effect of drugs that more specifically target serotonin or dopamine systems (Fluoxetine and Ropinirole, respectively). Due to limited research on dose-effects of Fluphenazine, we created dose-response curves with concentrations ranging from those measured in surface waters up to human therapeutic doses. We show that compared to control animals, Fluphenazine manipulation resulted in lower levels of both exploration and boldness, but did not affect activity nor aggression. The effect on explorative behaviour contradicts our previous results of serotonin and dopamine manipulations. These results together confirm the causal role of monoamines in explaining variation in behaviour often used to describe animal personality, effects that can be both dose- and behaviour-dependent. Further, our results suggest that previous results assigned specifically to the dopaminergic system, may at least partly be explained by effects of the serotonergic system. Thus, future studies should continue to investigate the explicit underlying roles of specific monoamines in explaining behavioural variation.

CRISPR/Cas9 mediated disruption of the white gene leads to pigmentation deficiency and copulation failure in Drosophila suzukii

The Spotted-wing Drosophila (Drosophila suzukii) is a devastating invasive pest of fruit crops. In D. melanogaster, the white (w) gene was associated with pigmentation and mating behavior, which are also important aspects to understand the invasion biology as well as to develop control strategies for D. suzukii. Here, we show that the generation of D. suzukii white-eyed mutants by CRISPR/Cas9 mutagenesis of the w gene resulted in the complete failure of copulation when w^- males were individually paired with w^- females in small circular arenas (diameter 0.7 cm) for 24 h. Further analysis showed that the mating defect was associated with w^- males and could not be rectified by two years of inbreeding by crossing sibling w^- females with w⁺ males, dim red illumination, male-female sexual training, changing to large arenas (diameter 3.5 cm), or different sex ratios. Profound pigmentation deficiency was detected in the compound eyes, ocelli, Malpighian tubules and testis sheaths in the w^- flies. Specifically, testis imaging showed that w^- males failed to deposit any pigments into pigment cells of the testis sheath, and produced smaller sperms and less seminal fluid compared to those from wildtype males. Together these observations suggest that the w gene plays an essential role in the regulation of sexual behavior and reproduction in D. suzukii. The similarities and differences in w gene function between D. suzukii and D. melanogaster in the context of pigmentation and mating behavior are discussed.

MicroRNA-277 regulates dopa decarboxylase to control larval-pupal and pupal-adult metamorphosis of Helicoverpa armigera

Insect metamorphosis is a complex process involving many metabolic pathways, such as juvenile hormones and molting hormones, bioamines, microRNAs (miRNAs), etc. However, relatively little is known about the biogenic amines and their miRNAs to regulate cotton bollworm metamorphosis. Here we show that one miRNA, miR-277 regulates larval-pupal and pupal-adult metamorphosis of cotton bollworm by targeting the 3'UTR of Dopa decarboxylase (DDC), a synthetic catalytic enzyme of dopamine. Injection of miR-277 agomir inhibited the expression of DDC at the mRNA and protein levels, leading to defects in the pupation and emergence of H. armigera that was consistent with the phenotype obtained by injection of DDC double-stranded RNA (dsRNA). Injection of miR-277 antagomir induced the mRNA and protein expression of DDC and rescued the phenotype of pupation failure caused by DDC gene silencing. Unexpectedly, miR-277 antagomir can also cause failure of emergence of H. armigera and both agomir and antagomir of miR-277 injection could cause abnormal phenotypes in wing veins. This study reveals that elaborate regulation of miRNA and its target gene expression is prerequisite for insect development, which provides a new insight to study the developmental mechanisms of insect wing veins.

Appetitive and aversive social learning with living and dead conspecifics in crickets

Many animals acquire biologically important information from conspecifics. Social learning has been demonstrated in many animals, but there are few experimental paradigms that are suitable for detailed analysis of its associative processes. We established procedures for appetitive and aversive social learning with living and dead conspecifics in well-controlled stimulus arrangements in crickets, Gryllus bimaculatus. A thirsty demonstrator cricket was released in a demonstrator room and allowed to visit two drinking apparatuses that contained water or saltwater and emitted apple or banana odour, and a thirsty learner was allowed to observe the demonstrator room through a net. In the post-training test, the learner preferred the odour of the water-containing apparatus at which the demonstrator stayed. When a dead cricket was placed on one of the two apparatuses, the learner avoided the odour of that apparatus. Further experiments suggested that a living conspecific can be recognized by either visual or olfactory cues for appetitive social learning, whereas olfactory cues are needed to recognize a dead conspecific for aversive social learning, and that different associative processes underlie social learning with living and dead conspecifics. The experimental paradigms described here will pave the way for detailed research on the neural basis of social learning.

Tyrosine hydroxylase immunolabeling reveals the distribution of catecholaminergic neurons in the central nervous systems of the spiders Hogna lenta (Araneae: Lycosidae) and Phidippus regius (Araneae: Salticidae)

With over 48,000 species currently described, spiders (Arthropoda: Chelicerata: Araneae) comprise one of the most diverse groups of animals on our planet, and exhibit an equally wide array of fascinating behaviors. Studies of central nervous systems (CNSs) in spiders, however, are relatively sparse, and no reports have yet characterized catecholaminergic (dopamine [DA]- or norepinephrine-synthesizing) neurons in any spider species. Because these neuromodulators are especially important for sensory and motor processing across animal taxa, we embarked on a study to identify catecholaminergic neurons in the CNS of the wolf spider Hogna lenta (Lycosidae) and the jumping spider Phidippus regius (Salticidae). These neurons were most effectively labeled with an antiserum raised against tyrosine hydroxylase (TH), the rate-limiting enzyme in catecholamine synthesis. We found extensive catecholamine-rich neuronal fibers in the first- and second-order optic neuropils of the supraesophageal mass (brain), as well as in the arcuate body, a region of the brain thought to receive visual input and which may be involved in higher order sensorimotor integration. This structure likely shares evolutionary origins with the DA-enriched central complex of the Mandibulata. In the subesophageal mass, we detected an extensive filigree of TH-immunoreactive (TH-ir) arborizations in the appendage neuromeres, as well as three prominent plurisegmental fiber tracts. A vast abundance of TH-ir somata were located in the opisthosomal neuromeres, the largest of which appeared to project to the brain and decorate the appendage neuromeres. Our study underscores the important roles that the catecholamines likely play in modulating spider vision, higher order sensorimotor processing, and motor patterning.

Development of behavioural automaticity by extended Pavlovian training in an insect

The effect of repetitive training on learned actions has been a major subject in behavioural neuroscience. Many studies of instrumental conditioning in mammals, including humans, suggested that learned actions early in training are goal-driven and controlled by outcome expectancy, but they become more automatic and insensitive to reduction in the value of the outcome after extended training. It was unknown, however, whether the development of value-insensitive behaviour also occurs by extended training of Pavlovian conditioning in any animals. Here we show that crickets Gryllus bimaculatus that had received minimal training to associate an odour with water (unconditioned stimulus, US) did not exhibit conditioned response (CR) to the odour when they were given water until satiation before the test, but those that had received extended training exhibited CR even when they were satiated with water. Further pharmacological experiments suggested that octopamine neurons, the invertebrate counterparts of noradrenaline neurons, mediate US value signals and control execution of CR after minimal training, but the control diminishes with the progress of training and hence the CR becomes insensitive to US devaluation. The results suggest that repetitive sensory experiences can lead to a change from a goal-driven response to a more automatic one in crickets.

Responsiveness to Sugar Solutions in the Moth Agrotis ipsilon: Parameters Affecting Proboscis Extension

Adult moths need energy and nutrients for reproducing and obtain them mainly by consuming flower nectar (a solution of sugars and other compounds). Gustatory perception gives them information on the plants they feed on. Feeding and food perception are integrated in the proboscis extension response, which occurs when their antennae touch a sugar solution. We took advantage of this reflex to explore moth sugar responsiveness depending on different parameters (i.e., sex, age, satiety, site of presentation, and composition of the solution). We observed that starvation but not age induced higher response rates to sucrose. Presentation of sucrose solutions in a randomized order confirmed that repeated sugar stimulations did not affect the response rate; however, animals were sometimes sensitized to water, indicating sucrose presentation might induce non-associative plasticity. Leg stimulation was much less efficient than antennal stimulation to elicit a response. Quinine prevented and terminated sucrose-elicited proboscis extension. Males but not females responded slightly more to sucrose than to fructose. Animals of either sex rarely reacted to glucose, but curiously, mixtures in which half sucrose or fructose were replaced by glucose elicited the same response rate than sucrose or fructose alone. Fructose synergized the response when mixed with sucrose in male but not female moths. This is consistent with the fact that nectars consumed by moths in nature are mixtures of these three sugars, which suggests an adaptation to nectar perception.

Tyrosine hydroxylase-immunoreactive neurons in the mushroom body of the field cricket, Gryllus bimaculatus

The mushroom body of the insect brain participates in processing and integrating multimodal sensory information and in various forms of learning. In the field cricket, Gryllus bimaculatus, dopamine plays a crucial role in aversive memory formation. However, the morphologies of dopamine neurons projecting to the mushroom body and their potential target neurons, the Kenyon cells, have not been characterized. Golgi impregnations revealed two classes of Kenyon cells (types I and II) and five different types of extrinsic fibers in the mushroom body. Type I cells, which are further divided into two subtypes (types I core and I surface), extend their dendrites into the anterior calyx, whereas type II cells extend many bushy dendritic branches into the posterior calyx. Axons of the two classes bifurcate between the pedunculus and lobes to form the vertical, medial and γ lobes. Immunocytochemistry to tyrosine hydroxylase (TH), a rate-limiting enzyme in dopamine biosynthesis, revealed the following four distinct classes of neurons: (1) TH-SLP projecting to the distal vertical lobe; (2) TH-IP1 extending to the medial and γ lobes; (3) TH-IP2 projecting to the basal vertical lobe; and (4) a multiglomerular projection neuron invading the anterior calyx and the lateral horn (TH-MPN). We previously proposed a model in the field cricket in which the efficiency of synapses from Kenyon cells transmitting a relevant sensory stimulus to output neurons commanding an appropriate behavioral reaction can be modified by dopaminergic neurons mediating aversive signals and here, we provide putative neural substrates for the cricket's aversive learning. These will be instrumental in understanding the principle of aversive memory formation in this model species.

Connectomics and function of a memory network: the mushroom body of larval Drosophila

The Drosophila larva is a relatively simple, 10 000-neuron study case for learning and memory with enticing analytical power, combining genetic tractability, the availability of robust behavioral assays, the opportunity for single-cell transgenic manipulation, and an emerging synaptic connectome of its complete central nervous system. Indeed, although the insect mushroom body is a much-studied memory network, the connectome revealed that more than half of the classes of connection within the mushroom body had escaped attention. The connectome also revealed circuitry that integrates, both within and across brain hemispheres, higher-order sensory input, intersecting valence signals, and output neurons that instruct behavior. Further, it was found that activating individual dopaminergic mushroom body input neurons can have a rewarding or a punishing effect on olfactory stimuli associated with it, depending on the relative timing of this activation, and that larvae form molecularly dissociable short-term, long-term, and amnesia-resistant memories. Together, the larval mushroom body is a suitable study case to achieve a nuanced account of molecular function in a behaviorally meaningful memory network.

Immediate-Early Promoter-Driven Transgenic Reporter System for Neuroethological Research in a Hemimetabolous Insect

Genes expressed in response to increased neuronal activity are widely used as activity markers in recent behavioral neuroscience. In the present study, we established transgenic reporter system for whole-brain activity mapping in the two-spotted cricket Gryllus bimaculatus, a hemimetabolous insect used in neuroethology and behavioral ecology. In the cricket brain, a homolog of early growth response-1 (Gryllus egr-B) was rapidly induced as an immediate-early gene (IEG) in response to neuronal hyperexcitability. The upstream genomic fragment of Gryllus egr-B contains potential binding sites for transcription factors regulated by various intracellular signaling pathways, as well as core promoter elements conserved across insect/crustacean egr-B homologs. Using the upstream genomic fragment of Gryllus egr-B, we established an IEG promoter-driven transgenic reporter system in the cricket. In the brain of transgenic crickets, the reporter gene (a nuclear-targeted destabilized EYFP) was induced in response to neuronal hyperexcitability. Inducible expression of reporter protein was detected in almost all neurons after neuronal hyperexcitability. Using our novel reporter system, we successfully detected neuronal activation evoked by feeding in the cricket brain. Our IEG promoter-driven activity reporting system allows us to visualize behaviorally relevant neural circuits at cellular resolution in the cricket brain.

Application of a Prediction Error Theory to Pavlovian Conditioning in an Insect

Elucidation of the conditions in which associative learning occurs is a critical issue in neuroscience and comparative psychology. In Pavlovian conditioning in mammals, it is thought that the discrepancy, or error, between the actual reward and the predicted reward determines whether learning occurs. This theory stems from the finding of Kamin’s blocking effect, in which after pairing of a stimulus with an unconditioned stimulus (US), conditioning of a second stimulus is blocked when the two stimuli are presented in compound and paired with the same US. Whether this theory is applicable to any species of invertebrates, however, has remained unknown. We first showed blocking and one-trial blocking of Pavlovian conditioning in the cricket Gryllus bimaculatus, which supported the Rescorla–Wagner model but not attentional theories, the major competitive error-correction learning theories to account for blocking. To match the prediction error theory, a neural circuit model was proposed, and prediction from the model was tested: the results were consistent with the Rescorla–Wagner model but not with the retrieval theory, another competitive theory to account for blocking. The findings suggest that the Rescorla–Wagner model best accounts for Pavlovian conditioning in crickets and that the basic computation rule underlying Pavlovian conditioning in crickets is the same to those suggested in mammals. Moreover, results of pharmacological studies in crickets suggested that octopamine and dopamine mediate prediction error signals in appetitive and aversive conditioning, respectively. This was in contrast to the notion that dopamine mediates appetitive prediction error signals in mammals. The functional significance and evolutionary implications of these findings are discussed.

Signaling Pathways for Long-Term Memory Formation in the Cricket

Unraveling the molecular mechanisms underlying memory formation in insects and a comparison with those of mammals will contribute to a further understanding of the evolution of higher-brain functions. As it is for mammals, insect memory can be divided into at least two distinct phases: protein-independent short-term memory and protein-dependent long-term memory (LTM). We have been investigating the signaling pathway of LTM formation by behavioral-pharmacological experiments using the cricket Gryllus bimaculatus, whose olfactory learning and memory abilities are among the highest in insect species. Our studies revealed that the NO-cGMP signaling pathway, CaMKII and PKA play crucial roles in LTM formation in crickets. These LTM formation signaling pathways in crickets share a number of attributes with those of mammals, and thus we conclude that insects, with relatively simple brain structures and neural circuitry, will also be beneficial in exploratory experiments to predict the molecular mechanisms underlying memory formation in mammals.

Aversive gustatory learning and perception in honey bees

Taste perception allows discriminating edible from non-edible items and is crucial for survival. In the honey bee, the gustatory sense has remained largely unexplored, as tastants have been traditionally used as reinforcements rather than as stimuli to be learned and discriminated. Here we provide the first characterization of antennal gustatory perception in this insect using a novel conditioning protocol in which tastants are dissociated from their traditional food-reinforcement role to be learned as predictors of punishment. We found that bees have a limited gustatory repertoire via their antennae: they discriminate between broad gustatory modalities but not within modalities, and are unable to differentiate bitter substances from water. Coupling gustatory conditioning with blockade of aminergic pathways in the bee brain revealed that these pathways are not restricted to encode reinforcements but may also encode conditioned stimuli. Our results reveal unknown aspects of honey bee gustation, and bring new elements for comparative analyses of gustatory perception in animals.

Visual discrimination transfer and modulation by biogenic amines in honeybees

For more than a century, visual learning and memory has been studied in the honeybee Apis mellifera using operant appetitive conditioning. Although honeybees show impressive visual learning capacities in this well-established protocol, operant training of free-flying animals can hardly be combined with invasive protocols for studying the neurobiological basis of visual learning. In view of that, different efforts have been made to develop new classical conditioning protocols for studying visual learning in harnessed honeybees, though learning performances remain considerably poorer than those obtained in free-flying animals. Here we investigated the ability of honeybees to use visual information acquired during classical conditioning in a new operant context. We performed differential visual conditioning of the proboscis extension reflex (PER) followed by visual orientation tests in Y-maze. Classical conditioning and Y-maze retention tests were performed using a same pair of perceptually isoluminant monochromatic stimuli, to avoid the influence of phototaxis during free-flying orientation. Visual discrimination transfer was clearly observed, with pre-trained honeybees significantly orienting their flights towards the former positive conditioned stimulus (CS+). We thus show that visual memories acquired by honeybees are resistant to context changes between conditioning and retention test. We combined this visual discrimination approach with selective pharmacological injections to evaluate the effect of dopamine and octopamine in appetitive visual learning. Both octopaminergic and dopaminergic antagonists impaired visual discrimination performances, suggesting that both these biogenic amines modulate appetitive visual learning in honeybees. Our study brings new insights into cognitive and neurobiological mechanisms underlying visual learning in honeybees.

Roles of Octopamine and Dopamine Neurons for Mediating Appetitive and Aversive Signals in Pavlovian Conditioning in Crickets

Revealing neural systems that mediate appetite and aversive signals in associative learning is critical for understanding the brain mechanisms controlling adaptive behavior in animals. In mammals, it has been shown that some classes of dopamine neurons in the midbrain mediate prediction error signals that govern the learning process, whereas other classes of dopamine neurons control execution of learned actions. In this review, based on the results of our studies on Pavlovian conditioning in the cricket Gryllus bimaculatus and by referring to the findings in honey bees and fruit-flies, we argue that comparable aminergic systems exist in the insect brain. We found that administrations of octopamine (the invertebrate counterpart of noradrenaline) and dopamine receptor antagonists impair conditioning to associate an olfactory or visual conditioned stimulus (CS) with water or sodium chloride solution (appetitive or aversive unconditioned stimulus, US), respectively, suggesting that specific octopamine and dopamine neurons mediate appetitive and aversive signals, respectively, in conditioning in crickets. These findings differ from findings in fruit-flies. In fruit-flies, appetitive and aversive signals are mediated by different dopamine neuron subsets, suggesting diversity in neurotransmitters mediating appetitive signals in insects. We also found evidences of “blocking” and “auto-blocking” phenomena, which suggested that the prediction error, the discrepancy between actual US and predicted US, governs the conditioning in crickets and that octopamine neurons mediate prediction error signals for appetitive US. Our studies also showed that activations of octopamine and dopamine neurons are needed for the execution of an appetitive conditioned response (CR) and an aversive CR, respectively, and we, thus, proposed that these neurons mediate US prediction signals that drive appetitive and aversive CRs. Our findings suggest that the basic principles of functioning of aminergic systems in associative learning, i.e., to transmit prediction error signals for conditioning and to convey US prediction signals for execution of CR, are conserved among insects and mammals, on account of the fact that the organization of the insect brain is much simpler than that of the mammalian brain. Further investigation of aminergic systems that govern associative learning in insects should lead to a better understanding of commonalities and diversities of computational rules underlying associative learning in animals.

Roles of dopamine neurons in mediating the prediction error in aversive learning in insects

In associative learning in mammals, it is widely accepted that the discrepancy, or error, between actual and predicted reward determines whether learning occurs. The prediction error theory has been proposed to account for the finding of a blocking phenomenon, in which pairing of a stimulus X with an unconditioned stimulus (US) could block subsequent association of a second stimulus Y to the US when the two stimuli were paired in compound with the same US. Evidence for this theory, however, has been imperfect since blocking can also be accounted for by competitive theories. We recently reported blocking in classical conditioning of an odor with water reward in crickets. We also reported an "auto-blocking" phenomenon in appetitive learning, which supported the prediction error theory and rejected alternative theories. The presence of auto-blocking also suggested that octopamine neurons mediate reward prediction error signals. Here we show that blocking and auto-blocking occur in aversive learning to associate an odor with salt water (US) in crickets, and our results suggest that dopamine neurons mediate aversive prediction error signals. We conclude that the prediction error theory is applicable to both appetitive learning and aversive learning in insects.

Peptidoglycan sensing by octopaminergic neurons modulates Drosophila oviposition

As infectious diseases pose a threat to host integrity, eukaryotes have evolved mechanisms to eliminate pathogens. In addition to develop strategies reducing infection, animals can engage in behaviors that lower the impact of the infection. The molecular mechanisms by which microbes impact host behavior are not well understood. We demonstrate that bacterial infection of Drosophila females reduces oviposition and that peptidoglycan, the component that activates Drosophila antibacterial response, is also the elicitor of this behavioral change. We show that peptidoglycan regulates egg-laying rate by activating NF-κB signaling pathway in octopaminergic neurons and that, a dedicated peptidoglycan degrading enzyme acts in these neurons to buffer this behavioral response. This study shows that a unique ligand and signaling cascade are used in immune cells to mount an immune response and in neurons to control fly behavior following infection. This may represent a case of behavioral immunity.

DOI:http://dx.doi.org/10.7554/eLife.21937.001

Bacteria are all around us: they are on our skin, in the food that we eat and inside our bodies, particularly in the gut. While many of these bacteria are harmless and some even help us digest our food, others can make us ill. Upon detecting harmful bacteria, our bodies therefore trigger an immune response intended to destroy them.

Some insects – including butterflies, moths and grasshoppers – have an additional way of defending themselves against bacteria besides their immune response. Whenever they detect harmful microorganisms, the insects change their behavior so as to reduce their chances of becoming infected and limit the damage an infection would cause. The insects move away from areas containing harmful bacteria, for example, and temporarily stop eating. But whereas the insects’ immune response to bacteria is well documented, little was known about the mechanisms that underlie these changes in behavior.

Kurz, Charroux et al. set out to rectify this using another insect species, the fruit fly Drosophila. Flies that are infected with bacteria lay fewer eggs than healthy flies: a change in behavior that helps protect the offspring from infection. Kurz, Charroux et al. show that fruit flies are able to detect a component of the cell wall that surrounds all bacteria. This substance, known as peptidoglycan, activates a set of neurons in the fly that produce a chemical called octopamine. These neurons in turn activate a signaling pathway featuring a molecule known as NF-κB, and this causes the flies to lay fewer eggs.

Notably, peptidoglycan and NF-κB are also the molecules that trigger the anti-bacterial immune response. Fruit flies thus use the same pathway in immune cells and in neurons to trigger immune responses and behavioral changes, respectively. The challenge now is to identify precisely which neurons respond to bacterial peptidoglycan, and to work out how peptidoglycan changes the activity of these cells. Furthermore, studies have recently shown that bacterial peptidoglycan can influence the development of the mouse brain, as well as mouse behavior. This suggests that mechanisms for detecting harmful bacteria may be conserved across evolution, a possibility that requires further investigation.

DOI:http://dx.doi.org/10.7554/eLife.21937.002

Male Psyllids Differentially Learn in the Context of Copulation

In the Asian citrus psyllid, Diaphorina citri Kuwayama, stimulatory cuticular hydrocarbons act as sex pheromone attractants. Male psyllids locate aggregations of females using those olfactory cues, as well as vibrational communication on the plant surface. Although previous research has indicated that learning plays a role in modulating female reproductive behaviors in psyllids, it is unknown whether males similarly use learning to increase the likelihood of copulatory success. We used an olfactometer-based bio-assay to study the effects of experience on male response to female odor. First, we compared male attraction to female odor in virgin and previously mated males. Second, we tested the effect of several modes of experience with a novel odor, vanillin, to determine whether mating, feeding, or general environmental exposure elicited a learned response. We found that male attraction to female odor significantly increased after mating experience. In addition, we found that males learn about odor specifically in the context of mating, rather than feeding or general exposure. Electrophysiological measurements of antennal response to odorants confirmed that mating status did not affect the sensitivity of the peripheral nervous system to volatile stimuli implicating learning at the level of the central nervous system. These results suggest that male response to female odor is not an entirely innate behavior. Males may require mating experience with female conspecifics to develop attraction to those olfactory cues produced by the female and in association with the female’s habitat. This adaptive plasticity may allow males to detect females in an ever-changing environment and promote diversification and further specialization on different host genotypes.

Activation of NO-cGMP Signaling Rescues Age-Related Memory Impairment in Crickets

Age-related memory impairment (AMI) is a common feature and a debilitating phenotype of brain aging in many animals. However, the molecular mechanisms underlying AMI are still largely unknown. The cricket Gryllus bimaculatus is a useful experimental animal for studying age-related changes in learning and memory capability; because the cricket has relatively short life-cycle and a high capability of olfactory learning and memory. Moreover, the molecular mechanisms underlying memory formation in crickets have been examined in detail. In the present study, we trained male crickets of different ages by multiple-trial olfactory conditioning to determine whether AMI occurs in crickets. Crickets 3 weeks after the final molt (3-week-old crickets) exhibited levels of retention similar to those of 1-week-old crickets at 30 min or 2 h after training; however they showed significantly decreased levels of 1-day retention, indicating AMI in long-term memory (LTM) but not in anesthesia-resistant memory (ARM) in olfactory learning of crickets. Furthermore, 3-week-old crickets injected with a nitric oxide (NO) donor, a cyclic GMP (cGMP) analog or a cyclic AMP (cAMP) analog into the hemolymph before conditioning exhibited a normal level of LTM, the same level as that in 1-week-old crickets. The rescue effect by NO donor or cGMP analog injection was absent when the crickets were injected after the conditioning. For the first time, an NO donor and a cGMP analog were found to antagonize the age-related impairment of LTM formation, suggesting that deterioration of NO synthase (NOS) or molecules upstream of NOS activation is involved in brain-aging processes.

Dopamine- and Tyrosine Hydroxylase-Immunoreactive Neurons in the Brain of the American Cockroach, Periplaneta americana

The catecholamine dopamine plays several vital roles in the central nervous system of many species, but its neural mechanisms remain elusive. Detailed neuroanatomical characterization of dopamine neurons is a prerequisite for elucidating dopamine’s actions in the brain. In the present study, we investigated the distribution of dopaminergic neurons in the brain of the American cockroach, Periplaneta americana, using two antisera: 1) an antiserum against dopamine, and 2) an antiserum against tyrosine hydroxylase (TH, an enzyme required for dopamine synthesis), and identified about 250 putatively dopaminergic neurons. The patterns of dopamine- and TH-immunoreactive neurons were strikingly similar, suggesting that both antisera recognize the same sets of “dopaminergic” neurons. The dopamine and TH antibodies intensively or moderately immunolabeled prominent brain neuropils, e.g. the mushroom body (memory center), antennal lobe (first-order olfactory center) and central complex (motor coordination center). All subdivisions of the mushroom body exhibit both dopamine and TH immunoreactivity. Comparison of immunolabeled neurons with those filled by dye injection revealed that a group of immunolabeled neurons with cell bodies near the calyx projects into a distal region of the vertical lobe, which is a plausible site for olfactory memory formation in insects. In the antennal lobe, ordinary glomeruli as well as macroglomeruli exhibit both dopamine and TH immunoreactivity. It is noteworthy that the dopamine antiserum labeled tiny granular structures inside the glomeruli whereas the TH antiserum labeled processes in the marginal regions of the glomeruli, suggesting a different origin. In the central complex, all subdivisions excluding part of the noduli and protocerebral bridge exhibit both dopamine and TH immunoreactivity. These anatomical findings will accelerate our understanding of dopaminergic systems, specifically in neural circuits underlying aversive memory formation and arousal, in insects.

Roles of OA1 octopamine receptor and Dop1 dopamine receptor in mediating appetitive and aversive reinforcement revealed by RNAi studies

Revealing reinforcing mechanisms in associative learning is important for elucidation of brain mechanisms of behavior. In mammals, dopamine neurons are thought to mediate both appetitive and aversive reinforcement signals. Studies using transgenic fruit-flies suggested that dopamine neurons mediate both appetitive and aversive reinforcements, through the Dop1 dopamine receptor, but our studies using octopamine and dopamine receptor antagonists and using Dop1 knockout crickets suggested that octopamine neurons mediate appetitive reinforcement and dopamine neurons mediate aversive reinforcement in associative learning in crickets. To fully resolve this issue, we examined the effects of silencing of expression of genes that code the OA1 octopamine receptor and Dop1 and Dop2 dopamine receptors by RNAi in crickets. OA1-silenced crickets exhibited impairment in appetitive learning with water but not in aversive learning with sodium chloride solution, while Dop1-silenced crickets exhibited impairment in aversive learning but not in appetitive learning. Dop2-silenced crickets showed normal scores in both appetitive learning and aversive learning. The results indicate that octopamine neurons mediate appetitive reinforcement via OA1 and that dopamine neurons mediate aversive reinforcement via Dop1 in crickets, providing decisive evidence that neurotransmitters and receptors that mediate appetitive reinforcement indeed differ among different species of insects.

Timing of Environmental Enrichment Affects Memory in the House Cricket, Acheta domesticus

Learning appears to be ubiquitous among animals, as it plays a key role in many behaviors including foraging and reproduction. Although there is some genetic basis for differences in learning ability and memory retention, environment also plays an important role, as it does for any other trait. For example, adult animals maintained in enriched housing conditions learn faster and remember tasks for longer than animals maintained in impoverished conditions. Such plasticity in adult learning ability has often been linked to plasticity in the brain, and studies aimed at understanding the mechanisms, stimuli, and consequences of adult behavioral and brain plasticity are numerous. However, the role of experiences during post-embryonic development in shaping plasticity in adult learning ability and memory retention remain relatively unexplored. Using the house cricket (Acheta domesticus) as a model organism, we developed a protocol to allow the odor preference of a large number of crickets to be tested in a short period of time. We then used this new protocol to examine how enrichment or impoverishment at two developmental stages (either the last nymphal instar or young adult) affected adult memory. Our results show that regardless of nymphal rearing conditions, crickets that experienced an enriched rearing condition as young adults performed better on a memory task than individuals that experienced an impoverished condition. Older adult crickets (more than 1 week post adult molt) did not demonstrate differences in memory of the odor task, regardless of rearing condition as a young adult. Our results suggest that environmentally-induced plasticity in memory may be restricted to the young adult stage.

Trace Amines and the Trace Amine-Associated Receptor 1: Pharmacology, Neurochemistry, and Clinical Implications

Biogenic amines are a collection of endogenous molecules that play pivotal roles as neurotransmitters and hormones. In addition to the "classical" biogenic amines resulting from decarboxylation of aromatic acids, including dopamine (DA), norepinephrine, epinephrine, serotonin (5-HT), and histamine, other biogenic amines, present at much lower concentrations in the central nervous system (CNS), and hence referred to as "trace" amines (TAs), are now recognized to play significant neurophysiological and behavioral functions. At the turn of the century, the discovery of the trace amine-associated receptor 1 (TAAR1), a phylogenetically conserved G protein-coupled receptor that is responsive to both TAs, such as β-phenylethylamine, octopamine, and tyramine, and structurally-related amphetamines, unveiled mechanisms of action for TAs other than interference with aminergic pathways, laying the foundations for deciphering the functional significance of TAs and its mammalian CNS receptor, TAAR1. Although, its molecular interactions and downstream targets have not been fully elucidated, TAAR1 activation triggers accumulation of intracellular cAMP, modulates PKA and PKC signaling and interferes with the β-arrestin2-dependent pathway via G protein-independent mechanisms. TAAR1 is uniquely positioned to exert direct control over DA and 5-HT neuronal firing and release, which has profound implications for understanding the pathophysiology of, and therefore designing more efficacious therapeutic interventions for, a range of neuropsychiatric disorders that involve aminergic dysregulation, including Parkinson's disease, schizophrenia, mood disorders, and addiction. Indeed, the recent development of novel pharmacological tools targeting TAAR1 has uncovered the remarkable potential of TAAR1-based medications as new generation pharmacotherapies in neuropsychiatry. This review summarizes recent developments in the study of TAs and TAAR1, their intricate neurochemistry and pharmacology, and their relevance for neurodegenerative and neuropsychiatric disease.

Remembering Components of Food in Drosophila

Remembering features of past feeding experience can refine foraging and food choice. Insects can learn to associate sensory cues with components of food, such as sugars, amino acids, water, salt, alcohol, toxins and pathogens. In the fruit fly Drosophila some food components activate unique subsets of dopaminergic neurons (DANs) that innervate distinct functional zones on the mushroom bodies (MBs). This architecture suggests that the overall dopaminergic neuron population could provide a potential cellular substrate through which the fly might learn to value a variety of food components. In addition, such an arrangement predicts that individual component memories reside in unique locations. DANs are also critical for food memory consolidation and deprivation-state dependent motivational control of the expression of food-relevant memories. Here, we review our current knowledge of how nutrient-specific memories are formed, consolidated and specifically retrieved in insects, with a particular emphasis on Drosophila.

Knockout crickets for the study of learning and memory: Dopamine receptor Dop1 mediates aversive but not appetitive reinforcement in crickets

Elucidation of reinforcement mechanisms in associative learning is an important subject in neuroscience. In mammals, dopamine neurons are thought to play critical roles in mediating both appetitive and aversive reinforcement. Our pharmacological studies suggested that octopamine and dopamine neurons mediate reward and punishment, respectively, in crickets, but recent studies in fruit-flies concluded that dopamine neurons mediates both reward and punishment, via the type 1 dopamine receptor Dop1. To resolve the discrepancy between studies in different insect species, we produced Dop1 knockout crickets using the CRISPR/Cas9 system and found that they are defective in aversive learning with sodium chloride punishment but not appetitive learning with water or sucrose reward. The results suggest that dopamine and octopamine neurons mediate aversive and appetitive reinforcement, respectively, in crickets. We suggest unexpected diversity in neurotransmitters mediating appetitive reinforcement between crickets and fruit-flies, although the neurotransmitter mediating aversive reinforcement is conserved. This study demonstrates usefulness of the CRISPR/Cas9 system for producing knockout animals for the study of learning and memory.

Differentially expressed genes linked to natural variation in long-term memory formation in Cotesia parasitic wasps

Even though learning and memory are universal traits in the Animal Kingdom, closely related species reveal substantial variation in learning rate and memory dynamics. To determine the genetic background of this natural variation, we studied two congeneric parasitic wasp species, Cotesia glomerata and C. rubecula, which lay their eggs in caterpillars of the large and small cabbage white butterfly. A successful egg laying event serves as an unconditioned stimulus (US) in a classical conditioning paradigm, where plant odors become associated with the encounter of a suitable host caterpillar. Depending on the host species, the number of conditioning trials and the parasitic wasp species, three different types of transcription-dependent long-term memory (LTM) and one type of transcription-independent, anesthesia-resistant memory (ARM) can be distinguished. To identify transcripts underlying these differences in memory formation, we isolated mRNA from parasitic wasp heads at three different time points between induction and consolidation of each of the four memory types, and for each sample three biological replicates, where after strand-specific paired-end 100 bp deep sequencing. Transcriptomes were assembled de novo and differential expression was determined for each memory type and time point after conditioning, compared to unconditioned wasps. Most differentially expressed (DE) genes and antisense transcripts were only DE in one of the LTM types. Among the DE genes that were DE in two or more LTM types, were many protein kinases and phosphatases, small GTPases, receptors and ion channels. Some genes were DE in opposing directions between any of the LTM memory types and ARM, suggesting that ARM in Cotesia requires the transcription of genes inhibiting LTM or vice versa. We discuss our findings in the context of neuronal functioning, including RNA splicing and transport, epigenetic regulation, neurotransmitter/peptide synthesis and antisense transcription. In conclusion, these brain transcriptomes provide candidate genes that may be involved in the observed natural variation in LTM in closely related Cotesia parasitic wasp species.

Roles of octopamine and dopamine in appetitive and aversive memory acquisition studied in olfactory conditioning of maxillary palpi extension response in crickets

Elucidation of reinforcing mechanisms for associative learning is an important subject in neuroscience. Based on results of our previous pharmacological studies in crickets, we suggested that octopamine and dopamine mediate reward and punishment signals, respectively, in associative learning. In fruit-flies, however, it was concluded that dopamine mediates both appetitive and aversive reinforcement, which differs from our suggestion in crickets. In our previous studies, the effect of conditioning was tested at 30 min after training or later, due to limitations of our experimental procedures, and thus the possibility that octopamine and dopamine were not needed for initial acquisition of learning was not ruled out. In this study we first established a conditioning procedure to enable us to evaluate acquisition performance in crickets. Crickets extended their maxillary palpi and vigorously swung them when they perceived some odors, and we found that crickets that received pairing of an odor with water reward or sodium chloride punishment exhibited an increase or decrease in percentages of maxillary palpi extension responses to the odor. Using this procedure, we found that octopamine and dopamine receptor antagonists impair acquisition of appetitive and aversive learning, respectively. This finding suggests that neurotransmitters mediating appetitive reinforcement differ in crickets and fruit-flies.

Functional coupling between sodium-activated potassium channels and voltage-dependent persistent sodium currents in cricket Kenyon cells

In this study, we examined the functional coupling between Na(+)-activated potassium (KNa) channels and Na(+) influx through voltage-dependent Na(+) channels in Kenyon cells isolated from the mushroom body of the cricket Gryllus bimaculatus. Single-channel activity of KNa channels was recorded with the cell-attached patch configuration. The open probability (Po) of KNa channels increased with increasing Na(+) concentration in a bath solution, whereas it decreased by the substitution of Na(+) with an equimolar concentration of Li(+). The Po of KNa channels was also found to be reduced by bath application of a high concentration of TTX (1 μM) and riluzole (100 μM), which inhibits both fast (INaf) and persistent (INaP) Na(+) currents, whereas it was unaffected by a low concentration of TTX (10 nM), which selectively blocks INaf. Bath application of Cd(2+) at a low concentration (50 μM), as an inhibitor of INaP, also decreased the Po of KNa channels. Conversely, bath application of the inorganic Ca(2+)-channel blockers Co(2+) and Ni(2+) at high concentrations (500 μM) had little effect on the Po of KNa channels, although Cd(2+) (500 μM) reduced the Po of KNa channels. Perforated whole cell clamp analysis further indicated the presence of sustained outward currents for which amplitude was dependent on the amount of Na(+) influx. Taken together, these results indicate that KNa channels could be activated by Na(+) influx passing through voltage-dependent persistent Na(+) channels. The functional significance of this coupling mechanism was discussed in relation to the membrane excitability of Kenyon cells and its possible role in the formation of long-term memory.

Nitric oxide augments single Ca(2+) channel currents via cGMP-dependent protein kinase in Kenyon cells isolated from the mushroom body of the cricket brain

Behavioral and pharmacological studies in insects have suggested that the nitric oxide (NO)/cyclic GMP (cGMP) signaling pathway is involved in the formation of long-term memory (LTM) associated with olfactory learning. However, the target molecules of NO and the downstream signaling pathway are still not known. In this study, we investigated the action of NO on single voltage-dependent Ca(2+) channels in the intrinsic neurons known as Kenyon cells within the mushroom body of the cricket brain, using the cell-attached configuration of the patch-clamp technique. Application of the NO donor S-nitrosoglutathione (GSNO) increased the open probability (NPO) of single Ca(2+) channel currents. This GSNO-induced increase was blocked by ODQ, a soluble guanylate cyclase (sGC) inhibitor, suggesting that the NO generated by GSNO acts via sGC to raise cGMP levels. The membrane-permeable cGMP analog 8-Bro-cGMP also increased the NPO of single Ca(2+) channel currents. Pretreatment of cells with KT5823, a protein kinase G blocker, abolished the excitatory effect of GSNO. These results suggest that NO augments the activity of single Ca(2+) channels via the cGMP/PKG signaling pathway. To gain insight into the physiological role of NO, we examined the effect of GSNO on action potentials of Kenyon cells under current-clamp conditions. Application of GSNO increased the frequency of action potentials elicited by depolarizing current injections, indicating that NO acts as a modulator resulting in a stimulatory signal in Kenyon cells. We discuss the increased Ca(2+) influx through these Ca(2+) channels via the NO/cGMP signaling cascade in relation to the formation of olfactory LTM.

Critical evidence for the prediction error theory in associative learning

In associative learning in mammals, it is widely accepted that the discrepancy, or error, between actual and predicted reward determines whether learning occurs. Complete evidence for the prediction error theory, however, has not been obtained in any learning systems: Prediction error theory stems from the finding of a blocking phenomenon, but blocking can also be accounted for by other theories, such as the attentional theory. We demonstrated blocking in classical conditioning in crickets and obtained evidence to reject the attentional theory. To obtain further evidence supporting the prediction error theory and rejecting alternative theories, we constructed a neural model to match the prediction error theory, by modifying our previous model of learning in crickets, and we tested a prediction from the model: the model predicts that pharmacological intervention of octopaminergic transmission during appetitive conditioning impairs learning but not formation of reward prediction itself, and it thus predicts no learning in subsequent training. We observed such an "auto-blocking", which could be accounted for by the prediction error theory but not by other competitive theories to account for blocking. This study unambiguously demonstrates validity of the prediction error theory in associative learning.

Toward elucidating diversity of neural mechanisms underlying insect learning

Insects are widely used as models to study neural mechanisms of learning and memory. Our recent studies on crickets, together with reports on other insect species, suggest that some fundamental differences exist in neural and molecular mechanisms of learning and memory among different species of insects, particularly between crickets and fruit flies. First, we suggested that in crickets octopamine (OA) and dopamine (DA) neurons convey reward and punishment signals, respectively, in associated learning. On the other hand, it has been reported that in fruit flies different sets of DA neurons convey reward or punishment signals. Secondly, we have suggested that in crickets OA and DA neurons participate in the retrieval of appetitive and aversive memories, respectively, while this is not the case in fruit flies. Thirdly, cyclic AMP signaling is critical for short-term memory formation in fruit flies, but not in crickets. Finally, nitric oxide-cyclic GMP signaling and calcium-calmodulin signaling are critical for long-term memory (LTM) formation in crickets, but such roles have not been reported in fruit flies. Not all of these differences can be ascribed to different experimental methods used in studies. We thus suggest that there are unexpected diversities in basic mechanisms of learning and memory among different insect species, especially between crickets and fruit flies. Studies on a larger number of insect species will help clarify the diversity of learning and memory mechanisms in relation to functional adaptation to the environment and evolutionary history.