Roles of Octopamine and Dopamine Neurons for Mediating Appetitive and Aversive Signals in Pavlovian Conditioning in Crickets

Tyramine-Mediated Hyperactivity Modulates the Dietary Habits in Helicoverpa armigera

Helicoverpa armigera exhibits extensive variability in feeding habits and food selection. Neuronal regulation of H. armigera feeding behavior is primarily influenced by biogenic amines such as Tyramine (TA) and Octopamine (OA). The molecular responses of H. armigera to dietary challenges in the presence of TA or OA have yet to be studied. This investigation dissects the impact of OA and TA on H. armigera feeding choices and behaviors under non-host nutritional stress. It has been observed that feeding behavior remains unaltered during the exogenous administration of OA and TA through an artificial diet (AD). Ingestion of higher OA or TA concentrations leads to increased mortality. OA and TA treatment in combination with host and non-host diets results in the induction of feeding and higher locomotion toward food, particularly in the case of TA treatment. Increased expression of markers, prominin-like, and tachykinin-related peptide receptor-like transcripts further assessed increased locomotion activity. Insects subjected to a non-host diet with TA treatment exhibited increased feeding and overexpression of the feeding indicator, the Neuropeptide F receptor, and the feeding regulator, Sulfakinin, compared with other conditions. Expression of sensation and biogenic amine synthesis genesis elevated in insects fed a non-host diet in combination with OA or TA. Metabolomics analysis revealed a decreased concentration of the feeding behavior elicitor, dopamine, in insects fed a non-host diet containing TA. This work highlights the complex interplay between biogenic amine functions during dietary stress and suggests the role of tyramine in feeding promotion under stressed conditions.

Lactobacillus melliventris promotes hive productivity and immune functionality in Bombus terrestris performance in the greenhouse

Bumblebees are important pollinators in agricultural ecosystems, but their abundance is declining globally. There is an urgent need to protect bumblebee health and their pollination services. Bumblebees possess specialized gut microbiota with potential to be used as probiotics to help defend at-risk bumblebee populations. However, evidence for probiotic benefits on bumblebees is lacking. Here, we evaluated how supplementation with Lactobacillus melliventris isolated from bumblebee gut affected the colony development of Bombus terrestris. This native strain colonized robustly and persisted long-term in bumblebees, leading to a significantly higher quality of offspring. Subsequently, the tyrosine pathway was upregulated in the brain and fat body, while the Wnt and mTOR pathways of the gut were downregulated. Notably, the field experiment in the greenhouse revealed the supplementation of L. melliventris led to a 2.5-fold increase in the bumblebee survival rate and a more than 10% increase in the number of flowers visited, indicating a better health condition and pollination ability in field conditions. Our study represents a first screening for the potential use of the native gut member, L. melliventris, as probiotic strains in hive supplement for bumblebee breeding, which may be a practical approach to improve immunity and hive health.

Distinct mechanisms of non-autonomous UPRER mediated by GABAergic, glutamatergic, and octopaminergic neurons

The capacity to deal with stress declines during the aging process, and preservation of cellular stress responses is critical to healthy aging. The unfolded protein response of the endoplasmic reticulum (UPRER) is one such conserved mechanism, which is critical for the maintenance of several major functions of the ER during stress, including protein folding and lipid metabolism. Hyperactivation of the UPRER by overexpression of the major transcription factor, xbp-1s, solely in neurons drives lifespan extension as neurons send a neurotransmitter-based signal to other tissue to activate UPRER in a non-autonomous fashion. Previous work identified serotonergic and dopaminergic neurons in this signaling paradigm. To further expand our understanding of the neural circuitry that underlies the non-autonomous signaling of ER stress, we activated UPRER solely in glutamatergic, octopaminergic, and GABAergic neurons in C. elegans and paired whole-body transcriptomic analysis with functional assays. We found that UPRER-induced signals from glutamatergic neurons increased expression of canonical protein homeostasis pathways and octopaminergic neurons promoted pathogen response pathways, while minor, but statistically significant changes were observed in lipid metabolism-related genes with GABAergic UPRER activation. These findings provide further evidence for the distinct role neuronal subtypes play in driving the diverse response to ER stress.

An octopamine-specific GRAB sensor reveals a monoamine relay circuitry that boosts aversive learning

Octopamine (OA), analogous to norepinephrine in vertebrates, is an essential monoamine neurotransmitter in invertebrates that plays a significant role in various biological functions, including olfactory associative learning. However, the spatial and temporal dynamics of OA in vivo remain poorly understood due to limitations associated with the currently available methods used to detect it. To overcome these limitations, we developed a genetically encoded GPCR  activation-based (GRAB) OA sensor called GRABOA1.0. This sensor is highly selective for OA and exhibits a robust and rapid increase in fluorescence in response to extracellular OA. Using GRABOA1.0, we monitored OA release in the Drosophila mushroom body (MB), the fly's learning center, and found that OA is released in response to both odor and shock stimuli in an aversive learning model. This OA release requires acetylcholine (ACh) released from Kenyon cells, signaling via nicotinic ACh receptors. Finally, we discovered that OA amplifies aversive learning behavior by augmenting dopamine-mediated punishment signals via Octβ1R in dopaminergic neurons, leading to alterations in synaptic plasticity within the MB. Thus, our new GRABOA1.0 sensor can be used to monitor OA release in real time under physiological conditions, providing valuable insights into the cellular and circuit mechanisms that underlie OA signaling.

An octopamine-specific GRAB sensor reveals a monoamine relay circuitry that boosts aversive learning

Octopamine (OA), analogous to norepinephrine in vertebrates, is an essential monoamine neurotransmitter in invertebrates that plays a significant role in various biological functions, including olfactory associative learning. However, the spatial and temporal dynamics of OA in vivo remain poorly understood due to limitations associated with the currently available methods used to detect it. To overcome these limitations, we developed a genetically encoded GPCR activation-based (GRAB) OA sensor called GRABOA1.0. This sensor is highly selective for OA and exhibits a robust and rapid increase in fluorescence in response to extracellular OA. Using GRABOA1.0, we monitored OA release in the Drosophila mushroom body (MB), the fly's learning center, and found that OA is released in response to both odor and shock stimuli in an aversive learning model. This OA release requires acetylcholine (ACh) released from Kenyon cells, signaling via nicotinic ACh receptors. Finally, we discovered that OA amplifies aversive learning behavior by augmenting dopamine-mediated punishment signals via Octβ1R in dopaminergic neurons, leading to alterations in synaptic plasticity within the MB. Thus, our new GRABOA1.0 sensor can be used to monitor OA release in real-time under physiological conditions, providing valuable insights into the cellular and circuit mechanisms that underlie OA signaling.

Minimal circuit motifs for second-order conditioning in the insect mushroom body

In well-established first-order conditioning experiments, the concurrence of a sensory cue with reinforcement forms an association, allowing the cue to predict future reinforcement. In the insect mushroom body, a brain region central to learning and memory, such associations are encoded in the synapses between its intrinsic and output neurons. This process is mediated by the activity of dopaminergic neurons that encode reinforcement signals. In second-order conditioning, a new sensory cue is paired with an already established one that presumably activates dopaminergic neurons due to its predictive power of the reinforcement. We explored minimal circuit motifs in the mushroom body for their ability to support second-order conditioning using mechanistic models. We found that dopaminergic neurons can either be activated directly by the mushroom body's intrinsic neurons or via feedback from the output neurons via several pathways. We demonstrated that the circuit motifs differ in their computational efficiency and robustness. Beyond previous research, we suggest an additional motif that relies on feedforward input of the mushroom body intrinsic neurons to dopaminergic neurons as a promising candidate for experimental evaluation. It differentiates well between trained and novel stimuli, demonstrating robust performance across a range of model parameters.

Characterization and Localization of Sol g 2.1 Protein from Solenopsis geminata Fire Ant Venom in the Central Nervous System of Injected Crickets (Acheta domestica)

Solenopsis geminata is recognized for containing the allergenic proteins Sol g 1, 2, 3, and 4 in its venom. Remarkably, Sol g 2.1 exhibits hydrophobic binding and has a high sequence identity (83.05%) with Sol i 2 from S. invicta. Notably, Sol g 2.1 acts as a mediator, causing paralysis in crickets. Given its structural resemblance and biological function, Sol g 2.1 may play a key role in transporting hydrophobic potent compounds, which induce paralysis by releasing the compounds through the insect's nervous system. To investigate this further, we constructed and characterized the recombinant Sol g 2.1 protein (rSol g 2.1), identified with LC-MS/MS. Circular dichroism spectroscopy was performed to reveal the structural features of the rSol g 2.1 protein. Furthermore, after treating crickets with S. geminata venom, immunofluorescence and immunoblotting results revealed that the Sol g 2.1 protein primarily localizes to the neuronal cell membrane of the brain and thoracic ganglia, with distribution areas related to octopaminergic neuron cell patterns. Based on protein-protein interaction predictions, we found that the Sol g 2.1 protein can interact with octopamine receptors (OctRs) in neuronal cell membranes, potentially mediating Sol g 2.1's localization within cricket central nervous systems. Here, we suggest that Sol g 2.1 may enhance paralysis in crickets by acting as carriers of active molecules and releasing them onto target cells through pH gradients. Future research should explore the binding properties of Sol g 2.1 with ligands, considering its potential as a transporter for active molecules targeting pest nervous systems, offering innovative pest control prospects.

Roles of octopamine neurons in the vertical lobe of the mushroom body for the execution of a conditioned response in cockroaches

Aminergic neurons mediate reward signals in mammals and insects. In crickets, we showed that blockade of synaptic transmission from octopamine neurons (OANs) impairs conditioning of an odor (conditioned stimulus, CS) with water or sucrose (unconditioned stimulus, US) and execution of a conditioned response (CR) to the CS. It has not yet been established, however, whether findings in crickets can be applied to other species of insects. In this study, we investigated the roles of OANs in conditioning of salivation, monitored by activities of salivary neurons, and in execution of the CR in cockroaches (Periplaneta americana). We showed that injection of epinastine (an OA receptor antagonist) into the head hemolymph impaired both conditioning and execution of the CR, in accordance with findings in crickets. Moreover, local injection of epinastine into the vertical lobes of the mushroom body (MB), the center for associative learning and control of the CR, impaired execution of the CR, whereas injection of epinastine into the calyces of the MB or the antennal lobes (primary olfactory centers) did not. We propose that OANs in the MB vertical lobes play critical roles in the execution of the CR in cockroaches. This is analogous to the fact that midbrain dopamine neurons govern execution of learned actions in mammals.

Modulation of aversive value coding in the vertebrate and invertebrate brain

Avoiding potentially dangerous situations is key for the survival of any organism. Throughout life, animals learn to avoid environments, stimuli or actions that can lead to bodily harm. While the neural bases for appetitive learning, evaluation and value-based decision-making have received much attention, recent studies have revealed more complex computations for aversive signals during learning and decision-making than previously thought. Furthermore, previous experience, internal state and systems level appetitive-aversive interactions seem crucial for learning specific aversive value signals and making appropriate choices. The emergence of novel methodologies (computation analysis coupled with large-scale neuronal recordings, neuronal manipulations at unprecedented resolution offered by genetics, viral strategies and connectomics) has helped to provide novel circuit-based models for aversive (and appetitive) valuation. In this review, we focus on recent vertebrate and invertebrate studies yielding strong evidence that aversive value information can be computed by a multitude of interacting brain regions, and that past experience can modulate future aversive learning and therefore influence value-based decisions.

Visual learning in tethered bees modifies flight orientation and is impaired by epinastine

Visual-orientation learning of a tethered flying bee was investigated using a flight simulator and a novel protocol in which orientation preference toward trained visual targets was assessed in tests performed before and after appetitive conditioning. Either a blue or a green rectangle (conditioned stimulus, CS) was associated with 30% sucrose solution (unconditioned stimulus, US), whereas the other rectangle was not paired with US. Bees were tested in a closed-looped flight simulator 5 min after ten pairings of the US and CS. Conditioned bees were preferentially oriented to the CS after such training. This increase in preference for CS was maintained for 24 h, indicating the presence of long-term memory. Because the total orienting time was not altered by conditioning, conditioning did not enhance orientation activity itself but increased the relative time for orientation to CS. When 0.4 or 4 mM epinastine (an antagonist of octopamine receptors) was injected into the bee's head 30 min prior to the experiment, both short- and long-term memory formation were significantly impaired, suggesting that octopamine, which is crucial for appetitive olfactory learning in insects, is also involved in visual orientation learning.

Genetic mechanisms modulating behaviour through plastic chemosensory responses in insects

The ability to transition between different behavioural stages is a widespread phenomenon across the animal kingdom. Such behavioural adaptations are often linked to changes in the sensitivity of those neurons that sense chemical cues associated with the respective behaviours. To identify the genetic mechanisms that regulate neuronal sensitivity, and by that behaviour, typically *omics approaches, such as RNA- and protein-sequencing, are applied to sensory organs of individuals displaying differences in behaviour. In this review, we discuss these genetic mechanisms and how they impact neuronal sensitivity, summarize the correlative and functional evidence for their role in regulating behaviour and discuss future directions. As such, this review can help interpret *omics data by providing a comprehensive list of already identified genes and mechanisms that impact behaviour through changes in neuronal sensitivity.

Regulation of Drosophila oviduct muscle contractility by octopamine

Octopamine is essential for egg-laying in Drosophila melanogaster, but the neuronal pathways and receptors by which it regulates visceral muscles in the reproductive tract are not known. We find that the two octopamine receptors that have been previously implicated in egg-laying–OAMB and Octβ2R-are expressed in octopaminergic and glutamatergic neurons that project to the reproductive tract, peripheral ppk(+) neurons within the reproductive tract and epithelial cells that line the lumen of the oviducts. Further optogenetic and mutational analyses indicate that octopamine regulates both oviduct contraction and relaxation via Octβ2 and OAMB respectively. Interactions with glutamatergic pathways modify the effects of octopamine. Octopaminergic activation of Octβ2R on glutamatergic processes provides a possible mechanism by which octopamine initiates lateral oviduct contractions. We speculate that aminergic pathways in the oviposition circuit may be comparable to some of the mechanisms that regulate visceral muscle contractility in mammals.

•

The receptors Octβ2 and OAMB mediate oviduct muscle contraction and relaxation

•

The receptors are detectably expressed in neurons and epithelia but not muscle cells

•

The control of visceral muscles in flies and mammals may share common features

Conditioned taste aversion in the cricket Gryllus bimaculatus

Conditioned taste aversion (CTA) is a form of classical conditioning in which animals associate the taste of a food with illness caused by toxin contained in the food. CTA in mammals is achieved with a long interval of up to several hours between food ingestion and illness induced by LiCl injection. Insects also exhibit CTA, but not much is known about its features. We investigated whether the cricket Gryllus bimaculatus exhibits CTA when ingestion of a sugar solution is followed by LiCl injection. Crickets that ingested sucrose solution 5–10 min before LiCl injection exhibited reduction of sucrose consumption tested 24 or 48 h after injection compared to that tested 24 h before injection. In contrast, crickets that ingested sucrose solution 5–10 min after LiCl injection or 1 h or 8 h before or after injection did not exhibit reduction of sucrose consumption, indicating that reduction of sucrose consumption by CTA training is pairing-specific. We conclude that CTA in crickets is similar to that in mammals in that one-trial pairing is sufficient to achieve memory retention for days, but it differs in that it is achieved with a relatively short interval (< 1 h) between food ingestion and toxin injection.

Honey bees can store and retrieve independent memory traces after complex experiences that combine appetitive and aversive associations

Real-world experiences do often mix appetitive and aversive events. Understanding the ability of animals to extract, store and use this information is an important issue in neurobiology. We used honey bees as model organism to study learning and memory after a differential conditioning that combines appetitive and aversive training trials. First of all, we describe an aversive conditioning paradigm that constitutes a clear opposite of the well known appetitive olfactory conditioning of the proboscis extension response. A neutral odour is presented paired with the bitter substance quinine. Aversive memory is evidenced later as an odour-specific impairment in appetitive conditioning. Then we tested the effect of mixing appetitive and aversive conditioning trials distributed along the same training session. Differential conditioning protocols like this were used before to study the ability to discriminate odours, however they were not focused on whether appetitive and aversive memories are formed. We found that after a differential conditioning, honey bees establish independent appetitive and aversive memories that do not interfere with each other during acquisition or storage. Finally, we moved the question forward to retrieval and memory expression to evaluate what happens when appetitive and the aversive learned odours are mixed during test. Interestingly, opposite memories compete in a way that they do not cancel each other out. Honey bees showed the ability to switch from expressing appetitive to aversive memory depending on their satiation level.

PaOctβ2R: Identification and Functional Characterization of an Octopamine Receptor Activating Adenylyl Cyclase Activity in the American Cockroach Periplaneta americana

Biogenic amines constitute an important group of neuroactive substances that control and modulate various neural circuits. These small organic compounds engage members of the guanine nucleotide-binding protein coupled receptor (GPCR) superfamily to evoke specific cellular responses. In addition to dopamine- and 5-hydroxytryptamine (serotonin) receptors, arthropods express receptors that are activated exclusively by tyramine and octopamine. These phenolamines functionally substitute the noradrenergic system of vertebrates Octopamine receptors that are the focus of this study are classified as either α- or β-adrenergic-like. Knowledge on these receptors is scarce for the American cockroach (Periplaneta americana). So far, only an α–adrenergic-like octopamine receptor that primarily causes Ca²⁺ release from intracellular stores has been studied from the cockroach (PaOctα1R). Here we succeeded in cloning a gene from cockroach brain tissue that encodes a β-adrenergic-like receptor and leads to cAMP production upon activation. Notably, the receptor is 100-fold more selective for octopamine than for tyramine. A series of synthetic antagonists selectively block receptor activity with epinastine being the most potent. Bioinformatics allowed us to identify a total of 19 receptor sequences that build the framework of the biogenic amine receptor clade in the American cockroach. Phylogenetic analyses using these sequences and receptor sequences from model organisms showed that the newly cloned gene is an β2-adrenergic-like octopamine receptor. The functional characterization of PaOctβ2R and the bioinformatics data uncovered that the monoaminergic receptor family in the hemimetabolic P. americana is similarly complex as in holometabolic model insects like Drosophila melanogaster and the honeybee, Apis mellifera. Thus, investigating these receptors in detail may contribute to a better understanding of monoaminergic signaling in insect behavior and physiology.

Appetitive olfactory learning suffers in ants when octopamine or dopamine receptors are blocked

Associative learning relies on the detection of coincidence between a stimulus and a reward or punishment. In the insect brain, this process is carried out in the mushroom bodies under the control of octopaminergic and dopaminergic neurons. It was assumed that appetitive learning is governed by octopaminergic neurons, while dopamine is required for aversive learning. This view has recently been challenged: both neurotransmitters are involved in both types of learning in bees and flies. Here, we tested which neurotransmitters are required for appetitive learning in ants. We trained Lasius niger workers to discriminate two mixtures of linear hydrocarbons and to associate one of them with a sucrose reward. We analysed the walking paths of the ants using machine learning and found that the ants spent more time near the rewarded odour than near the other, a preference that was stable for at least 24 h. We then treated the ants before learning with either epinastine, an octopamine receptor blocker, or flupentixol, a dopamine receptor blocker. Ants with blocked octopamine receptors did not prefer the rewarded odour. Octopamine signalling is thus necessary for appetitive learning of olfactory cues, probably because it signals information about odours or reward to the mushroom body. In contrast, ants with blocked dopamine receptors initially learned the rewarded odour but failed to retrieve this memory 24 h later. Dopamine is thus probably required for long-term memory consolidation, independent of short-term memory formation. Our results show that appetitive olfactory learning depends on both octopamine and dopamine signalling in ants.

Dissections of Larval, Pupal and Adult Butterfly Brains for Immunostaining and Molecular Analysis

Butterflies possess impressive cognitive abilities, and investigations into the neural mechanisms underlying these abilities are increasingly being conducted. Exploring butterfly neurobiology may require the isolation of larval, pupal, and/or adult brains for further molecular and histological experiments. This procedure has been largely described in the fruit fly, but a detailed description of butterfly brain dissections is still lacking. Here, we provide a detailed written and video protocol for the removal of Bicyclus anynana adult, pupal, and larval brains. This species is gradually becoming a popular model because it uses a large set of sensory modalities, displays plastic and hormonally controlled courtship behaviour, and learns visual mate preference and olfactory preferences that can be passed on to its offspring. The extracted brain can be used for downstream analyses, such as immunostaining, DNA or RNA extraction, and the procedure can be easily adapted to other lepidopteran species and life stages.

What Is Learned in Pavlovian Conditioning in Crickets? Revisiting the S-S and S-R Learning Theories

In Pavlovian conditioning in mammals, two theories have been proposed for associations underlying conditioned responses (CRs). One theory, called S-S theory, assumes an association between a conditioned stimulus (CS) and internal representation of an unconditioned stimulus (US), allowing the animal to adjust the CR depending on the current value of the US. The other theory, called S-R theory, assumes an association or connection between the CS center and the CR center, allowing the CS to elicit the CR. Whether these theories account for Pavlovian conditioning in invertebrates has remained unclear. In this article, results of our studies in the cricket Gryllus bimaculatus are reviewed. We showed that after a standard amount of Pavlovian training, crickets exhibited no response to odor CS when water US was devalued by providing it until satiation, whereas after extended training, they exhibited a CR after US devaluation. An increase of behavioral automaticity by extended training has not been reported in Pavlovian conditioning in any other animals, but it has been documented in instrumental conditioning in mammals. Our pharmacological analysis suggested that octopamine neurons mediate US (water) value signals and control execution of the CR after standard training. The control, however, diminishes with extension of training and hence the CR becomes insensitive to the US value. We also found that the nature of the habitual response after extended Pavlovian training in crickets is not the same as that after extended instrumental training in mammals concerning the context specificity. Adaptive significance and evolutionary implications for our findings are discussed.

Drosophila reward system - A summary of current knowledge

The fruit fly Drosophila melanogaster brain is the most extensively investigated model of a reward system in insects. Drosophila can discriminate between rewarding and punishing environmental stimuli and consequently undergo associative learning. Functional models, especially those modelling mushroom bodies, are constantly being developed using newly discovered information, adding to the complexity of creating a simple model of the reward system. This review aims to clarify whether its reward system also includes a hedonic component. Neurochemical systems that mediate the 'wanting' component of reward in the Drosophila brain are well documented, however, the systems that mediate the pleasure component of reward in mammals, including those involving the endogenous opioid and endocannabinoid systems, are unlikely to be present in insects. The mushroom body components exhibit differential developmental age and different functional processes. We propose a hypothetical hierarchy of the levels of reinforcement processing in response to particular stimuli, and the parallel processes that take place concurrently. The possible presence of activity-silencing and meta-satiety inducing levels in Drosophila should be further investigated.

Reduction of contextual control of conditioned responses by extended Pavlovian training in an insect

The effect of repetitive training on learned behavior has been an important subject in neuroscience. In instrumental conditioning in mammals, learned action early in training is often goal-driven and controlled by outcome expectancy, but as training progresses, it becomes more habitual and insensitive to outcome devaluation. Similarly, we recently showed in Pavlovian conditioning in crickets (Gryllus bimaculatus) that a conditioned response (CR) is initially sensitive to devaluation of the unconditioned stimulus but becomes insensitive to it after extended training. It is known that habitual responses after extended instrumental training are characterized by a higher context specificity than are initial goal-directed actions in mammals. In this study, we investigated whether this is applicable to Pavlovian conditioning in crickets. In crickets that received a standard amount of training to associate an odor with water reward under illumination, CR under illumination was stronger than that in the dark. In crickets that received extended training under illumination, on the other hand, the level of CR did not differ in different light conditions. Further experiments confirmed that context specificity decreases with the development of behavioral automaticity by extended training, as opposed to findings in instrumental training in mammals. We conclude that the nature of habitual behaviors after extended training differs in different learning systems of animals.

Concerted Actions of Octopamine and Dopamine Receptors Drive Olfactory Learning

Aminergic signaling modulates associative learning and memory. Substantial advance has been made in Drosophila on the dopamine receptors and circuits mediating olfactory learning; however, our knowledge of other aminergic modulation lags behind. To address this knowledge gap, we investigated the role of octopamine in olfactory conditioning. Here, we report that octopamine activity through the β-adrenergic-like receptor Octβ1R drives aversive and appetitive learning: Octβ1R in the mushroom body αβ neurons processes aversive learning, whereas Octβ1R in the projection neurons mediates appetitive learning. Our genetic interaction and imaging studies pinpoint cAMP signaling as a key downstream effector for Octβ1R function. The rutabaga-adenylyl cyclase synthesizes cAMP in a Ca²⁺/calmodulin-dependent manner, serving as a coincidence detector for associative learning and likely representing a downstream target for Octβ1R. Supporting this notion, the double heterozygous rutabaga/+;octβ1r/+ flies perform poorly in both aversive and appetitive conditioning, while individual heterozygous rutabaga/+ and octβ1r/+ flies behave like the wild-type control. Consistently, the mushroom body and projection neurons in the octβ1r brain exhibit blunted responses to octopamine when cAMP levels are monitored through the cAMP sensor. We previously demonstrated the pivotal functions of the D₁ receptor dDA1 in aversive and appetitive learning, and the α1 adrenergic-like receptor OAMB in appetitive learning. As expected, octβ1r genetically interacts with dumb (dDA1 mutant) in aversive and appetitive learning, but it interacts with oamb only in appetitive learning. This study uncovers the indispensable contributions of dopamine and octopamine signaling to aversive and appetitive learning. All experiments were performed on mixed sex unless otherwise noted.SIGNIFICANCE STATEMENT Animals make flexible behavioral choices that are constantly shaped by experience. This plasticity is vital for animals to appropriately respond to the cues predicting benefit or harm. In Drosophila, dopamine is known to mediate both reward-based and punishment-based learning while octopamine function is important only for reward. Here, we demonstrate that the octopamine-Octβ1R-cAMP pathway processes both aversive and appetitive learning in distinct neural sites of the olfactory circuit. Furthermore, we show that the octopamine-Octβ1R and dopamine-dDA1 signals together drive both aversive and appetitive learning, whereas the octopamine-Octβ1R and octopamine-OAMB pathways jointly facilitate appetitive, but not aversive, learning. This study identifies the cognate actions of octopamine and dopamine signaling as a key neural mechanism for associative learning.

Green model to adapt classical conditioning learning in the hippocampus

Compared with the biological paradigms of classical conditioning, non-adaptive computational models are not capable of realistically simulating the biological behavioural functions of the hippocampal regions, because of their implausible requirement for a large number of learning trials, which can be on the order of hundreds. Additionally, these models did not attain a unified, final stable state even after hundreds of learning trials. Conversely, the output response has a different threshold for similar tasks in various models with prolonged transient response of unspecified status via the training or even testing phases. Accordingly, a green model is a combination of adaptive neuro-computational hippocampal and cortical models that is proposed by adaptively updating the whole weights in all layers for both intact networks and lesion networks using instar and outstar learning rules with adaptive resonance theory (ART). The green model sustains and expands the classical conditioning biological paradigms of the non-adaptive models. The model also overcomes the irregular output response behaviour by using the proposed feature of adaptivity. Further, the model successfully simulates the hippocampal regions without passing the final output response back to the whole network, which is considered to be biologically implausible. The results of the Green model showed a significant improvement confirmed by empirical studies of different tasks. In addition, the results indicated that the model outperforms the previously published models. All the obtained results successfully and quickly attained a stable, desired final state (with a unified concluding state of either "1" or "0") with a significantly shorter transient duration.

Development of behavioural automaticity by extended Pavlovian training in an insect

The effect of repetitive training on learned actions has been a major subject in behavioural neuroscience. Many studies of instrumental conditioning in mammals, including humans, suggested that learned actions early in training are goal-driven and controlled by outcome expectancy, but they become more automatic and insensitive to reduction in the value of the outcome after extended training. It was unknown, however, whether the development of value-insensitive behaviour also occurs by extended training of Pavlovian conditioning in any animals. Here we show that crickets Gryllus bimaculatus that had received minimal training to associate an odour with water (unconditioned stimulus, US) did not exhibit conditioned response (CR) to the odour when they were given water until satiation before the test, but those that had received extended training exhibited CR even when they were satiated with water. Further pharmacological experiments suggested that octopamine neurons, the invertebrate counterparts of noradrenaline neurons, mediate US value signals and control execution of CR after minimal training, but the control diminishes with the progress of training and hence the CR becomes insensitive to US devaluation. The results suggest that repetitive sensory experiences can lead to a change from a goal-driven response to a more automatic one in crickets.

The Cricket Gryllus bimaculatus: Techniques for Quantitative and Functional Genetic Analyses of Cricket Biology

All extant species are an outcome of nature's "experiments" during evolution, and hence multiple species need to be studied and compared to gain a thorough understanding of evolutionary processes. The field of evolutionary developmental biology (evo-devo) aspires to expand the number of species studied, because most functional genetic studies in animals have been limited to a small number of "traditional" model organisms, many of which belong to the same phylum (Chordata). The phylum Arthropoda, and particularly its component class Insecta, possesses many important characteristics that are considered favorable and attractive for evo-devo research, including an astonishing diversity of extant species and a wide disparity in body plans. The development of the most thoroughly investigated insect genetic model system to date, the fruit fly Drosophila melanogaster (a holometabolous insect), appears highly derived with respect to other insects and indeed with respect to most arthropods. In comparison, crickets (a basally branching hemimetabolous insect lineage compared to the Holometabola) are thought to embody many developmental features that make them more representative of insects. Here we focus on crickets as emerging models to study problems in a wide range of biological areas and summarize the currently available molecular, genomic, forward and reverse genetic, imaging and computational tool kit that has been established or adapted for cricket research. With an emphasis on the cricket species Gryllus bimaculatus, we highlight recent efforts made by the scientific community in establishing this species as a laboratory model for cellular biology and developmental genetics. This broad toolkit has the potential to accelerate many traditional areas of cricket research, including studies of adaptation, evolution, neuroethology, physiology, endocrinology, regeneration, and reproductive behavior. It may also help to establish newer areas, for example, the use of crickets as animal infection model systems and human food sources.

A population of descending tyraminergic/octopaminergic projection neurons of the insect deutocerebrum

In this study, we describe a cluster of tyraminergic/octopaminergic neurons in the lateral dorsal deutocerebrum of desert locusts (Schistocerca gregaria) with descending axons to the abdominal ganglia. In the locust, these neurons synthesize octopamine from tyramine stress-dependently. Electrophysiological recordings in locusts reveal that they respond to mechanosensory touch stimuli delivered to various parts of the body including the antennae. A similar cluster of tyraminergic/octopaminergic neurons was also identified in the American cockroach (Periplaneta americana) and the pink winged stick insect (Sipyloidea sipylus). It is suggested that these neurons release octopamine in the ventral nerve cord ganglia and, most likely, convey information on arousal and/or stressful stimuli to neuronal circuits thus contributing to the many actions of octopamine in the central nervous system.

A comprehensive anatomical map of the peripheral octopaminergic/tyraminergic system of Drosophila melanogaster

The modulation of an animal’s behavior through external sensory stimuli, previous experience and its internal state is crucial to survive in a constantly changing environment. In most insects, octopamine (OA) and its precursor tyramine (TA) modulate a variety of physiological processes and behaviors by shifting the organism from a relaxed or dormant condition to a responsive, excited and alerted state. Even though OA/TA neurons of the central brain are described on single cell level in Drosophila melanogaster, the periphery was largely omitted from anatomical studies. Given that OA/TA is involved in behaviors like feeding, flying and locomotion, which highly depend on a variety of peripheral organs, it is necessary to study the peripheral connections of these neurons to get a complete picture of the OA/TA circuitry. We here describe the anatomy of this aminergic system in relation to peripheral tissues of the entire fly. OA/TA neurons arborize onto skeletal muscles all over the body and innervate reproductive organs, the heart, the corpora allata, and sensory organs in the antennae, legs, wings and halteres underlining their relevance in modulating complex behaviors.

Honey bee neurogenomic responses to affiliative and agonistic social interactions

Social interactions can be divided into two categories, affiliative and agonistic. How neurogenomic responses reflect these opposing valences is a central question in the biological embedding of experience. To address this question, we exposed honey bees to a queen larva, which evokes nursing, an affiliative alloparenting interaction, and measured the transcriptomic response of the mushroom body brain region at different times after exposure. Hundreds of genes were differentially expressed at distinct time points, revealing a dynamic temporal patterning of the response. Comparing these results to our previously published research on agonistic aggressive interactions, we found both shared and unique transcriptomic responses to each interaction. The commonly responding gene set was enriched for nuclear receptor signaling, the set specific to nursing was enriched for olfaction and neuron differentiation, and the set enriched for aggression was enriched for cytoskeleton, metabolism, and chromosome organization. Whole brain histone profiling after the affiliative interaction revealed few changes in chromatin accessibility, suggesting that the transcriptomic changes derive from already accessible areas of the genome. Although only one stimulus of each type was studied, we suggest that elements of the observed transcriptomic responses reflect molecular encoding of stimulus valence, thus priming individuals for future encounters. This hypothesis is supported by behavioral analyses showing that bees responding to either the affiliative or agonistic stimulus exhibited a higher probability of repeating the same behavior but a lower probability of performing the opposite behavior. These findings add to our understanding of the biological embedding at the molecular level.

Application of a Prediction Error Theory to Pavlovian Conditioning in an Insect

Elucidation of the conditions in which associative learning occurs is a critical issue in neuroscience and comparative psychology. In Pavlovian conditioning in mammals, it is thought that the discrepancy, or error, between the actual reward and the predicted reward determines whether learning occurs. This theory stems from the finding of Kamin’s blocking effect, in which after pairing of a stimulus with an unconditioned stimulus (US), conditioning of a second stimulus is blocked when the two stimuli are presented in compound and paired with the same US. Whether this theory is applicable to any species of invertebrates, however, has remained unknown. We first showed blocking and one-trial blocking of Pavlovian conditioning in the cricket Gryllus bimaculatus, which supported the Rescorla–Wagner model but not attentional theories, the major competitive error-correction learning theories to account for blocking. To match the prediction error theory, a neural circuit model was proposed, and prediction from the model was tested: the results were consistent with the Rescorla–Wagner model but not with the retrieval theory, another competitive theory to account for blocking. The findings suggest that the Rescorla–Wagner model best accounts for Pavlovian conditioning in crickets and that the basic computation rule underlying Pavlovian conditioning in crickets is the same to those suggested in mammals. Moreover, results of pharmacological studies in crickets suggested that octopamine and dopamine mediate prediction error signals in appetitive and aversive conditioning, respectively. This was in contrast to the notion that dopamine mediates appetitive prediction error signals in mammals. The functional significance and evolutionary implications of these findings are discussed.

Selection for associative learning of color stimuli reveals correlated evolution of this learning ability across multiple stimuli and rewards

We are only starting to understand how variation in cognitive ability can result from local adaptations to environmental conditions. A major question in this regard is to what extent selection on cognitive ability in a specific context affects that ability in general through correlated evolution. To address this question, we performed artificial selection on visual associative learning in female Nasonia vitripennis wasps. Using appetitive conditioning in which a visual stimulus was offered in association with a host reward, the ability to learn visual associations was enhanced within 10 generations of selection. To test for correlated evolution affecting this form of learning, the ability to readily form learned associations in females was also tested using an olfactory instead of a visual stimulus in the appetitive conditioning. Additionally, we assessed whether the improved associative learning ability was expressed across sexes by color-conditioning males with a mating reward. Both females and males from the selected lines consistently demonstrated an increased associative learning ability compared to the control lines, independent of learning context or conditioned stimulus. No difference in relative volume of brain neuropils was detected between the selected and control lines.