Computational models to understand decision making and pattern recognition in the insect brain

The Neural Correlations of Olfactory Associative Reward Memories in Drosophila

Advancing treatment to resolve human cognitive disorders requires a comprehensive understanding of the molecular signaling pathways underlying learning and memory. While most organ systems evolved to maintain homeostasis, the brain developed the capacity to perceive and adapt to environmental stimuli through the continuous modification of interactions within a gene network functioning within a broader neural network. This distinctive characteristic enables significant neural plasticity, but complicates experimental investigations. A thorough examination of the mechanisms underlying behavioral plasticity must integrate multiple levels of biological organization, encompassing genetic pathways within individual neurons, interactions among neural networks providing feedback on gene expression, and observable phenotypic behaviors. Model organisms, such as Drosophila melanogaster, which possess more simple and manipulable nervous systems and genomes than mammals, facilitate such investigations. The evolutionary conservation of behavioral phenotypes and the associated genetics and neural systems indicates that insights gained from flies are pertinent to understanding human cognition. Rather than providing a comprehensive review of the entire field of Drosophila memory research, we focus on olfactory associative reward memories and their related neural circuitry in fly brains, with the objective of elucidating the underlying neural mechanisms, thereby advancing our understanding of brain mechanisms linked to cognitive systems.

Visual processing and collective motion-related decision-making in desert locusts

Collectively moving groups of animals rely on the decision-making of locally interacting individuals in order to maintain swarm cohesion. However, the complex and noisy visual environment poses a major challenge to the extraction and processing of relevant information. We addressed this challenge by studying swarming-related decision-making in desert locust last-instar nymphs. Controlled visual stimuli, in the form of random dot kinematograms, were presented to tethered locust nymphs in a trackball set-up, while monitoring movement trajectory and walking parameters. In a complementary set of experiments, the neurophysiological basis of the observed behavioural responses was explored. Our results suggest that locusts use filtering and discrimination upon encountering multiple stimuli simultaneously. Specifically, we show that locusts are sensitive to differences in speed at the individual conspecific level, and to movement coherence at the group level, and may use these to filter out non-relevant stimuli. The locusts also discriminate and assign different weights to different stimuli, with an observed interactive effect of stimulus size, relative abundance and motion direction. Our findings provide insights into the cognitive abilities of locusts in the domain of decision-making and visual-based collective motion, and support locusts as a model for investigating sensory-motor integration and motion-related decision-making in the intricate swarm environment.

Drug effect and addiction research with insects - From Drosophila to collective reward in honeybees

Animals and humans share similar reactions to the effects of addictive substances, including those of their brain networks to drugs. Our review focuses on simple invertebrate models, particularly the honeybee (Apis mellifera), and on the effects of drugs on bee behaviour and brain functions. The drug effects in bees are very similar to those described in humans. Furthermore, the honeybee community is a superorganism in which many collective functions outperform the simple sum of individual functions. The distribution of reward functions in this superorganism is unique - although sublimated at the individual level, community reward functions are of higher quality. This phenomenon of collective reward may be extrapolated to other animal species living in close and strictly organised societies, i.e. humans. The relationship between sociality and reward, based on use of similar parts of the neural network (social decision-making network in mammals, mushroom body in bees), suggests a functional continuum of reward and sociality in animals.

Drosophila reward system - A summary of current knowledge

The fruit fly Drosophila melanogaster brain is the most extensively investigated model of a reward system in insects. Drosophila can discriminate between rewarding and punishing environmental stimuli and consequently undergo associative learning. Functional models, especially those modelling mushroom bodies, are constantly being developed using newly discovered information, adding to the complexity of creating a simple model of the reward system. This review aims to clarify whether its reward system also includes a hedonic component. Neurochemical systems that mediate the 'wanting' component of reward in the Drosophila brain are well documented, however, the systems that mediate the pleasure component of reward in mammals, including those involving the endogenous opioid and endocannabinoid systems, are unlikely to be present in insects. The mushroom body components exhibit differential developmental age and different functional processes. We propose a hypothetical hierarchy of the levels of reinforcement processing in response to particular stimuli, and the parallel processes that take place concurrently. The possible presence of activity-silencing and meta-satiety inducing levels in Drosophila should be further investigated.

Circuit and Cellular Mechanisms Facilitate the Transformation from Dense to Sparse Coding in the Insect Olfactory System

Transformations between sensory representations are shaped by neural mechanisms at the cellular and the circuit level. In the insect olfactory system, the encoding of odor information undergoes a transition from a dense spatiotemporal population code in the antennal lobe to a sparse code in the mushroom body. However, the exact mechanisms shaping odor representations and their role in sensory processing are incompletely identified. Here, we investigate the transformation from dense to sparse odor representations in a spiking model of the insect olfactory system, focusing on two ubiquitous neural mechanisms: spike frequency adaptation at the cellular level and lateral inhibition at the circuit level. We find that cellular adaptation is essential for sparse representations in time (temporal sparseness), while lateral inhibition regulates sparseness in the neuronal space (population sparseness). The interplay of both mechanisms shapes spatiotemporal odor representations, which are optimized for the discrimination of odors during stimulus onset and offset. Response pattern correlation across different stimuli showed a nonmonotonic dependence on the strength of lateral inhibition with an optimum at intermediate levels, which is explained by two counteracting mechanisms. In addition, we find that odor identity is stored on a prolonged timescale in the adaptation levels but not in the spiking activity of the principal cells of the mushroom body, providing a testable hypothesis for the location of the so-called odor trace.

Biological Mechanisms for Learning: A Computational Model of Olfactory Learning in the Manduca sexta Moth, With Applications to Neural Nets

The insect olfactory system, which includes the antennal lobe (AL), mushroom body (MB), and ancillary structures, is a relatively simple neural system capable of learning. Its structural features, which are widespread in biological neural systems, process olfactory stimuli through a cascade of networks where large dimension shifts occur from stage to stage and where sparsity and randomness play a critical role in coding. Learning is partly enabled by a neuromodulatory reward mechanism of octopamine stimulation of the AL, whose increased activity induces synaptic weight updates in the MB through Hebbian plasticity. Enforced sparsity in the MB focuses Hebbian growth on neurons that are the most important for the representation of the learned odor. Based upon current biophysical knowledge, we have constructed an end-to-end computational firing-rate model of the Manduca sexta moth olfactory system which includes the interaction of the AL and MB under octopamine stimulation. Our model is able to robustly learn new odors, and neural firing rates in our simulations match the statistical features of in vivo firing rate data. From a biological perspective, the model provides a valuable tool for examining the role of neuromodulators, like octopamine, in learning, and gives insight into critical interactions between sparsity, Hebbian growth, and stimulation during learning. Our simulations also inform predictions about structural details of the olfactory system that are not currently well-characterized. From a machine learning perspective, the model yields bio-inspired mechanisms that are potentially useful in constructing neural nets for rapid learning from very few samples. These mechanisms include high-noise layers, sparse layers as noise filters, and a biologically-plausible optimization method to train the network based on octopamine stimulation, sparse layers, and Hebbian growth.

Circuit variability interacts with excitatory-inhibitory diversity of interneurons to regulate network encoding capacity

Local interneurons (LNs) in the Drosophila olfactory system exhibit neuronal diversity and variability, yet it is still unknown how these features impact information encoding capacity and reliability in a complex LN network. We employed two strategies to construct a diverse excitatory-inhibitory neural network beginning with a ring network structure and then introduced distinct types of inhibitory interneurons and circuit variability to the simulated network. The continuity of activity within the node ensemble (oscillation pattern) was used as a readout to describe the temporal dynamics of network activity. We found that inhibitory interneurons enhance the encoding capacity by protecting the network from extremely short activation periods when the network wiring complexity is very high. In addition, distinct types of interneurons have differential effects on encoding capacity and reliability. Circuit variability may enhance the encoding reliability, with or without compromising encoding capacity. Therefore, we have described how circuit variability of interneurons may interact with excitatory-inhibitory diversity to enhance the encoding capacity and distinguishability of neural networks. In this work, we evaluate the effects of different types and degrees of connection diversity on a ring model, which may simulate interneuron networks in the Drosophila olfactory system or other biological systems.

Parameter Estimation of Nonlinear Systems by Dynamic Cuckoo Search

In order to address with the problem of the traditional or improved cuckoo search (CS) algorithm, we propose a dynamic adaptive cuckoo search with crossover operator (DACS-CO) algorithm. Normally, the parameters of the CS algorithm are kept constant or adapted by empirical equation that may result in decreasing the efficiency of the algorithm. In order to solve the problem, a feedback control scheme of algorithm parameters is adopted in cuckoo search; Rechenberg's 1/5 criterion, combined with a learning strategy, is used to evaluate the evolution process. In addition, there are no information exchanges between individuals for cuckoo search algorithm. To promote the search progress and overcome premature convergence, the multiple-point random crossover operator is merged into the CS algorithm to exchange information between individuals and improve the diversification and intensification of the population. The performance of the proposed hybrid algorithm is investigated through different nonlinear systems, with the numerical results demonstrating that the method can estimate parameters accurately and efficiently. Finally, we compare the results with the standard CS algorithm, orthogonal learning cuckoo search algorithm (OLCS), an adaptive and simulated annealing operation with the cuckoo search algorithm (ACS-SA), a genetic algorithm (GA), a particle swarm optimization algorithm (PSO), and a genetic simulated annealing algorithm (GA-SA). Our simulation results demonstrate the effectiveness and superior performance of the proposed algorithm.

A Fly-Inspired Mushroom Bodies Model for Sensory-Motor Control Through Sequence and Subsequence Learning

Classification and sequence learning are relevant capabilities used by living beings to extract complex information from the environment for behavioral control. The insect world is full of examples where the presentation time of specific stimuli shapes the behavioral response. On the basis of previously developed neural models, inspired by Drosophila melanogaster, a new architecture for classification and sequence learning is here presented under the perspective of the Neural Reuse theory. Classification of relevant input stimuli is performed through resonant neurons, activated by the complex dynamics generated in a lattice of recurrent spiking neurons modeling the insect Mushroom Bodies neuropile. The network devoted to context formation is able to reconstruct the learned sequence and also to trace the subsequences present in the provided input. A sensitivity analysis to parameter variation and noise is reported. Experiments on a roving robot are reported to show the capabilities of the architecture used as a neural controller.