A neural algorithm for Drosophila linear and nonlinear decision-making

Adaptive structure evolution and biologically plausible synaptic plasticity for recurrent spiking neural networks

The architecture design and multi-scale learning principles of the human brain that evolved over hundreds of millions of years are crucial to realizing human-like intelligence. Spiking neural network based Liquid State Machine (LSM) serves as a suitable architecture to study brain-inspired intelligence because of its brain-inspired structure and the potential for integrating multiple biological principles. Existing researches on LSM focus on different certain perspectives, including high-dimensional encoding or optimization of the liquid layer, network architecture search, and application to hardware devices. There is still a lack of in-depth inspiration from the learning and structural evolution mechanism of the brain. Considering these limitations, this paper presents a novel LSM learning model that integrates adaptive structural evolution and multi-scale biological learning rules. For structural evolution, an adaptive evolvable LSM model is developed to optimize the neural architecture design of liquid layer with separation property. For brain-inspired learning of LSM, we propose a dopamine-modulated Bienenstock-Cooper-Munros (DA-BCM) method that incorporates global long-term dopamine regulation and local trace-based BCM synaptic plasticity. Comparative experimental results on different decision-making tasks show that introducing structural evolution of the liquid layer, and the DA-BCM regulation of the liquid layer and the readout layer could improve the decision-making ability of LSM and flexibly adapt to rule reversal. This work is committed to exploring how evolution can help to design more appropriate network architectures and how multi-scale neuroplasticity principles coordinated to enable the optimization and learning of LSMs for relatively complex decision-making tasks.

Brain-inspired neural circuit evolution for spiking neural networks

In biological neural systems, different neurons are capable of self-organizing to form different neural circuits for achieving a variety of cognitive functions. However, the current design paradigm of spiking neural networks is based on structures derived from deep learning. Such structures are dominated by feedforward connections without taking into account different types of neurons, which significantly prevent spiking neural networks from realizing their potential on complex tasks. It remains an open challenge to apply the rich dynamical properties of biological neural circuits to model the structure of current spiking neural networks. This paper provides a more biologically plausible evolutionary space by combining feedforward and feedback connections with excitatory and inhibitory neurons. We exploit the local spiking behavior of neurons to adaptively evolve neural circuits such as forward excitation, forward inhibition, feedback inhibition, and lateral inhibition by the local law of spike-timing-dependent plasticity and update the synaptic weights in combination with the global error signals. By using the evolved neural circuits, we construct spiking neural networks for image classification and reinforcement learning tasks. Using the brain-inspired Neural circuit Evolution strategy (NeuEvo) with rich neural circuit types, the evolved spiking neural network greatly enhances capability on perception and reinforcement learning tasks. NeuEvo achieves state-of-the-art performance on CIFAR10, DVS-CIFAR10, DVS-Gesture, and N-Caltech101 datasets and achieves advanced performance on ImageNet. Combined with on-policy and off-policy deep reinforcement learning algorithms, it achieves comparable performance with artificial neural networks. The evolved spiking neural circuits lay the foundation for the evolution of complex networks with functions.

A brain-inspired theory of mind spiking neural network improves multi-agent cooperation and competition

During dynamic social interaction, inferring and predicting others' behaviors through theory of mind (ToM) is crucial for obtaining benefits in cooperative and competitive tasks. Current multi-agent reinforcement learning (MARL) methods primarily rely on agent observations to select behaviors, but they lack inspiration from ToM, which limits performance. In this article, we propose a multi-agent ToM decision-making (MAToM-DM) model, which consists of a MAToM spiking neural network (MAToM-SNN) module and a decision-making module. We design two brain-inspired ToM modules (Self-MAToM and Other-MAToM) to predict others' behaviors based on self-experience and observations of others, respectively. Each agent can adjust its behavior according to the predicted actions of others. The effectiveness of the proposed model has been demonstrated through experiments conducted in cooperative and competitive tasks. The results indicate that integrating the ToM mechanism can enhance cooperation and competition efficiency and lead to higher rewards compared with traditional MARL models.

BrainCog: A spiking neural network based, brain-inspired cognitive intelligence engine for brain-inspired AI and brain simulation

Spiking neural networks (SNNs) serve as a promising computational framework for integrating insights from the brain into artificial intelligence (AI). Existing software infrastructures based on SNNs exclusively support brain simulation or brain-inspired AI, but not both simultaneously. To decode the nature of biological intelligence and create AI, we present the brain-inspired cognitive intelligence engine (BrainCog). This SNN-based platform provides essential infrastructure support for developing brain-inspired AI and brain simulation. BrainCog integrates different biological neurons, encoding strategies, learning rules, brain areas, and hardware-software co-design as essential components. Leveraging these user-friendly components, BrainCog incorporates various cognitive functions, including perception and learning, decision-making, knowledge representation and reasoning, motor control, social cognition, and brain structure and function simulations across multiple scales. BORN is an AI engine developed by BrainCog, showcasing seamless integration of BrainCog's components and cognitive functions to build advanced AI models and applications.

Bio-inspired neural networks for decision-making mechanisms and neuromodulation for motor control in a differential robot

The aim of this work is to propose bio-inspired neural networks for decision-making mechanisms and modulation of motor control of an automaton. In this work, we have adapted and applied cortical synaptic circuits, such as short-term memory circuits, winner-take-all (WTA) class competitive neural networks, modulation neural networks, and nonlinear oscillation circuits, in order to make the automaton able to avoid obstacles and explore simulated and real environments. The performance achieved by using biologically inspired neural networks to solve the task at hand is similar to that of several works mentioned in the specialized literature. Furthermore, this work contributed to bridging the fields of computational neuroscience and robotics.

An incentive circuit for memory dynamics in the mushroom body of Drosophila melanogaster

Insects adapt their response to stimuli, such as odours, according to their pairing with positive or negative reinforcements, such as sugar or shock. Recent electrophysiological and imaging findings in Drosophila melanogaster allow detailed examination of the neural mechanisms supporting the acquisition, forgetting, and assimilation of memories. We propose that this data can be explained by the combination of a dopaminergic plasticity rule that supports a variety of synaptic strength change phenomena, and a circuit structure (derived from neuroanatomy) between dopaminergic and output neurons that creates different roles for specific neurons. Computational modelling shows that this circuit allows for rapid memory acquisition, transfer from short term to long term, and exploration/exploitation trade-off. The model can reproduce the observed changes in the activity of each of the identified neurons in conditioning paradigms and can be used for flexible behavioural control.

Drosophila females have an acoustic preference for symmetric males

Theoretically, symmetry in bilateral animals is subject to sexual selection, since it can serve as a proxy for genetic quality of competing mates during mate choice. Here, we report female preference for symmetric males in Drosophila, using a mate-choice paradigm where males with environmentally or genetically induced wing asymmetry were competed. Analysis of courtship songs revealed that males with asymmetric wings produced songs with asymmetric features that served as acoustic cues, facilitating this female preference. Females experimentally evolved in the absence of mate choice lost this preference for symmetry, suggesting that it is maintained by sexual selection.

In many species, including humans and Drosophila, symmetric individuals secure more matings, suggesting that bilateral symmetry signals the quality of potential mates and is subject to sexual selection. However, this idea remains controversial, largely because obtaining conclusive experimental evidence has been hindered by confounding effects arising from the methods used to increase asymmetry in test subjects. Here, we show that altering gravity during development increases asymmetry in Drosophila melanogaster without a detrimental effect on survival, growth, and behavior. Testing males with altered-gravity–induced asymmetry in female mate-choice assays revealed symmetry-based discrimination of males via auditory cues. Females similarly discriminated against males with genetically induced asymmetry, suggesting that their preference for symmetry is not specific to altered gravity. By segmenting the male courtship song into left and right wing-generated song-bouts, we detected asymmetry in the courtship song of altered-gravity males with asymmetric wings that experienced rejection. Females experimentally evolved in the absence of mate choice lacked this preference for symmetry, suggesting that symmetry is maintained by sexual selection. Our data provide evidence for the role of symmetry in sexual selection and reveal how nonvisual cues can flag mate asymmetry during courtship.