Habituation as a neural algorithm for online odor discrimination

Distributed algorithms from arboreal ants for the shortest path problem

Colonies of the arboreal turtle ant create networks of trails that link nests and food sources on the graph formed by branches and vines in the canopy of the tropical forest. Ants put down a volatile pheromone on the edges as they traverse them. At each vertex, the next edge to traverse is chosen using a decision rule based on the current pheromone level. There is a bidirectional flow of ants around the network. In a previous field study, it was observed that the trail networks approximately minimize the number of vertices, thus solving a variant of the popular shortest path problem without any central control and with minimal computational resources. We propose a biologically plausible model, based on a variant of the reinforced random walk on a graph, which explains this observation and suggests surprising algorithms for the shortest path problem and its variants. Through simulations and analysis, we show that when the rate of flow of ants does not change, the dynamics converges to the path with the minimum number of vertices, as observed in the field. The dynamics converges to the shortest path when the rate of flow increases with time, so the colony can solve the shortest path problem merely by increasing the flow rate. We also show that to guarantee convergence to the shortest path, bidirectional flow and a decision rule dividing the flow in proportion to the pheromone level are necessary, but convergence to approximately short paths is possible with other decision rules.

Improving Network Training on Resource-Constrained Devices via Habituation Normalization

As a technique for accelerating and stabilizing training, the batch normalization (BN) is widely used in deep learning. However, BN cannot effectively estimate the mean and the variance of samples when training/fine-tuning with small batches of data on resource-constrained devices. It will lead to a decrease in the accuracy of the deep learning model. In the fruit fly olfactory system, the algorithm based on the "negative image" habituation model can filter redundant information and improve numerical stability. Inspired by the circuit mechanism, we propose a novel normalization method, the habituation normalization (HN). HN first eliminates the "negative image" obtained by habituation and then calculates the statistics for normalizing. It solves the problem of accuracy degradation of BN when the batch size is small. The experiment results show that HN can speed up neural network training and improve the model accuracy on vanilla LeNet-5, VGG16, and ResNet-50 in the Fashion MNIST and CIFAR10 datasets. Compared with four standard normalization methods, HN keeps stable and high accuracy in different batch sizes, which shows that HN has strong robustness. Finally, the applying HN to the deep learning-based EEG signal application system indicates that HN is suitable for the network fine-tuning and neural network applications under limited computing power and memory.

Genetics, molecular control and clinical relevance of habituation learning

Habituation is the most fundamental form of learning. As a firewall that protects our brain from sensory overload, it is indispensable for cognitive processes. Studies in humans and animal models provide increasing evidence that habituation is affected in autism and related monogenic neurodevelopmental disorders (NDDs). An integrated application of habituation assessment in NDDs and their animal models has unexploited potential for neuroscience and medical care. With the aim to gain mechanistic insights, we systematically retrieved genes that have been demonstrated in the literature to underlie habituation. We identified 258 evolutionarily conserved genes across species, describe the biological processes they converge on, and highlight regulatory pathways and drugs that may alleviate habituation deficits. We also summarize current habituation paradigms and extract the most decisive arguments that support the crucial role of habituation for cognition in health and disease. We conclude that habituation is a conserved, quantitative, cognition- and disease-relevant process that can connect preclinical and clinical work, and hence is a powerful tool to advance research, diagnostics, and treatment of NDDs.