Short-term plasticity as cause-effect hypothesis testing in distal reward learning

Continuous Stress Detection Based on Social Media

Leveraging social media for stress detection has been growing attention in recent years. Most relevant studies so far concentrated on training a stress detection model on the entire data in a closed environment, and did not continuously incorporate new information into the already established models but instead regularly reconstruct a new model from scratch. In this study, we formulate a social media based continuous stress detection task with two particular questions to be addressed: (1) when to adapt a learned stress detection model? and (2) how to adapt a learned stress detection model? We design a protocol to quantify the conditions that trigger model's adaptation, and develop a layer-inheritance based knowledge distillation method to continually adapt the learned stress detection model to incoming data, while retaining the knowledge gained previously. The experimental results on a constructed dataset containing 69 users on Tencent Weibo validate the effectiveness of the proposed adaptive layer-inheritance based knowledge distillation method, achieving 86.32% and 91.56% of accuracy in 3-label and 2-label continuous stress detection. Implications and further possible improvements are also discussed at the end of the article.

Born to learn: The inspiration, progress, and future of evolved plastic artificial neural networks

Biological neural networks are systems of extraordinary computational capabilities shaped by evolution, development, and lifelong learning. The interplay of these elements leads to the emergence of biological intelligence. Inspired by such intricate natural phenomena, Evolved Plastic Artificial Neural Networks (EPANNs) employ simulated evolution in-silico to breed plastic neural networks with the aim to autonomously design and create learning systems. EPANN experiments evolve networks that include both innate properties and the ability to change and learn in response to experiences in different environments and problem domains. EPANNs' aims include autonomously creating learning systems, bootstrapping learning from scratch, recovering performance in unseen conditions, testing the computational advantages of particular neural components, and deriving hypotheses on the emergence of biological learning. Thus, EPANNs may include a large variety of different neuron types and dynamics, network architectures, plasticity rules, and other factors. While EPANNs have seen considerable progress over the last two decades, current scientific and technological advances in artificial neural networks are setting the conditions for radically new approaches and results. Exploiting the increased availability of computational resources and of simulation environments, the often challenging task of hand-designing learning neural networks could be replaced by more autonomous and creative processes. This paper brings together a variety of inspiring ideas that define the field of EPANNs. The main methods and results are reviewed. Finally, new opportunities and possible developments are presented.