Asymmetry in neural fields: a spatiotemporal encoding mechanism

Neural and Synaptic Array Transceiver: A Brain-Inspired Computing Framework for Embedded Learning

Embedded, continual learning for autonomous and adaptive behavior is a key application of neuromorphic hardware. However, neuromorphic implementations of embedded learning at large scales that are both flexible and efficient have been hindered by a lack of a suitable algorithmic framework. As a result, most neuromorphic hardware are trained off-line on large clusters of dedicated processors or GPUs and transferred post hoc to the device. We address this by introducing the neural and synaptic array transceiver (NSAT), a neuromorphic computational framework facilitating flexible and efficient embedded learning by matching algorithmic requirements and neural and synaptic dynamics. NSAT supports event-driven supervised, unsupervised and reinforcement learning algorithms including deep learning. We demonstrate the NSAT in a wide range of tasks, including the simulation of Mihalas-Niebur neuron, dynamic neural fields, event-driven random back-propagation for event-based deep learning, event-based contrastive divergence for unsupervised learning, and voltage-based learning rules for sequence learning. We anticipate that this contribution will establish the foundation for a new generation of devices enabling adaptive mobile systems, wearable devices, and robots with data-driven autonomy.

Neurons and networks organizing and sequencing memories

Hippocampal CA1 and CA3 neurons sampled randomly in large numbers in primate brain show conclusive examples of hierarchical encoding of task specific information. Hierarchical encoding allows multi-task utilization of the same hippocampal neural networks via distributed firing between neurons that respond to subsets, attributes or "categories" of stimulus features which can be applied in events in different contexts. In addition, such networks are uniquely adaptable to neural systems unrestricted by rigid synaptic architecture (i.e. columns, layers or "patches") which physically limits the number of possible task-specific interactions between neurons. Also hierarchical encoding is not random; it requires multiple exposures to the same types of relevant events to elevate synaptic connectivity between neurons for different stimulus features that occur in different task-dependent contexts. The large number of cells within associated hierarchical circuits in structures such as hippocampus provides efficient processing of information relevant to common memory-dependent behavioral decisions within different contextual circumstances. This article is part of a Special Issue entitled SI: Brain and Memory.