Theory of Connectivity: Nature and Nurture of Cell Assemblies and Cognitive Computation

Neural waves and computation in a neural net model II: Data-like structures and the dynamics of episodic memory

The computational resources of a neuromorphic network model introduced earlier were investigated in the first paper of this series. It was argued that a form of ubiquitous spontaneous local convolution enabled logical gate-like neural motifs to form into hierarchical feed-forward structures of the Hubel-Wiesel type. Here we investigate concomitant data-like structures and their dynamic rôle in memory formation, retrieval, and replay. The mechanisms give rise to the need for general inhibitory sculpting, and the simulation of the replay of episodic memories, well known in humans and recently observed in rats. Other consequences include explanations of such findings as the directional flows of neural waves in memory formation and retrieval, visual anomalies and memory deficits in schizophrenia, and the operation of GABA agonist drugs in suppressing episodic memories. We put forward the hypothesis that all neural logical operations and feature extractions are of the convolutional hierarchical type described here and in the earlier paper, and exemplified by the Hubel-Wiesel model of the visual cortex, but that in more general cases the precise geometric layering might be obscured and so far undetected.

Translational neuronal ensembles: Neuronal microcircuits in psychology, physiology, pharmacology and pathology

Multi-recording techniques show evidence that neurons coordinate their firing forming ensembles and that brain networks are made by connections between ensembles. While “canonical” microcircuits are composed of interconnected principal neurons and interneurons, it is not clear how they participate in recorded neuronal ensembles: “groups of neurons that show spatiotemporal co-activation”. Understanding synapses and their plasticity has become complex, making hard to consider all details to fill the gap between cellular-synaptic and circuit levels. Therefore, two assumptions became necessary: First, whatever the nature of the synapses these may be simplified by “functional connections”. Second, whatever the mechanisms to achieve synaptic potentiation or depression, the resultant synaptic weights are relatively stable. Both assumptions have experimental basis cited in this review, and tools to analyze neuronal populations are being developed based on them. Microcircuitry processing followed with multi-recording techniques show temporal sequences of neuronal ensembles resembling computational routines. These sequences can be aligned with the steps of behavioral tasks and behavior can be modified upon their manipulation, supporting the hypothesis that they are memory traces. In vitro, recordings show that these temporal sequences can be contained in isolated tissue of histological scale. Sequences found in control conditions differ from those recorded in pathological tissue obtained from animal disease models and those recorded after the actions of clinically useful drugs to treat disease states, setting the basis for new bioassays to test drugs with potential clinical use. These findings make the neuronal ensembles theoretical framework a dynamic neuroscience paradigm.

The Hebb Synapse Before Hebb: Theories of Synaptic Function in Learning and Memory Before , With a Discussion of the Long-Lost Synaptic Theory of William McDougall

Since the work of Semon was rediscovered by Schacter in 1978, there has been a renewed interest is searching for the "engram" as the locus of memory in the brain and Hebb's cell assembly has been equated with Semon's engram. There have been many theories of memory involving some concept of synaptic change, culminating in the "Hebb Synapse" theory in 1949. However, Hebb said that the idea that any two cells or systems of cells that are repeatedly active at the same time will tend to become "associated," was not his idea, but an old one. In this manuscript we give an overview of some of the theories of the neural basis of learning and memory before Hebb and describe the synaptic theory of William McDougall, which appears to have been an idea ahead of its time; so far ahead of its time that it was completely ignored by his contemporaries. We conclude by examining some critiques of McDougall's theory of inhibition and with a short discussion on the fate of neuroscientists whose ideas were neglected when first presented but were accepted as important many decades later.

Emergence of Content-Agnostic Information Processing by a Robot Using Active Inference, Visual Attention, Working Memory, and Planning

Generalization by learning is an essential cognitive competency for humans. For example, we can manipulate even unfamiliar objects and can generate mental images before enacting a preplan. How is this possible? Our study investigated this problem by revisiting our previous study (Jung, Matsumoto, & Tani, 2019), which examined the problem of vision-based, goal-directed planning by robots performing a task of block stacking. By extending the previous study, our work introduces a large network comprising dynamically interacting submodules, including visual working memory (VWMs), a visual attention module, and an executive network. The executive network predicts motor signals, visual images, and various controls for attention, as well as masking of visual information. The most significant difference from the previous study is that our current model contains an additional VWM. The entire network is trained by using predictive coding and an optimal visuomotor plan to achieve a given goal state is inferred using active inference. Results indicate that our current model performs significantly better than that used in Jung et al. (2019), especially when manipulating blocks with unlearned colors and textures. Simulation results revealed that the observed generalization was achieved because content-agnostic information processing developed through synergistic interaction between the second VWM and other modules during the course of learning, in which memorizing image contents and transforming them are dissociated. This letter verifies this claim by conducting both qualitative and quantitative analysis of simulation results.

Memory-specific correlated neuronal activity in higher-order auditory regions of a parrot

Male budgerigars (Melopsittacus undulatus) are open-ended learners that can learn to produce new vocalisations as adults. We investigated neuronal activation in male budgerigars using the expression of the protein products of the immediate early genes zenk and c-fos in response to exposure to conspecific contact calls (CCs: that of the mate or an unfamiliar female) in three subregions (CMM, dNCM and vNCM) of the caudomedial pallium, a higher order auditory region. Significant positive correlations of Zenk expression were found between these subregions after exposure to mate CCs. In contrast, exposure to CCs of unfamiliar females produced no such correlations. These results suggest the presence of a CC-specific association among the subregions involved in auditory memory. The caudomedial pallium of the male budgerigar may have functional subdivisions that cooperate in the neuronal representation of auditory memory.

A Vector Space Model for Neural Network Functions: Inspirations From Similarities Between the Theory of Connectivity and the Logarithmic Time Course of Word Production

The present report examines the coinciding results of two study groups each presenting a power-of-two function to describe network structures underlying perceptual processes in one case and word production during verbal fluency tasks in the other. The former is theorized as neural cliques organized according to the function N = 2 ⁱ - 1, whereas the latter assumes word conglomerations thinkable as tuples following the function N = 2 ⁱ . Both theories assume the innate optimization of energy efficiency to cause the specific connectivity structure. The vast resemblance between both formulae motivated the development of a common formulation. This was obtained by using a vector space model, in which the configuration of neural cliques or connected words is represented by a N-dimensional state vector. A further analysis of the model showed that the entire time course of word production could be derived using basically one single minimal transformation-matrix. This again seems in line with the principle of maximum energy efficiency.

Donald O. Hebb and the Organization of Behavior: 17 years in the writing

The Organization of Behavior has played a significant part in the development of behavioural neuroscience for the last 70 years. This book introduced the concepts of the "Hebb synapse", the "Hebbian cell assembly" and the "Phase sequence". The most frequently cited of these is the Hebb synapse, but the cell assembly may be Hebb's most important contribution. Even after 70 years, Hebb's theory is still relevant because it is a general framework for relating behavior to synaptic organization through the development of neural networks. The Organization of Behavior was Hebb's 40th publication. His first published papers in 1937 were on the innate organization of the visual system and he first used the phrase "the organization of behavior" in 1938. However, Hebb wrote a number of unpublished papers between 1932 and 1945 in which he developed the ideas published in The Organization of Behavior. Thus, the concept of the neural organization of behavior was central to Hebb's thinking from the beginning of his academic career. But his thinking about the organization of behavior in 1949 was different from what it was between 1932 and 1937. This paper examines Hebb's early ideas on the neural basis of behavior and attempts to trace the rather arduous series of steps through which he developed these ideas into the book that was published as The Organization of Behavior. Using the 1946 typescript and Hebb's correspondence we can see a number of changes made in the book before it was published. Finally, a number of issues arising from the book, and the importance of the book today are discussed.

Overcoming randomness does not rule out the importance of inherent randomness for functionality

Randomness is intrinsic to many natural processes. It is also clear that, under certain conditions, disorders are not associated with functionality. Several examples in which overcoming, suppressing, or combining both randomness and non-randomness is required are drawn from various fields. However, the need to suppress or overcome randomness does not negate its importance under certain conditions and its significance in valid processes and organ functions. Randomness should be acknowledged rather than ignored or suppressed; it can be viewed, at worst, as a disturbing disorder that may be treated to produce order, or, at best, as a 'beneficial disorder' that can be considered as a higher level of functionality.

FGF receptors are required for proper axonal branch targeting in Drosophila

Proper axonal branch growth and targeting are essential for establishing a hard-wired neural circuit. Here, we examined the role of Fibroblast Growth Factor Receptors (FGFRs) in axonal arbor development using loss of function and overexpression genetic analyses within single neurons. We used the invariant synaptic connectivity patterns of Drosophila mechanosensory neurons with their innate cleaning reflex responses as readouts for errors in synaptic targeting and circuit function. FGFR loss of function resulted in a decrease in axonal branch number and lengths, and overexpression of FGFRs resulted in ectopic branches and increased lengths. FGFR mutants produced stereotyped axonal targeting errors. Both loss of function and overexpression of FGFRs within the mechanosensory neuron decreased the animal’s frequency of response to mechanosensory stimulation. Our results indicate that FGFRs promote axonal branch growth and proper branch targeting. Disrupting FGFRs results in miswiring and impaired neural circuit function.

Quantum-like behavior without quantum physics III : Logic and memory

We employ some of the machinery developed in previous work to investigate the inferential and memory functions of quantum-like neural networks. We set up a logical apparatus to implement this in the form of a Gentzen sequent calculus which codifies some of the combinatory rules for the state spaces of the neuronal networks introduced earlier. We discuss memory storage in this context and along the way find formal proof that synchronicity promotes binding and storage. These results lead to an algorithmic fragment in calculus that simulates the memory function known as pattern completion. This claim is tested by noting that the failure of certain steps in the algorithm leads to memory deficits essentially identical to those found in such pathologies as Alzheimer's dementia, schizophrenia, and certain forms of autism. Moreover, a specific "power-of-two" wiring architecture and computational logic, which have been postulated and observed across many brain circuits, emerge spontaneously from our model. We draw conclusions concerning the possible nature of such mental processes qua computations.

Multidimensional Neural Selectivity in the Primate Amygdala

The amygdala contributes to multiple functions including attention allocation, sensory processing, decision-making, and the elaboration of emotional behaviors. The diversity of functions attributed to the amygdala is reflected in the response selectivity of its component neurons. Previous work claimed that subsets of neurons differentiate between broad categories of stimuli (e.g., objects vs faces, rewards vs punishment), while other subsets are narrowly specialized to respond to individual faces or facial features (e.g., eyes). Here we explored the extent to which the same neurons contribute to more than one neural subpopulation in a task that activated multiple functions of the amygdala. The subjects (Macaca mulatta) watched videos depicting conspecifics or inanimate objects, and learned by trial and error to choose the individuals or objects associated with the highest rewards. We found that the same neurons responded selectively to two or more of the following task events or stimulus features: (1) alerting, task-related stimuli (fixation icon, video start, and video end); (2) reward magnitude; (3) stimulus categories (social vs nonsocial); and (4) stimulus-unique features (faces, eyes). A disproportionate number of neurons showed selectivity for all of the examined stimulus features and task events. These results suggest that neurons that appear specialized and uniquely tuned to specific stimuli (e.g., face cells, eye cells) are likely to respond to multiple other types of stimuli or behavioral events, if/when these become behaviorally relevant in the context of a complex task. This multidimensional selectivity supports a flexible, context-dependent evaluation of inputs and subsequent decision making based on the activity of the same neural ensemble.

The Synaptic Theory of Memory: A Historical Survey and Reconciliation of Recent Opposition

Trettenbrein (2016) has argued that the concept of the synapse as the locus of memory is outdated and has made six critiques of this concept. In this article, we examine these six critiques and suggest that the current theories of the neurobiology of memory and the empirical data indicate that synaptic activation is the first step in a chain of cellular and biochemical events that lead to memories formed in cell assemblies and neural networks that rely on synaptic modification for their formation. These neural networks and their modified synaptic connections can account for the cognitive basis of learning and memory and for memory deterioration in neurological disorders. We first discuss Hebb's (1949) theory that synaptic change and the formation of cell assemblies and phase sequences can link neurophysiology to cognitive processes. We then examine each of Trettenbrein's (2016) critiques of the synaptic theory in light of Hebb's theories and recent empirical data. We examine the biochemical basis of memory formation and the necessity of synaptic modification to form the neural networks underlying learning and memory. We then examine the use of Hebb's theories of synaptic change and cell assemblies for integrating neurophysiological and cognitive conceptions of learning and memory. We conclude with an examination of the applications of the Hebb synapse and cell assembly theories to the study of the neuroscience of learning and memory, the development of computational models of memory and the construction of "intelligent" robots. We conclude that the synaptic theory of memory has not met its demise, but is essential to our understanding of the neural basis of memory, which has two components: synaptic plasticity and intrinsic plasticity.

Neural Coding of Appetitive Food Experiences in the Amygdala

Real-life experiences involve the consumption of various foods, yet it is unclear how the brain distinguishes and categorizes such food experiences. Despite the crucial roles of the basolateral amygdala (BLA) in appetitive behavior and emotion, how BLA pyramidal cells and interneurons encode food experiences has not yet been well characterized. Here we employ large-scale tetrode recording techniques to investigate the coding properties of pyramidal neurons vs. fast-spiking interneurons in the BLA as mice freely consumed a variety of foods, such as biscuits, rice, milk and water. We found that putative pyramidal cells conformed to the power-of-two-based permutation logic, as postulated by the Theory of Connectivity, to generate specific-to-general neural clique-coding patterns. Many pyramidal cells exhibited firing increases specific to a given food type, while some other pyramidal cells increased firings to various combinations of multiple foods. In contrast, fast-spiking interneurons can increase or decrease firings to given food types, and were more broadly tuned to various food experiences. We further show that a subset of pyramidal cells exhibited rapid desensitization to repeated eating of the same food, correlated with rapid behavioral habituation. Finally, we provide the intuitive visualization of BLA ensemble activation patterns using the dimensionality-reduction classification method to decode real-time appetitive stimulus identity on a moment-to-moment, single trial basis. Elucidation of the neural coding patterns in the BLA provides a key insight into how the brain's emotion and memory circuits performs the computational operation of pattern discrimination and categorization of natural food experiences.

Neural Coding of Cell Assemblies via Spike-Timing Self-Information

Cracking brain's neural code is of general interest. In contrast to the traditional view that enormous spike variability in resting states and stimulus-triggered responses reflects noise, here, we examine the "Neural Self-Information Theory" that the interspike-interval (ISI), or the silence-duration between 2 adjoining spikes, carries self-information that is inversely proportional to its variability-probability. Specifically, higher-probability ISIs convey minimal information because they reflect the ground state, whereas lower-probability ISIs carry more information, in the form of "positive" or "negative surprisals," signifying the excitatory or inhibitory shifts from the ground state, respectively. These surprisals serve as the quanta of information to construct temporally coordinated cell-assembly ternary codes representing real-time cognitions. Accordingly, we devised a general decoding method and unbiasedly uncovered 15 cell assemblies underlying different sleep cycles, fear-memory experiences, spatial navigation, and 5-choice serial-reaction time (5CSRT) visual-discrimination behaviors. We further revealed that robust cell-assembly codes were generated by ISI surprisals constituted of ~20% of the skewed ISI gamma-distribution tails, conforming to the "Pareto Principle" that specifies, for many events-including communication-roughly 80% of the output or consequences come from 20% of the input or causes. These results demonstrate that real-time neural coding arises from the temporal assembly of neural-clique members via silence variability-based self-information codes.

Multiple Approaches to the Investigation of Cell Assembly in Memory Research-Present and Future

In this review article we focus on research methodologies for detecting the actual activity of cell assemblies, which are populations of functionally connected neurons that encode information in the brain. We introduce and discuss traditional and novel experimental methods and those currently in development and briefly discuss their advantages and disadvantages for the detection of cell-assembly activity. First, we introduce the electrophysiological method, i.e., multineuronal recording, and review former and recent examples of studies showing models of dynamic coding by cell assemblies in behaving rodents and monkeys. We also discuss how the firing correlation of two neurons reflects the firing synchrony among the numerous surrounding neurons that constitute cell assemblies. Second, we review the recent outstanding studies that used the novel method of optogenetics to show causal relationships between cell-assembly activity and behavioral change. Third, we review the most recently developed method of live-cell imaging, which facilitates the simultaneous observation of firings of a large number of neurons in behaving rodents. Currently, all these available methods have both advantages and disadvantages, and no single measurement method can directly and precisely detect the actual activity of cell assemblies. The best strategy is to combine the available methods and utilize each of their advantages with the technique of operant conditioning of multiple-task behaviors in animals and, if necessary, with brain-machine interface technology to verify the accuracy of neural information detected as cell-assembly activity.

Total Number Is Important: Using the Disector Method in Design-Based Stereology to Understand the Structure of the Rodent Brain

The advantages of using design-based stereology in the collection of quantitative data, have been highlighted, in numerous publications, since the description of the disector method by Sterio (1984). This review article discusses the importance of total number derived with the disector method, as a key variable that must continue to be used to understand the rodent brain and that such data can be used to develop quantitative networks of the brain. The review article will highlight the huge impact total number has had on our understanding of the rodent brain and it will suggest that neuroscientists need to be aware of the increasing number of studies where density, not total number, is the quantitative measure used. It will emphasize that density can result in data that is misleading, most often in an unknown direction, and that we run the risk of this type of data being accepted into the collective neuroscience knowledge database. It will also suggest that design-based stereology using the disector method, can be used alongside recent developments in electron microscopy, such as serial block-face scanning electron microscopy (SEM), to obtain total number data very efficiently at the ultrastructural level. Throughout the article total number is discussed as a key parameter in understanding the micro-networks of the rodent brain as they can be represented as both anatomical and quantitative networks.

Neural Code-Neural Self-information Theory on How Cell-Assembly Code Rises from Spike Time and Neuronal Variability

A major stumbling block to cracking the real-time neural code is neuronal variability - neurons discharge spikes with enormous variability not only across trials within the same experiments but also in resting states. Such variability is widely regarded as a noise which is often deliberately averaged out during data analyses. In contrast to such a dogma, we put forth the Neural Self-Information Theory that neural coding is operated based on the self-information principle under which variability in the time durations of inter-spike-intervals (ISI), or neuronal silence durations, is self-tagged with discrete information. As the self-information processor, each ISI carries a certain amount of information based on its variability-probability distribution; higher-probability ISIs which reflect the balanced excitation-inhibition ground state convey minimal information, whereas lower-probability ISIs which signify rare-occurrence surprisals in the form of extremely transient or prolonged silence carry most information. These variable silence durations are naturally coupled with intracellular biochemical cascades, energy equilibrium and dynamic regulation of protein and gene expression levels. As such, this silence variability-based self-information code is completely intrinsic to the neurons themselves, with no need for outside observers to set any reference point as typically used in the rate code, population code and temporal code models. Moreover, temporally coordinated ISI surprisals across cell population can inherently give rise to robust real-time cell-assembly codes which can be readily sensed by the downstream neural clique assemblies. One immediate utility of this self-information code is a general decoding strategy to uncover a variety of cell-assembly patterns underlying external and internal categorical or continuous variables in an unbiased manner.

Brain Computation Is Organized via Power-of-Two-Based Permutation Logic

There is considerable scientific interest in understanding how cell assemblies—the long-presumed computational motif—are organized so that the brain can generate intelligent cognition and flexible behavior. The Theory of Connectivity proposes that the origin of intelligence is rooted in a power-of-two-based permutation logic (N = 2ⁱ–1), producing specific-to-general cell-assembly architecture capable of generating specific perceptions and memories, as well as generalized knowledge and flexible actions. We show that this power-of-two-based permutation logic is widely used in cortical and subcortical circuits across animal species and is conserved for the processing of a variety of cognitive modalities including appetitive, emotional and social information. However, modulatory neurons, such as dopaminergic (DA) neurons, use a simpler logic despite their distinct subtypes. Interestingly, this specific-to-general permutation logic remained largely intact although NMDA receptors—the synaptic switch for learning and memory—were deleted throughout adulthood, suggesting that the logic is developmentally pre-configured. Moreover, this computational logic is implemented in the cortex via combining a random-connectivity strategy in superficial layers 2/3 with nonrandom organizations in deep layers 5/6. This randomness of layers 2/3 cliques—which preferentially encode specific and low-combinatorial features and project inter-cortically—is ideal for maximizing cross-modality novel pattern-extraction, pattern-discrimination and pattern-categorization using sparse code, consequently explaining why it requires hippocampal offline-consolidation. In contrast, the nonrandomness in layers 5/6—which consists of few specific cliques but a higher portion of more general cliques projecting mostly to subcortical systems—is ideal for feedback-control of motivation, emotion, consciousness and behaviors. These observations suggest that the brain’s basic computational algorithm is indeed organized by the power-of-two-based permutation logic. This simple mathematical logic can account for brain computation across the entire evolutionary spectrum, ranging from the simplest neural networks to the most complex.