Towards solving the hard problem of consciousness: The varieties of brain resonances and the conscious experiences that they support

The attentive reconstruction of objects facilitates robust object recognition

Humans are extremely robust in our ability to perceive and recognize objects-we see faces in tea stains and can recognize friends on dark streets. Yet, neurocomputational models of primate object recognition have focused on the initial feed-forward pass of processing through the ventral stream and less on the top-down feedback that likely underlies robust object perception and recognition. Aligned with the generative approach, we propose that the visual system actively facilitates recognition by reconstructing the object hypothesized to be in the image. Top-down attention then uses this reconstruction as a template to bias feedforward processing to align with the most plausible object hypothesis. Building on auto-encoder neural networks, our model makes detailed hypotheses about the appearance and location of the candidate objects in the image by reconstructing a complete object representation from potentially incomplete visual input due to noise and occlusion. The model then leverages the best object reconstruction, measured by reconstruction error, to direct the bottom-up process of selectively routing low-level features, a top-down biasing that captures a core function of attention. We evaluated our model using the MNIST-C (handwritten digits under corruptions) and ImageNet-C (real-world objects under corruptions) datasets. Not only did our model achieve superior performance on these challenging tasks designed to approximate real-world noise and occlusion viewing conditions, but also better accounted for human behavioral reaction times and error patterns than a standard feedforward Convolutional Neural Network. Our model suggests that a complete understanding of object perception and recognition requires integrating top-down and attention feedback, which we propose is an object reconstruction.

Integrative medicine for musculoskeletal pains - A proposed model based on clinical experience

With an increasing number of chronic diseases and related disabilities, modern medicine is falling short of offering definitive, cost-effective, long-term solutions. As we realize contemporary medicine's limitations and side effects, we are gravitating towards whole-person care. Taking learnings from integrative medicine treatment of musculoskeletal pains, I comprehended that a paradigm shift is needed in thinking about etiopathogenesis and diagnosing disease. Different healing possibilities can be identified in humans if we shift our focus from reductionist science to whole-person care. Each health condition is an outcome of disturbed homeostasis involving multiple body systems. Based on homeostatic balancing principles and clinical experience, five interrelated and interdependent pathways are discussed. Based on these pathways, a working model of integrative medicine is presented. It can act as a template for medical practitioners to start integrative medicine practice for the benefit of patients. To make integrative medicine mainstream, there is a need to standardize care, frame regulations, train and educate the practitioners. At the same, it shall be put to rigorous scientific experimentation, research, and scrutiny.

Fields or firings? Comparing the spike code and the electromagnetic field hypothesis

Where is consciousness? Neurobiological theories of consciousness look primarily to synaptic firing and "spike codes" as the physical substrate of consciousness, although the specific mechanisms of consciousness remain unknown. Synaptic firing results from electrochemical processes in neuron axons and dendrites. All neurons also produce electromagnetic (EM) fields due to various mechanisms, including the electric potential created by transmembrane ion flows, known as "local field potentials," but there are also more meso-scale and macro-scale EM fields present in the brain. The functional role of these EM fields has long been a source of debate. We suggest that these fields, in both their local and global forms, may be the primary seat of consciousness, working as a gestalt with synaptic firing and other aspects of neuroanatomy to produce the marvelous complexity of minds. We call this assertion the "electromagnetic field hypothesis." The neuroanatomy of the brain produces the local and global EM fields but these fields are not identical with the anatomy of the brain. These fields are produced by, but not identical with, the brain, in the same manner that twigs and leaves are produced by a tree's branches and trunk but are not the same as the branches and trunk. As such, the EM fields represent the more granular, both spatially and temporally, aspects of the brain's structure and functioning than the neuroanatomy of the brain. The brain's various EM fields seem to be more sensitive to small changes than the neuroanatomy of the brain. We discuss issues with the spike code approach as well as the various lines of evidence supporting our argument that the brain's EM fields may be the primary seat of consciousness. This evidence (which occupies most of the paper) suggests that oscillating neural EM fields may make firing in neural circuits oscillate, and these oscillating circuits may help unify and guide conscious cognition.

Local motion signals silence the perceptual solution of global apparent motion

Stimuli for apparent motion can have ambiguity in frame-to-frame correspondences among visual elements. This occurs when visual inputs cause a correspondence problem that allows multiple alternatives of perceptual solutions. Herein we examined the influence of local visual motions on a perceptual solution under such a multistable situation. We repeatedly alternated two frames of stimuli in a circular configuration in which discrete elements in two different colors alternated in space and switched their colors frame by frame. These stimuli were compatible with three perceptual solutions: globally consistent clockwise and counterclockwise rotations and color flickers at the same locations without such global apparent motion. We added a sinusoidal grating continuously drifting within each element to examine whether the perceptual solution for the global apparent motion was affected by the local continuous motions. We found that the local motions suppressed global apparent motion and promoted another perceptual solution that the local elements were only flickering between the two colors and drifting within static windows. It was concluded that local continuous motions as counterevidence against global apparent motion contributed to individuating visual objects and integrating visual features for maintaining object identity at the same location.

The Grossberg Code: Universal Neural Network Signatures of Perceptual Experience

Two universal functional principles of Grossberg’s Adaptive Resonance Theory decipher the brain code of all biological learning and adaptive intelligence. Low-level representations of multisensory stimuli in their immediate environmental context are formed on the basis of bottom-up activation and under the control of top-down matching rules that integrate high-level, long-term traces of contextual configuration. These universal coding principles lead to the establishment of lasting brain signatures of perceptual experience in all living species, from aplysiae to primates. They are re-visited in this concept paper on the basis of examples drawn from the original code and from some of the most recent related empirical findings on contextual modulation in the brain, highlighting the potential of Grossberg’s pioneering insights and groundbreaking theoretical work for intelligent solutions in the domain of developmental and cognitive robotics.

From the origins to the stream of consciousness and its neural correlates

There are now dozens of very different theories of consciousness, each somehow contributing to our understanding of its nature. The science of consciousness needs therefore not new theories but a general framework integrating insights from those, yet not making it a still-born "Frankenstein" theory. First, the framework must operate explicitly on the stream of consciousness, not on its static description. Second, this dynamical account must also be put on the evolutionary timeline to explain the origins of consciousness. The Cognitive Evolution Theory (CET), outlined here, proposes such a framework. This starts with the assumption that brains have primarily evolved as volitional subsystems of organisms, inherited from primitive (fast and random) reflexes of simplest neural networks, only then resembling error-minimizing prediction machines. CET adopts the tools of critical dynamics to account for metastability, scale-free avalanches, and self-organization which are all intrinsic to brain dynamics. This formalizes the stream of consciousness as a discrete (transitive, irreflexive) chain of momentary states derived from critical brain dynamics at points of phase transitions and mapped then onto a state space as neural correlates of a particular conscious state. The continuous/discrete dichotomy appears naturally between the brain dynamics at the causal level and conscious states at the phenomenal level, each volitionally triggered from arousal centers of the brainstem and cognitively modulated by thalamocortical systems. Their objective observables can be entropy-based complexity measures, reflecting the transient level or quantity of consciousness at that moment.

Resonance as a Design Strategy for AI and Social Robots

Resonance, a powerful and pervasive phenomenon, appears to play a major role in human interactions. This article investigates the relationship between the physical mechanism of resonance and the human experience of resonance, and considers possibilities for enhancing the experience of resonance within human-robot interactions. We first introduce resonance as a widespread cultural and scientific metaphor. Then, we review the nature of "sympathetic resonance" as a physical mechanism. Following this introduction, the remainder of the article is organized in two parts. In part one, we review the role of resonance (including synchronization and rhythmic entrainment) in human cognition and social interactions. Then, in part two, we review resonance-related phenomena in robotics and artificial intelligence (AI). These two reviews serve as ground for the introduction of a design strategy and combinatorial design space for shaping resonant interactions with robots and AI. We conclude by posing hypotheses and research questions for future empirical studies and discuss a range of ethical and aesthetic issues associated with resonance in human-robot interactions.

Toward Understanding the Brain Dynamics of Music: Learning and Conscious Performance of Lyrics and Melodies With Variable Rhythms and Beats

A neural network architecture models how humans learn and consciously perform musical lyrics and melodies with variable rhythms and beats, using brain design principles and mechanisms that evolved earlier than human musical capabilities, and that have explained and predicted many kinds of psychological and neurobiological data. One principle is called factorization of order and rhythm: Working memories store sequential information in a rate-invariant and speaker-invariant way to avoid using excessive memory and to support learning of language, spatial, and motor skills. Stored invariant representations can be flexibly performed in a rate-dependent and speaker-dependent way under volitional control. A canonical working memory design stores linguistic, spatial, motoric, and musical sequences, including sequences with repeated words in lyrics, or repeated pitches in songs. Stored sequences of individual word chunks and pitch chunks are categorized through learning into lyrics chunks and pitches chunks. Pitches chunks respond selectively to stored sequences of individual pitch chunks that categorize harmonics of each pitch, thereby supporting tonal music. Bottom-up and top-down learning between working memory and chunking networks dynamically stabilizes the memory of learned music. Songs are learned by associatively linking sequences of lyrics and pitches chunks. Performance begins when list chunks read word chunk and pitch chunk sequences into working memory. Learning and performance of regular rhythms exploits cortical modulation of beats that are generated in the basal ganglia. Arbitrary performance rhythms are learned by adaptive timing circuits in the cerebellum interacting with prefrontal cortex and basal ganglia. The same network design that controls walking, running, and finger tapping also generates beats and the urge to move with a beat.

A Traditional Scientific Perspective on the Integrated Information Theory of Consciousness

This paper assesses two different theories for explaining consciousness, a phenomenon that is widely considered amenable to scientific investigation despite its puzzling subjective aspects. I focus on Integrated Information Theory (IIT), which says that consciousness is integrated information (as ϕMax) and says even simple systems with interacting parts possess some consciousness. First, I evaluate IIT on its own merits. Second, I compare it to a more traditionally derived theory called Neurobiological Naturalism (NN), which says consciousness is an evolved, emergent feature of complex brains. Comparing these theories is informative because it reveals strengths and weaknesses of each, thereby suggesting better ways to study consciousness in the future. IIT's strengths are the reasonable axioms at its core; its strong logic and mathematical formalism; its creative "experience-first" approach to studying consciousness; the way it avoids the mind-body ("hard") problem; its consistency with evolutionary theory; and its many scientifically testable predictions. The potential weakness of IIT is that it contains stretches of logic-based reasoning that were not checked against hard evidence when the theory was being constructed, whereas scientific arguments require such supporting evidence to keep the reasoning on course. This is less of a concern for the other theory, NN, because it incorporated evidence much earlier in its construction process. NN is a less mature theory than IIT, less formalized and quantitative, and less well tested. However, it has identified its own neural correlates of consciousness (NCC) and offers a roadmap through which these NNCs may answer the questions of consciousness using the hypothesize-test-hypothesize-test steps of the scientific method.

A Neural Model of Intrinsic and Extrinsic Hippocampal Theta Rhythms: Anatomy, Neurophysiology, and Function

This article describes a neural model of the anatomy, neurophysiology, and functions of intrinsic and extrinsic theta rhythms in the brains of multiple species. Topics include how theta rhythms were discovered; how theta rhythms organize brain information processing into temporal series of spatial patterns; how distinct theta rhythms occur within area CA1 of the hippocampus and between the septum and area CA3 of the hippocampus; what functions theta rhythms carry out in different brain regions, notably CA1-supported functions like learning, recognition, and memory that involve visual, cognitive, and emotional processes; how spatial navigation, adaptively timed learning, and category learning interact with hippocampal theta rhythms; how parallel cortical streams through the lateral entorhinal cortex (LEC) and the medial entorhinal cortex (MEC) represent the end-points of the What cortical stream for perception and cognition and the Where cortical stream for spatial representation and action; how the neuromodulator acetylcholine interacts with the septo-hippocampal theta rhythm and modulates category learning; what functions are carried out by other brain rhythms, such as gamma and beta oscillations; and how gamma and beta oscillations interact with theta rhythms. Multiple experimental facts about theta rhythms are unified and functionally explained by this theoretical synthesis.

Theoretical Models of Consciousness: A Scoping Review

The amount of knowledge on human consciousness has created a multitude of viewpoints and it is difficult to compare and synthesize all the recent scientific perspectives. Indeed, there are many definitions of consciousness and multiple approaches to study the neural correlates of consciousness (NCC). Therefore, the main aim of this article is to collect data on the various theories of consciousness published between 2007-2017 and to synthesize them to provide a general overview of this topic. To describe each theory, we developed a thematic grid called the dimensional model, which qualitatively and quantitatively analyzes how each article, related to one specific theory, debates/analyzes a specific issue. Among the 1130 articles assessed, 85 full texts were included in the prefinal step. Finally, this scoping review analyzed 68 articles that described 29 theories of consciousness. We found heterogeneous perspectives in the theories analyzed. Those with the highest grade of variability are as follows: subjectivity, NCC, and the consciousness/cognitive function. Among sub-cortical structures, thalamus, basal ganglia, and the hippocampus were the most indicated, whereas the cingulate, prefrontal, and temporal areas were the most reported for cortical ones also including the thalamo-cortical system. Moreover, we found several definitions of consciousness and 21 new sub-classifications.

A Canonical Laminar Neocortical Circuit Whose Bottom-Up, Horizontal, and Top-Down Pathways Control Attention, Learning, and Prediction

All perceptual and cognitive circuits in the human cerebral cortex are organized into layers. Specializations of a canonical laminar network of bottom-up, horizontal, and top-down pathways carry out multiple kinds of biological intelligence across different neocortical areas. This article describes what this canonical network is and notes that it can support processes as different as 3D vision and figure-ground perception; attentive category learning and decision-making; speech perception; and cognitive working memory (WM), planning, and prediction. These processes take place within and between multiple parallel cortical streams that obey computationally complementary laws. The interstream interactions that are needed to overcome these complementary deficiencies mix cell properties so thoroughly that some authors have noted the difficulty of determining what exactly constitutes a cortical stream and the differences between streams. The models summarized herein explain how these complementary properties arise, and how their interstream interactions overcome their computational deficiencies to support effective goal-oriented behaviors.

Will We Ever Have Conscious Machines?

The question of whether artificial beings or machines could become self-aware or conscious has been a philosophical question for centuries. The main problem is that self-awareness cannot be observed from an outside perspective and the distinction of being really self-aware or merely a clever imitation cannot be answered without access to knowledge about the mechanism's inner workings. We investigate common machine learning approaches with respect to their potential ability to become self-aware. We realize that many important algorithmic steps toward machines with a core consciousness have already been taken.

A Unified Neural Theory of Conscious Seeing, Hearing, Feeling, and Knowing

Adaptive Resonance Theory does more than satisfy 'hard criteria' for ToCs.

Hard criteria for empirical theories of consciousness

Consciousness is now a well-established field of empirical research. A large body of experimental results has been accumulated and is steadily growing. In parallel, many Theories of Consciousness (ToCs) have been proposed. These theories are diverse in nature, ranging from computational to neurophysiological and quantum theoretical approaches. This contrasts with other fields of natural science, which host a smaller number of competing theories. We suggest that one reason for this abundance of extremely different theories may be the lack of stringent criteria specifying how empirical data constrains ToCs. First, we argue that consciousness is a well-defined topic from an empirical point of view and motivate a purely empirical stance on the quest for consciousness. Second, we present a checklist of criteria that, we propose, empirical ToCs need to cope with. Third, we review 13 of the most influential ToCs and subject them to the criteria. Our analysis helps to situate these different ToCs in the theoretical landscapeand sheds light on their strengths and weaknesses from a strictly empirical point of view.

A neurodynamic model of the interaction between color perception and color memory

The memory color effect and Spanish castle illusion have been taken as evidence of the cognitive penetrability of vision. In the same manner, the successful decoding of color-related brain signals in functional neuroimaging studies suggests the retrieval of memory colors associated with a perceived gray object. Here, we offer an alternative account of these findings based on the design principles of adaptive resonance theory (ART). In ART, conscious perception is a consequence of a resonant state. Resonance emerges in a recurrent cortical circuit when a bottom-up spatial pattern agrees with the top-down expectation. When they do not agree, a special control mechanism is activated that resets the network and clears off erroneous expectation, thus allowing the bottom-up activity to always dominate in perception. We developed a color ART circuit and evaluated its behavior in computer simulations. The model helps to explain how traces of erroneous expectations about incoming color are eventually removed from the color perception, although their transient effect may be visible in behavioral responses or in brain imaging. Our results suggest that the color ART circuit, as a predictive computational system, is almost never penetrable, because it is equipped with computational mechanisms designed to constrain the impact of the top-down predictions on ongoing perceptual processing.

A Path Toward Explainable AI and Autonomous Adaptive Intelligence: Deep Learning, Adaptive Resonance, and Models of Perception, Emotion, and Action

Biological neural network models whereby brains make minds help to understand autonomous adaptive intelligence. This article summarizes why the dynamics and emergent properties of such models for perception, cognition, emotion, and action are explainable, and thus amenable to being confidently implemented in large-scale applications. Key to their explainability is how these models combine fast activations, or short-term memory (STM) traces, and learned weights, or long-term memory (LTM) traces. Visual and auditory perceptual models have explainable conscious STM representations of visual surfaces and auditory streams in surface-shroud resonances and stream-shroud resonances, respectively. Deep Learning is often used to classify data. However, Deep Learning can experience catastrophic forgetting: At any stage of learning, an unpredictable part of its memory can collapse. Even if it makes some accurate classifications, they are not explainable and thus cannot be used with confidence. Deep Learning shares these problems with the back propagation algorithm, whose computational problems due to non-local weight transport during mismatch learning were described in the 1980s. Deep Learning became popular after very fast computers and huge online databases became available that enabled new applications despite these problems. Adaptive Resonance Theory, or ART, algorithms overcome the computational problems of back propagation and Deep Learning. ART is a self-organizing production system that incrementally learns, using arbitrary combinations of unsupervised and supervised learning and only locally computable quantities, to rapidly classify large non-stationary databases without experiencing catastrophic forgetting. ART classifications and predictions are explainable using the attended critical feature patterns in STM on which they build. The LTM adaptive weights of the fuzzy ARTMAP algorithm induce fuzzy IF-THEN rules that explain what feature combinations predict successful outcomes. ART has been successfully used in multiple large-scale real world applications, including remote sensing, medical database prediction, and social media data clustering. Also explainable are the MOTIVATOR model of reinforcement learning and cognitive-emotional interactions, and the VITE, DIRECT, DIVA, and SOVEREIGN models for reaching, speech production, spatial navigation, and autonomous adaptive intelligence. These biological models exemplify complementary computing, and use local laws for match learning and mismatch learning that avoid the problems of Deep Learning.

An Integrated World Modeling Theory (IWMT) of Consciousness: Combining Integrated Information and Global Neuronal Workspace Theories With the Free Energy Principle and Active Inference Framework; Toward Solving the Hard Problem and Characterizing Agentic Causation

The Free Energy Principle and Active Inference Framework (FEP-AI) begins with the understanding that persisting systems must regulate environmental exchanges and prevent entropic accumulation. In FEP-AI, minds and brains are predictive controllers for autonomous systems, where action-driven perception is realized as probabilistic inference. Integrated Information Theory (IIT) begins with considering the preconditions for a system to intrinsically exist, as well as axioms regarding the nature of consciousness. IIT has produced controversy because of its surprising entailments: quasi-panpsychism; subjectivity without referents or dynamics; and the possibility of fully-intelligent-yet-unconscious brain simulations. Here, I describe how these controversies might be resolved by integrating IIT with FEP-AI, where integrated information only entails consciousness for systems with perspectival reference frames capable of generating models with spatial, temporal, and causal coherence for self and world. Without that connection with external reality, systems could have arbitrarily high amounts of integrated information, but nonetheless would not entail subjective experience. I further describe how an integration of these frameworks may contribute to their evolution as unified systems theories and models of emergent causation. Then, inspired by both Global Neuronal Workspace Theory (GNWT) and the Harmonic Brain Modes framework, I describe how streams of consciousness may emerge as an evolving generation of sensorimotor predictions, with the precise composition of experiences depending on the integration abilities of synchronous complexes as self-organizing harmonic modes (SOHMs). These integrating dynamics may be particularly likely to occur via richly connected subnetworks affording body-centric sources of phenomenal binding and executive control. Along these connectivity backbones, SOHMs are proposed to implement turbo coding via loopy message-passing over predictive (autoencoding) networks, thus generating maximum a posteriori estimates as coherent vectors governing neural evolution, with alpha frequencies generating basic awareness, and cross-frequency phase-coupling within theta frequencies for access consciousness and volitional control. These dynamic cores of integrated information also function as global workspaces, centered on posterior cortices, but capable of being entrained with frontal cortices and interoceptive hierarchies, thus affording agentic causation. Integrated World Modeling Theory (IWMT) represents a synthetic approach to understanding minds that reveals compatibility between leading theories of consciousness, thus enabling inferential synergy.

On a lightness phenomenon

This work demonstrates a lightness phenomenon useful to extend the notion of "belongingness," which is crucial to explain a class of illusions that include simultaneous lightness contrast, the Koffka-Benussi ring, the Benary cross, and the White effect. These phenomena manifest some kind of dissimilarity, difference, or change responsible for the perceived contrast. The dissimilarity is related to the "belongingness" of the crucial gray elements (i) to a unique or separated/divided object, as in the Koffka-Benussi ring, or (ii) to the figure or to the background, as in the Benary and White effects. If we plausibly assume that differences and changes are biologically important to be detected and if necessary highlighted, then any visible difference might induce a contrast effect. This is the main hypothesis demonstrated by the lightness phenomenon based on checks grouped vertically, split in two upper and lower halves, and segregated from the homogeneous gray background. The checks are alternated and vertically/horizontally reversed in the upper and lower halves of the pattern. Despite the constant visual organization and in spite of the identical local contrast within each check, the inner area of the elements of the upper group appears darker than the one of the lower group. The visible dissimilarity, although not related to the notion of belongingness, is sufficient to elicit a clear lightness difference.

Developmental Designs and Adult Functions of Cortical Maps in Multiple Modalities: Perception, Attention, Navigation, Numbers, Streaming, Speech, and Cognition

This article unifies neural modeling results that illustrate several basic design principles and mechanisms that are used by advanced brains to develop cortical maps with multiple psychological functions. One principle concerns how brains use a strip map that simultaneously enables one feature to be represented throughout its extent, as well as an ordered array of another feature at different positions of the strip. Strip maps include circuits to represent ocular dominance and orientation columns, place-value numbers, auditory streams, speaker-normalized speech, and cognitive working memories that can code repeated items. A second principle concerns how feature detectors for multiple functions develop in topographic maps, including maps for optic flow navigation, reinforcement learning, motion perception, and category learning at multiple organizational levels. A third principle concerns how brains exploit a spatial gradient of cells that respond at an ordered sequence of different rates. Such a rate gradient is found along the dorsoventral axis of the entorhinal cortex, whose lateral branch controls the development of time cells, and whose medial branch controls the development of grid cells. Populations of time cells can be used to learn how to adaptively time behaviors for which a time interval of hundreds of milliseconds, or several seconds, must be bridged, as occurs during trace conditioning. Populations of grid cells can be used to learn hippocampal place cells that represent the large spaces in which animals navigate. A fourth principle concerns how and why all neocortical circuits are organized into layers, and how functionally distinct columns develop in these circuits to enable map development. A final principle concerns the role of Adaptive Resonance Theory top-down matching and attentional circuits in the dynamic stabilization of early development and adult learning. Cortical maps are modeled in visual, auditory, temporal, parietal, prefrontal, entorhinal, and hippocampal cortices.

Terminological and Epistemological Issues in Current Memory Research

A number of observations in recent years demonstrates that across all levels of organization, memory is inherently fluid. On the cognitive-behavioral level, the innocent act of remembering can irrevocably alter the contents of established long-term memories, while the content of dormant long-term memories that is deemed irrelevant, superfluous, or limiting may be pragmatically erased or suppressed. On the cellular level, the proteins implementing the molecular alterations underpinning memories are in a constant state of flux, with proteins being turned over, translocated, reconfigured, substituted, and replaced. Yet, the general perception of memory, and the words used to describe it, suggest a static system characterized by the goal of preserving records of past experiences with high fidelity, in contrast to the reality of an inherently adaptive system purposed to enable survival in a changing world with a pragmatic disregard for the fate of acquired memories. Here, we examine present memory terminology and how it corresponds to our actual understanding of the molecules, cells, and systems underlying memory. We will identify where terms lead us astray and line out possible ways to reform memory nomenclature to better fit the true nature of memory as we begin to know it.

The Easy Part of the Hard Problem: A Resonance Theory of Consciousness

Synchronization, harmonization, vibrations, or simply resonance in its most general sense seems to have an integral relationship with consciousness itself. One of the possible “neural correlates of consciousness” in mammalian brains is a specific combination of gamma, beta and theta electrical synchrony. More broadly, we see similar kinds of resonance patterns in living and non-living structures of many types. What clues can resonance provide about the nature of consciousness more generally? This paper provides an overview of resonating structures in the fields of neuroscience, biology and physics and offers a possible solution to what we see as the “easy part” of the “Hard Problem” of consciousness, which is generally known as the “combination problem.” The combination problem asks: how do micro-conscious entities combine into a higher-level macro-consciousness? The proposed solution in the context of mammalian consciousness suggests that a shared resonance is what allows different parts of the brain to achieve a phase transition in the speed and bandwidth of information flows between the constituent parts. This phase transition allows for richer varieties of consciousness to arise, with the character and content of that consciousness in each moment determined by the particular set of constituent neurons. We also offer more general insights into the ontology of consciousness and suggest that consciousness manifests as a continuum of increasing richness in all physical processes, distinguishing our view from emergentist materialism. We refer to this approach, a meta-synthesis, as a (general) resonance theory of consciousness. We offer some suggestions for testing the theory.

The resonant brain: How attentive conscious seeing regulates action sequences that interact with attentive cognitive learning, recognition, and prediction

This article describes mechanistic links that exist in advanced brains between processes that regulate conscious attention, seeing, and knowing, and those that regulate looking and reaching. These mechanistic links arise from basic properties of brain design principles such as complementary computing, hierarchical resolution of uncertainty, and adaptive resonance. These principles require conscious states to mark perceptual and cognitive representations that are complete, context sensitive, and stable enough to control effective actions. Surface-shroud resonances support conscious seeing and action, whereas feature-category resonances support learning, recognition, and prediction of invariant object categories. Feedback interactions between cortical areas such as peristriate visual cortical areas V2, V3A, and V4, and the lateral intraparietal area (LIP) and inferior parietal sulcus (IPS) of the posterior parietal cortex (PPC) control sequences of saccadic eye movements that foveate salient features of attended objects and thereby drive invariant object category learning. Learned categories can, in turn, prime the objects and features that are attended and searched. These interactions coordinate processes of spatial and object attention, figure-ground separation, predictive remapping, invariant object category learning, and visual search. They create a foundation for learning to control motor-equivalent arm movement sequences, and for storing these sequences in cognitive working memories that can trigger the learning of cognitive plans with which to read out skilled movement sequences. Cognitive-emotional interactions that are regulated by reinforcement learning can then help to select the plans that control actions most likely to acquire valued goal objects in different situations. Many interdisciplinary psychological and neurobiological data about conscious and unconscious behaviors in normal individuals and clinical patients have been explained in terms of these concepts and mechanisms.

Admiring the Great Mountain: A Celebration Special Issue in Honor of Stephen Grossberg's 80th Birthday

This editorial summarizes selected key contributions of Prof. Stephen Grossberg and describes the papers in this 80th birthday special issue in his honor. His productivity, creativity, and vision would each be enough to mark a scientist of the first caliber. In combination, they have resulted in contributions that have changed the entire discipline of neural networks. Grossberg has been tremendously influential in engineering, dynamical systems, and artificial intelligence as well. Indeed, he has been one of the most important mentors and role models in my career, and has done so with extraordinary generosity and encouragement. All authors in this special issue have taken great pleasure in hereby commemorating his extraordinary career and contributions.

Dynamical modeling of multi-scale variability in neuronal competition

Variability is observed at multiple-scales in the brain and ubiquitous in perception. However, the nature of perceptual variability is an open question. We focus on variability during perceptual rivalry, a form of neuronal competition. Rivalry provides a window into neural processing since activity in many brain areas is correlated to the alternating perception rather than a constant ambiguous stimulus. It exhibits robust properties at multiple scales including conscious awareness and neuron dynamics. The prevalent theory for spiking variability is called the balanced state; whereas, the source of perceptual variability is unknown. Here we show that a single biophysical circuit model, satisfying certain mutual inhibition architectures, can explain spiking and perceptual variability during rivalry. These models adhere to a broad set of strict experimental constraints at multiple scales. As we show, the models predict how spiking and perceptual variability changes with stimulus conditions.

Subjectivity "Demystified": Neurobiology, Evolution, and the Explanatory Gap

While life in general can be explained by the mechanisms of physics, chemistry, and biology, to many scientists and philosophers, it appears that when it comes to explaining consciousness, there is what the philosopher Joseph Levine called an "explanatory gap" between the physical brain and subjective experiences. Here, we deduce the living and neural features behind primary consciousness within a naturalistic biological framework, identify which animal taxa have these features (the vertebrates, arthropods, and cephalopod molluscs), then reconstruct when consciousness first evolved and consider its adaptive value. We theorize that consciousness is based on all the complex system features of life, plus even more complex features of elaborate brains. We argue that the main reason why the explanatory gap between the brain and experience has been so refractory to scientific explanation is that it arises from both life and from varied and diverse brains and brain regions, so bridging the gap requires a complex, multifactorial account that includes the great diversity of consciousness, its personal nature that stems from embodied life, and the special neural features that make consciousness unique in nature.

The Embodied Brain of SOVEREIGN2: From Space-Variant Conscious Percepts During Visual Search and Navigation to Learning Invariant Object Categories and Cognitive-Emotional Plans for Acquiring Valued Goals

This article develops a model of how reactive and planned behaviors interact in real time. Controllers for both animals and animats need reactive mechanisms for exploration, and learned plans to efficiently reach goal objects once an environment becomes familiar. The SOVEREIGN model embodied these capabilities, and was tested in a 3D virtual reality environment. Neural models have characterized important adaptive and intelligent processes that were not included in SOVEREIGN. A major research program is summarized herein by which to consistently incorporate them into an enhanced model called SOVEREIGN2. Key new perceptual, cognitive, cognitive-emotional, and navigational processes require feedback networks which regulate resonant brain states that support conscious experiences of seeing, feeling, and knowing. Also included are computationally complementary processes of the mammalian neocortical What and Where processing streams, and homologous mechanisms for spatial navigation and arm movement control. These include: Unpredictably moving targets are tracked using coordinated smooth pursuit and saccadic movements. Estimates of target and present position are computed in the Where stream, and can activate approach movements. Motion cues can elicit orienting movements to bring new targets into view. Cumulative movement estimates are derived from visual and vestibular cues. Arbitrary navigational routes are incrementally learned as a labeled graph of angles turned and distances traveled between turns. Noisy and incomplete visual sensor data are transformed into representations of visual form and motion. Invariant recognition categories are learned in the What stream. Sequences of invariant object categories are stored in a cognitive working memory, whereas sequences of movement positions and directions are stored in a spatial working memory. Stored sequences trigger learning of cognitive and spatial/motor sequence categories or plans, also called list chunks, which control planned decisions and movements toward valued goal objects. Predictively successful list chunk combinations are selectively enhanced or suppressed via reinforcement learning and incentive motivational learning. Expected vs. unexpected event disconfirmations regulate these enhancement and suppressive processes. Adaptively timed learning enables attention and action to match task constraints. Social cognitive joint attention enables imitation learning of skills by learners who observe teachers from different spatial vantage points.

Beyond Bouma's window: How to explain global aspects of crowding?

In crowding, perception of an object deteriorates in the presence of nearby elements. Although crowding is a ubiquitous phenomenon, since elements are rarely seen in isolation, to date there exists no consensus on how to model it. Previous experiments showed that the global configuration of the entire stimulus must be taken into account. These findings rule out simple pooling or substitution models and favor models sensitive to global spatial aspects. In order to investigate how to incorporate global aspects into models, we tested a large number of models with a database of forty stimuli tailored for the global aspects of crowding. Our results show that incorporating grouping like components strongly improves model performance.

Origin and evolution of human consciousness

The study of the origin and evolution of consciousness presents several problems. The first problem concerns terminology. The word consciousness comes from the Latin term conscĭentĭa that means "knowledge shared with others." However, the term consciousness also refers to several other aspects involving both its levels (sleep, coma, dreams and waking state) and contents (subjective, phenomenal and objective). A second issue is the problem of other minds, namely, the possibility to establish whether others have minds very like our own. Moreover, human consciousness has been linked to three different forms of memory: procedural/implicit, semantic and episodic. All these different aspects of consciousness will be discussed in the first part of the chapter. In the second part, we discuss different neuroscientific theories on consciousness and examine how research from developmental psychology, clinical neurology (epilepsy, coma, vegetative state and minimal state of consciousness), neuropsychology (blindsight, agnosia, neglect, split-brain and ocular rivalry), and comparative neuropsychophysiology contribute to the study of consciousness. Finally, in the last part of the chapter we discuss the distinctive features of human consciousness and in particular the ability to travel mentally through time, the phenomenon of joint intentionality, theory of mind and language.

QuantumIS: A Qualia Consciousness Awareness and Information Theory Quale Approach to Reducing Strategic Decision-Making Entropy

This paper investigates the underlying driving force in strategic decision-making. From a conceptual standpoint, few studies empirically studied the decision-maker's intrinsic state composed of entropy and uncertainty. This study examines a mutual information theory approach integrated into a state of qualia complexity that minimizes exclusion and maximizes the interactions of the information system and its dynamic environment via logical metonymy, illusion, and epigenetics. The article questions whether decision-makers at all levels of the organization are responding from the consciousness of an objective quale from a more subjective qualia awareness in the narrow-sense perspective of individual instances of their conscious experience. To quantify this research question, we explore several hypotheses revolving around strategic information system decisions. In this research, we posit that the eigenvalues of factor analysis along with the reduction in the uncertainty coefficients of the qualia entropy will be balanced by the quale enthalpy of our information theory structural equation model of trust, flexibility, expertise, top management support, and competitive advantage performance. We operationalize the integration of the aforementioned top management support, information systems competencies, and competitive advantage performance concepts into the qualia consciousness awareness and information theory quale framework.

Embracing integration and complexity: placing emotion within a science of brain and behaviour

The present paper addresses conceptual issues that are central to emotion research. What is emotion? What are its defining characteristics? The field struggles with questions like these almost constantly. I argue that definitions, and deciding what is the proper status of emotion, are not a requirement for scientific progress - in fact, they can hinder it. Therefore, "emotion" researchers should strive to develop a science of complex behaviours, and worry less about their exact nature. But for interesting behaviours, is most of the explaining that is needed present at the level of isolated systems (perception, cognition, etc.) or at the level of interactions between them? I suggest that the level of interactions is where most of the work is needed. Accordingly, I advocate that it is important to embrace integration, and not to strive to necessarily disentangle the multiple contributions underlying behaviours. More generally, it is argued that we need to revise models of causation adopted when reasoning about the mind and brain. Instead, a "complex systems" approach is required where the interactions between multiple components lead to system-level - emergent - properties that cannot be isolated or attributed to more elementary parts.

Emotion and the Interactive Brain: Insights From Comparative Neuroanatomy and Complex Systems

Although emotion is closely associated with motivation, and interacts with perception, cognition, and action, many conceptualizations still treat emotion as separate from these domains. Here, a comparative/evolutionary anatomy framework is presented to motivate the idea that long-range, distributed circuits involving the midbrain, thalamus, and forebrain are central to emotional processing. It is proposed that emotion can be understood in terms of large-scale network interactions spanning the neuroaxis that form "functionally integrated systems." At the broadest level, the argument is made that we need to move beyond a Newtonian view of causation to one involving complex systems where bidirectional influences and nonlinearities abound. Therefore, understanding interactions between subsystems and signal integration becomes central to unraveling the organization of the emotional brain.

Good Old-Fashioned Artificial Consciousness and the Intermediate Level Fallacy

Recently, there has been considerable interest and effort to the possibility to design and implement conscious robots, i.e., the chance that robots may have subjective experiences. Typical approaches as the global workspace, information integration, enaction, cognitive mechanisms, embodiment, i.e., the Good Old-Fashioned Artificial Consciousness, henceforth, GOFAC, share the same conceptual framework. In this paper, we discuss GOFAC's basic tenets and their implication for AI and Robotics. In particular, we point out the intermediate level fallacy as the central issue affecting GOFAC. Finally, we outline a possible alternative conceptual framework toward robot consciousness.

Neural Dynamics of Autistic Repetitive Behaviors and Fragile X Syndrome: Basal Ganglia Movement Gating and mGluR-Modulated Adaptively Timed Learning

This article develops the iSTART neural model that proposes how specific imbalances in cognitive, emotional, timing, and motor processes that involve brain regions like prefrontal cortex, temporal cortex, amygdala, hypothalamus, hippocampus, and cerebellum may interact together to cause behavioral symptoms of autism. These imbalances include underaroused emotional depression in the amygdala/hypothalamus, learning of hyperspecific recognition categories that help to cause narrowly focused attention in temporal and prefrontal cortices, and breakdowns of adaptively timed motivated attention and motor circuits in the hippocampus and cerebellum. The article expands the model's explanatory range by, first, explaining recent data about Fragile X syndrome (FXS), mGluR, and trace conditioning; and, second, by explaining distinct causes of stereotyped behaviors in individuals with autism. Some of these stereotyped behaviors, such as an insistence on sameness and circumscribed interests, may result from imbalances in the cognitive and emotional circuits that iSTART models. These behaviors may be ameliorated by operant conditioning methods. Other stereotyped behaviors, such as repetitive motor behaviors, may result from imbalances in how the direct and indirect pathways of the basal ganglia open or close movement gates, respectively. These repetitive behaviors may be ameliorated by drugs that augment D2 dopamine receptor responses or reduce D1 dopamine receptor responses. The article also notes the ubiquitous role of gating by basal ganglia loops in regulating all the functions that iSTART models.

Desirability, availability, credit assignment, category learning, and attention: Cognitive-emotional and working memory dynamics of orbitofrontal, ventrolateral, and dorsolateral prefrontal cortices

BACKGROUND

The prefrontal cortices play an essential role in cognitive-emotional and working memory processes through interactions with multiple brain regions.

METHODS

This article further develops a unified neural architecture that explains many recent and classical data about prefrontal function and makes testable predictions.

RESULTS

Prefrontal properties of desirability, availability, credit assignment, category learning, and feature-based attention are explained. These properties arise through interactions of orbitofrontal, ventrolateral prefrontal, and dorsolateral prefrontal cortices with the inferotemporal cortex, perirhinal cortex, parahippocampal cortices; ventral bank of the principal sulcus, ventral prearcuate gyrus, frontal eye fields, hippocampus, amygdala, basal ganglia, hypothalamus, and visual cortical areas V1, V2, V3A, V4, middle temporal cortex, medial superior temporal area, lateral intraparietal cortex, and posterior parietal cortex. Model explanations also include how the value of visual objects and events is computed, which objects and events cause desired consequences and which may be ignored as predictively irrelevant, and how to plan and act to realise these consequences, including how to selectively filter expected versus unexpected events, leading to movements towards, and conscious perception of, expected events. Modelled processes include reinforcement learning and incentive motivational learning; object and spatial working memory dynamics; and category learning, including the learning of object categories, value categories, object-value categories, and sequence categories, or list chunks.

CONCLUSION

This article hereby proposes a unified neural theory of prefrontal cortex and its functions.

Acetylcholine Neuromodulation in Normal and Abnormal Learning and Memory: Vigilance Control in Waking, Sleep, Autism, Amnesia and Alzheimer's Disease

Adaptive Resonance Theory, or ART, is a neural model that explains how normal and abnormal brains may learn to categorize and recognize objects and events in a changing world, and how these learned categories may be remembered for a long time. This article uses ART to propose and unify the explanation of diverse data about normal and abnormal modulation of learning and memory by acetylcholine (ACh). In ART, vigilance control determines whether learned categories will be general and abstract, or specific and concrete. ART models how vigilance may be regulated by ACh release in layer 5 neocortical cells by influencing after-hyperpolarization (AHP) currents. This phasic ACh release is mediated by cells in the nucleus basalis (NB) of Meynert that are activated by unexpected events. The article additionally discusses data about ACh-mediated tonic control of vigilance. ART proposes that there are often dynamic breakdowns of tonic control in mental disorders such as autism, where vigilance remains high, and medial temporal amnesia, where vigilance remains low. Tonic control also occurs during sleep-wake cycles. Properties of Up and Down states during slow wave sleep arise in ACh-modulated laminar cortical ART circuits that carry out processes in awake individuals of contrast normalization, attentional modulation, decision-making, activity-dependent habituation, and mismatch-mediated reset. These slow wave sleep circuits interact with circuits that control circadian rhythms and memory consolidation. Tonic control properties also clarify how Alzheimer's disease symptoms follow from a massive structural degeneration that includes undermining vigilance control by ACh in cortical layers 3 and 5. Sleep disruptions before and during Alzheimer's disease, and how they contribute to a vicious cycle of plaque formation in layers 3 and 5, are also clarified from this perspective.

A Network Model of the Emotional Brain

Emotion is often understood in terms of a circumscribed set of cortical and subcortical brain regions. I propose, instead, that emotion should be understood in terms of large-scale network interactions spanning the entire neuroaxis. I describe multiple anatomical and functional principles of brain organization that lead to the concept of 'functionally integrated systems', cortical-subcortical systems that anchor the organization of emotion in the brain. The proposal is illustrated by describing the cortex-amygdala integrated system and how it intersects with systems involving the ventral striatum/accumbens, septum, hippocampus, hypothalamus, and brainstem. The important role of the thalamus is also highlighted. Overall, the model clarifies why the impact of emotion is wide-ranging, and how emotion is interlocked with perception, cognition, motivation, and action.

A neural model of normal and abnormal learning and memory consolidation: adaptively timed conditioning, hippocampus, amnesia, neurotrophins, and consciousness

How do the hippocampus and amygdala interact with thalamocortical systems to regulate cognitive and cognitive-emotional learning? Why do lesions of thalamus, amygdala, hippocampus, and cortex have differential effects depending on the phase of learning when they occur? In particular, why is the hippocampus typically needed for trace conditioning, but not delay conditioning, and what do the exceptions reveal? Why do amygdala lesions made before or immediately after training decelerate conditioning while those made later do not? Why do thalamic or sensory cortical lesions degrade trace conditioning more than delay conditioning? Why do hippocampal lesions during trace conditioning experiments degrade recent but not temporally remote learning? Why do orbitofrontal cortical lesions degrade temporally remote but not recent or post-lesion learning? How is temporally graded amnesia caused by ablation of prefrontal cortex after memory consolidation? How are attention and consciousness linked during conditioning? How do neurotrophins, notably brain-derived neurotrophic factor (BDNF), influence memory formation and consolidation? Is there a common output path for learned performance? A neural model proposes a unified answer to these questions that overcome problems of alternative memory models.