1
|
Fields C. The free energy principle induces intracellular compartmentalization. Biochem Biophys Res Commun 2024; 723:150070. [PMID: 38896995 DOI: 10.1016/j.bbrc.2024.150070] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2023] [Revised: 04/24/2024] [Accepted: 05/07/2024] [Indexed: 06/21/2024]
Abstract
Living systems at all scales are compartmentalized into interacting subsystems. This paper reviews a mechanism that drives compartmentalization in generic systems at any scale. It first discusses three symmetries of generic physical interactions in a quantum-theoretic description. It then shows that if one of these, a permutation symmetry on the inter-system boundary, is spontaneously broken, the symmetry breaking is amplified by the Free Energy Principle (FEP). It thus shows how compartmentalization generically results from permutation symmetry breaking under the FEP. It finally notes that the FEP asymptotically restores the broken symmetry, showing that the FEP can be regarded as a theory of fluctuations away from a permutation-symmetric boundary, and hence from an entangled joint state of the interacting systems.
Collapse
Affiliation(s)
- Chris Fields
- Allen Discovery Center at Tufts University, Medford, MA, 02155, USA.
| |
Collapse
|
2
|
Friston KJ, Parr T, Heins C, Constant A, Friedman D, Isomura T, Fields C, Verbelen T, Ramstead M, Clippinger J, Frith CD. Federated inference and belief sharing. Neurosci Biobehav Rev 2024; 156:105500. [PMID: 38056542 PMCID: PMC11139662 DOI: 10.1016/j.neubiorev.2023.105500] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2023] [Revised: 11/08/2023] [Accepted: 12/01/2023] [Indexed: 12/08/2023]
Abstract
This paper concerns the distributed intelligence or federated inference that emerges under belief-sharing among agents who share a common world-and world model. Imagine, for example, several animals keeping a lookout for predators. Their collective surveillance rests upon being able to communicate their beliefs-about what they see-among themselves. But, how is this possible? Here, we show how all the necessary components arise from minimising free energy. We use numerical studies to simulate the generation, acquisition and emergence of language in synthetic agents. Specifically, we consider inference, learning and selection as minimising the variational free energy of posterior (i.e., Bayesian) beliefs about the states, parameters and structure of generative models, respectively. The common theme-that attends these optimisation processes-is the selection of actions that minimise expected free energy, leading to active inference, learning and model selection (a.k.a., structure learning). We first illustrate the role of communication in resolving uncertainty about the latent states of a partially observed world, on which agents have complementary perspectives. We then consider the acquisition of the requisite language-entailed by a likelihood mapping from an agent's beliefs to their overt expression (e.g., speech)-showing that language can be transmitted across generations by active learning. Finally, we show that language is an emergent property of free energy minimisation, when agents operate within the same econiche. We conclude with a discussion of various perspectives on these phenomena; ranging from cultural niche construction, through federated learning, to the emergence of complexity in ensembles of self-organising systems.
Collapse
Affiliation(s)
- Karl J Friston
- Wellcome Trust Centre for Neuroimaging, Institute of Neurology, University College London, UK; VERSES AI Research Lab, Los Angeles, CA 90016, USA.
| | - Thomas Parr
- Wellcome Trust Centre for Neuroimaging, Institute of Neurology, University College London, UK
| | - Conor Heins
- VERSES AI Research Lab, Los Angeles, CA 90016, USA; Department of Collective Behaviour, Max Planck Institute of Animal Behavior, 78457 Konstanz, Germany; Centre for the Advanced Study of Collective Behaviour, 78457 Konstanz, Germany; Department of Biology, University of Konstanz, 78457 Konstanz, Germany
| | - Axel Constant
- VERSES AI Research Lab, Los Angeles, CA 90016, USA; School of Engineering and Informatics, The University of Sussex, Brighton, UK
| | - Daniel Friedman
- Department of Entomology and Nematology, University of California, Davis, Davis, CA, USA; Active Inference Institute, Davis, CA 95616, USA
| | - Takuya Isomura
- Brain Intelligence Theory Unit, RIKEN Center for Brain Science, Wako, Saitama 351-0198, Japan
| | - Chris Fields
- Allen Discovery Center at Tufts University, Medford, MA 02155, USA
| | - Tim Verbelen
- VERSES AI Research Lab, Los Angeles, CA 90016, USA
| | - Maxwell Ramstead
- Wellcome Trust Centre for Neuroimaging, Institute of Neurology, University College London, UK; VERSES AI Research Lab, Los Angeles, CA 90016, USA
| | | | - Christopher D Frith
- Institute of Philosophy, School of Advanced Studies, University of London, UK
| |
Collapse
|
3
|
Georgiev DD. Evolution of Consciousness. Life (Basel) 2023; 14:48. [PMID: 38255663 PMCID: PMC10817314 DOI: 10.3390/life14010048] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2023] [Revised: 12/01/2023] [Accepted: 12/25/2023] [Indexed: 01/24/2024] Open
Abstract
The natural evolution of consciousness in different animal species mandates that conscious experiences are causally potent in order to confer any advantage in the struggle for survival. Any endeavor to construct a physical theory of consciousness based on emergence within the framework of classical physics, however, leads to causally impotent conscious experiences in direct contradiction to evolutionary theory since epiphenomenal consciousness cannot evolve through natural selection. Here, we review recent theoretical advances in describing sentience and free will as fundamental aspects of reality granted by quantum physical laws. Modern quantum information theory considers quantum states as a physical resource that endows quantum systems with the capacity to perform physical tasks that are classically impossible. Reductive identification of conscious experiences with the quantum information comprised in quantum brain states allows for causally potent consciousness that is capable of performing genuine choices for future courses of physical action. The consequent evolution of brain cortical networks contributes to increased computational power, memory capacity, and cognitive intelligence of the living organisms.
Collapse
Affiliation(s)
- Danko D Georgiev
- Institute for Advanced Study, 30 Vasilaki Papadopulu Str., 9010 Varna, Bulgaria
| |
Collapse
|
4
|
Ramstead MJD, Sakthivadivel DAR, Heins C, Koudahl M, Millidge B, Da Costa L, Klein B, Friston KJ. On Bayesian mechanics: a physics of and by beliefs. Interface Focus 2023; 13:20220029. [PMID: 37213925 PMCID: PMC10198254 DOI: 10.1098/rsfs.2022.0029] [Citation(s) in RCA: 22] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2022] [Accepted: 01/17/2023] [Indexed: 05/23/2023] Open
Abstract
The aim of this paper is to introduce a field of study that has emerged over the last decade, called Bayesian mechanics. Bayesian mechanics is a probabilistic mechanics, comprising tools that enable us to model systems endowed with a particular partition (i.e. into particles), where the internal states (or the trajectories of internal states) of a particular system encode the parameters of beliefs about external states (or their trajectories). These tools allow us to write down mechanical theories for systems that look as if they are estimating posterior probability distributions over the causes of their sensory states. This provides a formal language for modelling the constraints, forces, potentials and other quantities determining the dynamics of such systems, especially as they entail dynamics on a space of beliefs (i.e. on a statistical manifold). Here, we will review the state of the art in the literature on the free energy principle, distinguishing between three ways in which Bayesian mechanics has been applied to particular systems (i.e. path-tracking, mode-tracking and mode-matching). We go on to examine a duality between the free energy principle and the constrained maximum entropy principle, both of which lie at the heart of Bayesian mechanics, and discuss its implications.
Collapse
Affiliation(s)
- Maxwell J. D. Ramstead
- VERSES Research Lab, Los Angeles, CA 90016, USA
- Wellcome Centre for Human Neuroimaging, University College London, London WC1N 3AR, UK
| | - Dalton A. R. Sakthivadivel
- VERSES Research Lab, Los Angeles, CA 90016, USA
- Department of Mathematics, Stony Brook University, Stony Brook, NY, USA
- Department of Physics and Astronomy, Stony Brook University, Stony Brook, NY, USA
- Department of Biomedical Engineering, Stony Brook University, Stony Brook, NY, USA
| | - Conor Heins
- VERSES Research Lab, Los Angeles, CA 90016, USA
- Department of Collective Behaviour, Max Planck Institute of Animal Behavior, 78464 Konstanz, Germany
- Department of Biology, University of Konstanz, 78464 Konstanz, Germany
- Centre for the Advanced Study of Collective Behaviour, University of Konstanz, 78464 Konstanz, Germany
| | - Magnus Koudahl
- VERSES Research Lab, Los Angeles, CA 90016, USA
- Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, The Netherlands
| | - Beren Millidge
- VERSES Research Lab, Los Angeles, CA 90016, USA
- Brain Network Dynamics Unit, University of Oxford, Oxford, UK
| | - Lancelot Da Costa
- Wellcome Centre for Human Neuroimaging, University College London, London WC1N 3AR, UK
- Department of Mathematics, Imperial College London, London SW7 2AZ, UK
| | - Brennan Klein
- VERSES Research Lab, Los Angeles, CA 90016, USA
- Network Science Institute, Northeastern University, Boston, MA, USA
| | - Karl J. Friston
- VERSES Research Lab, Los Angeles, CA 90016, USA
- Wellcome Centre for Human Neuroimaging, University College London, London WC1N 3AR, UK
| |
Collapse
|
5
|
Fields C, Levin M. Regulative development as a model for origin of life and artificial life studies. Biosystems 2023; 229:104927. [PMID: 37211257 DOI: 10.1016/j.biosystems.2023.104927] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2022] [Revised: 05/03/2023] [Accepted: 05/08/2023] [Indexed: 05/23/2023]
Abstract
Using the formal framework of the Free Energy Principle, we show how generic thermodynamic requirements on bidirectional information exchange between a system and its environment can generate complexity. This leads to the emergence of hierarchical computational architectures in systems that operate sufficiently far from thermal equilibrium. In this setting, the environment of any system increases its ability to predict system behavior by "engineering" the system towards increased morphological complexity and hence larger-scale, more macroscopic behaviors. When seen in this light, regulative development becomes an environmentally-driven process in which "parts" are assembled to produce a system with predictable behavior. We suggest on this basis that life is thermodynamically favorable and that, when designing artificial living systems, human engineers are acting like a generic "environment".
Collapse
Affiliation(s)
- Chris Fields
- Allen Discovery Center at Tufts University, Medford, MA, 02155, USA.
| | - Michael Levin
- Allen Discovery Center at Tufts University, Medford, MA, 02155, USA; Wyss Institute for Biologically Inspired Engineering at Harvard University, Boston, MA, 02115, USA
| |
Collapse
|
6
|
Miller WB. A scale-free universal relational information matrix (N-space) reconciles the information problem: N-space as the fabric of reality. Commun Integr Biol 2023; 16:2193006. [PMID: 37188326 PMCID: PMC10177686 DOI: 10.1080/19420889.2023.2193006] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2023] [Revised: 03/14/2023] [Accepted: 03/15/2023] [Indexed: 05/17/2023] Open
Abstract
Cellular measurement is a crucial faculty in living systems, and exaptations are acknowledged as a significant source of evolutionary innovation. However, the possibility that the origin of biological order is predicated on an exaptation of the measurement of information from the abiotic realm has not been previously explored. To support this hypothesis, the existence of a universal holographic relational information space-time matrix is proposed as a scale-free unification of abiotic and biotic information systems. In this framework, information is a universal property representing the interactions between matter and energy that can be subject to observation. Since observers are also universally distributed, information can be deemed the fundamental fabric of the universe. The novel concept of compartmentalizing this universal N-space information matrix into separate N-space partitions as nodes of informational density defined by Markov blankets and boundaries is introduced, permitting their applicability to both abiotic and biotic systems. Based on these N-space partitions, abiotic systems can derive meaningful information from the conditional settlement of quantum entanglement asymmetries and coherences between separately bounded quantum informational reference frames sufficient to be construed as a form of measurement. These conditional relationships are the precursor of the reiterating nested architecture of the N-space-derived information fields that characterize life and account for biological order. Accordingly, biotic measurement and biological N-space partitioning are exaptations of preexisting information processes within abiotic systems. Abiotic and biotic states thereby reconcile as differing forms of measurement of fundamental universal information. The essential difference between abiotic and biotic states lies within the attributes of the specific observer/detectors, thereby clarifying several contentious aspects of self-referential consciousness.
Collapse
|
7
|
Graham DJ. Nine insights from internet engineering that help us understand brain network communication. FRONTIERS IN COMPUTER SCIENCE 2023. [DOI: 10.3389/fcomp.2022.976801] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/12/2023] Open
Abstract
Philosophers have long recognized the value of metaphor as a tool that opens new avenues of investigation. By seeing brains as having the goal of representation, the computer metaphor in its various guises has helped systems neuroscience approach a wide array of neuronal behaviors at small and large scales. Here I advocate a complementary metaphor, the internet. Adopting this metaphor shifts our focus from computing to communication, and from seeing neuronal signals as localized representational elements to seeing neuronal signals as traveling messages. In doing so, we can take advantage of a comparison with the internet's robust and efficient routing strategies to understand how the brain might meet the challenges of network communication. I lay out nine engineering strategies that help the internet solve routing challenges similar to those faced by brain networks. The internet metaphor helps us by reframing neuronal activity across the brain as, in part, a manifestation of routing, which may, in different parts of the system, resemble the internet more, less, or not at all. I describe suggestive evidence consistent with the brain's use of internet-like routing strategies and conclude that, even if empirical data do not directly implicate internet-like routing, the metaphor is valuable as a reference point for those investigating the difficult problem of network communication in the brain and in particular the problem of routing.
Collapse
|
8
|
Moroz LL, Romanova DY. Alternative neural systems: What is a neuron? (Ctenophores, sponges and placozoans). Front Cell Dev Biol 2022; 10:1071961. [PMID: 36619868 PMCID: PMC9816575 DOI: 10.3389/fcell.2022.1071961] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2022] [Accepted: 12/13/2022] [Indexed: 12/24/2022] Open
Abstract
How to make a neuron, a synapse, and a neural circuit? Is there only one 'design' for a neural architecture with a universally shared genomic blueprint across species? The brief answer is "No." Four early divergent lineages from the nerveless common ancestor of all animals independently evolved distinct neuroid-type integrative systems. One of these is a subset of neural nets in comb jellies with unique synapses; the second lineage is the well-known Cnidaria + Bilateria; the two others are non-synaptic neuroid systems in sponges and placozoans. By integrating scRNA-seq and microscopy data, we revise the definition of neurons as synaptically-coupled polarized and highly heterogenous secretory cells at the top of behavioral hierarchies with learning capabilities. This physiological (not phylogenetic) definition separates 'true' neurons from non-synaptically and gap junction-coupled integrative systems executing more stereotyped behaviors. Growing evidence supports the hypothesis of multiple origins of neurons and synapses. Thus, many non-bilaterian and bilaterian neuronal classes, circuits or systems are considered functional rather than genetic categories, composed of non-homologous cell types. In summary, little-explored examples of convergent neuronal evolution in representatives of early branching metazoans provide conceptually novel microanatomical and physiological architectures of behavioral controls in animals with prospects of neuro-engineering and synthetic biology.
Collapse
Affiliation(s)
- Leonid L. Moroz
- Departments of Neuroscience and McKnight Brain Institute, University of Florida, Gainesville, FL, United States
- Whitney Laboratory for Marine Bioscience, University of Florida, St. Augustine, FL, United States
| | - Daria Y. Romanova
- Institute of Higher Nervous Activity and Neurophysiology of RAS, 5A Butlerova, Moscow, Russia
| |
Collapse
|
9
|
Fields C, Friston K, Glazebrook JF, Levin M. A free energy principle for generic quantum systems. PROGRESS IN BIOPHYSICS AND MOLECULAR BIOLOGY 2022; 173:36-59. [PMID: 35618044 DOI: 10.1016/j.pbiomolbio.2022.05.006] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/26/2022] [Revised: 05/04/2022] [Accepted: 05/18/2022] [Indexed: 01/17/2023]
Abstract
The Free Energy Principle (FEP) states that under suitable conditions of weak coupling, random dynamical systems with sufficient degrees of freedom will behave so as to minimize an upper bound, formalized as a variational free energy, on surprisal (a.k.a., self-information). This upper bound can be read as a Bayesian prediction error. Equivalently, its negative is a lower bound on Bayesian model evidence (a.k.a., marginal likelihood). In short, certain random dynamical systems evince a kind of self-evidencing. Here, we reformulate the FEP in the formal setting of spacetime-background free, scale-free quantum information theory. We show how generic quantum systems can be regarded as observers, which with the standard freedom of choice assumption become agents capable of assigning semantics to observational outcomes. We show how such agents minimize Bayesian prediction error in environments characterized by uncertainty, insufficient learning, and quantum contextuality. We show that in its quantum-theoretic formulation, the FEP is asymptotically equivalent to the Principle of Unitarity. Based on these results, we suggest that biological systems employ quantum coherence as a computational resource and - implicitly - as a communication resource. We summarize a number of problems for future research, particularly involving the resources required for classical communication and for detecting and responding to quantum context switches.
Collapse
Affiliation(s)
- Chris Fields
- 23 Rue des Lavandières, 11160, Caunes Minervois, France.
| | - Karl Friston
- Wellcome Centre for Human Neuroimaging, University College London, London, WC1N 3AR, UK
| | - James F Glazebrook
- Department of Mathematics and Computer Science, Eastern Illinois University, Charleston, IL, 61920, USA; Adjunct Faculty, Department of Mathematics, University of Illinois at Urbana-Champaign, Urbana, IL, 61801, USA
| | - Michael Levin
- Allen Discovery Center at Tufts University, Medford, MA, 02155, USA
| |
Collapse
|