The growth of cognition: Free energy minimization and the embryogenesis of cortical computation

Does the brain behave like a (complex) network? I. Dynamics

Graph theory is now becoming a standard tool in system-level neuroscience. However, endowing observed brain anatomy and dynamics with a complex network structure does not entail that the brain actually works as a network. Asking whether the brain behaves as a network means asking whether network properties count. From the viewpoint of neurophysiology and, possibly, of brain physics, the most substantial issues a network structure may be instrumental in addressing relate to the influence of network properties on brain dynamics and to whether these properties ultimately explain some aspects of brain function. Here, we address the dynamical implications of complex network, examining which aspects and scales of brain activity may be understood to genuinely behave as a network. To do so, we first define the meaning of networkness, and analyse some of its implications. We then examine ways in which brain anatomy and dynamics can be endowed with a network structure and discuss possible ways in which network structure may be shown to represent a genuine organisational principle of brain activity, rather than just a convenient description of its anatomy and dynamics.

Continuity and change in neural plasticity through embryonic morphogenesis, fetal activity-dependent synaptogenesis, and infant memory consolidation

There is an apparent continuity in human neural development that can be traced to venerable themes of vertebrate morphogenesis that have shaped the evolution of the reptilian telencephalon (including both primitive three-layered cortex and basal ganglia) and then the subsequent evolution of the mammalian six-layered neocortex. In this theoretical analysis, we propose that an evolutionary-developmental analysis of these general morphogenetic themes can help to explain the embryonic development of the dual divisions of the limbic system that control the dorsal and ventral networks of the human neocortex. These include the archicortical (dorsal limbic) Papez circuits regulated by the hippocampus that organize spatial, contextual memory, as well as the paleocortical (ventral limbic) circuits that organize object memory. We review evidence that these dorsal and ventral limbic divisions are controlled by the differential actions of brainstem lemnothalamic and midbrain collothalamic arousal control systems, respectively, thereby traversing the vertebrate subcortical neuraxis. These dual control systems are first seen shaping the phyletic morphogenesis of the archicortical and paleocortical foundations of the forebrain in embryogenesis. They then provide dual modes of activity-dependent synaptic organization in the active (lemnothalamic) and quiet (collothalamic) stages of fetal sleep. Finally, these regulatory systems mature to form the major systems of memory consolidation of postnatal development, including the rapid eye movement (lemnothalamic) consolidation of implicit memory and social attachment in the first year, and then-in a subsequent stage-the non-REM (collothalamic) consolidation of explicit memory that is integral to the autonomy and individuation of the second year of life.

Body as First Teacher: The Role of Rhythmic Visceral Dynamics in Early Cognitive Development

Embodied cognition-the idea that mental states and processes should be understood in relation to one's bodily constitution and interactions with the world-remains a controversial topic within cognitive science. Recently, however, increasing interest in predictive processing theories among proponents and critics of embodiment alike has raised hopes of a reconciliation. This article sets out to appraise the unificatory potential of predictive processing, focusing in particular on embodied formulations of active inference. Our analysis suggests that most active-inference accounts invoke weak, potentially trivial conceptions of embodiment; those making stronger claims do so independently of the theoretical commitments of the active-inference framework. We argue that a more compelling version of embodied active inference can be motivated by adopting a diachronic perspective on the way rhythmic physiological activity shapes neural development in utero. According to this visceral afferent training hypothesis, early-emerging physiological processes are essential not only for supporting the biophysical development of neural structures but also for configuring the cognitive architecture those structures entail. Focusing in particular on the cardiovascular system, we propose three candidate mechanisms through which visceral afferent training might operate: (a) activity-dependent neuronal development, (b) periodic signal modeling, and (c) oscillatory network coordination.

The mesoanatomy of the cortex, minimization of free energy, and generative cognition

Capacity for generativity and unlimited association is the defining characteristic of sentience, and this capacity somehow arises from neuronal self-organization in the cortex. We have previously argued that, consistent with the free energy principle, cortical development is driven by synaptic and cellular selection maximizing synchrony, with effects manifesting in a wide range of features of mesoscopic cortical anatomy. Here, we further argue that in the postnatal stage, as more structured inputs reach the cortex, the same principles of self-organization continue to operate at multitudes of local cortical sites. The unitary ultra-small world structures that emerged antenatally can represent sequences of spatiotemporal images. Local shifts of presynapses from excitatory to inhibitory cells result in the local coupling of spatial eigenmodes and the development of Markov blankets, minimizing prediction errors in each unit's interactions with surrounding neurons. In response to the superposition of inputs exchanged between cortical areas, more complicated, potentially cognitive structures are competitively selected by the merging of units and the elimination of redundant connections that result from the minimization of variational free energy and the elimination of redundant degrees of freedom. The trajectory along which free energy is minimized is shaped by interaction with sensorimotor, limbic, and brainstem mechanisms, providing a basis for creative and unlimited associative learning.

Unification of free energy minimization, spatiotemporal energy, and dimension reduction models of V1 organization: Postnatal learning on an antenatal scaffold

Developmental selection of neurons and synapses so as to maximize pulse synchrony has recently been used to explain antenatal cortical development. Consequences of the same selection process—an application of the Free Energy Principle—are here followed into the postnatal phase in V1, and the implications for cognitive function are considered. Structured inputs transformed via lag relay in superficial patch connections lead to the generation of circumferential synaptic connectivity superimposed upon the antenatal, radial, “like-to-like” connectivity surrounding each singularity. The spatiotemporal energy and dimension reduction models of cortical feature preferences are accounted for and unified within the expanded model, and relationships of orientation preference (OP), space frequency preference (SFP), and temporal frequency preference (TFP) are resolved. The emergent anatomy provides a basis for “active inference” that includes interpolative modification of synapses so as to anticipate future inputs, as well as learn directly from present stimuli. Neurodynamic properties are those of heteroclinic networks with coupled spatial eigenmodes.

Blankets at birth: Transitional objects: Commentary on "The growth of cognition: Free energy minimization and the embryogenesis of cortical computation" by Wright and Bourke

Birth is accompanied by a complete reset of metabolic flows in the neonate, challenging the brain to fulfill the basic needs of life through action - breathing, feeding, crying. The perinatal period is fundamentally a transitional one, such that the basic conditions for thermodynamic self-regulation are re-established ex utero. Wright and Bourke lay out the core tenants of these conditions [1]; the emergence of regularities in cortical geometry and activity that allow "crisp" states. Before this can occur - in the immediate perinatal phase - electrical recordings of neonatal cortex suggest it passes through a highly critical regime - a phase transition - with disordered statistical fingerprints. The resolution of this state is a necessary condition for the more stable metabolic conditions that support the conjectures of Wright and Bourke.

Cognition coming about: Self-organisation and free-energy: Commentary on Wright, J.J. and Bourke, P.D. (2020) "The growth of cognition: Free energy minimization and the embryogenesis of cortical computation"

Wright and Bourke's compelling article rightly points out that existing models of embryogenesis fail to explain the mechanisms and functional significance of the dynamic connections among neurons. We pursue their account of Dynamic Logic by appealing to the Markov blanket formalism that underwrites the Free Energy Principle. We submit that this allows one to model embryogenesis as self-organisation in a dynamical system that minimises free-energy. The ensuing formalism may be extended to also explain the autonomous emergence of cognition, specifically in the brain, as a dynamic self-assembling process.