Experimental validation of the free-energy principle with in vitro neural networks

Active Inference and Artificial Spin Ice: Control Processes and State Selection

Theory and simulations are used to demonstrate implementation of a variational Bayes algorithm called "active inference" in interacting arrays of nanomagnetic elements. The algorithm requires stochastic elements, and a simplified model based on a magnetic artificial spin ice geometry is used to illustrate how nanomagnets can generate the required random dynamics. Examples of tracking and PID control are demonstrated and shown to be consistent with the original stochastic differential equation formulation of active inference. Interestingly, nonlinear response in the form of spikes and spike trains not predicted by the original theory can appear in the nanomagnet system for certain temperature regimes. A theoretical approach using a mean-field approximation for spin systems is proposed, which describes the transition to nonlinear response. Finally, the possibility to create simple magnetic arrays using realistic models is shown with micromagnetic simulations of a simple 17 element array of nanomagnets that include magnetic anisotropies, and exchange and dipolar interactions. Possible applications are simulated to illustrate how nanomagnetic arrays can be used as the stochastic element for feedback control of processes, investigation and control of magnetic state evolution, and as a method to optimize pulsed field magnetic switching protocols.

A Computational Account of the Development and Evolution of Psychotic Symptoms

The mechanisms of psychotic symptoms such as hallucinations and delusions are often investigated in fully formed illness, well after symptoms emerge. These investigations have yielded key insights but are not well positioned to reveal the dynamic forces underlying symptom formation itself. Understanding symptom development over time would allow us to identify steps in the pathophysiological process leading to psychosis, shifting the focus of psychiatric intervention from symptom alleviation to prevention. We propose a model for understanding the emergence of psychotic symptoms within the context of an adaptive, developing neural system. We make the case for a pathophysiological process that begins with cortical hyperexcitability and bottom-up noise transmission, which engenders inappropriate belief formation via aberrant prediction error signaling. We argue that this bottom-up noise drives learning about the (im)precision of new incoming sensory information because of diminished signal-to-noise ratio, causing a compensatory relative overreliance on prior beliefs. This overreliance on priors predisposes to hallucinations and covaries with hallucination severity. An overreliance on priors may also lead to increased conviction in the beliefs generated by bottom-up noise and drive movement toward conversion to psychosis. We identify predictions of our model at each stage, examine evidence to support or refute those predictions, and propose experiments that could falsify or help select between alternative elements of the overall model. Nesting computational abnormalities within longitudinal development allows us to account for hidden dynamics among the mechanisms driving symptom formation and to view established symptoms as a point of equilibrium among competing biological forces.

Neuronal Electrical Activity in Neuronal Networks Induced by a Focused Femtosecond Laser

The spatial propagation of neuronal activity within neuronal circuits, which is associated with brain functions, such as memory and learning, is regulated by external stimuli. Conventional external stimuli, such as electrical inputs, pharmacological treatments, and optogenetic modifications, have been used to modify neuronal activity. However, these methods are tissue invasive, have insufficient spatial resolution, and cause irreversible gene modifications. To establish neuronal stimulation with less invasiveness and higher spatial resolution, we propose and demonstrate single-neuron stimulation using a focused femtosecond laser. Fluorescence Ca2+ imaging and microelectrode array recordings of extracellular potentials revealed Ca2+ influx into the target neuron and high-frequency electrical responses after laser irradiation. These results indicate that femtosecond laser-induced neuronal electrical activity has a greater number of electrical spikes, lasts longer after stimulation, and propagates to a region more distant from the target neuron compared with the properties evoked by electrical stimulation. Focused femtosecond laser-induced stimulation can be a promising tool for stimulating single neurons in neuronal networks.

Goal-Directed Learning in Cortical Organoids

Experimental neuroscience techniques are advancing rapidly, with major recent developments in high-density electrophysiology and targeted electrical stimulation. In combination with these techniques, cortical organoids derived from pluripotent stem cells show great promise as in vitro models of brain development and function. Although sensory input is vital to neurodevelopment in vivo , few studies have explored the effect of meaningful input to in vitro neural cultures over time. In this work, we demonstrate the first example of goal-directed learning in brain organoids. We developed a closed-loop electrophysiology framework to embody mouse cortical organoids into a simulated dynamical task (the inverted pendulum problem known as 'Cartpole') and evaluate learning through high-frequency training signals. Longitudinal experiments enabled by this framework illuminate how different methods of selecting training signals enable improvement on the tasks. We found that for most organoids, training signals chosen by artificial reinforcement learning yield better performance on the task than randomly chosen training signals or the absence of a training signal. This systematic approach to studying learning mechanisms in vitro opens new possibilities for therapeutic interventions and biological computation.

A hierarchical active inference model of spatial alternation tasks and the hippocampal-prefrontal circuit

Cognitive problem-solving benefits from cognitive maps aiding navigation and planning. Physical space navigation involves hippocampal (HC) allocentric codes, while abstract task space engages medial prefrontal cortex (mPFC) task-specific codes. Previous studies show that challenging tasks, like spatial alternation, require integrating these two types of maps. The disruption of the HC-mPFC circuit impairs performance. We propose a hierarchical active inference model clarifying how this circuit solves spatial interaction tasks by bridging physical and task-space maps. Simulations demonstrate that the model's dual layers develop effective cognitive maps for physical and task space. The model solves spatial alternation tasks through reciprocal interactions between the two layers. Disrupting its communication impairs decision-making, which is consistent with empirical evidence. Additionally, the model adapts to switching between multiple alternation rules, providing a mechanistic explanation of how the HC-mPFC circuit supports spatial alternation tasks and the effects of disruption.

The free energy principle induces intracellular compartmentalization

Living systems at all scales are compartmentalized into interacting subsystems. This paper reviews a mechanism that drives compartmentalization in generic systems at any scale. It first discusses three symmetries of generic physical interactions in a quantum-theoretic description. It then shows that if one of these, a permutation symmetry on the inter-system boundary, is spontaneously broken, the symmetry breaking is amplified by the Free Energy Principle (FEP). It thus shows how compartmentalization generically results from permutation symmetry breaking under the FEP. It finally notes that the FEP asymptotically restores the broken symmetry, showing that the FEP can be regarded as a theory of fluctuations away from a permutation-symmetric boundary, and hence from an entangled joint state of the interacting systems.

Mitochondria and MICOS - function and modeling

An extensive review is presented on mitochondrial structure and function, mitochondrial proteins, the outer and inner membranes, cristae, the role of F1FO-ATP synthase, the mitochondrial contact site and cristae organizing system (MICOS), the sorting and assembly machinery morphology and function, and phospholipids, in particular cardiolipin. Aspects of mitochondrial regulation under physiological and pathological conditions are outlined, in particular the role of dysregulated MICOS protein subunit Mic60 in Parkinson's disease, the relations between mitochondrial quality control and proteins, and mitochondria as signaling organelles. A mathematical modeling approach of cristae and MICOS using mechanical beam theory is introduced and outlined. The proposed modeling is based on the premise that an optimization framework can be used for a better understanding of critical mitochondrial function and also to better map certain experiments and clinical interventions.

On Predictive Planning and Counterfactual Learning in Active Inference

Given the rapid advancement of artificial intelligence, understanding the foundations of intelligent behaviour is increasingly important. Active inference, regarded as a general theory of behaviour, offers a principled approach to probing the basis of sophistication in planning and decision-making. This paper examines two decision-making schemes in active inference based on "planning" and "learning from experience". Furthermore, we also introduce a mixed model that navigates the data complexity trade-off between these strategies, leveraging the strengths of both to facilitate balanced decision-making. We evaluate our proposed model in a challenging grid-world scenario that requires adaptability from the agent. Additionally, our model provides the opportunity to analyse the evolution of various parameters, offering valuable insights and contributing to an explainable framework for intelligent decision-making.

A computational account of the development and evolution of psychotic symptoms

The mechanisms of psychotic symptoms like hallucinations and delusions are often investigated in fully-formed illness, well after symptoms emerge. These investigations have yielded key insights, but are not well-positioned to reveal the dynamic forces underlying symptom formation itself. Understanding symptom development over time would allow us to identify steps in the pathophysiological process leading to psychosis, shifting the focus of psychiatric intervention from symptom alleviation to prevention. We propose a model for understanding the emergence of psychotic symptoms within the context of an adaptive, developing neural system. We will make the case for a pathophysiological process that begins with cortical hyperexcitability and bottom-up noise transmission, which engenders inappropriate belief formation via aberrant prediction error signaling. We will argue that this bottom-up noise drives learning about the (im)precision of new incoming sensory information because of diminished signal-to-noise ratio, causing an adaptive relative over-reliance on prior beliefs. This over-reliance on priors predisposes to hallucinations and covaries with hallucination severity. An over-reliance on priors may also lead to increased conviction in the beliefs generated by bottom-up noise and drive movement toward conversion to psychosis. We will identify predictions of our model at each stage, examine evidence to support or refute those predictions, and propose experiments that could falsify or help select between alternative elements of the overall model. Nesting computational abnormalities within longitudinal development allows us to account for hidden dynamics among the mechanisms driving symptom formation and to view established symptomatology as a point of equilibrium among competing biological forces.