1
|
Végh J, Berki ÁJ. Revisiting neural information, computing and linking capacity. MATHEMATICAL BIOSCIENCES AND ENGINEERING : MBE 2023; 20:12380-12403. [PMID: 37501447 DOI: 10.3934/mbe.2023551] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/29/2023]
Abstract
Neural information theory represents a fundamental method to model dynamic relations in biological systems. However, the notion of information, its representation, its content and how it is processed are the subject of fierce debates. Since the limiting capacity of neuronal links strongly depends on how neurons are hypothesized to work, their operating modes are revisited by analyzing the differences between the results of the communication models published during the past seven decades and those of the recently developed generalization of the classical information theory. It is pointed out that the operating mode of neurons is in resemblance with an appropriate combination of the formerly hypothesized analog and digital working modes; furthermore that not only the notion of neural information and its processing must be reinterpreted. Given that the transmission channel is passive in Shannon's model, the active role of the transfer channels (the axons) may introduce further transmission limits in addition to the limits concluded from the information theory. The time-aware operating model enables us to explain why (depending on the researcher's point of view) the operation can be considered either purely analog or purely digital.
Collapse
Affiliation(s)
| | - Ádám József Berki
- Department of Neurology, Semmelweis University, 1085 Budapest, Hungary
- János Szentágothai Doctoral School of Neurosciences, Semmelweis University, 1085 Budapest, Hungary
| |
Collapse
|
2
|
Nakajima T. Computation by inverse causality: A universal principle to produce symbols for the external reality in living systems. Biosystems 2022; 218:104692. [DOI: 10.1016/j.biosystems.2022.104692] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2021] [Revised: 04/04/2022] [Accepted: 04/29/2022] [Indexed: 11/16/2022]
|
3
|
Drukarch B, Wilhelmus MMM, Shrivastava S. The thermodynamic theory of action potential propagation: a sound basis for unification of the physics of nerve impulses. Rev Neurosci 2021; 33:285-302. [PMID: 34913622 DOI: 10.1515/revneuro-2021-0094] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2021] [Accepted: 11/12/2021] [Indexed: 11/15/2022]
Abstract
The thermodynamic theory of action potential propagation challenges the conventional understanding of the nerve signal as an exclusively electrical phenomenon. Often misunderstood as to its basic tenets and predictions, the thermodynamic theory is virtually ignored in mainstream neuroscience. Addressing a broad audience of neuroscientists, we here attempt to stimulate interest in the theory. We do this by providing a concise overview of its background, discussion of its intimate connection to Albert Einstein's treatment of the thermodynamics of interfaces and outlining its potential contribution to the building of a physical brain theory firmly grounded in first principles and the biophysical reality of individual nerve cells. As such, the paper does not attempt to advocate the superiority of the thermodynamic theory over any other approach to model the nerve impulse, but is meant as an open invitation to the neuroscience community to experimentally test the assumptions and predictions of the theory on their validity.
Collapse
Affiliation(s)
- Benjamin Drukarch
- Department of Anatomy and Neurosciences, Amsterdam Neuroscience, Amsterdam UMC, Vrije Universiteit Amsterdam, De Boelelaan 1108, 1081 HZ Amsterdam, The Netherlands
| | - Micha M M Wilhelmus
- Department of Anatomy and Neurosciences, Amsterdam Neuroscience, Amsterdam UMC, Vrije Universiteit Amsterdam, De Boelelaan 1108, 1081 HZ Amsterdam, The Netherlands
| | - Shamit Shrivastava
- Institute for Biomedical Engineering, University of Oxford, Oxford OX3 7DQ, UK
| |
Collapse
|
4
|
Le-Kim TH, Koo BI, Jo SD, Liang NW, Yang MY, Cho I, Chang JB, Wang TW, Nam YS. Artificial Taste Buds: Bioorthogonally Ligated Gustatory-Neuronal Multicellular Hybrids Enabling Intercellular Taste Signal Transmission. ACS Biomater Sci Eng 2021; 7:3783-3792. [PMID: 34324295 DOI: 10.1021/acsbiomaterials.1c00247] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Abstract
Heterogeneous tissue models require the assembly and co-culture of multiple types of cells. Our recent work demonstrated taste signal transmission from gustatory cells to neurons by grafting single-stranded DNA into the cell membrane to construct multicellular assemblies. However, the weak DNA linkage and low grafting density allowed the formation of large gustatory cell self-aggregates that cannot communicate with neurons efficiently. This article presents the construction of artificial taste buds exhibiting active intercellular taste signal transmission through the hybridization of gustatory-neuronal multicellular interfaces using bioorthogonal click chemistry. Hybrid cell clusters were formed by the self-assembly of neonatal gustatory cells displaying tetrazine with a precultured embryonic hippocampal neuronal network displaying trans-cyclooctene. A bitter taste signal transduction was provoked in gustatory cells using denatonium benzoate and transmitted to neurons as monitored by intracellular calcium ion sensing. In the multicellular hybrids, the average number of signal transmissions was five to six peaks per cell, and the signal transmission lasted for ∼5 min with a signal-to-signal gap time of 10-40 s. The frequent and extended intercellular signal transmission suggests that the cell surface modification by the bioorthogonal click chemistry is a promising approach to fabricating functional multicellular hybrid clusters potentially useful for cell-based biosensors, toxicity assays, and tissue regeneration.
Collapse
Affiliation(s)
- Trang Huyen Le-Kim
- Department of Materials Science and Engineering, Korea Advanced Institute of Science and Technology, 291 Daehak-ro, Yuseong-gu, Daejeon 34141, Republic of Korea
| | - Bon Il Koo
- Department of Materials Science and Engineering, Korea Advanced Institute of Science and Technology, 291 Daehak-ro, Yuseong-gu, Daejeon 34141, Republic of Korea
| | - Sung Duk Jo
- Department of Materials Science and Engineering, Korea Advanced Institute of Science and Technology, 291 Daehak-ro, Yuseong-gu, Daejeon 34141, Republic of Korea
| | - Nai-Wen Liang
- Department of Materials Science and Engineering, National Tsing Hua University, 101, Section 2, Kuang-Fu Road, Hsinchu, Taiwan 30013, Republic of China
| | - Moon Young Yang
- KAIST Institute for NanoCentury, Korea Advanced Institute of Science and Technology, 291 Daehak-ro, Yuseong-gu, Daejeon 34141, Republic of Korea
| | - In Cho
- Department of Materials Science and Engineering, Korea Advanced Institute of Science and Technology, 291 Daehak-ro, Yuseong-gu, Daejeon 34141, Republic of Korea
| | - Jae Byum Chang
- Department of Materials Science and Engineering, Korea Advanced Institute of Science and Technology, 291 Daehak-ro, Yuseong-gu, Daejeon 34141, Republic of Korea
| | - Tzu-Wei Wang
- Department of Materials Science and Engineering, National Tsing Hua University, 101, Section 2, Kuang-Fu Road, Hsinchu, Taiwan 30013, Republic of China
| | - Yoon Sung Nam
- Department of Materials Science and Engineering, Korea Advanced Institute of Science and Technology, 291 Daehak-ro, Yuseong-gu, Daejeon 34141, Republic of Korea.,KAIST Institute for NanoCentury, Korea Advanced Institute of Science and Technology, 291 Daehak-ro, Yuseong-gu, Daejeon 34141, Republic of Korea
| |
Collapse
|
5
|
Falandays JB, Nguyen B, Spivey MJ. Is prediction nothing more than multi-scale pattern completion of the future? Brain Res 2021; 1768:147578. [PMID: 34284021 DOI: 10.1016/j.brainres.2021.147578] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2020] [Revised: 05/28/2021] [Accepted: 06/29/2021] [Indexed: 11/18/2022]
Abstract
While the notion of the brain as a prediction machine has been extremely influential and productive in cognitive science, there are competing accounts of how best to model and understand the predictive capabilities of brains. One prominent framework is of a "Bayesian brain" that explicitly generates predictions and uses resultant errors to guide adaptation. We suggest that the prediction-generation component of this framework may involve little more than a pattern completion process. We first describe pattern completion in the domain of visual perception, highlighting its temporal extension, and show how this can entail a form of prediction in time. Next, we describe the forward momentum of entrained dynamical systems as a model for the emergence of predictive processing in non-predictive systems. Then, we apply this reasoning to the domain of language, where explicitly predictive models are perhaps most popular. Here, we demonstrate how a connectionist model, TRACE, exhibits hallmarks of predictive processing without any representations of predictions or errors. Finally, we present a novel neural network model, inspired by reservoir computing models, that is entirely unsupervised and memoryless, but nonetheless exhibits prediction-like behavior in its pursuit of homeostasis. These explorations demonstrate that brain-like systems can get prediction "for free," without the need to posit formal logical representations with Bayesian probabilities or an inference machine that holds them in working memory.
Collapse
Affiliation(s)
- J Benjamin Falandays
- Department of Cognitive and Information Sciences, University of California, Merced, United States
| | - Benjamin Nguyen
- Department of Cognitive and Information Sciences, University of California, Merced, United States
| | - Michael J Spivey
- Department of Cognitive and Information Sciences, University of California, Merced, United States.
| |
Collapse
|
6
|
The Objective Bayesian Probability that an Unknown Positive Real Variable Is Greater Than a Known Is 1/2. PHILOSOPHIES 2021. [DOI: 10.3390/philosophies6010024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
If there are two dependent positive real variables x1 and x2, and only x1 is known, what is the probability that x2 is larger versus smaller than x1? There is no uniquely correct answer according to “frequentist” and “subjective Bayesian” definitions of probability. Here we derive the answer given the “objective Bayesian” definition developed by Jeffreys, Cox, and Jaynes. We declare the standard distance metric in one dimension, d(A,B)≡|A−B|, and the uniform prior distribution, as axioms. If neither variable is known, P(x2<x1)=P(x2>x1). This appears obvious, since the state spaces x2<x1 and x2>x1 have equal size. However, if x1 is known and x2 unknown, there are infinitely more numbers in the space x2>x1 than x2<x1. Despite this asymmetry, we prove P(x2<x1∣x1)=P(x2>x1∣x1), so that x1 is the median of p(x2|x1), and x1 is statistically independent of ratio x2/x1. We present three proofs that apply to all members of a set of distributions. Each member is distinguished by the form of dependence between variables implicit within a statistical model (gamma, Gaussian, etc.), but all exhibit two symmetries in the joint distribution p(x1,x2) that are required in the absence of prior information: exchangeability of variables, and non-informative priors over the marginal distributions p(x1) and p(x2). We relate our conclusion to physical models of prediction and intelligence, where the known ’sample’ could be the present internal energy within a sensor, and the unknown the energy in its external sensory cause or future motor effect.
Collapse
|
7
|
Abstract
Pointing to similarities between challenges encountered in today's neural coding and twentieth-century behaviorism, we draw attention to lessons learned from resolving the latter. In particular, Perceptual Control Theory posits behavior as a closed-loop control process with immediate and teleological causes. With two examples, we illustrate how these ideas may also address challenges facing current neural coding paradigms.
Collapse
|
8
|
Exposure to conditions of uncertainty promotes the pursuit of amphetamine. Neuropsychopharmacology 2019; 44:274-280. [PMID: 29875447 PMCID: PMC6300556 DOI: 10.1038/s41386-018-0099-4] [Citation(s) in RCA: 68] [Impact Index Per Article: 13.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/24/2018] [Revised: 04/19/2018] [Accepted: 05/16/2018] [Indexed: 12/11/2022]
Abstract
Prior exposure to abused drugs leads to long-lasting neuroadaptations culminating in excessive drug intake. Given the comorbidity between substance use and gambling disorders, surprisingly little is known about the effects of exposure to reinforcement contingencies experienced during games of chance. As it is a central feature of these games, we characterized the effects of exposure to uncertainty on biochemical and behavioral effects normally observed in rats exposed to amphetamine. Rats in different groups were trained to nose-poke for saccharin under certain [fixed-ratio (FR)] or uncertain conditions [variable-ratio (VR)] for 55 1-h sessions. Ratios were escalated on successive sessions and rats maintained on the last ratio (FR/VR 20) for 20-25 days. Two to three weeks later, rats were tested for their locomotor or nucleus accumbens dopamine (NAcc DA) response to amphetamine or self-administration of the drug using a lever press operant. NAcc DA overflow was also assessed in additional rats during the saccharin sessions. Rats exposed to uncertainty subsequently showed a higher locomotor and NAcc DA response to amphetamine and self-administered more drug infusions relative to rats exposed to predictable reinforcement. NAcc DA levels during the saccharin sessions tracked the variance of the scheduled ratios (a measure of uncertainty). VR rats showed escalating DA overflow with increasing ratios. Exposure to uncertainty triggered neuroadaptations similar to those produced by exposure to abused drugs. As these were produced in drug naive rats both during and after exposure to uncertainty, they provide a novel common pathway to drug and behavioral addictions.
Collapse
|
9
|
Abstract
We formulate the computational processes of perception in the framework of the principle of least action by postulating the theoretical action as a time integral of the variational free energy in the neurosciences. The free energy principle is accordingly rephrased, on autopoetic grounds, as follows: all viable organisms attempt to minimize their sensory uncertainty about an unpredictable environment over a temporal horizon. By taking the variation of informational action, we derive neural recognition dynamics (RD), which by construction reduces to the Bayesian filtering of external states from noisy sensory inputs. Consequently, we effectively cast the gradient-descent scheme of minimizing the free energy into Hamiltonian mechanics by addressing only the positions and momenta of the organisms' representations of the causal environment. To demonstrate the utility of our theory, we show how the RD may be implemented in a neuronally based biophysical model at a single-cell level and subsequently in a coarse-grained, hierarchical architecture of the brain. We also present numerical solutions to the RD for a model brain and analyze the perceptual trajectories around attractors in neural state space.
Collapse
Affiliation(s)
- Chang Sub Kim
- Department of Physics, Chonnam National University, Gwangju 61186, Republic of Korea
| |
Collapse
|
10
|
Towards building a more complex view of the lateral geniculate nucleus: Recent advances in understanding its role. Prog Neurobiol 2017. [DOI: 10.1016/j.pneurobio.2017.06.002] [Citation(s) in RCA: 33] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
11
|
Theory of optimal balance predicts and explains the amplitude and decay time of synaptic inhibition. Nat Commun 2017; 8:14566. [PMID: 28281523 PMCID: PMC5353699 DOI: 10.1038/ncomms14566] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2016] [Accepted: 01/09/2017] [Indexed: 11/23/2022] Open
Abstract
Synaptic inhibition counterbalances excitation, but it is not known what constitutes optimal inhibition. We previously proposed that perfect balance is achieved when the peak of an excitatory postsynaptic potential (EPSP) is exactly at spike threshold, so that the slightest variation in excitation determines whether a spike is generated. Using simulations, we show that the optimal inhibitory postsynaptic conductance (IPSG) increases in amplitude and decay rate as synaptic excitation increases from 1 to 800 Hz. As further proposed by theory, we show that optimal IPSG parameters can be learned through anti-Hebbian rules. Finally, we compare our theoretical optima to published experimental data from 21 types of neurons, in which rates of synaptic excitation and IPSG decay times vary by factors of about 100 (5–600 Hz) and 50 (1–50 ms), respectively. From an infinite range of possible decay times, theory predicted experimental decay times within less than a factor of 2. Across a distinct set of 15 types of neuron recorded in vivo, theory predicted the amplitude of synaptic inhibition within a factor of 1.7. Thus, the theory can explain biophysical quantities from first principles. Inhibition and excitation are counterbalanced at synapses, but the conditions that constitute optimal balance are not known. Here the authors show through modelling that the properties of synaptic inhibition are fine-tuned to maintain an optimal balance in which peak excitation reaches precisely to spike threshold.
Collapse
|
12
|
Kim HR, Hong SZ, Fiorillo CD. T-type calcium channels cause bursts of spikes in motor but not sensory thalamic neurons during mimicry of natural patterns of synaptic input. Front Cell Neurosci 2015; 9:428. [PMID: 26582654 PMCID: PMC4631812 DOI: 10.3389/fncel.2015.00428] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2015] [Accepted: 10/13/2015] [Indexed: 12/30/2022] Open
Abstract
Although neurons within intact nervous systems can be classified as ‘sensory’ or ‘motor,’ it is not known whether there is any general distinction between sensory and motor neurons at the cellular or molecular levels. Here, we extend and test a theory according to which activation of certain subtypes of voltage-gated ion channel (VGC) generate patterns of spikes in neurons of motor systems, whereas VGC are proposed to counteract patterns in sensory neurons. We previously reported experimental evidence for the theory from visual thalamus, where we found that T-type calcium channels (TtCCs) did not cause bursts of spikes but instead served the function of ‘predictive homeostasis’ to maximize the causal and informational link between retinogeniculate excitation and spike output. Here, we have recorded neurons in brain slices from eight sensory and motor regions of rat thalamus while mimicking key features of natural excitatory and inhibitory post-synaptic potentials. As predicted by theory, TtCC did cause bursts of spikes in motor thalamus. TtCC-mediated responses in motor thalamus were activated at more hyperpolarized potentials and caused larger depolarizations with more spikes than in visual and auditory thalamus. Somatosensory thalamus is known to be more closely connected to motor regions relative to auditory and visual thalamus, and likewise the strength of its TtCC responses was intermediate between these regions and motor thalamus. We also observed lower input resistance, as well as limited evidence of stronger hyperpolarization-induced (‘H-type’) depolarization, in nuclei closer to motor output. These findings support our theory of a specific difference between sensory and motor neurons at the cellular level.
Collapse
Affiliation(s)
- Haram R Kim
- Department of Bio and Brain Engineering, KAIST Daejeon, South Korea
| | - Su Z Hong
- Department of Bio and Brain Engineering, KAIST Daejeon, South Korea
| | | |
Collapse
|
13
|
Contreras-Hernández E, Chávez D, Rudomin P. Dynamic synchronization of ongoing neuronal activity across spinal segments regulates sensory information flow. J Physiol 2015; 593:2343-63. [PMID: 25653206 DOI: 10.1113/jphysiol.2014.288134] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2014] [Accepted: 01/30/2015] [Indexed: 01/02/2023] Open
Abstract
Previous studies on the correlation between spontaneous cord dorsum potentials recorded in the lumbar spinal segments of anaesthetized cats suggested the operation of a population of dorsal horn neurones that modulates, in a differential manner, transmission along pathways mediating Ib non-reciprocal postsynaptic inhibition and pathways mediating primary afferent depolarization and presynaptic inhibition. In order to gain further insight into the possible neuronal mechanisms that underlie this process, we have measured changes in the correlation between the spontaneous activity of individual dorsal horn neurones and the cord dorsum potentials associated with intermittent activation of these inhibitory pathways. We found that high levels of neuronal synchronization within the dorsal horn are associated with states of incremented activity along the pathways mediating presynaptic inhibition relative to pathways mediating Ib postsynaptic inhibition. It is suggested that ongoing changes in the patterns of functional connectivity within a distributed ensemble of dorsal horn neurones play a relevant role in the state-dependent modulation of impulse transmission along inhibitory pathways, among them those involved in the central control of sensory information. This feature would allow the same neuronal network to be involved in different functional tasks.
Collapse
Affiliation(s)
- E Contreras-Hernández
- Department of Physiology, Biophysics and Neurosciences, Center of Research and Advanced Studies of the Instituto Politécnico Nacional, México
| | - D Chávez
- Department of Physiology, Biophysics and Neurosciences, Center of Research and Advanced Studies of the Instituto Politécnico Nacional, México
| | - P Rudomin
- Department of Physiology, Biophysics and Neurosciences, Center of Research and Advanced Studies of the Instituto Politécnico Nacional, México.,El Colegio Nacional, México
| |
Collapse
|
14
|
Hong SZ, Kim HR, Fiorillo CD. T-type calcium channels promote predictive homeostasis of input-output relations in thalamocortical neurons of lateral geniculate nucleus. Front Comput Neurosci 2014; 8:98. [PMID: 25221503 PMCID: PMC4147392 DOI: 10.3389/fncom.2014.00098] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2014] [Accepted: 08/01/2014] [Indexed: 12/28/2022] Open
Abstract
A general theory views the function of all neurons as prediction, and one component of this theory is that of “predictive homeostasis” or “prediction error.” It is well established that sensory systems adapt so that neuronal output maintains sensitivity to sensory input, in accord with information theory. Predictive homeostasis applies the same principle at the cellular level, where the challenge is to maintain membrane excitability at the optimal homeostatic level so that spike generation is maximally sensitive to small gradations in synaptic drive. Negative feedback is a hallmark of homeostatic mechanisms, as exemplified by depolarization-activated potassium channels. In contrast, T-type calcium channels exhibit positive feedback that appears at odds with the theory. In thalamocortical neurons of lateral geniculate nucleus (LGN), T-type channels are capable of causing bursts of spikes with an all-or-none character in response to excitation from a hyperpolarized potential. This “burst mode” would partially uncouple visual input from spike output and reduce the information spikes convey about gradations in visual input. However, past observations of T-type-driven bursts may have resulted from unnaturally high membrane excitability. Here we have mimicked within rat brain slices the patterns of synaptic conductance that occur naturally during vision. In support of the theory of predictive homeostasis, we found that T-type channels restored excitability toward its homeostatic level during periods of hyperpolarization. Thus, activation of T-type channels allowed two retinal input spikes to cause one output spike on average, and we observed almost no instances in which output count exceeded input count (a “burst”). T-type calcium channels therefore help to maintain a single optimal mode of transmission rather than creating a second mode. More fundamentally our results support the general theory, which seeks to predict the properties of a neuron's ion channels and synapses given knowledge of natural patterns of synaptic input.
Collapse
Affiliation(s)
- Su Z Hong
- Department of Bio and Brain Engineering, Korea Advanced Institute of Science and Technology Daejeon, South Korea
| | - Haram R Kim
- Department of Bio and Brain Engineering, Korea Advanced Institute of Science and Technology Daejeon, South Korea
| | - Christopher D Fiorillo
- Department of Bio and Brain Engineering, Korea Advanced Institute of Science and Technology Daejeon, South Korea
| |
Collapse
|