Neuronal spike timing adaptation described with a fractional leaky integrate-and-fire model

Fractional order memcapacitive neuromorphic elements reproduce and predict neuronal function

There is an increasing need to implement neuromorphic systems that are both energetically and computationally efficient. There is also great interest in using electric elements with memory, memelements, that can implement complex neuronal functions intrinsically. A feature not widely incorporated in neuromorphic systems is history-dependent action potential time adaptation which is widely seen in real cells. Previous theoretical work shows that power-law history dependent spike time adaptation, seen in several brain areas and species, can be modeled with fractional order differential equations. Here, we show that fractional order spiking neurons can be implemented using super-capacitors. The super-capacitors have fractional order derivative and memcapacitive properties. We implemented two circuits, a leaky integrate and fire and a Hodgkin-Huxley. Both circuits show power-law spiking time adaptation and optimal coding properties. The spiking dynamics reproduced previously published computer simulations. However, the fractional order Hodgkin-Huxley circuit showed novel dynamics consistent with criticality. We compared the responses of this circuit to recordings from neurons in the weakly-electric fish that have previously been shown to perform fractional order differentiation of their sensory input. The criticality seen in the circuit was confirmed in spontaneous recordings in the live fish. Furthermore, the circuit also predicted long-lasting stimulation that was also corroborated experimentally. Our work shows that fractional order memcapacitors provide intrinsic memory dependence that could allow implementation of computationally efficient neuromorphic devices. Memcapacitors are static elements that consume less energy than the most widely studied memristors, thus allowing the realization of energetically efficient neuromorphic devices.

Adaptive exponential integrate-and-fire model with fractal extension

The description of neuronal activity has been of great importance in neuroscience. In this field, mathematical models are useful to describe the electrophysical behavior of neurons. One successful model used for this purpose is the Adaptive Exponential Integrate-and-Fire (Adex), which is composed of two ordinary differential equations. Usually, this model is considered in the standard formulation, i.e., with integer order derivatives. In this work, we propose and study the fractal extension of Adex model, which in simple terms corresponds to replacing the integer derivative by non-integer. As non-integer operators, we choose the fractal derivatives. We explore the effects of equal and different orders of fractal derivatives in the firing patterns and mean frequency of the neuron described by the Adex model. Previous results suggest that fractal derivatives can provide a more realistic representation due to the fact that the standard operators are generalized. Our findings show that the fractal order influences the inter-spike intervals and changes the mean firing frequency. In addition, the firing patterns depend not only on the neuronal parameters but also on the order of respective fractal operators. As our main conclusion, the fractal order below the unit value increases the influence of the adaptation mechanism in the spike firing patterns.

Fractional Marcus-Hush-Chidsey-Yakopcic current-voltage model for redox-based resistive memory devices

We propose a circuit-level model combining the Marcus-Hush-Chidsey electron current equation and the Yakopcic equation for the state variable for describing resistive switching memory devices of the structure metal-ionic conductor-metal. We extend the dynamics of the state variable originally described by a first-order time derivative by introducing a fractional derivative with an arbitrary order between zero and one. We show that the extended model fits with great fidelity the current-voltage characteristic data obtained on a Si electrochemical metallization memory device with Ag-Cu alloy.

Effect of fractional derivatives on amplitude chimeras and symmetry-breaking death states in networks of limit-cycle oscillators

We study networks of coupled oscillators whose local dynamics are governed by the fractional-order versions of the paradigmatic van der Pol and Rayleigh oscillators. We show that the networks exhibit diverse amplitude chimeras and oscillation death patterns. The occurrence of amplitude chimeras in a network of van der Pol oscillators is observed for the first time. A form of amplitude chimera, namely, "damped amplitude chimera" is observed and characterized, where the size of the incoherent region(s) increases continuously in the course of time, and the oscillations of drifting units are damped continuously until they are quenched to steady state. It is found that as the order of the fractional derivative decreases, the lifetime of classical amplitude chimeras increases, and there is a critical point at which there is a transition to damped amplitude chimeras. Overall, a decrease in the order of fractional derivatives reduces the propensity to synchronization and promotes oscillation death phenomena including solitary oscillation death and chimera death patterns that were unobserved in networks of integer-order oscillators. This effect of the fractional derivatives is verified by the stability analysis based on the properties of the master stability function of some collective dynamical states calculated from the block-diagonalized variational equations of the coupled systems. The present study generalizes the results of our recently studied network of fractional-order Stuart-Landau oscillators.

Diverse electrical responses in a network of fractional-order conductance-based excitable Morris-Lecar systems

The diverse excitabilities of cells often produce various spiking-bursting oscillations that are found in the neural system. We establish the ability of a fractional-order excitable neuron model with Caputo's fractional derivative to analyze the effects of its dynamics on the spike train features observed in our results. The significance of this generalization relies on a theoretical framework of the model in which memory and hereditary properties are considered. Employing the fractional exponent, we first provide information about the variations in electrical activities. We deal with the 2D class I and class II excitable Morris-Lecar (M-L) neuron models that show the alternation of spiking and bursting features including MMOs & MMBOs of an uncoupled fractional-order neuron. We then extend the study with the 3D slow-fast M-L model in the fractional domain. The considered approach establishes a way to describe various characteristics similarities between fractional-order and classical integer-order dynamics. Using the stability and bifurcation analysis, we discuss different parameter spaces where the quiescent state emerges in uncoupled neurons. We show the characteristics consistent with the analytical results. Next, the Erdös-Rényi network of desynchronized mixed neurons (oscillatory and excitable) is constructed that is coupled through membrane voltage. It can generate complex firing activities where quiescent neurons start to fire. Furthermore, we have shown that increasing coupling can create cluster synchronization, and eventually it can enable the network to fire in unison. Based on cluster synchronization, we develop a reduced-order model which can capture the activities of the entire network. Our results reveal that the effect of fractional-order depends on the synaptic connectivity and the memory trace of the system. Additionally, the dynamics captures spike frequency adaptation and spike latency that occur over multiple timescales as the effects of fractional derivative, which has been observed in neural computation.

A directionally selective collision-sensing visual neural network based on fractional-order differential operator

In this paper, we propose a directionally selective fractional-order lobular giant motion detector (LGMD) visual neural network. Unlike most collision-sensing network models based on LGMDs, our model can not only sense collision threats but also obtain the motion direction of the collision object. Firstly, this paper simulates the membrane potential response of neurons using the fractional-order differential operator to generate reliable collision response spikes. Then, a new correlation mechanism is proposed to obtain the motion direction of objects. Specifically, this paper performs correlation operation on the signals extracted from two pixels, utilizing the temporal delay of the signals to obtain their position relationship. In this way, the response characteristics of direction-selective neurons can be characterized. Finally, ON/OFF visual channels are introduced to encode increases and decreases in brightness, respectively, thereby modeling the bipolar response of special neurons. Extensive experimental results show that the proposed visual neural system conforms to the response characteristics of biological LGMD and direction-selective neurons, and that the performance of the system is stable and reliable.

Stability Analysis for a Fractional-Order Coupled FitzHugh–Nagumo-Type Neuronal Model

The aim of this work is to describe the dynamics of a fractional-order coupled FitzHugh–Nagumo neuronal model. The equilibrium states are analyzed in terms of their stability properties, both dependently and independently of the fractional orders of the Caputo derivatives, based on recently established theoretical results. Numerical simulations are shown to clarify and exemplify the theoretical results.

Memristive LIF Spiking Neuron Model and Its Application in Morse Code

The leaky integrate-and-fire (LIF) spiking model can successively mimic the firing patterns and information propagation of a biological neuron. It has been applied in neural networks, cognitive computing, and brain-inspired computing. Due to the resistance variability and the natural storage capacity of the memristor, the LIF spiking model with a memristor (MLIF) is presented in this article to simulate the function and working mode of neurons in biological systems. First, the comparison between the MLIF spiking model and the LIF spiking model is conducted. Second, it is experimentally shown that a single memristor could mimic the function of the integration and filtering of the dendrite and emulate the function of the integration and firing of the soma. Finally, the feasibility of the proposed MLIF spiking model is verified by the generation and recognition of Morse code. The experimental results indicate that the presented MLIF model efficiently performs good biological frequency adaptation, high firing frequency, and rich spiking patterns. A memristor can be used as the dendrite and the soma, and the MLIF spiking model can emulate the axon. The constructed single neuron can efficiently complete the generation and propagation of firing patterns.

Synchronization in a Multiplex Network of Nonidentical Fractional-Order Neurons

Fractional-order neuronal models that include memory effects can describe the rich dynamics of the firing of the neurons. This paper studies synchronization problems in a multiple network of Caputo–Fabrizio type fractional order neurons in which the orders of the derivatives in the layers are different. It is observed that the intralayer synchronization state occurs in weaker intralayer couplings when using nonidentical fractional-order derivatives rather than integer-order or identical fractional orders. Furthermore, the needed interlayer coupling strength for interlayer near synchronization decreases for lower fractional orders. The dynamics of the neurons in nonidentical layers are also considered. It is shown that in lower fractional orders, the neurons’ dynamics change to periodic when the near synchronization state occurs. Moreover, decreasing the derivative order leads to incrementing the frequency of the bursts in the synchronization manifold, which is in contrast to the behavior of the single neuron.

Vibrational Resonance and Electrical Activity Behavior of a Fractional-Order FitzHugh–Nagumo Neuron System

Making use of the numerical simulation method, the phenomenon of vibrational resonance and electrical activity behavior of a fractional-order FitzHugh–Nagumo neuron system excited by two-frequency periodic signals are investigated. Based on the definition and properties of the Caputo fractional derivative, the fractional L1 algorithm is applied to numerically simulate the phenomenon of vibrational resonance in the neuron system. Compared with the integer-order neuron model, the fractional-order neuron model can relax the requirement for the amplitude of the high-frequency signal and induce the phenomenon of vibrational resonance by selecting the appropriate fractional exponent. By introducing the time-delay feedback, it can be found that the vibrational resonance will occur with periods in the fractional-order neuron system, i.e., the amplitude of the low-frequency response periodically changes with the time-delay feedback. The weak low-frequency signal in the system can be significantly enhanced by selecting the appropriate time-delay parameter and the fractional exponent. In addition, the original integer-order model is extended to the fractional-order model, and the neuron system will exhibit rich dynamical behaviors, which provide a broader understanding of the neuron system.

Dendritic Organic Electrochemical Transistors Grown by Electropolymerization for 3D Neuromorphic Engineering

One of the major limitations of standard top-down technologies used in today's neuromorphic engineering is their inability to map the 3D nature of biological brains. Here, it is shown how bipolar electropolymerization can be used to engineer 3D networks of PEDOT:PSS dendritic fibers. By controlling the growth conditions of the electropolymerized material, it is investigated how dendritic fibers can reproduce structural plasticity by creating structures of controllable shape. Gradual topologies evolution is demonstrated in a multielectrode configuration. A detailed electrical characterization of the PEDOT:PSS dendrites is conducted through DC and impedance spectroscopy measurements and it is shown how organic electrochemical transistors (OECT) can be realized with these structures. These measurements reveal that quasi-static and transient response of OECTs can be adjusted by controlling dendrites' morphologies. The unique properties of organic dendrites are used to demonstrate short-term, long-term, and structural plasticity, which are essential features required for future neuromorphic hardware development.

NEO: NEuro-Inspired Optimization-A Fractional Time Series Approach

Solving optimization problems is a recurrent theme across different fields, including large-scale machine learning systems and deep learning. Often in practical applications, we encounter objective functions where the Hessian is ill-conditioned, which precludes us from using optimization algorithms utilizing second-order information. In this paper, we propose to use fractional time series analysis methods that have successfully been used to model neurophysiological processes in order to circumvent this issue. In particular, the long memory property of fractional time series exhibiting non-exponential power-law decay of trajectories seems to model behavior associated with the local curvature of the objective function at a given point. Specifically, we propose a NEuro-inspired Optimization (NEO) method that leverages this behavior, which contrasts with the short memory characteristics of currently used methods (e.g., gradient descent and heavy-ball). We provide evidence of the efficacy of the proposed method on a wide variety of settings implicitly found in practice.

Chaos in memory function of sleep: A nonlinear dynamical analysis in thalamocortical study

Studying the dynamical behaviors of neuronal models may help in better understanding of real nervous system. In addition, it can help researchers to understand some specific phenomena in neuronal system. The thalamocortical network is made of neurons in the thalamus and cortex. In it, the memory function is consolidated in sleep by creating up and down state oscillations (1 Hz) and fast (13-17 Hz) - slow (8-12 Hz) spindles. Recently, a nonlinear biological model for up-down oscillations and fast-slow spindles of the thalamocortical network has been proposed. In this research, the power spectral for the fast-slow spindle of the model is extracted. Dynamical properties of the model, such as the bifurcation diagrams, and attractors are investigated. The results show that the variation of the synaptic power between the excitatory neurons of the cortex and the reticular neurons in the thalamus changes the spindles' activity. According to previous experimental findings, it is an essential rule for consolidating the memory function during sleep. It is also pointed out that when the fast-slow spindles of the brain increase, the dynamics of the thalamocortical system tend to chaos.

Possibility of information encoding/decoding using the memory effect in fractional-order capacitive devices

In this study, we show that the discharge voltage pattern of a supercapacitor exhibiting fractional-order behavior from the same initial steady-state voltage into a constant resistor is dependent on the past charging voltage profile. The charging voltage was designed to follow a power-law function, i.e. \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$v_c(t)=V_{cc} \left( {t}/{t_{ss}}\right) ^p \;(0<t \leqslant t_{ss})$$\end{document}vc(t)=Vcct/tssp(0<t⩽tss), in which \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$t_{ss}$$\end{document}tss (charging time duration between zero voltage to the terminal voltage \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$V_{cc}$$\end{document}Vcc) and p (\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$0<p<1$$\end{document}0<p<1) act as two variable parameters. We used this history-dependence of the dynamic behavior of the device to uniquely retrieve information pre-coded in the charging waveform pattern. Furthermore, we provide an analytical model based on fractional calculus that explains phenomenologically the information storage mechanism. The use of this intrinsic material memory effect may lead to new types of methods for information storage and retrieval.

Statistical moments of the interspike intervals for a neuron model driven by trichotomous noise

The influence of a colored three-level input noise (trichotomous noise) on the spike generation of a perfect integrate-and-fire (PIF) model of neurons is studied. Using a first-passage-time formulation, exact expressions for the Laplace transform of the output interspike interval (ISI) density and for the statistical moments of the ISIs (such as the coefficient of variation, the skewness, the serial correlation coefficient, and the Fano factor) are derived. To model the anomalous subdiffusion that can arise from, e.g., the trapping properties of dendritic spines, the model is extended by including a random operational time in the form of an inverse strictly increasing Lévy-type subordinator, and exact formulas for ISI statistics are given for this case as well. Particularly, it is shown that at some parameter regimes, the ISI density exhibits a three-modal structure. The results for the extended model show that the ISI serial correlation coefficient and the Fano factor are nonmonotonic with respect to the input current, which indicates that at an intermediate value of the input current the variability of the output spike trains is minimal. Similarities and differences between the behavior of the presented models and the previously investigated PIF models driven by dichotomous noise are also discussed.

A New Spiking Convolutional Recurrent Neural Network (SCRNN) With Applications to Event-Based Hand Gesture Recognition

The combination of neuromorphic visual sensors and spiking neural network offers a high efficient bio-inspired solution to real-world applications. However, processing event- based sequences remains challenging because of the nature of their asynchronism and sparsity behavior. In this paper, a novel spiking convolutional recurrent neural network (SCRNN) architecture that takes advantage of both convolution operation and recurrent connectivity to maintain the spatial and temporal relations from event-based sequence data are presented. The use of recurrent architecture enables the network to have a sampling window with an arbitrary length, allowing the network to exploit temporal correlations between event collections. Rather than standard ANN to SNN conversion techniques, the network utilizes a supervised Spike Layer Error Reassignment (SLAYER) training mechanism that allows the network to adapt to neuromorphic (event-based) data directly. The network structure is validated on the DVS gesture dataset and achieves a 10 class gesture recognition accuracy of 96.59% and an 11 class gesture recognition accuracy of 90.28%.

Stability Results for Two-Dimensional Systems of Fractional-Order Difference Equations

Linear autonomous incommensurate systems that consist of two fractional-order difference equations of Caputo-type are studied in terms of their asymptotic stability and instability properties. More precisely, the asymptotic stability of the considered linear system is fully characterized, in terms of the fractional orders of the considered Caputo-type differences, as well as the elements of the linear system’s matrix and the discretization step size. Moreover, fractional-order-independent sufficient conditions are also derived for the instability of the system under investigation. With the aim of exemplifying the theoretical results, a fractional-order discrete version of the FitzHugh–Nagumo neuronal model is constructed and analyzed. Furthermore, numerical simulations are undertaken in order to substantiate the theoretical findings, showing that the membrane potential may exhibit complex bursting behavior for suitable choices of the model parameters and fractional orders of the Caputo-type differences.

Fractional Lotka-Volterra-Type Cooperation Models: Impulsive Control on Their Stability Behavior

We present a biological fractional n-species delayed cooperation model of Lotka-Volterra type. The considered fractional derivatives are in the Caputo sense. Impulsive control strategies are applied for several stability properties of the states, namely Mittag-Leffler stability, practical stability and stability with respect to sets. The proposed results extend the existing stability results for integer-order n-species delayed Lotka-Volterra cooperation models to the fractional-order case under impulsive control.

Effects of transient subordinators on the firing statistics of a neuron model driven by dichotomous noise

The behavior of a stochastic perfect integrate-and-fire (PIF) model of neurons is considered. The effect of temporally correlated random activity of synaptic inputs is modeled as a combination of an asymmetric dichotomous noise and a random operation time in the form of an inverse strictly increasing Lévy-type subordinator. Using a first-passage-time formulation, we find exact expressions for the output interspike interval (ISI) statistics. Particularly, it is shown that at some parameter regimes the ISI density exhibits a multimodal structure. Moreover, it is demonstrated that the coefficient of variation, the serial correlation coefficient, and the Fano factor display a nonmonotonic dependence on the mean input current μ, i.e., the ISI's regularity is maximized at an intermediate value of μ. The features of spike statistics, analytically revealed in our study, are compared with previously obtained results for a perfect integrate-and-fire neuron model driven by dichotomous noise (without subordination).

Emergence of bursting in a network of memory dependent excitable and spiking leech-heart neurons

Excitable cells often produce different oscillatory activities that help us to understand the transmitting and processing of signals in the neural system. The diverse excitabilities of an individual neuron can be reproduced by a fractional-order biophysical model that preserves several previous memory effects. However, it is not completely clear to what extent the fractional-order dynamics changes the firing properties of excitable cells. In this article, we investigate the alternation of spiking and bursting phenomena of an uncoupled and coupled fractional leech-heart (L-H) neurons. We show that a complete graph of heterogeneous de-synchronized neurons in the backdrop of diverse memory settings (a mixture of integer and fractional exponents) can eventually lead to bursting with the formation of cluster synchronization over a certain threshold of coupling strength, however, the uncoupled L-H neurons cannot reveal bursting dynamics. Using the stability analysis in fractional domain, we demarcate the parameter space where the quiescent or steady-state emerges in uncoupled L-H neuron. Finally, a reduced-order model is introduced to capture the activities of the large network of fractional-order model neurons.

Firing activities of a fractional-order FitzHugh-Rinzel bursting neuron model and its coupled dynamics

Fractional-order dynamics of excitable systems can be physically described as a memory dependent phenomenon. It can produce diverse and fascinating oscillatory patterns for certain types of neuron models. To address these characteristics, we consider a nonlinear fast-slow FitzHugh-Rinzel (FH-R) model that exhibits elliptic bursting at a fixed set of parameters with a constant input current. The generalization of this classical order model provides a wide range of neuronal responses (regular spiking, fast-spiking, bursting, mixed-mode oscillations, etc.) in understanding the single neuron dynamics. So far, it is not completely understood to what extent the fractional-order dynamics may redesign the firing properties of excitable systems. We investigate how the classical order system changes its complex dynamics and how the bursting changes to different oscillations with stability and bifurcation analysis depending on the fractional exponent (0 < α ≤ 1). This occurs due to the memory trace of the fractional-order dynamics. The firing frequency of the fractional-order FH-R model is less than the classical order model, although the first spike latency exists there. Further, we investigate the responses of coupled FH-R neurons with small coupling strengths that synchronize at specific fractional-orders. The interesting dynamical characteristics suggest various neurocomputational features that can be induced in this fractional-order system which enriches the functional neuronal mechanisms.

Integrating the Allen Brain Institute Cell Types Database into Automated Neuroscience Workflow

We developed software tools to download, extract features, and organize the Cell Types Database from the Allen Brain Institute (ABI) in order to integrate its whole cell patch clamp characterization data into the automated modeling/data analysis cycle. To expand the potential user base we employed both Python and MATLAB. The basic set of tools downloads selected raw data and extracts cell, sweep, and spike features, using ABI's feature extraction code. To facilitate data manipulation we added a tool to build a local specialized database of raw data plus extracted features. Finally, to maximize automation, we extended our NeuroManager workflow automation suite to include these tools plus a separate investigation database. The extended suite allows the user to integrate ABI experimental and modeling data into an automated workflow deployed on heterogeneous computer infrastructures, from local servers, to high performance computing environments, to the cloud. Since our approach is focused on workflow procedures our tools can be modified to interact with the increasing number of neuroscience databases being developed to cover all scales and properties of the nervous system.

Colored noise and a stochastic fractional model for correlated inputs and adaptation in neuronal firing

High variability in the neuronal response to stimulations and the adaptation phenomenon cannot be explained by the standard stochastic leaky integrate-and-fire model. The main reason is that the uncorrelated inputs involved in the model are not realistic. There exists some form of dependency between the inputs, and it can be interpreted as memory effects. In order to include these physiological features in the standard model, we reconsider it with time-dependent coefficients and correlated inputs. Due to its hard mathematical tractability, we perform simulations of it for a wide investigation of its output. A Gauss-Markov process is constructed for approximating its non-Markovian dynamics. The first passage time probability density of such a process can be numerically evaluated, and it can be used to fit the histograms of simulated firing times. Some estimates of the moments of firing times are also provided. The effect of the correlation time of the inputs on firing densities and on firing rates is shown. An exponential probability density of the first firing time is estimated for low values of input current and high values of correlation time. For comparison, a simulation-based investigation is also carried out for a fractional stochastic model that allows to preserve the memory of the time evolution of the neuronal membrane potential. In this case, the memory parameter that affects the firing activity is the fractional derivative order. In both models an adaptation level of spike frequency is attained, even if along different modalities. Comparisons and discussion of the obtained results are provided.

An integrate-and-fire model to generate spike trains with long-range dependence

Long-range dependence (LRD) has been observed in a variety of phenomena in nature, and for several years also in the spiking activity of neurons. Often, this is interpreted as originating from a non-Markovian system. Here we show that a purely Markovian integrate-and-fire (IF) model, with a noisy slow adaptation term, can generate interspike intervals (ISIs) that appear as having LRD. However a proper analysis shows that this is not the case asymptotically. For comparison, we also consider a new model of individual IF neuron with fractional (non-Markovian) noise. The correlations of its spike trains are studied and proven to have LRD, unlike classical IF models. On the other hand, to correctly measure long-range dependence, it is usually necessary to know if the data are stationary. Thus, a methodology to evaluate stationarity of the ISIs is presented and applied to the various IF models. We explain that Markovian IF models may seem to have LRD because of non-stationarities.

Memory in a fractional-order cardiomyocyte model alters properties of alternans and spontaneous activity

Cardiac memory is the dependence of electrical activity on the prior history of one or more system state variables, including transmembrane potential (V_m), ionic current gating, and ion concentrations. While prior work has represented memory either phenomenologically or with biophysical detail, in this study, we consider an intermediate approach of a minimal three-variable cardiomyocyte model, modified with fractional-order dynamics, i.e., a differential equation of order between 0 and 1, to account for history-dependence. Memory is represented via both capacitive memory, due to fractional-order V_m dynamics, that arises due to non-ideal behavior of membrane capacitance; and ionic current gating memory, due to fractional-order gating variable dynamics, that arises due to gating history-dependence. We perform simulations for varying V_m and gating variable fractional-orders and pacing cycle length and measure action potential duration (APD) and incidence of alternans, loss of capture, and spontaneous activity. In the absence of ionic current gating memory, we find that capacitive memory, i.e., decreased V_m fractional-order, typically shortens APD, suppresses alternans, and decreases the minimum cycle length (MCL) for loss of capture. However, in the presence of ionic current gating memory, capacitive memory can prolong APD, promote alternans, and increase MCL. Further, we find that reduced V_m fractional order (typically less than 0.75) can drive phase 4 depolarizations that promote spontaneous activity. Collectively, our results demonstrate that memory reproduced by a fractional-order model can play a role in alternans formation and pacemaking, and in general, can greatly increase the range of electrophysiological characteristics exhibited by a minimal model.

Combining Theory, Model, and Experiment to Explain How Intrinsic Theta Rhythms Are Generated in an In Vitro Whole Hippocampus Preparation without Oscillatory Inputs

Scientists have observed local field potential theta rhythms (3-12 Hz) in the hippocampus for decades, but understanding the mechanisms underlying their generation is complicated by their diversity in pharmacological and frequency profiles. In addition, interactions with other brain structures and oscillatory drives to the hippocampus during distinct brain states has made it difficult to identify hippocampus-specific properties directly involved in theta generation. To overcome this, we develop cellular-based network models using a whole hippocampus in vitro preparation that spontaneously generates theta rhythms. Building on theoretical and computational analyses, we find that spike frequency adaptation and postinhibitory rebound constitute a basis for theta generation in large, minimally connected CA1 pyramidal (PYR) cell network models with fast-firing parvalbumin-positive (PV⁺) inhibitory cells. Sparse firing of PYR cells and large excitatory currents onto PV⁺ cells are present as in experiments. The particular theta frequency is more controlled by PYR-to-PV⁺ cell interactions rather than PV⁺-to-PYR cell interactions. We identify two scenarios by which theta rhythms can emerge, and they can be differentiated by the ratio of excitatory to inhibitory currents to PV⁺ cells, but not to PYR cells. Only one of the scenarios is consistent with data from the whole hippocampus preparation, which leads to the prediction that the connection probability from PV⁺ to PYR cells needs to be larger than from PYR to PV⁺ cells. Our models can serve as a platform on which to build and develop an understanding of in vivo theta generation.

Population density equations for stochastic processes with memory kernels

We present a method for solving population density equations (PDEs)--a mean-field technique describing homogeneous populations of uncoupled neurons-where the populations can be subject to non-Markov noise for arbitrary distributions of jump sizes. The method combines recent developments in two different disciplines that traditionally have had limited interaction: computational neuroscience and the theory of random networks. The method uses a geometric binning scheme, based on the method of characteristics, to capture the deterministic neurodynamics of the population, separating the deterministic and stochastic process cleanly. We can independently vary the choice of the deterministic model and the model for the stochastic process, leading to a highly modular numerical solution strategy. We demonstrate this by replacing the master equation implicit in many formulations of the PDE formalism by a generalization called the generalized Montroll-Weiss equation-a recent result from random network theory-describing a random walker subject to transitions realized by a non-Markovian process. We demonstrate the method for leaky- and quadratic-integrate and fire neurons subject to spike trains with Poisson and gamma-distributed interspike intervals. We are able to model jump responses for both models accurately to both excitatory and inhibitory input under the assumption that all inputs are generated by one renewal process.

Fractional-order leaky integrate-and-fire model with long-term memory and power law dynamics

Pyramidal neurons produce different spiking patterns to process information, communicate with each other and transform information. These spiking patterns have complex and multiple time scale dynamics that have been described with the fractional-order leaky integrate-and-Fire (FLIF) model. Models with fractional (non-integer) order differentiation that generalize power law dynamics can be used to describe complex temporal voltage dynamics. The main characteristic of FLIF model is that it depends on all past values of the voltage that causes long-term memory. The model produces spikes with high interspike interval variability and displays several spiking properties such as upward spike-frequency adaptation and long spike latency in response to a constant stimulus. We show that the subthreshold voltage and the firing rate of the fractional-order model make transitions from exponential to power law dynamics when the fractional order α decreases from 1 to smaller values. The firing rate displays different types of spike timing adaptation caused by changes on initial values. We also show that the voltage-memory trace and fractional coefficient are the causes of these different types of spiking properties. The voltage-memory trace that represents the long-term memory has a feedback regulatory mechanism and affects spiking activity. The results suggest that fractional-order models might be appropriate for understanding multiple time scale neuronal dynamics. Overall, a neuron with fractional dynamics displays history dependent activities that might be very useful and powerful for effective information processing.

Modulation of neuronal dynamic range using two different adaptation mechanisms

The capability of neurons to discriminate between intensity of external stimulus is measured by its dynamic range. A larger dynamic range indicates a greater probability of neuronal survival. In this study, the potential roles of adaptation mechanisms (ion currents) in modulating neuronal dynamic range were numerically investigated. Based on the adaptive exponential integrate-and-fire model, which includes two different adaptation mechanisms, i.e. subthreshold and suprathreshold (spike-triggered) adaptation, our results reveal that the two adaptation mechanisms exhibit rather different roles in regulating neuronal dynamic range. Specifically, subthreshold adaptation acts as a negative factor that observably decreases the neuronal dynamic range, while suprathreshold adaptation has little influence on the neuronal dynamic range. Moreover, when stochastic noise was introduced into the adaptation mechanisms, the dynamic range was apparently enhanced, regardless of what state the neuron was in, e.g. adaptive or non-adaptive. Our model results suggested that the neuronal dynamic range can be differentially modulated by different adaptation mechanisms. Additionally, noise was a non-ignorable factor, which could effectively modulate the neuronal dynamic range.

SK channel subtypes enable parallel optimized coding of behaviorally relevant stimulus attributes: A review

Ion channels play essential roles toward determining how neurons respond to sensory input to mediate perception and behavior. Small conductance calcium-activated potassium (SK) channels are found ubiquitously throughout the brain and have been extensively characterized both molecularly and physiologically in terms of structure and function. It is clear that SK channels are key determinants of neural excitability as they mediate important neuronal response properties such as spike frequency adaptation. However, the functional roles of the different known SK channel subtypes are not well understood. Here we review recent evidence from the electrosensory system of weakly electric fish suggesting that the function of different SK channel subtypes is to optimize the processing of independent but behaviorally relevant stimulus attributes. Indeed, natural sensory stimuli frequently consist of a fast time-varying waveform (i.e., the carrier) whose amplitude (i.e., the envelope) varies slowly and independently. We first review evidence showing how somatic SK2 channels mediate tuning and responses to carrier waveforms. We then review evidence showing how dendritic SK1 channels instead determine tuning and optimize responses to envelope waveforms based on their statistics as found in the organism's natural environment in an independent fashion. The high degree of functional homology between SK channels in electric fish and their mammalian orthologs, as well as the many important parallels between the electrosensory system and the mammalian visual, auditory, and vestibular systems, suggest that these functional roles are conserved across systems and species.

Power-Law Dynamics of Membrane Conductances Increase Spiking Diversity in a Hodgkin-Huxley Model

We studied the effects of non-Markovian power-law voltage dependent conductances on the generation of action potentials and spiking patterns in a Hodgkin-Huxley model. To implement slow-adapting power-law dynamics of the gating variables of the potassium, n, and sodium, m and h, conductances we used fractional derivatives of order η≤1. The fractional derivatives were used to solve the kinetic equations of each gate. We systematically classified the properties of each gate as a function of η. We then tested if the full model could generate action potentials with the different power-law behaving gates. Finally, we studied the patterns of action potential that emerged in each case. Our results show the model produces a wide range of action potential shapes and spiking patterns in response to constant current stimulation as a function of η. In comparison with the classical model, the action potential shapes for power-law behaving potassium conductance (n gate) showed a longer peak and shallow hyperpolarization; for power-law activation of the sodium conductance (m gate), the action potentials had a sharp rise time; and for power-law inactivation of the sodium conductance (h gate) the spikes had wider peak that for low values of η replicated pituitary- and cardiac-type action potentials. With all physiological parameters fixed a wide range of spiking patterns emerged as a function of the value of the constant input current and η, such as square wave bursting, mixed mode oscillations, and pseudo-plateau potentials. Our analyses show that the intrinsic memory trace of the fractional derivative provides a negative feedback mechanism between the voltage trace and the activity of the power-law behaving gate variable. As a consequence, power-law behaving conductances result in an increase in the number of spiking patterns a neuron can generate and, we propose, expand the computational capacity of the neuron.

There is increasing evidence that the activity of individual membrane ion channels, conductances, and the firing rate of neurons are history dependent. In this work we studied how history dependent activation of membrane conductances affect the action potential activity of the Hodgkin-Huxley model, a widely used model of action potential generation. In order to implement history dependent activation, we made use of fractional order differential equations. This type of history dependent differential equations are increasingly being used in biomedical sciences to simulate complex phenomena. We use fractional order derivatives to model the kinetic dynamics of the gate variables for the potassium and sodium conductances of the Hodgkin-Huxley model. Our results show that power-law dynamics of the different gate variables result in a wide range of action potential shapes and spiking patterns, even in the case where the model was stimulated with constant current. As a consequence, power-law behaving conductances result in an increase in the number of spiking patterns a neuron can generate and, we propose, expand the computational capacity of the neuron.

Incorporating spike-rate adaptation into a rate code in mathematical and biological neurons

For a slowly varying stimulus, the simplest relationship between a neuron's input and output is a rate code, in which the spike rate is a unique function of the stimulus at that instant. In the case of spike-rate adaptation, there is no unique relationship between input and output, because the spike rate at any time depends both on the instantaneous stimulus and on prior spiking (the "history"). To improve the decoding of spike trains produced by neurons that show spike-rate adaptation, we developed a simple scheme that incorporates "history" into a rate code. We utilized this rate-history code successfully to decode spike trains produced by 1) mathematical models of a neuron in which the mechanism for adaptation (IAHP) is specified, and 2) the gastropyloric receptor (GPR2), a stretch-sensitive neuron in the stomatogastric nervous system of the crab Cancer borealis, that exhibits long-lasting adaptation of unknown origin. Moreover, when we modified the spike rate either mathematically in a model system or by applying neuromodulatory agents to the experimental system, we found that changes in the rate-history code could be related to the biophysical mechanisms responsible for altering the spiking.

Membrane capacitive memory alters spiking in neurons described by the fractional-order Hodgkin-Huxley model

Excitable cells and cell membranes are often modeled by the simple yet elegant parallel resistor-capacitor circuit. However, studies have shown that the passive properties of membranes may be more appropriately modeled with a non-ideal capacitor, in which the current-voltage relationship is given by a fractional-order derivative. Fractional-order membrane potential dynamics introduce capacitive memory effects, i.e., dynamics are influenced by a weighted sum of the membrane potential prior history. However, it is not clear to what extent fractional-order dynamics may alter the properties of active excitable cells. In this study, we investigate the spiking properties of the neuronal membrane patch, nerve axon, and neural networks described by the fractional-order Hodgkin-Huxley neuron model. We find that in the membrane patch model, as fractional-order decreases, i.e., a greater influence of membrane potential memory, peak sodium and potassium currents are altered, and spike frequency and amplitude are generally reduced. In the nerve axon, the velocity of spike propagation increases as fractional-order decreases, while in a neural network, electrical activity is more likely to cease for smaller fractional-order. Importantly, we demonstrate that the modulation of the peak ionic currents that occurs for reduced fractional-order alone fails to reproduce many of the key alterations in spiking properties, suggesting that membrane capacitive memory and fractional-order membrane potential dynamics are important and necessary to reproduce neuronal electrical activity.