Multistability of recurrent neural networks with time-varying delays and nonincreasing activation function

An Overview of the Stability Analysis of Recurrent Neural Networks With Multiple Equilibria

The stability analysis of recurrent neural networks (RNNs) with multiple equilibria has received extensive interest since it is a prerequisite for successful applications of RNNs. With the increasing theoretical results on this topic, it is desirable to review the results for a systematical understanding of the state of the art. This article provides an overview of the stability results of RNNs with multiple equilibria including complete stability and multistability. First, preliminaries on the complete stability and multistability analysis of RNNs are introduced. Second, the complete stability results of RNNs are summarized. Third, the multistability results of various RNNs are reviewed in detail. Finally, future directions in these interesting topics are suggested.

Multistability of Switched Neural Networks With Gaussian Activation Functions Under State-Dependent Switching

This article presents theoretical results on the multistability of switched neural networks with Gaussian activation functions under state-dependent switching. It is shown herein that the number and location of the equilibrium points of the switched neural networks can be characterized by making use of the geometrical properties of Gaussian functions and local linearization based on the Brouwer fixed-point theorem. Four sets of sufficient conditions are derived to ascertain the existence of 7^p₁5^p₂3^p₃ equilibrium points, and 4^p₁3^p₂2^p₃ of them are locally stable, wherein p₁ , p₂ , and p₃ are nonnegative integers satisfying 0 ≤ p₁+p₂+p₃ ≤ n and n is the number of neurons. It implies that there exist up to 7ⁿ equilibria, and up to 4ⁿ of them are locally stable when p₁=n . It also implies that properly selecting p₁ , p₂ , and p₃ can engender a desirable number of stable equilibria. Two numerical examples are elaborated to substantiate the theoretical results.

Multimode function multistability for Cohen-Grossberg neural networks with mixed time delays

In this paper, we are concerned with the multimode function multistability for Cohen-Grossberg neural networks (CGNNs) with mixed time delays. It is introduced the multimode function multistability as well as its specific mathematical expression, which is a generalization of multiple exponential stability, multiple polynomial stability, multiple logarithmic stability, and asymptotic stability. Also, according to the neural network (NN) model and the maximum and minimum values of activation functions, n pairs of upper and lower boundary functions are obtained. Via the locations of the zeros of the n pairs of upper and lower boundary functions, the state space is divided into ∏_i=1ⁿ(2H_i+1) parts correspondingly. By virtue of the reduction to absurdity, continuity of function, Brouwer's fixed point theorem and Lyapunov stability theorem, the criteria for multimode function multistability are acquired. Multiple types of multistability, including multiple exponential stability, multiple polynomial stability, multiple logarithmic stability, and multiple asymptotic stability, can be achieved by selecting different types of function P(t). Two numerical examples are offered to substantiate the generality of the obtained criteria over the existing results.

Multistability and Stabilization of Fractional-Order Competitive Neural Networks With Unbounded Time-Varying Delays

This article investigates the multistability and stabilization of fractional-order competitive neural networks (FOCNNs) with unbounded time-varying delays. By utilizing the monotone operator, several sufficient conditions of the coexistence of equilibrium points (EPs) are obtained for FOCNNs with concave-convex activation functions. And then, the multiple μ -stability of delayed FOCNNs is derived by the analytical method. Meanwhile, several comparisons with existing work are shown, which implies that the derived results cover the inverse-power stability and Mittag-Leffler stability as special cases. Moreover, the criteria on the stabilization of FOCNNs with uncertainty are established by designing a controller. Compared with the results of fractional-order neural networks, the obtained results in this article enrich and improve the previous results. Finally, three numerical examples are provided to show the effectiveness of the presented results.

Multiple Mittag-Leffler Stability of Delayed Fractional-Order Cohen-Grossberg Neural Networks via Mixed Monotone Operator Pair

This article mainly investigates the multiple Mittag-Leffler stability of delayed fractional-order Cohen-Grossberg neural networks with time-varying delays. By using mixed monotone operator pair, the conditions of the coexistence of multiple equilibrium points are obtained for fractional-order Cohen-Grossberg neural networks, and these conditions are eventually transformed into algebraic inequalities based on the vertex of the divided region. In particular, when the symbols of these inequalities are determined by the dominant term, several verifiable corollaries are given. And then, the sufficient conditions of the Mittag-Leffler stability are derived for fractional-order Cohen-Grossberg neural networks with time-varying delays. In addition, two numerical examples are provided to illustrate the effectiveness of the theoretical results.

Robust Stability of Recurrent Neural Networks With Time-Varying Delays and Input Perturbation

This paper addresses the robust stability of recurrent neural networks (RNNs) with time-varying delays and input perturbation, where the time-varying delays include discrete and distributed delays. By employing the new ψ -type integral inequality, several sufficient conditions are derived for the robust stability of RNNs with discrete and distributed delays. Meanwhile, the robust boundedness of neural networks is explored by the bounded input perturbation and L¹ -norm constraint. Moreover, RNNs have a strong anti-jamming ability to input perturbation, and the robustness of RNNs is suitable for associative memory. Specifically, when input perturbation belongs to the specified and well-characterized space, the results cover both monostability and multistability as special cases. It is revealed that there is a relationship between the stability of neural networks and input perturbation. Compared with the existing results, these conditions proposed in this paper improve and extend the existing stability in some literature. Finally, the numerical examples are given to substantiate the effectiveness of the theoretical results.

Multistability of delayed fractional-order competitive neural networks

This paper is concerned with the multistability of fractional-order competitive neural networks (FCNNs) with time-varying delays. Based on the division of state space, the equilibrium points (EPs) of FCNNs are given. Several sufficient conditions and criteria are proposed to ascertain the multiple O(t^-α)-stability of delayed FCNNs. The O(t^-α)-stability is the extension of Mittag-Leffler stability of fractional-order neural networks, which contains monostability and multistability. Moreover, the attraction basins of the stable EPs of FCNNs are estimated, which shows the attraction basins of the stable EPs can be larger than the divided subsets. These conditions and criteria supplement and improve the previous results. Finally, the results are illustrated by the simulation examples.

Multistability of Fractional-Order Neural Networks With Unbounded Time-Varying Delays

This article addresses the multistability and attraction of fractional-order neural networks (FONNs) with unbounded time-varying delays. Several sufficient conditions are given to ensure the coexistence of equilibrium points (EPs) of FONNs with concave-convex activation functions. Moreover, by exploiting the analytical method and the property of the Mittag-Leffler function, it is shown that the multiple Mittag-Leffler stability of delayed FONNs is derived and the obtained criteria do not depend on differentiable time-varying delays. In particular, the criterion of the Mittag-Leffler stability can be simplified to M-matrix. In addition, the estimation of attraction basin of delayed FONNs is studied, which implies that the extension of attraction basin is independent of the magnitude of delays. Finally, three numerical examples are given to show the validity of the theoretical results.

Multistability and attraction basins of discrete-time neural networks with nonmonotonic piecewise linear activation functions

This paper is concerned with multistability and attraction basins of discrete-time neural networks with nonmonotonic piecewise linear activation functions. Under some reasonable conditions, the addressed networks have (2m+1)ⁿ equilibrium points. (m+1)ⁿ of which are locally asymptotically stable, and the others are unstable. The attraction basins of the locally asymptotically stable equilibrium points are given in the form of hyperspherical regions. These results here, which include existence, uniqueness, locally asymptotical stability, instability and attraction basins of the multiple equilibrium points, generalize and improve the earlier publications. Finally, an illustrative example with numerical simulation is given to show the feasibility and the effectiveness of the theoretical results. The theoretical results and illustrative example indicate that the activation functions improve the storage capacity of neural networks significantly.

Multiple ψ -Type Stability and Its Robustness for Recurrent Neural Networks With Time-Varying Delays

In this paper, the ψ -type stability and robustness of recurrent neural networks are investigated by using the differential inequality. By utilizing ψ -type functions combined with the inequality techniques, some sufficient conditions ensuring ψ -type stability and robustness are derived for linear neural networks with time-varying delays. Then, by choosing appropriate Lipschitz coefficient in subregion, some algebraic criteria of the multiple ψ -type stability and robust boundedness are established for the delayed neural networks with time-varying delays. For special cases, several criteria are also presented by selecting parameters with easy implementation. The derived results cover both ψ -type mono-stability and multiple ψ -type stability. In addition, these theoretical results contain exponential stability, polynomial stability, and μ -stability, and they also complement and extend some previous results. Finally, two numerical examples are provided to illustrate the effectiveness of the proposed criteria.

Multiple ψ -Type Stability of Cohen-Grossberg Neural Networks With Both Time-Varying Discrete Delays and Distributed Delays

In this paper, multiple ψ -type stability of Cohen-Grossberg neural networks (CGNNs) with both time-varying discrete delays and distributed delays is investigated. By utilizing ψ -type functions combined with a new ψ -type integral inequality for treating distributed delay terms, some sufficient conditions are obtained to ensure that multiple equilibrium points are ψ -type stable for CGNNs with discrete and distributed delays, where the distributed delays include bounded and unbounded delays. These conditions of CGNNs with different output functions are less restrictive. More specifically, the algebraic criteria of the generalized model are applicable to several well-known neural network models by taking special parameters, and multiple different output functions are introduced to replace some of the same output functions, which improves the diversity of output results for the design of neural networks. In addition, the estimation of relative convergence rate of ψ -type stability is determined by the parameters of CGNNs and the selection of ψ -type functions. As a result, the existing results on multistability and monostability can be improved and extended. Finally, some numerical simulations are presented to illustrate the effectiveness of the obtained results.

Multistability and instability analysis of recurrent neural networks with time-varying delays

This paper provides new theoretical results on the multistability and instability analysis of recurrent neural networks with time-varying delays. It is shown that such n-neuronal recurrent neural networks have exactly [Formula: see text] equilibria, [Formula: see text] of which are locally exponentially stable and the others are unstable, where k₀ is a nonnegative integer such that k₀≤n. By using the combination method of two different divisions, recurrent neural networks can possess more dynamic properties. This method improves and extends the existing results in the literature. Finally, one numerical example is provided to show the superiority and effectiveness of the presented results.