Adaptive NN Control Without Feasibility Conditions for Nonlinear State Constrained Stochastic Systems With Unknown Time Delays

Preassigned Time Adaptive Neural Tracking Control for Stochastic Nonlinear Multiagent Systems With Deferred Constraints

This article studies a preassigned time adaptive tracking control problem for stochastic multiagent systems (MASs) with deferred full state constraints and deferred prescribed performance. A modified nonlinear mapping is designed, which incorporates a class of shift functions, to eliminate the constraints on the initial value conditions. By virtue of this nonlinear mapping, the feasibility conditions of the full state constraints for stochastic MASs can also be circumvented. In addition, the Lyapunov function codesigned by the shift function and the fixed-time prescribed performance function is constructed. The unknown nonlinear terms of the converted systems are handled based on the approximation property of the neural networks. Furthermore, a preassigned time adaptive tracking controller is established, which can achieve deferred prescribed performance for stochastic MASs that provide only local information. Finally, a numerical example is given to demonstrate the effectiveness of the proposed scheme.

Neural Network-Based Adaptive Tracking Control for Denitrification and Aeration Processes With Time Delays

Wastewater treatment process (WWTP), consisting of a class of physical, chemical, and biological phenomena, is an important means to reduce environmental pollution and improve recycling efficiency of water resources. Considering characteristics of the complexities, uncertainties, nonlinearities, and multitime delays in WWTPs, an adaptive neural controller is presented to achieve the satisfying control performance for WWTPs. With the advantages of radial basis function neural networks (RBF NNs), the unknown dynamics in WWTPs are identified. Based on the mechanistic analysis, the time-varying delayed models of the denitrification and aeration processes are established. Based on the established delayed models, the Lyapunov-Krasovskii functional (LKF) is used to compensate for the time-varying delays caused by the push-flow and recycle flow phenomenon. The barrier Lyapunov function (BLF) is used to ensure that the dissolved oxygen (DO) and nitrate concentrations are always kept within the specified ranges though the time-varying delays and disturbances exist. Using Lyapunov theorem, the stability of the closed-loop system is proven. Finally, the proposed control method is carried out on the benchmark simulation model 1 (BSM1) to verify the effectiveness and practicability.

Adaptive fuzzy fixed-time bipartite consensus control for stochastic nonlinear multi-agent systems with performance constraints

This paper investigates the fixed-time bipartite consensus control problem of stochastic nonlinear multi-agent systems (MASs) with performance constraints. A constraint scaling function is proposed to model the performance constraints with user-predefined steady-state accuracy and settling time without relying on the initial condition. Technically, the local synchronization error of each follower is mapped to a new error variable using the constraint scaling function and an error transformation function before being used to design the controller. To achieve fixed-time convergence of the local tracking error, a barrier function transforms the scaled synchronization error to a new variable to guarantee the prescribed performance. Then, an adaptive fuzzy fixed-time bipartite consensus controller is developed. The fuzzy logic system handles the uncertainties in the designing procedures, and one adaptive parameter needs to be estimated online. It is shown that the closed-loop system has practical fixed-time stability in probability, and the antagonistic network's consensus error evolves within user-predefined performance constraints. The simulation results evaluate the effectiveness of the developed control scheme.

Reinforcement learning based adaptive optimal control for constrained nonlinear system via a novel state-dependent transformation

Existing schemes for state-constrained systems either impose feasibility conditions or ignore the optimality. In this article, an adaptive optimal control scheme for the strict-feedback nonlinear system is proposed, which benefits from two design steps. Firstly, a novel nonlinear state-dependent function (NSDF) is formulated to equivalently transform the system into a non-constrained one to deal with state constraints without the requirements on feasibility conditions. Secondly, an adaptive optimal control scheme is designed for the non-constrained system, in which reinforcement learning (RL) is utilized to yield the optimal controller in each designing procedure. Updating rules of the actor and critic neural network are driven by the modified adaptive laws, used to approximate the optimal virtual and actual controllers. It is proved that all the signals in the closed-loop system are bounded and the output tracking error converges to an adjustable neighborhood of the origin not affected by the proposed NSDF. Two simulation examples are presented illustrating the effectiveness of the proposed scheme.

Adaptive tracking control for stochastic nonlinear systems with time-varying delays using multi-dimensional Taylor network

For stochastic nonlinear systems (SNSs) perturbed by compound uncertainties, the conventional model-based control approaches assume that the evolution behavior of uncertain variables is known. Unfortunately, such approaches are often conservative for most practical scenarios with the slow convergence speed and unsatisfactory anti-interference performance. For this sake, an adaptive control scheme based on deep deterministic policy gradient (DDPG) and multi-dimensional Taylor network (MTN) is proposed here to address the tracking problem for a category of SNSs subject to fast time-varying uncertainties, stochastic disturbance and unknown time-varying delays. The effect of time delay is embedded in the reproducing kernel Hilbert space through the error coordinate transformation. In the framework of DDPG, the MTN-based surrogate is utilized to construct the online network and target network via the temporal-difference method, which promises more desirable real-time performance due to its concise structure than conventional NN-based surrogates. In order to enhance the robustness of the system under fast time-varying uncertainties, a novel persistent excitation (PE) mechanism is designed to ensure that the control policy is appropriately rewarded or punished. Based on the PE condition, weights of MTNs converge exponentially and animate the system to evolve towards the target persistently. The tracking error and closed-loop state signals are proved theoretically to be uniformly ultimately bounded (UUB) via Lyapunov-Krasovskii functional. A numerical simulation from the process industry verifies the effectiveness of the proposed method.

Indefinite Mean-Field Stochastic Cooperative Linear-Quadratic Dynamic Difference Game With Its Application to the Network Security Model

In this article, we show how to obtain all of the Pareto optimal decision vectors and solutions for the finite horizon indefinite mean-field stochastic cooperative linear-quadratic (LQ) difference game. First, the equivalence between the solvability of the introduced N coupled generalized difference Riccati equations (GDREs) and the solvability of the multiobjective optimization problem is established. However, it is difficult to obtain Pareto optimal decision vectors based on the N coupled GDREs because the optimal joint strategy adopted by all players to optimize the performance criterion of some players in the game is different from the strategies of other players, which rely on the weighted matrices of cost functionals that may be different among players. Second, a necessary and sufficient condition is developed to guarantee the convexity of the costs, which makes the weighting technique not only sufficient but also necessary for searching Pareto optimal decision vectors. It is then shown that the mean-field Pareto optimality algorithm (MF-POA) is presented to identify, in principle, all of the Pareto optimal decision vectors and solutions via the solutions to the weighted coupled GDREs and the weighted coupled generalized difference Lyapunov equations (GDLEs), respectively. Finally, a cooperative network security game is reported to illustrate the results presented. Simulation results validate the solvability, correctness, and efficiency of the proposed algorithm.

Observer-Based Adaptive Fuzzy Control for Nonlinear State-Constrained Systems Without Involving Feasibility Conditions

For nonlinear full-state-constrained systems with unmeasured states, an adaptive output feedback control strategy is developed. The main challenge of this article is how to avoid that the unmeasured states exceed the constrained spaces. To achieve a good tracking performance for the considered systems, a stable state observer is structured to estimate unmeasured states which are not available in the control design. In addition, the constraints existing in most practical engineering are the source of reducing control performance and causing the system instability. The main limitation of current barrier Lyapunov functions is the feasibility conditions for intermediate controllers. The nonlinear mappings are used to achieve the satisfaction of full-state constraints directly and avoid feasibility conditions for intermediate controllers. By the Lyapunov theorem, the closed-loop system stability is proven. Simulation results are given to confirm the validity of the developed strategy.

Neuroscience and Network Dynamics Toward Brain-Inspired Intelligence

This article surveys the interdisciplinary research of neuroscience, network science, and dynamic systems, with emphasis on the emergence of brain-inspired intelligence. To replicate brain intelligence, a practical way is to reconstruct cortical networks with dynamic activities that nourish the brain functions, instead of using only artificial computing networks. The survey provides a complex network and spatiotemporal dynamics (abbr. network dynamics) perspective for understanding the brain and cortical networks and, furthermore, develops integrated approaches of neuroscience and network dynamics toward building brain-inspired intelligence with learning and resilience functions. Presented are fundamental concepts and principles of complex networks, neuroscience, and hybrid dynamic systems, as well as relevant studies about the brain and intelligence. Other promising research directions, such as brain science, data science, quantum information science, and machine behavior are also briefly discussed toward future applications.

Accelerated Log-Regularized Convolutional Transform Learning and Its Convergence Guarantee

Convolutional transform learning (CTL), learning filters by minimizing the data fidelity loss function in an unsupervised way, is becoming very pervasive, resulting from keeping the best of both worlds: the benefit of unsupervised learning and the success of the convolutional neural network. There have been growing interests in developing efficient CTL algorithms. However, developing a convergent and accelerated CTL algorithm with accurate representations simultaneously with proper sparsity is an open problem. This article presents a new CTL framework with a log regularizer that can not only obtain accurate representations but also yield strong sparsity. To efficiently address our nonconvex composite optimization, we propose to employ the proximal difference of the convex algorithm (PDCA) which relies on decomposing the nonconvex regularizer into the difference of two convex parts and then optimizes the convex subproblems. Furthermore, we introduce the extrapolation technology to accelerate the algorithm, leading to a fast and efficient CTL algorithm. In particular, we provide a rigorous convergence analysis for the proposed algorithm under the accelerated PDCA. The experimental results demonstrate that the proposed algorithm can converge more stably to desirable solutions with lower approximation error and simultaneously with stronger sparsity and, thus, learn filters efficiently. Meanwhile, the convergence speed is faster than the existing CTL algorithms.

Adaptive Event-Triggered Finite-Time Dissipative Filtering for Interval Type-2 Fuzzy Markov Jump Systems With Asynchronous Modes

This article investigates the adaptive event-triggered finite-time dissipative filtering problems for the interval type-2 (IT2) Takagi-Sugeno (T-S) fuzzy Markov jump systems (MJSs) with asynchronous modes. By designing a generalized performance index, the H_∞ , L₂-L_∞ , and dissipative fuzzy filtering problems with network transmission delay are addressed. The adaptive event-triggered scheme (ETS) is proposed to guarantee that the IT2 T-S fuzzy MJSs are finite-time boundedness (FTB) and, thus, lower the energy consumption of communication while ensuring the performance of the system with extended dissipativity. Different from the conventional triggering mechanism, in this article, the parameters of the triggering function are based on an adaptive law, which is obtained online rather than as a predefined constant. Besides, the asynchronous phenomenon between the plant and the filter is considered, which is described by a hidden Markov model (HMM). Finally, two examples are presented to show the availability of the proposed algorithms.

Adaptive Full-State-Constrained Control of Nonlinear Systems With Deferred Constraints Based on Nonbarrier Lyapunov Function Method

In this article, the problem of tracking control is considered for a class of uncertain strict-feedback nonlinear systems with deferred asymmetric time-varying full-state constraints. A novel adaptive robust full-state-constrained control scheme is developed. First, by introducing a novel shifting function, the original constrained system with any initial values is modified to a new constrained system, and the initial values of the modified constrained system remain 0. Then, to remove the feasibility condition caused by the barrier Lyapunov functions, the modified constrained system is further transformed into a new unconstrained system by a brand new nonlinear transformation. Furthermore, the tracking error system of the unconstrained system is constructed by using a new coordinate transformation, and a novel adaptive full-state-constrained control scheme is designed based on this error system through the backstepping recursion method and first-order filters. Finally, the resulting closed-loop system proves to be stable and numerical simulations are conducted to demonstrate the effectiveness of the developed control strategy.

Observer Design for Sampled-Data Systems via Deterministic Learning

A unified approach is proposed to design sampled-data observers for a certain type of unknown nonlinear systems undergoing recurrent motions based on deterministic learning in this article. First, a discrete-time implementation of high-gain observer (HGO) is utilized to obtain state trajectory from sampled output measurements. By taking the recurrent estimated trajectory as inputs to a dynamical radial basis function network (RBFN), a partial persistent exciting (PE) condition is satisfied, and a locally accurate approximation of nonlinear dynamics can be realized along the estimated sampled-data trajectory. Second, an RBFN-based observer consisting of the obtained dynamics from the process of deterministic learning is designed. Without resorting to high gains, the RBFN-based observer is shown capable of achieving correct state observation. The novelty of this article lies in that, by incorporating deterministic learning with the discrete-time HGO, the nonlinear dynamics can be accurately approximated along the estimated trajectory, and such obtained knowledge can then be utilized to realize nonhigh-gain state estimation for the same or similar sampled-data systems. Simulation is performed to validate the effectiveness of the proposed approach.

Adaptive NN Controller of Nonlinear State-Dependent Constrained Systems With Unknown Control Direction

Various constraints commonly exist in most physical systems; however, traditional constraint control methods consider the constraint boundaries only relying on constant or time variable, which greatly restricts applying constraint control to practical systems. To avoid such conservatism, this study develops a new adaptive neural controller for the nonlinear strict-feedback systems subject to state-dependent constraint boundaries. The nonlinear state-dependent mapping is employed in each step of backstepping procedure, and the prescribed transient performance on tracking error and the constraints on system states are ensured without repeatedly verifying the feasibility conditions on virtual controllers. The radial basis function neural network (NN) with less parameters approach is introduced as an identifier to estimate the unknown system dynamics and reduce computation burden. For removing the effect of unknown control direction, the Nussbaum gain technique is integrated into controller design. Based on the Lyapunov analysis, the developed control strategy can ensure that all the closed-loop signals are bounded, and the constraints on full system states and tracking error are achieved. The simulation examples are used to illustrate the effectiveness of the developed control strategy.

Adaptive Approximation-Based Tracking Control for a Class of Unknown High-Order Nonlinear Systems With Unknown Powers

In this article, the problem of adaptive tracking control is tackled for a class of high-order nonlinear systems. In contrast to existing results, the considered system contains not only unknown nonlinear functions but also unknown rational powers. By utilizing the fuzzy approximation approach together with the barrier Lyapunov functions (BLFs), we present a new adaptive tracking control strategy. Remarkably, the BLFs are employed to determine a priori the compact set for maintaining the validity of fuzzy approximation. The primary advantage of this article is that the developed controller is independent of the powers and can be capable of ensuring global stability. Finally, two illustrative examples are given to verify the effectiveness of the theoretical findings.

Adaptive Anti-Disturbance Control for Systems With Saturating Input via Dynamic Neural Network Disturbance Modeling

This article discusses the issue of disturbance rejection and anti-windup control for a class of complex systems with both saturating actuators and diverse types of disturbances. At the input port, to better characterize those irregular disturbances, exogenous dynamic neural network (DNN) models with adjustable weight parameters are first introduced. A novel disturbance observer-based adaptive control (DOBAC) technique is then established, which realizes the dynamic monitoring for the unknown input disturbance. To handle the system disturbance with a bounded norm, the attenuation performance is concurrently analyzed by optimizing the L₁ gain index. Moreover, the PI-type dynamic tracking controller is proposed by integrating the polytopic description of the saturating input with the estimation of the input disturbance. The favorable stability, tracking, and robustness performances of the augmented system are achieved within a given domain of attraction by employing the convex optimization theory. Finally, using DNN-based modeling for three kinds of different irregular disturbances, simulation studies for an A4D aircraft model are conducted to substantiate the superiority of the designed algorithm.

Asymptotic Tracking Control of State-Constrained Nonlinear Systems With Time-Varying Powers

This article investigates the asymptotic tracking control problem for full-state-constrained nonlinear systems with unknown time-varying powers. By introducing a nonlinear state-dependent transformation, a continuous bounded scalar function, and lower and higher powers into adding a power integrator control design, full-state constraints are skillfully handled without imposing frequently used feasibility conditions in traditional barrier Lyapunov function-based methods, and an asymptotic tracking control design is provided. It is proved that all the closed-loop signals are bounded, full-state constraints are not transgressed, and the asymptotic tracking is achieved.

Removing Feasibility Conditions on Adaptive Neural Tracking Control of Nonlinear Time-Delay Systems With Time-Varying Powers, Input, and Full-State Constraints

This article investigates the tracking control for input and full-state-constrained nonlinear time-delay systems with unknown time-varying powers, whose nonlinearities do not impose any growth assumption. By utilizing the auxiliary control signal and nonlinear state-dependent transformation (NSDT) to counteract the effect of input saturation and cope with full-state constraints, respectively, and then introducing lower and higher powers and Lyapunov-Krasovskii (L-K) functionals in control design together with the adaptive neural-networks (NNs) method, an adaptive neural tracking control design is provided without feasibility conditions. It is proved that NNs approximation is valid, all the closed-loop signals are semiglobally bounded, and input and full-state constraints are not violated.

Adaptive Fuzzy Asymptotic Tracking Control of State-Constrained High-Order Nonlinear Time-Delay Systems and Its Applications

This article discusses the adaptive fuzzy asymptotic tracking control for high-order nonlinear time-delay systems with full-state constraints. Fuzzy-logic systems and a separation principle are utilized to relax growth assumptions imposed on unknown nonlinearities. The adverse effect caused by unknown time delays is eliminated by choosing appropriate Lyapunov-Krasovskii functionals. By integrating nonlinear-transformed functions with a key coordinate transformation into the control design and constructing a specific compact set on the initial values of system states, the desired trajectory and parameter estimates, it is rigorously proved that all closed-loop signals are semiglobally bounded, the fuzzy approximation is valid, the full-state constraints are not violated without feasibility conditions on virtual controllers, and asymptotic tracking is achieved. The effectiveness and advantages of this control scheme are confirmed by two examples including a single-link robotic system.

Adaptive Fuzzy Finite-Time Tracking Control for Nonstrict Full States Constrained Nonlinear System With Coupled Dead-Zone Input

This article proposes an adaptive finite-time tracking control based on fuzzy-logic systems (FLSs) for an uncertain nonstrict nonlinear multi-input-multi-output (MIMO) full-state-constrained system with the coupled uncertain dead-zone input. By using three kinds of FLSs: the uncertain system, the uncertain dead zone, and the uncertain input transfer inverse matrix are approximated using the system function FLS, dead-zone FLS, and input transfer inverse matrix FLS, respectively. After defining the barrier Lyapunov function, the fuzzy-based adaptive tracking controllers are designed, and the fuzzy weights are updated through the proposed adaptive laws. Then, based on the extended finite-time convergence theorem, with the design parameters chosen properly, the target uncertain nonlinear system is guaranteed to be semiglobal practical finite-time stable (SGPFS); and the full-state constraints are not violated while avoiding the effects of the dead zones. Furthermore, a simulation is presented to verify the validity of the proposed algorithm.

Adaptive Asymptotic Regulation for Uncertain Nonlinear Stochastic Systems with Time-Varying Delays

In this paper, for a class of uncertain stochastic nonlinear systems with input time-varying delays, an adaptive neural dynamic surface control (DSC) method is proposed. To approximate the unknown continuous functions online, the neural network approximation technique was applied, and based on the DSC scheme, the desired controller was constructed. A compensation system is presented to compensate for the effect of the input delay. The Lyapunov–Krasovskii functionals (LKFs) were employed to compensate for the effect of the state delay. Compared with the existing works, based on using the DSC scheme with the nonlinear filter and stochastic Barbalat’s lemma, the asymptotic regulation performance of this closed-loop system can be guaranteed under the developed controller. To certify the availability for the designed control method, some simulation results are presented.

Robust Intelligent Control of SISO Nonlinear Systems Using Switching Mechanism

In this article, a robust adaptive learning control strategy for uncertain single-input-single-output systems in strict-feedback form and controllability canonical form (CCF) is studied. For the strict-feedback system, the dynamic surface control is introduced while for the controllability canonical system, sliding-mode control is further constructed. The finite-time design is introduced for fast convergence. Under the switching mechanism, the intelligent design and the robust technique work together to obtain robust tracking performance. Once the states run out of the domain of intelligent control, the robust item will pull the states back while inside the neural working domain, the composite learning is developed to achieve higher approximation precision by building the prediction error for the weight update. The closed-loop system stability is analyzed via the Lyapunov approach. Especially for the CCF, the finite-time convergence is achieved while the system signals are globally uniformly ultimately bounded. Simulation studies on the general nonlinear systems and the flight dynamics show that the new design scheme obtains better tracking performance with higher precision and stronger robustness.

Relaxed Stability Criteria for Neural Networks With Time-Varying Delay Using Extended Secondary Delay Partitioning and Equivalent Reciprocal Convex Combination Techniques

This article investigates global asymptotic stability for neural networks (NNs) with time-varying delay, which is differentiable and uniformly bounded, and the delay derivative exists and is upper-bounded. First, we propose the extended secondary delay partitioning technique to construct the novel Lyapunov-Krasovskii functional, where both single-integral and double-integral state variables are considered, while the single-integral ones are only solved by the traditional secondary delay partitioning. Second, a novel free-weight matrix equality (FWME) is presented to resolve the reciprocal convex combination problem equivalently and directly without Schur complement, which eliminates the need of positive definite matrices, and is less conservative and restrictive compared with various improved reciprocal convex inequalities. Furthermore, by the present extended secondary delay partitioning, equivalent reciprocal convex combination technique, and Bessel-Legendre inequality, two different relaxed sufficient conditions ensuring global asymptotic stability for NNs are obtained, for time-varying delays, respectively, with unknown and known lower bounds of the delay derivative. Finally, two examples are given to illustrate the superiority and effectiveness of the presented method.

Adaptive Neural Quantized Control of MIMO Nonlinear Systems Under Actuation Faults and Time-Varying Output Constraints

In this article, a neural network (NN)-based robust adaptive fault-tolerant control (FTC) algorithm is proposed for a class of multi-input multi-output (MIMO) strict-feedback nonlinear systems with input quantization and actuation faults as well as asymmetric yet time-varying output constraints. By introducing a key nonlinear decomposition for quantized input, the developed control scheme does not require the detailed information of quantization parameters. By imposing a reasonable condition on the gain matrix under actuation faults, together with the inherent approximation capability of NN, the difficulty of FTC design caused by anomaly actuation can be handled gracefully, and the normally used yet rigorous assumption on control gain matrix in most existing results is significantly relaxed. Furthermore, a brand new barrier function is constructed to handle the asymmetric yet time-varying output constraints such that the analysis and design are extremely simplified compared with the traditional barrier Lyapunov function (BLF)-based methods. NNs are used to approximate the unknown nonlinear continuous functions. The stability of the closed-loop system is analyzed by using the Lyapunov method and is verified through a simulation example.

Adaptive neural network output feedback control for stochastic nonlinear systems with full state constraints

This paper presents an adaptive neural network output feedback control method for stochastic nonlinear systems with full state constraints. The barrier Lyapunov functions are used to conquer the effect of state constraints to system performance. The neural network state observer is established to estimate the unmeasured states. By using dynamic surface control technique, the "explosion of complexity" issue existing in the backstepping design is overcome. The proposed control scheme can guarantee that all signals of the system are bounded and the system output can follow the desired signal. Finally, two examples are given to verify the effectiveness of our control method.