Adaptive Consensus Tracking Control of Uncertain Nonlinear Multiagent Systems With Predefined Accuracy

Adaptive Critic Learning-Based Optimal Bipartite Consensus for Multiagent Systems With Prescribed Performance

Developing a distributed bipartite optimal consensus scheme while ensuring user-predefined performance is essential in practical applications. Existing approaches to this problem typically require a complex controller structure due to adopting an identifier-actor-critic framework and prescribed performance cannot be guaranteed. In this work, an adaptive critic learning (ACL)-based optimal bipartite consensus scheme is developed to bridge the gap. A newly designed error scaling function, which defines the user-predefined settling time and steady accuracy without relying on the initial conditions, is then integrated into a cost function. The backstepping framework combines the ACL and integral reinforcement learning (IRL) algorithm to develop the adaptive optimal bipartite consensus scheme, which contributes a critic-only controller structure by removing the identifier and actor networks in the existing methods. The adaptive law of the critic network is derived by the gradient descent algorithm and experience replay to minimize the IRL-based residual error. It is shown that a compute-saving learning mechanism can achieve the optimal consensus, and the error variables of the closed-loop system are uniformly ultimately bounded (UUB). Besides, in any bounded initial condition, the evolution of bipartite consensus is limited to a user-prescribed boundary under bounded initial conditions. The illustrative simulation results validate the efficacy of the approach.

Cooperative regulation based on virtual vector triangles asymptotically compressed in multidimensional space for time-varying nonlinear multi-agent systems

This study constructs virtual vector triangles in multidimensional space to address cooperative control issue in time-varying nonlinear multi-agent systems. The distributed adaptive virtual point and its dynamic equations are designed, with this virtual point, the leader, and the follower being respectively defined as the vertices of the virtual vector triangle. The virtual vector edges, decomposed by vectors into coordinate axis components, are organized to form a closed virtual vector triangle by connecting the three vertices with directed vector arrows that are oriented from the tail to the head. Specifically, these virtual vector edges are fictitious vector line segments connecting two vertices and used to compute the relative Euclidean distances between each vertex in multidimensional space. Based on the established virtual vector triangles, which are placed in multidimensional space, and the novel spatial coordinate transformation method, the cooperative regulation problem of the time-varying nonlinear multi-agent system is transformed into a mathematical problem of compressing the virtual vector triangles with exponential magnitude. The created distributed compression control protocol asymptotically shrinks the magnitude of the virtual vector triangles by exponential oscillatory decay towards the same dynamic point aligned with the motion trajectory of the leader or the leader, where the states of the time-varying nonlinear multi-agent systems achieve asymptotic convergence consensus. The reliable stability of the asymptotic compression convergence process of the virtual vector triangles was verified by establishing a Lyapunov function and relying on the Lyapunov stability theory. Finally, the example of time-varying nonlinear multi-agent systems are presented for simulation experiments to further validate the effectiveness and feasibility of the proposed control protocol in addressing the cooperative regulation issue.

Robust Adaptive Leader-Following Formation Control of Nonlinear Multiagents Using Three-Layer Neural Networks

This article studies a formation control problem for a group of heterogeneous, nonlinear, uncertain, input-affine, second-order agents modeled by a directed graph. A tunable neural network (NN) is presented, with three layers (input, two hidden, and output) that can approximate an unknown nonlinearity. Unlike one- or two-layer NNs, this design has the advantage of being able to set the number of neurons in each layer ahead of time rather than relying on trial and error. The NN weights tuning law is rigorously derived using the Lyapunov theory. The formation control problem is tackled using a robust integral of the sign of the error feedback and NNs-based control. The robust integral of the sign of the error feedback compensates for the unknown dynamics of the leader and disturbances in the agent errors, while the NN-based controller accounts for the unknown nonlinearity in the multiagent system. The stability and semi-global asymptotic tracking of the results are proven using the Lyapunov stability theory. The study compares its results with two others to assess the effectiveness and efficiency of the proposed method.

Predefined Accuracy Adaptive Tracking Control for Nonlinear Multiagent Systems With Unmodeled Dynamics

This article focuses on an adaptive dynamic surface tracking control issue of nonlinear multiagent systems (MASs) with unmodeled dynamics and input quantization under predefined accuracy. Radial basis function neural networks (RBFNNs) are employed to estimate unknown nonlinear items. A dynamic signal is established to handle the trouble introduced by the unmodeled dynamics. Moreover, the predefined precision control is realized with the aid of two key functions. Unlike the existing works on nonlinear MASs with unmodeled dynamics, to avoid the issue of "explosion of complexity," the dynamic surface control (DSC) method is applied with the nonlinear filter. By using the designed controller, the consensus errors can gather to a precision assigned a priori. Finally, the simulation results are given to demonstrate the effectiveness of the proposed strategy.

Adaptive fuzzy fixed-time bipartite consensus control for stochastic nonlinear multi-agent systems with performance constraints

This paper investigates the fixed-time bipartite consensus control problem of stochastic nonlinear multi-agent systems (MASs) with performance constraints. A constraint scaling function is proposed to model the performance constraints with user-predefined steady-state accuracy and settling time without relying on the initial condition. Technically, the local synchronization error of each follower is mapped to a new error variable using the constraint scaling function and an error transformation function before being used to design the controller. To achieve fixed-time convergence of the local tracking error, a barrier function transforms the scaled synchronization error to a new variable to guarantee the prescribed performance. Then, an adaptive fuzzy fixed-time bipartite consensus controller is developed. The fuzzy logic system handles the uncertainties in the designing procedures, and one adaptive parameter needs to be estimated online. It is shown that the closed-loop system has practical fixed-time stability in probability, and the antagonistic network's consensus error evolves within user-predefined performance constraints. The simulation results evaluate the effectiveness of the developed control scheme.

Resilient exponential tracking for disturbed systems with communication links faults

Resilience is to appraise the ability of disturbed systems to recover cooperative performance after suffering from failures or disturbances. In this paper, the improvement on the exponential tracking resilience for disturbed Euler-Lagrange systems is explored by settling the unknown time-variant faults imposed on the communication interaction between agents. First, we transform the resilient exponential tracking problem into designing the trajectory and velocity observers for leaders, and showcase that the proposed observers are resilient to communication interaction malfunctions. Second, a disturbance observer is manifested to estimate disturbances precisely, which is needless to know the upper bound of disturbance. The reliable observers and estimator are incorporated into the resilient tracking control frame. Further, the global exponential stabilization of the tracking systems is performed by utilizing the Lyapunov theory. Moreover, benefiting from feasible and reliable observation and estimation results, the proposed control framework enables to realize a satisfactory resilient exponential tracking performance even in the case of communication links faults (CLFs) and disturbances. Comprehensive studies are executed on a group of satellite systems, and the simulations results verify the effectiveness of the proposed resilient approaches in a time-variant tracking case.

Adaptive Fixed-Time Neural Control for Uncertain Nonlinear Multiagent Systems

In this article, we consider the problem of adaptive fixed-time tracking control for a class of multiagent systems (MASs) with mismatched uncertainty. Unlike the existing methodologies that only implement the practical finite-/fixed-time stability for MASs, a newly adaptive consensus control criterion is developed to reach fixed-time stability, where the controller design includes a series of newly Lyavonov functions and modified tuning functions. Radial basis function neural networks are employed to deal with the unknown functions in each agent, and the direct adaptive strategy solves the obstacle of "explosion of complexity." Under the performance-oriented controller, the error of the MASs converges to a predetermined interval within a fixed time. Two simulations illustrate the results obtained.

Improved disturbance observer-based fixed-time adaptive neural network consensus tracking for nonlinear multi-agent systems

This paper is concerned with the problem of fixed-time consensus tracking for a class of nonlinear multi-agent systems subject to unknown disturbances. Firstly, a modified fixed-time disturbance observer is devised to estimate the unknown mismatched disturbance. Secondly, a distributed fixed-time neural network control protocol is designed, in which neural network is employed to approximate the uncertain nonlinear function. Simultaneously, the technique of command filter is applied to fixed-time control, which circumvents the "explosion of complexity" problem. Under the proposed control strategy, all agents are enable to track the desired trajectory in fixed-time, and the consensus tracking error and disturbance estimation error converge to an arbitrarily small neighborhood of the origin, meanwhile, all signals in the closed-loop system remain bounded. Finally, a simulation example is provided to validate the effectiveness of the presented design method.

Leader-Follower Asymptotic Consensus Control of Multiagent Systems: An Observer-Based Disturbance Reconstruction Approach

In this article, a leader-follower asymptotic consensus control strategy is developed for a class of linear multiagent systems (MASs) with unknown external disturbances and measurement noises. First, the preconditions, the minimum phase condition (MPC) and observer matching condition (OMC), are discussed in detail, and an equivalent result under these two preconditions is given. In this way, the corresponding results from Corless and Tu (1998) are improved. Meanwhile, a reduced-order observer is designed for a constructed augmented system to estimate the system states and noises of each agent. Next, with the help of a traditional interval observer, a novel unknown disturbance reconstruction method is developed, and the reconstruction can converge to the unknown disturbance asymptotically and decouple from the control input. The subsequent asymptotic consensus is accomplished by utilizing an observer-based control scheme, with its design satisfying the so-called separation principle. Finally, two simulation examples are given to verify the effectiveness and show the advantages of the proposed methods.

Reinforcement learning based adaptive optimal control for constrained nonlinear system via a novel state-dependent transformation

Existing schemes for state-constrained systems either impose feasibility conditions or ignore the optimality. In this article, an adaptive optimal control scheme for the strict-feedback nonlinear system is proposed, which benefits from two design steps. Firstly, a novel nonlinear state-dependent function (NSDF) is formulated to equivalently transform the system into a non-constrained one to deal with state constraints without the requirements on feasibility conditions. Secondly, an adaptive optimal control scheme is designed for the non-constrained system, in which reinforcement learning (RL) is utilized to yield the optimal controller in each designing procedure. Updating rules of the actor and critic neural network are driven by the modified adaptive laws, used to approximate the optimal virtual and actual controllers. It is proved that all the signals in the closed-loop system are bounded and the output tracking error converges to an adjustable neighborhood of the origin not affected by the proposed NSDF. Two simulation examples are presented illustrating the effectiveness of the proposed scheme.

Roto-Translation Invariant Formation of Multiple Underactuated Planar Rigid Bodies

This article investigates the roto-translation invariant (RTI) formation of multiple underactuated planar rigid bodies, which are established under the framework of matrix Lie groups. The main contribution is that we define the RTI and pseudo RTI (P-RTI) formation of planar rigid bodies. Different from the common formation given in the earth-fixed frame, the RTI formation is defined in the body-fixed frame so that it possesses a rigid-body motion obtained by composing rotation and translation simultaneously. Moreover, regarding fully actuated planar rigid bodies, we propose the velocity and force requirements to maintain the RTI formation, which are derived based on the kinematic and dynamic model, respectively. Another contribution of this article is that the RTI formation feasibility is investigated for underactuated planar rigid bodies subject to nonholonomic constraints on velocities and accelerations. To be more specific, we study the occasions when wheeled mobile robots and underactuated surface vessels can maintain the RTI or P-RTI formation. Finally, the results of the simulation and experiment are presented so as to exhibit the RTI and P-RTI formation intuitively.

Event-triggered prescribed settling time consensus control of uncertain nonlinear multiagent systems with given transient performance

Multiagent systems (MASs) are usually used in unmanned aerial vehicle formations, multi-manipulator coordinated, traffic vehicle control and other fields, which have attracted a lot of attention from scholars. In this research, with the help of the designed performance function, the nonlinear transformation of synchronization error is realized. And the synchronization error of MASs with given transient performance could converge to the predefined interval. According to the designed transformation function, a prescribed setting time consensus control is investigated with the advantages of Radial Basis Function Neural Networks (RBFNNs) in dealing with unknown functions. It guarantees that the MASs under consideration are uniformly bounded convergent. Furthermore, event-triggered mechanism is applied to relieve pressure of MASs' communication resources. Simulation results demonstrate its effectiveness.

Cooperative Adaptive Model-Free Control With Model-Free Estimation and Online Gain Tuning

In this article, a distributed adaptive model-free control algorithm is proposed for consensus and formation-tracking problems in a network of agents with completely unknown nonlinear dynamic systems. The specification of the communication graph in the network is incorporated in the adaptive laws for estimation of the unknown linear and nonlinear terms, and in the online updating of the elements in the main controller gain matrix. The decentralized control signal at each agent in the network requires information about the states of the leader agent, as well as the desired formation variables of the agents in a local coordinate frame. These two sets of variables are provided at each agent by utilizing two recently proposed distributed observers. It is shown that only a spanning-tree rooted at the leader agent is enough for the convergence and stability of the proposed cooperative control and observer algorithms. Two simulation studies are provided to evaluate the performance of the proposed algorithm in comparison with two state-of-the-art distributed model-free control algorithms. With lower control effort as well as fewer offline gain tuning, the same level of consensus errors is achieved. Finally, the application of the proposed solution is studied in the formation-tracking control of a team of autonomous aerial mobile robots via simulation results.

Neural-Network-Based Distributed Asynchronous Event-Triggered Consensus Tracking of a Class of Uncertain Nonlinear Multi-Agent Systems

This article proposes a neural-network-based adaptive asynchronous event-triggered design strategy for the distributed consensus tracking of uncertain lower triangular nonlinear multi-agent systems under a directed network. Compared with the existing event-triggered recursive consensus tracking designs using multiple neural networks for each follower and continuous communications among followers, the primary contribution of this study is the development of an asynchronous event-triggered consensus tracking methodology based on a single-neural network for each follower under event-driven intermittent communications among followers. To this end, a distributed event-triggered estimator using neighbors' triggered output information is developed to estimate a leader signal. Subsequently, the estimated leader signal is used to design local trackers. Only a triggering law and a single-neural network are used to design the local tracking law of each follower, irrespective of unmatched unknown nonlinearities. The information of each follower and its neighbors is asynchronously and intermittently communicated through a directed network. Thus, the proposed asynchronous event-triggered tracking scheme can save communicational and computational resources. From the Lyapunov stability theorem, the stability of the entire closed-loop system is analyzed and the comparative simulation results demonstrate the effectiveness of the proposed control strategy.

Distributed Quantized Feedback Design Strategy for Adaptive Consensus Tracking of Uncertain Strict-Feedback Nonlinear Multiagent Systems With State Quantizers

This study investigates a quantized feedback design problem for distributed adaptive leader-following consensus of uncertain strict-feedback nonlinear multiagent systems with state quantizers. It is assumed that all system nonlinearities of followers are unknown and heterogeneous, all state variables of each follower are quantized by a uniform state quantizer, and quantized states of followers are only communicated under a directed network. Compared with previous approximation-based distributed consensus tracking methods for uncertain lower triangular multiagent systems, the main contribution of this article is addressing the distributed quantized state communication problem in the adaptive leader-following consensus tracking field of uncertain lower triangular multiagent systems. A quantized-states-based local adaptive control law for each follower is derived by designing quantized-signals-based weight tuning laws for neural-network-based function approximators. By analyzing the boundedness of the local quantization errors, it is shown that the total closed-loop signals are uniformly ultimately bounded and the consensus tracking errors converge to a sufficiently small domain around the origin. Finally, simulation examples, including multiple ship steering systems, are considered to verify the effectiveness of the proposed theoretical approach.