Data-Driven Multiagent Systems Consensus Tracking Using Model Free Adaptive Control

This paper investigates the data-driven consensus tracking problem for multiagent systems with both fixed communication topology and switching topology by utilizing a distributed model free adaptive control (MFAC) method. Here, agent's dynamics are described by unknown nonlinear systems and only a subset of followers can access the desired trajectory. The dynamical linearization technique is applied to each agent based on the pseudo partial derivative, and then, a distributed MFAC algorithm is proposed to ensure that all agents can track the desired trajectory. It is shown that the consensus error can be reduced for both time invariable and time varying desired trajectories. The main feature of this design is that consensus tracking can be achieved using only input-output data of each agent. The effectiveness of the proposed design is verified by simulation examples.

Terminal Sliding Mode-Based Consensus Tracking Control for Networked Uncertain Mechanical Systems on Digraphs

This brief investigates the finite-time consensus tracking control problem for networked uncertain mechanical systems on digraphs. A new terminal sliding-mode-based cooperative control scheme is developed to guarantee that the tracking errors converge to an arbitrarily small bound around zero in finite time. All the networked systems can have different dynamics and all the dynamics are unknown. A neural network is used at each node to approximate the local unknown dynamics. The control schemes are implemented in a fully distributed manner. The proposed control method eliminates some limitations in the existing terminal sliding-mode-based consensus control methods and extends the existing analysis methods to the case of directed graphs. Simulation results on networked robot manipulators are provided to show the effectiveness of the proposed control algorithms.

Distributed robust adaptive control of high order nonlinear multi agent systems

In this paper, a robust adaptive neural network based controller is presented for multi agent high order nonlinear systems with unknown nonlinear functions, unknown control gains and unknown actuator failures. At first, Neural Network (NN) is used to approximate the nonlinear uncertainty terms derived from the controller design procedure for the followers. Then, a novel distributed robust adaptive controller is developed by combining the backstepping method and the Dynamic Surface Control (DSC) approach. The proposed controllers are distributed in the sense that the designed controller for each follower agent only requires relative state information between itself and its neighbors. By using the Young's inequality, only few parameters need to be tuned regardless of NN nodes number. Accordingly, the problems of dimensionality curse and explosion of complexity are counteracted, simultaneously. New adaptive laws are designed by choosing the appropriate Lyapunov-Krasovskii functionals. The proposed approach proves the boundedness of all the closed-loop signals in addition to the convergence of the distributed tracking errors to a small neighborhood of the origin. Simulation results indicate that the proposed controller is effective and robust.

Neural network disturbance observer-based distributed finite-time formation tracking control for multiple unmanned helicopters

The distributed finite-time formation tracking control problem for multiple unmanned helicopters is investigated in this paper. The control object is to maintain the positions of follower helicopters in formation with external interferences. The helicopter model is divided into a second order outer-loop subsystem and a second order inner-loop subsystem based on multiple-time scale features. Using radial basis function neural network (RBFNN) technique, we first propose a novel finite-time multivariable neural network disturbance observer (FMNNDO) to estimate the external disturbance and model uncertainty, where the neural network (NN) approximation errors can be dynamically compensated by adaptive law. Next, based on FMNNDO, a distributed finite-time formation tracking controller and a finite-time attitude tracking controller are designed using the nonsingular fast terminal sliding mode (NFTSM) method. In order to estimate the second derivative of the virtual desired attitude signal, a novel finite-time sliding mode integral filter is designed. Finally, Lyapunov analysis and multiple-time scale principle ensure the realization of control goal in finite-time. The effectiveness of the proposed FMNNDO and controllers are then verified by numerical simulations.

Leader-follower formation control of underactuated surface vehicles based on sliding mode control and parameter estimation

This paper studies the leader-follower formation control of underactuated surface vehicles with model uncertainties and environmental disturbances. A parameter estimation and upper bound estimation based sliding mode control scheme is proposed to solve the problem of the unknown plant parameters and environmental disturbances. For each of these leader-follower formation systems, the dynamic equations of position and attitude are analyzed using coordinate transformation with the aid of the backstepping technique. All the variables are guaranteed to be uniformly ultimately bounded stable in the closed-loop system, which is proven by the distribution design Lyapunov function synthesis. The main advantages of this approach are that: first, parameter estimation based sliding mode control can enhance the robustness of the closed-loop system in presence of model uncertainties and environmental disturbances; second, a continuous function is developed to replace the signum function in the design of sliding mode scheme, which devotes to reduce the chattering of the control system. Finally, numerical simulations are given to demonstrate the effectiveness of the proposed method.

Neural-Learning-Based Telerobot Control With Guaranteed Performance

In this paper, a neural networks (NNs) enhanced telerobot control system is designed and tested on a Baxter robot. Guaranteed performance of the telerobot control system is achieved at both kinematic and dynamic levels. At kinematic level, automatic collision avoidance is achieved by the control design at the kinematic level exploiting the joint space redundancy, thus the human operator would be able to only concentrate on motion of robot's end-effector without concern on possible collision. A posture restoration scheme is also integrated based on a simulated parallel system to enable the manipulator restore back to the natural posture in the absence of obstacles. At dynamic level, adaptive control using radial basis function NNs is developed to compensate for the effect caused by the internal and external uncertainties, e.g., unknown payload. Both the steady state and the transient performance are guaranteed to satisfy a prescribed performance requirement. Comparative experiments have been performed to test the effectiveness and to demonstrate the guaranteed performance of the proposed methods.

Predictor-Based Neural Dynamic Surface Control for Uncertain Nonlinear Systems in Strict-Feedback Form

This paper presents a predictor-based neural dynamic surface control (PNDSC) design method for a class of uncertain nonlinear systems in a strict-feedback form. In contrast to existing NDSC approaches where the tracking errors are commonly used to update neural network weights, a predictor is proposed for every subsystem, and the prediction errors are employed to update the neural adaptation laws. The proposed scheme enables smooth and fast identification of system dynamics without incurring high-frequency oscillations, which are unavoidable using classical NDSC methods. Furthermore, the result is extended to the PNDSC with observer feedback, and its robustness against measurement noise is analyzed. Numerical and experimental results are given to demonstrate the efficacy of the proposed PNDSC architecture.

Consensus Control of Nonlinear Multiagent Systems With Time-Varying State Constraints

In this paper, we present a novel adaptive consensus algorithm for a class of nonlinear multiagent systems with time-varying asymmetric state constraints. As such, our contribution is a step forward beyond the usual consensus stabilization result to show that the states of the agents remain within a user defined, time-varying bound. To prove our new results, the original multiagent system is transformed into a new one. Stabilization and consensus of transformed states are sufficient to ensure the consensus of the original networked agents without violating of the predefined asymmetric time-varying state constraints. A single neural network (NN), whose weights are tuned online, is used in our design to approximate the unknown functions in the agent's dynamics. To account for the NN approximation residual, reconstruction error, and external disturbances, a robust term is introduced into the approximating system equation. Additionally in our design, each agent only exchanges the information with its neighbor agents, and thus the proposed consensus algorithm is decentralized. The theoretical results are proved via Lyapunov synthesis. Finally, simulations are performed on a nonlinear multiagent system to illustrate the performance of our consensus design scheme.

Neural Network-Based Adaptive Leader-Following Consensus Control for a Class of Nonlinear Multiagent State-Delay Systems

Compared with the existing neural network (NN) or fuzzy logic system (FLS) based adaptive consensus methods, the proposed approach can greatly alleviate the computation burden because it needs only to update a few adaptive parameters online. In the multiagent agreement control, the system uncertainties derive from the unknown nonlinear dynamics are counteracted by employing the adaptive NNs; the state delays are compensated by designing a Lyapunov-Krasovskii functional. Finally, based on Lyapunov stability theory, it is demonstrated that the proposed consensus scheme can steer a multiagent system synchronizing to the predefined reference signals. Two simulation examples, a numerical multiagent system and a practical multimanipulator system, are carried out to further verify and testify the effectiveness of the proposed agreement approach.

Distributed Adaptive Neural Control for Stochastic Nonlinear Multiagent Systems

In this paper, a consensus tracking problem of nonlinear multiagent systems is investigated under a directed communication topology. All the followers are modeled by stochastic nonlinear systems in nonstrict feedback form, where nonlinearities and stochastic disturbance terms are totally unknown. Based on the structural characteristic of neural networks (in Lemma 4), a novel distributed adaptive neural control scheme is put forward. The raised control method not only effectively handles unknown nonlinearities in nonstrict feedback systems, but also copes with the interactions among agents and coupling terms. Based on the stochastic Lyapunov functional method, it is indicated that all the signals of the closed-loop system are bounded in probability and all followers' outputs are convergent to a neighborhood of the output of leader. At last, the efficiency of the control method is testified by a numerical example.

Neuro-Adaptive Consensus Tracking of Multiagent Systems With a High-Dimensional Leader

This paper is concerned with the distributed consensus tracking problem of uncertain multiagent systems with directed communication topology and a single high-dimensional leader. Compared with existing related works, the dynamics of each follower in the present framework are subject to unmodeled dynamics and unknown external disturbances, which is more practical in various applications. Furthermore, the dimensions of leader's dynamics may be different with those of the followers' dynamics. Under the mild assumption that each follower can directly or indirectly sense the output information of the leader, a distributed robust adaptive neural network controller together with a local observer are designed to each follower to ensure that the states of each follower ultimately synchronize to the leader's output with bounded residual errors under a fixed topology. By appropriately constructing some multiple Lyapunov functions, the derived results are further extended to consensus tracking with switching directed communication topologies. The effectiveness of the analytical results is demonstrated via numerical simulations.

Adaptive fuzzy wavelet network control of second order multi-agent systems with unknown nonlinear dynamics

In this paper, consensus problem is considered for second order multi-agent systems with unknown nonlinear dynamics under undirected graphs. A novel distributed control strategy is suggested for leaderless systems based on adaptive fuzzy wavelet networks. Adaptive fuzzy wavelet networks are employed to compensate for the effect of unknown nonlinear dynamics. Moreover, the proposed method is developed for leader following systems and leader following systems with state time delays. Lyapunov functions are applied to prove uniformly ultimately bounded stability of closed loop systems and to obtain adaptive laws. Three simulation examples are presented to illustrate the effectiveness of the proposed control algorithms.

Robust consensus tracking control of multiple mechanical systems under fixed and switching interaction topologies

Consensus tracking problems for multiple mechanical systems are considered in this paper, where information communications are limited between individuals and the desired trajectory is available to only a subset of the mechanical systems. A distributed tracking algorithm based on computed torque approach is proposed in the fixed interaction topology case, in which a robust feedback term is developed for each agent to estimate the external disturbances and the unknown agent dynamics. Then the result is extended to address the case under switching interaction topologies by using Lyapunov approaches and sufficient conditions are given. Two examples and numerical simulations are presented to validate the effectiveness of the proposed robust tracking method.

Distributed Adaptive Neural Network Output Tracking of Leader-Following High-Order Stochastic Nonlinear Multiagent Systems With Unknown Dead-Zone Input

This paper studies the problem of distributed output tracking consensus control for a class of high-order stochastic nonlinear multiagent systems with unknown nonlinear dead-zone under a directed graph topology. The adaptive neural networks are used to approximate the unknown nonlinear functions and a new inequality is used to deal with the completely unknown dead-zone input. Then, we design the controllers based on backstepping method and the dynamic surface control technique. It is strictly proved that the resulting closed-loop system is stable in probability in the sense of semiglobally uniform ultimate boundedness and the tracking errors between the leader and the followers approach to a small residual set based on Lyapunov stability theory. Finally, two simulation examples are presented to show the effectiveness and the advantages of the proposed techniques.

Containment Control of Multiagent Systems With Dynamic Leaders Based on a $PI^{n}$ -Type Approach

This paper studies the containment control of multiagent systems (MASs) with multiple dynamic leaders in both continuous-time domain and discrete-time domain. The leaders' motions are described by the n th-order polynomial trajectories. This setting makes practical sense because given some critical points, the leaders' trajectories are usually planned by the polynomial interpolations. In order to drive all followers into the convex hull spanned by the leaders, a PI ⁿ -type containment algorithm is proposed ( P and I are short for proportional and integral, respectively; I ⁿ implies that the algorithm includes up to the n th-order integral terms). It is theoretically proved that the PI ⁿ -type containment algorithm is able to solve the containment problem of MASs where the followers are described by any order integral dynamics. Compared to the previous results on the MASs with dynamic leaders, the distinguished features of this paper are that: 1) the containment problem is studied not only in the continuous-time domain but also in the discrete-time domain while most existing results only work in the continuous-time domain; 2) to deal with the leaders with the n th-order polynomial trajectories, existing results require the follower's dynamics to be the ( n+ 1)th-order integral while the followers considered in this paper can be described by any-order integral dynamics; 3) the "sign" function is not employed in the proposed algorithm, which avoids the chattering phenomenon; and 4) both disturbance and measurement noise are taken into account. Finally, some simulation examples are given to demonstrate the effectiveness of the proposed algorithm.

Observer-Based Adaptive Backstepping Consensus Tracking Control for High-Order Nonlinear Semi-Strict-Feedback Multiagent Systems

Combined with backstepping techniques, an observer-based adaptive consensus tracking control strategy is developed for a class of high-order nonlinear multiagent systems, of which each follower agent is modeled in a semi-strict-feedback form. By constructing the neural network-based state observer for each follower, the proposed consensus control method solves the unmeasurable state problem of high-order nonlinear multiagent systems. The control algorithm can guarantee that all signals of the multiagent system are semi-globally uniformly ultimately bounded and all outputs can synchronously track a reference signal to a desired accuracy. A simulation example is carried out to further demonstrate the effectiveness of the proposed consensus control method.

Optimal Formation of Multirobot Systems Based on a Recurrent Neural Network

The optimal formation problem of multirobot systems is solved by a recurrent neural network in this paper. The desired formation is described by the shape theory. This theory can generate a set of feasible formations that share the same relative relation among robots. An optimal formation means that finding one formation from the feasible formation set, which has the minimum distance to the initial formation of the multirobot system. Then, the formation problem is transformed into an optimization problem. In addition, the orientation, scale, and admissible range of the formation can also be considered as the constraints in the optimization problem. Furthermore, if all robots are identical, their positions in the system are exchangeable. Then, each robot does not necessarily move to one specific position in the formation. In this case, the optimal formation problem becomes a combinational optimization problem, whose optimal solution is very hard to obtain. Inspired by the penalty method, this combinational optimization problem can be approximately transformed into a convex optimization problem. Due to the involvement of the Euclidean norm in the distance, the objective function of these optimization problems are nonsmooth. To solve these nonsmooth optimization problems efficiently, a recurrent neural network approach is employed, owing to its parallel computation ability. Finally, some simulations and experiments are given to validate the effectiveness and efficiency of the proposed optimal formation approach.

Distributed Synchronization Control of Multiagent Systems With Unknown Nonlinearities

This paper revisits the distributed adaptive control problem for synchronization of multiagent systems where the dynamics of the agents are nonlinear, nonidentical, unknown, and subject to external disturbances. Two communication topologies, represented, respectively, by a fixed strongly-connected directed graph and by a switching connected undirected graph, are considered. Under both of these communication topologies, we use distributed neural networks to approximate the uncertain dynamics. Decentralized adaptive control protocols are then constructed to solve the cooperative tracker problem, the problem of synchronization of all follower agents to a leader agent. In particular, we show that, under the proposed decentralized control protocols, the synchronization errors are ultimately bounded, and their ultimate bounds can be reduced arbitrarily by choosing the control parameter appropriately. Simulation study verifies the effectiveness of our proposed protocols.

Neural Controller Design-Based Adaptive Control for Nonlinear MIMO Systems With Unknown Hysteresis Inputs

This paper studies an adaptive neural control for nonlinear multiple-input multiple-output systems in interconnected form. The studied systems are composed of N subsystems in pure feedback structure and the interconnection terms are contained in every equation of each subsystem. Moreover, the studied systems consider the effects of Prandtl-Ishlinskii (PI) hysteresis model. It is for the first time to study the control problem for such a class of systems. In addition, the proposed scheme removes an important assumption imposed on the previous works that the bounds of the parameters in PI hysteresis are known. The radial basis functions neural networks are employed to approximate unknown functions. The adaptation laws and the controllers are designed by employing the backstepping technique. The closed-loop system can be proven to be stable by using Lyapunov theorem. A simulation example is studied to validate the effectiveness of the scheme.

Distributed Containment Control for Multiple Unknown Second-Order Nonlinear Systems With Application to Networked Lagrangian Systems

In this paper, we consider the distributed containment control problem for multiagent systems with unknown nonlinear dynamics. More specifically, we focus on multiple second-order nonlinear systems and networked Lagrangian systems. We first study the distributed containment control problem for multiple second-order nonlinear systems with multiple dynamic leaders in the presence of unknown nonlinearities and external disturbances under a general directed graph that characterizes the interaction among the leaders and the followers. A distributed adaptive control algorithm with an adaptive gain design based on the approximation capability of neural networks is proposed. We present a necessary and sufficient condition on the directed graph such that the containment error can be reduced as small as desired. As a byproduct, the leaderless consensus problem is solved with asymptotical convergence. Because relative velocity measurements between neighbors are generally more difficult to obtain than relative position measurements, we then propose a distributed containment control algorithm without using neighbors' velocity information. A two-step Lyapunov-based method is used to study the convergence of the closed-loop system. Next, we apply the ideas to deal with the containment control problem for networked unknown Lagrangian systems under a general directed graph. All the proposed algorithms are distributed and can be implemented using only local measurements in the absence of communication. Finally, simulation examples are provided to show the effectiveness of the proposed control algorithms.

Toward a new task assignment and path evolution (TAPE) for missile defense system (MDS) using intelligent adaptive SOM with recurrent neural networks (RNNs)

In this paper, a new adaptive self-organizing map (SOM) with recurrent neural network (RNN) controller is proposed for task assignment and path evolution of missile defense system (MDS). We address the problem of N agents (defending missiles) and D targets (incoming missiles) in MDS. A new RNN controller is designed to force an agent (or defending missile) toward a target (or incoming missile), and a monitoring controller is also designed to reduce the error between RNN controller and ideal controller. A new SOM with RNN controller is then designed to dispatch agents to their corresponding targets by minimizing total damaging cost. This is actually an important application of the multiagent system. The SOM with RNN controller is the main controller. After task assignment, the weighting factors of our new SOM with RNN controller are activated to dispatch the agents toward their corresponding targets. Using the Lyapunov constraints, the weighting factors for the proposed SOM with RNN controller are updated to guarantee the stability of the path evolution (or planning) system. Excellent simulations are obtained using this new approach for MDS, which show that our RNN has the lowest average miss distance among the several techniques.