1
|
Li J, Yang M. Learning-based near-optimal tracking control for industrial processes with slow and fast modes. ISA TRANSACTIONS 2023; 141:212-222. [PMID: 37451921 DOI: 10.1016/j.isatra.2023.06.021] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/20/2022] [Revised: 05/31/2023] [Accepted: 06/23/2023] [Indexed: 07/18/2023]
Abstract
This paper devotes to solving the optimal tracking control (OTC) problem of singular perturbation systems in industrial processes under the framework of reinforcement learning (RL) technology. The encountered challenges include the different time scales in system operations and an unknown slow process. The immeasurability of slow process states especially increases the difficulty of finding the optimal tracking controller. To overcome these challenges, a novel off-policy ridge RL method is developed after decomposing the singular perturbed systems using the singular perturbation (SP) theory and replacing unmeasured states using important mathematical manipulations. Theoretical analysis of approximate equivalence of the sum of solutions of subproblems to the solution of the OTC problem is presented. Finally, a mixed separation thickening process (MSTP) and a numerical example are used to verify the effectiveness.
Collapse
Affiliation(s)
- Jinna Li
- School of Information and Control Engineering, Liaoning Petrochemical University, Fushun, 113001, PR China.
| | - Mingwei Yang
- School of Information and Control Engineering, Liaoning Petrochemical University, Fushun, 113001, PR China.
| |
Collapse
|
2
|
$$H_{\infty }$$ Secure Consensus of Two-Time-Scale Markov Jump Multi-agent Systems with Partially Unknown Transition Rates Against Hybrid Cyber-Attacks. Neural Process Lett 2023. [DOI: 10.1007/s11063-022-11128-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/04/2023]
|
3
|
An Q, Wu S, Shi R, Wang H, Yu J, Li Z. Intelligent Detection of Hazardous Goods Vehicles and Determination of Risk Grade Based on Deep Learning. SENSORS (BASEL, SWITZERLAND) 2022; 22:s22197123. [PMID: 36236221 PMCID: PMC9571748 DOI: 10.3390/s22197123] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/15/2022] [Revised: 08/26/2022] [Accepted: 08/26/2022] [Indexed: 05/20/2023]
Abstract
Currently, deep learning has been widely applied in the field of object detection, and some relevant scholars have applied it to vehicle detection. In this paper, the deep learning EfficientDet model is analyzed, and the advantages of the model in the detection of hazardous good vehicles are determined. The adaptive training model is built based on the optimization of the training process, and the training model is used to detect hazardous goods vehicles. The detection results are compared with Cascade R-CNN and CenterNet, and the results show that the proposed method is superior to the other two methods in two aspects of computational complexity and detection accuracy. Simultaneously, the proposed method is suitable for the detection of hazardous goods vehicles in different scenarios. We make statistics on the number of detected hazardous goods vehicles at different times and places. The risk grade of different locations is determined according to the statistical results. Finally, the case study shows that the proposed method can be used to detect hazardous goods vehicles and determine the risk level of different places.
Collapse
Affiliation(s)
- Qing An
- School of Artificial Intelligence, Wuchang University of Technology, Wuhan 430223, China
| | - Shisong Wu
- China Railway Wuhan Survey and Design Institute Co., Ltd., Building E5, Optics Valley Software Park, No. 1, Guanshan Avenue, Donghu High-Tech Zone, Wuhan 430050, China
| | - Ruizhe Shi
- School of Safety Science and Emergency Management, Wuhan University of Technology, Wuhan 430070, China
- Correspondence:
| | - Haojun Wang
- School of Safety Science and Emergency Management, Wuhan University of Technology, Wuhan 430070, China
| | - Jun Yu
- USTC iFLYTEK Co., Ltd., Hefei 230088, China
| | - Zhifeng Li
- School of Artificial Intelligence, Wuchang University of Technology, Wuhan 430223, China
| |
Collapse
|
4
|
Qiu Q, Su H, Zeng Z. Distributed Adaptive Output Feedback Consensus of Parabolic PDE Agents on Undirected Networks. IEEE TRANSACTIONS ON CYBERNETICS 2022; 52:7742-7752. [PMID: 33566784 DOI: 10.1109/tcyb.2021.3050729] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
In this article, we investigate the distributed adaptive consensus problem of parabolic partial differential equation (PDE) agents by output feedback on undirected communication networks, in which two cases of no leader and leader-follower with a leader are taken into account. For the leaderless case, a novel distributed adaptive protocol, namely, the vertex-based protocol, is designed to achieve consensus by taking advantage of the relative output information of itself and its neighbors for any given undirected connected communication graph. For the case of leader-follower, a distributed continuous adaptive controller is put forward to converge the tracking error to a bounded domain by using the Lyapunov function, graph theory, and PDE theory. Furthermore, a corollary that the tracking error tends to zero by replacing the continuous controller with the discontinuous controller is given. Finally, the relevant simulation results are further demonstrated to demonstrate the theoretical results obtained.
Collapse
|
5
|
Wang X, Jiang GP, Su H, Zeng Z. Consensus-Based Distributed Reduced-Order Observer Design for LTI Systems. IEEE TRANSACTIONS ON CYBERNETICS 2022; 52:6331-6341. [PMID: 33151885 DOI: 10.1109/tcyb.2020.3025603] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
In this article, we refocus on the distributed observer construction of a continuous-time linear time-invariant (LTI) system, which is called the target system, by using a network of observers to measure the output of the target system. Each observer can access only a part of the component information of the output of the target system, but the consensus-based communication among them can make it possible for each observer to estimate the full state vector of the target system asymptotically. The main objective of this article is to simplify the distributed reduced-order observer design for the LTI system on the basis of the consensus communication pattern. For observers interacting on a directed graph, we first address the problem of the distributed reduced-order observer design for the detectable target system and provide sufficient conditions involving the topology information to guarantee the existence of the distributed reduced-order observer. Then, the dependence on the topology information in the sufficient conditions will be eliminated by using the adaptive strategy and so that a completely distributed reduced-order observer can be designed for the target system. Finally, some numerical simulations are proposed to verify the theoretical results.
Collapse
|
6
|
Liu Y, Su H, Zeng Z. Second-Order Consensus for Multiagent Systems With Switched Dynamics. IEEE TRANSACTIONS ON CYBERNETICS 2022; 52:4105-4114. [PMID: 32924944 DOI: 10.1109/tcyb.2020.3015977] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
This article investigates the consensus control problem for second-order multiagent systems with switched dynamics, consisting of a continuous-time subsystem and a discrete-time subsystem. Under a fixed directed topology, two linear control protocols are proposed for achieving consensus. One is that two subsystems use different control inputs, where the continuous-time system uses continuous-time control, and the discrete-time system uses discrete-time control. In order to reach consensus for this kind of control protocol, some necessary and sufficient conditions are derived. The other is to use the same control algorithm for the two subsystems, which is a sampled-data control input. Similar consensus conditions are also obtained. Finally, a few simulation examples are given to verify the theoretical results.
Collapse
|
7
|
Sun Y, Su H, Zeng Z. H∞ Control for Observer-Based Non-Negative Edge Consensus of Discrete-Time Networked Systems. IEEE TRANSACTIONS ON CYBERNETICS 2022; 52:2351-2360. [PMID: 32649287 DOI: 10.1109/tcyb.2020.3003279] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
This article is concerned with observer-based non-negative edge-consensus (OBNNEC) problems of networked discrete-time systems with or without actuator saturation. An algorithm which only uses actual outputs of neighboring edges is proposed by means of an H∞ control method and modified algebraic Riccati equation (MARE)-based technique. The observer matrix and feedback matrix are constructed by solving the MARE and linear matrix inequality (LMI), respectively. Then, sufficient conditions for guaranteeing bounded inputs and non-negative edge states are derived. In addition, the low-gain characteristic of the MARE-based method is instrumental in guaranteeing non-negative edge states and deriving the feasible observer matrix and feedback matrix. Finally, two examples are shown to demonstrate the obtained theoretical results.
Collapse
|
8
|
Long M, Su H, Zeng Z. Output-Feedback Global Consensus of Discrete-Time Multiagent Systems Subject to Input Saturation via Q-Learning Method. IEEE TRANSACTIONS ON CYBERNETICS 2022; 52:1661-1670. [PMID: 32396125 DOI: 10.1109/tcyb.2020.2987385] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
This article proposes a Q -learning (QL)-based algorithm for global consensus of saturated discrete-time multiagent systems (DTMASs) via output feedback. According to the low-gain feedback (LGF) theory, control inputs of the saturated DTMASs can avoid the saturation by utilizing the control policies with LGF matrices, which were computed from the modified algebraic Riccati equation (MARE) by requiring the information of system dynamics in most previous works. However, in this article, we first find the lower bound on the real part of Laplacian matrices' nonzero eigenvalues of directed network topologies. Then, we define a test control input and propose a Q -function to derive a QL Bellman equation, which plays an essential part of the QL algorithm. Subsequently, different from the previous works, the output-feedback gain (OFG) matrix of this article can be obtained by limited iterations of the QL algorithm without requiring the information of agent dynamics and network topologies of the saturated DTMASs. Furthermore, the saturated DTMASs can achieve global consensus rather than the semiglobal consensus of the previous results. Finally, the effectiveness of the QL algorithm is confirmed via two simulations.
Collapse
|
9
|
Su H, Chen J, Chen X, He H. Adaptive Observer-Based Output Regulation of Multiagent Systems With Communication Constraints. IEEE TRANSACTIONS ON CYBERNETICS 2021; 51:5259-5268. [PMID: 32520712 DOI: 10.1109/tcyb.2020.2995147] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
In the absence of assuming that all agents know the system matrix of the external system, for heterogeneous linear multiagent systems (MASs), this article resolves the cooperative regulation problem in the presence of communication constraints. Based on the mild assumption on the digraph, two novel adaptive protocols are presented to solve the cooperative output regulation problem (ORP) via state feedback and measurement output feedback subject to snatchy and asynchronous information exchange between agents, unknown time-varying delays, and probable information losses. Finally, some simulations are offered to demonstrate the validity of our results about the problem.
Collapse
|
10
|
Containment control in fractional-order multi-agent systems with intermittent sampled data over directed networks. Neurocomputing 2021. [DOI: 10.1016/j.neucom.2021.01.136] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
|
11
|
Liu B, Su H, Wu L, Li X, Lu X. Fractional-order controllability of multi-agent systems with time-delay. Neurocomputing 2021. [DOI: 10.1016/j.neucom.2020.04.083] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
12
|
Su H, Wang X, Zeng Z. Consensus of Second-Order Hybrid Multiagent Systems by Event-Triggered Strategy. IEEE TRANSACTIONS ON CYBERNETICS 2020; 50:4648-4657. [PMID: 31722505 DOI: 10.1109/tcyb.2019.2948209] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
In this article, an event-triggered method is proposed to solve the consensus of the second-order hybrid multiagent systems (MASs), which contain discrete-time and continuous-time individuals. First, we give a selection criteria of the coupling gains, the eigenvalues of communication topology, and the event-triggered sampling interval to guarantee the hybrid consensus, which have an impact on system stability, due to the interaction and co-existence of discrete-time and continuous-time individuals. Second, the hybrid second-order consensus under the event-triggered strategy is proven, where the agents communicate with their neighbors and update their controllers only at the triggered instants. Finally, we give some simulation examples to prove the validity of the main results.
Collapse
|
13
|
Liu B, Ping Y, Wu L, Su H. Controllability of discrete-time multi-agent systems based on absolute protocol with time-delays. Neurocomputing 2020. [DOI: 10.1016/j.neucom.2020.05.046] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
|
14
|
Disturbance-observer based consensus of linear multi-agent systems with exogenous disturbance under intermittent communication. Neurocomputing 2020. [DOI: 10.1016/j.neucom.2020.04.051] [Citation(s) in RCA: 22] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
|
15
|
Wang X, Wang X, Su H, Lam J. Coordination Control for Uncertain Networked Systems Using Interval Observers. IEEE TRANSACTIONS ON CYBERNETICS 2020; 50:4008-4019. [PMID: 31670690 DOI: 10.1109/tcyb.2019.2945580] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
In this article, we take the coordination control problem of linear time-invariant networked systems with uncertain additive disturbance and uncertain initial states into consideration. A distributed interval observer is first constructed for uncertain networked systems in which the control algorithm of each agent involves only the upper bound information and the lower bound information of the interval observer associated with itself and its neighbors, respectively. With the help of the cooperativity theory, it is proved that the interval observer can estimate the piecewise state for each agent and the interval-observer-based control algorithm can drive the uncertain system to achieve coordination behavior. Then, time-varying coordinate transformation is introduced to construct a novel interval observer which can eliminate the cooperativity premise on the system matrices and bound the states of all agents in real time. It is shown that the novel interval-observer-based control algorithm can guide the uncertain system to reach coordinated behavior. Finally, the numerical simulations are provided to verify the theoretical results.
Collapse
|
16
|
Su H, Sun Y, Zeng Z. Semiglobal Observer-Based Non-Negative Edge Consensus of Networked Systems With Actuator Saturation. IEEE TRANSACTIONS ON CYBERNETICS 2020; 50:2827-2836. [PMID: 31180905 DOI: 10.1109/tcyb.2019.2917006] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
The observer-based edge-consensus problem of networked continuous-time dynamical systems with edge state non-negative constraint and actuator saturation is considered in this paper. Based on line graph theory, low-gain output-feedback technique and algebraic Riccati equation (ARE)-based method, two edge-consensus algorithms are designed to achieve the observer-based edge consensus, in which the specific mathematical expressions of the two algorithms are obtained. Meanwhile, sufficient conditions are obtained to meet the bounded inputs and the non-negative edge states by combining with the ARE-based low-gain output-feedback technique and the positive system theory. Moreover, the feedback-gain and observer-gain matrices which must meet the sufficient conditions at the same time are existed and easy to obtain. Finally, two simulation cases are introduced to show the effectiveness of the theoretical results.
Collapse
|
17
|
Liu Y, Su H. Some necessary and sufficient conditions for containment of second-order multi-agent systems with sampled position data. Neurocomputing 2020. [DOI: 10.1016/j.neucom.2019.10.031] [Citation(s) in RCA: 31] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
18
|
Long M, Su H, Wang X, Liu B. Controllability of heterogeneous multiagent systems with two-time-scale feature. CHAOS (WOODBURY, N.Y.) 2019; 29:043116. [PMID: 31042957 DOI: 10.1063/1.5090319] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/26/2019] [Accepted: 03/25/2019] [Indexed: 06/09/2023]
Abstract
In this paper, we investigate the controllability problems for heterogeneous multiagent systems (MASs) with two-time-scale feature under fixed topology. Firstly, the heterogeneous two-time-scale MASs are modeled by singular perturbation system with a singular perturbation parameter, which distinguishes fast and slow subsystems evolving on two different time scales. Due to the ill-posedness problems caused by the singular perturbation parameter, we analyze the two-time-scale MASs via the singular perturbation method, instead of the general methods. Then, we split the heterogeneous two-time-scale MASs into slow and fast subsystems to eliminate the singular perturbation parameter. Subsequently, according to the matrix theory and the graph theory, we propose some necessary/sufficient criteria for the controllability of the heterogeneous two-time-scale MASs. Lastly, we give some simulation and numerical examples to demonstrate the effectiveness of the proposed theoretical results.
Collapse
Affiliation(s)
- Mingkang Long
- School of Artificial Intelligence and Automation, Image Processing and Intelligent Control Key Laboratory of Education Ministry of China, Huazhong University of Science and Technology, Luoyu Road 1037, Wuhan 430074, China
| | - Housheng Su
- School of Artificial Intelligence and Automation, Image Processing and Intelligent Control Key Laboratory of Education Ministry of China, Huazhong University of Science and Technology, Luoyu Road 1037, Wuhan 430074, China
| | - Xiaoling Wang
- School of Automation, Nanjing University of Posts and Telecommunications, Nanjing 210023, China
| | - Bo Liu
- College of Science, North China University of Technology, Beijing 100144, China
| |
Collapse
|
19
|
Semi-global observer-based nonnegative edge-consensus of linear discrete-time multi-agent systems with nonnegative constraint and input saturation. Neurocomputing 2019. [DOI: 10.1016/j.neucom.2018.12.072] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
|
20
|
Zhang J, Su H. Time-varying formation for linear multi-agent systems based on sampled data with multiple leaders. Neurocomputing 2019. [DOI: 10.1016/j.neucom.2019.02.018] [Citation(s) in RCA: 38] [Impact Index Per Article: 7.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|