1
|
Zhao S, Wang J, Xu H, Wang B. Composite Observer-Based Optimal Attitude-Tracking Control With Reinforcement Learning for Hypersonic Vehicles. IEEE TRANSACTIONS ON CYBERNETICS 2023; 53:913-926. [PMID: 35969557 DOI: 10.1109/tcyb.2022.3192871] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
This article proposes an observer-based reinforcement learning (RL) control approach to address the optimal attitude-tracking problem and application for hypersonic vehicles in the reentry phase. Due to the unknown uncertainty and nonlinearity caused by parameter perturbation and external disturbance, accurate model information of hypersonic vehicles in the reentry phase is generally unavailable. For this reason, a novel synchronous estimation is proposed to construct a composite observer for hypersonic vehicles, which consists of a neural-network (NN)-based Luenberger-type observer and a synchronous disturbance observer. This solves the identification problem of nonlinear dynamics in the reference control and realizes the estimation of the system state when unknown nonlinear dynamics and unknown disturbance exist at the same time. By synthesizing the information from the composite observer, an RL tracking controller is developed to solve the optimal attitude-tracking control problem. To improve the convergence performance of critic network weights, concurrent learning is employed to replace the traditional persistent excitation condition with a historical experience replay manner. In addition, this article proves that the weight estimation error is bounded when the learning rate satisfies the given sufficient condition. Finally, the numerical simulation demonstrates the effectiveness and superiority of the proposed approaches to attitude-tracking control systems for hypersonic vehicles.
Collapse
|
2
|
A Novel Reformed Reduced Kernel Extreme Learning Machine with RELIEF-F for Classification. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:4795535. [PMID: 35371239 PMCID: PMC8970950 DOI: 10.1155/2022/4795535] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/25/2021] [Revised: 02/15/2022] [Accepted: 02/28/2022] [Indexed: 11/30/2022]
Abstract
With the exponential growth of the Internet population, scientists and researchers face the large-scale data for processing. However, the traditional algorithms, due to their complex computation, are not suitable for the large-scale data, although they play a vital role in dealing with large-scale data for classification and regression. One of these variants, which is called Reduced Kernel Extreme Learning Machine (Reduced-KELM), is widely used in the classification task and attracts attention from researchers due to its superior performance. However, it still has limitations, such as instability of prediction because of the random selection and the redundant training samples and features because of large-scaled input data. This study proposes a novel model called Reformed Reduced Kernel Extreme Learning Machine with RELIEF-F (R-RKELM) for human activity recognition. RELIEF-F is applied to discard the attributes of samples with the negative values in the weights. A new sample selection approach, which is used to further reduce training samples and to replace the random selection part of Reduced-KELM, solves the unstable classification problem in the conventional Reduced-KELM and computation complexity problem. According to experimental results and statistical analysis, our proposed model obtains the best classification performances for human activity data sets than those of the baseline model, with an accuracy of 92.87 % for HAPT, 92.81 % for HARUS, and 86.92 % for Smartphone, respectively.
Collapse
|
3
|
Hu Y, Wang H, Cao Z, Zheng J, Ping Z, Chen L, Jin X. Extreme-learning-machine-based FNTSM control strategy for electronic throttle. Neural Comput Appl 2019. [DOI: 10.1007/s00521-019-04446-9] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
|
4
|
Xu B, Sun F. Composite Intelligent Learning Control of Strict-Feedback Systems With Disturbance. IEEE TRANSACTIONS ON CYBERNETICS 2018; 48:730-741. [PMID: 28166515 DOI: 10.1109/tcyb.2017.2655053] [Citation(s) in RCA: 49] [Impact Index Per Article: 8.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
This paper addresses the dynamic surface control of uncertain nonlinear systems on the basis of composite intelligent learning and disturbance observer in presence of unknown system nonlinearity and time-varying disturbance. The serial-parallel estimation model with intelligent approximation and disturbance estimation is built to obtain the prediction error and in this way the composite law for weights updating is constructed. The nonlinear disturbance observer is developed using intelligent approximation information while the disturbance estimation is guaranteed to converge to a bounded compact set. The highlight is that different from previous work directly toward asymptotic stability, the transparency of the intelligent approximation and disturbance estimation is included in the control scheme. The uniformly ultimate boundedness stability is analyzed via Lyapunov method. Through simulation verification, the composite intelligent learning with disturbance observer can efficiently estimate the effect caused by system nonlinearity and disturbance while the proposed approach obtains better performance with higher accuracy.
Collapse
|
5
|
Wang F, Zou Q, Hua C, Zong Q. Dynamic surface tracking controller design for a constrained hypersonic vehicle based on disturbance observer. INT J ADV ROBOT SYST 2017. [DOI: 10.1177/1729881417703776] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022] Open
Affiliation(s)
- Fang Wang
- School of Science, Yanshan University, Qinhuangdao, China
| | - Qin Zou
- School of Mechanics, Yanshan University, Qinhuangdao, China
| | - Changchun Hua
- School of Electrical and Engineering, State Key Laboratory of Metastable Materials Science and Technology, Yanshan University, Qinhuangdao, China
| | - Qun Zong
- School of Electrical Engineering and Automation, Tianjin University, Tianjin, China
| |
Collapse
|
6
|
Yan X, Chen M, Wu Q, Shao S. Adaptive neural tracking control for near-space vehicles with stochastic disturbances. INT J ADV ROBOT SYST 2017. [DOI: 10.1177/1729881417703777] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
Affiliation(s)
- Xiaohui Yan
- College of Automation Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, China
- Department of Mathematics and Physics, Hefei University, Hefei, China
| | - Mou Chen
- College of Automation Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, China
| | - Qingxian Wu
- College of Automation Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, China
| | - Shuyi Shao
- College of Automation Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, China
| |
Collapse
|
7
|
Huang B, Li A, Xu B. Adaptive fault tolerant control for hypersonic vehicle with external disturbance. INT J ADV ROBOT SYST 2017. [DOI: 10.1177/1729881416687136] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022] Open
Abstract
In this article, an adaptive fault tolerant control strategy is proposed to solve the trajectory tracking problem of a generic hypersonic vehicle subjected to actuator fault, external disturbance, and input saturation. The longitudinal model of generic hypersonic vehicle is divided into velocity subsystem and altitude subsystem, in which dynamic inversion and backstepping are applied, respectively, to track the desired trajectories. For the unknown maximum disturbance upper bound, actuator fault, and input saturation constraint, adaptive laws are proposed to estimate these information online. Finally, numeric simulation is conducted in the cruise phase for generic hypersonic vehicle. Simulation results show that the controllers designed in this article can make generic hypersonic vehicle track the desired trajectories in the presence of actuator fault, external disturbance, and input saturation.
Collapse
Affiliation(s)
- Bing Huang
- School of Automation, Northwestern Polytechnical University, Xi’an, Shaanxi, China
| | - Aijun Li
- School of Automation, Northwestern Polytechnical University, Xi’an, Shaanxi, China
| | - Bin Xu
- School of Automation, Northwestern Polytechnical University, Xi’an, Shaanxi, China
- Shenzhen Research Institute of Northwestern Polytechnical University, Shenzhen, China
| |
Collapse
|
8
|
|
9
|
Adaptive neural prescribed performance tracking control for near space vehicles with input nonlinearity. Neurocomputing 2016. [DOI: 10.1016/j.neucom.2015.09.099] [Citation(s) in RCA: 70] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
|
10
|
Bu X, Wu X, Ma Z, Zhang R, Huang J. Novel auxiliary error compensation design for the adaptive neural control of a constrained flexible air-breathing hypersonic vehicle. Neurocomputing 2016. [DOI: 10.1016/j.neucom.2015.06.058] [Citation(s) in RCA: 26] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
11
|
Azad NL, Mozaffari A, Hedrick JK. A hybrid switching predictive controller based on bi-level kernel-based ELM and online trajectory builder for automotive coldstart emissions reduction. Neurocomputing 2016. [DOI: 10.1016/j.neucom.2015.08.070] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
12
|
Neural adaptive control of hypersonic aircraft with actuator fault using randomly assigned nodes. Neurocomputing 2016. [DOI: 10.1016/j.neucom.2015.10.023] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
|
13
|
Zhang Y, Zhang L, Li P. A novel biologically inspired ELM-based network for image recognition. Neurocomputing 2016. [DOI: 10.1016/j.neucom.2015.03.117] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
14
|
|
15
|
Bu X, Wu X, Zhu F, Huang J, Ma Z, Zhang R. Novel prescribed performance neural control of a flexible air-breathing hypersonic vehicle with unknown initial errors. ISA TRANSACTIONS 2015; 59:149-159. [PMID: 26456727 DOI: 10.1016/j.isatra.2015.09.007] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/16/2015] [Revised: 05/22/2015] [Accepted: 09/07/2015] [Indexed: 06/05/2023]
Abstract
A novel prescribed performance neural controller with unknown initial errors is addressed for the longitudinal dynamic model of a flexible air-breathing hypersonic vehicle (FAHV) subject to parametric uncertainties. Different from traditional prescribed performance control (PPC) requiring that the initial errors have to be known accurately, this paper investigates the tracking control without accurate initial errors via exploiting a new performance function. A combined neural back-stepping and minimal learning parameter (MLP) technology is employed for exploring a prescribed performance controller that provides robust tracking of velocity and altitude reference trajectories. The highlight is that the transient performance of velocity and altitude tracking errors is satisfactory and the computational load of neural approximation is low. Finally, numerical simulation results from a nonlinear FAHV model demonstrate the efficacy of the proposed strategy.
Collapse
Affiliation(s)
- Xiangwei Bu
- Air and Missile Defense College, Air Force Engineering University, Xi'an 710051, China.
| | - Xiaoyan Wu
- Air and Missile Defense College, Air Force Engineering University, Xi'an 710051, China
| | - Fujing Zhu
- Air and Missile Defense College, Air Force Engineering University, Xi'an 710051, China
| | - Jiaqi Huang
- Air and Missile Defense College, Air Force Engineering University, Xi'an 710051, China
| | - Zhen Ma
- Air and Missile Defense College, Air Force Engineering University, Xi'an 710051, China
| | - Rui Zhang
- Air and Missile Defense College, Air Force Engineering University, Xi'an 710051, China
| |
Collapse
|
16
|
Zhang Y, Wang S. MLP technique based reinforcement learning control of discrete pure-feedback systems. Neurocomputing 2015. [DOI: 10.1016/j.neucom.2015.05.087] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
17
|
Xu B, Fan Y, Zhang S. Minimal-learning-parameter technique based adaptive neural control of hypersonic flight dynamics without back-stepping. Neurocomputing 2015. [DOI: 10.1016/j.neucom.2015.02.069] [Citation(s) in RCA: 54] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
18
|
|
19
|
|
20
|
Rong HJ, Wei JT, Bai JM, Zhao GS, Liang YQ. Adaptive neural control for a class of MIMO nonlinear systems with extreme learning machine. Neurocomputing 2015. [DOI: 10.1016/j.neucom.2014.01.066] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
|
21
|
Xu B, Shi Z, Yang C, Sun F. Composite neural dynamic surface control of a class of uncertain nonlinear systems in strict-feedback form. IEEE TRANSACTIONS ON CYBERNETICS 2014; 44:2626-2634. [PMID: 24718583 DOI: 10.1109/tcyb.2014.2311824] [Citation(s) in RCA: 114] [Impact Index Per Article: 11.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
Abstract
This paper studies the composite adaptive tracking control for a class of uncertain nonlinear systems in strict-feedback form. Dynamic surface control technique is incorporated into radial-basis-function neural networks (NNs)-based control framework to eliminate the problem of explosion of complexity. To avoid the analytic computation, the command filter is employed to produce the command signals and their derivatives. Different from directly toward the asymptotic tracking, the accuracy of the identified neural models is taken into consideration. The prediction error between system state and serial-parallel estimation model is combined with compensated tracking error to construct the composite laws for NN weights updating. The uniformly ultimate boundedness stability is established using Lyapunov method. Simulation results are presented to demonstrate that the proposed method achieves smoother parameter adaption, better accuracy, and improved performance.
Collapse
|