Q-learning based fault estimation and fault tolerant iterative learning control for MIMO systems

BAGAIL: Multi-modal imitation learning from imbalanced demonstrations

Expert demonstrations in imitation learning often contain different behavioral modes, e.g., driving modes such as driving on the left, keeping the lane, and driving on the right in the driving tasks. Although most existing multi-modal imitation learning methods allow learning from demonstrations of multiple modes, they have strict constraints on the data of each mode, generally requiring a near data ratio of all modes. Otherwise, it tends to fall into a mode collapse or only learn the data distribution of the mode that has the largest data volume. To address the problem, an algorithm that balances real-fake loss and classification loss by modifying the output of the discriminator, referred to as BAlanced Generative Adversarial Imitation Learning (BAGAIL), is proposed. With this modification, the generator is only rewarded for generating real trajectories with correct modes. BAGAIL is therefore able to deal with imbalanced expert demonstrations and carry out efficient learning for each mode. The learning process of BAGAIL is divided into a pre-training stage and an imitation learning stage. During the pre-training stage, BAGAIL initializes the generator parameters by means of conditional Behavioral Cloning, laying the foundation for the direction of parameter optimization. During the imitation learning stage, BAGAIL optimizes the parameters by using the adversary between the generator and the modified discriminator so that the finally obtained policy can successfully learn the distribution of imbalanced expert data. The experiments showed that BAGAIL accurately distinguished different behavioral modes with imbalanced demonstrations. What is more, the learning result of each mode is close to the expert standard and more stable than other multi-modal imitation learning methods.

Euler implicit time-discretization of multivariable sliding-mode controllers

This paper aims to develop the Euler implicit time-discretization of multivariable sliding-mode controllers to solve the numerical chattering problem without modifying the continuous-time control law. To this end, a continuous-time multi-input plant under a multivariable sliding-mode control is studied, and it is shown that the implicit discretization of the continuous-time sliding-mode controller leads to a multivariable generalized equation with several set-valued terms which is not possible to be solved using the graphical interpretations. Subsequently, an algorithm is proposed to solve such a multivariable generalized equation required to synthesize the implicit sliding-mode control signal at each time step. The proposed algorithm is explained through a simple example accompanied by numerical simulations. The properties of the implicit multivariable sliding-mode controller, e.g., finite-time convergence, gain insensitivity, and chattering suppression, are studied analytically. Afterwards, a multivariable sliding-mode controller is implemented on a digital processor based on the developed algorithm to control a six-input six-output system, i.e., six-component thrust generator, and the results are compared with the case where the continuous-time sliding-mode controller is implemented using the conventional Euler explicit discretization. In the end, the related issues and drawbacks are addressed to be considered in future works.