Iterative Learning Fault-Tolerant Control for Networked Batch Processes with Multirate Sampling and Quantization Effects

Off-policy two-dimensional reinforcement learning for optimal tracking control of batch processes with network-induced dropout and disturbances

In this paper, a new off-policy two-dimensional (2D) reinforcement learning approach is proposed to deal with the optimal tracking control (OTC) issue of batch processes with network-induced dropout and disturbances. A dropout 2D augmented Smith predictor is first devised to estimate the present extended state utilizing past data of time and batch orientations. The dropout 2D value function and Q-function are further defined, and their relation is analyzed to meet the optimal performance. On this basis, the dropout 2D Bellman equation is derived according to the principle of the Q-function. For the sake of addressing the dropout 2D OTC problem of batch processes, two algorithms, i.e., the off-line 2D policy iteration algorithm and the off-policy 2D Q-learning algorithm, are presented. The latter method is developed by applying only the input and the estimated state, not the underlying information of the system. Meanwhile, the analysis with regard to the unbiasedness of solutions and convergence is separately given. The effectiveness of the provided methodologies is eventually validated through the application of a simulated case during the filling process.

Quantitative Data-Driven Adaptive Iterative Learning Control: From Trajectory Tracking to Point-to-Point Tracking

This article reconsiders the data quantization problem in iterative learning control (ILC) for nonlinear nonaffine systems from four aspects: 1) use of available additional control knowledge; 2) different tracking tasks; 3) adaptation to uncertainties; and 4) data-driven design and analysis framework. An iterative linear data model (iLDM) is established first to represent the nonlinear nonaffine system for subsequent control algorithm design and analysis under a data-driven framework. A quantitative data-driven adaptive ILC (QDDAILC) is then developed using quantized tracking errors based on the nonlifted iLDM and, thus, additional available input information from previous time instants can be utilized to improve control performance. The parameter estimation derived from an adaptive updating law makes the learning gain of the QDDAILC adjustable, therefore improving the robustness to uncertainties. Due to the coupled dynamics among inputs and tracking errors, a new double-dynamics analysis method is introduced besides the contraction mapping principle to show error convergence. A quantized data-driven adaptive point-to-point ILC (QDDAPTPILC) is further presented using partial quantized measurements at the specified instants for multi-intermediate-point tracking. Simulation examples verify theoretical results and illustrate that the QDDAPTPILC outperforms the QDDAILC for multi-intermediate-point tracking tasks because it removes the unnecessary constraints.

A 2D-FM model-based robust iterative learning model predictive control for batch processes

The work deals with composite iterative learning model predictive control (CILMPC) for uncertain batch processes via a two dimensional Fornasini-Marchesini (2D-FM) model. A novel equivalent error system is first presented which is composed of state error and tracking error. Then an iterative learning predictive updating law is constructed by 2D state feedback control and the 'worst' case linear quadratic function is also designed. Besides, the update controller considering the input and output constraint will be optimized using the worst-case objective function along the infinite moving horizon. The solvable conditions that can be optimized online in real time are constructed using linear matrix inequalities (LMIs). The stability of the proposed control scheme can be achieved with the feasibility of the optimization problem. Compared with robust traditional MPC using one-dimensional models, the presented control approach can guarantee more degrees of tuning to achieve faster convergence of tracking error, which is of more significance since uncertainties exist inevitably in industrial batch processes. Finally, an injection molding process and a three-tank are introduced as two cases to demonstrate the feasibility and superiority of the proposed MPC strategy.