TDMA Datalink Cooperative Navigation Algorithm Based on INS/JTIDS/BA

Distributed deep reinforcement learning based on bi-objective framework for multi-robot formation

Improving generalization ability in multi-robot formation can reduce repetitive training and calculation. In this paper, we study the multi-robot formation problem with the ability to generalize the target position. Since the generalization ability of neural network is directly proportional to spatial dimension, we adopt the strategy of using different networks to solve different objectives, so that the network learning can focus on the learning of one objective to obtain better performance. In addition, this paper presents a distributed deep reinforcement learning method based on soft actor-critic algorithm for solving multi-robot formation problem. At the same time, the formation evaluation assignment function is designed to adapt to distributed training. Compared with the original algorithm, the improved algorithm can get higher reward cumulative values. The experimental results show that the proposed algorithm can better maintain the desired formation in the moving process, and the rotation design in the reward function makes the multi-robot system have better flexibility in formation. The comparison of control signal curve shows that the proposed algorithm is more stable. At the end of the experiments, the universality of the proposed algorithm in formation maintenance and formation variations is demonstrated.

Cooperative Location Method for Leader-Follower UAV Formation Based on Follower UAV's Moving Vector

The traditional leader-follower Unmanned Aerial Vehicle (UAV) formation cooperative positioning (CP) algorithm, based on relative ranging, requires at least four leader UAV positions to be known accurately, using relative distance with leader UAVs to achieve the unknown position follower UAV's high-precision positioning. When the number of the known position leader UAVs is limited, the traditional CP algorithm is not applicable. Aiming at the minimum cooperative unit, which consists of a known position leader UAV and an unknown position follower UAV, this paper proposes a CP method based on the follower UAV's moving vector. Considering the follower UAV can only acquire the single distance with the leader UAV at each distance-sampling period, it is difficult to determine the follower UAV's spatial location. The follower UAV's moving vector is used to construct position observation of the follower UAV's inertial navigation system (INS). High-precision positioning is achieved by combining the follower UAV's moving vector. In the process of CP, the leader UAV obtains a high-precision position by an INS/Global Positioning System (GPS) loosely integrated navigation system and transmits its position information to the follower UAV. Based on accurate modeling of the follower UAV's INS, the position, velocity and heading observation equation of the follower UAV's INS are constructed. The improved extended Kalman filtering is designed to estimate the state vector to improve the follower UAV's positioning accuracy. In addition, considering that the datalink system based on radio signals may be interfered with by the external environment, it is difficult for the follower UAV to obtain relative distance information from the leader UAV in real time. In this paper, the availability of the relative distance information is judged by a two-state Markov chain. Finally, a real flight test is conducted to validate the performance of the proposed algorithm.

Research on Gradient-Descent Extended Kalman Attitude Estimation Method for Low-Cost MARG

Aiming at the problem of the weak dynamic performance of the gradient descent method in the attitude and heading reference system, the susceptibility to the interference of accelerometers and magnetometers, and the complex calculation of the nonlinear Kalman Filter method, an extended Kalman filter suitable for a low-cost magnetic, angular rate, and gravity (MARG) sensor system is proposed. The method proposed in this paper is a combination of a two-stage gradient descent algorithm and the extended Kalman filter (GDEKF). First, the accelerometer and magnetometer are used to correct the attitude angle according to the two-stage gradient descent algorithm. The obtained attitude quaternion is combined with the gyroscope measurement value as the observation vector of EKF and the calculated attitude of the gyroscope and the bias of the gyroscope are corrected. The elimination of the bias of the gyroscope can further improve the stability of the attitude observation results. Finally, the MARG sensor system was designed for mathematical model simulation and hardware-in-the-loop simulation to verify the performance of the filter. The results show that compared with the gradient descent method, it has better anti-interference performance and dynamic performance, and better measurement accuracy than the extended Kalman filter.

A Distributed Formation Joint Network Navigation and Positioning Algorithm

In view of the problem that the leader-follower joint navigation scheme relies too much on the absolute navigation and positioning accuracy of the leader node, under the conditions of distributed network-centric warfare (NCW) and to meet the location service accuracy, reliability, and synergy efficiency of the future integrated communication, navigation (ICN), we built a joint navigation and positioning system with low Earth orbit (LEO), airborne data link, and inertial navigation system (INS) as the core; designed a ranging and time-synchronization scheme of the joint navigation and positioning system; and established a joint navigation and positioning method for formation and networking based on mutual ranging and velocity measurement information between aircrafts. Finally, based on the designed LEO constellation, the universality, effectiveness, superiority, and potential superiority of algorithm are verified, respectively. The simulation results show that the scheme can meet the requirements of joint location services in challenging environments, and could be used as a reference scheme for future ICN integration.