Autonomous Underwater Vehicles: Localization, Navigation, and Communication for Collaborative Missions

Learning a global underwater geolocalization model with sectoral transformer

Polarization-based underwater geolocalization presents an innovative method for positioning unmanned autonomous devices beneath the water surface, in environments where GPS signals are ineffective. While the state-of-the-art deep neural network (DNN) method achieves high-precision geolocalization based on sun polarization patterns in same-site tasks, its learning-based nature limits its generalizability to unseen sites and subsequently impairs its performance on cross-site tasks, where an unavoidable domain gap between training and test data exists. In this paper, we present an advanced Deep Neural Network (DNN) methodology, which includes a neural network built on a Transformer architecture, similar to the core of large language models such as ChatGPT, and integrates an unscented Kalman filter (UKF) for estimating underwater geolocation using polarization-based images. This combination effectively simulates the sun's daily trajectory, yielding enhanced performance across different locations and quicker inference speeds compared to current benchmarks. Following thorough analysis of over 10 million polarization images from four global locations, we conclude that our proposed technique significantly boosts cross-site geolocalization accuracy by around 28% when contrasted with traditional DNN methods.

Sensor Placement in an Irregular 3D Surface for Improving Localization Accuracy Using a Multi-Objective Memetic Algorithm

Accurate localization is a critical task in underwater navigation. Typical localization methods use a set of acoustic sensors and beacons to estimate relative position, whose geometric configuration has a significant impact on the localization accuracy. Although there is much effort in the literature to define optimal 2D or 3D sensor placement, the optimal sensor placement in irregular and constrained 3D surfaces, such as autonomous underwater vehicles (AUVs) or other structures, is not exploited for improving localization. Additionally, most applications using AUVs employ commercial acoustic modems or compact arrays, therefore the optimization of the placement of spatially independent sensors is not a considered issue. This article tackles acoustic sensor placement optimization in irregular and constrained 3D surfaces, for inverted ultra-short baseline (USBL) approaches, to improve localization accuracy. The implemented multi-objective memetic algorithm combines an evaluation of the geometric sensor's configuration, using the Cramer-Rao Lower Bound (CRLB), with the incidence angle of the received signal. A case study is presented over a simulated homing and docking scenario to demonstrate the proposed optimization algorithm.

Simultaneous Localization and Guidance of Two Underwater Hexapod Robots under Underwater Currents

This paper addresses the simultaneous localization and guidance of two underwater hexapod robots under sea currents. This paper considers an underwater environment where there are no landmarks or features which can assist a robot's localization. This article uses two underwater hexapod robots that move together while using each other as landmarks in the environment. While one robot moves, another robot extends its legs into the seabed and acts as a static landmark. A moving robot measures the relative position of another static robot, in order to estimate its position while it moves. Due to underwater currents, a robot cannot maintain its desired course. Moreover, there may be obstacles, such as underwater nets, that a robot needs to avoid. We thus develop a guidance strategy for avoiding obstacles, while estimating the perturbation due to the sea currents. As far as we know, this paper is novel in tackling simultaneous localization and guidance of underwater hexapod robots in environments with various obstacles. MATLAB simulations demonstrate that the proposed methods are effective in harsh environments where the sea current magnitude can change irregularly.

Experimental Investigation of Relative Localization Estimation in a Coordinated Formation Control of Low-Cost Underwater Drones

This study presents a relative localization estimation method for a group of low-cost underwater drones (l-UD), which only uses visual feedback provided by an on-board camera and IMU data. It aims to design a distributed controller for a group of robots to reach a specific shape. This controller is based on a leader-follower architecture. The main contribution is to determine the relative position between the l-UD without using digital communication and sonar positioning methods. In addition, the proposed implementation of the EKF to fuse the vision data and the IMU data improves the prediction capability in cases where the robot is out of view of the camera. This approach allows the study and testing of distributed control algorithms for low-cost underwater drones. Finally, three robot operating system (ROS) platform-based BlueROVs are used in an experiment in a near-realistic environment. The experimental validation of the approach has been obtained by investigating different scenarios.

Finite-Time Controller for Coordinated Navigation of Unmanned Underwater Vehicles in a Collaborative Manipulation Task

Unmanned underwater vehicles perform inspection and maintenance tasks in complex and changing environments. Some of these tasks require synchronous navigation of multiple vehicles, which is challenging. This paper proposes a synchronous navigation scheme for two BlueROV2 underwater vehicles for a coordinated multi-vehicle task. In the proposed scheme, the vehicles perform the collaborative task of grasping, transporting, and releasing an object. In this scheme, no vehicle-to-vehicle communication is required. A model-free second-order sliding mode controller with finite-time convergence is used to accomplish this task. The controller's convergence time is user-defined and does not depend on the physical or hydrodynamic parameters of the vehicle, unlike the other finite-time controllers found in the literature. Simulation experiments were conducted to verify the controller's performance, including high ocean currents as external disturbances. Comparisons were made with two state-of-the-art controllers with finite-time convergence. The results showed that the proposed controller achieved the best results, as the user-defined convergence time was achieved for both vehicles and the collaborative task was completed, no ripples, deviations, or oscillations were observed, and no chattering occurred. The results proved the robustness of the controller in the presence of high ocean currents without the need to readjust the parameters.

2D SLAM Algorithms Characterization, Calibration, and Comparison Considering Pose Error, Map Accuracy as Well as CPU and Memory Usage

The present work proposes a method to characterize, calibrate, and compare, any 2D SLAM algorithm, providing strong statistical evidence, based on descriptive and inferential statistics to bring confidence levels about overall behavior of the algorithms and their comparisons. This work focuses on characterize, calibrate, and compare Cartographer, Gmapping, HECTOR-SLAM, KARTO-SLAM, and RTAB-Map SLAM algorithms. There were four metrics in place: pose error, map accuracy, CPU usage, and memory usage; from these four metrics, to characterize them, Plackett-Burman and factorial experiments were performed, and enhancement after characterization and calibration was granted using hypothesis tests, in addition to the central limit theorem.

Multi-AUV Cooperative Navigation Algorithm Based on Temporal Difference Method

To reduce the cooperative positioning error and improve the navigation accuracy, a single master–slave AUV cooperative navigation method is proposed in this paper, which mainly focuses on planning the optimal path of the master AUV by the time difference (TD) method, under the premise that the path of the slave AUV has been planned. First, the model of multi-AUV cooperative navigation is established, and the observable problem of the system is analyzed. Second, for the single master–slave AUV cooperative navigation system, a Markov decision process (MDP)-based multi-AUV cooperative navigation model is established, and the master AUV path planning method is designed based on the TD method. Finally, the extended Kalman filter (EKF) and unscented Kalman filter (UKF) nonlinear filtering algorithms are applied to simulate and verify the algorithm that is proposed in this paper. The results show that the theoretical positioning error of the slave AUV can be controlled to about 3.2m by planning the path of the master AUV using the TD method. This method can not only reduce the observation error and positioning error of the slave AUV during the whole cooperative navigation process, but also keep the relative measurement distance between the master AUV and the slave AUV within an appropriate range.

Analysis of Thermal Characteristics of MEMS Sensors for Measuring the Rolling Period of Maritime Autonomous Surface Ships

Recently, with the emergence of maritime autonomous surface ships (MASS), ensuring seaworthiness has increased with the operation of MASS. Ship stability is important for safety, and technical methods for controlling a ship’s motion are required to evaluate the stability. A ship’s rolling period is estimated using microelectromechanical systems (MEMS) sensors to measure the ship’s metacentric height. However, weather changes (e.g., temperature) are drastic due to various marine environments in the sea. Hence, it is necessary to analyze MEMS sensors’ thermal characteristics for applying them to MASS. This study aims to analyze the thermal characteristics of a siX-axis MEMS sensor for its application in MASS. The experiments analyzed measurement errors and noise at six steps in the range of 25 °C–75 °C in which the MEMS sensor can be operated. The experimental results showed that the gyroscope’s thermal error and MEMS sensor’s noise level were much larger than those of the accelerometer and the respective thermal error values along the Z-axis of the accelerometer and gyroscope were the most stable compared to those along the other axes. The findings can be applied to a measurement method of the stability of MASS employing MEMS sensors in navigation equipment.

Model-Free High-Order Sliding Mode Controller for Station-Keeping of an Autonomous Underwater Vehicle in Manipulation Task: Simulations and Experimental Validation

The use of autonomous underwater vehicles (AUVs) has expanded in recent years to include inspection, maintenance, and repair missions. For these tasks, the vehicle must maintain its position while inspections or manipulations are performed. Some station-keeping controllers for AUVs can be found in the literature that exhibits robust performance against external disturbances. However, they are either model-based or require an observer to deal with the disturbances. Moreover, most of them have been evaluated only by numerical simulations. In this paper, the feasibility of a model-free high-order sliding mode controller for the station-keeping problem is validated. The proposed controller was evaluated through numerical simulations and experiments in a semi-Olympic swimming pool, introducing external disturbances that remained unknown to the controller. Results have shown robust performance in terms of the root mean square error (RMSE) of the vehicle position. The simulation resulted in the outstanding station-keeping of the BlueROV2 vehicle, as the tracking errors were kept to zero throughout the simulation, even in the presence of strong ocean currents. The experimental results demonstrated the robustness of the controller, which was able to maintain the RMSE in the range of 1-4 cm for the depth of the vehicle, outperforming related work, even when the disturbance was large enough to produce thruster saturation.

Collaborative Unmanned Vehicles for Inspection, Maintenance, and Repairs of Offshore Wind Turbines

Operations and maintenance of Offshore Wind Turbines (OWTs) are challenging, with manual operators constantly exposed to hazardous environments. Due to the high task complexity associated with the OWT, the transition to unmanned solutions remains stagnant. Efforts toward unmanned operations have been observed using Unmanned Aerial Vehicles (UAVs) and Unmanned Underwater Vehicles (UUVs) but are limited mostly to visual inspections only. Collaboration strategies between unmanned vehicles have introduced several opportunities that would enable unmanned operations for the OWT maintenance and repair activities. There have been many papers and reviews on collaborative UVs. However, most of the past papers reviewed collaborative UVs for surveillance purposes, search and rescue missions, and agricultural activities. This review aims to present the current capabilities of Unmanned Vehicles (UVs) used in OWT for Inspection, Maintenance, and Repair (IMR) operations. Strategies to implement collaborative UVs for complex tasks and their associated challenges are discussed together with the strategies to solve localization and navigation issues, prolong operation time, and establish effective communication within the OWT IMR operations. This paper also briefly discusses the potential failure modes for collaborative approaches and possible redundancy strategies to manage them. The collaborative strategies discussed herein will be of use to researchers and technology providers in identifying significant gaps that have hindered the implementation of full unmanned systems which have significant impacts towards the net zero strategy.

Monocular vision aided optical tracking for underwater optical wireless communications

Underwater optical wireless communication (UOWC) has received increasing attention due to its distinctive characteristics such as high bandwidth and low latency. However, the UOWC link is usually vulnerable to water flow, underwater turbulence and the terminals' own vibration. Thus, to maintain a stable transmission link, an accurate tracking method is essential for UOWC systems. In this paper, a monocular vision aided optical tracking method is proposed, where the deviation degree of the laser spot is employed to realize autonomous real-time alignment of the receiver with the transmitter. Experimental results verify that with the proposed tracking method, the bit error ratio can be ensured to be below the forward error correction (FEC) limit of 3.8×10^-3 even under strong disturbance for the practical UOWC system.

Probabilistic Framework Allocation on Underwater Vehicular Systems Using Hydrophone Sensor Networks

This article emphasis the importance of constructing an underwater vehicle monitoring system to solve various issues that are related to deep sea explorations. For solving the issues, conventional methods are not implemented, whereas a new underwater vehicle is introduced which acts as a sensing device and monitors the ambient noise in the system. However, the fundamentals of creating underwater vehicles have been considered from conventional systems and the new formulations are generated. This innovative sensing device will function based on the energy produced by the solar cells which will operate for a short period of time under the water where low parametric units are installed. In addition, the energy consumed for operating a particular unit is much lesser and this results in achieving high reliability using a probabilistic path finding algorithm. Further, two different application segments have been solved using the proposed formulations including the depth of monitoring the ocean. To validate the efficiency of the proposed method, comparisons have been made with existing methods in terms of navigation output units, rate of decomposition for solar cells, reliability rate, and directivity where the proposed method proves to be more efficient for an average percentile of 64%.

Numerical Simulation of Time-Optimal Path Planning for Autonomous Underwater Vehicles Using a Markov Decision Process Method

Many path planning algorithms developed for land or air based autonomous vehicles no longer apply under the water. A time-optimal path planning method for autonomous underwater vehicles (AUVs), based on a Markov decision process (MDP) algorithm, is proposed for the marine environment. Its performance is examined for different oceanic conditions, including complex coastal bathymetry and time-varying ocean currents, revealing advantages compared to the A* algorithm, a traditional path planning method. The ocean current is predicted using a regional ocean model and then provided to the MDP algorithm as a priori. A computation-efficient and feature-resolved spatial resolution are determined through a series of sensitivity experiments. The simulations demonstrate the importance to incorporate ocean currents in the path planning of AUVs in the real ocean. The MDP algorithm remains robust even if the ocean current is complex.

Optimal Navigation of an Unmanned Surface Vehicle and an Autonomous Underwater Vehicle Collaborating for Reliable Acoustic Communication with Collision Avoidance

This paper focuses on safe navigation of an unmanned surface vehicle in proximity to a submerged autonomous underwater vehicle so as to maximise short-range, through-water data transmission while minimising the probability that the two vehicles will accidentally collide. A sliding mode navigation law is developed, and a rigorous proof of optimality of the proposed navigation law is presented. The developed navigation algorithm is relatively computationally simple and easily implementable in real time. Illustrative examples with extensive computer simulations demonstrate the effectiveness of the proposed method.

Experimental Validation of a Model-Free High-Order Sliding Mode Controller with Finite-Time Convergence for Trajectory Tracking of Autonomous Underwater Vehicles

Several control strategies have been proposed for the trajectory tracking problem of Autonomous Underwater Vehicles (AUV). Most of them are model-based, hence, detailed knowledge of the parameters of the robot is needed. Few works consider a finite-time convergence in their controllers, which offers strong robustness and fast convergence compared with asymptotic or exponential solutions. Those finite-time controllers do not permit the users to predefine the convergence time, which can be useful for a more efficient use of the robot’s energy. This paper presents the experimental validation of a model-free high-order Sliding Mode Controller (SMC) with finite-time convergence in a predefined time. The convergence time is introduced by the simple change of a time-base parameter. The aim is to validate the controller so it can be implemented for cooperative missions where the communication is limited or null. Results showed that the proposed controller can drive the robot to the desired depth and heading trajectories in the predefined time for all the cases, reducing the error by up to 75% and 41% when compared with a PID and the same SMC with asymptotic convergence. The energy consumption was reduced 35% and 50% when compared with those same controllers.

A Review of Unmanned System Technologies with Its Application to Aquaculture Farm Monitoring and Management

This paper aims to provide an overview of the capabilities of unmanned systems to monitor and manage aquaculture farms that support precision aquaculture using the Internet of Things. The locations of aquaculture farms are diverse, which is a big challenge on accessibility. For offshore fish cages, there is a difficulty and risk in the continuous monitoring considering the presence of waves, water currents, and other underwater environmental factors. Aquaculture farm management and surveillance operations require collecting data on water quality, water pollutants, water temperature, fish behavior, and current/wave velocity, which requires tremendous labor cost, and effort. Unmanned vehicle technologies provide greater efficiency and accuracy to execute these functions. They are even capable of cage detection and illegal fishing surveillance when equipped with sensors and other technologies. Additionally, to provide a more large-scale scope, this document explores the capacity of unmanned vehicles as a communication gateway to facilitate offshore cages equipped with robust, low-cost sensors capable of underwater and in-air wireless connectivity. The capabilities of existing commercial systems, the Internet of Things, and artificial intelligence combined with drones are also presented to provide a precise aquaculture framework.

Optimization of Acoustic Communication Links for a Swarm of AUVs: The COMET and NEMOSENS Examples

Underwater acoustic communication is a key point for performance improvement in an autonomous underwater vehicle (AUV) swarm. The communication process is essential for improving the AUVs localization accuracy for navigation and is a convenient way for sharing information among the AUVs in a network. The objective of this work, which was developed in the COMET and NEMOSENS projects, is to address the communication process required in a mobile underwater wireless network, with a focus on the proposal of an adaptive physical layer methodology. We discuss about the employed channel access method, the frame structure, and we propose the usage of an adaptive guard interval in order to ameliorate the network usage rate. We explain the physical layer aspect of the communication: the data processing at the transmitter and receiver side. In addition to that, we propose the usage of smart communications among AUVs. We design a method for adapting some physical layer parameters. The proposed approach relies only on the knowledge of the transmission geometry, and it optimizes the number of subcarriers and the cyclic-prefix length of the Orthogonal Frequency-Division Multiplexing (OFDM) system. The obtained results show a performance improvement in terms of bit-error rate when compared with the case of random parameters selection. These results corroborate the benefits of our adaptive parameters approach.

Sensors and Measurements for Unmanned Systems: An Overview

The advance of technology has enabled the development of unmanned systems/vehicles used in the air, on the ground or on/in the water. The application range for these systems is continuously increasing, and unmanned platforms continue to be the subject of numerous studies and research contributions. This paper deals with the role of sensors and measurements in ensuring that unmanned systems work properly, meet the requirements of the target application, provide and increase their navigation capabilities, and suitably monitor and gain information on several physical quantities in the environment around them. Unmanned system types and the critical environmental factors affecting their performance are discussed. The measurements that these kinds of vehicles can carry out are presented and discussed, while also describing the most frequently used on-board sensor technologies, as well as their advantages and limitations. The paper provides some examples of sensor specifications related to some current applications, as well as describing the recent research contributions in the field.

Model-Free High Order Sliding Mode Control with Finite-Time Tracking for Unmanned Underwater Vehicles

Several strategies to deal with the trajectory tracking problem of Unmanned Underwater Vehicles are encountered, from traditional controllers such as Proportional Integral Derivative (PID) or Lyapunov-based, to backstepping, sliding mode, and neural network approaches. However, most of them are model-based controllers where it is imperative to have an accurate knowledge of the vehicle hydrodynamic parameters. Despite some sliding mode and neural network-based controllers are reported as model-free, just a few of them consider a solution with finite-time convergence, which brings strong robustness and fast convergence compared with asymptotic or exponential solutions and it can also help to reduce the power consumption of the vehicle thrusters. This work aims to implement a model-free high-order sliding-mode controller and synthesize it with a time-base generator to achieve finite-time convergence. The time-base was included by parametrizing the control gain at the sliding surface. Numerical simulations validated the finite-time convergence of the controller for different time-bases even in the presence of high ocean currents. The performance of the obtained solution was also evaluated by the Root Mean Square (RMS) value of the control coefficients computed for the thrusters, as a parameter to measure the power consumption of the vehicle when following a trajectory. Computational results showed a reduction of up to 50% in the power consumption from the thrusters when compared with other solutions.

Multi-Sensor Fusion for Underwater Vehicle Localization by Augmentation of RBF Neural Network and Error-State Kalman Filter

The Kalman filter variants extended Kalman filter (EKF) and error-state Kalman filter (ESKF) are widely used in underwater multi-sensor fusion applications for localization and navigation. Since these filters are designed by employing first-order Taylor series approximation in the error covariance matrix, they result in a decrease in estimation accuracy under high nonlinearity. In order to address this problem, we proposed a novel multi-sensor fusion algorithm for underwater vehicle localization that improves state estimation by augmentation of the radial basis function (RBF) neural network with ESKF. In the proposed algorithm, the RBF neural network is utilized to compensate the lack of ESKF performance by improving the innovation error term. The weights and centers of the RBF neural network are designed by minimizing the estimation mean square error (MSE) using the steepest descent optimization approach. To test the performance, the proposed RBF-augmented ESKF multi-sensor fusion was compared with the conventional ESKF under three different realistic scenarios using Monte Carlo simulations. We found that our proposed method provides better navigation and localization results despite high nonlinearity, modeling uncertainty, and external disturbances.

Autonomous Underwater Vehicle Localization Using Sound Measurements of Passing Ships

This paper introduces the localization method of an Autonomous Underwater Vehicle (AUV) in environments (such as harbors or ports) where there can be passing ships near the AUV. It is assumed that the AUV can access the trajectory and approximate source level of a passing ship, while identifying the ship by processing the ship’s sound. This paper considers an AUV which can localize itself by integrating propeller and Inertial Measurement Units (IMU). Suppose that the AUV has been moving in underwater environments for a long time, under the IMU-only localization. To fix long-term drift in the IMU-only localization, we propose that the AUV localization uses sound measurements of passing ships whose trajectories are known a priori. As far as we know, this AUV localization method is novel in using sound measurements of passing ships of which the trajectories are known a priori. The performance of the proposed localization method is verified utilizing MATLAB simulations. The simulation results show significant estimation improvements, compared to IMU-only localization. Moreover, using measurements from multiple ships gives better estimation results, compared to the case where the measurement of a single ship is used.

A MBSE Application to Controllers of Autonomous Underwater Vehicles Based on Model-Driven Architecture Concepts

In this paper, a hybrid realization model is proposed for the controllers of autonomous underwater vehicles (AUVs). This model is based on the model-based systems engineering (MBSE) methodology, in combination with the model-driven architecture (MDA), the real-time unified modeling language (UML)/systems modeling language (SysML), the extended/unscented Kalman filter (EKF/UKF) algorithms, and hybrid automata, and it can be reused for designing controllers of various AUV types. The dynamic model and control structure of AUVs were combined with the specialization of MDA concepts as follows. The computation-independent model (CIM) was specified by the use-case model combined with the EKF/UKF algorithms and hybrid automata to intensively gather the control requirements. Then, the platform-independent model (PIM) was specialized using the real-time UML/SysML to design the capsule collaboration of control and its connections. The detailed PIM was subsequently converted into the platform-specific model (PSM) using open-source platforms to promptly realize the AUV controller. On the basis of the proposed hybrid model, a planar trajectory-tracking controller, which allows a miniature torpedo-shaped AUV to autonomously track the desired planar trajectory, was implemented and evaluated, and shown to have good feasibility.

Localisation of Unmanned Underwater Vehicles (UUVs) in Complex and Confined Environments: A Review

The inspection of aquatic environments is a challenging activity, which is made more difficult if the environment is complex or confined, such as those that are found in nuclear storage facilities and accident sites, marinas and boatyards, liquid storage tanks, or flooded tunnels and sewers. Human inspections of these environments are often dangerous or infeasible, so remote inspection using unmanned underwater vehicles (UUVs) is used. Due to access restrictions and environmental limitations, such as low illumination levels, turbidity, and a lack of salient features, traditional localisation systems that have been developed for use in large bodies of water cannot be used. This means that UUV capabilities are severely restricted to manually controlled low-quality visual inspections, generating non-geospatially located data. The localisation of UUVs in these environments would enable the autonomous behaviour and the development of accurate maps. This article presents a review of the state-of-the-art in localisation technologies for these environments and identifies areas of future research to overcome the challenges posed.

Design, Construction, and Modeling of a BAUV with Propulsion System Based on a Parallel Mechanism for the Caudal Fin

Traditional propulsion systems for autonomous underwater vehicles (AUVs) have several deficiencies, such as the invasion of the aquatic environment through the generation of noise and damage to the ecosystem, higher energy consumption, and a unidirectional thruster vector. The last characteristic constrains the maneuverability of the vehicle. This paper proposes a 3-DOF spherical 3 universal–cylindrical–universal and 1 spherical joint (3UCU-1S) parallel mechanism coupled to an artificial caudal fin to produce a vectored thruster for a biomimetic AUV (BAUV). First, the design and construction of the prototype are described. Then, the kinematics and dynamics analysis of the parallel mechanism is presented. Finally, a motion study shows the types of movements that can be achieved with the mechanism to perform flapping of the caudal fin in different directions.