I-AUV Docking and Panel Intervention at Sea

A Novel Simulation Platform for Underwater Data Muling Communications Using Autonomous Underwater Vehicles

Autonomous Underwater Vehicles (AUVs) are seen as a safe and cost-effective platforms for performing a myriad of underwater missions. These vehicles are equipped with multiple sensors which, combined with their long endurance, can produce large amounts of data, especially when used for video capturing. These data need to be transferred to the surface to be processed and analyzed. When considering deep sea operations, where surfacing before the end of the mission may be unpractical, the communication is limited to low bitrate acoustic communications, which make unfeasible the timely transmission of large amounts of data unfeasible. The usage of AUVs as data mules is an alternative communications solution. Data mules can be used to establish a broadband data link by combining short-range, high bitrate communications (e.g., RF and wireless optical) with a Delay Tolerant Network approach. This paper presents an enhanced version of UDMSim, a novel simulation platform for data muling communications. UDMSim is built upon a new realistic AUV Motion and Localization (AML) simulator and Network Simulator 3 (ns-3). It can simulate the position of the data mules, including localization errors, realistic position control adjustments, the received signal, the realistic throughput adjustments, and connection losses due to the fast SNR change observed underwater. The enhanced version includes a more realistic AML simulator and the antenna radiation patterns to help evaluating the design and relative placement of underwater antennas. The results obtained using UDMSim show a good match with the experimental results achieved using an underwater testbed. UDMSim is made available to the community to support easy and faster evaluation of underwater data muling oriented communications solutions and to enable offline replication of real world experiments.

MViDO: A High Performance Monocular Vision-Based System for Docking A Hovering AUV

This paper presents a high performance (low computationally demanding) monocular vision-based system for a hovering Autonomous Underwater Vehicle (AUV) in the context of autonomous docking process-MViDO system: Monocular Vision-based Docking Operation aid. The MViDO consists of three sub-modules: a pose estimator, a tracker and a guidance sub-module. The system is based on a single camera and a three spherical color markers target that signal the docking station. The MViDO system allows the pose estimation of the three color markers even in situations of temporary occlusions, being also a system that rejects outliers and false detections. This paper also describes the design and implementation of the MViDO guidance module for the docking manoeuvres. We address the problem of driving the AUV to a docking station with the help of the visual markers detected by the on-board camera, and show that by adequately choosing the references for the linear degrees of freedom of the AUV, the AUV is conducted to the dock while keeping those markers in the field of view of the on-board camera. The main concepts behind the MViDO are provided and a complete characterization of the developed system is presented from the formal and experimental point of view. To test and evaluate the MViDO detector and pose an estimator module, we created a ground truth setup. To test and evaluate the tracker module we used the MARES AUV and the designed target in a four-meter tank. The performance of the proposed guidance law was tested on simulink/Matlab.

Autonomous Underwater Vehicles: Localization, Navigation, and Communication for Collaborative Missions

Development of Autonomous Underwater Vehicles (AUVs) has permitted the automatization of many tasks originally achieved with manned vehicles in underwater environments. Teams of AUVs designed to work within a common mission are opening the possibilities for new and more complex applications. In underwater environments, communication, localization, and navigation of AUVs are considered challenges due to the impossibility of relying on radio communications and global positioning systems. For a long time, acoustic systems have been the main approach for solving these challenges. However, they present their own shortcomings, which are more relevant for AUV teams. As a result, researchers have explored different alternatives. To summarize and analyze these alternatives, a review of the literature is presented in this paper. Finally, a summary of collaborative AUV teams and missions is also included, with the aim of analyzing their applicability, advantages, and limitations.

Docking Control of an Autonomous Underwater Vehicle Using Reinforcement Learning

To achieve persistent systems in the future, autonomous underwater vehicles (AUVs) willneed to autonomously dock onto a charging station. Here, reinforcement learning strategies wereapplied for the first time to control the docking of an AUV onto a fixed platform in a simulationenvironment. Two reinforcement learning schemes were investigated: one with continuous stateand action spaces, deep deterministic policy gradient (DDPG), and one with continuous state butdiscrete action spaces, deep Q network (DQN). For DQN, the discrete actions were selected as stepchanges in the control input signals. The performance of the reinforcement learning strategies wascompared with classical and optimal control techniques. The control actions selected by DDPG sufferfrom chattering effects due to a hyperbolic tangent layer in the actor. Conversely, DQN presents thebest compromise between short docking time and low control effort, whilst meeting the dockingrequirements. Whereas the reinforcement learning algorithms present a very high computational costat training time, they are five orders of magnitude faster than optimal control at deployment time,thus enabling an on-line implementation. Therefore, reinforcement learning achieves a performancesimilar to optimal control at a much lower computational cost at deployment, whilst also presentinga more general framework.

Underwater navigation using visual markers in the context of intervention missions

Intervention missions, that is, underwater manipulation tasks, for example, in the context of oil-&-gas production, require a high amount of precise, robust navigation. In this article, we describe the use of an advanced vision system suited for deep-sea operations, which in combination with artificial markers on target structures like oil-&-gas production-Christmas-trees significantly boosts navigation performance. The system is validated in two intensive field tests running off the shore of Marseille, France. In the experiments, a commercial remotely operated vehicle equipped with the system and a mock-up structure with an oil-&-gas production panel is used to evaluate the navigation performance.