Real-time optical SLAM-based mosaicking for unmanned underwater vehicles

A Visual Servoing Scheme for Autonomous Aquaculture Net Pens Inspection Using ROV

Aquaculture net pens inspection and monitoring are important to ensure net stability and fish health in the fish farms. Remotely operated vehicles (ROVs) offer a low-cost and sophisticated solution for the regular inspection of the underwater fish net pens due to their ability of visual sensing and autonomy in a challenging and dynamic aquaculture environment. In this paper, we report the integration of an ROV with a visual servoing scheme for regular inspection and tracking of the net pens. We propose a vision-based positioning scheme that consists of an object detector, a pose generator, and a closed-loop controller. The system employs a modular approach that first utilizes two easily identifiable parallel ropes attached to the net for image processing through traditional computer vision methods. Second, the reference positions of the ROV relative to the net plane are extracted on the basis of a vision triangulation method. Third, a closed-loop control law is employed to instruct the vehicle to traverse from top to bottom along the net plane to inspect its status. The proposed vision-based scheme has been implemented and tested both through simulations and field experiments. The extensive experimental results have allowed the assessment of the performance of the scheme that resulted satisfactorily and can supplement the traditional aquaculture net pens inspection and tracking systems.

Development of Modular Bio-Inspired Autonomous Underwater Vehicle for Close Subsea Asset Inspection

To reduce human risk and maintenance costs, Autonomous Underwater Vehicles (AUVs) are involved in subsea inspections and measurements for a wide range of marine industries such as offshore wind farms and other underwater infrastructure. Most of these inspections may require levels of manoeuvrability similar to what can be achieved by tethered vehicles, called Remotely Operated Vehicles (ROVs). To extend AUV intervention time and perform closer inspection in constrained spaces, AUVs need to be more efficient and flexible by being able to undulate around physical constraints. A biomimetic fish-like AUV known as RoboFish has been designed to mimic propulsion techniques observed in nature to provide high thrust efficiency and agility to navigate its way autonomously around complex underwater structures. Building upon advances in acoustic communications, computer vision, electronics and autonomy technologies, RoboFish aims to provide a solution to such critical inspections. This paper introduces the first RoboFish prototype that comprises cost-effective 3D printed modules joined together with innovative magnetic coupling joints and a modular software framework. Initial testing shows that the preliminary working prototype is functional in terms of water-tightness, propulsion, body control and communication using acoustics, with visual localisation and mapping capability.

A Novel Underwater Simultaneous Localization and Mapping Online Algorithm Based on Neural Network

The navigation and localization of autonomous underwater vehicles (AUVs) in seawater are of the utmost importance for scientific research, petroleum engineering, search and rescue, and military missions concerning the special environment of seawater. However, there is still no general method for AUVs navigation and localization, especially in the featureless seabed. The reported approaches to solving AUVs navigation and localization problems employ an expensive inertial navigation system (INS), with cumulative errors and dead reckoning, and a high-cost long baseline (LBL) in a featureless subsea. In this study, a simultaneous localization and mapping (AMB-SLAM) online algorithm, based on acoustic and magnetic beacons, was proposed. The AMB-SLAM online algorithm is based on multiple randomly distributed beacons of low-frequency magnetic fields and a single fixed acoustic beacon for location and mapping. The experimental results show that the performance of the AMB-SLAM online algorithm has a high robustness. The proposed approach (the AMB-SLAM online algorithm) provides a low-complexity, low-cost, and high-precision online solution to the AUVs navigation and localization problem in featureless seawater environments. The AMB-SLAM online solution could enable AUVs to autonomously explore or autonomously intervene in featureless seawater environments, which would enable AUVs to accomplish fully autonomous survey missions.

A novel localization approach for underwater welding vehicles in spent fuel pools via attitude heading reference system and altimeters

In this article, a novel localization approach incorporating attitude and heading reference system and underwater altimeters is presented to accurately localize the underwater welding vehicles in spent fuel pools of the nuclear power stations. Different from the conventional underwater localization technologies, the presented localization approach is a more suitable approach in cases of confined structured water areas. Firstly, a multi-regions division localization algorithm is proposed for calculating the coordinate of the underwater welding vehicle through data from sensors. Also, considering the attitude errors of the underwater welding vehicle, the beam angle of the altimeters, and the boundary effects of cross-regions, an optimized multi-regions division localization algorithm is introduced for general applicability of the multi-regions division localization. Then, computer simulations are employed to evaluate the validity and the performance of multi-regions division localization and optimized multi-regions division localization. Finally, the efficiency of the proposed approach is confirmed via system experiments. The experimental results are consistent with simulation results which further indicate that the presented approach holds great potential in effective underwater vehicles localization for confined structured water scenarios.

Toward Digitalization of Maritime Transport?

Although maritime transport is the backbone of world commerce, its digitalization lags significantly behind when we consider some basic facts. This work verifies the state-of-the-art as it currently applies to eight digital domains: Autonomous vehicles and robotics; artificial intelligence; big data; virtual reality, augmented and mixed reality; internet of things; the cloud and edge computing; digital security; and 3D printing and additive engineering. It also provides insight into each of the three sectors into which this industry has been divided: Ship design and shipbuilding; shipping; and ports. The work, based on a systematic literature review, demonstrates that there are domains on which almost no formal study has been done thus far and concludes that there are major areas that require attention in terms of research. It also illustrates the increasing interest on the subject, arising from the necessity of raising the maritime transport industry to the same level of digitalization as other industries.

Trajectory-based visual localization in underwater surveying missions

We present a new vision-based localization system applied to an autonomous underwater vehicle (AUV) with limited sensing and computation capabilities. The traditional EKF-SLAM approaches are usually expensive in terms of execution time; the approach presented in this paper strengthens this method by adopting a trajectory-based schema that reduces the computational requirements. The pose of the vehicle is estimated using an extended Kalman filter (EKF), which predicts the vehicle motion by means of a visual odometer and corrects these predictions using the data associations (loop closures) between the current frame and the previous ones. One of the most important steps in this procedure is the image registration method, as it reinforces the data association and, thus, makes it possible to close loops reliably. Since the use of standard EKFs entail linearization errors that can distort the vehicle pose estimations, the approach has also been tested using an iterated Kalman filter (IEKF). Experiments have been conducted using a real underwater vehicle in controlled scenarios and in shallow sea waters, showing an excellent performance with very small errors, both in the vehicle pose and in the overall trajectory estimates.

Graph theory approach for match reduction in image mosaicing

One of the crucial steps in image mosaicing is global alignment, which requires finding the best image registration parameters by employing nonlinear minimization methods over correspondences between overlapping image pairs for a dataset. Based on graph theory, we propose a simple but efficient method to reduce the number of overlapping image pairs without any noticeable effect on the final mosaic quality. This reduction significantly lowers the computational cost of the image mosaicing process. The proposed method can be applied in a topology estimation process to reduce the number of image matching attempts. The method has been validated through experiments on challenging underwater image sequences obtained during sea trials with different unmanned underwater vehicles.