1
|
Song D, Gan W, Yao P. Search and tracking strategy of autonomous surface underwater vehicle in oceanic eddies based on deep reinforcement learning. Appl Soft Comput 2022. [DOI: 10.1016/j.asoc.2022.109902] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/05/2022]
|
2
|
Zang W, Yao P, Song D. Underwater gliders linear trajectory tracking: The experience breeding actor-critic approach. ISA TRANSACTIONS 2022; 129:415-423. [PMID: 35039155 DOI: 10.1016/j.isatra.2021.12.029] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/24/2021] [Revised: 12/20/2021] [Accepted: 12/20/2021] [Indexed: 06/14/2023]
Abstract
This paper studies the underwater glider trajectory tracking in currents field. The objective is to ensure that trajectories fit to the straight target track. The underwater glider model is introduced to demonstrate the vehicle dynamic properties. Considering currents disturbance as well as the uncertain status of the glider controlled by complicated roll policies, the trajectory tracking task can be classified into the model-free optimization. Such problem is difficult to solve with mathematical analysis. This work transfers the underwater glider trajectory tracking into a Markov Decision Process by specifying the actions and observations as well as rewards. On this basis, a neural network controls framework called experience breeding actor-critic is proposed to handle the trajectory tracking. The EBAC enhances the explorations to the potentially high reward area. And it steers glider heading meticulously so as to counteract the currents influence. Through simulation results, the EBAC shows a desired performance in controlling the gliders to accurately fit the target track.
Collapse
Affiliation(s)
- Wenchuan Zang
- College of Information Science and Engineering, Ocean University of China, No. 238 Songling Rd, Qingdao, 266100, Shandong, China
| | - Peng Yao
- College of Engineering, Ocean University of China, No. 238 Songling Rd, Qingdao, 266100, Shandong, China
| | - Dalei Song
- College of Engineering, Ocean University of China, No. 238 Songling Rd, Qingdao, 266100, Shandong, China; Institute for Advanced Ocean Study, Ocean University of China, No. 238 Songling Rd, Qingdao, 266100, Shandong, China.
| |
Collapse
|
3
|
Chen G, Shen Y, Zhang Y, Zhang W, Wang D, He B. 2D multi-area coverage path planning using L-SHADE in simulated ocean survey. Appl Soft Comput 2021. [DOI: 10.1016/j.asoc.2021.107754] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
4
|
Hou M, Cho S, Zhou H, Edwards CR, Zhang F. Bounded Cost Path Planning for Underwater Vehicles Assisted by a Time-Invariant Partitioned Flow Field Model. Front Robot AI 2021; 8:575267. [PMID: 34336932 PMCID: PMC8317853 DOI: 10.3389/frobt.2021.575267] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2020] [Accepted: 06/17/2021] [Indexed: 11/13/2022] Open
Abstract
A bounded cost path planning method is developed for underwater vehicles assisted by a data-driven flow modeling method. The modeled flow field is partitioned as a set of cells of piece-wise constant flow speed. A flow partition algorithm and a parameter estimation algorithm are proposed to learn the flow field structure and parameters with justified convergence. A bounded cost path planning algorithm is developed taking advantage of the partitioned flow model. An extended potential search method is proposed to determine the sequence of partitions that the optimal path crosses. The optimal path within each partition is then determined by solving a constrained optimization problem. Theoretical justification is provided for the proposed extended potential search method generating the optimal solution. The path planned has the highest probability to satisfy the bounded cost constraint. The performance of the algorithms is demonstrated with experimental and simulation results, which show that the proposed method is more computationally efficient than some of the existing methods.
Collapse
Affiliation(s)
- Mengxue Hou
- Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, United States
| | - Sungjin Cho
- Department of Guidance and Control, Agency for Defense Development, Daejeon, South Korea
| | - Haomin Zhou
- School of Mathematics, Georgia Institute of Technology, Atlanta, GA, United States
| | - Catherine R Edwards
- Skidaway Institute of Oceanography, University of Georgia, Savannah, GA, United States
| | - Fumin Zhang
- Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, United States
| |
Collapse
|
5
|
Zhong X, Duan M, Cheng P. Ranking-based hierarchical random mutation in differential evolution. PLoS One 2021; 16:e0245887. [PMID: 33539464 PMCID: PMC7861417 DOI: 10.1371/journal.pone.0245887] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2020] [Accepted: 01/08/2021] [Indexed: 12/03/2022] Open
Abstract
In order to improve the performance of differential evolution (DE), this paper proposes a ranking-based hierarchical random mutation in differential evolution (abbreviated as RHRMDE), in which two improvements are presented. First, RHRMDE introduces a hierarchical random mutation mechanism to apply the classic “DE/rand/1” and its variant on the non-inferior and inferior group determined by the fitness value. The non-inferior group employs the traditional mutation operator “DE/rand/1” with global and random characteristics, which increases the global exploration ability and population diversity. The inferior group uses the improved mutation operator “DE/rand/1” with elite and random characteristics, which enhances the local exploitation ability and convergence speed. Second, the control parameter adaptation of RHRMDE not only considers the complexity differences of various problems but also takes individual differences into account. The proposed RHRMDE is compared with five DE variants and five non-DE algorithms on 32 universal benchmark functions, and the results show that the RHRMDE is superior over the compared algorithms.
Collapse
Affiliation(s)
- Xuxu Zhong
- National Key Laboratory of Fundamental Science on Synthetic Vision, Sichuan University, Chengdu, China
| | - Meijun Duan
- School of Computer and Software Engineering, Xihua University, Chengdu, China
- * E-mail:
| | - Peng Cheng
- School of Aeronautics and Astronautics, Sichuan University, Chengdu, China
| |
Collapse
|
6
|
Ye P, Pan G. Shape optimization of a blended-wing-body underwater glider using surrogate-based global optimization method IESGO-HSR. Sci Prog 2020; 103:36850420950144. [PMID: 32907492 PMCID: PMC10451057 DOI: 10.1177/0036850420950144] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
As a novel flying-wing configuration underwater glider, the blended-wing-body underwater glider (BWBUG) has the satisfactory hydrodynamic performance in comparison to the conventional cylindrical autonomous underwater gliders (AUGs). The complicated shape optimization of BWBUG is significant for improving its hydrodynamic efficiency while it has to require huge computation time and efforts. A novel surrogate-based shape optimization (SBSO) framework is proposed to deal with the BWBUG shape optimization problem for improving the optimization efficiency and quality. During the optimization search, the parametric geometric model of the BWBUG is constructed depending on seven specific sectional airfoils, with the planar surface being unaltered. Moreover, an improved ensemble of surrogates based global optimization method using a hierarchical design space reduction strategy (IESGO-HSR) is used for optimizing the chosen sectional airfoils. The optimum shape of BWBUG can be obtained using all sectional airfoils which are successfully optimized. The maximum lift to drag ratio (LDR) of the optimal BWBUG is improved by 24.32% with acceptable computational resources. The optimization results show that the proposed SBSO framework is more superior and efficient in handling the BWBUG shape optimization problem.
Collapse
Affiliation(s)
- Pengcheng Ye
- School of Marine Science and Technology, Northwestern Polytechnical University, Xi’an, Shaanxi, China
- Key Laboratory for Unmanned Underwater Vehicle, Northwestern Polytechnical University, Xi’an, Shaanxi, China
| | - Guang Pan
- School of Marine Science and Technology, Northwestern Polytechnical University, Xi’an, Shaanxi, China
- Key Laboratory for Unmanned Underwater Vehicle, Northwestern Polytechnical University, Xi’an, Shaanxi, China
| |
Collapse
|
7
|
|
8
|
Lucas C, Hernández-Sosa D, Greiner D, Zamuda A, Caldeira R. An Approach to Multi-Objective Path Planning Optimization for Underwater Gliders. SENSORS 2019; 19:s19245506. [PMID: 31847132 PMCID: PMC6960702 DOI: 10.3390/s19245506] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/30/2019] [Revised: 12/01/2019] [Accepted: 12/12/2019] [Indexed: 11/30/2022]
Abstract
Underwater gliders are energy-efficient vehicles that rely on changes in buoyancy in order to convert up and down movement into forward displacement. These vehicles are conceived as multi-sensor platforms, and can be used to collect ocean data for long periods in wide range areas. This endurance is achieved at the cost of low speed, which requires extensive planning to ensure vehicle safety and mission success, particularly when dealing with strong ocean currents. As gliders are often involved on missions that pursue multiple objectives (track events, reach a target point, avoid obstacles, sample specified areas, save energy), path planning requires a way to deal with several constraints at the same time; this makes glider path planning a multi-objective (MO) optimization problem. In this work, we analyse the usage of the non-dominated sorting genetic algorithm II (NSGA-II) to tackle a MO glider path planning application on a complex environment integrating 3D and time varying ocean currents. Multiple experiments using a glider kinematic simulator coupled with NSGA-II, combining different control parameters were carried out, to find the best parameter configuration that provided suitable paths for the desired mission. Ultimately, the system described in this work was able to optimize multi-objective trajectories, providing non dominated solutions. Such a planning tool could be of great interest in real mission planning, to assist glider pilots in selecting the most convenient paths for the vehicle, taking into account ocean forecasts and particular characteristics of the deployment location.
Collapse
Affiliation(s)
- Carlos Lucas
- Oceanic Observatory of Madeira, Agência Regional para o Desenvolvimento da Investigação Tecnologia e Inovação, Ed. Madeira Tecnopolo, 9020-105 Funchal, Madeira, Portugal;
- Instituto Universitario de Sistemas Inteligentes y Aplicaciones Numéricas en Ingeniería (SIANI)-Universidad de Las Palmas de Gran Canaria, Campus de Tafira, 35017 Las Palmas de Gran Canaria, Spain; (D.H.-S.); (D.G.)
- Correspondence:
| | - Daniel Hernández-Sosa
- Instituto Universitario de Sistemas Inteligentes y Aplicaciones Numéricas en Ingeniería (SIANI)-Universidad de Las Palmas de Gran Canaria, Campus de Tafira, 35017 Las Palmas de Gran Canaria, Spain; (D.H.-S.); (D.G.)
| | - David Greiner
- Instituto Universitario de Sistemas Inteligentes y Aplicaciones Numéricas en Ingeniería (SIANI)-Universidad de Las Palmas de Gran Canaria, Campus de Tafira, 35017 Las Palmas de Gran Canaria, Spain; (D.H.-S.); (D.G.)
| | - Aleš Zamuda
- Faculty of Electrical Engineering and Computer Science, University of Maribor, Koroška cesta 46, 2000 Maribor, Slovenia;
| | - Rui Caldeira
- Oceanic Observatory of Madeira, Agência Regional para o Desenvolvimento da Investigação Tecnologia e Inovação, Ed. Madeira Tecnopolo, 9020-105 Funchal, Madeira, Portugal;
- Dom Luiz Institute, Faculty of Sciences, University of Lisbon, 1749-016 Lisboa, Portugal
| |
Collapse
|
9
|
Fossum TO, Eidsvik J, Ellingsen I, Alver MO, Fragoso GM, Johnsen G, Mendes R, Ludvigsen M, Rajan K. Information-driven robotic sampling in the coastal ocean. J FIELD ROBOT 2018. [DOI: 10.1002/rob.21805] [Citation(s) in RCA: 24] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Affiliation(s)
- Trygve Olav Fossum
- Department of Marine Technology; Norwegian University of Science and Technology (NTNU); Trondheim Norway
- Centre of Autonomous Marine Operations and Systems (AMOS); Trondheim Norway
| | - Jo Eidsvik
- Department of Mathematical Sciences; Norwegian University of Science and Technology (NTNU); Trondheim Norway
| | | | | | - Glaucia Moreira Fragoso
- Department of Biology; Norwegian University of Science and Technology (NTNU); Trondheim Norway
| | - Geir Johnsen
- Centre of Autonomous Marine Operations and Systems (AMOS); Trondheim Norway
- Department of Biology; Norwegian University of Science and Technology (NTNU); Trondheim Norway
- University Centre in Svalbard (UNIS); Longyearbyen Norway
| | - Renato Mendes
- Underwater Systems and Technology Laboratory; Faculty of Engineering; University of Porto (UP); Portugal
- Interdisciplinary Center for Marine and Environmental Research (CIIMAR); UP Portugal
- Physics Department; CESAM; University of Aveiro; Portugal
| | - Martin Ludvigsen
- Department of Marine Technology; Norwegian University of Science and Technology (NTNU); Trondheim Norway
- Centre of Autonomous Marine Operations and Systems (AMOS); Trondheim Norway
- University Centre in Svalbard (UNIS); Longyearbyen Norway
| | - Kanna Rajan
- Centre of Autonomous Marine Operations and Systems (AMOS); Trondheim Norway
- Underwater Systems and Technology Laboratory; Faculty of Engineering; University of Porto (UP); Portugal
- Department of Engineering Cybernetics; Norwegian University of Science and Technology (NTNU); Trondheim Norway
| |
Collapse
|
10
|
Ellefsen K, Lepikson H, Albiez J. Multiobjective coverage path planning: Enabling automated inspection of complex, real-world structures. Appl Soft Comput 2017. [DOI: 10.1016/j.asoc.2017.07.051] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
11
|
Wang Y, Zhang Y, Zhang M, Yang Z, Wu Z. Design and flight performance of hybrid underwater glider with controllable wings. INT J ADV ROBOT SYST 2017. [DOI: 10.1177/1729881417703566] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
Affiliation(s)
- Yanhui Wang
- School of Mechanical Engineering, Tianjin University, Tianjin, China
| | - Yiteng Zhang
- School of Mechanical Engineering, Tianjin University, Tianjin, China
| | - MingMing Zhang
- School of Mechanical Engineering, Tianjin University, Tianjin, China
| | - Zhijin Yang
- School of Mechanical Engineering, Tianjin University, Tianjin, China
| | - Zhiliang Wu
- School of Mechanical Engineering, Tianjin University, Tianjin, China
| |
Collapse
|
12
|
Sahoo A, Chandra S. Multi-objective Grey Wolf Optimizer for improved cervix lesion classification. Appl Soft Comput 2017. [DOI: 10.1016/j.asoc.2016.12.022] [Citation(s) in RCA: 70] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/28/2022]
|
13
|
Altinoz OT, Yilmaz AE. A Population Size Reduction Approach for Nondominated Sorting-Based Optimization Algorithms. INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE AND APPLICATIONS 2017. [DOI: 10.1142/s1469026817500055] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
The solution set of any multi-objective optimization problem can be expressed as an approximation set of Pareto front. The number of solution candidates in this set could be large enough to cover the entire Pareto front as a general belief. However, among the sufficiently close points on the objective space, almost same accurate solutions can obtain. Hence, in this set, it is possible to eliminate some of the solutions without detriment to the overall performance. Therefore, in this research, the authors propose a population size reduction method which systematically reduced the population size based on the distance and angle relations between any consecutive solutions. The results are evaluated based on two-objective benchmark problems and compared with the results of NSGA-II algorithm with respect to three different performance evaluation metrics.
Collapse
Affiliation(s)
- O. Tolga Altinoz
- Department of Electrical and Electronics Engineering, Ankara University, Golbasi Campus, Ankara, 06830, Turkey
| | - A. Egemen Yilmaz
- Department of Electrical and Electronics Engineering, Ankara University, Golbasi Campus, Ankara, 06830, Turkey
| |
Collapse
|