1
|
Zare A, Ablakimova N, Kaliyev AA, Mussin NM, Tanideh N, Rahmanifar F, Tamadon A. An update for various applications of Artificial Intelligence (AI) for detection and identification of marine environmental pollutions: A bibliometric analysis and systematic review. MARINE POLLUTION BULLETIN 2024; 206:116751. [PMID: 39053264 DOI: 10.1016/j.marpolbul.2024.116751] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/10/2024] [Revised: 07/16/2024] [Accepted: 07/16/2024] [Indexed: 07/27/2024]
Abstract
Marine environmental pollution is one of the growing concerns of humans all over the world. Therefore, managing these marine pollutants has been a crucial matter for scientists in recent decades. Thus, researchers have tried to implement artificial intelligence (AI) to handle marine environmental pollutants. Therefore, in this manuscript, we performed a bibliometric analysis to understand the main applications of AI for managing marine environments. Therefore, we examined both PubMed online database and Google Scholar to find any research articles that discuss the applications of AI in managing marine environmental pollution. Ultimately, we found that AI can detect, locate, and even predict aquatic contaminants like oil fingerprinting, oil spills, oil spill damage, oil slicks, forecasting marine water quality, water quality development, harmful algal blooms, benthic sediment toxicity, as well as detection of marine debris with high accuracy.
Collapse
Affiliation(s)
| | - Nurgul Ablakimova
- Department of Pharmacology, West Kazakhstan Marat Ospanov Medical University, Aktobe 030012, Kazakhstan
| | - Asset Askerovich Kaliyev
- Department of Surgery, West Kazakhstan Marat Ospanov Medical University, Aktobe 030012, Kazakhstan
| | - Nadiar Maratovich Mussin
- Department of Surgery, West Kazakhstan Marat Ospanov Medical University, Aktobe 030012, Kazakhstan.
| | - Nader Tanideh
- Stem Cells Technology Research Center, Shiraz University of Medical Sciences, Shiraz 71348-14336, Iran; Department of Pharmacology, Medical School, Shiraz University of Medical Sciences, Shiraz 71348-14336, Iran
| | - Farhad Rahmanifar
- Department of Basic Sciences, School of Veterinary Medicine, Shiraz University, Shiraz, Iran
| | - Amin Tamadon
- Department for Natural Sciences, West Kazakhstan Marat Ospanov Medical University, Aktobe, Kazakhstan
| |
Collapse
|
2
|
Sun Z, Yang Q, Yan N, Chen S, Zhu J, Zhao J, Sun S. Utilizing deep learning algorithms for automated oil spill detection in medium resolution optical imagery. MARINE POLLUTION BULLETIN 2024; 206:116777. [PMID: 39083910 DOI: 10.1016/j.marpolbul.2024.116777] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/24/2024] [Revised: 07/22/2024] [Accepted: 07/23/2024] [Indexed: 08/02/2024]
Abstract
This study evaluates the performance of three typical convolutional neural network based deep learning algorithms for oil spill detection using medium-resolution optical satellite imagery from Sentinel-2 MSI, Landsat-8 OLI, and Landsat-9 OLI2. Oil slick training and validation dataset were created through a semi-automatic labeling approach, based on chronic and accidental oil spill cases reported worldwide. The research enhances UNet, BiSeNetV2, and DeepLabV3+ architectures by integrating attention mechanisms including the Squeeze-and-Excitation module (SE), Convolutional Block Attention Module (CBAM), and a Simple, parameter-free Attention Module (SimAM), analyzing the optimal model for oil spill detection. Notably, UNet integrated with CBAM, especially with sun glint as a feature, significantly outperformed others, achieving a micro-average F1 score of 88.8 %. This research highlights deep learning's potential in optical remote sensing for oil spill detection, stressing its escalating relevance with the growing deployment of medium- to high-resolution optical satellites.
Collapse
Affiliation(s)
- Zhen Sun
- Institute of Estuarine and Coastal Research, School of Ocean Engineering and Technology, Sun Yat-sen University, and Southern Marine Science and Engineering Guangdong Laboratory (Zhuhai), Zhuhai 519082, China
| | - Qingshu Yang
- Institute of Estuarine and Coastal Research, School of Ocean Engineering and Technology, Sun Yat-sen University, and Southern Marine Science and Engineering Guangdong Laboratory (Zhuhai), Zhuhai 519082, China
| | - Nanyang Yan
- Guangzhou Urban Planning & Design Survey Research Institute, Guangzhou 510060, China; Collaborative Innovation Center for Natural Resources Planning and Marine Technology of Guangzhou, Guangzhou 510060, China
| | - Siyu Chen
- School of Marine Sciences, Sun Yat-sen University, Zhuhai 519082, China
| | - Jianhang Zhu
- School of Marine Sciences, Sun Yat-sen University, Zhuhai 519082, China
| | - Jun Zhao
- School of Marine Sciences, Sun Yat-sen University, Zhuhai 519082, China; Guangdong Provincial Key Laboratory of Marine Resources and Coastal Engineering, Guangzhou 510275, China; Pearl River Estuary Marine Ecosystem Research Station, Ministry of Education, Zhuhai 519000, China
| | - Shaojie Sun
- School of Marine Sciences, Sun Yat-sen University, Zhuhai 519082, China; Guangdong Provincial Key Laboratory of Marine Resources and Coastal Engineering, Guangzhou 510275, China; Pearl River Estuary Marine Ecosystem Research Station, Ministry of Education, Zhuhai 519000, China.
| |
Collapse
|
3
|
Trujillo-Acatitla R, Tuxpan-Vargas J, Ovando-Vázquez C, Monterrubio-Martínez E. Marine oil spill detection and segmentation in SAR data with two steps Deep Learning framework. MARINE POLLUTION BULLETIN 2024; 204:116549. [PMID: 38850755 DOI: 10.1016/j.marpolbul.2024.116549] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/20/2024] [Revised: 05/30/2024] [Accepted: 05/31/2024] [Indexed: 06/10/2024]
Abstract
Marine oil spills pose significant ecological and economic threats worldwide, requiring effective decision-making tools. In this study, the optimal parameters, and configurations for Deep Learning models in oil spill classification and segmentation using Sentinel-1 SAR imagery were identified. First, a new Sentinel-1 image dataset was created. Ninety CNN configurations were explored for classification by varying the number of convolutional layers, filters, hidden layers, and neurons in each layer. For segmentation tasks, MLP and U-Net models were evaluated with variations in convolutional layers, filters, and incorporation of IoU and Focal Loss. The results indicated that a CNN model with six layers, 32 filters, and two hidden layers achieved 99 % classification accuracy. For segmentation, the U-Net model with more layers and filters using Focal Loss achieved 99 % accuracy and 96 % IoU. Therefore, a CNN and U-Net framework was proposed that achieves an overall accuracy of 95 % and an IoU of 90 %.
Collapse
Affiliation(s)
- Rubicel Trujillo-Acatitla
- División de Geociencias Aplicadas, Instituto Potosino de Investigación Científica y Tecnológica A.C., Camino a la Presa de San José No. 2055, Colonia Lomas 4ta Sección, San Luis Potosí, San Luis Potosí C.P. 78216, Mexico
| | - José Tuxpan-Vargas
- División de Geociencias Aplicadas, Instituto Potosino de Investigación Científica y Tecnológica A.C., Camino a la Presa de San José No. 2055, Colonia Lomas 4ta Sección, San Luis Potosí, San Luis Potosí C.P. 78216, Mexico; Cátedras-CONAHCyT, Consejo Nacional de Humanidades, Ciencias y Tecnologías, CDMX 03940, Mexico.
| | - Cesaré Ovando-Vázquez
- División de Biología Molecular, Instituto Potosino de Investigación Científica y Tecnológica A.C., Camino a la Presa de San José No. 2055, Colonia Lomas 4ta Sección, San Luis Potosí, San Luis Potosí C.P. 78216, Mexico; Centro Nacional de Supercómputo (CNS), Instituto Potosino de Investigación Científica y Tecnológica A.C., Camino a la Presa de San José No. 2055, Colonia Lomas 4ta Sección, San Luis Potosí, San Luis Potosí C.P. 78216, Mexico; Cátedras-CONAHCyT, Consejo Nacional de Humanidades, Ciencias y Tecnologías, CDMX 03940, Mexico.
| | - Erandi Monterrubio-Martínez
- División de Geociencias Aplicadas, Instituto Potosino de Investigación Científica y Tecnológica A.C., Camino a la Presa de San José No. 2055, Colonia Lomas 4ta Sección, San Luis Potosí, San Luis Potosí C.P. 78216, Mexico
| |
Collapse
|
4
|
Cai Y, Chen L, Zhuang X, Zhang B. Automated marine oil spill detection algorithm based on single-image generative adversarial network and YOLO-v8 under small samples. MARINE POLLUTION BULLETIN 2024; 203:116475. [PMID: 38761680 DOI: 10.1016/j.marpolbul.2024.116475] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/28/2024] [Revised: 04/23/2024] [Accepted: 05/05/2024] [Indexed: 05/20/2024]
Abstract
As marine resources and transportation develop, oil spill incidents are increasing, endangering marine ecosystems and human lives. Rapidly and accurately identifying marine oil spill is of utmost importance in protecting marine ecosystems. Marine oil spill detection methods based on deep learning and computer vision have the great potential significantly enhance detection efficiency and accuracy, but their performance is often limited by the scarcity of real oil spill samples, posing a challenging to train a precise detection model. This study introduces a detection method specifically designed for scenarios with limited sample sizes. First, the small sample dataset of marine oil spill taken by Landsat-8 satellite is used as the training set. Then, a single image generative adversarial network (SinGAN) capable of training with a single oil spill image is constructed for expanding the dataset, generating diverse marine oil spill samples with different shapes. Second, a YOLO-v8 model is pretrained via the method of transfer learning and then trained with dataset before and after augmentation separately for real-time and efficient oil spill detection. Experimental results have demonstrated that the YOLO-v8 model, trained on an expanded dataset, exhibits notable enhancements in recall, precision, and average precision, with improvements of 12.3 %, 6.3 %, and 11.3 % respectively, compared to the unexpanded dataset. It reveals that our marine oil spill detection model based on YOLO-v8 exhibits leading or comparable performance in terms of recall, precision, and AP metrics. The data augmentation technique based on SinGAN contributes to the performance of other popular object detection algorithms as well.
Collapse
Affiliation(s)
- Yuepeng Cai
- School of Systems Science and Engineering, Sun Yat-sen University, Guangzhou, Guangdong, 510006, China
| | - Lusheng Chen
- School of Marine Sciences, Sun Yat-sen University, Zhuhai, Guangdong, 519082, China
| | - Xuebin Zhuang
- School of Systems Science and Engineering, Sun Yat-sen University, Guangzhou, Guangdong, 510006, China.
| | - Bolin Zhang
- School of Systems Science and Engineering, Sun Yat-sen University, Guangzhou, Guangdong, 510006, China
| |
Collapse
|
5
|
Wang R, Ma L, He G, Johnson BA, Yan Z, Chang M, Liang Y. Transformers for Remote Sensing: A Systematic Review and Analysis. SENSORS (BASEL, SWITZERLAND) 2024; 24:3495. [PMID: 38894286 PMCID: PMC11175147 DOI: 10.3390/s24113495] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/22/2024] [Revised: 05/20/2024] [Accepted: 05/27/2024] [Indexed: 06/21/2024]
Abstract
Research on transformers in remote sensing (RS), which started to increase after 2021, is facing the problem of a relative lack of review. To understand the trends of transformers in RS, we undertook a quantitative analysis of the major research on transformers over the past two years by dividing the application of transformers into eight domains: land use/land cover (LULC) classification, segmentation, fusion, change detection, object detection, object recognition, registration, and others. Quantitative results show that transformers achieve a higher accuracy in LULC classification and fusion, with more stable performance in segmentation and object detection. Combining the analysis results on LULC classification and segmentation, we have found that transformers need more parameters than convolutional neural networks (CNNs). Additionally, further research is also needed regarding inference speed to improve transformers' performance. It was determined that the most common application scenes for transformers in our database are urban, farmland, and water bodies. We also found that transformers are employed in the natural sciences such as agriculture and environmental protection rather than the humanities or economics. Finally, this work summarizes the analysis results of transformers in remote sensing obtained during the research process and provides a perspective on future directions of development.
Collapse
Affiliation(s)
- Ruikun Wang
- Beijing Institute of Satellite Information Engineering, Beijing 100095, China
- State Key Laboratory of Space-Ground Integrated Information Technology, Space Star Technology Co., Ltd., Beijing 100095, China
| | - Lei Ma
- Jiangsu Provincial Key Laboratory of Geographic Information Science and Technology, Key Laboratory for Land Satellite Remote Sensing Applications of Ministry of Natural Resources, School of Geography and Ocean Science, Nanjing University, Nanjing 210023, China
| | - Guangjun He
- Beijing Institute of Satellite Information Engineering, Beijing 100095, China
- State Key Laboratory of Space-Ground Integrated Information Technology, Space Star Technology Co., Ltd., Beijing 100095, China
| | - Brian Alan Johnson
- Natural Resources and Ecosystem Services, Institute for Global Environmental Strategies, 2108-11, Kamiyamaguchi, Hayama, Kanagawa 240-0115, Japan
| | - Ziyun Yan
- Jiangsu Provincial Key Laboratory of Geographic Information Science and Technology, Key Laboratory for Land Satellite Remote Sensing Applications of Ministry of Natural Resources, School of Geography and Ocean Science, Nanjing University, Nanjing 210023, China
| | - Ming Chang
- Beijing Institute of Satellite Information Engineering, Beijing 100095, China
- State Key Laboratory of Space-Ground Integrated Information Technology, Space Star Technology Co., Ltd., Beijing 100095, China
| | - Ying Liang
- Beijing Institute of Satellite Information Engineering, Beijing 100095, China
- State Key Laboratory of Space-Ground Integrated Information Technology, Space Star Technology Co., Ltd., Beijing 100095, China
| |
Collapse
|
6
|
Zhan C, Bai K, Tu B, Zhang W. Offshore Oil Spill Detection Based on CNN, DBSCAN, and Hyperspectral Imaging. SENSORS (BASEL, SWITZERLAND) 2024; 24:411. [PMID: 38257504 PMCID: PMC10819121 DOI: 10.3390/s24020411] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Revised: 12/24/2023] [Accepted: 01/02/2024] [Indexed: 01/24/2024]
Abstract
Offshore oil spills have the potential to inflict substantial ecological damage, underscoring the critical importance of timely offshore oil spill detection and remediation. At present, offshore oil spill detection typically combines hyperspectral imaging with deep learning techniques. While these methodologies have made significant advancements, they prove inadequate in scenarios requiring real-time detection due to limited model detection speeds. To address this challenge, a method for detecting oil spill areas is introduced, combining convolutional neural networks (CNNs) with the DBSCAN clustering algorithm. This method aims to enhance the efficiency of oil spill area detection in real-time scenarios, providing a potential solution to the limitations posed by the intricate structures of existing models. The proposed method includes a pre-feature selection process applied to the spectral data, followed by pixel classification using a convolutional neural network (CNN) model. Subsequently, the DBSCAN algorithm is employed to segment oil spill areas from the classification results. To validate our proposed method, we simulate an offshore oil spill environment in the laboratory, utilizing a hyperspectral sensing device to collect data and create a dataset. We then compare our method with three other models-DRSNet, CNN-Visual Transformer, and GCN-conducting a comprehensive analysis to evaluate the advantages and limitations of each model.
Collapse
Affiliation(s)
- Ce Zhan
- Hubei Key Laboratory of Drilling and Production Engineering for Oil and Gas, Yangtze University, Jingzhou 430023, China; (C.Z.); (B.T.); (W.Z.)
- Xi’an Key Laboratory of Tight Oil (Shale Oil) Development, Xi’an Shiyou University, Xi’an 710065, China
- School of Computer Science, Yangtze University, Jingzhou 430023, China
| | - Kai Bai
- Hubei Key Laboratory of Drilling and Production Engineering for Oil and Gas, Yangtze University, Jingzhou 430023, China; (C.Z.); (B.T.); (W.Z.)
- Xi’an Key Laboratory of Tight Oil (Shale Oil) Development, Xi’an Shiyou University, Xi’an 710065, China
- School of Computer Science, Yangtze University, Jingzhou 430023, China
| | - Binrui Tu
- Hubei Key Laboratory of Drilling and Production Engineering for Oil and Gas, Yangtze University, Jingzhou 430023, China; (C.Z.); (B.T.); (W.Z.)
- Xi’an Key Laboratory of Tight Oil (Shale Oil) Development, Xi’an Shiyou University, Xi’an 710065, China
- School of Computer Science, Yangtze University, Jingzhou 430023, China
| | - Wanxing Zhang
- Hubei Key Laboratory of Drilling and Production Engineering for Oil and Gas, Yangtze University, Jingzhou 430023, China; (C.Z.); (B.T.); (W.Z.)
- Xi’an Key Laboratory of Tight Oil (Shale Oil) Development, Xi’an Shiyou University, Xi’an 710065, China
- School of Computer Science, Yangtze University, Jingzhou 430023, China
| |
Collapse
|
7
|
Najafizadegan S, Danesh-Yazdi M. Variable-complexity machine learning models for large-scale oil spill detection: The case of Persian Gulf. MARINE POLLUTION BULLETIN 2023; 195:115459. [PMID: 37683396 DOI: 10.1016/j.marpolbul.2023.115459] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/04/2023] [Revised: 08/18/2023] [Accepted: 08/24/2023] [Indexed: 09/10/2023]
Abstract
Oil spill is the main cause of marine pollution in the waterbodies with rich oil resources. In this study, we developed and compared the performance of variable-complexity machine-learning models to detect oil spill origin, extent, and movement over large scales. To this end, we trained Support Vector Machine (SVM), Random Forest (RF), and Convolutional Neural Network (CNN) models by using the statistical, geometrical, and textural features of Sentinel-1 SAR data. Our results in the Persian Gulf showed that CNN is superior to RF and SVM classifiers in oil spill detection, as evidenced by the testing accuracy of 95.8 %, 86.0 %, and 78.9 %, respectively. The results suggested utilizing both ascending and descending orbit pass directions to track the movement of oil spill and the underlying transport rate. The proposed methodology enables the detection of probable leaking tankers and platforms, which aids in identifying other sources of oil pollution than tankers and platforms.
Collapse
|