1
|
Saleh A, Zulkifley MA, Harun HH, Gaudreault F, Davison I, Spraggon M. Forest fire surveillance systems: A review of deep learning methods. Heliyon 2024; 10:e23127. [PMID: 38163175 PMCID: PMC10754902 DOI: 10.1016/j.heliyon.2023.e23127] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2023] [Revised: 11/03/2023] [Accepted: 11/27/2023] [Indexed: 01/03/2024] Open
Abstract
This review aims to critically examine the existing state-of-the-art forest fire detection systems that are based on deep learning methods. In general, forest fire incidences bring significant negative impact to the economy, environment, and society. One of the crucial mitigation actions that needs to be readied is an effective forest fire detection system that are able to automatically notify the relevant parties on the incidence of forest fire as early as possible. This review paper has examined in details 37 research articles that have implemented deep learning (DL) model for forest fire detection, which were published between January 2018 and 2023. In this paper, in depth analysis has been performed to identify the quantity and type of data that includes images and video datasets, as well as data augmentation methods and the deep model architecture. This paper is structured into five subsections, each of which focuses on a specific application of deep learning (DL) in the context of forest fire detection. These subsections include 1) classification, 2) detection, 3) detection and classification, 4) segmentation, and 5) segmentation and classification. To compare the model's performance, the methods were evaluated using comprehensive metrics like accuracy, mean average precision (mAP), F1-Score, mean pixel accuracy (MPA), etc. From the findings, of the usage of DL models for forest fire surveillance systems have yielded favourable outcomes, whereby the majority of studies managed to achieve accuracy rates that exceeds 90%. To further enhance the efficacy of these models, future research can explore the optimal fine-tuning of the hyper-parameters, integrate various satellite data, implement generative data augmentation techniques, and refine the DL model architecture. In conclusion, this paper highlights the potential of deep learning methods in enhancing forest fire detection that is crucial for forest fire management and mitigation.
Collapse
Affiliation(s)
- Azlan Saleh
- Department of Electrical, Electronic and Systems Engineering, Faculty of Engineering & Built Environment, Universiti Kebangsaan Malaysia (UKM), 43600 UKM, Bangi, Selangor, Malaysia
| | - Mohd Asyraf Zulkifley
- Department of Electrical, Electronic and Systems Engineering, Faculty of Engineering & Built Environment, Universiti Kebangsaan Malaysia (UKM), 43600 UKM, Bangi, Selangor, Malaysia
| | - Hazimah Haspi Harun
- Department of Electrical, Electronic and Systems Engineering, Faculty of Engineering & Built Environment, Universiti Kebangsaan Malaysia (UKM), 43600 UKM, Bangi, Selangor, Malaysia
| | - Francis Gaudreault
- Rabdan Academy, 65, Al Inshirah, Al Sa'adah, Abu Dhabi, 22401, PO Box: 114646, United Arab Emirates
| | - Ian Davison
- Rabdan Academy, 65, Al Inshirah, Al Sa'adah, Abu Dhabi, 22401, PO Box: 114646, United Arab Emirates
| | - Martin Spraggon
- Rabdan Academy, 65, Al Inshirah, Al Sa'adah, Abu Dhabi, 22401, PO Box: 114646, United Arab Emirates
| |
Collapse
|
2
|
Atasever ÜH, Tercan E. Deep learning-based burned forest areas mapping via Sentinel-2 imagery: a comparative study. ENVIRONMENTAL SCIENCE AND POLLUTION RESEARCH INTERNATIONAL 2024; 31:5304-5318. [PMID: 38112873 DOI: 10.1007/s11356-023-31575-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/27/2022] [Accepted: 12/11/2023] [Indexed: 12/21/2023]
Abstract
In order to evaluate the effects of forest fires on the dynamics of the function and structure of ecosystems, it is necessary to determine burned forest areas with high accuracy, effectively, economically, and practically using satellite images. Extraction of burned forest areas utilizing high-resolution satellite images and image classification algorithms and assessing the successfulness of varied classification algorithms has become a prominent research field. This study aims to indicate on the capability of the deep learning-based Stacked Autoencoders method for the burned forest areas mapping from Sentinel-2 satellite images. The Stacked Autoencoders, used in this study as an unsupervised learning method, were compared qualitatively and quantitatively with frequently used supervised learning algorithms (k-Nearest Neighbors (k-NN), Subspaced k-NN, Support Vector Machines, Random Forest, Bagged Decision Tree, Naive Bayes, Linear Discriminant Analysis) on two distinct burnt forest zones. By selecting burned forest zones with contrasting structural characteristics from one another, an objective assessment was achieved. Manually digitized burned areas from Sentinel-2 satellite images were utilized for accuracy assessment. For comparison, different classification performance and quality metrics (Overall Accuracy, Mean Squared Error, Correlation Coefficient, Structural Similarity Index Measure, Peak Signal-to-Noise Ratio, Universal Image Quality Index, and KAPPA metrics) were used. In addition, whether the Stacked Autoencoders method produces consistent results was examined through boxplots. In terms of both quantitative and qualitative analysis, the Stacked Autoencoders method showed the highest accuracy values.
Collapse
Affiliation(s)
- Ümit Haluk Atasever
- Department of Geomatics Engineering, Faculty of Engineering, Erciyes University, 38039, Kayseri, Turkey
| | - Emre Tercan
- Department of Traffic Safety, 13th Region, General Directorate of Highways, 07090, Antalya, Turkey.
| |
Collapse
|
3
|
Yilmaz OS, Acar U, Sanli FB, Gulgen F, Ates AM. Mapping burn severity and monitoring CO content in Türkiye's 2021 Wildfires, using Sentinel-2 and Sentinel-5P satellite data on the GEE platform. EARTH SCIENCE INFORMATICS 2023; 16:221-240. [PMID: 36685273 PMCID: PMC9838501 DOI: 10.1007/s12145-023-00933-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/24/2022] [Accepted: 01/01/2023] [Indexed: 06/17/2023]
Abstract
This study investigated forest fires in the Mediterranean of Türkiye between July 28, 2021, and August 11, 2021. Burn severity maps were produced with the difference normalised burned ratio index (dNBR) and difference normalised difference vegetation index (dNDVI) using Sentinel-2 images on the Google Earth Engine (GEE) cloud platform. The burned areas were estimated based on the determined burning severity degrees. Vegetation density losses in burned areas were analysed using the normalised difference vegetation index (NDVI) time series. At the same time, the post-fire Carbon Monoxide (CO) column number densities were determined using the Sentinel-5P satellite data. According to the burn severity maps obtained with dNBR, the sum of high and moderate severity areas constitutes 34.64%, 20.57%, 46.43%, 51.50% and 18.88% of the entire area in Manavgat, Gündoğmuş, Marmaris, Bodrum and Köyceğiz districts, respectively. Likewise, according to the burn severity maps obtained with dNDVI, the sum of the areas of very high severity and high severity constitutes 41.17%, 30.16%, 30.50%, 42.35%, and 10.40% of the entire region, respectively. In post-fire NDVI time series analyses, sharp decreases were observed in NDVI values from 0.8 to 0.1 in all burned areas. While the Tropospheric CO column number density was 0.03 mol/m2 in all regions burned before the fire, it was observed that this value increased to 0.14 mol/m2 after the fire. Moreover, when the area was examined more broadly with Sentinel 5P data, it was observed that the amount of CO increased up to a maximum value of 0.333 mol/m2. The results of this study present significant information in terms of determining the severity of forest fires in the Mediterranean region in 2021 and the determination of the CO column number density after the fire. In addition, monitoring polluting gases with RS techniques after forest fires is essential in understanding the extent of the damage they can cause to the environment.
Collapse
Affiliation(s)
- Osman Salih Yilmaz
- Demirci Vocational School, Manisa Celal Bayar University, 45900 Manisa, Türkiye
| | - Ugur Acar
- Geomatic Engineering Department, Yildiz Technical University, 34220 Istanbul, Türkiye
| | - Fusun Balik Sanli
- Geomatic Engineering Department, Yildiz Technical University, 34220 Istanbul, Türkiye
| | - Fatih Gulgen
- Geomatic Engineering Department, Yildiz Technical University, 34220 Istanbul, Türkiye
| | - Ali Murat Ates
- Computer and Instructional Technologies Department, Faculty of Education, Manisa Celal Bayar University 45900, Manisa, Türkiye
| |
Collapse
|
4
|
Development of a Novel Burned-Area Subpixel Mapping (BASM) Workflow for Fire Scar Detection at Subpixel Level. REMOTE SENSING 2022. [DOI: 10.3390/rs14153546] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
The accurate detection of burned forest area is essential for post-fire management and assessment, and for quantifying carbon budgets. Therefore, it is imperative to map burned areas accurately. Currently, there are few burned-area products around the world. Researchers have mapped burned areas directly at the pixel level that is usually a mixture of burned area and other land cover types. In order to improve the burned area mapping at subpixel level, we proposed a Burned Area Subpixel Mapping (BASM) workflow to map burned areas at the subpixel level. We then applied the workflow to Sentinel 2 data sets to obtain burned area mapping at subpixel level. In this study, the information of true fire scar was provided by the Department of Emergency Management of Hunan Province, China. To validate the accuracy of the BASM workflow for detecting burned areas at the subpixel level, we applied the workflow to the Sentinel 2 image data and then compared the detected burned area at subpixel level with in situ measurements at fifteen fire-scar reference sites located in Hunan Province, China. Results show the proposed method generated successfully burned area at the subpixel level. The methods, especially the BASM-Feature Extraction Rule Based (BASM-FERB) method, could minimize misclassification and effects due to noise more effectively compared with the BASM-Random Forest (BASM-RF), BASM-Backpropagation Neural Net (BASM-BPNN), BASM-Support Vector Machine (BASM-SVM), and BASM-notra methods. We conducted a comparison study among BASM-FERB, BASM-RF, BASM-BPNN, BASM-SVM, and BASM-notra using five accuracy evaluation indices, i.e., overall accuracy (OA), user’s accuracy (UA), producer’s accuracy (PA), intersection over union (IoU), and Kappa coefficient (Kappa). The detection accuracy of burned area at the subpixel level by BASM-FERB’s OA, UA, IoU, and Kappa is 98.11%, 81.72%, 74.32%, and 83.98%, respectively, better than BASM-RF’s, BASM-BPNN’s, BASM-SVM’s, and BASM-notra’s, even though BASM-RF’s and BASM-notra’s average PA is higher than BASM-FERB’s, with 89.97%, 91.36%, and 89.52%, respectively. We conclude that the newly proposed BASM workflow can map burned areas at the subpixel level, providing greater accuracy in regards to the burned area for post-forest fire management and assessment.
Collapse
|
5
|
A Systematic Review of Applications of Machine Learning Techniques for Wildfire Management Decision Support. INVENTIONS 2022. [DOI: 10.3390/inventions7010015] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
Abstract
Wildfires threaten and kill people, destroy urban and rural property, degrade air quality, ravage forest ecosystems, and contribute to global warming. Wildfire management decision support models are thus important for avoiding or mitigating the effects of these events. In this context, this paper aims at providing a review of recent applications of machine learning methods for wildfire management decision support. The emphasis is on providing a summary of these applications with a classification according to the case study type, machine learning method, case study location, and performance metrics. The review considers documents published in the last four years, using a sample of 135 documents (review articles and research articles). It is concluded that the adoption of machine learning methods may contribute to enhancing support in different fire management phases.
Collapse
|
6
|
DSMNN-Net: A Deep Siamese Morphological Neural Network Model for Burned Area Mapping Using Multispectral Sentinel-2 and Hyperspectral PRISMA Images. REMOTE SENSING 2021. [DOI: 10.3390/rs13245138] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/05/2023]
Abstract
Wildfires are one of the most destructive natural disasters that can affect our environment, with significant effects also on wildlife. Recently, climate change and human activities have resulted in higher frequencies of wildfires throughout the world. Timely and accurate detection of the burned areas can help to make decisions for their management. Remote sensing satellite imagery can have a key role in mapping burned areas due to its wide coverage, high-resolution data collection, and low capture times. However, although many studies have reported on burned area mapping based on remote sensing imagery in recent decades, accurate burned area mapping remains a major challenge due to the complexity of the background and the diversity of the burned areas. This paper presents a novel framework for burned area mapping based on Deep Siamese Morphological Neural Network (DSMNN-Net) and heterogeneous datasets. The DSMNN-Net framework is based on change detection through proposing a pre/post-fire method that is compatible with heterogeneous remote sensing datasets. The proposed network combines multiscale convolution layers and morphological layers (erosion and dilation) to generate deep features. To evaluate the performance of the method proposed here, two case study areas in Australian forests were selected. The framework used can better detect burned areas compared to other state-of-the-art burned area mapping procedures, with a performance of >98% for overall accuracy index, and a kappa coefficient of >0.9, using multispectral Sentinel-2 and hyperspectral PRISMA image datasets. The analyses of the two datasets illustrate that the DSMNN-Net is sufficiently valid and robust for burned area mapping, and especially for complex areas.
Collapse
|