1
|
Madokoro H, Sato K, Nix S, Chiyonobu S, Nagayoshi T, Sato K. OutcropHyBNet: Hybrid Backbone Networks with Data Augmentation for Accurate Stratum Semantic Segmentation of Monocular Outcrop Images in Carbon Capture and Storage Applications. SENSORS (BASEL, SWITZERLAND) 2023; 23:8809. [PMID: 37960509 PMCID: PMC10650223 DOI: 10.3390/s23218809] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/21/2023] [Revised: 10/11/2023] [Accepted: 10/26/2023] [Indexed: 11/15/2023]
Abstract
The rapid advancement of climate change and global warming have widespread impacts on society, including ecosystems, water security, food production, health, and infrastructure. To achieve significant global emission reductions, approximately 74% is expected to come from cutting carbon dioxide (CO2) emissions in energy supply and demand. Carbon Capture and Storage (CCS) has attained global recognition as a preeminent approach for the mitigation of atmospheric carbon dioxide levels, primarily by means of capturing and storing CO2 emissions originating from fossil fuel systems. Currently, geological models for storage location determination in CCS rely on limited sampling data from borehole surveys, which poses accuracy challenges. To tackle this challenge, our research project focuses on analyzing exposed rock formations, known as outcrops, with the goal of identifying the most effective backbone networks for classifying various strata types in outcrop images. We leverage deep learning-based outcrop semantic segmentation techniques using hybrid backbone networks, named OutcropHyBNet, to achieve accurate and efficient lithological classification, while considering texture features and without compromising computational efficiency. We conducted accuracy comparisons using publicly available benchmark datasets, as well as an original dataset expanded through random sampling of 13 outcrop images obtained using a stationary camera, installed on the ground. Additionally, we evaluated the efficacy of data augmentation through image synthesis using Only Adversarial Supervision for Semantic Image Synthesis (OASIS). Evaluation experiments on two public benchmark datasets revealed insights into the classification characteristics of different classes. The results demonstrate the superiority of Convolutional Neural Networks (CNNs), specifically DeepLabv3, and Vision Transformers (ViTs), particularly SegFormer, under specific conditions. These findings contribute to advancing accurate lithological classification in geological studies using deep learning methodologies. In the evaluation experiments conducted on ground-level images obtained using a stationary camera and aerial images captured using a drone, we successfully demonstrated the superior performance of SegFormer across all categories.
Collapse
Affiliation(s)
- Hirokazu Madokoro
- Faculty of Software and Information Science, Iwate Prefectural University, Takizawa 020-0693, Japan
| | - Kodai Sato
- Faculty of Systems Science and Technology, Akita Prefectural University, Yurihonjo 015-0055, Japan
| | - Stephanie Nix
- Faculty of Software and Information Science, Iwate Prefectural University, Takizawa 020-0693, Japan
| | - Shun Chiyonobu
- Graduate School of International Resource Sciences, Akita University, Akita 010-8502, Japan
| | - Takeshi Nagayoshi
- Faculty of Bioresource Sciences, Akita Prefectural University, Akita 010-0195, Japan
| | - Kazuhito Sato
- Faculty of Systems Science and Technology, Akita Prefectural University, Yurihonjo 015-0055, Japan
| |
Collapse
|
2
|
Chodorek A, Chodorek RR, Yastrebov A. The Prototype Monitoring System for Pollution Sensing and Online Visualization with the Use of a UAV and a WebRTC-Based Platform. SENSORS 2022; 22:s22041578. [PMID: 35214478 PMCID: PMC8877218 DOI: 10.3390/s22041578] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/22/2021] [Revised: 01/31/2022] [Accepted: 02/14/2022] [Indexed: 12/10/2022]
Abstract
Nowadays, we observe a great interest in air pollution, including exhaust fumes. This interest is manifested in both the development of technologies enabling the limiting of the emission of harmful gases and the development of measures to detect excessive emissions. The latter includes IoT systems, the spread of which has become possible thanks to the use of low-cost sensors. This paper presents the development and field testing of a prototype pollution monitoring system, allowing for both online and off-line analyses of environmental parameters. The system was built on a UAV and WebRTC-based platform, which was the subject of our previous paper. The platform was retrofitted with a set of low-cost environmental sensors, including a gas sensor able to measure the concentration of exhaust fumes. Data coming from sensors, video metadata captured from 4K camera, and spatiotemporal metadata are put in one situational context, which is transmitted to the ground. Data and metadata are received by the ground station, processed (if needed), and visualized on a dashboard retrieving situational context. Field studies carried out in a parking lot show that our system provides the monitoring operator with sufficient situational awareness to easily detect exhaust emissions online, and delivers enough information to enable easy detection during offline analyses as well.
Collapse
Affiliation(s)
- Agnieszka Chodorek
- Department of Applied Computer Science, Faculty of Electrical Engineering, Automatic Control and Computer Science, Kielce University of Technology, Al. 1000-lecia P.P. 7, 25-314 Kielce, Poland; (A.C.); (A.Y.)
| | - Robert Ryszard Chodorek
- Institute of Telecommunications, Faculty of Computer Science, Electronics and Telecommunications, The AGH University of Science and Technology, Al. Mickiewicza 30, 30-059 Krakow, Poland
- Correspondence: ; Tel.: +48-12-617-4803
| | - Alexander Yastrebov
- Department of Applied Computer Science, Faculty of Electrical Engineering, Automatic Control and Computer Science, Kielce University of Technology, Al. 1000-lecia P.P. 7, 25-314 Kielce, Poland; (A.C.); (A.Y.)
| |
Collapse
|
3
|
Chodorek A, Chodorek RR, Yastrebov A. Weather Sensing in an Urban Environment with the Use of a UAV and WebRTC-Based Platform: A Pilot Study. SENSORS (BASEL, SWITZERLAND) 2021; 21:7113. [PMID: 34770420 PMCID: PMC8586944 DOI: 10.3390/s21217113] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/01/2021] [Revised: 10/22/2021] [Accepted: 10/22/2021] [Indexed: 11/16/2022]
Abstract
Thanks to IoT, Internet access, and low-cost sensors, it has become possible to increase the number of weather measuring points; hence, the density of the deployment of sources that provide weather data for the needs of large recipients, for example, weather web services or smart city management systems, has also increased. This paper presents a flying weather station that carries out measurements of two weather factors that are typically included in weather stations (ambient temperature and relative humidity), an often included weather factor (atmospheric pressure), and a rarely included one (ultraviolet index). In our solution, the measurements are supplemented with a visual observation of present weather phenomena. The flying weather station is built on a UAV and WebRTC-based universal platform proposed in our previous paper. The complete, fully operational flying weather station was evaluated in field studies. Experiments were conducted during a 6-month period on days having noticeably different weather conditions. Results show that weather data coming from the flying weather station were equal (with a good approximation) to weather data obtained from the reference weather station. When compared to the weather stations described in the literature (both stationary weather stations and mobile ones), the proposed solution achieved better accuracy than the other weather stations based on low-cost sensors.
Collapse
Affiliation(s)
- Agnieszka Chodorek
- Department of Applied Computer Science, Faculty of Electrical Engineering, Automatic Control and Computer Science, Kielce University of Technology, Al. 1000-Lecia P.P. 7, 25-314 Kielce, Poland; (A.C.); (A.Y.)
| | - Robert Ryszard Chodorek
- Institute of Telecommunications, Faculty of Computer Science, Electronics and Telecommunications, The AGH University of Science and Technology, Al. Mickiewicza 30, 30-059 Krakow, Poland
| | - Alexander Yastrebov
- Department of Applied Computer Science, Faculty of Electrical Engineering, Automatic Control and Computer Science, Kielce University of Technology, Al. 1000-Lecia P.P. 7, 25-314 Kielce, Poland; (A.C.); (A.Y.)
| |
Collapse
|
4
|
Madokoro H, Kiguchi O, Nagayoshi T, Chiba T, Inoue M, Chiyonobu S, Nix S, Woo H, Sato K. Development of Drone-Mounted Multiple Sensing System with Advanced Mobility for In Situ Atmospheric Measurement: A Case Study Focusing on PM 2.5 Local Distribution. SENSORS 2021; 21:s21144881. [PMID: 34300619 PMCID: PMC8309946 DOI: 10.3390/s21144881] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/18/2021] [Revised: 07/08/2021] [Accepted: 07/14/2021] [Indexed: 11/16/2022]
Abstract
This study was conducted using a drone with advanced mobility to develop a unified sensor and communication system as a new platform for in situ atmospheric measurements. As a major cause of air pollution, particulate matter (PM) has been attracting attention globally. We developed a small, lightweight, simple, and cost-effective multi-sensor system for multiple measurements of atmospheric phenomena and related environmental information. For in situ local area measurements, we used a long-range wireless communication module with real-time monitoring and visualizing software applications. Moreover, we developed four prototype brackets with optimal assignment of sensors, devices, and a camera for mounting on a drone as a unified system platform. Results of calibration experiments, when compared to data from two upper-grade PM2.5 sensors, demonstrated that our sensor system followed the overall tendencies and changes. We obtained original datasets after conducting flight measurement experiments at three sites with differing surrounding environments. The experimentally obtained prediction results matched regional PM2.5 trends obtained using long short-term memory (LSTM) networks trained using the respective datasets.
Collapse
Affiliation(s)
- Hirokazu Madokoro
- Faculty of Software and Information Science, Iwate Prefectural University, Takizawa 020-0693, Japan
- Faculty of Systems Science and Technology, Akita Prefectural University, Yurihonjo 015-0055, Japan; (S.N.); (K.S.)
- Correspondence: ; Tel.: +81-019-694-2500
| | - Osamu Kiguchi
- Faculty of Bioresource Sciences, Akita Prefectural University, Akita 010-0195, Japan; (O.K.); (T.N.); (M.I.)
| | - Takeshi Nagayoshi
- Faculty of Bioresource Sciences, Akita Prefectural University, Akita 010-0195, Japan; (O.K.); (T.N.); (M.I.)
| | - Takashi Chiba
- College of Agriculture, Food and Environment Sciences, Rakuno Gakuen University, Ebetsu 069-0851, Japan;
| | - Makoto Inoue
- Faculty of Bioresource Sciences, Akita Prefectural University, Akita 010-0195, Japan; (O.K.); (T.N.); (M.I.)
| | - Shun Chiyonobu
- Graduate School of International Resource Sciences, Akita University, Akita 010-8502, Japan;
| | - Stephanie Nix
- Faculty of Systems Science and Technology, Akita Prefectural University, Yurihonjo 015-0055, Japan; (S.N.); (K.S.)
| | - Hanwool Woo
- Institute of Engineering Innovation, Graduate School of Engineering, The University of Tokyo, Tokyo 113-8656, Japan;
| | - Kazuhito Sato
- Faculty of Systems Science and Technology, Akita Prefectural University, Yurihonjo 015-0055, Japan; (S.N.); (K.S.)
| |
Collapse
|
5
|
Using OCO-2 Satellite Data for Investigating the Variability of Atmospheric CO2 Concentration in Relationship with Precipitation, Relative Humidity, and Vegetation over Oman. WATER 2019. [DOI: 10.3390/w12010101] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Recognition of the carbon dioxide (CO2) concentration variations over time is critical for tracing the future changes in climate both globally and regionally. In this study, a time series analysis of atmospheric CO2 concentration and its relationship with precipitation, relative humidity (RH), and vegetation is investigated over Oman. The daily XCO2 data from OCO-2 satellite was obtained from September 2014 to March 2019. The daily RH and precipitation data were also collected from the ground weather stations, and the Normalized Difference Vegetation Index was obtained from MODIS. Oman was studied in four distinct regions where the main emphasis was on the Monsoon Region in the far south. The CO2 concentration time series indicated a significant upward trend over different regions for the study period, with annual cycles being the same for all regions except the Monsoon Region. This is indicative of RH, precipitation, and consequently vegetation cover impact on atmospheric CO2 concentration, resulting in an overall lower annual growth in the Monsoon Region. Simple and multiple correlation analyses of CO2 concentration with mentioned parameters were performed in zero to three-month lags over Oman. They showed high correlations mainly during the rainfall period in the Monsoon Region.
Collapse
|