The New Hyperspectral Satellite PRISMA: Imagery for Forest Types Discrimination

Current and Near-Term Earth-Observing Environmental Satellites, Their Missions, Characteristics, Instruments, and Applications

Among the essential tools to address global environmental information requirements are the Earth-Observing (EO) satellites with free and open data access. This paper reviews those EO satellites from international space programs that already, or will in the next decade or so, provide essential data of importance to the environmental sciences that describe Earth's status. We summarize factors distinguishing those pioneering satellites placed in space over the past half century, and their links to modern ones, and the changing priorities for spaceborne instruments and platforms. We illustrate the broad sweep of instrument technologies useful for observing different aspects of the physio-biological aspects of the Earth's surface, spanning wavelengths from the UV-A at 380 nanometers to microwave and radar out to 1 m. We provide a background on the technical specifications of each mission and its primary instrument(s), the types of data collected, and examples of applications that illustrate these observations. We provide websites for additional mission details of each instrument, the history or context behind their measurements, and additional details about their instrument design, specifications, and measurements.

Optical Identification of Diabetic Retinopathy Using Hyperspectral Imaging

The severity of diabetic retinopathy (DR) is directly correlated to changes in both the oxygen utilization rate of retinal tissue as well as the blood oxygen saturation of both arteries and veins. Therefore, the current stage of DR in a patient can be identified by analyzing the oxygen content in blood vessels through fundus images. This enables medical professionals to make accurate and prompt judgments regarding the patient's condition. However, in order to use this method to implement supplementary medical treatment, blood vessels under fundus images need to be determined first, and arteries and veins then need to be differentiated from one another. Therefore, the entire study was split into three sections. After first removing the background from the fundus images using image processing, the blood vessels in the images were then separated from the background. Second, the method of hyperspectral imaging (HSI) was utilized in order to construct the spectral data. The HSI algorithm was utilized in order to perform analysis and simulations on the overall reflection spectrum of the retinal image. Thirdly, principal component analysis (PCA) was performed in order to both simplify the data and acquire the major principal components score plot for retinopathy in arteries and veins at all stages. In the final step, arteries and veins in the original fundus images were separated using the principal components score plots for each stage. As retinopathy progresses, the difference in reflectance between the arteries and veins gradually decreases. This results in a more difficult differentiation of PCA results in later stages, along with decreased precision and sensitivity. As a consequence of this, the precision and sensitivity of the HSI method in DR patients who are in the normal stage and those who are in the proliferative DR (PDR) stage are the highest and lowest, respectively. On the other hand, the indicator values are comparable between the background DR (BDR) and pre-proliferative DR (PPDR) stages due to the fact that both stages exhibit comparable clinical-pathological severity characteristics. The results indicate that the sensitivity values of arteries are 82.4%, 77.5%, 78.1%, and 72.9% in the normal, BDR, PPDR, and PDR, while for veins, these values are 88.5%, 85.4%, 81.4%, and 75.1% in the normal, BDR, PPDR, and PDR, respectively.

Classification of Skin Cancer Using Novel Hyperspectral Imaging Engineering via YOLOv5

Many studies have recently used several deep learning methods for detecting skin cancer. However, hyperspectral imaging (HSI) is a noninvasive optics system that can obtain wavelength information on the location of skin cancer lesions and requires further investigation. Hyperspectral technology can capture hundreds of narrow bands of the electromagnetic spectrum both within and outside the visible wavelength range as well as bands that enhance the distinction of image features. The dataset from the ISIC library was used in this study to detect and classify skin cancer on the basis of basal cell carcinoma (BCC), squamous cell carcinoma (SCC), and seborrheic keratosis (SK). The dataset was divided into training and test sets, and you only look once (YOLO) version 5 was applied to train the model. The model performance was judged according to the generated confusion matrix and five indicating parameters, including precision, recall, specificity, accuracy, and the F1-score of the trained model. Two models, namely, hyperspectral narrowband image (HSI-NBI) and RGB classification, were built and then compared in this study to understand the performance of HSI with the RGB model. Experimental results showed that the HSI model can learn the SCC feature better than the original RGB image because the feature is more prominent or the model is not captured in other categories. The recall rate of the RGB and HSI models were 0.722 to 0.794, respectively, thereby indicating an overall increase of 7.5% when using the HSI model.

The Weight of Hyperion and PRISMA Hyperspectral Sensor Characteristics on Image Capability to Retrieve Urban Surface Materials in the City of Venice

Following the success of the first hyperspectral sensor, the evaluation of hyperspectral image capability became a challenge in research, which mainly focused on improving image pre-processing and processing steps to minimize their errors, whereas in this study, the focus was on the weight of hyperspectral sensor characteristics on image capability in order to distinguish this effect from errors caused by image pre-processing and processing steps and improve our knowledge of errors. For these purposes, two satellite hyperspectral sensors with similar spatial and spectral characteristics (Hyperion and PRISMA) were compared with corresponding synthetic images, and the city of Venice was selected as the study area. After creating the synthetic images, the errors in the simulation of Hyperion and PRISMA images were evaluated (1.6 and 1.1%, respectively). The same spectral unmixing procedure was performed using real and synthetic images, and their accuracies were compared. The spectral accuracies in root mean square error were equal to 0.017 and 0.016, respectively. In addition, 72.3 and 77.4% of these values were related to sensor characteristics. The spatial accuracies in the mean absolute error were equal to 3.93 and 3.68, respectively. A total of 55.6 and 59.0% of these values were related to sensor characteristics, and 22.6 and 22.3% were related to co-localization and spatial resampling errors. The difference between the radiometric precision values of the sensors was 6.81 and 5.91% regarding the spectral and spatial accuracies of Hyperion image. In conclusion, the results of this study showed that the combined use of two or more real hyperspectral images with similar characteristics and their synthetic images quantifies the weight of hyperspectral sensor characteristics on their image capability and improves our knowledge regarding processing errors, and thus image capability.

Tree species composition mapping with dimension reduction and post-classification using very high-resolution hyperspectral imaging

Tree species' composition of forests is essential in forest management and nature conservation. We aimed to identify the tree species structure of a floodplain forest area using a hyperspectral image. We proposed an efficient novel strategy including the testing of three dimension reduction (DR) methods: Principal Component Analysis, Minimum Noise Fraction (MNF) and Indipendent Component Analysis with five machine learning (ML) algorithms (Maximum Likelihood Classifier, Support Vector Classification, Support Vector Machine, Random Forest and Artificial Neural Network) to find the most accurate outcome; altogether 300 models were calculated. Post-classification was applied by combining the multiresolution segmentation and filtering. MNF was the most efficient DR technique, and at least 7 components were needed to gain an overall accuracy (OA) of > 75%. Forty-five models had > 80% OAs; MNF was 43, and the Maximum Likelihood was 19 times among these models. Best classification belonged to MNF with 10 components and Maximum Likelihood classifier with the OA of 83.3%. Post-classification increased the OA to 86.1%. We quantified the differences among the possible DR and ML methods, and found that even > 10% worse model can be found using popular standard procedures related to the best results. Our workflow calls the attention of careful model selection to gain accurate maps.

Intelligent Identification of Early Esophageal Cancer by Band-Selective Hyperspectral Imaging

In this study, the combination of hyperspectral imaging (HSI) technology and band selection was coupled with color reproduction. The white-light images (WLIs) were simulated as narrow-band endoscopic images (NBIs). As a result, the blood vessel features in the endoscopic image became more noticeable, and the prediction performance was improved. In addition, a single-shot multi-box detector model for predicting the stage and location of esophageal cancer was developed to evaluate the results. A total of 1780 esophageal cancer images, including 845 WLIs and 935 NBIs, were used in this study. The images were divided into three stages based on the pathological features of esophageal cancer: normal, dysplasia, and squamous cell carcinoma. The results showed that the mean average precision (mAP) reached 80% in WLIs, 85% in NBIs, and 84% in HSI images. This study′s results showed that HSI has more spectral features than white-light imagery, and it improves accuracy by about 5% and matches the results of NBI predictions.

Air Pollution Detection Using a Novel Snap-Shot Hyperspectral Imaging Technique

Air pollution has emerged as a global problem in recent years. Particularly, particulate matter (PM2.5) with a diameter of less than 2.5 μm can move through the air and transfer dangerous compounds to the lungs through human breathing, thereby creating major health issues. This research proposes a large-scale, low-cost solution for detecting air pollution by combining hyperspectral imaging (HSI) technology and deep learning techniques. By modeling the visible-light HSI technology of the aerial camera, the image acquired by the drone camera is endowed with hyperspectral information. Two methods are used for the classification of the images. That is, 3D Convolutional Neural Network Auto Encoder and principal components analysis (PCA) are paired with VGG-16 (Visual Geometry Group) to find the optical properties of air pollution. The images are classified into good, moderate, and severe based on the concentration of PM2.5 particles in the images. The results suggest that the PCA + VGG-16 has the highest average classification accuracy of 85.93%.

A Transmission Efficiency Evaluation Method of Adaptive Coding Modulation for Ka-Band Data-Transmission of LEO EO Satellites

Nowadays low Earth orbit (LEO) Earth observation (EO) satellites commonly use constant coding modulation (CCM) or variable coding modulation (VCM) schemes for data transmission to ground stations (G/S). Compared with CCM and VCM, the adaptive coding modulation (ACM) could further improve the data throughput of the link by making full use of link resource and the time-varying characteristics of atmospheric attenuation. In order to comprehensively study the data transmission performance, one new index which could be utilized as a quantitative index for the satellite-to-ground data transmission scheme selection, the transmission efficiency factor (TEF) of LEO satellites is proposed and defined as "the product of the link availability and the average useful data rate". Then, the transmission efficiency of CCM, VCM and ACM at typical G/S with different weather characteristics at Ka-band is compared and analyzed. The results show that ACM is more suitable for the G/S with moderate and abundant rainfall. Compared with the CCM of MCS 28, for Beijing G/S and Sanya G/S, ACM not only improves the transmission efficiency with the TEF increased by 3.62% and 24.51%, respectively, but also improves the link availability with the outage period reduced by 82.47% and 75.18%, respectively.

Squirrel Search Optimization with Deep Transfer Learning-Enabled Crop Classification Model on Hyperspectral Remote Sensing Imagery

With recent advances in remote sensing image acquisition and the increasing availability of fine spectral and spatial information, hyperspectral remote sensing images (HSI) have received considerable attention in several application areas such as agriculture, environment, forestry, and mineral mapping, etc. HSIs have become an essential method for distinguishing crop classes and accomplishing growth information monitoring for precision agriculture, depending upon the fine spectral response to the crop attributes. The recent advances in computer vision (CV) and deep learning (DL) models allow for the effective identification and classification of different crop types on HSIs. This article introduces a novel squirrel search optimization with a deep transfer learning-enabled crop classification (SSODTL-CC) model on HSIs. The proposed SSODTL-CC model intends to identify the crop type in HSIs properly. To accomplish this, the proposed SSODTL-CC model initially derives a MobileNet with an Adam optimizer for the feature extraction process. In addition, an SSO algorithm with a bidirectional long-short term memory (BiLSTM) model is employed for crop type classification. To demonstrate the better performance of the SSODTL-CC model, a wide-ranging experimental analysis is performed on two benchmark datasets, namely dataset-1 (WHU-Hi-LongKou) and dataset-2 (WHU-Hi-HanChuan). The comparative analysis pointed out the better outcomes of the SSODTL-CC model over other models with a maximum of 99.23% and 97.15% on test datasets 1 and 2, respectively.

Wavelength Extension of the Optimized Asymmetric-Order Vegetation Isoline Equation to Cover the Range from Visible to Near-Infrared

Vegetation isoline equations describe analytical relationships between two reflectances of different wavelengths. Their applications range from retrievals of biophysical parameters to the derivation of the inter-sensor relationships of spectral vegetation indexes. Among the three variants of vegetation isoline equations introduced thus far, the optimized asymmetric-order vegetation isoline equation is the newest and is known to be the most accurate. This accuracy assessment, however, has been performed only for the wavelength pair of red and near-infrared (NIR) bands fixed at ∼655 nm and ∼865 nm, respectively. The objective of this study is to extend this wavelength limitation. An accuracy assessment was therefore performed over a wider range of wavelengths, from 400 to 1200 nm. The optimized asymmetric-order vegetation isoline equation was confirmed to demonstrate the highest accuracy among the three isolines for all the investigated wavelength pairs. The second-best equation, the asymmetric-order isoline equation, which does not include an optimization factor, was not superior to the least-accurate equation (i.e., the first-order isoline equation) in some cases. This tendency was prominent when the reflectances of the two wavelengths were similar. By contrast, the optimized asymmetric-order vegetation isoline showed stable performance throughout this study. A single factor introduced into the optimized asymmetric-order isoline equation was concluded to effectively reduce errors in the isoline for all the wavelength combinations examined in this study.

How to Orient and Orthorectify PRISMA Images and Related Issues

The orientation of satellite images is a necessary operation for the correct geometric use of satellite images whether they are used individually to obtain an orthophoto or as stereocouples to extract three-dimensional information. The orientation allows us to reconstruct the correct position on the ground of the single pixels that form the image, which normally can be performed using certain functions of commercial software customised for each specific satellite. These functions read the metadata parameters provided by the satellite operator and use them to correctly orient the images. Unfortunately, these parameters have not been standardised and various satellites report them according to variable conventions, so new satellites or those that are not widely used cannot be oriented automatically. The PRISMA satellite launched by the Italian Space Agency (ASI) releases free hyperspectral and panchromatic images with metric resolution, but there is not yet a standardised procedure for orienting its images and this limits its usability. This paper reports on the first experimentation of orientation and orthorectification of PRISMA (PRecursore IperSpettrale della Missione Applicativa) images carried out using the three most widely used models, namely the rigorous, the Rational Polynomial Coefficients (RPC) and the Rational Polynomial Functions (RPF) tools. The results obtained by interpreting the parameters and making them suitable for use in standard procedures have made it possible to obtain results with an accuracy equal to the maximum resolution of panchromatic images (5 m), thus making it possible to achieve the highest level of geometric accuracy that can be extracted from the images themselves.

DSMNN-Net: A Deep Siamese Morphological Neural Network Model for Burned Area Mapping Using Multispectral Sentinel-2 and Hyperspectral PRISMA Images

Wildfires are one of the most destructive natural disasters that can affect our environment, with significant effects also on wildlife. Recently, climate change and human activities have resulted in higher frequencies of wildfires throughout the world. Timely and accurate detection of the burned areas can help to make decisions for their management. Remote sensing satellite imagery can have a key role in mapping burned areas due to its wide coverage, high-resolution data collection, and low capture times. However, although many studies have reported on burned area mapping based on remote sensing imagery in recent decades, accurate burned area mapping remains a major challenge due to the complexity of the background and the diversity of the burned areas. This paper presents a novel framework for burned area mapping based on Deep Siamese Morphological Neural Network (DSMNN-Net) and heterogeneous datasets. The DSMNN-Net framework is based on change detection through proposing a pre/post-fire method that is compatible with heterogeneous remote sensing datasets. The proposed network combines multiscale convolution layers and morphological layers (erosion and dilation) to generate deep features. To evaluate the performance of the method proposed here, two case study areas in Australian forests were selected. The framework used can better detect burned areas compared to other state-of-the-art burned area mapping procedures, with a performance of >98% for overall accuracy index, and a kappa coefficient of >0.9, using multispectral Sentinel-2 and hyperspectral PRISMA image datasets. The analyses of the two datasets illustrate that the DSMNN-Net is sufficiently valid and robust for burned area mapping, and especially for complex areas.

Joint Use of in-Scene Background Radiance Estimation and Optimal Estimation Methods for Quantifying Methane Emissions Using PRISMA Hyperspectral Satellite Data: Application to the Korpezhe Industrial Site

Methane (CH4) is one of the most contributing anthropogenic greenhouse gases (GHGs) in terms of global warming. Industry is one of the largest anthropogenic sources of methane, which are currently only roughly estimated. New satellite hyperspectral imagers, such as PRISMA, open up daily temporal monitoring of industrial methane sources at a spatial resolution of 30 m. Here, we developed the Characterization of Effluents Leakages in Industrial Environment (CELINE) code to inverse images of the Korpezhe industrial site. In this code, the in-Scene Background Radiance (ISBR) method was combined with a standard Optimal Estimation (OE) approach. The ISBR-OE method avoids the use of a complete and time-consuming radiative transfer model. The ISBR-OEM developed here overcomes the underestimation issues of the linear method (LM) used in the literature for high concentration plumes and controls a posteriori uncertainty. For the Korpezhe site, using the ISBR-OEM instead of the LM -retrieved CH4 concentration map led to a bias correction on CH4 mass from 4 to 16% depending on the source strength. The most important CH4 source has an estimated flow rate ranging from 0.36 ± 0.3 kg·s−1 to 4 ± 1.76 kg·s−1 on nine dates. These local and variable sources contribute to the CH4 budget and can better constrain climate change models.

Multitemporal Mapping of Post-Fire Land Cover Using Multiplatform PRISMA Hyperspectral and Sentinel-UAV Multispectral Data: Insights from Case Studies in Portugal and Italy

Wildfires have affected global forests and the Mediterranean area with increasing recurrency and intensity in the last years, with climate change resulting in reduced precipitations and higher temperatures. To assess the impact of wildfires on the environment, burned area mapping has become progressively more relevant. Initially carried out via field sketches, the advent of satellite remote sensing opened new possibilities, reducing the cost uncertainty and safety of the previous techniques. In the present study an experimental methodology was adopted to test the potential of advanced remote sensing techniques such as multispectral Sentinel-2, PRISMA hyperspectral satellite, and UAV (unmanned aerial vehicle) remotely-sensed data for the multitemporal mapping of burned areas by soil–vegetation recovery analysis in two test sites in Portugal and Italy. In case study one, innovative multiplatform data classification was performed with the correlation between Sentinel-2 RBR (relativized burn ratio) fire severity classes and the scene hyperspectral signature, performed with a pixel-by-pixel comparison leading to a converging classification. In the adopted methodology, RBR burned area analysis and vegetation recovery was tested for accordance with biophysical vegetation parameters (LAI, fCover, and fAPAR). In case study two, a UAV-sensed NDVI index was adopted for high-resolution mapping data collection. At a large scale, the Sentinel-2 RBR index proved to be efficient for burned area analysis, from both fire severity and vegetation recovery phenomena perspectives. Despite the elapsed time between the event and the acquisition, PRISMA hyperspectral converging classification based on Sentinel-2 was able to detect and discriminate different spectral signatures corresponding to different fire severity classes. At a slope scale, the UAV platform proved to be an effective tool for mapping and characterizing the burned area, giving clear advantage with respect to filed GPS mapping. Results highlighted that UAV platforms, if equipped with a hyperspectral sensor and used in a synergistic approach with PRISMA, would create a useful tool for satellite acquired data scene classification, allowing for the acquisition of a ground truth.

Evaluation of Object-Based Greenhouse Mapping Using WorldView-3 VNIR and SWIR Data: A Case Study from Almería (Spain)

Plastic covered greenhouse (PCG) mapping via remote sensing has received a great deal of attention over the past decades. The WorldView-3 (WV3) satellite is a very high resolution (VHR) sensor with eight multispectral bands in the visible and near-infrared (VNIR) spectral range, and eight additional bands in the short-wave infrared (SWIR) region. A few studies have already established the importance of indices based on some of these SWIR bands to detect urban plastic materials and hydrocarbons which are also related to plastics. This paper aims to investigate the capability of WV3 (VNIR and SWIR) for direct PCG detection following an object‐based image analysis (OBIA) approach. Three strategies were carried out: (i) using object features only derived from VNIR bands (VNIR); (ii) object features only derived from SWIR bands (SWIR), and (iii) object features derived from both VNIR and SWIR bands (All Features). The results showed that the majority of predictive power was attributed to SWIR indices, especially to the Normalized Difference Plastic Index (NDPI). Overall, accuracy values of 90.85%, 96.79% and 97.38% were attained for VNIR, SWIR and All Features strategies, respectively. The main PCG misclassification problem was related to the agricultural practice of greenhouse whitewash (greenhouse shading) that temporally masked the spectral signature of the plastic film.

Estimating VAIA Windstorm Damaged Forest Area in Italy Using Time Series Sentinel-2 Imagery and Continuous Change Detection Algorithms

Mapping forest disturbances is an essential component of forest monitoring systems both to support local decisions and for international reporting. Between the 28 and 29 October 2018, the VAIA storm hit the Northeast regions of Italy with wind gusts exceeding 200 km h−1. The forests in these regions have been seriously damaged. Over 490 Municipalities in six administrative Regions in Northern Italy registered forest damages caused by VAIA, that destroyed or intensely damaged forest stands spread over an area of 67,000 km2. The present work tested the use of two continuous change detection algorithms, i.e., the Bayesian estimator of abrupt change, seasonal change, and trend (BEAST) and the continuous change detection and classification (CCDC) to map and estimate forest windstorm damage area using a normalized burned ration (NBR) time series calculated on three years Sentinel-2 (S2) images collection (i.e., January 2017–October 2019). We analyzed the accuracy of the maps and the damaged forest area using a probability-based stratified estimation within 12 months after the storm with an independent validation dataset. The results showed that close to the storm (i.e., 1 to 6 months November 2018–March 2019) it is not possible to obtain accurate results independently of the algorithm used, while accurate results were observed between 7 and 12 months from the storm (i.e., May 2019–October 2019) in terms of Standard Error (SE), percentage SE (SE%), overall accuracy (OA), producer accuracy (PA), user accuracy (UA), and gmean for both BEAST and CCDC (SE < 3725.3 ha, SE% < 9.69, OA > 89.7, PA and UA > 0.87, gmean > 0.83).

Analysis of Regional Distribution of Tree Species Using Multi-Seasonal Sentinel-1&2 Imagery within Google Earth Engine

Accurate information on tree species is in high demand for forestry management and further investigations on biodiversity and environmental monitoring. Over regional or large areas, distinguishing tree species at high resolutions faces the challenges of a lack of representative features and computational power. A novel methodology was proposed to delineate the explicit spatial distribution of six dominant tree species (Pinus tabulaeformis, Quercus mongolia, Betula spp., Populus spp., Larix spp., and Armeniaca sibirica) and one residual class at 10 m resolution. Their spatial patterns were analyzed over an area covering over 90,000 km2 using the analysis-ready large volume of multisensor imagery within the Google Earth engine (GEE) platform afterwards. Random forest algorithm built into GEE was used together with the 20th and 80th percentiles of multitemporal features extracted from Sentinel-1/2, and topographic features. The composition of tree species in natural forests and plantations at the city and county-level were performed in detail afterwards. The classification achieved a reliable accuracy (77.5% overall accuracy, 0.71 kappa), and the spatial distribution revealed that plantations (Pinus tabulaeformis, Populus spp., Larix spp., and Armeniaca sibirica) outnumber natural forests (Quercus mongolia and Betula spp.) by 6% and were mainly concentrated in the northern and southern regions. Arhorchin had the largest forest area of over 4500 km2, while Hexingten and Aohan ranked first in natural forest and plantation area. Additionally, the class proportion of the number of tree species in Karqin and Ningcheng was more balanced. We suggest focusing more on the suitable areas modeling for tree species using species’ distribution models and environmental factors based on the classification results rather than field survey plots in further studies.