Physically-Based Retrieval of Canopy Equivalent Water Thickness Using Hyperspectral Data

Advances in the tea plants phenotyping using hyperspectral imaging technology

Rapid detection of plant phenotypic traits is crucial for plant breeding and cultivation. Traditional measurement methods are carried out by rich-experienced agronomists, which are time-consuming and labor-intensive. However, with the increasing demand for rapid and high-throughput testing in tea plants traits, digital breeding and smart cultivation of tea plants rely heavily on precise plant phenotypic trait measurement techniques, among which hyperspectral imaging (HSI) technology stands out for its ability to provide real-time and rich-information. In this paper, we provide a comprehensive overview of the principles of hyperspectral imaging technology, the processing methods of cubic data, and relevant algorithms in tea plant phenomics, reviewing the progress of applying hyperspectral imaging technology to obtain information on tea plant phenotypes, growth conditions, and quality indicators under environmental stress. Lastly, we discuss the challenges faced by HSI technology in the detection of tea plant phenotypic traits from different perspectives, propose possible solutions, and envision the potential development prospects of HSI technology in the digital breeding and smart cultivation of tea plants. This review aims to provide theoretical and technical support for the application of HSI technology in detecting tea plant phenotypic information, further promoting the trend of developing high quality and high yield tea leaves.

Retrieval of carbon content and biomass from hyperspectral imagery over cultivated areas

Spaceborne imaging spectroscopy is a highly promising data source for all agricultural management and research disciplines that require spatio-temporal information on crop properties. Recently launched science-driven missions, such as the Environmental Mapping and Analysis Program (EnMAP), deliver unprecedented data from the Earth's surface. This new kind of data should be explored to develop robust retrieval schemes for deriving crucial variables from future routine missions. Therefore, we present a workflow for inferring crop carbon content (Carea ), and aboveground dry and wet biomass (AGBdry , AGBfresh ) from EnMAP data. To achieve this, a hybrid workflow was generated, combining radiative transfer modeling (RTM) with machine learning regression algorithms. The key concept involves: (1) coupling the RTMs PROSPECT-PRO and 4SAIL for simulation of a wide range of vegetation states, (2) using dimensionality reduction to deal with collinearity, (3) applying a semi-supervised active learning technique against a 4-years campaign dataset, followed by (4) training of a Gaussian process regression (GPR) machine learning algorithm and (5) validation with an independent in situ dataset acquired during the ESA Hypersense experiment campaign at a German test site. Internal validation of the GPR-Carea and GPR-AGB models achieved coefficients of determination (R 2) of 0.80 for Carea and 0.80, 0.71 for AGBdry and AGBfresh , respectively. The mapping capability of these models was successfully demonstrated using airborne AVIRIS-NG hyperspectral imagery, which was spectrally resampled to EnMAP spectral properties. Plausible estimates were achieved over both bare and green fields after adding bare soil spectra to the training data. Validation over green winter wheat fields generated reliable estimates as suggested by low associated model uncertainties (< 40%). These results suggest a high degree of model reliability for cultivated areas during active growth phases at canopy closure. Overall, our proposed carbon and biomass models based on EnMAP spectral sampling demonstrate a promising path toward the inference of these crucial variables over cultivated areas from future spaceborne operational hyperspectral missions.

Seasonal Mapping of Irrigated Winter Wheat Traits in Argentina with a Hybrid Retrieval Workflow Using Sentinel-2 Imagery

Earth observation offers an unprecedented opportunity to monitor intensively cultivated areas providing key support to assess fertilizer needs and crop water uptake. Routinely, vegetation traits mapping can help farmers to monitor plant development along the crop's phenological cycle, which is particularly relevant for irrigated agricultural areas. The high spatial and temporal resolution of the Sentinel-2 (S2) multispectral instrument leverages the possibility to estimate leaf area index (LAI), canopy chlorophyll content (CCC), and vegetation water content (VWC) from space. Therefore, our study presents a hybrid retrieval workflow combining a physically-based strategy with a machine learning regression algorithm, i.e., Gaussian processes regression, and an active learning technique to estimate LAI, CCC and VWC of irrigated winter wheat. The established hybrid models of the three traits were validated against in-situ data of a wheat campaign in the Bonaerense valley, South of the Buenos Aires Province, Argentina, in the year 2020. We obtained good to highly accurate validation results with LAI: R2 = 0.92, RMSE = 0.43 m2 m-2, CCC: R2 = 0.80, RMSE = 0.27 g m-2 and VWC: R2 = 0.75, RMSE = 416 g m-2. The retrieval models were also applied to a series of S2 images, producing time series along the seasonal cycle, which reflected the effects of fertilizer and irrigation on crop growth. The associated uncertainties along with the obtained maps underlined the robustness of the hybrid retrieval workflow. We conclude that processing S2 imagery with optimised hybrid models allows accurate space-based crop traits mapping over large irrigated areas and thus can support agricultural management decisions.

Estimating soil moisture content under grassland with hyperspectral data using radiative transfer modelling and machine learning

The monitoring of soil moisture content (SMC) at very high spatial resolution (<10m) using unmanned aerial systems (UAS) is of high interest for precision agriculture and the validation of large scale SMC products. Data-driven approaches are the most common method to retrieve SMC with UAS-borne data at water limited sites over non-disturbed agricultural crops. A major disadvantage of data-driven algorithms is the limited transferability in space and time and the need of a high number of ground reference samples. Physically-based approaches are less dependent on the amount of samples and are transferable in space and time. This study explores the potential of (1) a hybrid method targeting the soil brightness factor of the PROSAIL model using a variational heteroscedastic Gaussian Processes regression (VHGPR) algorithm, and (2) a data-driven method employing VHGPR for the retrieval of SMC over three grassland sites based on UAS-borne VIS-NIR (399-1001 nm) hyperspectral data. The sites were managed by mowing (Fendt), grazing (Grosses Bruch) and irrigation (Marquardt). With these distinct local pre-conditions we aimed to identify factors that favor and limit the retrieval of SMC. The hybrid approach presented encouraging results in Marquardt (RMSE = 1.5 Vol_%, R2 = 0.2). At the permanent grassland sites (Fendt, Grosses Bruch) the thatch layer jeopardized the application of the hybrid model. We identified the complex canopy structure of grassland as the main factor impacting the hybrid SMC retrieval. The data-driven approach showed high accuracy for Fendt (R2 = 0.84, RMSE = 8.66) and Marquardt (R2 = 0.4, RMSE = 10.52). All data-driven models build on the LAI-SMC relationship. However, this relationship was hampered by mowing (Fendt), leading to a lack of transferability in time. The alteration of plant traits by grazing prevents finding a relationship with SMC in Grosses Bruch. In Marquardt, we identified the timelag between changes in SMC and plant response as the main reason of decrease in model accuracy. Yet, the model performance is accurate in undisturbed and water-limited areas (Marquardt). The analysis points to challenges that need to be tackled in future research and opens the discussion for the development of robust models to retrieve high resolution SMC from UAS-borne remote sensing observations.

Retrieval of the Leaf Area Index from MODIS Top-of-Atmosphere Reflectance Data Using a Neural Network Supported by Simulation Data

The leaf area index (LAI), a key parameter used to characterize the structure and function of the vegetation canopy, is crucial to simulations of the carbon, nitrogen, and water cycles of Earth’s system. In this paper, a neural network (NN) method coupled with vegetation canopy and atmospheric radiative transfer (RT) simulations is proposed to realize LAI retrieval without prior data support and complex atmospheric corrections. The look-up table (LUT) of the top-of-atmosphere (TOA) reflectance and associated input variables was simulated by 6S (6S simulation) based on the top-of-canopy (TOC) reflectance LUT simulated by PROSAIL. This was then used to train the NN to obtain the LAI inversion model. This method has been successfully applied to MODIS L1B data (MOD021KM), and the LAI retrieval of the vegetation canopy was realized. The estimated LAI was compared with the MODIS LAI (MOD15A2H) using mid-latitude summer data from 2000 to 2017 in the DIRECT 2.0 ground database. The experiments indicated that the LAI retrieved by the TOA reflectance (r = 0.7852, RMSE = 0.5191) was not much different from the LAI retrieved by the TOC reflectance (r = 0.8063, RMSE = 0.7669), and the accuracy was better than the MODIS LAI (r = 0.7607, RMSE = 0.8239), which proves the feasibility of this method.

Prototyping Crop Traits Retrieval Models for CHIME: Dimensionality Reduction Strategies Applied to PRISMA Data

In preparation for new-generation imaging spectrometer missions and the accompanying unprecedented inflow of hyperspectral data, optimized models are needed to generate vegetation traits routinely. Hybrid models, combining radiative transfer models with machine learning algorithms, are preferred, however, dealing with spectral collinearity imposes an additional challenge. In this study, we analyzed two spectral dimensionality reduction methods: principal component analysis (PCA) and band ranking (BR), embedded in a hybrid workflow for the retrieval of specific leaf area (SLA), leaf area index (LAI), canopy water content (CWC), canopy chlorophyll content (CCC), the fraction of absorbed photosynthetic active radiation (FAPAR), and fractional vegetation cover (FVC). The SCOPE model was used to simulate training data sets, which were optimized with active learning. Gaussian process regression (GPR) algorithms were trained over the simulations to obtain trait-specific models. The inclusion of PCA and BR with 20 features led to the so-called GPR-20PCA and GPR-20BR models. The 20PCA models encompassed over 99.95% cumulative variance of the full spectral data, while the GPR-20BR models were based on the 20 most sensitive bands. Validation against in situ data obtained moderate to optimal results with normalized root mean squared error (NRMSE) from 13.9% (CWC) to 22.3% (CCC) for GPR-20PCA models, and NRMSE from 19.6% (CWC) to 29.1% (SLA) for GPR-20BR models. Overall, the GPR-20PCA slightly outperformed the GPR-20BR models for all six variables. To demonstrate mapping capabilities, both models were tested on a PRecursore IperSpettrale della Missione Applicativa (PRISMA) scene, spectrally resampled to Copernicus Hyperspectral Imaging Mission for the Environment (CHIME), over an agricultural test site (Jolanda di Savoia, Italy). The two strategies obtained plausible spatial patterns, and consistency between the two models was highest for FVC and LAI (R 2 = 0.91, R 2 = 0.86) and lowest for SLA mapping (R 2 = 0.53). From these findings, we recommend implementing GPR-20PCA models as the most efficient strategy for the retrieval of multiple crop traits from hyperspectral data streams. Hence, this workflow will support and facilitate the preparations of traits retrieval models from the next-generation operational CHIME.

Gaussian processes retrieval of crop traits in Google Earth Engine based on Sentinel-2 top-of-atmosphere data

The unprecedented availability of optical satellite data in cloud-based computing platforms, such as Google Earth Engine (GEE), opens new possibilities to develop crop trait retrieval models from the local to the planetary scale. Hybrid retrieval models are of interest to run in these platforms as they combine the advantages of physically- based radiative transfer models (RTM) with the flexibility of machine learning regression algorithms. Previous research with GEE primarily relied on processing bottom-of-atmosphere (BOA) reflectance data, which requires atmospheric correction. In the present study, we implemented hybrid models directly into GEE for processing Sentinel-2 (S2) Level-1C (L1C) top-of-atmosphere (TOA) reflectance data into crop traits. To achieve this, a training dataset was generated using the leaf-canopy RTM PROSAIL in combination with the atmospheric model 6SV. Gaussian process regression (GPR) retrieval models were then established for eight essential crop traits namely leaf chlorophyll content, leaf water content, leaf dry matter content, fractional vegetation cover, leaf area index (LAI), and upscaled leaf variables (i.e., canopy chlorophyll content, canopy water content and canopy dry matter content). An important pre-requisite for implementation into GEE is that the models are sufficiently light in order to facilitate efficient and fast processing. Successful reduction of the training dataset by 78% was achieved using the active learning technique Euclidean distance-based diversity (EBD). With the EBD-GPR models, highly accurate validation results of LAI and upscaled leaf variables were obtained against in situ field data from the validation study site Munich-North-Isar (MNI), with normalized root mean square errors (NRMSE) from 6% to 13%. Using an independent validation dataset of similar crop types (Italian Grosseto test site), the retrieval models showed moderate to good performances for canopy-level variables, with NRMSE ranging from 14% to 50%, but failed for the leaf-level estimates. Obtained maps over the MNI site were further compared against Sentinel-2 Level 2 Prototype Processor (SL2P) vegetation estimates generated from the ESA Sentinels' Application Platform (SNAP) Biophysical Processor, proving high consistency of both retrievals (R 2 from 0.80 to 0.94). Finally, thanks to the seamless GEE processing capability, the TOA-based mapping was applied over the entirety of Germany at 20 m spatial resolution including information about prediction uncertainty. The obtained maps provided confidence of the developed EBD-GPR retrieval models for integration in the GEE framework and national scale mapping from S2-L1C imagery. In summary, the proposed retrieval workflow demonstrates the possibility of routine processing of S2 TOA data into crop traits maps at any place on Earth as required for operational agricultural applications.

Monitoring Cropland Phenology on Google Earth Engine Using Gaussian Process Regression

Monitoring cropland phenology from optical satellite data remains a challenging task due to the influence of clouds and atmospheric artifacts. Therefore, measures need to be taken to overcome these challenges and gain better knowledge of crop dynamics. The arrival of cloud computing platforms such as Google Earth Engine (GEE) has enabled us to propose a Sentinel-2 (S2) phenology end-to-end processing chain. To achieve this, the following pipeline was implemented: (1) the building of hybrid Gaussian Process Regression (GPR) retrieval models of crop traits optimized with active learning, (2) implementation of these models on GEE (3) generation of spatiotemporally continuous maps and time series of these crop traits with the use of gap-filling through GPR fitting, and finally, (4) calculation of land surface phenology (LSP) metrics such as the start of season (SOS) or end of season (EOS). Overall, from good to high performance was achieved, in particular for the estimation of canopy-level traits such as leaf area index (LAI) and canopy chlorophyll content, with normalized root mean square errors (NRMSE) of 9% and 10%, respectively. By means of the GPR gap-filling time series of S2, entire tiles were reconstructed, and resulting maps were demonstrated over an agricultural area in Castile and Leon, Spain, where crop calendar data were available to assess the validity of LSP metrics derived from crop traits. In addition, phenology derived from the normalized difference vegetation index (NDVI) was used as reference. NDVI not only proved to be a robust indicator for the calculation of LSP metrics, but also served to demonstrate the good phenology quality of the quantitative trait products. Thanks to the GEE framework, the proposed workflow can be realized anywhere in the world and for any time window, thus representing a shift in the satellite data processing paradigm. We anticipate that the produced LSP metrics can provide meaningful insights into crop seasonal patterns in a changing environment that demands adaptive agricultural production.

Assessing Non-Photosynthetic Cropland Biomass from Spaceborne Hyperspectral Imagery

Non-photosynthetic vegetation (NPV) biomass has been identified as a priority variable for upcoming spaceborne imaging spectroscopy missions, calling for a quantitative estimation of lignocellulosic plant material as opposed to the sole indication of surface coverage. Therefore, we propose a hybrid model for the retrieval of non-photosynthetic cropland biomass. The workflow included coupling the leaf optical model PROSPECT-PRO with the canopy reflectance model 4SAIL, which allowed us to simulate NPV biomass from carbon-based constituents (CBC) and leaf area index (LAI). PROSAIL-PRO provided a training database for a Gaussian process regression (GPR) algorithm, simulating a wide range of non-photosynthetic vegetation states. Active learning was employed to reduce and optimize the training data set. In addition, we applied spectral dimensionality reduction to condense essential information of non-photosynthetic signals. The resulting NPV-GPR model was successfully validated against soybean field data with normalized root mean square error (nRMSE) of 13.4% and a coefficient of determination (R2) of 0.85. To demonstrate mapping capability, the NPV-GPR model was tested on a PRISMA hyperspectral image acquired over agricultural areas in the North of Munich, Germany. Reliable estimates were mainly achieved over senescent vegetation areas as suggested by model uncertainties. The proposed workflow is the first step towards the quantification of non-photosynthetic cropland biomass as a next-generation product from near-term operational missions, such as CHIME.

Predicting Equivalent Water Thickness in Wheat Using UAV Mounted Multispectral Sensor through Deep Learning Techniques

The equivalent water thickness (EWT) is an important biophysical indicator of water status in crops. The effective monitoring of EWT in wheat under different nitrogen and water treatments is important for irrigation management in precision agriculture. This study aimed to investigate the performances of machine learning (ML) algorithms in retrieving wheat EWT. For this purpose, a rain shelter experiment (Exp. 1) with four irrigation quantities (0, 120, 240, 360 mm) and two nitrogen levels (75 and 255 kg N/ha), and field experiments (Exps. 2–3) with the same irrigation and rainfall water levels (360 mm) but different nitrogen levels (varying from 75 to 255 kg N/ha) were conducted in the North China Plain. The canopy reflectance was measured for all plots at 30 m using an unmanned aerial vehicle (UAV)-mounted multispectral camera. Destructive sampling was conducted immediately after the UAV flights to measure total fresh and dry weight. Deep Neural Network (DNN) is a special type of neural network, which has shown performance in regression analysis is compared with other machine learning (ML) models. A feature selection (FS) algorithm named the decision tree (DT) was used as the automatic relevance determination method to obtain the relative relevance of 5 out of 67 vegetation indices (Vis), which were used for estimating EWT. The selected VIs were used to estimate EWT using multiple linear regression (MLR), deep neural network multilayer perceptron (DNN-MLP), artificial neural networks multilayer perceptron (ANN-MLP), boosted tree regression (BRT), and support vector machines (SVMs). The results show that the DNN-MLP with R2 = 0.934, NSE = 0.933, RMSE = 0.028 g/cm2, and MAE of 0.017 g/cm2 outperformed other ML algorithms (ANN-MPL, BRT, and SVM- Polynomial) owing to its high capacity for estimating EWT as compared to other ML methods. Our findings support the conclusion that ML can potentially be applied in combination with VIs for retrieving EWT. Despite the complexity of the ML models, the EWT map should help farmers by improving the real-time irrigation efficiency of wheat by quantifying field water content and addressing variability.

Impact of Modeling Abstractions When Estimating Leaf Mass per Area and Equivalent Water Thickness over Sparse Forests Using a Hybrid Method

Equivalent water thickness (EWT) and leaf mass per area (LMA) are important indicators of plant processes, such as photosynthetic and potential growth rates and health status, and are also important variables for fire risk assessment. Retrieving these traits through remote sensing is challenging and often requires calibration with in situ measurements to provide acceptable results. However, calibration data cannot be expected to be available at the operational level when estimating EWT and LMA over large regions. In this study, we assessed the ability of a hybrid retrieval method, consisting of training a random forest regressor (RFR) over the outputs of the discrete anisotropic radiative transfer (DART) model, to yield accurate EWT and LMA estimates depending on the scene modeling within DART and the spectral interval considered. We show that canopy abstractions mostly affect crown reflectance over the 0.75–1.3 μm range. It was observed that excluding these wavelengths when training the RFR resulted in the abstraction level having no effect on the subsequent LMA estimates (RMSE of 0.0019 g/cm2 for both the detailed and abstract models), and EWT estimates were not affected by the level of abstraction. Over AVIRIS-Next Generation images, we showed that the hybrid method trained with a simplified scene obtained accuracies (RMSE of 0.0029 and 0.0028 g/cm2 for LMA and EWT) consistent with what had been obtained from the test dataset of the calibration phase (RMSE of 0.0031 and 0.0032 g/cm2 for LMA and EWT), and the result yielded spatially coherent maps. The results demonstrate that, provided an appropriate spectral domain is used, the uncertainties inherent to the abstract modeling of tree crowns within an RTM do not significantly affect EWT and LMA accuracy estimates when tree crowns can be identified in the images.

Mapping landscape canopy nitrogen content from space using PRISMA data

Satellite imaging spectroscopy for terrestrial applications is reaching maturity with recently launched and upcoming science-driven missions, e.g. PRecursore IperSpettrale della Missione Applicativa (PRISMA) and Environmental Mapping and Analysis Program (EnMAP), respectively. Moreover, the high-priority mission candidate Copernicus Hyperspectral Imaging Mission for the Environment (CHIME) is expected to globally provide routine hyperspectral observations to support new and enhanced services for, among others, sustainable agricultural and biodiversity management. Thanks to the provision of contiguous visible-to-shortwave infrared spectral data, hyperspectral missions open enhanced opportunities for the development of new-generation retrieval models of multiple vegetation traits. Among these, canopy nitrogen content (CNC) is one of the most promising variables given its importance for agricultural monitoring applications. This work presents the first hybrid CNC retrieval model for the operational delivery from spaceborne imaging spectroscopy data. To achieve this, physically-based models were combined with machine learning regression algorithms and active learning (AL). The key concepts involve: (1) coupling the radiative transfer models PROSPECT-PRO and SAIL for the generation of a wide range of vegetation states as training data, (2) using dimensionality reduction to deal with collinearity, (3) applying an AL technique in combination with Gaussian process regression (GPR) for fine-tuning the training dataset on in field collected data, and (4) adding non-vegetated spectra to enable the model to deal with spectral heterogeneity in the image. The final CNC model was successfully validated against field data achieving a low root mean square error (RMSE) of 3.4 g/m² and coefficient of determination (R ²) of 0.7. The model was applied to a PRISMA image acquired over agricultural areas in the North of Munich, Germany. Mapping aboveground CNC yielded reliable estimates over the whole landscape and meaningful associated uncertainties. These promising results demonstrate the feasibility of routinely quantifying CNC from space, such as in an operational context as part of the future CHIME mission.

Sentinel-1 Backscatter Analysis and Radiative Transfer Modeling of Dense Winter Wheat Time Series

This study evaluates a temporally dense VV-polarized Sentinel-1 C-band backscatter time series (revisit time of 1.5 days) for wheat fields near Munich (Germany). A dense time series consisting of images from different orbits (varying acquisition) is analyzed, and Radiative Transfer (RT)-based model combinations are adapted and evaluated with the use of radar backscatter. The model shortcomings are related to scattering mechanism changes throughout the growth period with the use of polarimetric decomposition. Furthermore, changes in the RT modeled backscatter results with spatial aggregation from the pixel to field scales are quantified and related to the sensitivity of the RT models, and their soil moisture output are quantified and related to changes in backscatter. Therefore, various (sub)sets of the dense Sentinel-1 time series are analyzed to relate and quantify the impact of the abovementioned points on the modeling results. The results indicate that the incidence angle is the main driver for backscatter differences between consecutive acquisitions with various recording scenarios. The influence of changing azimuth angles was found to be negligible. Further analyses of polarimetric entropy and scattering alpha angle using a dual polarimetric eigen-based decomposition show that scattering mechanisms change over time. The patterns analyzed in the entropy-alpha space indicate that scattering mechanism changes are mainly driven by the incidence angle and not by the azimuth angle. Besides the analysis of differences within the Sentinel-1 data, we analyze the capability of RT model approaches to capture the observed Sentinel-1 backscatter changes due to various acquisition geometries. For this, the surface models “Oh92” or “IEM_B” (Baghdadi’s version of the Integral Equation Method) are coupled with the canopy model “SSRT” (Single Scattering Radiative Transfer). To resolve the shortcomings of the RT model setup in handling varying incidence angles and therefore the backscatter changes observed between consecutive time steps of a dense winter wheat time series, an empirical calibration parameter (coef) influencing the transmissivity (T) is introduced. The results show that shortcomings of simplified RT model architectures caused by handling time series consisting of images with varied incidence angles can be at least partially compensated by including a calibration coefficient to parameterize the modeled transmissivity for the varying incidence angle scenarios individually.

Top-of-Atmosphere Retrieval of Multiple Crop Traits Using Variational Heteroscedastic Gaussian Processes within a Hybrid Workflow

In support of cropland monitoring, operational Copernicus Sentinel-2 (S2) data became available globally and can be explored for the retrieval of important crop traits. Based on a hybrid workflow, retrieval models for six essential biochemical and biophysical crop traits were developed for both S2 bottom-of-atmosphere (BOA) L2A and S2 top-of-atmosphere (TOA) L1C data. A variational heteroscedastic Gaussian process regression (VHGPR) algorithm was trained with simulations generated by the combined leaf-canopy reflectance model PROSAILat the BOA scale and further combined with the Second Simulation of a Satellite Signal in the Solar Spectrum (6SV) atmosphere model at the TOA scale. Established VHGPR models were then applied to S2 L1C and L2A reflectance data for mapping: leaf chlorophyll content (Cab ), leaf water content (Cw ), fractional vegetation coverage (FVC), leaf area index (LAI), and upscaled leaf biochemical compounds, i.e., LAI * Cab (laiCab) and LAI * Cw (laiCw). Estimated variables were validated using in situ reference data collected during the Munich-North-Isar field campaigns within growing seasons of maize and winter wheat in the years 2017 and 2018. For leaf biochemicals, retrieval from BOA reflectance slightly outperformed results from TOA reflectance, e.g., obtaining a root mean squared error (RMSE) of 6.5 μg/cm2 (BOA) vs. 8 μg/cm2 (TOA) in the case of Cab . For the majority of canopy-level variables, instead, estimation accuracy was higher when using TOA reflectance data, e.g., with an RMSE of 139 g/m2 (BOA) vs. 113 g/m2 (TOA) for laiCw. Derived maps were further compared against reference products obtained from the ESA Sentinel Application Platform (SNAP) Biophysical Processor. Altogether, the consistency between L1C and L2A retrievals confirmed that crop traits can potentially be estimated directly from TOA reflectance data. Successful mapping of canopy-level crop traits including information about prediction confidence suggests that the models can be transferred over spatial and temporal scales and, therefore, can contribute to decision-making processes for cropland management.

Estimation of leaf water content from hyperspectral data of different plant species by using three new spectral absorption indices

The leaf equivalent water thickness (EWT, g cm-2) and fuel moisture content (FMC, %) are key variables in ecological and environmental monitoring. Although a variety of hyperspectral vegetation indices have been developed to estimate the leaf EWT and FMC, most of these indices are defined considered two or three specific bands for a specific plant species, which limits their applicability. In this study, we proposed three new spectral absorption indices (SAI970, SAI1200, and SAI1660) for various plant types by considering the symmetry of the spectral absorption at 970 nm, 1200 nm and 1660 nm and spectral heterogeneity of different leaves. The indices were calculated considering the absorption peak and shoulder bands of each leaf instead of the same specific bands for all leaves. A pooled dataset of three tree species (camphor (VX), capricorn (VJ), and red-leaf plum (VL)) was used to test the performance of the SAIs in terms of the leaf EWT and FMC estimation. The results indicated that, first, SAI1200 was more suitable for estimating the EWT than FMC, whereas SAI970 and SAI1660 were more suitable for estimating the FMC. Second, SAI1200 achieved the most accurate estimation of the EWT with a cross-validation coefficient of determination (Rcv2) of 0.845 and relative cross-validation root mean square error (rRMSEcv) of 8.90%. Third, SAI1660 outperformed the other indices in estimating the FMC at the leaf level, with an Rcv2 of 0.637 and rRMSEcv of 8.56%. Fourth, SAI970 achieved a moderate accuracy in estimating the EWT (Rcv2 of 0.25 and rRMSEcv of 19.68%) and FMC (Rcv2 of 0.275 and rRMSEcv of 12.10%) at the leaf level. These results can enrich the application of the SAIs and demonstrate the potential of using SAI1200 to determine the leaf EWT and SAI1660 to obtain the leaf FMC among various plant types.

A Survey of Active Learning for Quantifying Vegetation Traits from Terrestrial Earth Observation Data

The current exponential increase of spatiotemporally explicit data streams from satellitebased Earth observation missions offers promising opportunities for global vegetation monitoring. Intelligent sampling through active learning (AL) heuristics provides a pathway for fast inference of essential vegetation variables by means of hybrid retrieval approaches, i.e., machine learning regression algorithms trained by radiative transfer model (RTM) simulations. In this study we summarize AL theory and perform a brief systematic literature survey about AL heuristics used in the context of Earth observation regression problems over terrestrial targets. Across all relevant studies it appeared that: (i) retrieval accuracy of AL-optimized training data sets outperformed models trained over large randomly sampled data sets, and (ii) Euclidean distance-based (EBD) diversity method tends to be the most efficient AL technique in terms of accuracy and computational demand. Additionally, a case study is presented based on experimental data employing both uncertainty and diversity AL criteria. Hereby, a a simulated training data base by the PROSAIL-PRO canopy RTM is used to demonstrate the benefit of AL techniques for the estimation of total leaf carotenoid content (Cxc ) and leaf water content (Cw ). Gaussian process regression (GPR) was incorporated to minimize and optimize the training data set with AL. Training the GPR algorithm on optimally AL-based sampled data sets led to improved variable retrievals compared to training on full data pools, which is further demonstrated on a mapping example. From these findings we can recommend the use of AL-based sub-sampling procedures to select the most informative samples out of large training data pools. This will not only optimize regression accuracy due to exclusion of redundant information, but also speed up processing time and reduce final model size of kernel-based machine learning regression algorithms, such as GPR. With this study we want to encourage further testing and implementation of AL sampling methods for hybrid retrieval workflows. AL can contribute to the solution of regression problems within the framework of operational vegetation monitoring using satellite imaging spectroscopy data, and may strongly facilitate data processing for cloud-computing platforms.

Retrieval of aboveground crop nitrogen content with a hybrid machine learning method

Hyperspectral acquisitions have proven to be the most informative Earth observation data source for the estimation of nitrogen (N) content, which is the main limiting nutrient for plant growth and thus agricultural production. In the past, empirical algorithms have been widely employed to retrieve information on this biochemical plant component from canopy reflectance. However, these approaches do not seek for a cause-effect relationship based on physical laws. Moreover, most studies solely relied on the correlation of chlorophyll content with nitrogen, and thus neglected the fact that most N is bound in proteins. Our study presents a hybrid retrieval method using a physically-based approach combined with machine learning regression to estimate crop N content. Within the workflow, the leaf optical properties model PROSPECT-PRO including the newly calibrated specific absorption coefficients (SAC) of proteins, was coupled with the canopy reflectance model 4SAIL to PROSAIL-PRO. The latter was then employed to generate a training database to be used for advanced probabilistic machine learning methods: a standard homoscedastic Gaussian process (GP) and a heteroscedastic GP regression that accounts for signal-to-noise relations. Both GP models have the property of providing confidence intervals for the estimates, which sets them apart from other machine learners. Moreover, a GP-based sequential backward band removal algorithm was employed to analyze the band-specific information content of PROSAIL-PRO simulated spectra for the estimation of aboveground N. Data from multiple hyperspectral field campaigns, carried out in the framework of the future satellite mission Environmental Mapping and Analysis Program (EnMAP), were exploited for validation. In these campaigns, corn and winter wheat spectra were acquired to simulate spectral EnMAP data. Moreover, destructive N measurements from leaves, stalks and fruits were collected separately to enable plant-organ-specific validation. The results showed that both GP models can provide accurate aboveground N simulations, with slightly better results of the heteroscedastic GP in terms of model testing and against in situ N measurements from leaves plus stalks, with root mean square error (RMSE) of 2.1 g/m2. However, the inclusion of fruit N content for validation deteriorated the results, which can be explained by the inability of the radiation to penetrate the thick tissues of stalks, corn cobs and wheat ears. GP-based band analysis identified optimal spectral settings with ten bands mainly situated in the shortwave infrared (SWIR) spectral region. Use of well-known protein absorption bands from the literature showed comparative results. Finally, the heteroscedastic GP model was successfully applied on airborne hyperspectral data for N mapping. We conclude that GP algorithms, and in particular the heteroscedastic GP, should be implemented for global agricultural monitoring of aboveground N from future imaging spectroscopy data.

Retrieval of aboveground crop nitrogen content with a hybrid machine learning method

Hyperspectral acquisitions have proven to be the most informative Earth observation data source for the estimation of nitrogen (N) content, which is the main limiting nutrient for plant growth and thus agricultural production. In the past, empirical algorithms have been widely employed to retrieve information on this biochemical plant component from canopy reflectance. However, these approaches do not seek for a cause-effect relationship based on physical laws. Moreover, most studies solely relied on the correlation of chlorophyll content with nitrogen, and thus neglected the fact that most N is bound in proteins. Our study presents a hybrid retrieval method using a physically-based approach combined with machine learning regression to estimate crop N content. Within the workflow, the leaf optical properties model PROSPECT-PRO including the newly calibrated specific absorption coefficients (SAC) of proteins, was coupled with the canopy reflectance model 4SAIL to PROSAIL-PRO. The latter was then employed to generate a training database to be used for advanced probabilistic machine learning methods: a standard homoscedastic Gaussian process (GP) and a heteroscedastic GP regression that accounts for signal-to-noise relations. Both GP models have the property of providing confidence intervals for the estimates, which sets them apart from other machine learners. Moreover, a GP-based sequential backward band removal algorithm was employed to analyze the band-specific information content of PROSAIL-PRO simulated spectra for the estimation of aboveground N. Data from multiple hyperspectral field campaigns, carried out in the framework of the future satellite mission Environmental Mapping and Analysis Program (EnMAP), were exploited for validation. In these campaigns, corn and winter wheat spectra were acquired to simulate spectral EnMAP data. Moreover, destructive N measurements from leaves, stalks and fruits were collected separately to enable plant-organ-specific validation. The results showed that both GP models can provide accurate aboveground N simulations, with slightly better results of the heteroscedastic GP in terms of model testing and against in situ N measurements from leaves plus stalks, with root mean square error (RMSE) of 2.1 g/m². However, the inclusion of fruit N content for validation deteriorated the results, which can be explained by the inability of the radiation to penetrate the thick tissues of stalks, corn cobs and wheat ears. GP-based band analysis identified optimal spectral settings with ten bands mainly situated in the shortwave infrared (SWIR) spectral region. Use of well-known protein absorption bands from the literature showed comparative results. Finally, the heteroscedastic GP model was successfully applied on airborne hyperspectral data for N mapping. We conclude that GP algorithms, and in particular the heteroscedastic GP, should be implemented for global agricultural monitoring of aboveground N from future imaging spectroscopy data.

Evaluation of Different Radiative Transfer Models for Microwave Backscatter Estimation of Wheat Fields

This study aimed to analyze existing microwave surface (Oh, Dubois, Water Cloud Model “WCM”, Integral Equation Model “IEM”) and canopy (Water Cloud Model “WCM”, Single Scattering Radiative Transfer “SSRT”) Radiative Transfer (RT) models and assess advantages and disadvantages of different model combinations in terms of VV polarized radar backscatter simulation of wheat fields. The models are driven with field measurements acquired in 2017 at a test site near Munich, Germany. As vegetation descriptor for the canopy models Leaf Area Index (LAI) was used. The effect of empirical model parameters is evaluated in two different ways: (a) empirical model parameters are set as static throughout the whole time series of one growing season and (b) empirical model parameters describing the backscatter attenuation by the canopy are treated as non-static in time. The model results are compared to a dense Sentinel-1 C-band time series with observations every 1.5 days. The utilized Sentinel-1 time series comprises images acquired with different satellite acquisition geometries (different incidence and azimuth angles), which allows us to evaluate the model performance for different acquisition geometries. Results show that total LAI as vegetation descriptor in combination with static empirical parameters fit Sentinel-1 radar backscatter of wheat fields only sufficient within the first half of the vegetation period. With the saturation of LAI and/or canopy height of the wheat fields, the observed increase in Sentinel-1 radar backscatter cannot be modeled. Probable cause are effects of changes within the grains (both structure and water content per leaf area) and their influence on the backscatter. However, model results with LAI and non-static empirical parameters fit the Sentinel-1 data well for the entire vegetation period. Limitations regarding different satellite acquisition geometries become apparent for the second half of the vegetation period. The observed overall increase in backscatter can be modeled, but a trend mismatch between modeled and observed backscatter values of adjacent time points with different acquisition geometries is observed.

Quantifying the Robustness of Vegetation Indices through Global Sensitivity Analysis of Homogeneous and Forest Leaf-Canopy Radiative Transfer Models

Vegetation indices (VIs) are widely used in optical remote sensing to estimate biophysical variables of vegetated surfaces. With the advent of spectroscopy technology, spectral bands can be combined in numerous ways to extract the desired information. This resulted in a plethora of proposed indices, designed for a diversity of applications and research purposes. However, it is not always clear whether they are sensitive to the variable of interest while at the same time, responding insensitive to confounding factors. Hence, to be able to quantify the robustness of VIs, a systematic evaluation is needed, thereby introducing a widest possible variety of biochemical and structural heterogeneity. Such exercise can be achieved with coupled leaf and canopy radiative transfer models (RTMs), whereby input variables can virtually simulate any vegetation scenario. With the intention of evaluating multiple VIs in an efficient way, this led us to the development of a global sensitivity analysis (GSA) toolbox dedicated to the analysis of VIs on their sensitivity towards RTM input variables. We identified VIs that are designed to be sensitive towards leaf chlorophyll content (LCC), leaf water content (LWC) and leaf area index (LAI) for common sensors of terrestrial Earth observation satellites: Landsat 8, MODIS, Sentinel-2, Sentinel-3 and the upcoming imaging spectrometer mission EnMAP. The coupled RTMs PROSAIL and PROINFORM were used for simulations of homogeneous and forest canopies respectively. GSA total sensitivity results suggest that LCC-sensitive indices respond most robust: for the great majority of scenarios, chlorophyll a + b content (Cab) drives between 75% and 82% of the indices' variability. LWC-sensitive indices were most affected by confounding variables such as Cab and LAI, although the equivalent water thickness (Cw) can drive between 25% and 50% of the indices' variability. Conversely, the majority of LAI-sensitive indices are not only sensitive to LAI but rather to a mixture of structural and biochemical variables.

Fitted PROSAIL Parameterization of Leaf Inclinations, Water Content and Brown Pigment Content for Winter Wheat and Maize Canopies

Decades after release of the first PROSPECT + SAIL (commonly called PROSAIL) versions, the model is still the most famous representative in the field of canopy reflectance modelling and has been widely used to obtain plant biochemical and structural variables, particularly in the agricultural context. The performance of the retrieval is usually assessed by quantifying the distance between the estimated and the in situ measured variables. While this has worked for hundreds of studies that obtained canopy density as a one-sided Leaf Area Index (LAI) or pigment content, little is known about the role of the canopy geometrical properties specified as the Average Leaf Inclination Angle (ALIA). In this study, we exploit an extensive field dataset, including narrow-band field spectra, leaf variables and canopy properties recorded in seven individual campaigns for winter wheat (4x) and silage maize (3x). PROSAIL outputs generally did not represent field spectra well, when in situ variables served as input for the model. A manual fitting of ALIA and leaf water (EWT) revealed significant deviations for both variables (RMSE = 14.5°, 0.020 cm) and an additional fitting of the brown leaf pigments (Cbrown) was necessary to obtain matching spectra at the near infrared (NIR) shoulder. Wheat spectra tend to be underestimated by the model until the emergence of inflorescence when PROSAIL begins to overestimate crop reflectance. This seasonal pattern could be attributed to an attenuated development of ALIAopt compared to in situ measured ALIA. Segmentation of nadir images of wheat was further used to separate spectral contributors into dark background, ears and leaves + stalks. It could be shown that the share of visible fruit ears from nadir view correlates positively with the deviations between field spectral measurement and PROSAIL spectral outputs (R² = 0.78 for aggregation by phenological stages), indicating that retrieval errors increase for ripening stages. An appropriate model parameterization is recommended to assure accurate retrievals of biophysical and biochemical products of interest. The interpretation of inverted ALIA as physical leaf inclinations is considered unfeasible and we argue in favour of treating it as a free calibration parameter.