Effects of Heterogeneity within Tree Crowns on Airborne-Quantified SIF and the CWSI as Indicators of Water Stress in the Context of Precision Agriculture

Automatic Crop Canopy Temperature Measurement Using a Low-Cost Image-Based Thermal Sensor: Application in a Pomegranate Orchard under a Permanent Shade Net House

Water scarcity in arid and semi-arid areas has led to the development of regulated deficit irrigation (RDI) strategies on most species of fruit trees in order to improve water productivity. For a successful implementation, these strategies require continuous feedback of the soil and crop water status. This feedback is provided by physical indicators from the soil-plant-atmosphere continuum, as is the case of the crop canopy temperature, which can be used for the indirect estimation of crop water stress. Infrared Radiometers (IRs) are considered as the reference tool for temperature-based water status monitoring in crops. Alternatively, in this paper, we assess the performance of a low-cost thermal sensor based on thermographic imaging technology for the same purpose. The thermal sensor was tested in field conditions by performing continuous measurements on pomegranate trees (Punica granatum L. 'Wonderful') and was compared with a commercial IR. A strong correlation (R² = 0.976) between the two sensors was obtained, demonstrating the suitability of the experimental thermal sensor to monitor the crop canopy temperature for irrigation management.

Proximal and remote sensing in plant phenomics: 20 years of progress, challenges, and perspectives

Plant phenomics (PP) has been recognized as a bottleneck in studying the interactions of genomics and environment on plants, limiting the progress of smart breeding and precise cultivation. High-throughput plant phenotyping is challenging owing to the spatio-temporal dynamics of traits. Proximal and remote sensing (PRS) techniques are increasingly used for plant phenotyping because of their advantages in multi-dimensional data acquisition and analysis. Substantial progress of PRS applications in PP has been observed over the last two decades and is analyzed here from an interdisciplinary perspective based on 2972 publications. This progress covers most aspects of PRS application in PP, including patterns of global spatial distribution and temporal dynamics, specific PRS technologies, phenotypic research fields, working environments, species, and traits. Subsequently, we demonstrate how to link PRS to multi-omics studies, including how to achieve multi-dimensional PRS data acquisition and processing, how to systematically integrate all kinds of phenotypic information and derive phenotypic knowledge with biological significance, and how to link PP to multi-omics association analysis. Finally, we identify three future perspectives for PRS-based PP: (1) strengthening the spatial and temporal consistency of PRS data, (2) exploring novel phenotypic traits, and (3) facilitating multi-omics communication.

Multi-sensor spectral synergies for crop stress detection and monitoring in the optical domain: A review

Remote detection and monitoring of the vegetation responses to stress became relevant for sustainable agriculture. Ongoing developments in optical remote sensing technologies have provided tools to increase our understanding of stress-related physiological processes. Therefore, this study aimed to provide an overview of the main spectral technologies and retrieval approaches for detecting crop stress in agriculture. Firstly, we present integrated views on: i) biotic and abiotic stress factors, the phases of stress, and respective plant responses, and ii) the affected traits, appropriate spectral domains and corresponding methods for measuring traits remotely. Secondly, representative results of a systematic literature analysis are highlighted, identifying the current status and possible future trends in stress detection and monitoring. Distinct plant responses occurring under shortterm, medium-term or severe chronic stress exposure can be captured with remote sensing due to specific light interaction processes, such as absorption and scattering manifested in the reflected radiance, i.e. visible (VIS), near infrared (NIR), shortwave infrared, and emitted radiance, i.e. solar-induced fluorescence and thermal infrared (TIR). From the analysis of 96 research papers, the following trends can be observed: increasing usage of satellite and unmanned aerial vehicle data in parallel with a shift in methods from simpler parametric approaches towards more advanced physically-based and hybrid models. Most study designs were largely driven by sensor availability and practical economic reasons, leading to the common usage of VIS-NIR-TIR sensor combinations. The majority of reviewed studies compared stress proxies calculated from single-source sensor domains rather than using data in a synergistic way. We identified new ways forward as guidance for improved synergistic usage of spectral domains for stress detection: (1) combined acquisition of data from multiple sensors for analysing multiple stress responses simultaneously (holistic view); (2) simultaneous retrieval of plant traits combining multi-domain radiative transfer models and machine learning methods; (3) assimilation of estimated plant traits from distinct spectral domains into integrated crop growth models. As a future outlook, we recommend combining multiple remote sensing data streams into crop model assimilation schemes to build up Digital Twins of agroecosystems, which may provide the most efficient way to detect the diversity of environmental and biotic stresses and thus enable respective management decisions.

Detection of Xylella fastidiosa in almond orchards by synergic use of an epidemic spread model and remotely sensed plant traits

The early detection of Xylella fastidiosa (Xf) infections is critical to the management of this dangerous plan pathogen across the world. Recent studies with remote sensing (RS) sensors at different scales have shown that Xf-infected olive trees have distinct spectral features in the visible and infrared regions (VNIR). However, further work is needed to integrate remote sensing in the management of plant disease epidemics. Here, we research how the spectral changes picked up by different sets of RS plant traits (i.e., pigments, structural or leaf protein content), can help capture the spatial dynamics of Xf spread. We coupled a spatial spread model with the probability of Xf-infection predicted by a RS-driven support vector machine (RS-SVM) model. Furthermore, we analyzed which RS plant traits contribute most to the output of the prediction models. For that, in almond orchards affected by Xf (n = 1426 trees), we conducted a field campaign simultaneously with an airborne campaign to collect high-resolution thermal images and hyperspectral images in the visible-near-infrared (VNIR, 400-850 nm) and short-wave infrared regions (SWIR, 950-1700 nm). The best performing RS-SVM model (OA = 75%; kappa = 0.50) included as predictors leaf protein content, nitrogen indices (NIs), fluorescence and a thermal indicator (Tc), alongside pigments and structural parameters. Leaf protein content together with NIs contributed 28% to the explanatory power of the model, followed by chlorophyll (22%), structural parameters (LAI and LIDFa), and chlorophyll indicators of photosynthetic efficiency. Coupling the RS model with an epidemic spread model increased the accuracy (OA = 80%; kappa = 0.48). In the almond trees where the presence of Xf was assayed by qPCR (n = 318 trees), the combined RS-spread model yielded an OA of 71% and kappa = 0.33, which is higher than the RS-only model and visual inspections (both OA = 64-65% and kappa = 0.26-31). Our work demonstrates how combining spatial epidemiological models and remote sensing can lead to highly accurate predictions of plant disease spatial distribution.

Evaluation of the FluorWPS Model and Study of the Parameter Sensitivity for Simulating Solar-Induced Chlorophyll Fluorescence

Solar-induced chlorophyll fluorescence (SIF) has been used as an indicator for the photosynthetic activity of vegetation at regional and global scales. Canopy structure affects the radiative transfer process of SIF within canopy and causes the angular-dependencies of SIF. A common solution for interpreting these effects is the use of physically-based radiative transfer models. As a first step, a comprehensive evaluation of the three-dimensional (3D) radiative transfers is needed using ground truth biological and hyperspectral remote sensing measurements. Due to the complexity of forest modeling, few studies have systematically investigated the effect of canopy structural factors and sun-target-viewing geometry on SIF. In this study, we evaluated the capability of the Fluorescence model with the Weighted Photon Spread method (FluorWPS) to simulate at-sensor radiance and SIF at the top of canopy, and identified the influence of the canopy structural factors and sun-target-viewing geometry on the magnitude and directional response of SIF in deciduous forests. To evaluate the model, a 3D forest scene was first constructed from Goddard’s LiDAR Hyperspectral and Thermal (G-LiHT) LiDAR data. The reliability of the reconstructed scene was confirmed by comparing the calculated leaf area index with the measured ones from the scene, which resulted in a relative error of 3.5%. Then, the performance of FluorWPS was evaluated by comparing the simulated at-sensor radiance spectra with the spectra measured from the DUAL and FLUO spectrometer of HyPlant. The radiance spectra simulated by FluorWPS agreed well with the measured spectra by the two high-performance imaging spectrometers, with a coefficient of determination (R2) of 0.998 and 0.926, respectively. SIF simulated by the FluorWPS model agreed well with the values of the DART model. Furthermore, a sensitivity analysis was conducted to assess the effect of the canopy structural parameters and sun-target-viewing geometry on SIF. The maximum difference of the total SIF can be as large as 45% and 47% at the wavelengths of 685 nm and 740 nm for different foliage area volume densities (FAVDs), and 48% and 46% for fractional vegetation covers (FVCs), respectively. Leaf angle distribution has a markedly influence on the magnitude of SIF, with a ratio of emission part to SIF range from 0.48 to 0.72. SIF from the grass layer under the tree contributed 10%+ more to the top of canopy SIF even for a dense forest canopy (FAVD = 3.5 m−1, FVC = 76%). The red SIF at the wavelength of 685 nm had a similar shape to the far-red SIF at a wavelength of 740 nm but with higher variability in varying illumination conditions. The integration of the FluorWPS model and LiDAR modeling can greatly improve the interpretation of SIF at different scales and angular configurations.

A Neural Network Method for Classification of Sunlit and Shaded Components of Wheat Canopies in the Field Using High-Resolution Hyperspectral Imagery

(1) Background: Information rich hyperspectral sensing, together with robust image analysis, is providing new research pathways in plant phenotyping. This combination facilitates the acquisition of spectral signatures of individual plant organs as well as providing detailed information about the physiological status of plants. Despite the advances in hyperspectral technology in field-based plant phenotyping, little is known about the characteristic spectral signatures of shaded and sunlit components in wheat canopies. Non-imaging hyperspectral sensors cannot provide spatial information; thus, they are not able to distinguish the spectral reflectance differences between canopy components. On the other hand, the rapid development of high-resolution imaging spectroscopy sensors opens new opportunities to investigate the reflectance spectra of individual plant organs which lead to the understanding of canopy biophysical and chemical characteristics. (2) Method: This study reports the development of a computer vision pipeline to analyze ground-acquired imaging spectrometry with high spatial and spectral resolutions for plant phenotyping. The work focuses on the critical steps in the image analysis pipeline from pre-processing to the classification of hyperspectral images. In this paper, two convolutional neural networks (CNN) are employed to automatically map wheat canopy components in shaded and sunlit regions and to determine their specific spectral signatures. The first method uses pixel vectors of the full spectral features as inputs to the CNN model and the second method integrates the dimension reduction technique known as linear discriminate analysis (LDA) along with the CNN to increase the feature discrimination and improves computational efficiency. (3) Results: The proposed technique alleviates the limitations and lack of separability inherent in existing pre-defined hyperspectral classification methods. It optimizes the use of hyperspectral imaging and ensures that the data provide information about the spectral characteristics of the targeted plant organs, rather than the background. We demonstrated that high-resolution hyperspectral imagery along with the proposed CNN model can be powerful tools for characterizing sunlit and shaded components of wheat canopies in the field. The presented method will provide significant advances in the determination and relevance of spectral properties of shaded and sunlit canopy components under natural light conditions.

Leveraging Very-High Spatial Resolution Hyperspectral and Thermal UAV Imageries for Characterizing Diurnal Indicators of Grapevine Physiology

Efficient and accurate methods to monitor crop physiological responses help growers better understand crop physiology and improve crop productivity. In recent years, developments in unmanned aerial vehicles (UAV) and sensor technology have enabled image acquisition at very-high spectral, spatial, and temporal resolutions. However, potential applications and limitations of very-high-resolution (VHR) hyperspectral and thermal UAV imaging for characterization of plant diurnal physiology remain largely unknown, due to issues related to shadow and canopy heterogeneity. In this study, we propose a canopy zone-weighting (CZW) method to leverage the potential of VHR (≤9 cm) hyperspectral and thermal UAV imageries in estimating physiological indicators, such as stomatal conductance (Gs) and steady-state fluorescence (Fs). Diurnal flights and concurrent in-situ measurements were conducted during grapevine growing seasons in 2017 and 2018 in a vineyard in Missouri, USA. We used neural net classifier and the Canny edge detection method to extract pure vine canopy from the hyperspectral and thermal images, respectively. Then, the vine canopy was segmented into three canopy zones (sunlit, nadir, and shaded) using K-means clustering based on the canopy shadow fraction and canopy temperature. Common reflectance-based spectral indices, sun-induced chlorophyll fluorescence (SIF), and simplified canopy water stress index (siCWSI) were computed as image retrievals. Using the coefficient of determination (R2) established between the image retrievals from three canopy zones and the in-situ measurements as a weight factor, weighted image retrievals were calculated and their correlation with in-situ measurements was explored. The results showed that the most frequent and the highest correlations were found for Gs and Fs, with CZW-based Photochemical reflectance index (PRI), SIF, and siCWSI (PRICZW, SIFCZW, and siCWSICZW), respectively. When all flights combined for the given field campaign date, PRICZW, SIFCZW, and siCWSICZW significantly improved the relationship with Gs and Fs. The proposed approach takes full advantage of VHR hyperspectral and thermal UAV imageries, and suggests that the CZW method is simple yet effective in estimating Gs and Fs.

Unmanned Aerial Systems (UAS)-Based Methods for Solar Induced Chlorophyll Fluorescence (SIF) Retrieval with Non-Imaging Spectrometers: State of the Art

Chlorophyll fluorescence (ChlF) information offers a deep insight into the plant physiological status by reason of the close relationship it has with the photosynthetic activity. The unmanned aerial systems (UAS)-based assessment of solar induced ChlF (SIF) using non-imaging spectrometers and radiance-based retrieval methods, has the potential to provide spatio-temporal photosynthetic performance information at field scale. The objective of this manuscript is to report the main advances in the development of UAS-based methods for SIF retrieval with non-imaging spectrometers through the latest scientific contributions, some of which are being developed within the frame of the Training on Remote Sensing for Ecosystem Modelling (TRuStEE) program. Investigations from the Universities of Edinburgh (School of Geosciences) and Tasmania (School of Technology, Environments and Design) are first presented, both sharing the principle of the spectroradiometer optical path bifurcation throughout, the so called ‘Piccolo-Doppio’ and ‘AirSIF’ systems, respectively. Furthermore, JB Hyperspectral Devices’ ongoing investigations towards the closest possible characterization of the atmospheric interference suffered by orbital platforms are outlined. The latest approach focuses on the observation of one single ground point across a multiple-kilometer atmosphere vertical column using the high altitude UAS named as AirFloX, mounted on a specifically designed and manufactured fixed wing platform: ‘FloXPlane’. We present technical details and preliminary results obtained from each instrument, a summary of their main characteristics, and finally the remaining challenges and open research questions are addressed. On the basis of the presented findings, the consensus is that SIF can be retrieved from low altitude spectroscopy. However, the UAS-based methods for SIF retrieval still present uncertainties associated with the current sensor characteristics and the spatio-temporal mismatching between aerial and ground measurements, which complicate robust validations. Complementary studies regarding the standardization of calibration methods and the characterization of spectroradiometers and data processing workflows are also required. Moreover, other open research questions such as those related to the implementation of atmospheric correction, bidirectional reflectance distribution function (BRDF) correction, and accurate surface elevation models remain to be addressed.

Review of Top-of-Canopy Sun-Induced Fluorescence (SIF) Studies from Ground, UAV, Airborne to Spaceborne Observations

Remote sensing (RS) of sun-induced fluorescence (SIF) has emerged as a promising indicator of photosynthetic activity and related stress from the leaf to the ecosystem level. The implementation of modern RS technology on SIF is highly motivated by the direct link of SIF to the core of photosynthetic machinery. In the last few decades, a lot of studies have been conducted on SIF measurement techniques, retrieval algorithms, modeling, application, validation, and radiative transfer processes, incorporating different RS observations (i.e., ground, unmanned aerial vehicle (UAV), airborne, and spaceborne). These studies have made a significant contribution to the enrichment of SIF science over time. However, to realize the potential of SIF and to explore its full spectrum using different RS observations, a complete document of existing SIF studies is needed. Considering this gap, we have performed a detailed review of current SIF studies from the ground, UAV, airborne, and spaceborne observations. In this review, we have discussed the in-depth interpretation of each SIF study using four RS platforms. The limitations and challenges of SIF studies have also been discussed to motivate future research and subsequently overcome them. This detailed review of SIF studies will help, support, and inspire the researchers and application-based users to consider SIF science with confidence.

Terrestrial and Remote Indexes to Assess Moderate Deficit Irrigation in Early-Maturing Nectarine Trees

Monitoring plant water status is relevant for the sustainable management ofirrigation under water deficit conditions. Two treatments were applied to an early-maturingnectarine orchard: control (well irrigated) and precise deficit irrigation (PDI, based on soilwater content thresholds). Moderate water deficits generated by PDI were assessed bycomparing terrestrial: stem water potential (Ψstem) and gas exchange parameters, with remote:canopy temperature, normalized difference vegetation (NDVI), and soil adjusted vegetationindex (SAVI), plant water status indicators. The Ψstem was the only indicator that showedsignificant differences between treatments. NDVI and SAVI at the postharvest period wereappropriate indexes for estimating winter pruning, although they did not serve well as plantstress indicator. Vapor pressure deficit along with Ψstem values were able to predict remotesensing data. Ψstem and canopy to air temperature difference values registered the highestsignal intensity and NDVI the highest sensitivity for detecting water deficit situations. Theresults suggest that care should be taken when using instantaneous remote indicators toevaluate moderate water deficits in deciduous fruit trees; more severe/longer water stressconditions are probably needed. The proposed PDI strategy promoted water saving whilemaintaining yield, and could be considered a promising tool for semi-arid agrosystems.

Phenotyping Plant Responses to Biotic Stress by Chlorophyll Fluorescence Imaging

Photosynthesis is a pivotal process in plant physiology, and its regulation plays an important role in plant defense against biotic stress. Interactions with pathogens and pests often cause alterations in the metabolism of sugars and sink/source relationships. These changes can be part of the plant defense mechanisms to limit nutrient availability to the pathogens. In other cases, these alterations can be the result of pests manipulating the plant metabolism for their own benefit. The effects of biotic stress on plant physiology are typically heterogeneous, both spatially and temporarily. Chlorophyll fluorescence imaging is a powerful tool to mine the activity of photosynthesis at cellular, leaf, and whole-plant scale, allowing the phenotyping of plants. This review will recapitulate the responses of the photosynthetic machinery to biotic stress factors, from pathogens (viruses, bacteria, and fungi) to pests (herbivory) analyzed by chlorophyll fluorescence imaging both at the lab and field scale. Moreover, chlorophyll fluorescence imagers and alternative techniques to indirectly evaluate photosynthetic traits used at field scale are also revised.

Automatic Wheat Ear Counting Using Thermal Imagery

Ear density is one of the most important agronomical yield components in wheat. Ear counting is time-consuming and tedious as it is most often conducted manually in field conditions. Moreover, different sampling techniques are often used resulting in a lack of standard protocol, which may eventually affect inter-comparability of results. Thermal sensors capture crop canopy features with more contrast than RGB sensors for image segmentation and classification tasks. An automatic thermal ear counting system is proposed to count the number of ears using zenithal/nadir thermal images acquired from a moderately high resolution handheld thermal camera. Three experimental sites under different growing conditions in Spain were used on a set of 24 varieties of durum wheat for this study. The automatic pipeline system developed uses contrast enhancement and filter techniques to segment image regions detected as ears. The approach is based on the temperature differential between the ears and the rest of the canopy, given that ears usually have higher temperatures due to their lower transpiration rates. Thermal images were acquired, together with RGB images and in situ (i.e., directly in the plot) visual ear counting from the same plot segment for validation purposes. The relationship between the thermal counting values and the in situ visual counting was fairly weak (R2 = 0.40), which highlights the difficulties in estimating ear density from one single image-perspective. However, the results show that the automatic thermal ear counting system performed quite well in counting the ears that do appear in the thermal images, exhibiting high correlations with the manual image-based counts from both thermal and RGB images in the sub-plot validation ring (R2 = 0.75–0.84). Automatic ear counting also exhibited high correlation with the manual counting from thermal images when considering the complete image (R2 = 0.80). The results also show a high correlation between the thermal and the RGB manual counting using the validation ring (R2 = 0.83). Methodological requirements and potential limitations of the technique are discussed.

Dual Activation Function-Based Extreme Learning Machine (ELM) for Estimating Grapevine Berry Yield and Quality

Reliable assessment of grapevine productivity is a destructive and time-consuming process. In addition, the mixed effects of grapevine water status and scion-rootstock interactions on grapevine productivity are not always linear. Despite the potential opportunity of applying remote sensing and machine learning techniques to predict plant traits, there are still limitations to previously studied techniques for vine productivity due to the complexity of the system not being adequately modeled. During the 2014 and 2015 growing seasons, hyperspectral reflectance spectra were collected using a handheld spectroradiometer in a vineyard designed to investigate the effects of irrigation level (0%, 50%, and 100%) and rootstocks (1103 Paulsen, 3309 Couderc, SO4 and Chambourcin) on vine productivity. To assess vine productivity, it is necessary to measure factors related to fruit ripeness and not just yield, as an over cropped vine may produce high-yield but poor-quality fruit. Therefore, yield, Total Soluble Solids (TSS), Titratable Acidity (TA) and the ratio TSS/TA (maturation index, IMAD) were measured. A total of 20 vegetation indices were calculated from hyperspectral data and used as input for predictive model calibration. Prediction performance of linear/nonlinear multiple regression methods and Weighted Regularized Extreme Learning Machine (WRELM) were compared with our newly developed WRELM-TanhRe. The developed method is based on two activation functions: hyperbolic tangent (Tanh) and rectified linear unit (ReLU). The results revealed that WRELM and WRELM-TanhRe outperformed the widely used multiple regression methods when model performance was tested with an independent validation dataset. WRELM-TanhRe produced the highest prediction accuracy for all the berry yield and quality parameters (R2 of 0.522–0.682 and RMSE of 2–15%), except for TA, which was predicted best with WRELM (R2 of 0.545 and RMSE of 6%). The results demonstrate the value of combining hyperspectral remote sensing and machine learning methods for improving of berry yield and quality prediction.

Monitoring Crop Evapotranspiration and Crop Coefficients over an Almond and Pistachio Orchard Throughout Remote Sensing

In California, water is a perennial concern. As competition for water resources increases due to growth in population, California’s tree nut farmers are committed to improving the efficiency of water used for food production. There is an imminent need to have reliable methods that provide information about the temporal and spatial variability of crop water requirements, which allow farmers to make irrigation decisions at field scale. This study focuses on estimating the actual evapotranspiration and crop coefficients of an almond and pistachio orchard located in Central Valley (California) during an entire growing season by combining a simple crop evapotranspiration model with remote sensing data. A dataset of the vegetation index NDVI derived from Landsat-8 was used to facilitate the estimation of the basal crop coefficient (Kcb), or potential crop water use. The soil water evaporation coefficient (Ke) was measured from microlysimeters. The water stress coefficient (Ks) was derived from airborne remotely sensed canopy thermal-based methods, using seasonal regressions between the crop water stress index (CWSI) and stem water potential (Ψstem). These regressions were statistically-significant for both crops, indicating clear seasonal differences in pistachios, but not in almonds. In almonds, the estimated maximum Kcb values ranged between 1.05 to 0.90, while for pistachios, it ranged between 0.89 to 0.80. The model indicated a difference of 97 mm in transpiration over the season between both crops. Soil evaporation accounted for an average of 16% and 13% of the total actual evapotranspiration for almonds and pistachios, respectively. Verification of the model-based daily crop evapotranspiration estimates was done using eddy-covariance and surface renewal data collected in the same orchards, yielding an R2 ≥ 0.7 and average root mean square errors (RMSE) of 0.74 and 0.91 mm·day−1 for almond and pistachio, respectively. It is concluded that the combination of crop evapotranspiration models with remotely-sensed data is helpful for upscaling irrigation information from plant to field scale and thus may be used by farmers for making day-to-day irrigation management decisions.