Thermal Imaging for Plant Stress Detection and Phenotyping

Noninvasive Abiotic Stress Phenotyping of Vascular Plant in Each Vegetative Organ View

The last decades have witnessed a rapid development of noninvasive plant phenotyping, capable of detecting plant stress scale levels from the subcellular to the whole population scale. However, even with such a broad range, most phenotyping objects are often just concerned with leaves. This review offers a unique perspective of noninvasive plant stress phenotyping from a multi-organ view. First, plant sensing and responding to abiotic stress from the diverse vegetative organs (leaves, stems, and roots) and the interplays between these vital components are analyzed. Then, the corresponding noninvasive optical phenotyping techniques are also provided, which can prompt the practical implementation of appropriate noninvasive phenotyping techniques for each organ. Furthermore, we explore methods for analyzing compound stress situations, as field conditions frequently encompass multiple abiotic stressors. Thus, our work goes beyond the conventional approach of focusing solely on individual plant organs. The novel insights of the multi-organ, noninvasive phenotyping study provide a reference for testing hypotheses concerning the intricate dynamics of plant stress responses, as well as the potential interactive effects among various stressors.

Modern phenomics to empower holistic crop science, agronomy, and breeding research

Crop phenomics enables the collection of diverse plant traits for a large number of samples along different time scales, representing a greater data collection throughput compared with traditional measurements. Most modern crop phenomics use different sensors to collect reflective, emitted, and fluorescence signals, etc., from plant organs at different spatial and temporal resolutions. Such multi-modal, high-dimensional data not only accelerates basic research on crop physiology, genetics, and whole plant systems modeling, but also supports the optimization of field agronomic practices, internal environments of plant factories, and ultimately crop breeding. Major challenges and opportunities facing the current crop phenomics research community include developing community consensus or standards for data collection, management, sharing, and processing, developing capabilities to measure physiological parameters, and enabling farmers and breeders to effectively use phenomics in the field to directly support agricultural production.

Infrared Thermography Monitoring of Durum and Common Wheat for Adaptability Assessing and Yield Performance Prediction

Wheat is one of the most cultivated cereals thanks to both its nutritional value and its versatility to technological transformation. Nevertheless, the growth and yield of wheat, as well as of the other food crops, can be strongly limited by many abiotic and biotic stress factors. To face this need, new methodological approaches are required to optimize wheat cultivation from both a qualitative and quantitative point of view. In this context, crop analysis based on imaging techniques has become an important tool in agriculture. Thermography is an appealing method that represents an outstanding approach in crop monitoring, as it is well suited to the emerging needs of the precision agriculture management strategies. In this work, we performed an on-field infrared monitoring of several durum and common wheat varieties to evaluate their adaptability to the internal Mediterranean area chosen for cultivation. Two new indices based on the thermal data useful to estimate the agronomical response of wheat subjected to natural stress conditions during different phenological stages of growth have been introduced. The comparison with some productive parameters collected at harvest highlighted the correlation of the indices with the wheat yield (ranging between p < 0.001 and p < 0.05), providing interesting information for their early prediction.

AI-assisted image analysis and physiological validation for progressive drought detection in a diverse panel of Gossypium hirsutum L

Introduction

Drought detection, spanning from early stress to severe conditions, plays a crucial role in maintaining productivity, facilitating recovery, and preventing plant mortality. While handheld thermal cameras have been widely employed to track changes in leaf water content and stomatal conductance, research on thermal image classification remains limited due mainly to low resolution and blurry images produced by handheld cameras.

Methods

In this study, we introduce a computer vision pipeline to enhance the significance of leaf-level thermal images across 27 distinct cotton genotypes cultivated in a greenhouse under progressive drought conditions. Our approach involved employing a customized software pipeline to process raw thermal images, generating leaf masks, and extracting a range of statistically relevant thermal features (e.g., min and max temperature, median value, quartiles, etc.). These features were then utilized to develop machine learning algorithms capable of assessing leaf hydration status and distinguishing between well-watered (WW) and dry-down (DD) conditions.

Results

Two different classifiers were trained to predict the plant treatment-random forest and multilayer perceptron neural networks-finding 75% and 78% accuracy in the treatment prediction, respectively. Furthermore, we evaluated the predicted versus true labels based on classic physiological indicators of drought in plants, including volumetric soil water content, leaf water potential, and chlorophyll a fluorescence, to provide more insights and possible explanations about the classification outputs.

Discussion

Interestingly, mislabeled leaves mostly exhibited notable responses in fluorescence, water uptake from the soil, and/or leaf hydration status. Our findings emphasize the potential of AI-assisted thermal image analysis in enhancing the informative value of common heterogeneous datasets for drought detection. This application suggests widening the experimental settings to be used with deep learning models, designing future investigations into the genotypic variation in plant drought response and potential optimization of water management in agricultural settings.

Herbicide Bioassay Using a Multi-Well Plate and Plant Spectral Image Analysis

A spectral image analysis has the potential to replace traditional approaches for assessing plant responses to different types of stresses, including herbicides, through non-destructive and high-throughput screening (HTS). Therefore, this study was conducted to develop a rapid bioassay method using a multi-well plate and spectral image analysis for the diagnosis of herbicide activity and modes of action. Crabgrass (Digitaria ciliaris), as a model weed, was cultivated in multi-well plates and subsequently treated with six herbicides (paraquat, tiafenacil, penoxsulam, isoxaflutole, glufosinate, and glyphosate) with different modes of action when the crabgrass reached the 1-leaf stage, using only a quarter of the recommended dose. To detect the plant's response to herbicides, plant spectral images were acquired after herbicide treatment using RGB, infrared (IR) thermal, and chlorophyll fluorescence (CF) sensors and analyzed for diagnosing herbicide efficacy and modes of action. A principal component analysis (PCA), using all spectral data, successfully distinguished herbicides and clustered depending on their modes of action. The performed experiments showed that the multi-well plate assay combined with a spectral image analysis can be successfully applied for herbicide bioassays. In addition, the use of spectral image sensors, especially CF images, would facilitate HTS by enabling the rapid observation of herbicide responses at as early as 3 h after herbicide treatment.

Water Deficit Diagnosis of Winter Wheat Based on Thermal Infrared Imaging

Field experiments were conducted to analyze the effectiveness of the crop stress index (CWSI) obtained by infrared thermal imaging to indicate crop water status, and to determine the appropriate CWSI threshold range for wheat at different growth stages. The results showed that the sensitivity of plant physiological parameters to soil water was different at different growth stages. The sensitivity of stomatal conductance (Gs) and transpiration rate (Tr) to soil water was higher than that of leaf relative water content (LRWC) and photosynthetic rate (Pn). The characteristics of plant physiology and biomass (yield) at each growth stage showed that the plant production would not suffer from drought stress as long as the soil water content (SWC) was maintained above 57.0% of the field water capacity (FWC) during the jointing stage, 63.0% of the FWC during the flowering stage and 60.0% of the FWC during the filling stage. Correlation analysis showed that the correlation of CWSI with Gs, Tr and Pn was lower than that with LRWC and SWC at the jointing stage. CWSI was extremely significantly negatively correlated with SWC and LRWC (p < 0.01), but significantly negatively correlated with Gs, Tr and Pn (p < 0.05). At the flowering stage, CWSI was extremely significantly negatively correlated with all physiological and soil parameters (p < 0.01). The regression analysis showed that the CWSI of winter wheat was correlated with biomass (grain yield) in a curvilinear relationship at each growth stage. When the CWSI increased to a certain extent, the biomass and yield showed a decreasing trend with the increase in CWSI. Comprehensive analysis of all indexes showed that CWSI can be used as a decision-making index to guide the water-saving irrigation of winter wheat, as long as the CWSI threshold of plants was maintained at 0.26-0.38 during the jointing stage, 0.27-0.32 during the flowering stage and 0.30-0.36 during the filling stage, which could not only avoid the adverse effects of water stress on crop production, but also achieve the purpose of water saving.

Can Grapevine Leaf Water Potential Be Modelled from Physiological and Meteorological Variables? A Machine Learning Approach

Climate change is affecting global viticulture, increasing heatwaves and drought. Precision irrigation, supported by robust water status indicators (WSIs), is inevitable in most of the Mediterranean basin. One of the most reliable WSIs is the leaf water potential (Ψleaf), which is determined via an intrusive and time-consuming method. The aim of this work is to discern the most effective variables that are correlated with plants' water status and identify the variables that better predict Ψleaf. Five grapevine varieties grown in the Alentejo region (Portugal) were selected and subjected to three irrigation treatments, starting in 2018: full irrigation (FI), deficit irrigation (DI), and no irrigation (NI). Plant monitoring was performed in 2023. Measurements included stomatal conductance (gs), predawn water potential Ψpd, stem water potential (Ψstem), thermal imaging, and meteorological data. The WSIs, namely Ψpd and gs, responded differently according to the irrigation treatment. Ψstem measured at mid-morning (MM) and mid-day (MD) proved unable to discern between treatments. MM measurements presented the best correlations between WSIs. gs showed the best correlations between the other WSIs, and consequently the best predictive capability to estimate Ψpd. Machine learning regression models were trained on meteorological, thermal, and gs data to predict Ψpd, with ensemble models showing a great performance (ExtraTrees: R2=0.833, MAE=0.072; Gradient Boosting: R2=0.830; MAE=0.073).

An overview of image-based phenotyping as an adaptive 4.0 technology for studying plant abiotic stress: A bibliometric and literature review

Improving the tolerance of crop species to abiotic stresses that limit plant growth and productivity is essential for mitigating the emerging problems of global warming. In this context, imaged data analysis represents an effective method in the 4.0 technology era, where this method has the non-destructive and recursive characterization of plant phenotypic traits as selection criteria. So, the plant breeders are helped in the development of adapted and climate-resilient crop varieties. Although image-based phenotyping has recently resulted in remarkable improvements for identifying the crop status under a range of growing conditions, the topic of its application for assessing the plant behavioral responses to abiotic stressors has not yet been extensively reviewed. For such a purpose, bibliometric analysis is an ideal analytical concept to analyze the evolution and interplay of image-based phenotyping to abiotic stresses by objectively reviewing the literature in light of existing database. Bibliometricy, a bibliometric analysis was applied using a systematic methodology which involved data mining, mining data improvement and analysis, and manuscript construction. The obtained results indicate that there are 554 documents related to image-based phenotyping to abiotic stress until 5 January 2023. All document showed the future development trends of image-based phenotyping will be mainly centered in the United States, European continent and China. The keywords analysis major focus to the application of 4.0 technology and machine learning in plant breeding, especially to create the tolerant variety under abiotic stresses. Drought and saline become an abiotic stress often using image-based phenotyping. Besides that, the rice, wheat and maize as the main commodities in this topic. In conclusion, the present work provides information on resolutive interactions in developing image-based phenotyping to abiotic stress, especially optimizing high-throughput sensors in image-based phenotyping for the future development.

Field phenotyping for African crops: overview and perspectives

Improvements in crop productivity are required to meet the dietary demands of the rapidly-increasing African population. The development of key staple crop cultivars that are high-yielding and resilient to biotic and abiotic stresses is essential. To contribute to this objective, high-throughput plant phenotyping approaches are important enablers for the African plant science community to measure complex quantitative phenotypes and to establish the genetic basis of agriculturally relevant traits. These advances will facilitate the screening of germplasm for optimum performance and adaptation to low-input agriculture and resource-constrained environments. Increasing the capacity to investigate plant function and structure through non-invasive technologies is an effective strategy to aid plant breeding and additionally may contribute to precision agriculture. However, despite the significant global advances in basic knowledge and sensor technology for plant phenotyping, Africa still lags behind in the development and implementation of these systems due to several practical, financial, geographical and political barriers. Currently, field phenotyping is mostly carried out by manual methods that are prone to error, costly, labor-intensive and may come with adverse economic implications. Therefore, improvements in advanced field phenotyping capabilities and appropriate implementation are key factors for success in modern breeding and agricultural monitoring. In this review, we provide an overview of the current state of field phenotyping and the challenges limiting its implementation in some African countries. We suggest that the lack of appropriate field phenotyping infrastructures is impeding the development of improved crop cultivars and will have a detrimental impact on the agricultural sector and on food security. We highlight the prospects for integrating emerging and advanced low-cost phenotyping technologies into breeding protocols and characterizing crop responses to environmental challenges in field experimentation. Finally, we explore strategies for overcoming the barriers and maximizing the full potential of emerging field phenotyping technologies in African agriculture. This review paper will open new windows and provide new perspectives for breeders and the entire plant science community in Africa.

Plant optics: underlying mechanisms in remotely sensed signals for phenotyping applications

Optical-based remote sensing offers great potential for phenotyping vegetation traits and functions for a range of applications including vegetation monitoring and assessment. A key strength of optical-based approaches is the underlying mechanistic link to vegetation physiology, biochemistry, and structure that influences a spectral signal. By exploiting spectral variation driven by plant physiological response to environment, remotely sensed products can be used to estimate vegetation traits and functions. However, oftentimes these products are proxies based on covariance, which can lead to misinterpretation and decoupling under certain scenarios. This viewpoint will discuss (i) the optical properties of vegetation, (ii) applications of vegetation indices, solar-induced fluorescence, and machine-learning approaches, and (iii) how covariance can lead to good empirical proximation of plant traits and functions. Understanding and acknowledging the underlying mechanistic basis of plant optics must be considered as remotely sensed data availability and applications continue to grow. Doing so will enable appropriate application and consideration of limitations for the use of optical-based remote sensing for phenotyping applications.

Restructuring plant types for developing tailor-made crops

Plants have adapted to different environmental niches by fine-tuning the developmental factors working together to regulate traits. Variations in the developmental factors result in a wide range of quantitative variations in these traits that helped plants survive better. The major developmental pathways affecting plant architecture are also under the control of such pathways. Most notable are the CLAVATA-WUSCHEL pathway regulating shoot apical meristem fate, GID1-DELLA module influencing plant height and tillering, LAZY1-TAC1 module controlling branch/tiller angle and the TFL1-FT determining the floral fate in plants. Allelic variants of these key regulators selected during domestication shaped the crops the way we know them today. There is immense yield potential in the 'ideal plant architecture' of a crop. With the available genome-editing techniques, possibilities are not restricted to naturally occurring variations. Using a transient reprogramming system, one can screen the effect of several developmental gene expressions in novel ecosystems to identify the best targets. We can use the plant's fine-tuning mechanism for customizing crops to specific environments. The process of crop domestication can be accelerated with a proper understanding of these developmental pathways. It is time to step forward towards the next-generation molecular breeding for restructuring plant types in crops ensuring yield stability.

A Synthetic Review of Various Dimensions of Non-Destructive Plant Stress Phenotyping

Non-destructive plant stress phenotyping begins with traditional one-dimensional (1D) spectroscopy, followed by two-dimensional (2D) imaging, three-dimensional (3D) or even temporal-three-dimensional (T-3D), spectral-three-dimensional (S-3D), and temporal-spectral-three-dimensional (TS-3D) phenotyping, all of which are aimed at observing subtle changes in plants under stress. However, a comprehensive review that covers all these dimensional types of phenotyping, ordered in a spatial arrangement from 1D to 3D, as well as temporal and spectral dimensions, is lacking. In this review, we look back to the development of data-acquiring techniques for various dimensions of plant stress phenotyping (1D spectroscopy, 2D imaging, 3D phenotyping), as well as their corresponding data-analyzing pipelines (mathematical analysis, machine learning, or deep learning), and look forward to the trends and challenges of high-performance multi-dimension (integrated spatial, temporal, and spectral) phenotyping demands. We hope this article can serve as a reference for implementing various dimensions of non-destructive plant stress phenotyping.

Active vs. Passive Thermal Imaging for Helping the Early Detection of Soil-Borne Rot Diseases on Wild Rocket [Diplotaxis tenuifolia (L.) D.C.]

Cultivation of wild rocket [Diplotaxis tenuifolia (L.) D.C.] as a baby-leaf vegetable for the high-convenience food chain is constantly growing due to its nutritional and taste qualities. As is well known, these crops are particularly exposed to soil-borne fungal diseases and need to be effectively protected. At present, wild rocket disease management is performed by using permitted synthetic fungicides or through the application of agro-ecological and biological methods that must be optimized. In this regard, the implementation of innovative digital-based technologies, such as infrared thermography (IT), as supporting systems to decision-making processes is welcome. In this work, leaves belonging to wild rocket plants inoculated with the soil-borne pathogens Rhizoctonia solani Kühn and Sclerotinia sclerotiorum (Lib.) de Bary were analyzed and monitored by both active and passive thermographic methods and compared with visual detection. A comparison between the thermal analysis carried out in both medium (MWIR)- and long (LWIR)-wave infrared was made and discussed. The results achieved highlight how the monitoring based on the use of IT is promising for carrying out an early detection of the rot diseases induced by the investigated pathogens, allowing their detection in 3-6 days before the canopy is completely wilted. Active thermal imaging has the potential to detect early soil-borne rotting diseases.

Assessment of Black Rot in Oilseed Rape Grown under Climate Change Conditions Using Biochemical Methods and Computer Vision

Global warming is a challenge for plants and pathogens, involving profound changes in the physiology of both contenders to adapt to the new environmental conditions and to succeed in their interaction. Studies have been conducted on the behavior of oilseed rape plants and two races (1 and 4) of the bacterium Xanthomonas campestris pv. campestris (Xcc) and their interaction to anticipate our response in the possible future climate. Symptoms caused by both races of Xcc were very similar to each other under any climatic condition assayed, although the bacterial count from infected leaves differed for each race. Climate change caused an earlier onset of Xcc symptoms by at least 3 days, linked to oxidative stress and a change in pigment composition. Xcc infection aggravated the leaf senescence already induced by climate change. To identify Xcc-infected plants early under any climatic condition, four classifying algorithms were trained with parameters obtained from the images of green fluorescence, two vegetation indices and thermography recorded on Xcc-symptomless leaves. Classification accuracies were above 0.85 out of 1.0 in all cases, with k-nearest neighbor analysis and support vector machines performing best under the tested climatic conditions.

Image-based assessment of plant disease progression identifies new genetic loci for resistance to Ralstonia solanacearum in tomato

A major challenge in global crop production is mitigating yield loss due to plant diseases. One of the best strategies to control these losses is through breeding for disease resistance. One barrier to the identification of resistance genes is the quantification of disease severity, which is typically based on the determination of a subjective score by a human observer. We hypothesized that image-based, non-destructive measurements of plant morphology over an extended period after pathogen infection would capture subtle quantitative differences between genotypes, and thus enable identification of new disease resistance loci. To test this, we inoculated a genetically diverse biparental mapping population of tomato (Solanum lycopersicum) with Ralstonia solanacearum, a soilborne pathogen that causes bacterial wilt disease. We acquired over 40 000 time-series images of disease progression in this population, and developed an image analysis pipeline providing a suite of 10 traits to quantify bacterial wilt disease based on plant shape and size. Quantitative trait locus (QTL) analyses using image-based phenotyping for single and multi-traits identified QTLs that were both unique and shared compared with those identified by human assessment of wilting, and could detect QTLs earlier than human assessment. Expanding the phenotypic space of disease with image-based, non-destructive phenotyping both allowed earlier detection and identified new genetic components of resistance.

Impact of a DANA Event on the Thermal Response of Nectarine Trees

This field experiment focuses on the effects of a heavy rainfall event (DANA, depresión aislada en niveles altos) that occurred on 12-14 September 2019 (DOY, Day of the year, 255-257), in southern Spain on plant water status and the thermal response of nectarine trees. Two irrigation treatments were applied during the summer-autumn postharvest period (DOY 158-329): full-irrigated (CTL) and non-irrigated (DRY). Volumetric soil water content (θ_v), air temperature (Ta) and canopy temperature (Tc) were monitored in real-time and the crop water stress index (CWSI) was calculated. The difference in Tc between the DRY and CTL treatments (Tc' - Tc) is proposed as a new thermal indicator. Stem water potential (Ψ_stem) and leaf gas exchange measurements were recorded on representative days. During the DANA event, only the Tc measured by the infrared radiometer sensors could be monitored. Therefore, the effects of the DANA forced the soil water content sensors to be switched off, which prevented Ψ_stem and leaf gas exchange determinations from DOY 255 to 275. Before the DANA event, withholding irrigation caused a gradual decrease in the soil and plant water status in the DRY treatment. Significant differences appeared between treatments in the studied thermal indexes. Moreover, Tc' - Tc was more sensitive than Tc - Ta in assessing nectarine water stress. The effects of the DANA reduced these differences, suggesting different baselines for the calculation of CWSI. In this respect, the relationship Tc - Ta vs. VPD improved the coefficient of determination after the DANA event in full-irrigated trees. Similar values of Ψ_stem and leaf gas exchange were found in both treatments after the DANA event, even though thermal indexes showed some significant differences. In addition, the strong relationship found between Tc - Ta and CWSI vs. Ψ_stem worsened after DANA occurred, revealing a lower sensitivity of Ψ_stem compared to canopy temperature to accurately assess nectarine water status in these saturated soil conditions. This research underlined the robustness of infrared thermography to continuously monitor plant water status under these extreme weather conditions.

A Guide to Plant Intracellular Temperature Imaging using Fluorescent Thermometers

All aspects of plant physiology are influenced by temperature. Changes in environmental temperature alter the temperatures of plant tissues and cells, which then affect various cellular activities, such as gene expression, protein stability and enzyme activities. In turn, changes in cellular activities, which are associated with either exothermic or endothermic reactions, can change the local temperature in cells and tissues. In the past 10 years, a number of fluorescent probes that detect temperature and enable intracellular temperature imaging have been reported. Intracellular temperature imaging has revealed that there is a temperature difference >1°C inside cells and that the treatment of cells with mitochondrial uncoupler or ionomycin can cause more than a 1°C intracellular temperature increase in mammalian cultured cells. Thermogenesis mechanisms in brown adipocytes have been revealed with the aid of intracellular temperature imaging. While there have been no reports on plant intracellular temperature imaging thus far, intracellular temperature imaging is expected to provide a new way to analyze the mechanisms underlying the various activities of plant cells. In this review, I will first summarize the recent progress in the development of fluorescent thermometers and their biological applications. I will then discuss the selection of fluorescent thermometers and experimental setup for the adaptation of intracellular temperature imaging to plant cells. Finally, possible applications of intracellular temperature imaging to investigate plant cell functions will be discussed.

An Open-Source Package for Thermal and Multispectral Image Analysis for Plants in Glasshouse

Advanced plant phenotyping techniques to measure biophysical traits of crops are helping to deliver improved crop varieties faster. Phenotyping of plants using different sensors for image acquisition and its analysis with novel computational algorithms are increasingly being adapted to measure plant traits. Thermal and multispectral imagery provides novel opportunities to reliably phenotype crop genotypes tested for biotic and abiotic stresses under glasshouse conditions. However, optimization for image acquisition, pre-processing, and analysis is required to correct for optical distortion, image co-registration, radiometric rescaling, and illumination correction. This study provides a computational pipeline that optimizes these issues and synchronizes image acquisition from thermal and multispectral sensors. The image processing pipeline provides a processed stacked image comprising RGB, green, red, NIR, red edge, and thermal, containing only the pixels present in the object of interest, e.g., plant canopy. These multimodal outputs in thermal and multispectral imageries of the plants can be compared and analysed mutually to provide complementary insights and develop vegetative indices effectively. This study offers digital platform and analytics to monitor early symptoms of biotic and abiotic stresses and to screen a large number of genotypes for improved growth and productivity. The pipeline is packaged as open source and is hosted online so that it can be utilized by researchers working with similar sensors for crop phenotyping.

Proximal and remote sensing in plant phenomics: 20 years of progress, challenges, and perspectives

Plant phenomics (PP) has been recognized as a bottleneck in studying the interactions of genomics and environment on plants, limiting the progress of smart breeding and precise cultivation. High-throughput plant phenotyping is challenging owing to the spatio-temporal dynamics of traits. Proximal and remote sensing (PRS) techniques are increasingly used for plant phenotyping because of their advantages in multi-dimensional data acquisition and analysis. Substantial progress of PRS applications in PP has been observed over the last two decades and is analyzed here from an interdisciplinary perspective based on 2972 publications. This progress covers most aspects of PRS application in PP, including patterns of global spatial distribution and temporal dynamics, specific PRS technologies, phenotypic research fields, working environments, species, and traits. Subsequently, we demonstrate how to link PRS to multi-omics studies, including how to achieve multi-dimensional PRS data acquisition and processing, how to systematically integrate all kinds of phenotypic information and derive phenotypic knowledge with biological significance, and how to link PP to multi-omics association analysis. Finally, we identify three future perspectives for PRS-based PP: (1) strengthening the spatial and temporal consistency of PRS data, (2) exploring novel phenotypic traits, and (3) facilitating multi-omics communication.

Multi-sensor spectral synergies for crop stress detection and monitoring in the optical domain: A review

Remote detection and monitoring of the vegetation responses to stress became relevant for sustainable agriculture. Ongoing developments in optical remote sensing technologies have provided tools to increase our understanding of stress-related physiological processes. Therefore, this study aimed to provide an overview of the main spectral technologies and retrieval approaches for detecting crop stress in agriculture. Firstly, we present integrated views on: i) biotic and abiotic stress factors, the phases of stress, and respective plant responses, and ii) the affected traits, appropriate spectral domains and corresponding methods for measuring traits remotely. Secondly, representative results of a systematic literature analysis are highlighted, identifying the current status and possible future trends in stress detection and monitoring. Distinct plant responses occurring under shortterm, medium-term or severe chronic stress exposure can be captured with remote sensing due to specific light interaction processes, such as absorption and scattering manifested in the reflected radiance, i.e. visible (VIS), near infrared (NIR), shortwave infrared, and emitted radiance, i.e. solar-induced fluorescence and thermal infrared (TIR). From the analysis of 96 research papers, the following trends can be observed: increasing usage of satellite and unmanned aerial vehicle data in parallel with a shift in methods from simpler parametric approaches towards more advanced physically-based and hybrid models. Most study designs were largely driven by sensor availability and practical economic reasons, leading to the common usage of VIS-NIR-TIR sensor combinations. The majority of reviewed studies compared stress proxies calculated from single-source sensor domains rather than using data in a synergistic way. We identified new ways forward as guidance for improved synergistic usage of spectral domains for stress detection: (1) combined acquisition of data from multiple sensors for analysing multiple stress responses simultaneously (holistic view); (2) simultaneous retrieval of plant traits combining multi-domain radiative transfer models and machine learning methods; (3) assimilation of estimated plant traits from distinct spectral domains into integrated crop growth models. As a future outlook, we recommend combining multiple remote sensing data streams into crop model assimilation schemes to build up Digital Twins of agroecosystems, which may provide the most efficient way to detect the diversity of environmental and biotic stresses and thus enable respective management decisions.

Challenging the water stress index concept: Thermographic assessment of Arabidopsis transpiration

Water stress may greatly limit plant functionality and growth. Stomatal closure and consequently reduced transpiration are considered as early and sensitive plant responses to drought and salinity stress. An important consequence of stomatal closure under water stress is the rise of leaf temperature (T_leaf ), yet T_leaf is not only fluctuating with stomatal closure. It is regulated by several plant parameters and environmental factors. Thermal imaging and different stress indices, incorporating actual leaf/crop temperature and reference temperatures, were developed in previous studies toward normalizing for effects unassociated to water stress on T_leaf , aiming at a more efficient water stress assessment. The concept of stress indices has not been extensively studied on the model plant Arabidopsis thaliana. Therefore, the aim of this study was to examine the different indices employed in previous studies in assessing rosette transpiration rate (E) in Arabidopsis plants grown under two different light environments and subjected to salinity. After salinity imposition, E was gravimetrically quantified, and thermal imaging was employed to quantify rosette (T_rosette ) and artificial reference temperature (T_wet, T_dry ). T_rosette and several water stress indices were tested for their relation to E. Among the microclimatic growth conditions tested, RWSI₁ ([T_rosette  - T_wet ]/[T_dry  - T_wet ]) and RWSI₂ ([T_dry  - T_rosette ]/[T_dry  - T_wet ]) were well linearly-related to E, irrespective of the light environment, while the sole use of either T_wet or T_dry in different combinations with T_rosette returned less accurate results. This study provides evidence that selected combinations of T_rosette , T_dry , and T_wet can be utilized to assess E under water stress irrespective of the light environment.

High throughput saliency-based quantification of grape powdery mildew at the microscopic level for disease resistance breeding

Imaging-based high throughput phenotyping (HTP) systems have demonstrated promising solutions to enhance genetic understanding of grapevine powdery mildew (PM) resistance and have accelerated PM-resistant cultivar breeding. The accuracy and throughput of extracting phenotypic traits from images are still the bottleneck of modern HTP systems, especially at the microscopic level. The goal of this study was to develop a saliency-based processing pipeline for the quantification of PM infection in microscopic images and comprehensively evaluate its performance for genetic analyses. An input image was segregated into subimages that were classified as infected or healthy by a pretrained CNN classifier. Saliency maps from the classification were generated post-hoc and used for the quantification of PM infection in the input image at the pixel level without the use of mask annotations. A total of seven phenotypic traits were extracted from images collected for a biparental population. Experimental results showed that optimal combinations of convolutional neural network and saliency methods achieved strong measurement correlations (r = 0.74 to 0.75) with human assessments at the image patch level, and the traits calculated by the saliency-based processing pipeline were highly correlated (r = 0.87 to 0.88) with reference PM infection ratings at the leaf image level. The high quantification accuracy of the saliency-based pipeline led to the increased explanation of phenotypic variance and reliable identification of quantitative trait loci. Therefore, the saliency-based processing pipeline can be used as an effective and efficient analysis tool for PM disease research and breeding programs in the future, especially agricultural and life science studies requiring microscopic image analysis.

A survey on deep learning-based identification of plant and crop diseases from UAV-based aerial images

The agricultural crop productivity can be affected and reduced due to many factors such as weeds, pests, and diseases. Traditional methods that are based on terrestrial engines, devices, and farmers' naked eyes are facing many limitations in terms of accuracy and the required time to cover large fields. Currently, precision agriculture that is based on the use of deep learning algorithms and Unmanned Aerial Vehicles (UAVs) provides an effective solution to achieve agriculture applications, including plant disease identification and treatment. In the last few years, plant disease monitoring using UAV platforms is one of the most important agriculture applications that have gained increasing interest by researchers. Accurate detection and treatment of plant diseases at early stages is crucial to improving agricultural production. To this end, in this review, we analyze the recent advances in the use of computer vision techniques that are based on deep learning algorithms and UAV technologies to identify and treat crop diseases.

Novel Vegetation Indices to Identify Broccoli Plants Infected With Xanthomonas campestris pv. campestris

A rapid diagnosis of black rot in brassicas, a devastating disease caused by Xanthomonas campestris pv. campestris (Xcc), would be desirable to avoid significant crop yield losses. The main aim of this work was to develop a method of detection of Xcc infection on broccoli leaves. Such method is based on the use of imaging sensors that capture information about the optical properties of leaves and provide data that can be implemented on machine learning algorithms capable of learning patterns. Based on this knowledge, the algorithms are able to classify plants into categories (healthy and infected). To ensure the robustness of the detection method upon future alterations in climate conditions, the response of broccoli plants to Xcc infection was analyzed under a range of growing environments, taking current climate conditions as reference. Two projections for years 2081-2100 were selected, according to the Assessment Report of Intergovernmental Panel on Climate Change. Thus, the response of broccoli plants to Xcc infection and climate conditions has been monitored using leaf temperature and five conventional vegetation indices (VIs) derived from hyperspectral reflectance. In addition, three novel VIs, named diseased broccoli indices (DBI₁-DBI₃), were defined based on the spectral reflectance signature of broccoli leaves upon Xcc infection. Finally, the nine parameters were implemented on several classifying algorithms. The detection method offering the best performance of classification was a multilayer perceptron-based artificial neural network. This model identified infected plants with accuracies of 88.1, 76.9, and 83.3%, depending on the growing conditions. In this model, the three Vis described in this work proved to be very informative parameters for the disease detection. To our best knowledge, this is the first time that future climate conditions have been taken into account to develop a robust detection model using classifying algorithms.

Capturing crop adaptation to abiotic stress using image-based technologies

Farmers and breeders aim to improve crop responses to abiotic stresses and secure yield under adverse environmental conditions. To achieve this goal and select the most resilient genotypes, plant breeders and researchers rely on phenotyping to quantify crop responses to abiotic stress. Recent advances in imaging technologies allow researchers to collect physiological data non-destructively and throughout time, making it possible to dissect complex plant responses into quantifiable traits. The use of image-based technologies enables the quantification of crop responses to stress in both controlled environmental conditions and field trials. This paper summarizes phenotyping imaging technologies (RGB, multispectral and hyperspectral sensors, among others) that have been used to assess different abiotic stresses including salinity, drought and nitrogen deficiency, while discussing their advantages and drawbacks. We present a detailed review of traits involved in abiotic tolerance, which have been quantified by a range of imaging sensors under high-throughput phenotyping facilities or using unmanned aerial vehicles in the field. We also provide an up-to-date compilation of spectral tolerance indices and discuss the progress and challenges in machine learning, including supervised and unsupervised models as well as deep learning.

A Comprehensive Review of High Throughput Phenotyping and Machine Learning for Plant Stress Phenotyping

During the last decade, there has been rapid adoption of ground and aerial platforms with multiple sensors for phenotyping various biotic and abiotic stresses throughout the developmental stages of the crop plant. High throughput phenotyping (HTP) involves the application of these tools to phenotype the plants and can vary from ground-based imaging to aerial phenotyping to remote sensing. Adoption of these HTP tools has tried to reduce the phenotyping bottleneck in breeding programs and help to increase the pace of genetic gain. More specifically, several root phenotyping tools are discussed to study the plant's hidden half and an area long neglected. However, the use of these HTP technologies produces big data sets that impede the inference from those datasets. Machine learning and deep learning provide an alternative opportunity for the extraction of useful information for making conclusions. These are interdisciplinary approaches for data analysis using probability, statistics, classification, regression, decision theory, data visualization, and neural networks to relate information extracted with the phenotypes obtained. These techniques use feature extraction, identification, classification, and prediction criteria to identify pertinent data for use in plant breeding and pathology activities. This review focuses on the recent findings where machine learning and deep learning approaches have been used for plant stress phenotyping with data being collected using various HTP platforms. We have provided a comprehensive overview of different machine learning and deep learning tools available with their potential advantages and pitfalls. Overall, this review provides an avenue for studying various HTP platforms with particular emphasis on using the machine learning and deep learning tools for drawing legitimate conclusions. Finally, we propose the conceptual challenges being faced and provide insights on future perspectives for managing those issues.

Machine Learning for Plant Stress Modeling: A Perspective towards Hormesis Management

Plant stress is one of the most significant factors affecting plant fitness and, consequently, food production. However, plant stress may also be profitable since it behaves hormetically; at low doses, it stimulates positive traits in crops, such as the synthesis of specialized metabolites and additional stress tolerance. The controlled exposure of crops to low doses of stressors is therefore called hormesis management, and it is a promising method to increase crop productivity and quality. Nevertheless, hormesis management has severe limitations derived from the complexity of plant physiological responses to stress. Many technological advances assist plant stress science in overcoming such limitations, which results in extensive datasets originating from the multiple layers of the plant defensive response. For that reason, artificial intelligence tools, particularly Machine Learning (ML) and Deep Learning (DL), have become crucial for processing and interpreting data to accurately model plant stress responses such as genomic variation, gene and protein expression, and metabolite biosynthesis. In this review, we discuss the most recent ML and DL applications in plant stress science, focusing on their potential for improving the development of hormesis management protocols.

Integrated Analysis of Osmotic Stress and Infrared Thermal Imaging for the Selection of Resilient Rice Under Water Scarcity

The climate change scenario has increased the severity and frequency of drought stress, which limits the growth and yield of rice worldwide. There is a dire need to select drought-tolerant rice varieties to sustain crop production under water scarcity. Therefore, the present study effectively combined morpho-physiological and biochemical approaches with the technology of infrared thermal imaging (IRTI) for a reliable selection of drought-tolerant genotypes. Initially, we studied 28 rice genotypes including 26 advance lines and three varieties for water stress tolerance under net house conditions. Three genotypes NIBGE-DT-02, KSK-133, and NIBGE-DT-11 were selected based on the Standard Evaluation System (SES) scoring for drought tolerance. NIBGE-DT-02 showed tolerance to polyethylene glycol (20%) induced osmotic stress indicated by a minimum reduction in seedling length, biomass, chlorophyll content, and increased leaf proline content as compared to susceptible varieties under a hydroponic system. NIBGE-DT-02 was further evaluated for water withholding at varying growth stages, i.e., 30 and 60 days after transplantation (DAT) in pots under net house conditions. NIBGE-DT-02 showed a significantly lower reduction (35.9%) in yield as compared to a susceptible variety (78.06%) under water stress at 60 DAT with concomitant induction of antioxidant enzymes such as peroxidase, catalase, and polyphenol oxidase. A significant increase (45.9%) in proline content, a low increase (7.5%) in plant temperature, along with a low reduction in relative water content (RWC) (5.5%), and membrane stability index (MSI) (9%) were observed under water stress at 60 DAT as compared to the well-watered control. Pearson correlation analysis showed the strong correlation of shoot length with MSI and root length with RWC in rice genotypes at the later growth stage. Furthermore, Regression analysis indicated a negative correlation between plant temperature of NIBGE-DT-02 and proline, RWC, MSI, and peroxidase enzyme under variable water stress conditions. All these responses collectively validated the adaptive response of selected genotypes under water stress during different growth stages. Tolerant genotypes can be used in breeding programs aimed at improving drought tolerance and can expand rice cultivation. Furthermore, this study provides a foundation for future research directed to utilize IRTI as a fast and non-destructive approach for the selection of potent rice genotypes better adapted to water scarcity from wide germplasm collection.

Monitoring of the copper persistence on plant leaves using pulsed thermography

Copper-based fungicides are largely used in agriculture in the control of a wide range of plant diseases. Applied on plants, they remain deposited on leaf surfaces and are not absorbed into plant tissues. Because of accumulation problems and their ecotoxicological profiles in the soil, their use needs to be monitored and controlled, also by using modern technologies to better optimize the efficacy rendering minimum the amount of copper per season used. In this work, we test a novel approach based on pulsed thermography to evaluate the persistence of the copper on plant leaves so that the time between two applications should be the minimum needs. We monitored the thermal response observed on different treatments of both grapevine and tobacco plants over a 3-week period. Our experimental results demonstrate that the new methodological approach based on pulsed thermography can be an effective tool to evaluate in real time the presence of copper on differently treated plants allowing a tentative quantification and, therefore, to optimize its use in the agricultural practices, according also to the European Regulation n. 1107/2009.

UAV-Assisted Thermal Infrared and Multispectral Imaging of Weed Canopies for Glyphosate Resistance Detection

The foundation of contemporary weed management practices in many parts of the world is glyphosate. However, dependency on the effectiveness of herbicide practices has led to overuse through continuous growth of crops resistant to a single mode of action. In order to provide a cost-effective weed management strategy that does not promote glyphosate-resistant weed biotypes, differences between resistant and susceptible biotypes have to be identified accurately in the field conditions. Unmanned Aerial Vehicle (UAV)-assisted thermal and multispectral remote sensing has potential for detecting biophysical characteristics of weed biotypes during the growing season, which includes distinguishing glyphosate-susceptible and glyphosate-resistant weed populations based on canopy temperature and deep learning driven weed identification algorithms. The objective of this study was to identify herbicide resistance after glyphosate application in true field conditions by analyzing the UAV-acquired thermal and multispectral response of kochia, waterhemp, redroot pigweed, and common ragweed. The data were processed in ArcGIS for raster classification as well as spectral comparison of glyphosate-resistant and glyphosate-susceptible weeds. The classification accuracy between the sensors and classification methods of maximum likelihood, random trees, and Support Vector Machine (SVM) were compared. The random trees classifier performed the best at 4 days after application (DAA) for kochia with 62.9% accuracy. The maximum likelihood classifier provided the highest performing result out of all classification methods with an accuracy of 75.2%. A commendable classification was made at 8 DAA where the random trees classifier attained an accuracy of 87.2%. However, thermal reflectance measurements as a predictor for glyphosate resistance within weed populations in field condition was unreliable due to its susceptibility to environmental conditions. Normalized Difference Vegetation Index (NDVI) and a composite reflectance of 842 nm, 705 nm, and 740 nm wavelength managed to provide better classification results than thermal in most cases.

Review: Application of Artificial Intelligence in Phenomics

Plant phenomics has been rapidly advancing over the past few years. This advancement is attributed to the increased innovation and availability of new technologies which can enable the high-throughput phenotyping of complex plant traits. The application of artificial intelligence in various domains of science has also grown exponentially in recent years. Notably, the computer vision, machine learning, and deep learning aspects of artificial intelligence have been successfully integrated into non-invasive imaging techniques. This integration is gradually improving the efficiency of data collection and analysis through the application of machine and deep learning for robust image analysis. In addition, artificial intelligence has fostered the development of software and tools applied in field phenotyping for data collection and management. These include open-source devices and tools which are enabling community driven research and data-sharing, thereby availing the large amounts of data required for the accurate study of phenotypes. This paper reviews more than one hundred current state-of-the-art papers concerning AI-applied plant phenotyping published between 2010 and 2020. It provides an overview of current phenotyping technologies and the ongoing integration of artificial intelligence into plant phenotyping. Lastly, the limitations of the current approaches/methods and future directions are discussed.

UAV-Based Thermal, RGB Imaging and Gene Expression Analysis Allowed Detection of Fusarium Head Blight and Gave New Insights Into the Physiological Responses to the Disease in Durum Wheat

Wheat is one of the world's most economically important cereal crop, grown on 220 million hectares. Fusarium head blight (FHB) disease is considered a major threat to durum (Triticum turgidum subsp. durum (Desfontaines) Husnache) and bread wheat (T. aestivum L.) cultivars and is mainly managed by the application of fungicides at anthesis. However, fungicides are applied when FHB symptoms are clearly visible and the spikes are almost entirely bleached (% of diseased spikelets > 80%), by when it is too late to control FHB disease. For this reason, farmers often react by performing repeated fungicide treatments that, however, due to the advanced state of the infection, cause a waste of money and pose significant risks to the environment and non-target organisms. In the present study, we used unmanned aerial vehicle (UAV)-based thermal infrared (TIR) and red-green-blue (RGB) imaging for FHB detection in T. turgidum (cv. Marco Aurelio) under natural field conditions. TIR and RGB data coupled with ground-based measurements such as spike's temperature, photosynthetic efficiency and molecular identification of FHB pathogens, detected FHB at anthesis half-way (Zadoks stage 65, ZS 65), when the percentage (%) of diseased spikelets ranged between 20% and 60%. Moreover, in greenhouse experiments the transcripts of the key genes involved in stomatal closure were mostly up-regulated in F. graminearum-inoculated plants, demonstrating that the physiological mechanism behind the spike's temperature increase and photosynthetic efficiency decrease could be attributed to the closure of the guard cells in response to F. graminearum. In addition, preliminary analysis revealed that there is differential regulation of genes between drought-stressed and F. graminearum-inoculated plants, suggesting that there might be a possibility to discriminate between water stress and FHB infection. This study shows the potential of UAV-based TIR and RGB imaging for field phenotyping of wheat and other cereal crop species in response to environmental stresses. This is anticipated to have enormous promise for the detection of FHB disease and tremendous implications for optimizing the application of fungicides, since global food crop demand is to be met with minimal environmental impacts.