Hyperspectral imaging combined with machine learning as a tool to obtain high-throughput plant salt-stress phenotyping

Deep learning-based prediction of plant height and crown area of vegetable crops using LiDAR point cloud

Remote sensing has been increasingly used in precision agriculture. Buoyed by the developments in the miniaturization of sensors and platforms, contemporary remote sensing offers data at resolutions finer enough to respond to within-farm variations. LiDAR point cloud, offers features amenable to modelling structural parameters of crops. Early prediction of crop growth parameters helps farmers and other stakeholders dynamically manage farming activities. The objective of this work is the development and application of a deep learning framework to predict plant-level crop height and crown area at different growth stages for vegetable crops. LiDAR point clouds were acquired using a terrestrial laser scanner on five dates during the growth cycles of tomato, eggplant and cabbage on the experimental research farms of the University of Agricultural Sciences, Bengaluru, India. We implemented a hybrid deep learning framework combining distinct features of long-term short memory (LSTM) and Gated Recurrent Unit (GRU) for the predictions of plant height and crown area. The predictions are validated with reference ground truth measurements. These predictions were validated against ground truth measurements. The findings demonstrate that plant-level structural parameters can be predicted well ahead of crop growth stages with around 80% accuracy. Notably, the LSTM and the GRU models exhibited limitations in capturing variations in structural parameters. Conversely, the hybrid model offered significantly improved predictions, particularly for crown area, with error rates for height prediction ranging from 5 to 12%, with deviations exhibiting a more balanced distribution between overestimation and underestimation This approach effectively captured the inherent temporal growth pattern of the crops, highlighting the potential of deep learning for precision agriculture applications. However, the prediction quality is relatively low at the advanced growth stage, closer to the harvest. In contrast, the prediction quality is stable across the three different crops. The results indicate the presence of a robust relationship between the features of the LiDAR point cloud and the auto-feature map of the deep learning methods adapted for plant-level crop structural characterization. This approach effectively captured the inherent temporal growth pattern of the crops, highlighting the potential of deep learning for precision agriculture applications.

Simulation of Automatically Annotated Visible and Multi-/Hyperspectral Images Using the Helios 3D Plant and Radiative Transfer Modeling Framework

Deep learning and multimodal remote and proximal sensing are widely used for analyzing plant and crop traits, but many of these deep learning models are supervised and necessitate reference datasets with image annotations. Acquiring these datasets often demands experiments that are both labor-intensive and time-consuming. Furthermore, extracting traits from remote sensing data beyond simple geometric features remains a challenge. To address these challenges, we proposed a radiative transfer modeling framework based on the Helios 3-dimensional (3D) plant modeling software designed for plant remote and proximal sensing image simulation. The framework has the capability to simulate RGB, multi-/hyperspectral, thermal, and depth cameras, and produce associated plant images with fully resolved reference labels such as plant physical traits, leaf chemical concentrations, and leaf physiological traits. Helios offers a simulated environment that enables generation of 3D geometric models of plants and soil with random variation, and specification or simulation of their properties and function. This approach differs from traditional computer graphics rendering by explicitly modeling radiation transfer physics, which provides a critical link to underlying plant biophysical processes. Results indicate that the framework is capable of generating high-quality, labeled synthetic plant images under given lighting scenarios, which can lessen or remove the need for manually collected and annotated data. Two example applications are presented that demonstrate the feasibility of using the model to enable unsupervised learning by training deep learning models exclusively with simulated images and performing prediction tasks using real images.

Noninvasive Abiotic Stress Phenotyping of Vascular Plant in Each Vegetative Organ View

The last decades have witnessed a rapid development of noninvasive plant phenotyping, capable of detecting plant stress scale levels from the subcellular to the whole population scale. However, even with such a broad range, most phenotyping objects are often just concerned with leaves. This review offers a unique perspective of noninvasive plant stress phenotyping from a multi-organ view. First, plant sensing and responding to abiotic stress from the diverse vegetative organs (leaves, stems, and roots) and the interplays between these vital components are analyzed. Then, the corresponding noninvasive optical phenotyping techniques are also provided, which can prompt the practical implementation of appropriate noninvasive phenotyping techniques for each organ. Furthermore, we explore methods for analyzing compound stress situations, as field conditions frequently encompass multiple abiotic stressors. Thus, our work goes beyond the conventional approach of focusing solely on individual plant organs. The novel insights of the multi-organ, noninvasive phenotyping study provide a reference for testing hypotheses concerning the intricate dynamics of plant stress responses, as well as the potential interactive effects among various stressors.

High-throughput phenotyping using VIS/NIR spectroscopy in the classification of soybean genotypes for grain yield and industrial traits

Employing visible and near infrared sensors in high-throughput phenotyping provides insight into the relationship between the spectral characteristics of the leaf and the content of grain properties, helping soybean breeders to direct their program towards improving grain traits according to researchers' interests. Our research hypothesis is that the leaf reflectance of soybean genotypes can be directly related to industrial grain traits such as protein and fiber contents. Thus, the objectives of the study were: (i) to classify soybean genotypes according to the grain yield and industrial traits; (ii) to identify the algorithm(s) with the highest accuracy for classifying genotypes using leaf reflectance as model input; (iii) to identify the best input data for the algorithms to improve their performance. A field experiment was carried out in randomized block design with three replications and 32 soybean genotypes. At 60 days after emergence, spectral analysis was carried out on three leaf samples from each plot. A hyperspectral sensor was used to capture reflectance between the wavelengths from 450 to 824 nm. Representative spectral bands were selected and grouped into means. After harvest, grain yield was assessed and laboratory analyses of industrial traits were carried out. Spectral, industrial traits and yield data were subjected to statistical analysis. Data were analyzed by the following machine learning algorithms: J48 (J48) and REPTree (DT) decision trees, Random Forest (RF), Artificial Neural Networks (ANN), Support Vector Machine (SVM), and conventional Logistic Regression (LR) analysis. The clusters formed were used as the output of the models, while two groups of input data were used for the input of the models: the spectral variables (WL) noise-free obtained by the sensor (450-828 nm) and the spectral means of the selected bands (SB) (450.0-720.6 nm). Soybean genotypes were grouped according to their grain yield and industrial traits, in which the SVM and J48 algorithms performed better at classifying them. Using the spectral bands selected in the study improved the classification accuracy of the algorithms.

A comparative study of 11 non-linear regression models highlighting autoencoder, DBN, and SVR, enhanced by SHAP importance analysis in soybean branching prediction

To explore a robust tool for advancing digital breeding practices through an artificial intelligence-driven phenotype prediction expert system, we undertook a thorough analysis of 11 non-linear regression models. Our investigation specifically emphasized the significance of Support Vector Regression (SVR) and SHapley Additive exPlanations (SHAP) in predicting soybean branching. By using branching data (phenotype) of 1918 soybean accessions and 42 k SNP (Single Nucleotide Polymorphism) polymorphic data (genotype), this study systematically compared 11 non-linear regression AI models, including four deep learning models (DBN (deep belief network) regression, ANN (artificial neural network) regression, Autoencoders regression, and MLP (multilayer perceptron) regression) and seven machine learning models (e.g., SVR (support vector regression), XGBoost (eXtreme Gradient Boosting) regression, Random Forest regression, LightGBM regression, GPs (Gaussian processes) regression, Decision Tree regression, and Polynomial regression). After being evaluated by four valuation metrics: R2 (R-squared), MAE (Mean Absolute Error), MSE (Mean Squared Error), and MAPE (Mean Absolute Percentage Error), it was found that the SVR, Polynomial Regression, DBN, and Autoencoder outperformed other models and could obtain a better prediction accuracy when they were used for phenotype prediction. In the assessment of deep learning approaches, we exemplified the SVR model, conducting analyses on feature importance and gene ontology (GO) enrichment to provide comprehensive support. After comprehensively comparing four feature importance algorithms, no notable distinction was observed in the feature importance ranking scores across the four algorithms, namely Variable Ranking, Permutation, SHAP, and Correlation Matrix, but the SHAP value could provide rich information on genes with negative contributions, and SHAP importance was chosen for feature selection. The results of this study offer valuable insights into AI-mediated plant breeding, addressing challenges faced by traditional breeding programs. The method developed has broad applicability in phenotype prediction, minor QTL (quantitative trait loci) mining, and plant smart-breeding systems, contributing significantly to the advancement of AI-based breeding practices and transitioning from experience-based to data-based breeding.

A review of artificial intelligence-assisted omics techniques in plant defense: current trends and future directions

Plants intricately deploy defense systems to counter diverse biotic and abiotic stresses. Omics technologies, spanning genomics, transcriptomics, proteomics, and metabolomics, have revolutionized the exploration of plant defense mechanisms, unraveling molecular intricacies in response to various stressors. However, the complexity and scale of omics data necessitate sophisticated analytical tools for meaningful insights. This review delves into the application of artificial intelligence algorithms, particularly machine learning and deep learning, as promising approaches for deciphering complex omics data in plant defense research. The overview encompasses key omics techniques and addresses the challenges and limitations inherent in current AI-assisted omics approaches. Moreover, it contemplates potential future directions in this dynamic field. In summary, AI-assisted omics techniques present a robust toolkit, enabling a profound understanding of the molecular foundations of plant defense and paving the way for more effective crop protection strategies amidst climate change and emerging diseases.

Predicting rice diseases using advanced technologies at different scales: present status and future perspectives

The past few years have witnessed significant progress in emerging disease detection techniques for accurately and rapidly tracking rice diseases and predicting potential solutions. In this review we focus on image processing techniques using machine learning (ML) and deep learning (DL) models related to multi-scale rice diseases. Furthermore, we summarize applications of different detection techniques, including genomic, physiological, and biochemical approaches. In addition, we also present the state-of-the-art in contemporary optical sensing applications of pathogen-plant interaction phenotypes. This review serves as a valuable resource for researchers seeking effective solutions to address the challenges of high-throughput data and model recognition for early detection of issues affecting rice crops through ML and DL models.

Recent advances in artificial intelligence, mechanistic models, and speed breeding offer exciting opportunities for precise and accelerated genomics-assisted breeding

Given the challenges of population growth and climate change, there is an urgent need to expedite the development of high-yielding stress-tolerant crop cultivars. While traditional breeding methods have been instrumental in ensuring global food security, their efficiency, precision, and labour intensiveness have become increasingly inadequate to address present and future challenges. Fortunately, recent advances in high-throughput phenomics and genomics-assisted breeding (GAB) provide a promising platform for enhancing crop cultivars with greater efficiency. However, several obstacles must be overcome to optimize the use of these techniques in crop improvement, such as the complexity of phenotypic analysis of big image data. In addition, the prevalent use of linear models in genome-wide association studies (GWAS) and genomic selection (GS) fails to capture the nonlinear interactions of complex traits, limiting their applicability for GAB and impeding crop improvement. Recent advances in artificial intelligence (AI) techniques have opened doors to nonlinear modelling approaches in crop breeding, enabling the capture of nonlinear and epistatic interactions in GWAS and GS and thus making this variation available for GAB. While statistical and software challenges persist in AI-based models, they are expected to be resolved soon. Furthermore, recent advances in speed breeding have significantly reduced the time (3-5-fold) required for conventional breeding. Thus, integrating speed breeding with AI and GAB could improve crop cultivar development within a considerably shorter timeframe while ensuring greater accuracy and efficiency. In conclusion, this integrated approach could revolutionize crop breeding paradigms and safeguard food production in the face of population growth and climate change.

High-throughput phenotyping salt tolerance in JUNCAOs by combining prompt chlorophyll a fluorescence with hyperspectral spectroscopy

The planting of salt-tolerant plants is regarded as the one of important measurements to improve the saline-alkali lands. The outstanding biological properties of JUNCAOs have made them candidates to improve and utilize saline-alkali lands. At present, little attention has been paid to developing a non-destructive and high throughput approach to evaluate the salt tolerance of JUNCAO. To close the gaps, three typical JUNCAOs (A.donax. No.1, A.donax. No.5 and A.donax. No.10) were evaluated by combining prompt chlorophyll a fluorescence (ChlF) with hyperspectral spectroscopy (HS). The results showed that salt stress reduced relative stem growth, water content, and total chlorophyll content but enhanced the malondialdehyde (MDA) content. It caused a significant change in chlorophyll a fluorescence kinetics with an appearance of L-, K- and J-band, implying damaging energetic connectivity between PSII units, uncoupling of the oxygen evolving complex (OEC) and inhibition of the Q_A^-reoxidation. The negative impact of salt stress on JUNCAOs increased with the increasing level of salt concentration. Effect on spectral reflectance in the in the visible region with shifts on red edge position (REP) and blue edge position (BEP) to shorter wavelength was also found in salt stress plants. Combining principal component analysis (PCA) with the membership function method based on spectral indices and JIP-test parameters could well screen JUNCAOs salt tolerant ability with the highest for A.donax. NO.10 but lowest for A.donax. NO.1, which was the same as that of using conventional approach. The results demonstrate that prompt ChlF coupling with HS could provide potentials for non-invasively and high-throughput phenotyping salt tolerance in JUNCAOs.

Proximal hyperspectral sensing of abiotic stresses in plants

Recent attempts, advances and challenges, as well as future perspectives regarding the application of proximal hyperspectral sensing (where sensors are placed within 10 m above plants, either on land-based platforms or in controlled environments) to assess plant abiotic stresses have been critically reviewed. Abiotic stresses, caused by either physical or chemical reasons such as nutrient deficiency, drought, salinity, heavy metals, herbicides, extreme temperatures, and so on, may be more damaging than biotic stresses (affected by infectious agents such as bacteria, fungi, insects, etc.) on crop yields. The proximal hyperspectral sensing provides images at a sub-millimeter spatial resolution for doing an in-depth study of plant physiology and thus offers a global view of the plant's status and allows for monitoring spatio-temporal variations from large geographical areas reliably and economically. The literature update has been based on 362 research papers in this field, published from 2010, most of which are from four years ago and, in our knowledge, it is the first paper that provides a comprehensive review of the applications of the technique for the detection of various types of abiotic stresses in plants.

Machine learning versus crop growth models: an ally, not a rival

The rapid increases of the global population and climate change pose major challenges to a sustainable production of food to meet consumer demands. Process-based models (PBMs) have long been used in agricultural crop production for predicting yield and understanding the environmental regulation of plant physiological processes and its consequences for crop growth and development. In recent years, with the increasing use of sensor and communication technologies for data acquisition in agriculture, machine learning (ML) has become a popular tool in yield prediction (especially on a large scale) and phenotyping. Both PBMs and ML are frequently used in studies on major challenges in crop production and each has its own advantages and drawbacks. We propose to combine PBMs and ML given their intrinsic complementarity, to develop knowledge- and data-driven modelling (KDDM) with high prediction accuracy as well as good interpretability. Parallel, serial and modular structures are three main modes can be adopted to develop KDDM for agricultural applications. The KDDM approach helps to simplify model parameterization by making use of sensor data and improves the accuracy of yield prediction. Furthermore, the KDDM approach has great potential to expand the boundary of current crop models to allow upscaling towards a farm, regional or global level and downscaling to the gene-to-cell level. The KDDM approach is a promising way of combining simulation models in agriculture with the fast developments in data science while mechanisms of many genetic and physiological processes are still under investigation, especially at the nexus of increasing food production, mitigating climate change and achieving sustainability.

Artificial neural network modeling for deciphering the in vitro induced salt stress tolerance in chickpea (Cicer arietinum L)

Salt stress is one of the most critical abiotic stresses having significant contribution in global agriculture production. Chickpea is sensitive to salt stress at various growth stages and a better knowledge of salt tolerance in chickpea would enable breeding of salt tolerant varieties. During present investigation, in vitro screening of desi chickpea by continuous exposure of seeds to NaCl-containing medium was performed. NaCl was applied in the MS medium at the rate of 6.25, 12.50, 25, 50, 75, 100, and 125 mM. Different germination indices and growth indices of roots and shoots were recorded. Mean germination (%) of roots and shoots ranged from 52.08 to 100%, and 41.67-100%, respectively. The mean germination time (MGT) of roots and shoots ranged from 2.40 to 4.78 d and 3.23-7.05 d. The coefficient of variation of the germination time (CVt) was recorded as 20.91-53.43% for roots, and 14.53-44.17% for shoots. The mean germination rate (MR) of roots was better than shoots. The uncertainty (U) values were tabulated as 0.43-1.59 (roots) and 0.92-2.33 (shoots). The synchronization index (Z) reflected the negative impact of elevated salinity levels on both root and shoot emergence. Application of NaCl exerted a negative impact on all growth indices compared to control and decreased gradually with elevated NaCl concentration. Results on salt tolerance index (STI) also revealed the reduced STI with elevated NaCl concentration and STI of roots was less than shoot. Elemental analysis revealed more Na and Cl accumulation with respective elevated NaCl concentrations. The In vitro growth parameters and STI values validated and predicted by multilayer perceptron (MLP) model revealed the relatively high R 2 values of all growth indices and STI. Findings of this study will be helpful to broaden the understanding about the salinity tolerance level of desi chickpea seeds under in vitro conditions using various germination indices and seedling growth indices.

Supplementary Information

The online version contains supplementary material available at 10.1007/s12298-023-01282-z.

Exploring plant responses to abiotic stress by contrasting spectral signature changes

In this study, daily changes over a short period and diurnal progression of spectral reflectance at the leaf level were used to identify spring wheat genotypes (Triticum aestivum L.) susceptible to adverse conditions. Four genotypes were grown in pots experiments under semi-controlled conditions in Chile and Spain. Three treatments were applied: i) control (C), ii) water stress (WS), and iii) combined water and heat shock (WS+T). Spectral reflectance, gas exchange and chlorophyll fluorescence measurements were performed on flag leaves for three consecutive days at anthesis. High canopy temperature ( H _CT ) genotypes showed less variability in their mean spectral reflectance signature and chlorophyll fluorescence, which was related to weaker responses to environmental fluctuations. While low canopy temperature ( L _CT ) genotypes showed greater variability. The genotypes spectral signature changes, in accordance with environmental fluctuation, were associated with variations in their stomatal conductance under both stress conditions (WS and WS+T); L _CT genotypes showed an anisohydric response compared that of H _CT , which was isohydric. This approach could be used in breeding programs for screening a large number of genotypes through proximal or remote sensing tools and be a novel but simple way to identify groups of genotypes with contrasting performances.

Proximal and remote sensing in plant phenomics: 20 years of progress, challenges, and perspectives

Plant phenomics (PP) has been recognized as a bottleneck in studying the interactions of genomics and environment on plants, limiting the progress of smart breeding and precise cultivation. High-throughput plant phenotyping is challenging owing to the spatio-temporal dynamics of traits. Proximal and remote sensing (PRS) techniques are increasingly used for plant phenotyping because of their advantages in multi-dimensional data acquisition and analysis. Substantial progress of PRS applications in PP has been observed over the last two decades and is analyzed here from an interdisciplinary perspective based on 2972 publications. This progress covers most aspects of PRS application in PP, including patterns of global spatial distribution and temporal dynamics, specific PRS technologies, phenotypic research fields, working environments, species, and traits. Subsequently, we demonstrate how to link PRS to multi-omics studies, including how to achieve multi-dimensional PRS data acquisition and processing, how to systematically integrate all kinds of phenotypic information and derive phenotypic knowledge with biological significance, and how to link PP to multi-omics association analysis. Finally, we identify three future perspectives for PRS-based PP: (1) strengthening the spatial and temporal consistency of PRS data, (2) exploring novel phenotypic traits, and (3) facilitating multi-omics communication.

Detection of seed purity of hybrid wheat using reflectance and transmittance hyperspectral imaging technology

Chemical hybridization and genic male sterility systems are two main methods of hybrid wheat production; however, complete sterility of female wheat plants cannot be guaranteed owing to the influence of the growth stage and weather. Consequently, hybrid wheat seeds are inevitably mixed with few parent seeds, especially female seeds. Therefore, seed purity is a key factor in the popularization of hybrid wheat. However, traditional seed purity detection and variety identification methods are time-consuming, laborious, and destructive. Therefore, to establish a non-destructive classification method for hybrid and female parent seeds, three hybrid wheat varieties (Jingmai 9, Jingmai 11, and Jingmai 183) and their parent seeds were sampled. The transmittance and reflectance spectra of all seeds were collected via hyperspectral imaging technology, and a classification model was established using partial least squares-discriminant analysis (PLS-DA) combined with various preprocessing methods. The transmittance spectrum significantly improved the classification of hybrids and female parents compared to that obtained using reflectance spectrum. Specifically, using transmittance spectrum combined with a characteristic wavelength-screening algorithm, the Detrend-CARS-PLS-DA model was established, and the accuracy rates in the testing sets of Jingmai 9, Jingmai 11, and Jingmai 183 were 95.69%, 98.25%, and 97.25%, respectively. In conclusion, transmittance hyperspectral imaging combined with a machine learning algorithm can effectively distinguish female parent seeds from hybrid seeds. These results provide a reference for rapid seed purity detection in the hybrid production process. Owing to the non-destructive and rapid nature of hyperspectral imaging, the detection of hybrid wheat seed purity can be improved by online sorting in the future.

Integrating speed breeding with artificial intelligence for developing climate-smart crops

INTRODUCTION

In climate change, breeding crop plants with improved productivity, sustainability, and adaptability has become a daunting challenge to ensure global food security for the ever-growing global population. Correspondingly, climate-smart crops are also the need to regulate biomass production, which is imperative for the maintenance of ecosystem services worldwide. Since conventional breeding technologies for crop improvement are limited, time-consuming, and involve laborious selection processes to foster new and improved crop varieties. An urgent need is to accelerate the plant breeding cycle using artificial intelligence (AI) to depict plant responses to environmental perturbations in real-time.

MATERIALS AND METHODS

The review is a collection of authorized information from various sources such as journals, books, book chapters, technical bulletins, conference papers, and verified online contents.

CONCLUSIONS

Speed breeding has emerged as an essential strategy for accelerating the breeding cycles of crop plants by growing them under artificial light and temperature conditions. Furthermore, speed breeding can also integrate marker-assisted selection and cutting-edged gene-editing tools for early selection and manipulation of essential crops with superior agronomic traits. Scientists have recently applied next-generation AI to delve deeper into the complex biological and molecular mechanisms that govern plant functions under environmental cues. In addition, AIs can integrate, assimilate, and analyze complex OMICS data sets, an essential prerequisite for successful speed breeding protocol implementation to breed crop plants with superior yield and adaptability.

Capturing crop adaptation to abiotic stress using image-based technologies

Farmers and breeders aim to improve crop responses to abiotic stresses and secure yield under adverse environmental conditions. To achieve this goal and select the most resilient genotypes, plant breeders and researchers rely on phenotyping to quantify crop responses to abiotic stress. Recent advances in imaging technologies allow researchers to collect physiological data non-destructively and throughout time, making it possible to dissect complex plant responses into quantifiable traits. The use of image-based technologies enables the quantification of crop responses to stress in both controlled environmental conditions and field trials. This paper summarizes phenotyping imaging technologies (RGB, multispectral and hyperspectral sensors, among others) that have been used to assess different abiotic stresses including salinity, drought and nitrogen deficiency, while discussing their advantages and drawbacks. We present a detailed review of traits involved in abiotic tolerance, which have been quantified by a range of imaging sensors under high-throughput phenotyping facilities or using unmanned aerial vehicles in the field. We also provide an up-to-date compilation of spectral tolerance indices and discuss the progress and challenges in machine learning, including supervised and unsupervised models as well as deep learning.

Machine Learning in the Analysis of Multispectral Reads in Maize Canopies Responding to Increased Temperatures and Water Deficit

Real-time monitoring of crop responses to environmental deviations represents a new avenue for applications of remote and proximal sensing. Combining the high-throughput devices with novel machine learning (ML) approaches shows promise in the monitoring of agricultural production. The 3 × 2 multispectral arrays with responses at 610 and 680 nm (red), 730 and 760 nm (red-edge) and 810 and 860 nm (infrared) spectra were used to assess the occurrence of leaf rolling (LR) in 545 experimental maize plots measured four times for calibration dataset (n = 2180) and 145 plots measured once for external validation. Multispectral reads were used to calculate 15 simple normalized vegetation indices. Four ML algorithms were assessed: single and multilayer perceptron (SLP and MLP), convolutional neural network (CNN) and support vector machines (SVM) in three validation procedures, which were stratified cross-validation, random subset validation and validation with external dataset. Leaf rolling occurrence caused visible changes in spectral responses and calculated vegetation indexes. All algorithms showed good performance metrics in stratified cross-validation (accuracy >80%). SLP was the least efficient in predictions with external datasets, while MLP, CNN and SVM showed comparable performance. Combining ML with multispectral sensing shows promise in transition towards agriculture based on data-driven decisions especially considering the novel Internet of Things (IoT) avenues.

Transcriptome and hyperspectral profiling allows assessment of phosphorus nutrient status in rice under field conditions

Phosphorus (P) is one of the macronutrients indispensable for crop production, and therefore it is important to understand the potential of plants to adapt to low P conditions. We compared growth and leaf genome-wide transcriptome of four rice cultivars during growth between two fields with different amount of available phosphate and further analysed the acceptable range of P levels for normal growth from the view of both appearance traits and internal P nutrient status, which was measured by profiling the expression of the P indicator gene. This demonstrated that rice plants have a robustness to moderate P-deficient conditions expressing a system for P acquisition and usage without any effects on yield potential and that P indicator gene expression could be a useful index for early diagnosis of P status in plants. To develop a simple method for assessment of P status, we tried to predict the expression level using reflectance spectroscopy and hyperspectral imaging, thereby providing models with good performance. Our findings suggest that rice plants have the potential to adapt to moderate low P conditions in the field and showed that the hyperspectral technique is one of the useful tools for simple measurement of molecular-level dynamics reflecting internal nutrient conditions.

Sorting biotic and abiotic stresses on wild rocket by leaf-image hyperspectral data mining with an artificial intelligence model

BACKGROUND

Wild rocket (Diplotaxis tenuifolia) is prone to soil-borne stresses under intensive cultivation systems devoted to ready-to-eat salad chain, increasing needs for external inputs. Early detection of the abiotic and biotic stresses by using digital reflectance-based probes may allow optimization and enhance performances of the mitigation strategies.

METHODS

Hyperspectral image analysis was applied to D. tenuifolia potted plants subjected, in a greenhouse experiment, to five treatments for one week: a control treatment watered to 100% water holding capacity, two biotic stresses: Fusarium wilting and Rhizoctonia rotting, and two abiotic stresses: water deficit and salinity. Leaf hyperspectral fingerprints were submitted to an artificial intelligence pipeline for training and validating image-based classification models able to work in the stress range. Spectral investigation was corroborated by pertaining physiological parameters.

RESULTS

Water status was mainly affected by water deficit treatment, followed by fungal diseases, while salinity did not change water relations of wild rocket plants compared to control treatment. Biotic stresses triggered discoloration in plants just in a week after application of the treatments, as evidenced by the colour space coordinates and pigment contents values. Some vegetation indices, calculated on the bases of the reflectance data, targeted on plant vitality and chlorophyll content, healthiness, and carotenoid content, agreed with the patterns of variations observed for the physiological parameters. Artificial neural network helped selection of VIS (492-504, 540-568 and 712-720 nm) and NIR (855, 900-908 and 970 nm) bands, whose read reflectance contributed to discriminate stresses by imaging.

CONCLUSIONS

This study provided significative spectral information linked to the assessed stresses, allowing the identification of narrowed spectral regions and single wavelengths due to changes in photosynthetically active pigments and in water status revealing the etiological cause.

One hundred years into the study of ecotypes, new advances are being made through large-scale field experiments in perennial plant systems

A hundred years after Turesson first clearly described how locally adaptive variation is distributed within species, plant biologists are making major breakthroughs in our understanding of mechanisms underlying adaptation from local populations to the scale of continents. Although the genetics of local adaptation has typically been studied in smaller reciprocal transplant experiments, it is now being evaluated with whole genomes in large-scale networks of common garden experiments with perennial switchgrass and poplar trees. These studies support the hypothesis that a complex combination of loci, both with and without adaptive trade-offs, underlies local adaptation and that hybridization and adaptive introgression play a key role in the evolution of these species. Future studies incorporating high-throughput phenotyping, gene expression, and modeling will be used to predict responses of these species to climate change.

A Hyperspectral Data 3D Convolutional Neural Network Classification Model for Diagnosis of Gray Mold Disease in Strawberry Leaves

Gray mold disease is one of the most frequently occurring diseases in strawberries. Given that it spreads rapidly, rapid countermeasures are necessary through the development of early diagnosis technology. In this study, hyperspectral images of strawberry leaves that were inoculated with gray mold fungus to cause disease were taken; these images were classified into healthy and infected areas as seen by the naked eye. The areas where the infection spread after time elapsed were classified as the asymptomatic class. Square regions of interest (ROIs) with a dimensionality of 16 × 16 × 150 were acquired as training data, including infected, asymptomatic, and healthy areas. Then, 2D and 3D data were used in the development of a convolutional neural network (CNN) classification model. An effective wavelength analysis was performed before the development of the CNN model. Further, the classification model that was developed with 2D training data showed a classification accuracy of 0.74, while the model that used 3D data acquired an accuracy of 0.84; this indicated that the 3D data produced slightly better performance. When performing classification between healthy and asymptomatic areas for developing early diagnosis technology, the two CNN models showed a classification accuracy of 0.73 with regards to the asymptomatic ones. To increase accuracy in classifying asymptomatic areas, a model was developed by smoothing the spectrum data and expanding the first and second derivatives; the results showed that it was possible to increase the asymptomatic classification accuracy to 0.77 and reduce the misclassification of asymptomatic areas as healthy areas. Based on these results, it is concluded that the proposed 3D CNN classification model can be used as an early diagnosis sensor of gray mold diseases since it produces immediate on-site analysis results of hyperspectral images of leaves.

A Review of Deep Learning in Multiscale Agricultural Sensing

Population growth, climate change, and the worldwide COVID-19 pandemic are imposing increasing pressure on global agricultural production. The challenge of increasing crop yield while ensuring sustainable development of environmentally friendly agriculture is a common issue throughout the world. Autonomous systems, sensing technologies, and artificial intelligence offer great opportunities to tackle this issue. In precision agriculture (PA), non-destructive and non-invasive remote and proximal sensing methods have been widely used to observe crops in visible and invisible spectra. Nowadays, the integration of high-performance imagery sensors (e.g., RGB, multispectral, hyperspectral, thermal, and SAR) and unmanned mobile platforms (e.g., satellites, UAVs, and terrestrial agricultural robots) are yielding a huge number of high-resolution farmland images, in which rich crop information is compressed. However, this has been accompanied by challenges, i.e., ways to swiftly and efficiently making full use of these images, and then, to perform fine crop management based on information-supported decision making. In the past few years, deep learning (DL) has shown great potential to reshape many industries because of its powerful capabilities of feature learning from massive datasets, and the agriculture industry is no exception. More and more agricultural scientists are paying attention to applications of deep learning in image-based farmland observations, such as land mapping, crop classification, biotic/abiotic stress monitoring, and yield prediction. To provide an update on these studies, we conducted a comprehensive investigation with a special emphasis on deep learning in multiscale agricultural remote and proximal sensing. Specifically, the applications of convolutional neural network-based supervised learning (CNN-SL), transfer learning (TL), and few-shot learning (FSL) in crop sensing at land, field, canopy, and leaf scales are the focus of this review. We hope that this work can act as a reference for the global agricultural community regarding DL in PA and can inspire deeper and broader research to promote the evolution of modern agriculture.

Determination of the quantitative content of chlorophylls in leaves by reflection spectra using the random forest algorithm

Determining the quantitative content of chlorophylls in plant leaves by their reflection spectra is an important task both in monitoring the state of natural and industrial phytocenoses, and in laboratory studies of normal and pathological processes during plant growth. The use of machine learning methods for these purposes is promising, since these methods allow inferring the relationships between input and output variables (prediction model), and in order to improve the quality of the prediction, a researcher may modify predictors and selects a set of method parameters. Here, we present the results of the implementation and evaluation of the random forest algorithm for predicting the total concentration of chlorophylls a and b from the reflection spectra of plant leaves in the visible and infrared wavelengths. We used the reflection spectra for 276 leaf samples from 39 plant species obtained from open sources. 181 samples were from the sycamore maple (Acer pseudoplatanus L.). The reflection spectrum represented wavelengths from 400 to 2500 nm with a step of 1 nm. The training set consisted of the 85 % of A. pseudoplatanus L. samples, and the performance was evaluated on the remaining 15 % samples of this species (validation sample). Six models based on the random forest algorithm with different predictors were evaluated. The selection of control parameters was performed by cross-checking on five partitions. For the first model, the intensity of the reflection spectra without any transformation was used. Based on the analysis of this model, the optimal ranges of wavelengths for the remaining five models were selected. The best results were obtained by models that used a two-point estimation of the derivative of the reflection spectrum in the visible wavelength range as input data. We compared one of these models (the two-point estimation of the derivative of the reflection spectrum in the range of 400-800 nm with a step of 1 nm) with the model by other authors (which is based on the functional dependence between two unknown parameters selected by the least squares method and two reflection coefficients, the choice of which is described in the article). The comparison of the results of predictions of the model based on the random forest algorithm with the model of other authors was carried out both on the validation sample of maple and on the sample from other plant species. In the first case, the predictions of the method based on a random forest had a lower estimate of the standard deviation. In the second case, the predictions of this method had a large error for small values of chlorophyll, while the third-party method had acceptable predictions. The article provides the analysis of the results, as well as recommendations for using this machine learning method to assess the quantitative content of chlorophylls in leaves.

Genome-Wide Association Studies of Soybean Yield-Related Hyperspectral Reflectance Bands Using Machine Learning-Mediated Data Integration Methods

In conjunction with big data analysis methods, plant omics technologies have provided scientists with cost-effective and promising tools for discovering genetic architectures of complex agronomic traits using large breeding populations. In recent years, there has been significant progress in plant phenomics and genomics approaches for generating reliable large datasets. However, selecting an appropriate data integration and analysis method to improve the efficiency of phenome-phenome and phenome-genome association studies is still a bottleneck. This study proposes a hyperspectral wide association study (HypWAS) approach as a phenome-phenome association analysis through a hierarchical data integration strategy to estimate the prediction power of hyperspectral reflectance bands in predicting soybean seed yield. Using HypWAS, five important hyperspectral reflectance bands in visible, red-edge, and near-infrared regions were identified significantly associated with seed yield. The phenome-genome association analysis of each tested hyperspectral reflectance band was performed using two conventional genome-wide association studies (GWAS) methods and a machine learning mediated GWAS based on the support vector regression (SVR) method. Using SVR-mediated GWAS, more relevant QTL with the physiological background of the tested hyperspectral reflectance bands were detected, supported by the functional annotation of candidate gene analyses. The results of this study have indicated the advantages of using hierarchical data integration strategy and advanced mathematical methods coupled with phenome-phenome and phenome-genome association analyses for a better understanding of the biology and genetic backgrounds of hyperspectral reflectance bands affecting soybean yield formation. The identified yield-related hyperspectral reflectance bands using HypWAS can be used as indirect selection criteria for selecting superior genotypes with improved yield genetic gains in large breeding populations.

Wheat physiology predictor: predicting physiological traits in wheat from hyperspectral reflectance measurements using deep learning

BACKGROUND

The need for rapid in-field measurement of key traits contributing to yield over many thousands of genotypes is a major roadblock in crop breeding. Recently, leaf hyperspectral reflectance data has been used to train machine learning models using partial least squares regression (PLSR) to rapidly predict genetic variation in photosynthetic and leaf traits across wheat populations, among other species. However, the application of published PLSR spectral models is limited by a fixed spectral wavelength range as input and the requirement of separate custom-built models for each trait and wavelength range. In addition, the use of reflectance spectra from the short-wave infrared region requires expensive multiple detector spectrometers. The ability to train a model that can accommodate input from different spectral ranges would potentially make such models extensible to more affordable sensors. Here we compare the accuracy of prediction of PLSR with various deep learning approaches and an ensemble model, each trained and tested using previously published data sets.

RESULTS

We demonstrate that the accuracy of PLSR to predict photosynthetic and related leaf traits in wheat can be improved with deep learning-based and ensemble models without overfitting. Additionally, these models can be flexibly applied across spectral ranges without significantly compromising accuracy.

CONCLUSION

The method reported provides an improved prediction of wheat leaf and photosynthetic traits from leaf hyperspectral reflectance and do not require a full range, high cost leaf spectrometer. We provide a web service for deploying these algorithms to predict physiological traits in wheat from a variety of spectral data sets, with important implications for wheat yield prediction and crop breeding.

Hyperspectral Imaging Combined with Machine Learning for the Detection of Fusiform Rust Disease Incidence in Loblolly Pine Seedlings

Loblolly pine is an economically important timber species in the United States, with almost 1 billion seedlings produced annually. The most significant disease affecting this species is fusiform rust, caused by Cronartium quercuum f. sp. fusiforme. Testing for disease resistance in the greenhouse involves artificial inoculation of seedlings followed by visual inspection for disease incidence. An automated, high-throughput phenotyping method could improve both the efficiency and accuracy of the disease screening process. This study investigates the use of hyperspectral imaging for the detection of diseased seedlings. A nursery trial comprising families with known in-field rust resistance data was conducted, and the seedlings were artificially inoculated with fungal spores. Hyperspectral images in the visible and near-infrared region (400–1000 nm) were collected six months after inoculation. The disease incidence was scored with traditional methods based on the presence or absence of visible stem galls. The seedlings were segmented from the background by thresholding normalized difference vegetation index (NDVI) images, and the delineation of individual seedlings was achieved through object detection using the Faster RCNN model. Plant parts were subsequently segmented using the DeepLabv3+ model. The trained DeepLabv3+ model for semantic segmentation achieved a pixel accuracy of 0.76 and a mean Intersection over Union (mIoU) of 0.62. Crown pixels were segmented using geometric features. Support vector machine discrimination models were built for classifying the plants into diseased and non-diseased classes based on spectral data, and balanced accuracy values were calculated for the comparison of model performance. Averaged spectra from the whole plant (balanced accuracy = 61%), the crown (61%), the top half of the stem (77%), and the bottom half of the stem (62%) were used. A classification model built using the spectral data from the top half of the stem was found to be the most accurate, and resulted in an area under the receiver operating characteristic curve (AUC) of 0.83.

Development of an Image Analysis Pipeline to Estimate Sphagnum Colony Density in the Field

Sphagnum peatmosses play an important part in water table management of many peatland ecosystems. Keeping the ecosystem saturated, they slow the breakdown of organic matter and release of greenhouse gases, facilitating peatland’s function as a carbon sink rather than a carbon source. Although peatland monitoring and restoration programs have increased recently, there are few tools to quantify traits that Sphagnum species display in their ecosystems. Colony density is often described as an important determinant in the establishment and performance in Sphagnum but detailed evidence for this is limited. In this study, we describe an image analysis pipeline that accurately annotates Sphagnum capitula and estimates plant density using open access computer vision packages. The pipeline was validated using images of different Sphagnum species growing in different habitats, taken on different days and with different smartphones. The developed pipeline achieves high accuracy scores, and we demonstrate its utility by estimating colony densities in the field and detecting intra and inter-specific colony densities and their relationship with habitat. This tool will enable ecologists and conservationists to rapidly acquire accurate estimates of Sphagnum density in the field without the need of specialised equipment.

High-Throughput Phenotyping: A Platform to Accelerate Crop Improvement

Development of high-throughput phenotyping technologies has progressed considerably in the last 10 years. These technologies provide precise measurements of desired traits among thousands of field-grown plants under diversified environments; this is a critical step towards selection of better performing lines as to yield, disease resistance, and stress tolerance to accelerate crop improvement programs. High-throughput phenotyping techniques and platforms help unraveling the genetic basis of complex traits associated with plant growth and development and targeted traits. This review focuses on the advancements in technologies involved in high-throughput, field-based, aerial, and unmanned platforms. Development of user-friendly data management tools and softwares to better understand phenotyping will increase the use of field-based high-throughput techniques, which have potential to revolutionize breeding strategies and meet the future needs of stakeholders.

High-throughput image segmentation and machine learning approaches in the plant sciences across multiple scales

Agriculture has benefited greatly from the rise of big data and high-performance computing. The acquisition and analysis of data across biological scales have resulted in strategies modeling inter- actions between plant genotype and environment, models of root architecture that provide insight into resource utilization, and the elucidation of cell-to-cell communication mechanisms that are instrumental in plant development. Image segmentation and machine learning approaches for interpreting plant image data are among many of the computational methodologies that have evolved to address challenging agricultural and biological problems. These approaches have led to contributions such as the accelerated identification of gene that modulate stress responses in plants and automated high-throughput phenotyping for early detection of plant diseases. The continued acquisition of high throughput imaging across multiple biological scales provides opportunities to further push the boundaries of our understandings quicker than ever before. In this review, we explore the current state of the art methodologies in plant image segmentation and machine learning at the agricultural, organ, and cellular scales in plants. We show how the methodologies for segmentation and classification differ due to the diversity of physical characteristics found at these different scales. We also discuss the hardware technologies most commonly used at these different scales, the types of quantitative metrics that can be extracted from these images, and how the biological mechanisms by which plants respond to abiotic/biotic stresses or genotypic modifications can be extracted from these approaches.

Combining Multi-Dimensional Convolutional Neural Network (CNN) With Visualization Method for Detection of Aphis gossypii Glover Infection in Cotton Leaves Using Hyperspectral Imaging

Cotton is a significant economic crop. It is vulnerable to aphids (Aphis gossypii Glovers) during the growth period. Rapid and early detection has become an important means to deal with aphids in cotton. In this study, the visible/near-infrared (Vis/NIR) hyperspectral imaging system (376-1044 nm) and machine learning methods were used to identify aphid infection in cotton leaves. Both tall and short cotton plants (Lumianyan 24) were inoculated with aphids, and the corresponding plants without aphids were used as control. The hyperspectral images (HSIs) were acquired five times at an interval of 5 days. The healthy and infected leaves were used to establish the datasets, with each leaf as a sample. The spectra and RGB images of each cotton leaf were extracted from the hyperspectral images for one-dimensional (1D) and two-dimensional (2D) analysis. The hyperspectral images of each leaf were used for three-dimensional (3D) analysis. Convolutional Neural Networks (CNNs) were used for identification and compared with conventional machine learning methods. For the extracted spectra, 1D CNN had a fine classification performance, and the classification accuracy could reach 98%. For RGB images, 2D CNN had a better classification performance. For HSIs, 3D CNN performed moderately and performed better than 2D CNN. On the whole, CNN performed relatively better than conventional machine learning methods. In the process of 1D, 2D, and 3D CNN visualization, the important wavelength ranges were analyzed in 1D and 3D CNN visualization, and the importance of wavelength ranges and spatial regions were analyzed in 2D and 3D CNN visualization. The overall results in this study illustrated the feasibility of using hyperspectral imaging combined with multi-dimensional CNN to detect aphid infection in cotton leaves, providing a new alternative for pest infection detection in plants.

Morphological, Physiological and Molecular Markers for Salt-Stressed Plants

Plant growth and development is adversely affected by different kind of stresses. One of the major abiotic stresses, salinity, causes complex changes in plants by influencing the interactions of genes. The modulated genetic regulation perturbs metabolic balance, which may alter plant's physiology and eventually causing yield losses. To improve agricultural output, researchers have concentrated on identification, characterization and selection of salt tolerant varieties and genotypes, although, most of these varieties are less adopted for commercial production. Nowadays, phenotyping plants through Machine learning (deep learning) approaches that analyze the images of plant leaves to predict biotic and abiotic damage on plant leaves have increased. Here, we review salinity stress related markers on molecular, physiological and morphological levels for crops such as maize, rice, ryegrass, tomato, salicornia, wheat and model plant, Arabidopsis. The combined analysis of data from stress markers on different levels together with image data are important for understanding the impact of salt stress on plants.

Predicting Plant Growth from Time-Series Data Using Deep Learning

Phenotyping involves the quantitative assessment of the anatomical, biochemical, and physiological plant traits. Natural plant growth cycles can be extremely slow, hindering the experimental processes of phenotyping. Deep learning offers a great deal of support for automating and addressing key plant phenotyping research issues. Machine learning-based high-throughput phenotyping is a potential solution to the phenotyping bottleneck, promising to accelerate the experimental cycles within phenomic research. This research presents a study of deep networks’ potential to predict plants’ expected growth, by generating segmentation masks of root and shoot systems into the future. We adapt an existing generative adversarial predictive network into this new domain. The results show an efficient plant leaf and root segmentation network that provides predictive segmentation of what a leaf and root system will look like at a future time, based on time-series data of plant growth. We present benchmark results on two public datasets of Arabidopsis (A. thaliana) and Brassica rapa (Komatsuna) plants. The experimental results show strong performance, and the capability of proposed methods to match expert annotation. The proposed method is highly adaptable, trainable (transfer learning/domain adaptation) on different plant species and mutations.

Proximal Methods for Plant Stress Detection Using Optical Sensors and Machine Learning

Plant stresses have been monitored using the imaging or spectrometry of plant leaves in the visible (red-green-blue or RGB), near-infrared (NIR), infrared (IR), and ultraviolet (UV) wavebands, often augmented by fluorescence imaging or fluorescence spectrometry. Imaging at multiple specific wavelengths (multi-spectral imaging) or across a wide range of wavelengths (hyperspectral imaging) can provide exceptional information on plant stress and subsequent diseases. Digital cameras, thermal cameras, and optical filters have become available at a low cost in recent years, while hyperspectral cameras have become increasingly more compact and portable. Furthermore, smartphone cameras have dramatically improved in quality, making them a viable option for rapid, on-site stress detection. Due to these developments in imaging technology, plant stresses can be monitored more easily using handheld and field-deployable methods. Recent advances in machine learning algorithms have allowed for images and spectra to be analyzed and classified in a fully automated and reproducible manner, without the need for complicated image or spectrum analysis methods. This review will highlight recent advances in portable (including smartphone-based) detection methods for biotic and abiotic stresses, discuss data processing and machine learning techniques that can produce results for stress identification and classification, and suggest future directions towards the successful translation of these methods into practical use.

Molecular Modeling Applied to the Discovery of New Lead Compounds for P2 Receptors Based on Natural Sources

P2 receptors are a family of transmembrane receptors activated by nucleotides and nucleosides. Two classes have been described in mammals, P2X and P2Y, which are implicated in various diseases. Currently, only P2Y12 has medicines approved for clinical use as antiplatelet agents and natural products have emerged as a source of new drugs with action on P2 receptors due to the diversity of chemical structures. In drug discovery, in silico virtual screening (VS) techniques have become popular because they have numerous advantages, which include the evaluation of thousands of molecules against a target, usually proteins, faster and cheaper than classical high throughput screening (HTS). The number of studies using VS techniques has been growing in recent years and has led to the discovery of new molecules of natural origin with action on different P2X and P2Y receptors. Using different algorithms it is possible to obtain information on absorption, distribution, metabolism, toxicity, as well as predictions on biological activity and the lead-likeness of the selected hits. Selected biomolecules may then be tested by molecular dynamics and, if necessary, rationally designed or modified to improve their interaction for the target. The algorithms of these in silico tools are being improved to permit the precision development of new drugs and, in the future, this process will take the front of drug development against some central nervous system (CNS) disorders. Therefore, this review discusses the methodologies of in silico tools concerning P2 receptors, as well as future perspectives and discoveries, such as the employment of artificial intelligence in drug discovery.

Image-Based Machine Learning Characterizes Root Nodule in Soybean Exposed to Silicon

Silicon promotes nodule formation in legume roots which is crucial for nitrogen fixation. However, it is very time-consuming and laborious to count the number of nodules and to measure nodule size manually, which led nodule characterization not to be study as much as other agronomical characters. Thus, the current study incorporated various techniques including machine learning to determine the number and size of root nodules and identify various root phenotypes from root images that may be associated with nodule formation with and without silicon treatment. Among those techniques, the machine learning for characterizing nodule is the first attempt, which enabled us to find high correlations among root phenotypes including root length, number of forks, and average link angles, and nodule characters such as number of nodules and nodule size with silicon treatments. The methods here could greatly accelerate further investigation such as delineating the optimal concentration of silicon for nodule formation.

Principles and Applications of Vibrational Spectroscopic Imaging in Plant Science: A Review

Detailed knowledge about plant chemical constituents and their distributions from organ level to sub-cellular level is of critical interest to basic and applied sciences. Spectral imaging techniques offer unparalleled advantages in that regard. The core advantage of these technologies is that they acquire spatially distributed semi-quantitative information of high specificity towards chemical constituents of plants. This forms invaluable asset in the studies on plant biochemical and structural features. In certain applications, non-invasive analysis is possible. The information harvested through spectral imaging can be used for exploration of plant biochemistry, physiology, metabolism, classification, and phenotyping among others, with significant gains for basic and applied research. This article aims to present a general perspective about vibrational spectral imaging/micro-spectroscopy in the context of plant research. Within the scope of this review are infrared (IR), near-infrared (NIR) and Raman imaging techniques. To better expose the potential and limitations of these techniques, fluorescence imaging is briefly overviewed as a method relatively less flexible but particularly powerful for the investigation of photosynthesis. Included is a brief introduction to the physical, instrumental, and data-analytical background essential for the applications of imaging techniques. The applications are discussed on the basis of recent literature.