Data-mining Techniques for Image-based Plant Phenotypic Traits Identification and Classification

Classification of high-throughput phenotyping data for differentiation among nutrient deficiency in common bean

The development of automated, image-based, high-throughput plant phenotyping enabled the simultaneous measurement of many plant traits. Big and complex phenotypic datasets require advanced statistical methods which enable the extraction of the most valuable traits when combined with other measurements, interpretation, and understanding of their (eco)physiological background. Nutrient deficiency in plants causes specific symptoms that can be easily detected by multispectral imaging, 3D scanning, and chlorophyll fluorescence measurements. Screening of numerous image-based phenotypic traits of common bean plants grown in nutrient-deficient solutions was conducted to optimize phenotyping and select the most valuable phenotypic traits related to the specific nutrient deficit. Discriminant analysis was used to compare the efficiency of groups of traits obtained by high-throughput phenotyping techniques (chlorophyll fluorescence, multispectral traits, and morphological traits) in discrimination between nutrients [nitrogen (N), phosphorus (P), potassium (K), magnesium (Mg), and iron (Fe)] at early and prolonged deficiency. Furthermore, a recursive partitioning analysis was used to select variables within each group of traits that show the highest accuracy for assigning plants to the respective nutrient deficit treatment. Using the entire set of measured traits, the highest classification success by discriminant function was achieved using multispectral traits. In the subsequent measurements, chlorophyll fluorescence and multispectral traits achieved comparably high classification success. Recursive partitioning analysis was able to intrinsically identify variables within each group of traits and their threshold values that best separate the observations from different nutrient deficiency groups. Again, the highest success in assigning plants into their respective groups was achieved based on selected multispectral traits. Selected chlorophyll fluorescence traits also showed high accuracy for assigning plants into control, Fe, Mg, and P deficit but could not correctly assign K and N deficit plants. This study has shown the usefulness of combining high-throughput phenotyping techniques with advanced data analysis to determine and differentiate nutrient deficiency stress.

High-throughput plant phenotyping: a role for metabolomics?

High-throughput (HTP) plant phenotyping approaches are developing rapidly and are already helping to bridge the genotype-phenotype gap. However, technologies should be developed beyond current physico-spectral evaluations to extend our analytical capacities to the subcellular level. Metabolites define and determine many key physiological and agronomic features in plants and an ability to integrate a metabolomics approach within current HTP phenotyping platforms has huge potential for added value. While key challenges remain on several fronts, novel technological innovations are upcoming yet under-exploited in a phenotyping context. In this review, we present an overview of the state of the art and how current limitations might be overcome to enable full integration of metabolomics approaches into a generic phenotyping pipeline in the near future.

Robust High-Throughput Phenotyping with Deep Segmentation Enabled by a Web-Based Annotator

The abilities of plant biologists and breeders to characterize the genetic basis of physiological traits are limited by their abilities to obtain quantitative data representing precise details of trait variation, and particularly to collect this data at a high-throughput scale with low cost. Although deep learning methods have demonstrated unprecedented potential to automate plant phenotyping, these methods commonly rely on large training sets that can be time-consuming to generate. Intelligent algorithms have therefore been proposed to enhance the productivity of these annotations and reduce human efforts. We propose a high-throughput phenotyping system which features a Graphical User Interface (GUI) and a novel interactive segmentation algorithm: Semantic-Guided Interactive Object Segmentation (SGIOS). By providing a user-friendly interface and intelligent assistance with annotation, this system offers potential to streamline and accelerate the generation of training sets, reducing the effort required by the user. Our evaluation shows that our proposed SGIOS model requires fewer user inputs compared to the state-of-art models for interactive segmentation. As a case study of the use of the GUI applied for genetic discovery in plants, we present an example of results from a preliminary genome-wide association study (GWAS) of in planta regeneration in Populus trichocarpa (poplar). We further demonstrate that the inclusion of a semantic prior map with SGIOS can accelerate the training process for future GWAS, using a sample of a dataset extracted from a poplar GWAS of in vitro regeneration. The capabilities of our phenotyping system surpass those of unassisted humans to rapidly and precisely phenotype our traits of interest. The scalability of this system enables large-scale phenomic screens that would otherwise be time-prohibitive, thereby providing increased power for GWAS, mutant screens, and other studies relying on large sample sizes to characterize the genetic basis of trait variation. Our user-friendly system can be used by researchers lacking a computational background, thus helping to democratize the use of deep segmentation as a tool for plant phenotyping.

A Novel Computational Framework for Precision Diagnosis and Subtype Discovery of Plant With Lesion

Plants are often attacked by various pathogens during their growth, which may cause environmental pollution, food shortages, or economic losses in a certain area. Integration of high throughput phenomics data and computer vision (CV) provides a great opportunity to realize plant disease diagnosis in the early stage and uncover the subtype or stage patterns in the disease progression. In this study, we proposed a novel computational framework for plant disease identification and subtype discovery through a deep-embedding image-clustering strategy, Weighted Distance Metric and the t-stochastic neighbor embedding algorithm (WDM-tSNE). To verify the effectiveness, we applied our method on four public datasets of images. The results demonstrated that the newly developed tool is capable of identifying the plant disease and further uncover the underlying subtypes associated with pathogenic resistance. In summary, the current framework provides great clustering performance for the root or leave images of diseased plants with pronounced disease spots or symptoms.

Chemometric approaches for calibrating high-throughput spectral imaging setups to support digital plant phenotyping by calibrating and transferring spectral models from a point spectrometer

Visible and near-infrared (Vis-NIR) spectral imaging is appearing as a potential tool to support high-throughput digital agricultural plant phenotyping. One of the uses of spectral imaging is to predict non-destructively the chemical constituents in the plants such as nitrogen content which can be related to the functional status of plants. However, before using high-throughput spectral imaging, it requires extensive calibration, just as needed for any other spectral sensor. Calibrating the high-throughput spectral imaging setup can be a challenging task as the resources needed to run experiments in high-throughput setups are far more than performing measurements with point spectrometers. Hence, to supply a resource-efficient approach to calibrate spectral cameras integrated with high-throughput plant phenotyping setups, this study proposes the use of chemometric calibration transfer (CT) and model update. The main idea was to use a point spectrometer to develop the primary model and transfer it to the spectral cameras integrated into the high-throughput setups. The potential of the approach was showed using a real Vis-NIR dataset related to nitrogen prediction in wheat plants measured with point spectrometer, tabletop spectral cameras and spectral cameras integrated with a high-throughput plant phenotyping setup. For CT and model update, direct standardization and parameter-free calibration enhancement approaches were explored. A key aim of this study was to only use and compare techniques that does not require any further optimization as they can be easily implemented by the plant biologist in future applications. The proposed approach based on the transfer of point spectroscopy models to spectral cameras in a high-throughput setup can allow spectral calibrations to be sharable and widely applicable, thus helping the global digital plant phenotyping community.

Predicting Heritability of Oil Palm Breeding Using Phenotypic Traits and Machine Learning

Oil palm is one of the main crops grown to help achieve sustainability in Malaysia. The selection of the best breeds will produce quality crops and increase crop yields. This study aimed to examine machine learning (ML) in oil palm breeding (OPB) using factors other than genetic data. A new conceptual framework to adopt the ML in OPB will be presented at the end of this paper. At first, data types, phenotype traits, current ML models, and evaluation technique will be identified through a literature survey. This study found that the phenotype and genotype data are widely used in oil palm breeding programs. The average bunch weight, bunch number, and fresh fruit bunch are the most important characteristics that can influence the genetic improvement of progenies. Although machine learning approaches have been applied to increase the productivity of the crop, most studies focus on molecular markers or genotypes for plant breeding, rather than on phenotype. Theoretically, the use of phenotypic data related to offspring should predict high breeding values by using ML. Therefore, a new ML conceptual framework to study the phenotype and progeny data of oil palm breeds will be discussed in relation to achieving the Sustainable Development Goals (SDGs).

Neural Network-Based Mapping Mining of Image Style Transfer in Big Data Systems

Image style transfer can realize the mutual transfer between different styles of images and is an essential application for big data systems. The use of neural network-based image data mining technology can effectively mine the useful information in the image and improve the utilization rate of information. However, when using the deep learning method to transform the image style, the content information is often lost. To address this problem, this paper introduces L1 loss on the basis of the VGG-19 network to reduce the difference between image style and content and adds perceptual loss to calculate the semantic information of the feature map to improve the model's perceptual ability. Experiments show that the proposal in this paper improves the ability of style transfer, while maintaining image content information. The stylization of the improved model can better meet people's requirements for stylization, and the evaluation indexes of structural similarity, cosine similarity, and mutual information value have increased by 0.323%, 0.094%, and 3.591%, respectively.

Genetic mapping of the early responses to salt stress in Arabidopsis thaliana

Salt stress decreases plant growth prior to significant ion accumulation in the shoot. However, the processes underlying this rapid reduction in growth are still unknown. To understand the changes in salt stress responses through time and at multiple physiological levels, examining different plant processes within a single set-up is required. Recent advances in phenotyping has allowed the image-based estimation of plant growth, morphology, colour and photosynthetic activity. In this study, we examined the salt stress-induced responses of 191 Arabidopsis accessions from 1 h to 7 days after treatment using high-throughput phenotyping. Multivariate analyses and machine learning algorithms identified that quantum yield measured in the light-adapted state (F_v' /F_m' ) greatly affected growth maintenance in the early phase of salt stress, whereas the maximum quantum yield (QY_max ) was crucial at a later stage. In addition, our genome-wide association study (GWAS) identified 770 loci that were specific to salt stress, in which two loci associated with QY_max and F_v' /F_m' were selected for validation using T-DNA insertion lines. We characterized an unknown protein kinase found in the QY_max locus that reduced photosynthetic efficiency and growth maintenance under salt stress. Understanding the molecular context of the candidate genes identified will provide valuable insights into the early plant responses to salt stress. Furthermore, our work incorporates high-throughput phenotyping, multivariate analyses and GWAS, uncovering details of temporal stress responses and identifying associations across different traits and time points, which are likely to constitute the genetic components of salinity tolerance.

Review: Application of Artificial Intelligence in Phenomics

Plant phenomics has been rapidly advancing over the past few years. This advancement is attributed to the increased innovation and availability of new technologies which can enable the high-throughput phenotyping of complex plant traits. The application of artificial intelligence in various domains of science has also grown exponentially in recent years. Notably, the computer vision, machine learning, and deep learning aspects of artificial intelligence have been successfully integrated into non-invasive imaging techniques. This integration is gradually improving the efficiency of data collection and analysis through the application of machine and deep learning for robust image analysis. In addition, artificial intelligence has fostered the development of software and tools applied in field phenotyping for data collection and management. These include open-source devices and tools which are enabling community driven research and data-sharing, thereby availing the large amounts of data required for the accurate study of phenotypes. This paper reviews more than one hundred current state-of-the-art papers concerning AI-applied plant phenotyping published between 2010 and 2020. It provides an overview of current phenotyping technologies and the ongoing integration of artificial intelligence into plant phenotyping. Lastly, the limitations of the current approaches/methods and future directions are discussed.

Interactive machine learning for soybean seed and seedling quality classification

New computer vision solutions combined with artificial intelligence algorithms can help recognize patterns in biological images, reducing subjectivity and optimizing the analysis process. The aim of this study was to propose an approach based on interactive and traditional machine learning methods to classify soybean seeds and seedlings according to their appearance and physiological potential. In addition, we correlated the appearance of seeds to their physiological performance. Images of soybean seeds and seedlings were used to develop models using low-cost approaches and free-access software. The models developed showed high performance, with overall accuracy reaching 0.94 for seeds and seedling classification. The high precision of the models that were developed based on interactive and traditional machine learning demonstrated that the method can easily be used to classify soybean seeds according to their appearance, as well as to classify soybean seedling vigor quickly and non-subjectively. The appearance of soybean seeds is strongly correlated with their physiological performance.