GPhenoVision: A Ground Mobile System with Multi-modal Imaging for Field-Based High Throughput Phenotyping of Cotton

Cyber-agricultural systems for crop breeding and sustainable production

The cyber-agricultural system (CAS) represents an overarching framework of agriculture that leverages recent advances in ubiquitous sensing, artificial intelligence, smart actuators, and scalable cyberinfrastructure (CI) in both breeding and production agriculture. We discuss the recent progress and perspective of the three fundamental components of CAS - sensing, modeling, and actuation - and the emerging concept of agricultural digital twins (DTs). We also discuss how scalable CI is becoming a key enabler of smart agriculture. In this review we shed light on the significance of CAS in revolutionizing crop breeding and production by enhancing efficiency, productivity, sustainability, and resilience to changing climate. Finally, we identify underexplored and promising future directions for CAS research and development.

A hyperspectral plant health monitoring system for space crop production

Compact and automated sensing systems are needed to monitor plant health for NASA's controlled-environment space crop production. A new hyperspectral system was designed for early detection of plant stresses using both reflectance and fluorescence imaging in visible and near-infrared (VNIR) wavelength range (400-1000 nm). The prototype system mainly includes two LED line lights providing VNIR broadband and UV-A (365 nm) light for reflectance and fluorescence measurement, respectively, a line-scan hyperspectral camera, and a linear motorized stage with a travel range of 80 cm. In an overhead sensor-to-sample arrangement, the stage translates the lights and camera over the plants to acquire reflectance and fluorescence images in sequence during one cycle of line-scan imaging. System software was developed using LabVIEW to realize hardware parameterization, data transfer, and automated imaging functions. The imaging unit was installed in a plant growth chamber at NASA Kennedy Space Center for health monitoring studies for pick-and-eat salad crops. A preliminary experiment was conducted to detect plant drought stress for twelve Dragoon lettuce samples, of which half were well-watered and half were under-watered while growing. A machine learning method using an optimized discriminant classifier based on VNIR reflectance spectra generated classification accuracies over 90% for the first four days of the stress treatment, showing great potential for early detection of the drought stress on lettuce leaves before any visible symptoms and size differences were evident. The system is promising to provide useful information for optimization of growth environment and early mitigation of stresses in space crop production.

Development of a Target-to-Sensor Mode Multispectral Imaging Device for High-Throughput and High-Precision Touch-Based Leaf-Scale Soybean Phenotyping

Image-based spectroscopy phenotyping is a rapidly growing field that investigates how genotype, environment and management interact using remote or proximal sensing systems to capture images of a plant under multiple wavelengths of light. While remote sensing techniques have proven effective in crop phenotyping, they can be subject to various noise sources, such as varying lighting conditions and plant physiological status, including leaf orientation. Moreover, current proximal leaf-scale imaging devices require the sensors to accommodate the state of the samples during imaging which induced extra time and labor cost. Therefore, this study developed a proximal multispectral imaging device that can actively attract the leaf to the sensing area (target-to-sensor mode) for high-precision and high-throughput leaf-scale phenotyping. To increase the throughput and to optimize imaging results, this device innovatively uses active airflow to reposition and flatten the soybean leaf. This novel mechanism redefines the traditional sensor-to-target mode and has relieved the device operator from the labor of capturing and holding the leaf, resulting in a five-fold increase in imaging speed compared to conventional proximal whole leaf imaging device. Besides, this device uses artificial lights to create stable and consistent lighting conditions to further improve the quality of the images. Furthermore, the touch-based imaging device takes full advantage of proximal sensing by providing ultra-high spatial resolution and quality of each pixel by blocking the noises induced by ambient lighting variances. The images captured by this device have been tested in the field and proven effective. Specifically, it has successfully identified nitrogen deficiency treatment at an earlier stage than a typical remote sensing system. The p-value of the data collected by the device (p = 0.008) is significantly lower than that of a remote sensing system (p = 0.239).

LeafSpec-Dicot: An Accurate and Portable Hyperspectral Imaging Device for Dicot Leaves

Soybean is one of the world's most consumed crops. As the human population continuously increases, new phenotyping technology is needed to develop new soybean varieties with high-yield, stress-tolerant, and disease-tolerant traits. Hyperspectral imaging (HSI) is one of the most used technologies for phenotyping. The current HSI techniques with indoor imaging towers and unmanned aerial vehicles (UAVs) suffer from multiple major noise sources, such as changes in ambient lighting conditions, leaf slopes, and environmental conditions. To reduce the noise, a portable single-leaf high-resolution HSI imager named LeafSpec was developed. However, the original design does not work efficiently for the size and shape of dicot leaves, such as soybean leaves. In addition, there is a potential to make the dicot leaf scanning much faster and easier by automating the manual scan effort in the original design. Therefore, a renovated design of a LeafSpec with increased efficiency and imaging quality for dicot leaves is presented in this paper. The new design collects an image of a dicot leaf within 20 s. The data quality of this new device is validated by detecting the effect of nitrogen treatment on soybean plants. The improved spatial resolution allows users to utilize the Normalized Difference Vegetative Index (NDVI) spatial distribution heatmap of the entire leaf to predict the nitrogen content of a soybean plant. This preliminary NDVI distribution analysis result shows a strong correlation (R2 = 0.871) between the image collected by the device and the nitrogen content measured by a commercial laboratory. Therefore, it is concluded that the new LeafSpec-Dicot device can provide high-quality hyperspectral leaf images with high spatial resolution, high spectral resolution, and increased throughput for more accurate phenotyping. This enables phenotyping researchers to develop novel HSI image processing algorithms to utilize both spatial and spectral information to reveal more signals in soybean leaf images.

Dynamic detection of three-dimensional crop phenotypes based on a consumer-grade RGB-D camera

INTRODUCTION

Nondestructive detection of crop phenotypic traits in the field is very important for crop breeding. Ground-based mobile platforms equipped with sensors can efficiently and accurately obtain crop phenotypic traits. In this study, we propose a dynamic 3D data acquisition method in the field suitable for various crops by using a consumer-grade RGB-D camera installed on a ground-based movable platform, which can collect RGB images as well as depth images of crop canopy sequences dynamically.

METHODS

A scale-invariant feature transform (SIFT) operator was used to detect adjacent date frames acquired by the RGB-D camera to calculate the point cloud alignment coarse matching matrix and the displacement distance of adjacent images. The data frames used for point cloud matching were selected according to the calculated displacement distance. Then, the colored ICP (iterative closest point) algorithm was used to determine the fine matching matrix and generate point clouds of the crop row. The clustering method was applied to segment the point cloud of each plant from the crop row point cloud, and 3D phenotypic traits, including plant height, leaf area and projected area of individual plants, were measured.

RESULTS AND DISCUSSION

We compared the effects of LIDAR and image-based 3D reconstruction methods, and experiments were carried out on corn, tobacco, cottons and Bletilla striata in the seedling stage. The results show that the measurements of the plant height (R²= 0.9~0.96, RSME = 0.015~0.023 m), leaf area (R²= 0.8~0.86, RSME = 0.0011~0.0041 m ² ) and projected area (R² = 0.96~0.99) have strong correlations with the manual measurement results. Additionally, 3D reconstruction results with different moving speeds and times throughout the day and in different scenes were also verified. The results show that the method can be applied to dynamic detection with a moving speed up to 0.6 m/s and can achieve acceptable detection results in the daytime, as well as at night. Thus, the proposed method can improve the efficiency of individual crop 3D point cloud data extraction with acceptable accuracy, which is a feasible solution for crop seedling 3D phenotyping outdoors.

The field phenotyping platform's next darling: Dicotyledons

The genetic information and functional properties of plants have been further identified with the completion of the whole-genome sequencing of numerous crop species and the rapid development of high-throughput phenotyping technologies, laying a suitable foundation for advanced precision agriculture and enhanced genetic gains. Collecting phenotypic data from dicotyledonous crops in the field has been identified as a key factor in the collection of large-scale phenotypic data of crops. On the one hand, dicotyledonous plants account for 4/5 of all angiosperm species and play a critical role in agriculture. However, their morphology is complex, and an abundance of dicot phenotypic information is available, which is critical for the analysis of high-throughput phenotypic data in the field. As a result, the focus of this paper is on the major advancements in ground-based, air-based, and space-based field phenotyping platforms over the last few decades and the research progress in the high-throughput phenotyping of dicotyledonous field crop plants in terms of morphological indicators, physiological and biochemical indicators, biotic/abiotic stress indicators, and yield indicators. Finally, the future development of dicots in the field is explored from the perspectives of identifying new unified phenotypic criteria, developing a high-performance infrastructure platform, creating a phenotypic big data knowledge map, and merging the data with those of multiomic techniques.

A Review of High-Throughput Field Phenotyping Systems: Focusing on Ground Robots

Manual assessments of plant phenotypes in the field can be labor-intensive and inefficient. The high-throughput field phenotyping systems and in particular robotic systems play an important role to automate data collection and to measure novel and fine-scale phenotypic traits that were previously unattainable by humans. The main goal of this paper is to review the state-of-the-art of high-throughput field phenotyping systems with a focus on autonomous ground robotic systems. This paper first provides a brief review of nonautonomous ground phenotyping systems including tractors, manually pushed or motorized carts, gantries, and cable-driven systems. Then, a detailed review of autonomous ground phenotyping robots is provided with regard to the robot's main components, including mobile platforms, sensors, manipulators, computing units, and software. It also reviews the navigation algorithms and simulation tools developed for phenotyping robots and the applications of phenotyping robots in measuring plant phenotypic traits and collecting phenotyping datasets. At the end of the review, this paper discusses current major challenges and future research directions.

Fast anther dehiscence status recognition system established by deep learning to screen heat tolerant cotton

BACKGROUND

From an economic perspective, cotton is one of the most important crops in the world. The fertility of male reproductive organs is a key determinant of cotton yield. Anther dehiscence or indehiscence directly determines the probability of fertilization in cotton. Thus, rapid and accurate identification of cotton anther dehiscence status is important for judging anther growth status and promoting genetic breeding research. The development of computer vision technology and the advent of big data have prompted the application of deep learning techniques to agricultural phenotype research. Therefore, two deep learning models (Faster R-CNN and YOLOv5) were proposed to detect the number and dehiscence status of anthers.

RESULT

The single-stage model based on YOLOv5 has higher recognition speed and the ability to deploy to the mobile end. Breeding researchers can apply this model to terminals to achieve a more intuitive understanding of cotton anther dehiscence status. Moreover, three improvement strategies are proposed for the Faster R-CNN model, where the improved model has higher detection accuracy than the YOLOv5 model. We have made three improvements to the Faster R-CNN model and after the ensemble of the three models and original Faster R-CNN model, R2 of "open" reaches to 0.8765, R2 of "close" reaches to 0.8539, R2 of "all" reaches to 0.8481, higher than the prediction results of either model alone, which are completely able to replace the manual counting results. We can use this model to quickly extract the dehiscence rate of cotton anthers under high temperature (HT) conditions. In addition, the percentage of dehiscent anthers of 30 randomly selected cotton varieties were observed from the cotton population under normal conditions and HT conditions through the ensemble of the Faster R-CNN model and manual counting. The results show that HT decreased the percentage of dehiscent anthers in different cotton lines, consistent with the manual method.

CONCLUSIONS

Deep learning technology have been applied to cotton anther dehiscence status recognition instead of manual methods for the first time to quickly screen HT-tolerant cotton varieties. Deep learning can help to explore the key genetic improvement genes in the future, promoting cotton breeding and improvement.

Nitrogen use efficiency in cotton: Challenges and opportunities against environmental constraints

Nitrogen is a vital nutrient for agricultural, and a defieciency of it causes stagnate cotton growth and yield penalty. Farmers rely heavily on N over-application to boost cotton output, which can result in decreased lint yield, quality, and N use efficiency (NUE). Therefore, improving NUE in cotton is most crucial for reducing environmental nitrate pollution and increasing farm profitability. Well-defined management practices, such as the type of sources, N-rate, application time, application method, crop growth stages, and genotypes, have a notable impact on NUE. Different N formulations, such as slow and controlled released fertilizers, have been shown to improve N uptake and, NUE. Increasing N rates are said to boost cotton yield, although high rates may potentially impair the yield depending on the soil and environmental conditions. This study comprehensively reviews various factors including agronomic and environmental constraints that influence N uptake, transport, accumulation, and ultimately NUE in cotton. Furthermore, we explore several agronomic and molecular approaches to enhance efficiency for better N uptake and utilization in cotton. Finally, this objective of this review to highlight a comprehensive view on enhancement of NUE in cotton and could be useful for understanding the physiological, biochemical and molecular mechanism of N in cotton.

Design Considerations for In-Field Measurement of Plant Architecture Traits Using Ground-Based Platforms

This work provides a high-level overview of system design considerations for measuring plant architecture traits in row crops using ground-based, mobile platforms. High-throughput phenotyping technologies are commonly deployed in isolated growth chambers or greenhouses; however, there is a need for field-based systems to measure large quantities of plants exposed to natural climates throughout a growing season. High-throughput methods using ground-based mobile systems collect valuable phenotypic information at higher temporal resolutions compared to manual methods (e.g., handheld calipers and measuring sticks). Additionally, the close proximity to plants when using ground-based systems compared to aerial platforms enables plant phenotyping at the organ level. While there is no single best platform for obtaining ground-based plant measurements across crop varieties with different planting configurations, there are a wide range of off-the-shelf systems and sensors that can be integrated to accommodate varying row widths, plant spacing, plant heights, and plot sizes, in addition to emerging commercially available platforms. This chapter will provide an overview of sensor types suitable for phenotyping plant size and shape, as well as provide guidance for deployment with ground-based systems, including push carts or buggies, modified tractors, and robotic platforms.

Development and Testing of a UAV-Based Multi-Sensor System for Plant Phenotyping and Precision Agriculture

Unmanned aerial vehicles have been used widely in plant phenotyping and precision agriculture. Several critical challenges remain, however, such as the lack of cross-platform data acquisition software system, sensor calibration protocols, and data processing methods. This paper developed an unmanned aerial system that integrates three cameras (RGB, multispectral, and thermal) and a LiDAR sensor. Data acquisition software supporting data recording and visualization was implemented to run on the Robot Operating System. The design of the multi-sensor unmanned aerial system was open sourced. A data processing pipeline was proposed to preprocess the raw data and to extract phenotypic traits at the plot level, including morphological traits (canopy height, canopy cover, and canopy volume), canopy vegetation index, and canopy temperature. Protocols for both field and laboratory calibrations were developed for the RGB, multispectral, and thermal cameras. The system was validated using ground data collected in a cotton field. Temperatures derived from thermal images had a mean absolute error of 1.02 °C, and canopy NDVI had a mean relative error of 6.6% compared to ground measurements. The observed error for maximum canopy height was 0.1 m. The results show that the system can be useful for plant breeding and precision crop management.

Registration and Fusion of Close-Range Multimodal Wheat Images in Field Conditions

Multimodal images fusion has the potential to enrich the information gathered by multi-sensor plant phenotyping platforms. Fusion of images from multiple sources is, however, hampered by the technical lock of image registration. The aim of this paper is to provide a solution to the registration and fusion of multimodal wheat images in field conditions and at close range. Eight registration methods were tested on nadir wheat images acquired by a pair of red, green and blue (RGB) cameras, a thermal camera and a multispectral camera array. The most accurate method, relying on a local transformation, aligned the images with an average error of 2 mm but was not reliable for thermal images. More generally, the suggested registration method and the preprocesses necessary before fusion (plant mask erosion, pixel intensity averaging) would depend on the application. As a consequence, the main output of this study was to identify four registration-fusion strategies: (i) the REAL-TIME strategy solely based on the cameras’ positions, (ii) the FAST strategy suitable for all types of images tested, (iii) and (iv) the ACCURATE and HIGHLY ACCURATE strategies handling local distortion but unable to deal with images of very different natures. These suggestions are, however, limited to the methods compared in this study. Further research should investigate how recent cutting-edge registration methods would perform on the specific case of wheat canopy.

High-Throughput Phenotyping: A Platform to Accelerate Crop Improvement

Development of high-throughput phenotyping technologies has progressed considerably in the last 10 years. These technologies provide precise measurements of desired traits among thousands of field-grown plants under diversified environments; this is a critical step towards selection of better performing lines as to yield, disease resistance, and stress tolerance to accelerate crop improvement programs. High-throughput phenotyping techniques and platforms help unraveling the genetic basis of complex traits associated with plant growth and development and targeted traits. This review focuses on the advancements in technologies involved in high-throughput, field-based, aerial, and unmanned platforms. Development of user-friendly data management tools and softwares to better understand phenotyping will increase the use of field-based high-throughput techniques, which have potential to revolutionize breeding strategies and meet the future needs of stakeholders.

Development of a Miniaturized Mobile Mapping System for In-Row, Under-Canopy Phenotyping

This paper focuses on the development of a miniaturized mobile mapping platform with advantages over current agricultural phenotyping systems in terms of acquiring data that facilitate under-canopy plant trait extraction. The system is based on an unmanned ground vehicle (UGV) for in-row, under-canopy data acquisition to deliver accurately georeferenced 2D and 3D products. The paper addresses three main aspects pertaining to the UGV development: (a) architecture of the UGV mobile mapping system (MMS), (b) quality assessment of acquired data in terms of georeferencing information as well as derived 3D point cloud, and (c) ability to derive phenotypic plant traits using data acquired by the UGV MMS. The experimental results from this study demonstrate the ability of the UGV MMS to acquire dense and accurate data over agricultural fields that would facilitate highly accurate plant phenotyping (better than above-canopy platforms such as unmanned aerial systems and high-clearance tractors). Plant centers and plant count with an accuracy in the 90% range have been achieved.

High-Throughput Plant Phenotyping Platform (HT3P) as a Novel Tool for Estimating Agronomic Traits From the Lab to the Field

Food scarcity, population growth, and global climate change have propelled crop yield growth driven by high-throughput phenotyping into the era of big data. However, access to large-scale phenotypic data has now become a critical barrier that phenomics urgently must overcome. Fortunately, the high-throughput plant phenotyping platform (HT3P), employing advanced sensors and data collection systems, can take full advantage of non-destructive and high-throughput methods to monitor, quantify, and evaluate specific phenotypes for large-scale agricultural experiments, and it can effectively perform phenotypic tasks that traditional phenotyping could not do. In this way, HT3Ps are novel and powerful tools, for which various commercial, customized, and even self-developed ones have been recently introduced in rising numbers. Here, we review these HT3Ps in nearly 7 years from greenhouses and growth chambers to the field, and from ground-based proximal phenotyping to aerial large-scale remote sensing. Platform configurations, novelties, operating modes, current developments, as well the strengths and weaknesses of diverse types of HT3Ps are thoroughly and clearly described. Then, miscellaneous combinations of HT3Ps for comparative validation and comprehensive analysis are systematically present, for the first time. Finally, we consider current phenotypic challenges and provide fresh perspectives on future development trends of HT3Ps. This review aims to provide ideas, thoughts, and insights for the optimal selection, exploitation, and utilization of HT3Ps, and thereby pave the way to break through current phenotyping bottlenecks in botany.

Decoding Plant-Environment Interactions That Influence Crop Agronomic Traits

To ensure food security in the face of increasing global demand due to population growth and progressive urbanization, it will be crucial to integrate emerging technologies in multiple disciplines to accelerate overall throughput of gene discovery and crop breeding. Plant agronomic traits often appear during the plants' later growth stages due to the cumulative effects of their lifetime interactions with the environment. Therefore, decoding plant-environment interactions by elucidating plants' temporal physiological responses to environmental changes throughout their lifespans will facilitate the identification of genetic and environmental factors, timing and pathways that influence complex end-point agronomic traits, such as yield. Here, we discuss the expected role of the life-course approach to monitoring plant and crop health status in improving crop productivity by enhancing the understanding of plant-environment interactions. We review recent advances in analytical technologies for monitoring health status in plants based on multi-omics analyses and strategies for integrating heterogeneous datasets from multiple omics areas to identify informative factors associated with traits of interest. In addition, we showcase emerging phenomics techniques that enable the noninvasive and continuous monitoring of plant growth by various means, including three-dimensional phenotyping, plant root phenotyping, implantable/injectable sensors and affordable phenotyping devices. Finally, we present an integrated review of analytical technologies and applications for monitoring plant growth, developed across disciplines, such as plant science, data science and sensors and Internet-of-things technologies, to improve plant productivity.

Ground Based Hyperspectral Imaging to Characterize Canopy-Level Photosynthetic Activities

Improving plant photosynthesis provides the best possibility for increasing crop yield potential, which is considered a crucial effort for global food security. Chlorophyll fluorescence is an important indicator for the study of plant photosynthesis. Previous studies have intensively examined the use of spectrometer, airborne, and spaceborne spectral data to retrieve solar induced fluorescence (SIF) for estimating gross primary productivity and carbon fixation. None of the methods, however, had a spatial resolution and a scanning throughput suitable for applications at the canopy and sub-canopy levels, thereby limiting photosynthesis analysis for breeding programs and genetics/genomics studies. The goal of this study was to develop a hyperspectral imaging approach to characterize plant photosynthesis at the canopy level. An experimental field was planted with two cotton cultivars that received two different treatments (control and herbicide treated), with each cultivar-treatment combination having eight replicate 10 m plots. A ground mobile sensing system (GPhenoVision) was configured with a hyperspectral module consisting of a spectrometer and a hyperspectral camera that covered the spectral range from 400 to 1000 nm with a spectral sampling resolution of 2 nm. The system acquired downwelling irradiance spectra from the spectrometer and reflected radiance spectral images from the hyperspectral camera. On the day after 24 h of the DCMU (3-(3,4-dichlorophenyl)-1,1-dimethylurea) application, the system was used to conduct six data collection trials in the experiment field from 08:00 to 18:00 with an interval of two hours. A data processing pipeline was developed to measure SIF using the irradiance and radiance spectral data. Diurnal SIF measurements were used to estimate the effective quantum yield and electron transport rate, deriving rapid light curves (RLCs) to characterize photosynthetic efficiency at the group and plot levels. Experimental results showed that the effective quantum yields estimated by the developed method highly correlated with those measured by a pulse amplitude modulation (PAM) fluorometer. In addition, RLC characteristics calculated using the developed method showed similar statistical trends with those derived using the PAM data. Both the RLC and PAM data agreed with destructive growth analyses. This suggests that the developed method can be used as an effective tool for future breeding programs and genetics/genomics studies to characterize plant photosynthesis at the canopy level.

Climatic changes and potatoes: How can we cope with the abiotic stresses?

Climate change triggers increases in temperature, drought, and/or salinity that threaten potato production, because they necessitate specific amounts and quality of water, meanwhile lower temperatures generally support stable crop yields. Various cultivation techniques have been developed to reduce the negative effects of drought, heat and/or salinity stresses on potato. Developing innovative varieties with relevant tolerance to abiotic stress is absolutely necessary to guarantee competitive production under sub-optimal environments. Commercial varieties are sensitive to abiotic stresses, and substantial changes to their higher tolerance levels are not easily achieved because their genetic base is narrow. Nonetheless, there are several other possibilities for genetic enhancement using landraces and wild relatives. The complexity of polysomic genetics and heterozygosity in potato hamper the phenotype evaluation over abiotic stresses and consequent conventional introgression of tolerance traits, which are more challenging than previous successes shown over diseases and insects resistances. Today, potatoes face more challenges with severe abiotic stresses. Potato wild relatives can be explored further using innovative genomic, transcriptomic, proteomic, and metabolomic approaches. At the field level, appropriate cultivation techniques must be applied along with precision farming technology and tolerant varieties developed from various breeding techniques, in order to realize high yield under multiple stresses.

A Framework for Evaluating Field-Based, High-Throughput Phenotyping Systems: A Meta-Analysis

This paper presents a framework for the evaluation of system complexity and utility and the identification of bottlenecks in the deployment of field-based, high-throughput phenotyping (FB-HTP) systems. Although the capabilities of technology used for high-throughput phenotyping has improved and costs decreased, there have been few, if any, successful attempts at developing turnkey field-based phenotyping systems. To identify areas for future improvement in developing turnkey FB-HTP solutions, a framework for evaluating their complexity and utility was developed and applied to total of 10 case studies to highlight potential barriers in their development and adoption. The framework performs system factorization and rates the complexity and utility of subsystem factors, as well as each FB-HTP system as a whole, and provides data related to the trends and relationships within the complexity and utility factors. This work suggests that additional research and development are needed focused around the following areas: (i) data handling and management, specifically data transfer from the field to the data processing pipeline, (ii) improved human-machine interaction to facilitate usability across multiple users, and (iii) design standardization of the factors common across all FB-HTP systems to limit the competing drivers of system complexity and utility. This framework can be used to evaluate both previously developed and future proposed systems to approximate the overall system complexity and identify areas for improvement prior to implementation.

High-Throughput Field-Phenotyping Tools for Plant Breeding and Precision Agriculture

High-throughput field phenotyping has garnered major attention in recent years leading to the development of several new protocols for recording various plant traits of interest. Phenotyping of plants for breeding and for precision agriculture have different requirements due to different sizes of the plots and fields, differing purposes and the urgency of the action required after phenotyping. While in plant breeding phenotyping is done on several thousand small plots mainly to evaluate them for various traits, in plant cultivation, phenotyping is done in large fields to detect the occurrence of plant stresses and weeds at an early stage. The aim of this review is to highlight how various high-throughput phenotyping methods are used for plant breeding and farming and the key differences in the applications of such methods. Thus, various techniques for plant phenotyping are presented together with applications of these techniques for breeding and cultivation. Several examples from the literature using these techniques are summarized and the key technical aspects are highlighted.

High-Throughput Phenotyping Analysis of Potted Soybean Plants Using Colorized Depth Images Based on A Proximal Platform

Canopy color and structure can strongly reflect plant functions. Color characteristics and plant height as well as canopy breadth are important aspects of the canopy phenotype of soybean plants. High-throughput phenotyping systems with imaging capabilities providing color and depth information can rapidly acquire data of soybean plants, making it possible to quantify and monitor soybean canopy development. The goal of this study was to develop a 3D imaging approach to quantitatively analyze soybean canopy development under natural light conditions. Thus, a Kinect sensor-based high-throughput phenotyping (HTP) platform was developed for soybean plant phenotyping. To calculate color traits accurately, the distortion phenomenon of color images was first registered in accordance with the principle of three primary colors and color constancy. Then, the registered color images were applied to depth images for the reconstruction of the colorized three-dimensional canopy structure. Furthermore, the 3D point cloud of soybean canopies was extracted from the background according to adjusted threshold, and each area of individual potted soybean plants in the depth images was segmented for the calculation of phenotypic traits. Finally, color indices, plant height and canopy breadth were assessed based on 3D point cloud of soybean canopies. The results showed that the maximum error of registration for the R, G, and B bands in the dataset was 1.26%, 1.09%, and 0.75%, respectively. Correlation analysis between the sensors and manual measurements yielded R2 values of 0.99, 0.89, and 0.89 for plant height, canopy breadth in the west-east (W–E) direction, and canopy breadth in the north-south (N–S) direction, and R2 values of 0.82, 0.79, and 0.80 for color indices h, s, and i, respectively. Given these results, the proposed approaches provide new opportunities for the identification of the quantitative traits that control canopy structure in genetic/genomic studies or for soybean yield prediction in breeding programs.

Multispectral imaging and unmanned aerial systems for cotton plant phenotyping

This paper demonstrates the application of aerial multispectral images in cotton plant phenotyping. Four phenotypic traits (plant height, canopy cover, vegetation index, and flower) were measured from multispectral images captured by a multispectral camera on an unmanned aerial system. Data were collected on eight different days from two fields. Ortho-mosaic and digital elevation models (DEM) were constructed from the raw images using the structure from motion (SfM) algorithm. A data processing pipeline was developed to calculate plant height using the ortho-mosaic and DEM. Six ground calibration targets (GCTs) were used to correct the error of the calculated plant height caused by the georeferencing error of the DEM. Plant heights were measured manually to validate the heights predicted from the imaging method. The error in estimation of the maximum height of each plot ranged from -40.4 to 13.5 cm among six datasets, all of which showed strong linear relationships with the manual measurement (R2 > 0.89). Plot canopy was separated from the soil based on the DEM and normalized differential vegetation index (NDVI). Canopy cover and mean canopy NDVI were calculated to show canopy growth over time and the correlation between the two indices was investigated. The spectral responses of the ground, leaves, cotton flower, and ground shade were analyzed and detection of cotton flowers was satisfactory using a support vector machine (SVM). This study demonstrated the potential of using aerial multispectral images for high throughput phenotyping of important cotton phenotypic traits in the field.

Optical Flow-Based Analysis of the Relationships between Leaf Wilting and Stem Diameter Variations in Tomato Plants

The estimation of water stress is critical for the reliable production of high-quality fruits cultivated using the tacit knowledge of expert farmers. Multimodal deep neural network has achieved success in the estimation of stem diameter variations as a water stress index, calculated from leaf wilting and environmental data. However, these studies have not addressed the specific role of leaf wilting in the estimation. Revealing the role of leaf wilting not only ensures the reliability of the estimation model but also provides an opportunity for improving the estimation method. In this paper, we investigated the relationships between leaf wilting and stem diameter variations without resorting to black-box approaches such as deep neural network. To clarify the role of leaf wilting, this study uses cross-correlation analysis to analyze the time lag correlation between leaf wilting, quantified by optical flow, and stem diameter variations as a water stress index. The analysis showed that leaf wilting had a significant time lag correlation with short-term stem diameter variations, which were water stress responses in plants. As the results were consistent with known plant water transport mechanisms, it was suggested that leaf wilting quantified by optical flow can explain short-term stem diameter variations.

Quantitative Analysis of Cotton Canopy Size in Field Conditions Using a Consumer-Grade RGB-D Camera

Plant canopy structure can strongly affect crop functions such as yield and stress tolerance, and canopy size is an important aspect of canopy structure. Manual assessment of canopy size is laborious and imprecise, and cannot measure multi-dimensional traits such as projected leaf area and canopy volume. Field-based high throughput phenotyping systems with imaging capabilities can rapidly acquire data about plants in field conditions, making it possible to quantify and monitor plant canopy development. The goal of this study was to develop a 3D imaging approach to quantitatively analyze cotton canopy development in field conditions. A cotton field was planted with 128 plots, including four genotypes of 32 plots each. The field was scanned by GPhenoVision (a customized field-based high throughput phenotyping system) to acquire color and depth images with GPS information in 2016 covering two growth stages: canopy development, and flowering and boll development. A data processing pipeline was developed, consisting of three steps: plot point cloud reconstruction, plant canopy segmentation, and trait extraction. Plot point clouds were reconstructed using color and depth images with GPS information. In colorized point clouds, vegetation was segmented from the background using an excess-green (ExG) color filter, and cotton canopies were further separated from weeds based on height, size, and position information. Static morphological traits were extracted on each day, including univariate traits (maximum and mean canopy height and width, projected canopy area, and concave and convex volumes) and a multivariate trait (cumulative height profile). Growth rates were calculated for univariate static traits, quantifying canopy growth and development. Linear regressions were performed between the traits and fiber yield to identify the best traits and measurement time for yield prediction. The results showed that fiber yield was correlated with static traits after the canopy development stage (R² = 0.35-0.71) and growth rates in early canopy development stages (R² = 0.29-0.52). Multi-dimensional traits (e.g., projected canopy area and volume) outperformed one-dimensional traits, and the multivariate trait (cumulative height profile) outperformed univariate traits. The proposed approach would be useful for identification of quantitative trait loci (QTLs) controlling canopy size in genetics/genomics studies or for fiber yield prediction in breeding programs and production environments.