Automated recovery of three-dimensional models of plant shoots from multiple color images

SCAG: A Stratified, Clustered, and Growing-Based Algorithm for Soybean Branch Angle Extraction and Ideal Plant Architecture Evaluation

Three-dimensional (3D) phenotyping is important for studying plant structure and function. Light detection and ranging (LiDAR) has gained prominence in 3D plant phenotyping due to its ability to collect 3D point clouds. However, organ-level branch detection remains challenging due to small targets, sparse points, and low signal-to-noise ratios. In addition, extracting biologically relevant angle traits is difficult. In this study, we developed a stratified, clustered, and growing-based algorithm (SCAG) for soybean branch detection and branch angle calculation from LiDAR data, which is heuristic, open-source, and expandable. SCAG achieved high branch detection accuracy (F-score = 0.77) and branch angle calculation accuracy (r = 0.84) when evaluated on 152 diverse soybean varieties. Meanwhile, the SCAG outperformed 2 other classic algorithms, the support vector machine (F-score = 0.53) and density-based methods (F-score = 0.55). Moreover, after applying the SCAG to 405 soybean varieties over 2 consecutive years, we quantified various 3D traits, including canopy width, height, stem length, and average angle. After data filtering, we identified novel heritable and repeatable traits for evaluating soybean density tolerance potential, such as the ratio of average angle to height and the ratio of average angle to stem length, which showed greater potential than the well-known ratio of canopy width to height trait. Our work demonstrates remarkable advances in 3D phenotyping and plant architecture screening. The algorithm can be applied to other crops, such as maize and tomato. Our dataset, scripts, and software are public, which can further benefit the plant science community by enhancing plant architecture characterization and ideal variety selection.

A Pathway to Assess Genetic Variation of Wheat Germplasm by Multidimensional Traits with Digital Images

In this paper, a new pathway was proposed to assess the germplasm genetic variation by multidimensional traits of wheat seeds generated from digital images. A machine vision platform was first established to reconstruct wheat germplasm 3D model from omnidirectional image sequences of wheat seeds. Then, multidimensional traits were conducted from the wheat germplasm 3D model, including seed length, width, thickness, surface area, volume, maximum projection area, roundness, and 2 new defined traits called cardioid-derived area and the index of adjustment (J index). To assess genetic variation of wheat germplasm, phenotypic coefficients of variation (PCVs), analysis of variance (ANOVA), clustering, and the defined genetic variation factor (GVF) were calculated using the extracted morphological traits of 15 wheat accessions comprising 13 offspring and 2 parents. The measurement accuracy of 3D reconstruction model is demonstrated by the correlation coefficient (R) and root mean square errors (RMSEs). Results of PCVs among all the traits show importance of multidimensional traits, as seed volume (22.4%), cardioid-derived area (16.97%), and maximum projection area (14.67%). ANOVA shows a highly significance difference among all accessions. The results of GVF innovatively reflect the connection between genotypic variance and phenotypic traits from parents to offspring. Our results confirmed that extracting multidimensional traits from digital images is a promising high-throughput and cost-efficient pathway that can be included as a valuable approach in genetic variation assessment, and it can provide useful information for genetic improvement, preservation, and evaluation of wheat germplasm.

A Novel Method for Quantifying Plant Morphological Characteristics Using Normal Vectors and Local Curvature Data via 3D Modelling-A Case Study in Leaf Lettuce

Three-dimensional measurement is a high-throughput method that can record a large amount of information. Three-dimensional modelling of plants has the possibility to not only automate dimensional measurement, but to also enable visual assessment to be quantified, eliminating ambiguity in human judgment. In this study, we have developed new methods that could be used for the morphological analysis of plants from the information contained in 3D data. Specifically, we investigated characteristics that can be measured by scale (dimension) and/or visual assessment by humans. The latter is particularly novel in this paper. The characteristics that can be measured on a scale-related dimension were tested based on the bounding box, convex hull, column solid, and voxel. Furthermore, for characteristics that can be evaluated by visual assessment, we propose a new method using normal vectors and local curvature (LC) data. For these examinations, we used our highly accurate all-around 3D plant modelling system. The coefficient of determination between manual measurements and the scale-related methods were all above 0.9. Furthermore, the differences in LC calculated from the normal vector data allowed us to visualise and quantify the concavity and convexity of leaves. This technique revealed that there were differences in the time point at which leaf blistering began to develop among the varieties. The precise 3D model made it possible to perform quantitative measurements of lettuce size and morphological characteristics. In addition, the newly proposed LC-based analysis method made it possible to quantify the characteristics that rely on visual assessment. This research paper was able to demonstrate the following possibilities as outcomes: (1) the automation of conventional manual measurements, and (2) the elimination of variability caused by human subjectivity, thereby rendering evaluations by skilled experts unnecessary.

Quantifying Contributions of Different Factors to Canopy Photosynthesis in 2 Maize Varieties: Development of a Novel 3D Canopy Modeling Pipeline

Crop yield potential is intrinsically related to canopy photosynthesis; therefore, improving canopy photosynthetic efficiency is a major focus of current efforts to enhance crop yield. Canopy photosynthesis rate (Ac) is influenced by several factors, including plant architecture, leaf chlorophyll content, and leaf photosynthetic properties, which interact with each other. Identifying factors that restrict canopy photosynthesis and target adjustments to improve canopy photosynthesis in a specific crop cultivar pose an important challenge for the breeding community. To address this challenge, we developed a novel pipeline that utilizes factorial analysis, canopy photosynthesis modeling, and phenomics data collected using a 64-camera multi-view stereo system, enabling the dissection of the contributions of different factors to differences in canopy photosynthesis between maize cultivars. We applied this method to 2 maize varieties, W64A and A619, and found that leaf photosynthetic efficiency is the primary determinant (17.5% to 29.2%) of the difference in Ac between 2 maize varieties at all stages, and plant architecture at early stages also contribute to the difference in Ac (5.3% to 6.7%). Additionally, the contributions of each leaf photosynthetic parameter and plant architectural trait were dissected. We also found that the leaf photosynthetic parameters were linearly correlated with Ac and plant architecture traits were non-linearly related to Ac. This study developed a novel pipeline that provides a method for dissecting the relationship among individual phenotypes controlling the complex trait of canopy photosynthesis.

A fast phenotype approach of 3D point clouds of Pinus massoniana seedlings

The phenotyping of Pinus massoniana seedlings is essential for breeding, vegetation protection, resource investigation, and so on. Few reports regarding estimating phenotypic parameters accurately in the seeding stage of Pinus massoniana plants using 3D point clouds exist. In this study, seedlings with heights of approximately 15-30 cm were taken as the research object, and an improved approach was proposed to automatically calculate five key parameters. The key procedure of our proposed method includes point cloud preprocessing, stem and leaf segmentation, and morphological trait extraction steps. In the skeletonization step, the cloud points were sliced in vertical and horizontal directions, gray value clustering was performed, the centroid of the slice was regarded as the skeleton point, and the alternative skeleton point of the main stem was determined by the DAG single source shortest path algorithm. Then, the skeleton points of the canopy in the alternative skeleton point were removed, and the skeleton point of the main stem was obtained. Last, the main stem skeleton point after linear interpolation was restored, while stem and leaf segmentation was achieved. Because of the leaf morphological characteristics of Pinus massoniana, its leaves are large and dense. Even using a high-precision industrial digital readout, it is impossible to obtain a 3D model of Pinus massoniana leaves. In this study, an improved algorithm based on density and projection is proposed to estimate the relevant parameters of Pinus massoniana leaves. Finally, five important phenotypic parameters, namely plant height, stem diameter, main stem length, regional leaf length, and total leaf number, are obtained from the skeleton and the point cloud after separation and reconstruction. The experimental results showed that there was a high correlation between the actual value from manual measurement and the predicted value from the algorithm output. The accuracies of the main stem diameter, main stem length, and leaf length were 93.5%, 95.7%, and 83.8%, respectively, which meet the requirements of real applications.

How to make sense of 3D representations for plant phenotyping: a compendium of processing and analysis techniques

Computer vision technology is moving more and more towards a three-dimensional approach, and plant phenotyping is following this trend. However, despite its potential, the complexity of the analysis of 3D representations has been the main bottleneck hindering the wider deployment of 3D plant phenotyping. In this review we provide an overview of typical steps for the processing and analysis of 3D representations of plants, to offer potential users of 3D phenotyping a first gateway into its application, and to stimulate its further development. We focus on plant phenotyping applications where the goal is to measure characteristics of single plants or crop canopies on a small scale in research settings, as opposed to large scale crop monitoring in the field.

All-around 3D plant modeling system using multiple images and its composition

In this study, we developed an all-around 3D plant modeling system that operates using images and is capable of measuring plants non-destructively without any contact. During the fabrication of this device, we selected a method capable of performing 3D model reconstruction from multiple images. We then developed an improved SfM-MVS (Structure from Motion / Multi-View-Stereo) method that enables 3D reconstruction by simply capturing images with a camera. The resulting image-based method offers a high degree of freedom because the hardware and software can comprise commercially available products, and it permits the use of one or more cameras according to the shape and size of the plant. The advantages of the image-based method are that 3D reconstruction can be conducted at any time as long as the images are already taken, and that the desired locations can be observed, measured, and analyzed from 2D images and a 3D point cloud. The device we developed is capable of 3D measurements and modeling of plants from a few millimeters to 2.4 m of height using this method. This article explains this device, the principles of its composition, and the accuracy of the models obtained from it.

Model-based plant phenomics on morphological traits using morphometric descriptors

The morphological traits of plants contribute to many important functional features such as radiation interception, lodging tolerance, gas exchange efficiency, spatial competition between individuals and/or species, and disease resistance. Although the importance of plant phenotyping techniques is increasing with advances in molecular breeding strategies, there are barriers to its advancement, including the gap between measured data and phenotypic values, low quantitativity, and low throughput caused by the lack of models for representing morphological traits. In this review, we introduce morphological descriptors that can be used for phenotyping plant morphological traits. Geometric morphometric approaches pave the way to a general-purpose method applicable to single units. Hierarchical structures composed of an indefinite number of multiple elements, which is often observed in plants, can be quantified in terms of their multi-scale topological characteristics using topological data analysis. Theoretical morphological models capture specific anatomical structures, if recognized. These morphological descriptors provide us with the advantages of model-based plant phenotyping, including robust quantification of limited datasets. Moreover, we discuss the future possibilities that a system of model-based measurement and model refinement would solve the lack of morphological models and the difficulties in scaling out the phenotyping processes.

A miniaturized phenotyping platform for individual plants using multi-view stereo 3D reconstruction

Plant phenotyping is essential in plant breeding and management. High-throughput data acquisition and automatic phenotypes extraction are common concerns in plant phenotyping. Despite the development of phenotyping platforms and the realization of high-throughput three-dimensional (3D) data acquisition in tall plants, such as maize, handling small-size plants with complex structural features remains a challenge. This study developed a miniaturized shoot phenotyping platform MVS-Pheno V2 focusing on low plant shoots. The platform is an improvement of MVS-Pheno V1 and was developed based on multi-view stereo 3D reconstruction. It has the following four components: Hardware, wireless communication and control, data acquisition system, and data processing system. The hardware sets the rotation on top of the platform, separating plants to be static while rotating. A novel local network was established to realize wireless communication and control; thus, preventing cable twining. The data processing system was developed to calibrate point clouds and extract phenotypes, including plant height, leaf area, projected area, shoot volume, and compactness. This study used three cultivars of wheat shoots at four growth stages to test the performance of the platform. The mean absolute percentage error of point cloud calibration was 0.585%. The squared correlation coefficient R ² was 0.9991, 0.9949, and 0.9693 for plant height, leaf length, and leaf width, respectively. The root mean squared error (RMSE) was 0.6996, 0.4531, and 0.1174 cm for plant height, leaf length, and leaf width. The MVS-Pheno V2 platform provides an alternative solution for high-throughput phenotyping of low individual plants and is especially suitable for shoot architecture-related plant breeding and management studies.

The effect of canopy architecture on the patterning of "windflecks" within a wheat canopy

Under field conditions, plants are subject to wind-induced movement which creates fluctuations of light intensity and spectral quality reaching the leaves, defined here as windflecks. Within this study, irradiance within two contrasting wheat (Triticum aestivum) canopies during full sun conditions was measured using a spectroradiometer to determine the frequency, duration and magnitude of low- to high-light events plus the spectral composition during wind-induced movement. Similarly, a static canopy was modelled using three-dimensional reconstruction and ray tracing to determine fleck characteristics without the presence of wind. Corresponding architectural traits were measured manually and in silico including plant height, leaf area and angle plus biomechanical properties. Light intensity can differ up to 40% during a windfleck, with changes occurring on a sub-second scale compared to ~5 min in canopies not subject to wind. Features such as a shorter height, more erect leaf stature and having an open structure led to an increased frequency and reduced time interval of light flecks in the CMH79A canopy compared to Paragon. This finding illustrates the potential for architectural traits to be selected to improve the canopy light environment and provides the foundation to further explore the links between plant form and function in crop canopies.

Canopy occupation volume as an indicator of canopy photosynthetic capacity

Leaf angle and leaf area index together influence canopy light interception and canopy photosynthesis. However, so far, there is no effective method to identify the optimal combination of these two parameters for canopy photosynthesis. In this study, first a robust high-throughput method for accurate segmentation of maize organs based on 3D point clouds data was developed, then the segmented plant organs were used to generate new 3D point clouds for the canopy of altered architectures. With this, we simulated the synergistic effect of leaf area and leaf angle on canopy photosynthesis. The results show that, compared to the traditional parameters describing the canopy photosynthesis including leaf area index, facet angle and canopy coverage, a new parameter - the canopy occupation volume (COV) - can better explain the variations of canopy photosynthetic capacity. Specifically, COV can explain > 79% variations of canopy photosynthesis generated by changing leaf angle and > 84% variations of canopy photosynthesis generated by changing leaf area. As COV can be calculated in a high-throughput manner based on the canopy point clouds, it can be used to evaluate canopy architecture in breeding and agronomic research.

Open source 3D phenotyping of chickpea plant architecture across plant development

BACKGROUND

Being able to accurately assess the 3D architecture of plant canopies can allow us to better estimate plant productivity and improve our understanding of underlying plant processes. This is especially true if we can monitor these traits across plant development. Photogrammetry techniques, such as structure from motion, have been shown to provide accurate 3D reconstructions of monocot crop species such as wheat and rice, yet there has been little success reconstructing crop species with smaller leaves and more complex branching architectures, such as chickpea.

RESULTS

In this work, we developed a low-cost 3D scanner and used an open-source data processing pipeline to assess the 3D structure of individual chickpea plants. The imaging system we developed consists of a user programmable turntable and three cameras that automatically captures 120 images of each plant and offloads these to a computer for processing. The capture process takes 5-10 min for each plant and the majority of the reconstruction process on a Windows PC is automated. Plant height and total plant surface area were validated against "ground truth" measurements, producing R2 > 0.99 and a mean absolute percentage error < 10%. We demonstrate the ability to assess several important architectural traits, including canopy volume and projected area, and estimate relative growth rate in commercial chickpea cultivars and lines from local and international breeding collections. Detailed analysis of individual reconstructions also allowed us to investigate partitioning of plant surface area, and by proxy plant biomass.

CONCLUSIONS

Our results show that it is possible to use low-cost photogrammetry techniques to accurately reconstruct individual chickpea plants, a crop with a complex architecture consisting of many small leaves and a highly branching structure. We hope that our use of open-source software and low-cost hardware will encourage others to use this promising technique for more architecturally complex species.

Robust Surface Reconstruction of Plant Leaves from 3D Point Clouds

The automation of plant phenotyping using 3D imaging techniques is indispensable. However, conventional methods for reconstructing the leaf surface from 3D point clouds have a trade-off between the accuracy of leaf surface reconstruction and the method's robustness against noise and missing points. To mitigate this trade-off, we developed a leaf surface reconstruction method that reduces the effects of noise and missing points while maintaining surface reconstruction accuracy by capturing two components of the leaf (the shape and distortion of that shape) separately using leaf-specific properties. This separation simplifies leaf surface reconstruction compared with conventional methods while increasing the robustness against noise and missing points. To evaluate the proposed method, we reconstructed the leaf surfaces from 3D point clouds of leaves acquired from two crop species (soybean and sugar beet) and compared the results with those of conventional methods. The result showed that the proposed method robustly reconstructed the leaf surfaces, despite the noise and missing points for two different leaf shapes. To evaluate the stability of the leaf surface reconstructions, we also calculated the leaf surface areas for 14 consecutive days of the target leaves. The result derived from the proposed method showed less variation of values and fewer outliers compared with the conventional methods.

Photoprotective energy dissipation is greater in the lower, not the upper, regions of a rice canopy: a 3D analysis

High light intensities raise photosynthetic and plant growth rates but can cause damage to the photosynthetic machinery. The likelihood and severity of deleterious effects are minimised by a set of photoprotective mechanisms, one key process being the controlled dissipation of energy from chlorophyll within PSII known as non-photochemical quenching (NPQ). Although ubiquitous, the role of NPQ in plant productivity is important because it momentarily reduces the quantum efficiency of photosynthesis. Rice plants overexpressing and deficient in the gene encoding a central regulator of NPQ, the protein PsbS, were used to assess the effect of protective effectiveness of NPQ (pNPQ) at the canopy scale. Using a combination of three-dimensional reconstruction, modelling, chlorophyll fluorescence, and gas exchange, the influence of altered NPQ capacity on the distribution of pNPQ was explored. A higher phototolerance in the lower layers of a canopy was found, regardless of genotype, suggesting a mechanism for increased protection for leaves that experience relatively low light intensities interspersed with brief periods of high light. Relative to wild-type plants, psbS overexpressors have a reduced risk of photoinactivation and early growth advantage, demonstrating that manipulating photoprotective mechanisms can impact both subcellular mechanisms and whole-canopy function.

Active Vision and Surface Reconstruction for 3D Plant Shoot Modelling

Plant phenotyping is the quantitative description of a plant's physiological, biochemical, and anatomical status which can be used in trait selection and helps to provide mechanisms to link underlying genetics with yield. Here, an active vision- based pipeline is presented which aims to contribute to reducing the bottleneck associated with phenotyping of architectural traits. The pipeline provides a fully automated response to photometric data acquisition and the recovery of three-dimensional (3D) models of plants without the dependency of botanical expertise, whilst ensuring a non-intrusive and non-destructive approach. Access to complete and accurate 3D models of plants supports computation of a wide variety of structural measurements. An Active Vision Cell (AVC) consisting of a camera-mounted robot arm plus combined software interface and a novel surface reconstruction algorithm is proposed. This pipeline provides a robust, flexible, and accurate method for automating the 3D reconstruction of plants. The reconstruction algorithm can reduce noise and provides a promising and extendable framework for high throughput phenotyping, improving current state-of-the-art methods. Furthermore, the pipeline can be applied to any plant species or form due to the application of an active vision framework combined with the automatic selection of key parameters for surface reconstruction.

Quantification of light interception within image-based 3-D reconstruction of sole and intercropped canopies over the entire growth season

BACKGROUND AND AIMS

Light interception is closely related to canopy architecture. Few studies based on multi-view photography have been conducted in a field environment, particularly studies that link 3-D plant architecture with a radiation model to quantify the dynamic canopy light interception. In this study, we combined realistic 3-D plant architecture with a radiation model to quantify and evaluate the effect of differences in planting patterns and row orientations on canopy light interception.

METHODS

The 3-D architectures of maize and soybean plants were reconstructed for sole crops and intercrops based on multi-view images obtained at five growth dates in the field. We evaluated the accuracy of the calculated leaf length, maximum leaf width, plant height and leaf area according to the measured data. The light distribution within the 3-D plant canopy was calculated with a 3-D radiation model. Finally, we evaluated canopy light interception in different row orientations.

KEY RESULTS

There was good agreement between the measured and calculated phenotypic traits, with an R2 >0.97. The light distribution was more uniform for intercropped maize and more concentrated for sole maize. At the maize silking stage, 85 % of radiation was intercepted by approx. 55 % of the upper canopy region for maize and by approx. 33 % of the upper canopy region for soybean. There was no significant difference in daily light interception between the different row orientations for the entire intercropping and sole systems. However, for intercropped maize, near east-west orientations showed approx. 19 % higher daily light interception than near south-north orientations. For intercropped soybean, daily light interception showed the opposite trend. It was approx. 49 % higher for near south-north orientations than for near east-west orientations.

CONCLUSIONS

The accurate reconstruction of 3-D plants grown in the field based on multi-view images provides the possibility for high-throughput 3-D phenotyping in the field and allows a better understanding of the relationship between canopy architecture and the light environment.

Decomposition analysis on soybean productivity increase under elevated CO2 using 3-D canopy model reveals synergestic effects of CO2 and light in photosynthesis

BACKGROUND AND AIMS

Understanding how climate change influences crop productivity helps in identifying new options to increase crop productivity. Soybean is the most important dicotyledonous seed crop in terms of planting area. Although the impacts of elevated atmospheric [CO2] on soybean physiology, growth and biomass accumulation have been studied extensively, the contribution of different factors to changes in season-long whole crop photosynthetic CO2 uptake [gross primary productivity (GPP)] under elevated [CO2] have not been fully quantified.

METHODS

A 3-D canopy model combining canopy 3-D architecture, ray tracing and leaf photosynthesis was built to: (1) study the impacts of elevated [CO2] on soybean GPP across a whole growing season; (2) dissect the contribution of different factors to changes in GPP; and (3) determine the extent, if any, of synergism between [CO2] and light on changes in GPP. The model was parameterized from measurements of leaf physiology and canopy architectural parameters at the soybean Free Air CO2 Enrichment (SoyFACE) facility in Champaign, Illinois.

KEY RESULTS

Using this model, we showed that both a CO2 fertilization effect and changes in canopy architecture contributed to the large increase in GPP while acclimation in photosynthetic physiological parameters to elevated [CO2] and altered leaf temperature played only a minor role in the changes in GPP. Furthermore, at early developmental stages, elevated [CO2] increased leaf area index which led to increased canopy light absorption and canopy photosynthesis. At later developmental stages, on days with high ambient light levels, the proportion of leaves in a canopy limited by Rubisco carboxylation increased from 12.2 % to 35.6 %, which led to a greater enhancement of elevated [CO2] to GPP.

CONCLUSIONS

This study develops a new method to dissect the contribution of different factors to responses of crops under climate change. We showed that there is a synergestic effect of CO2 and light on crop growth under elevated CO2 conditions.

Image-Based, Organ-Level Plant Phenotyping for Wheat Improvement

Wheat was one of the first grain crops domesticated by humans and remains among the major contributors to the global calorie and protein budget. The rapidly expanding world population demands further enhancement of yield and performance of wheat. Phenotypic information has historically been instrumental in wheat breeding for improved traits. In the last two decades, a steadily growing collection of tools and imaging software have given us the ability to quantify shoot, root, and seed traits with progressively increasing accuracy and throughput. This review discusses challenges and advancements in image analysis platforms for wheat phenotyping at the organ level. Perspectives on how these collective phenotypes can inform basic research on understanding wheat physiology and breeding for wheat improvement are also provided.

Performances Evaluation of a Low-Cost Platform for High-Resolution Plant Phenotyping

This study aims to test the performances of a low-cost and automatic phenotyping platform, consisting of a Red-Green-Blue (RGB) commercial camera scanning objects on rotating plates and the reconstruction of main plant phenotypic traits via the structure for motion approach (SfM). The precision of this platform was tested in relation to three-dimensional (3D) models generated from images of potted maize, tomato and olive tree, acquired at a different frequency (steps of 4°, 8° and 12°) and quality (4.88, 6.52 and 9.77 µm/pixel). Plant and organs heights, angles and areas were extracted from the 3D models generated for each combination of these factors. Coefficient of determination (R²), relative Root Mean Square Error (rRMSE) and Akaike Information Criterion (AIC) were used as goodness-of-fit indexes to compare the simulated to the observed data. The results indicated that while the best performances in reproducing plant traits were obtained using 90 images at 4.88 µm/pixel (R² = 0.81, rRMSE = 9.49% and AIC = 35.78), this corresponded to an unviable processing time (from 2.46 h to 28.25 h for herbaceous plants and olive trees, respectively). Conversely, 30 images at 4.88 µm/pixel resulted in a good compromise between a reliable reconstruction of considered traits (R² = 0.72, rRMSE = 11.92% and AIC = 42.59) and processing time (from 0.50 h to 2.05 h for herbaceous plants and olive trees, respectively). In any case, the results pointed out that this input combination may vary based on the trait under analysis, which can be more or less demanding in terms of input images and time according to the complexity of its shape (R² = 0.83, rRSME = 10.15% and AIC = 38.78). These findings highlight the reliability of the developed low-cost platform for plant phenotyping, further indicating the best combination of factors to speed up the acquisition and elaboration process, at the same time minimizing the bias between observed and simulated data.

Dynamic non-photochemical quenching in plants: from molecular mechanism to productivity

Photoprotection refers to a set of well defined plant processes that help to prevent the deleterious effects of high and excess light on plant cells, especially within the chloroplast. Molecular components of chloroplast photoprotection are closely aligned with those of photosynthesis and together they influence productivity. Proof of principle now exists that major photoprotective processes such as non-photochemical quenching (NPQ) directly determine whole canopy photosynthesis, biomass and yield via prevention of photoinhibition and a momentary downregulation of photosynthetic quantum yield. However, this phenomenon has neither been quantified nor well characterized across different environments. Here we address this problem by assessing the existing literature with a different approach to that taken previously, beginning with our understanding of the molecular mechanism of NPQ and its regulation within dynamic environments. We then move to the leaf and the plant level, building an understanding of the circumstances (when and where) NPQ limits photosynthesis and linking to our understanding of how this might take place on a molecular and metabolic level. We argue that such approaches are needed to fine tune the relevant features necessary for improving dynamic NPQ in important crop species.

High-throughput 3D modelling to dissect the genetic control of leaf elongation in barley (Hordeum vulgare)

To optimize shoot growth and structure of cereals, we need to understand the genetic components controlling initiation and elongation. While measuring total shoot growth at high throughput using 2D imaging has progressed, recovering the 3D shoot structure of small grain cereals at a large scale is still challenging. Here, we present a method for measuring defined individual leaves of cereals, such as wheat and barley, using few images. Plant shoot modelling over time was used to measure the initiation and elongation of leaves in a bi-parental barley mapping population under low and high soil salinity. We detected quantitative trait loci (QTL) related to shoot growth per se, using both simple 2D total shoot measurements and our approach of measuring individual leaves. In addition, we detected QTL specific to leaf elongation and not to total shoot size. Of particular importance was the detection of a QTL on chromosome 3H specific to the early responses of leaf elongation to salt stress, a locus that could not be detected without the computer vision tools developed in this study.

A rapid monitoring of NDVI across the wheat growth cycle for grain yield prediction using a multi-spectral UAV platform

Wheat improvement programs require rapid assessment of large numbers of individual plots across multiple environments. Vegetation indices (VIs) that are mainly associated with yield and yield-related physiological traits, and rapid evaluation of canopy normalized difference vegetation index (NDVI) can assist in-season selection. Multi-spectral imagery using unmanned aerial vehicles (UAV) can readily assess the VIs traits at various crop growth stages. Thirty-two wheat cultivars and breeding lines grown in limited irrigation and full irrigation treatments were investigated to monitor NDVI across the growth cycle using a Sequoia sensor mounted on a UAV. Significant correlations ranging from R² = 0.38 to 0.90 were observed between NDVI detected from UAV and Greenseeker (GS) during stem elongation (SE) to late grain gilling (LGF) across the treatments. UAV-NDVI also had high heritabilities at SE (h² = 0.91), flowering (F)(h² = 0.95), EGF (h² = 0.79) and mid grain filling (MGF) (h² = 0.71) under the full irrigation treatment, and at booting (B) (h² = 0.89), EGF (h² = 0.75) in the limited irrigation treatment. UAV-NDVI explained significant variation in grain yield (GY) at EGF (R² = 0.86), MGF (R² = 0.83) and LGF (R² = 0.89) stages, and results were consistent with GS-NDVI. Higher correlations between UAV-NDVI and GY were observed under full irrigation at three different grain-filling stages (R² = 0.40, 0.49 and 0.45) than the limited irrigation treatment (R² = 0.08, 0.12 and 0.14) and GY was calculated to be 24.4% lower under limited irrigation conditions. Pearson correlations between UAV-NDVI and GY were also low ranging from r = 0.29 to 0.37 during grain-filling under limited irrigation but higher than GS-NDVI data. A similar pattern was observed for normalized difference red-edge (NDRE) and normalized green red difference index (NGRDI) when correlated with GY. Fresh biomass estimated at late flowering stage had significant correlations of r = 0.30 to 0.51 with UAV-NDVI at EGF. Some genotypes Nongda 211, Nongda 5181, Zhongmai 175 and Zhongmai 12 were identified as high yielding genotypes using NDVI during grain-filling. In conclusion, a multispectral sensor mounted on a UAV is a reliable high-throughput platform for NDVI measurement to predict biomass and GY and grain-filling stage seems the best period for selection.

A photometric stereo-based 3D imaging system using computer vision and deep learning for tracking plant growth

BACKGROUND

Tracking and predicting the growth performance of plants in different environments is critical for predicting the impact of global climate change. Automated approaches for image capture and analysis have allowed for substantial increases in the throughput of quantitative growth trait measurements compared with manual assessments. Recent work has focused on adopting computer vision and machine learning approaches to improve the accuracy of automated plant phenotyping. Here we present PS-Plant, a low-cost and portable 3D plant phenotyping platform based on an imaging technique novel to plant phenotyping called photometric stereo (PS).

RESULTS

We calibrated PS-Plant to track the model plant Arabidopsis thaliana throughout the day-night (diel) cycle and investigated growth architecture under a variety of conditions to illustrate the dramatic effect of the environment on plant phenotype. We developed bespoke computer vision algorithms and assessed available deep neural network architectures to automate the segmentation of rosettes and individual leaves, and extract basic and more advanced traits from PS-derived data, including the tracking of 3D plant growth and diel leaf hyponastic movement. Furthermore, we have produced the first PS training data set, which includes 221 manually annotated Arabidopsis rosettes that were used for training and data analysis (1,768 images in total). A full protocol is provided, including all software components and an additional test data set.

CONCLUSIONS

PS-Plant is a powerful new phenotyping tool for plant research that provides robust data at high temporal and spatial resolutions. The system is well-suited for small- and large-scale research and will help to accelerate bridging of the phenotype-to-genotype gap.

Genetic and environmental dissection of biomass accumulation in multi-genotype maize canopies

Multi-genotype canopies are frequent in phenotyping experiments and are of increasing interest in agriculture. Radiation interception efficiency (RIE) and radiation use efficiency (RUE) have low heritabilities in such canopies. We propose a revised Monteith equation that identifies environmental and genetic components of RIE and RUE. An environmental term, a component of RIE, characterizes the effect of the presence or absence of neighbours on light interception. The ability of a given plant to compete with its neighbours is then identified, which accounts for the genetic variability of RIE of plants having similar leaf areas. This method was used in three experiments in a phenotyping platform with 765 plants of 255 maize hybrids. As expected, the heritability of the environmental term was near zero, whereas that of the competitiveness term increased with phenological stage, resulting in the identification of quantitative trait loci. In the same way, RUE was dissected as an effect of intercepted light and a genetic term. This approach was used for predicting the behaviour of individual genotypes in virtual multi-genotype canopies. A large effect of competitiveness was observed in multi-genotype but not in single-genotype canopies, resulting in a bias for genotype comparisons in breeding fields.

A canopy conundrum: can wind-induced movement help to increase crop productivity by relieving photosynthetic limitations?

Wind-induced movement is a ubiquitous occurrence for all plants grown in natural or agricultural settings, and in the context of high, damaging wind speeds it has been well studied. However, the impact of lower wind speeds (which do not cause any damage) on mode of movement, light transmission, and photosynthetic properties has, surprisingly, not been fully explored. This impact is likely to be influenced by biomechanical properties and architectural features of the plant and canopy. A limited number of eco-physiological studies have indicated that movement in wind has the potential to alter light distribution within canopies, improving canopy productivity by relieving photosynthetic limitations. Given the current interest in canopy photosynthesis, it is timely to consider such movement in terms of crop yield progress. This opinion article sets out the background to wind-induced crop movement and argues that plant biomechanical properties may have a role in the optimization of whole-canopy photosynthesis via established physiological processes. We discuss how this could be achieved using canopy models.

An Accurate Skeleton Extraction Approach From 3D Point Clouds of Maize Plants

Accurate and high-throughput determination of plant morphological traits is essential for phenotyping studies. Nowadays, there are many approaches to acquire high-quality three-dimensional (3D) point clouds of plants. However, it is difficult to estimate phenotyping parameters accurately of the whole growth stages of maize plants using these 3D point clouds. In this paper, an accurate skeleton extraction approach was proposed to bridge the gap between 3D point cloud and phenotyping traits estimation of maize plants. The algorithm first uses point cloud clustering and color difference denoising to reduce the noise of the input point clouds. Next, the Laplacian contraction algorithm is applied to shrink the points. Then the key points representing the skeleton of the plant are selected through adaptive sampling, and neighboring points are connected to form a plant skeleton composed of semantic organs. Finally, deviation skeleton points to the input point cloud are calibrated by building a step forward local coordinate along the tangent direction of the original points. The proposed approach successfully generates accurately extracted skeleton from 3D point cloud and helps to estimate phenotyping parameters with high precision of maize plants. Experimental verification of the skeleton extraction process, tested using three cultivars and different growth stages maize, demonstrates that the extracted matches the input point cloud well. Compared with 3D digitizing data-derived morphological parameters, the NRMSE of leaf length, leaf inclination angle, leaf top length, leaf azimuthal angle, leaf growth height, and plant height, estimated using the extracted plant skeleton, are 5.27, 8.37, 5.12, 4.42, 1.53, and 0.83%, respectively, which could meet the needs of phenotyping analysis. The time required to process a single maize plant is below 100 s. The proposed approach may play an important role in further maize research and applications, such as genotype-to-phenotype study, geometric reconstruction, functional structural maize modeling, and dynamic growth animation.

Computational aspects underlying genome to phenome analysis in plants

Recent advances in genomics technologies have greatly accelerated the progress in both fundamental plant science and applied breeding research. Concurrently, high-throughput plant phenotyping is becoming widely adopted in the plant community, promising to alleviate the phenotypic bottleneck. While these technological breakthroughs are significantly accelerating quantitative trait locus (QTL) and causal gene identification, challenges to enable even more sophisticated analyses remain. In particular, care needs to be taken to standardize, describe and conduct experiments robustly while relying on plant physiology expertise. In this article, we review the state of the art regarding genome assembly and the future potential of pangenomics in plant research. We also describe the necessity of standardizing and describing phenotypic studies using the Minimum Information About a Plant Phenotyping Experiment (MIAPPE) standard to enable the reuse and integration of phenotypic data. In addition, we show how deep phenotypic data might yield novel trait-trait correlations and review how to link phenotypic data to genomic data. Finally, we provide perspectives on the golden future of machine learning and their potential in linking phenotypes to genomic features.

High-throughput micro-phenotyping measurements applied to assess stalk lodging in maize (Zea mays L.)

BACKGROUND

The biomechanical properties of maize stalks largely determine their lodging resistance, which affects crop yield per unit area. However, the quantitative and qualitative relationship between micro-phenotypes and the biomechanics of maize stalks is still under examined. In particular, the roles of the number, geometry, and distribution of vascular bundles of stalks in maize lodging resistance remain unclear. Research on these biomechanical properties will benefit from high-resolution micro-phenotypic image acquisition capabilities, which have been improved by modern X-ray imaging devices such as micro-CT and the development of micro-phenotyping analysis software. Hence, high-throughput image analysis and accurate quantification of anatomical phenotypes of stalks are necessary.

RESULTS

We have updated VesselParser version 1.0 to version 2.0 and have improved its performance, accuracy, and computation strategies. Anatomical characteristics of the second and third stalk internodes of the cultivars 'Jingke968' and 'Jingdan38' were analyzed using VesselParser 2.0. The relationships between lodging resistance and anatomical phenotypes of stalks between the two different maize varieties were investigated. The total area of vascular bundles in the peripheral layer, auxiliary axis diameter, and total area of vascular bundles were revealed to have the highest correlation with mechanical properties, and anatomical phenotypes of maize stalk were better predictors of mechanical properties than macro features observed optically from direct measurement, such as diameter and perimeter.

CONCLUSIONS

This study demonstrates the utility of VesselParser 2.0 in assessing stalk mechanical properties. The combination of anatomical phenotypes and mechanical behavior research provides unique insights into the problem of stalk lodging, showing that micro phenotypes of vascular bundles are good predictors of maize stalk mechanical properties that may be important indices for the evaluation and identification of the biomechanical properties to improve lodging resistance of future maize varieties.

Plant Phenotyping: An Active Vision Cell for Three-Dimensional Plant Shoot Reconstruction

Three-dimensional (3D) computer-generated models of plants are urgently needed to support both phenotyping and simulation-based studies such as photosynthesis modeling. However, the construction of accurate 3D plant models is challenging, as plants are complex objects with an intricate leaf structure, often consisting of thin and highly reflective surfaces that vary in shape and size, forming dense, complex, crowded scenes. We address these issues within an image-based method by taking an active vision approach, one that investigates the scene to intelligently capture images, to image acquisition. Rather than use the same camera positions for all plants, our technique is to acquire the images needed to reconstruct the target plant, tuning camera placement to match the plant's individual structure. Our method also combines volumetric- and surface-based reconstruction methods and determines the necessary images based on the analysis of voxel clusters. We describe a fully automatic plant modeling/phenotyping cell (or module) comprising a six-axis robot and a high-precision turntable. By using a standard color camera, we overcome the difficulties associated with laser-based plant reconstruction methods. The 3D models produced are compared with those obtained from fixed cameras and evaluated by comparison with data obtained by x-ray microcomputed tomography across different plant structures. Our results show that our method is successful in improving the accuracy and quality of data obtained from a variety of plant types.

Three-Dimensional Reconstruction of Soybean Canopies Using Multisource Imaging for Phenotyping Analysis

Geometric three-dimensional (3D) reconstruction has emerged as a powerful tool for plant phenotyping and plant breeding. Although laser scanning is one of the most intensely used sensing techniques for 3D reconstruction projects, it still has many limitations, such as the high investment cost. To overcome such limitations, in the present study, a low-cost, novel, and efficient imaging system consisting of a red-green-blue (RGB) camera and a photonic mixer detector (PMD) was developed, and its usability for plant phenotyping was demonstrated via a 3D reconstruction of a soybean plant that contains color information. To reconstruct soybean canopies, a density-based spatial clustering of applications with noise (DBSCAN) algorithm was used to extract canopy information from the raw 3D point cloud. Principal component analysis (PCA) and iterative closest point (ICP) algorithms were then used to register the multisource images for the 3D reconstruction of a soybean plant from both the side and top views. We then assessed phenotypic traits such as plant height and the greenness index based on the deviations of test samples. The results showed that compared with manual measurements, the side view-based assessments yielded a determination coefficient (R2) of 0.9890 for the estimation of soybean height and a R2 of 0.6059 for the estimation of soybean canopy greenness index; the top view-based assessment yielded a R2 of 0.9936 for the estimation of soybean height and a R2 of 0.8864 for the estimation of soybean canopy greenness. Together, the results indicated that an assembled 3D imaging device applying the algorithms developed in this study could be used as a reliable and robust platform for plant phenotyping, and potentially for automated and high-throughput applications under both natural light and indoor conditions.

Three-dimensional plant architecture and sunlit-shaded patterns: a stochastic model of light dynamics in canopies

Background and Aims

Diurnal changes in solar position and intensity combined with the structural complexity of plant architecture result in highly variable and dynamic light patterns within the plant canopy. This affects productivity through the complex ways that photosynthesis responds to changes in light intensity. Current methods to characterize light dynamics, such as ray-tracing, are able to produce data with excellent spatio-temporal resolution but are computationally intensive and the resulting data are complex and high-dimensional. This necessitates development of more economical models for summarizing the data and for simulating realistic light patterns over the course of a day.

Methods

High-resolution reconstructions of field-grown plants are assembled in various configurations to form canopies, and a forward ray-tracing algorithm is applied to the canopies to compute light dynamics at high (1 min) temporal resolution. From the ray-tracer output, the sunlit or shaded state for each patch on the plants is determined, and these data are used to develop a novel stochastic model for the sunlit-shaded patterns. The model is designed to be straightforward to fit to data using maximum likelihood estimation, and fast to simulate from.

Key Results

For a wide range of contrasting 3-D canopies, the stochastic model is able to summarize, and replicate in simulations, key features of the light dynamics. When light patterns simulated from the stochastic model are used as input to a model of photoinhibition, the predicted reduction in carbon gain is similar to that from calculations based on the (extremely costly) ray-tracer data.

Conclusions

The model provides a way to summarize highly complex data in a small number of parameters, and a cost-effective way to simulate realistic light patterns. Simulations from the model will be particularly useful for feeding into larger-scale photosynthesis models for calculating how light dynamics affects the photosynthetic productivity of canopies.

Measuring the dynamic photosynthome

Background

Photosynthesis underpins plant productivity and yet is notoriously sensitive to small changes in environmental conditions, meaning that quantitation in nature across different time scales is not straightforward. The 'dynamic' changes in photosynthesis (i.e. the kinetics of the various reactions of photosynthesis in response to environmental shifts) are now known to be important in driving crop yield.

Scope

It is known that photosynthesis does not respond in a timely manner, and even a small temporal 'mismatch' between a change in the environment and the appropriate response of photosynthesis toward optimality can result in a fall in productivity. Yet the most commonly measured parameters are still made at steady state or a temporary steady state (including those for crop breeding purposes), meaning that new photosynthetic traits remain undiscovered.

Conclusions

There is a great need to understand photosynthesis dynamics from a mechanistic and biological viewpoint especially when applied to the field of 'phenomics' which typically uses large genetically diverse populations of plants. Despite huge advances in measurement technology in recent years, it is still unclear whether we possess the capability of capturing and describing the physiologically relevant dynamic features of field photosynthesis in sufficient detail. Such traits are highly complex, hence we dub this the 'photosynthome'. This review sets out the state of play and describes some approaches that could be made to address this challenge with reference to the relevant biological processes involved.

Plant Phenomics, From Sensors to Knowledge

Major improvements in crop yield are needed to keep pace with population growth and climate change. While plant breeding efforts have greatly benefited from advances in genomics, profiling the crop phenome (i.e., the structure and function of plants) associated with allelic variants and environments remains a major technical bottleneck. Here, we review the conceptual and technical challenges facing plant phenomics. We first discuss how, given plants' high levels of morphological plasticity, crop phenomics presents distinct challenges compared with studies in animals. Next, we present strategies for multi-scale phenomics, and describe how major improvements in imaging, sensor technologies and data analysis are now making high-throughput root, shoot, whole-plant and canopy phenomic studies possible. We then suggest that research in this area is entering a new stage of development, in which phenomic pipelines can help researchers transform large numbers of images and sensor data into knowledge, necessitating novel methods of data handling and modelling. Collectively, these innovations are helping accelerate the selection of the next generation of crops more sustainable and resilient to climate change, and whose benefits promise to scale from physiology to breeding and to deliver real world impact for ongoing global food security efforts.

A Leaf Modeling and Multi-Scale Remeshing Method for Visual Computation via Hierarchical Parametric Vein and Margin Representation

This paper introduces a novel hierarchical structured representation for leaf modeling and proposes a corresponding multi-resolution remeshing method for large-scale visual computation. Leaf modeling is a very difficult and challenging problem due to the wide variations in the shape and structures among different species of plants. Firstly, we introduce a Hierarchical Parametric Veins and Margin (HPVM) representation approach, which describes the leaf biological structures and exact geometry via interpolation of parametric curves from the extracted vein features from non-manifold data. Secondly, a parametric surface model is constructed using HPVM with geometric and structured constraints. Finally, for a given size, we adapt a multi-step discrete point resampling strategy and a CDT-based (Constrained Delaunay Triangulation) meshing method to generate a mesh model. Our representation consists of three coupled data structures, a core hierarchical parametric data structure of veins and margin for the leaf skeleton, the corresponding parametric surface model, and a set of unstructured triangular meshes with user-specified density for the leaf membrane. Numerical experiments show that our method can obtain high quality meshes from the scanned non-manifold mesh data with well-preserved biological structures and geometry. This novel approach is suitable for effective leaf simulation, rendering, texture mapping, and simulation of light distribution in crop canopies.

Land-based crop phenotyping by image analysis: consistent canopy characterization from inconsistent field illumination

BACKGROUND

One of the main challenges associated with image-based field phenotyping is the variability of illumination. During a single day's imaging session, or between different sessions on different days, the sun moves in and out of cloud cover and has varying intensity. How is one to know from consecutive images alone if a plant has become darker over time, or if the weather conditions have simply changed from clear to overcast? This is a significant problem to address as colour is an important phenotypic trait that can be measured automatically from images.

RESULTS

In this work we use an industry standard colour checker to balance the colour in images within and across every day of a field trial conducted over four months in 2016. By ensuring that the colour checker is present in every image we are afforded a 'ground truth' to correct for varying illumination conditions across images. We employ a least squares approach to fit a quadratic model for correcting RGB values of an image in such a way that the observed values of the colour checker tiles align with their true values after the transformation.

CONCLUSIONS

The proposed method is successful in reducing the error between observed and reference colour chart values in all images. Furthermore, the standard deviation of mean canopy colour across multiple days is reduced significantly after colour correction is applied. Finally, we use a number of examples to demonstrate the usefulness of accurate colour measurements in recording phenotypic traits and analysing variation among varieties and treatments.

Holistic and component plant phenotyping using temporal image sequence

BACKGROUND

Image-based plant phenotyping facilitates the extraction of traits noninvasively by analyzing large number of plants in a relatively short period of time. It has the potential to compute advanced phenotypes by considering the whole plant as a single object (holistic phenotypes) or as individual components, i.e., leaves and the stem (component phenotypes), to investigate the biophysical characteristics of the plants. The emergence timing, total number of leaves present at any point of time and the growth of individual leaves during vegetative stage life cycle of the maize plants are significant phenotypic expressions that best contribute to assess the plant vigor. However, image-based automated solution to this novel problem is yet to be explored.

RESULTS

A set of new holistic and component phenotypes are introduced in this paper. To compute the component phenotypes, it is essential to detect the individual leaves and the stem. Thus, the paper introduces a novel method to reliably detect the leaves and the stem of the maize plants by analyzing 2-dimensional visible light image sequences captured from the side using a graph based approach. The total number of leaves are counted and the length of each leaf is measured for all images in the sequence to monitor leaf growth. To evaluate the performance of the proposed algorithm, we introduce University of Nebraska-Lincoln Component Plant Phenotyping Dataset (UNL-CPPD) and provide ground truth to facilitate new algorithm development and uniform comparison. The temporal variation of the component phenotypes regulated by genotypes and environment (i.e., greenhouse) are experimentally demonstrated for the maize plants on UNL-CPPD. Statistical models are applied to analyze the greenhouse environment impact and demonstrate the genetic regulation of the temporal variation of the holistic phenotypes on the public dataset called Panicoid Phenomap-1.

CONCLUSION

The central contribution of the paper is a novel computer vision based algorithm for automated detection of individual leaves and the stem to compute new component phenotypes along with a public release of a benchmark dataset, i.e., UNL-CPPD. Detailed experimental analyses are performed to demonstrate the temporal variation of the holistic and component phenotypes in maize regulated by environment and genetic variation with a discussion on their significance in the context of plant science.

Image-based dynamic quantification and high-accuracy 3D evaluation of canopy structure of plant populations

BACKGROUND AND AIMS

Global agriculture is facing the challenge of a phenotyping bottleneck due to large-scale screening/breeding experiments with improved breeds. Phenotypic analysis with high-throughput, high-accuracy and low-cost technologies has therefore become urgent. Recent advances in image-based 3D reconstruction offer the opportunity of high-throughput phenotyping. The main aim of this study was to quantify and evaluate the canopy structure of plant populations in two and three dimensions based on the multi-view stereo (MVS) approach, and to monitor plant growth and development from seedling stage to fruiting stage.

METHODS

Multi-view images of flat-leaf cucumber, small-leaf pepper and curly-leaf eggplant were obtained by moving a camera around the plant canopy. Three-dimensional point clouds were reconstructed from images based on the MVS approach and were then converted into surfaces with triangular facets. Phenotypic parameters, including leaf length, leaf width, leaf area, plant height and maximum canopy width, were calculated from reconstructed surfaces. Accurate evaluation in 2D and 3D for individual leaves was performed by comparing reconstructed phenotypic parameters with referenced values and by calculating the Hausdorff distance, i.e. the mean distance between two surfaces.

KEY RESULTS

Our analysis demonstrates that there were good agreements in leaf parameters between referenced and estimated values. A high level of overlap was also found between surfaces of image-based reconstructions and laser scanning. Accuracy of 3D reconstruction of curly-leaf plants was relatively lower than that of flat-leaf plants. Plant height of three plants and maximum canopy width of cucumber and pepper showed an increasing trend during the 70 d after transplanting. Maximum canopy width of eggplants reached its peak at the 40th day after transplanting. The larger leaf phenotypic parameters of cucumber were mostly found at the middle-upper leaf position.

CONCLUSIONS

High-accuracy 3D evaluation of reconstruction quality indicated that dynamic capture of the 3D canopy based on the MVS approach can be potentially used in 3D phenotyping for applications in breeding and field management.

A Novel LiDAR-Based Instrument for High-Throughput, 3D Measurement of Morphological Traits in Maize and Sorghum

Recently, imaged-based approaches have developed rapidly for high-throughput plant phenotyping (HTPP). Imaging reduces a 3D plant into 2D images, which makes the retrieval of plant morphological traits challenging. We developed a novel LiDAR-based phenotyping instrument to generate 3D point clouds of single plants. The instrument combined a LiDAR scanner with a precision rotation stage on which an individual plant was placed. A LabVIEW program was developed to control the scanning and rotation motion, synchronize the measurements from both devices, and capture a 360° view point cloud. A data processing pipeline was developed for noise removal, voxelization, triangulation, and plant leaf surface reconstruction. Once the leaf digital surfaces were reconstructed, plant morphological traits, including individual and total leaf area, leaf inclination angle, and leaf angular distribution, were derived. The system was tested with maize and sorghum plants. The results showed that leaf area measurements by the instrument were highly correlated with the reference methods (R² > 0.91 for individual leaf area; R² > 0.95 for total leaf area of each plant). Leaf angular distributions of the two species were also derived. This instrument could fill a critical technological gap for indoor HTPP of plant morphological traits in 3D.

Enhanced thylakoid photoprotection can increase yield and canopy radiation use efficiency in rice

High sunlight can raise plant growth rates but can potentially cause cellular damage. The likelihood of deleterious effects is lowered by a sophisticated set of photoprotective mechanisms, one of the most important being the controlled dissipation of energy from chlorophyll within photosystem II (PSII) measured as non-photochemical quenching (NPQ). Although ubiquitous, the role of NPQ in plant productivity remains uncertain because it momentarily reduces the quantum efficiency of photosynthesis. Here we used plants overexpressing the gene encoding a central regulator of NPQ, the protein PsbS, within a major crop species (rice)  to assess the effect of photoprotection at the whole canopy scale. We accounted for canopy light interception, to our knowledge for the first time in this context. We show that in comparison to wild-type plants, psbS overexpressors increased canopy radiation use efficiency and grain yield in fluctuating light, demonstrating that photoprotective mechanisms should be altered to improve rice crop productivity.

Suboptimal Acclimation of Photosynthesis to Light in Wheat Canopies

Photosynthetic acclimation (photoacclimation) is the process whereby leaves alter their morphology and/or biochemistry to optimize photosynthetic efficiency and productivity according to long-term changes in the light environment. The three-dimensional architecture of plant canopies imposes complex light dynamics, but the drivers for photoacclimation in such fluctuating environments are poorly understood. A technique for high-resolution three-dimensional reconstruction was combined with ray tracing to simulate a daily time course of radiation profiles for architecturally contrasting field-grown wheat (Triticum aestivum) canopies. An empirical model of photoacclimation was adapted to predict the optimal distribution of photosynthesis according to the fluctuating light patterns throughout the canopies. While the photoacclimation model output showed good correlation with field-measured gas-exchange data at the top of the canopy, it predicted a lower optimal light-saturated rate of photosynthesis at the base. Leaf Rubisco and protein contents were consistent with the measured optimal light-saturated rate of photosynthesis. We conclude that, although the photosynthetic capacity of leaves is high enough to exploit brief periods of high light within the canopy (particularly toward the base), the frequency and duration of such sunflecks are too small to make acclimation a viable strategy in terms of carbon gain. This suboptimal acclimation renders a large portion of residual photosynthetic capacity unused and reduces photosynthetic nitrogen use efficiency at the canopy level, with further implications for photosynthetic productivity. It is argued that (1) this represents an untapped source of photosynthetic potential and (2) canopy nitrogen could be lowered with no detriment to carbon gain or grain protein content.

Volatilomics: a non-invasive technique for screening plant phenotypic traits

BACKGROUND

Climate change represents a grand challenge for agricultural productivity. Understanding complex plant traits such as stress tolerance, disease resistance or crop yield is thus essential for breeding and the development of sustainable agriculture strategies. When screening for the most robust plant phenotypes, fast, high-throughput phenotyping represents the means of choice.

RESULTS

We have developed a plant phenotyping platform to measure the emission of volatile organic compounds (VOCs), photosynthetic gas exchange and transpiration under ambient, or abiotic and biotic stress conditions. These parameters are highly suitable markers to non-invasively and dynamically study plant growth and plant stress status, making them perfect test variables for long-term, online plant monitoring. Here we introduce the new phenotyping platform, termed VOC-SCREEN, and present results of a first case study with three barley cultivars, demonstrating that the plant's volatilome can be successfully applied to discriminate different barley varieties.

CONCLUSION

Volatilomics is a promising technique to non-invasively screen for plant phenotypic traits.

Deep machine learning provides state-of-the-art performance in image-based plant phenotyping

In plant phenotyping, it has become important to be able to measure many features on large image sets in order to aid genetic discovery. The size of the datasets, now often captured robotically, often precludes manual inspection, hence the motivation for finding a fully automated approach. Deep learning is an emerging field that promises unparalleled results on many data analysis problems. Building on artificial neural networks, deep approaches have many more hidden layers in the network, and hence have greater discriminative and predictive power. We demonstrate the use of such approaches as part of a plant phenotyping pipeline. We show the success offered by such techniques when applied to the challenging problem of image-based plant phenotyping and demonstrate state-of-the-art results (>97% accuracy) for root and shoot feature identification and localization. We use fully automated trait identification using deep learning to identify quantitative trait loci in root architecture datasets. The majority (12 out of 14) of manually identified quantitative trait loci were also discovered using our automated approach based on deep learning detection to locate plant features. We have shown deep learning-based phenotyping to have very good detection and localization accuracy in validation and testing image sets. We have shown that such features can be used to derive meaningful biological traits, which in turn can be used in quantitative trait loci discovery pipelines. This process can be completely automated. We predict a paradigm shift in image-based phenotyping bought about by such deep learning approaches, given sufficient training sets.

A Robotic Platform for Corn Seedling Morphological Traits Characterization

Crop breeding plays an important role in modern agriculture, improving plant performance, and increasing yield. Identifying the genes that are responsible for beneficial traits greatly facilitates plant breeding efforts for increasing crop production. However, associating genes and their functions with agronomic traits requires researchers to observe, measure, record, and analyze phenotypes of large numbers of plants, a repetitive and error-prone job if performed manually. An automated seedling phenotyping system aimed at replacing manual measurement, reducing sampling time, and increasing the allowable work time is thus highly valuable. Toward this goal, we developed an automated corn seedling phenotyping platform based on a time-of-flight of light (ToF) camera and an industrial robot arm. A ToF camera is mounted on the end effector of the robot arm. The arm positions the ToF camera at different viewpoints for acquiring 3D point cloud data. A camera-to-arm transformation matrix was calculated using a hand-eye calibration procedure and applied to transfer different viewpoints into an arm-based coordinate frame. Point cloud data filters were developed to remove the noise in the background and in the merged seedling point clouds. A 3D-to-2D projection and an x-axis pixel density distribution method were used to segment the stem and leaves. Finally, separated leaves were fitted with 3D curves for morphological traits characterization. This platform was tested on a sample of 60 corn plants at their early growth stages with between two to five leaves. The error ratios of the stem height and leave length measurements are 13.7% and 13.1%, respectively, demonstrating the feasibility of this robotic system for automated corn seedling phenotyping.

Image Analysis in Plant Sciences: Publish Then Perish

Image analysis has become a powerful technique for most plant scientists. In recent years dozens of image analysis tools have been published in plant science journals. These tools cover the full spectrum of plant scales, from single cells to organs and canopies. However, the field of plant image analysis remains in its infancy. It still has to overcome important challenges, such as the lack of robust validation practices or the absence of long-term support. In this Opinion article, I: (i) present the current state of the field, based on data from the plant-image-analysis.org database; (ii) identify the challenges faced by its community; and (iii) propose workable ways of improvement.

Exploring Relationships between Canopy Architecture, Light Distribution, and Photosynthesis in Contrasting Rice Genotypes Using 3D Canopy Reconstruction

The arrangement of leaf material is critical in determining the light environment, and subsequently the photosynthetic productivity of complex crop canopies. However, links between specific canopy architectural traits and photosynthetic productivity across a wide genetic background are poorly understood for field grown crops. The architecture of five genetically diverse rice varieties-four parental founders of a multi-parent advanced generation intercross (MAGIC) population plus a high yielding Philippine variety (IR64)-was captured at two different growth stages using a method for digital plant reconstruction based on stereocameras. Ray tracing was employed to explore the effects of canopy architecture on the resulting light environment in high-resolution, whilst gas exchange measurements were combined with an empirical model of photosynthesis to calculate an estimated carbon gain and total light interception. To further test the impact of different dynamic light patterns on photosynthetic properties, an empirical model of photosynthetic acclimation was employed to predict the optimal light-saturated photosynthesis rate (Pmax ) throughout canopy depth, hypothesizing that light is the sole determinant of productivity in these conditions. First, we show that a plant type with steeper leaf angles allows more efficient penetration of light into lower canopy layers and this, in turn, leads to a greater photosynthetic potential. Second the predicted optimal Pmax responds in a manner that is consistent with fractional interception and leaf area index across this germplasm. However, measured Pmax , especially in lower layers, was consistently higher than the optimal Pmax indicating factors other than light determine photosynthesis profiles. Lastly, varieties with more upright architecture exhibit higher maximum quantum yield of photosynthesis indicating a canopy-level impact on photosynthetic efficiency.

Image-based 3D canopy reconstruction to determine potential productivity in complex multi-species crop systems

Background and Aims

Intercropping systems contain two or more species simultaneously in close proximity. Due to contrasting features of the component crops, quantification of the light environment and photosynthetic productivity is extremely difficult. However it is an essential component of productivity. Here, a low-tech but high-resolution method is presented that can be applied to single- and multi-species cropping systems to facilitate characterization of the light environment. Different row layouts of an intercrop consisting of Bambara groundnut ( Vigna subterranea ) and proso millet ( Panicum miliaceum ) have been used as an example and the new opportunities presented by this approach have been analysed.

Methods

Three-dimensional plant reconstruction, based on stereo cameras, combined with ray tracing was implemented to explore the light environment within the Bambara groundnut-proso millet intercropping system and associated monocrops. Gas exchange data were used to predict the total carbon gain of each component crop.

Key Results

The shading influence of the tall proso millet on the shorter Bambara groundnut results in a reduction in total canopy light interception and carbon gain. However, the increased leaf area index (LAI) of proso millet, higher photosynthetic potential due to the C4 pathway and sub-optimal photosynthetic acclimation of Bambara groundnut to shade means that increasing the number of rows of millet will lead to greater light interception and carbon gain per unit ground area, despite Bambara groundnut intercepting more light per unit leaf area.

Conclusions

Three-dimensional reconstruction combined with ray tracing provides a novel, accurate method of exploring the light environment within an intercrop that does not require difficult measurements of light interception and data-intensive manual reconstruction, especially for such systems with inherently high spatial possibilities. It provides new opportunities for calculating potential productivity within multi-species cropping systems, enables the quantification of dynamic physiological differences between crops grown as monoculture and those within intercrops, and enables the prediction of new productive combinations of previously untested crops.