Using Machine Learning to Develop a Fully Automated Soybean Nodule Acquisition Pipeline (SNAP)

In Situ Root Dataset Expansion Strategy Based on an Improved CycleGAN Generator

The root system plays a vital role in plants' ability to absorb water and nutrients. In situ root research offers an intuitive approach to exploring root phenotypes and their dynamics. Deep-learning-based root segmentation methods have gained popularity, but they require large labeled datasets for training. This paper presents an expansion method for in situ root datasets using an improved CycleGAN generator. In addition, spatial-coordinate-based target background separation method is proposed, which solves the issue of background pixel variations caused by generator errors. Compared to traditional threshold segmentation methods, this approach demonstrates superior speed, accuracy, and stability. Moreover, through time-division soil image acquisition, diverse culture medium can be replaced in in situ root images, thereby enhancing dataset versatility. After validating the performance of the Improved_UNet network on the augmented dataset, the optimal results show a 0.63% increase in mean intersection over union, 0.41% in F1, and 0.04% in accuracy. In terms of generalization performance, the optimal results show a 33.6% increase in mean intersection over union, 28.11% in F1, and 2.62% in accuracy. The experimental results confirm the feasibility and practicality of the proposed dataset augmentation strategy. In the future, we plan to combine normal mapping with rendering software to achieve more accurate shading simulations of in situ roots. In addition, we aim to create a broader range of images that encompass various crop varieties and soil types.

Cyber-agricultural systems for crop breeding and sustainable production

The cyber-agricultural system (CAS) represents an overarching framework of agriculture that leverages recent advances in ubiquitous sensing, artificial intelligence, smart actuators, and scalable cyberinfrastructure (CI) in both breeding and production agriculture. We discuss the recent progress and perspective of the three fundamental components of CAS - sensing, modeling, and actuation - and the emerging concept of agricultural digital twins (DTs). We also discuss how scalable CI is becoming a key enabler of smart agriculture. In this review we shed light on the significance of CAS in revolutionizing crop breeding and production by enhancing efficiency, productivity, sustainability, and resilience to changing climate. Finally, we identify underexplored and promising future directions for CAS research and development.

Application of Improved UNet and EnglightenGAN for Segmentation and Reconstruction of In Situ Roots

The root is an important organ for crops to absorb water and nutrients. Complete and accurate acquisition of root phenotype information is important in root phenomics research. The in situ root research method can obtain root images without destroying the roots. In the image, some of the roots are vulnerable to soil shading, which severely fractures the root system and diminishes its structural integrity. The methods of ensuring the integrity of in situ root identification and establishing in situ root image phenotypic restoration remain to be explored. Therefore, based on the in situ root image of cotton, this study proposes a root segmentation and reconstruction strategy, improves the UNet model, and achieves precise segmentation. It also adjusts the weight parameters of EnlightenGAN to achieve complete reconstruction and employs transfer learning to implement enhanced segmentation using the results of the former two. The research results show that the improved UNet model has an accuracy of 99.2%, mIOU of 87.03%, and F1 of 92.63%. The root reconstructed by EnlightenGAN after direct segmentation has an effective reconstruction ratio of 92.46%. This study enables a transition from supervised to unsupervised training of root system reconstruction by designing a combination strategy of segmentation and reconstruction network. It achieves the integrity restoration of in situ root system pictures and offers a fresh approach to studying the phenotypic of in situ root systems, also realizes the restoration of the integrity of the in situ root image, and provides a new method for in situ root phenotype study.

A Systematic Review of Effective Hardware and Software Factors Affecting High-Throughput Plant Phenotyping

Plant phenotyping studies the complex characteristics of plants, with the aim of evaluating and assessing their condition and finding better exemplars. Recently, a new branch emerged in the phenotyping field, namely, high-throughput phenotyping (HTP). Specifically, HTP exploits modern data sampling techniques to gather a high amount of data that can be used to improve the effectiveness of phenotyping. Hence, HTP combines the knowledge derived from the phenotyping domain with computer science, engineering, and data analysis techniques. In this scenario, machine learning (ML) and deep learning (DL) algorithms have been successfully integrated with noninvasive imaging techniques, playing a key role in automation, standardization, and quantitative data analysis. This study aims to systematically review two main areas of interest for HTP: hardware and software. For each of these areas, two influential factors were identified: for hardware, platforms and sensing equipment were analyzed; for software, the focus was on algorithms and new trends. The study was conducted following the PRISMA protocol, which allowed the refinement of the research on a wide selection of papers by extracting a meaningful dataset of 32 articles of interest. The analysis highlighted the diffusion of ground platforms, which were used in about 47% of reviewed methods, and RGB sensors, mainly due to their competitive costs, high compatibility, and versatility. Furthermore, DL-based algorithms accounted for the larger share (about 69%) of reviewed approaches, mainly due to their effectiveness and the focus posed by the scientific community over the last few years. Future research will focus on improving DL models to better handle hardware-generated data. The final aim is to create integrated, user-friendly, and scalable tools that can be directly deployed and used on the field to improve the overall crop yield.

"Canopy fingerprints" for characterizing three-dimensional point cloud data of soybean canopies

Advances in imaging hardware allow high throughput capture of the detailed three-dimensional (3D) structure of plant canopies. The point cloud data is typically post-processed to extract coarse-scale geometric features (like volume, surface area, height, etc.) for downstream analysis. We extend feature extraction from 3D point cloud data to various additional features, which we denote as 'canopy fingerprints'. This is motivated by the successful application of the fingerprint concept for molecular fingerprints in chemistry applications and acoustic fingerprints in sound engineering applications. We developed an end-to-end pipeline to generate canopy fingerprints of a three-dimensional point cloud of soybean [Glycine max (L.) Merr.] canopies grown in hill plots captured by a terrestrial laser scanner (TLS). The pipeline includes noise removal, registration, and plot extraction, followed by the canopy fingerprint generation. The canopy fingerprints are generated by splitting the data into multiple sub-canopy scale components and extracting sub-canopy scale geometric features. The generated canopy fingerprints are interpretable and can assist in identifying patterns in a database of canopies, querying similar canopies, or identifying canopies with a certain shape. The framework can be extended to other modalities (for instance, hyperspectral point clouds) and tuned to find the most informative fingerprint representation for downstream tasks. These canopy fingerprints can aid in the utilization of canopy traits at previously unutilized scales, and therefore have applications in plant breeding and resilient crop production.

Self-supervised maize kernel classification and segmentation for embryo identification

Introduction

Computer vision and deep learning (DL) techniques have succeeded in a wide range of diverse fields. Recently, these techniques have been successfully deployed in plant science applications to address food security, productivity, and environmental sustainability problems for a growing global population. However, training these DL models often necessitates the large-scale manual annotation of data which frequently becomes a tedious and time-and-resource- intensive process. Recent advances in self-supervised learning (SSL) methods have proven instrumental in overcoming these obstacles, using purely unlabeled datasets to pre-train DL models.

Methods

Here, we implement the popular self-supervised contrastive learning methods of NNCLR Nearest neighbor Contrastive Learning of visual Representations) and SimCLR (Simple framework for Contrastive Learning of visual Representations) for the classification of spatial orientation and segmentation of embryos of maize kernels. Maize kernels are imaged using a commercial high-throughput imaging system. This image data is often used in multiple downstream applications across both production and breeding applications, for instance, sorting for oil content based on segmenting and quantifying the scutellum's size and for classifying haploid and diploid kernels.

Results and discussion

We show that in both classification and segmentation problems, SSL techniques outperform their purely supervised transfer learning-based counterparts and are significantly more annotation efficient. Additionally, we show that a single SSL pre-trained model can be efficiently finetuned for both classification and segmentation, indicating good transferability across multiple downstream applications. Segmentation models with SSL-pretrained backbones produce DICE similarity coefficients of 0.81, higher than the 0.78 and 0.73 of those with ImageNet-pretrained and randomly initialized backbones, respectively. We observe that finetuning classification and segmentation models on as little as 1% annotation produces competitive results. These results show SSL provides a meaningful step forward in data efficiency with agricultural deep learning and computer vision.

Using machine learning enabled phenotyping to characterize nodulation in three early vegetative stages in soybean

The symbiotic relationship between soybean [Glycine max L. (Merr.)] roots and bacteria (Bradyrhizobium japonicum) lead to the development of nodules, important legume root structures where atmospheric nitrogen (N2) is fixed into bio-available ammonia (NH3) for plant growth and development. With the recent development of the Soybean Nodule Acquisition Pipeline (SNAP), nodules can more easily be quantified and evaluated for genetic diversity and growth patterns across unique soybean root system architectures. We explored six diverse soybean genotypes across three field year combinations in three early vegetative stages of development and report the unique relationships between soybean nodules in the taproot and non-taproot growth zones of diverse root system architectures of these genotypes. We found unique growth patterns in the nodules of taproots showing genotypic differences in how nodules grew in count, size, and total nodule area per genotype compared to non-taproot nodules. We propose that nodulation should be defined as a function of both nodule count and individual nodule area resulting in a total nodule area per root or growth regions of the root. We also report on the relationships between the nodules and total nitrogen in the seed at maturity, finding a strong correlation between the taproot nodules and final seed nitrogen at maturity. The applications of these findings could lead to an enhanced understanding of the plant-Bradyrhizobium relationship and exploring these relationships could lead to leveraging greater nitrogen use efficiency and nodulation carbon to nitrogen production efficiency across the soybean germplasm.

Deep learning-based phenotyping for genome wide association studies of sudden death syndrome in soybean

Using a reliable and accurate method to phenotype disease incidence and severity is essential to unravel the complex genetic architecture of disease resistance in plants, and to develop disease resistant cultivars. Genome-wide association studies (GWAS) involve phenotyping large numbers of accessions, and have been used for a myriad of traits. In field studies, genetic accessions are phenotyped across multiple environments and replications, which takes a significant amount of labor and resources. Deep Learning (DL) techniques can be effective for analyzing image-based tasks; thus DL methods are becoming more routine for phenotyping traits to save time and effort. This research aims to conduct GWAS on sudden death syndrome (SDS) of soybean [Glycine max L. (Merr.)] using disease severity from both visual field ratings and DL-based (using images) severity ratings collected from 473 accessions. Images were processed through a DL framework that identified soybean leaflets with SDS symptoms, and then quantified the disease severity on those leaflets into a few classes with mean Average Precision of 0.34 on unseen test data. Both visual field ratings and image-based ratings identified significant single nucleotide polymorphism (SNP) markers associated with disease resistance. These significant SNP markers are either in the proximity of previously reported candidate genes for SDS or near potentially novel candidate genes. Four previously reported SDS QTL were identified that contained a significant SNPs, from this study, from both a visual field rating and an image-based rating. The results of this study provide an exciting avenue of using DL to capture complex phenotypic traits from images to get comparable or more insightful results compared to subjective visual field phenotyping of traits for disease symptoms.

Multi-Omics Techniques for Soybean Molecular Breeding

Soybean is a major crop that provides essential protein and oil for food and feed. Since its origin in China over 5000 years ago, soybean has spread throughout the world, becoming the second most important vegetable oil crop and the primary source of plant protein for global consumption. From early domestication and artificial selection through hybridization and ultimately molecular breeding, the history of soybean breeding parallels major advances in plant science throughout the centuries. Now, rapid progress in plant omics is ushering in a new era of precision design breeding, exemplified by the engineering of elite soybean varieties with specific oil compositions to meet various end-use targets. The assembly of soybean reference genomes, made possible by the development of genome sequencing technology and bioinformatics over the past 20 years, was a great step forward in soybean research. It facilitated advances in soybean transcriptomics, proteomics, metabolomics, and phenomics, all of which paved the way for an integrated approach to molecular breeding in soybean. In this review, we summarize the latest progress in omics research, highlight novel findings made possible by omics techniques, note current drawbacks and areas for further research, and suggest that an efficient multi-omics approach may accelerate soybean breeding in the future. This review will be of interest not only to soybean breeders but also to researchers interested in the use of cutting-edge omics technologies for crop research and improvement.