Proximal Remote Sensing Buggies and Potential Applications for Field-Based Phenotyping

Prediction accuracy and repeatability of UAV based biomass estimation in wheat variety trials as affected by variable type, modelling strategy and sampling location

BACKGROUND

This study explores the use of Unmanned Aerial Vehicles (UAVs) for estimating wheat biomass, focusing on the impact of phenotyping and analytical protocols in the context of late-stage variety selection programs. It emphasizes the importance of variable selection, model specificity, and sampling location within the experimental plot in predicting biomass, aiming to refine UAV-based estimation techniques for enhanced selection accuracy and throughput in variety testing programs.

RESULTS

The research uncovered that integrating geometric and spectral traits led to an increase in prediction accuracy, whilst a recursive feature elimination (RFE) based variable selection workflowled to slight reductions in accuracy with the benefit of increased interpretability. Models, tailored to specific experiments were more accurate than those modelling all experiments together, while models trained for broad-growth stages did not significantly increase accuracy. The comparison between a permanent and a precise region of interest (ROI) within the plot showed negligible differences in biomass prediction accuracy, indicating the robustness of the approach across different sampling locations within the plot. Significant differences in the within-season repeatability (w2) of biomass predictions across different experiments highlighted the need for further investigation into the optimal timing of measurement for prediction.

CONCLUSIONS

The study highlights the promising potential of UAV technology in biomass prediction for wheat at a small plot scale. It suggests that the accuracy of biomass predictions can be significantly improved through optimizing analytical and modelling protocols (i.e., variable selection, algorithm selection, stage-specific model development). Future work should focus on exploring the applicability of these findings under a wider variety of conditions and from a more diverse set of genotypes.

Sunpheno: A Deep Neural Network for Phenological Classification of Sunflower Images

Leaf senescence is a complex trait which becomes crucial for grain filling because photoassimilates are translocated to the seeds. Therefore, a correct sync between leaf senescence and phenological stages is necessary to obtain increasing yields. In this study, we evaluated the performance of five deep machine-learning methods for the evaluation of the phenological stages of sunflowers using images taken with cell phones in the field. From the analysis, we found that the method based on the pre-trained network resnet50 outperformed the other methods, both in terms of accuracy and velocity. Finally, the model generated, Sunpheno, was used to evaluate the phenological stages of two contrasting lines, B481_6 and R453, during senescence. We observed clear differences in phenological stages, confirming the results obtained in previous studies. A database with 5000 images was generated and was classified by an expert. This is important to end the subjectivity involved in decision making regarding the progression of this trait in the field and could be correlated with performance and senescence parameters that are highly associated with yield increase.

Calibrating ultrasonic sensor measurements of crop canopy heights: a case study of maize and wheat

Canopy height serves as an important dynamic indicator of crop growth in the decision-making process of field management. Compared with other commonly used canopy height measurement techniques, ultrasonic sensors are inexpensive and can be exposed in fields for long periods of time to obtain easy-to-process data. However, the acoustic wave characteristics and crop canopy structure affect the measurement accuracy. To improve the ultrasonic sensor measurement accuracy, a four-year (2018-2021) field experiment was conducted on maize and wheat, and a measurement platform was developed. A series of single-factor experiments were conducted to investigate the significant factors affecting measurements, including the observation angle (0-60°), observation height (0.5-2.5 m), observation period (8:00-18:00), platform moving speed with respect to the crop (0-2.0 m min-1), planting density (0.2-1 time of standard planting density), and growth stage (maize from three-leaf to harvest period and wheat from regreening to maturity period). The results indicated that both the observation angle and planting density significantly affected the results of ultrasonic measurements (p-value< 0.05), whereas the effects of other factors on measurement accuracy were negligible (p-value > 0.05). Moreover, a double-input factor calibration model was constructed to assess canopy height under different years by utilizing the normalized difference vegetation index and ultrasonic measurements. The model was developed by employing the least-squares method, and ultrasonic measurement accuracy was significantly improved when integrating the measured value of canopy heights and the normalized difference vegetation index (NDVI). The maize measurement accuracy had a root mean squared error (RMSE) ranging from 81.4 mm to 93.6 mm, while the wheat measurement accuracy had an RMSE from 37.1 mm to 47.2 mm. The research results effectively combine stable and low-cost commercial sensors with ground-based agricultural machinery platforms, enabling efficient and non-destructive acquisition of crop height information.

Bagging Improves the Performance of Deep Learning-Based Semantic Segmentation with Limited Labeled Images: A Case Study of Crop Segmentation for High-Throughput Plant Phenotyping

Advancements in imaging, computer vision, and automation have revolutionized various fields, including field-based high-throughput plant phenotyping (FHTPP). This integration allows for the rapid and accurate measurement of plant traits. Deep Convolutional Neural Networks (DCNNs) have emerged as a powerful tool in FHTPP, particularly in crop segmentation-identifying crops from the background-crucial for trait analysis. However, the effectiveness of DCNNs often hinges on the availability of large, labeled datasets, which poses a challenge due to the high cost of labeling. In this study, a deep learning with bagging approach is introduced to enhance crop segmentation using high-resolution RGB images, tested on the NU-Spidercam dataset from maize plots. The proposed method outperforms traditional machine learning and deep learning models in prediction accuracy and speed. Remarkably, it achieves up to 40% higher Intersection-over-Union (IoU) than the threshold method and 11% over conventional machine learning, with significantly faster prediction times and manageable training duration. Crucially, it demonstrates that even small labeled datasets can yield high accuracy in semantic segmentation. This approach not only proves effective for FHTPP but also suggests potential for broader application in remote sensing, offering a scalable solution to semantic segmentation challenges. This paper is accompanied by publicly available source code.

The role of phenomics and genomics in delineating the genetic basis of complex traits in millets

Millets, comprising a diverse group of small-seeded grains, have emerged as vital crops with immense nutritional, environmental, and economic significance. The comprehension of complex traits in millets, influenced by multifaceted genetic determinants, presents a compelling challenge and opportunity in agricultural research. This review delves into the transformative roles of phenomics and genomics in deciphering these intricate genetic architectures. On the phenomics front, high-throughput platforms generate rich datasets on plant morphology, physiology, and performance in diverse environments. This data, coupled with field trials and controlled conditions, helps to interpret how the environment interacts with genetics. Genomics provides the underlying blueprint for these complex traits. Genome sequencing and genotyping technologies have illuminated the millet genome landscape, revealing diverse gene pools and evolutionary relationships. Additionally, different omics approaches unveil the intricate information of gene expression, protein function, and metabolite accumulation driving phenotypic expression. This multi-omics approach is crucial for identifying candidate genes and unfolding the intricate pathways governing complex traits. The review highlights the synergy between phenomics and genomics. Genomically informed phenotyping targets specific traits, reducing the breeding size and cost. Conversely, phenomics identifies promising germplasm for genomic analysis, prioritizing variants with superior performance. This dynamic interplay accelerates breeding programs and facilitates the development of climate-smart, nutrient-rich millet varieties and hybrids. In conclusion, this review emphasizes the crucial roles of phenomics and genomics in unlocking the genetic enigma of millets.

Comparing CNNs and PLSr for estimating wheat organs biophysical variables using proximal sensing

Estimation of biophysical vegetation variables is of interest for diverse applications, such as monitoring of crop growth and health or yield prediction. However, remote estimation of these variables remains challenging due to the inherent complexity of plant architecture, biology and surrounding environment, and the need for features engineering. Recent advancements in deep learning, particularly convolutional neural networks (CNN), offer promising solutions to address this challenge. Unfortunately, the limited availability of labeled data has hindered the exploration of CNNs for regression tasks, especially in the frame of crop phenotyping. In this study, the effectiveness of various CNN models in predicting wheat dry matter, nitrogen uptake, and nitrogen concentration from RGB and multispectral images taken from tillering to maturity was examined. To overcome the scarcity of labeled data, a training pipeline was devised. This pipeline involves transfer learning, pseudo-labeling of unlabeled data and temporal relationship correction. The results demonstrated that CNN models significantly benefit from the pseudolabeling method, while the machine learning approach employing a PLSr did not show comparable performance. Among the models evaluated, EfficientNetB4 achieved the highest accuracy for predicting above-ground biomass, with an R² value of 0.92. In contrast, Resnet50 demonstrated superior performance in predicting LAI, nitrogen uptake, and nitrogen concentration, with R² values of 0.82, 0.73, and 0.80, respectively. Moreover, the study explored multi-output models to predict the distribution of dry matter and nitrogen uptake between stem, inferior leaves, flag leaf, and ear. The findings indicate that CNNs hold promise as accessible and promising tools for phenotyping quantitative biophysical variables of crops. However, further research is required to harness their full potential.

Field phenotyping for African crops: overview and perspectives

Improvements in crop productivity are required to meet the dietary demands of the rapidly-increasing African population. The development of key staple crop cultivars that are high-yielding and resilient to biotic and abiotic stresses is essential. To contribute to this objective, high-throughput plant phenotyping approaches are important enablers for the African plant science community to measure complex quantitative phenotypes and to establish the genetic basis of agriculturally relevant traits. These advances will facilitate the screening of germplasm for optimum performance and adaptation to low-input agriculture and resource-constrained environments. Increasing the capacity to investigate plant function and structure through non-invasive technologies is an effective strategy to aid plant breeding and additionally may contribute to precision agriculture. However, despite the significant global advances in basic knowledge and sensor technology for plant phenotyping, Africa still lags behind in the development and implementation of these systems due to several practical, financial, geographical and political barriers. Currently, field phenotyping is mostly carried out by manual methods that are prone to error, costly, labor-intensive and may come with adverse economic implications. Therefore, improvements in advanced field phenotyping capabilities and appropriate implementation are key factors for success in modern breeding and agricultural monitoring. In this review, we provide an overview of the current state of field phenotyping and the challenges limiting its implementation in some African countries. We suggest that the lack of appropriate field phenotyping infrastructures is impeding the development of improved crop cultivars and will have a detrimental impact on the agricultural sector and on food security. We highlight the prospects for integrating emerging and advanced low-cost phenotyping technologies into breeding protocols and characterizing crop responses to environmental challenges in field experimentation. Finally, we explore strategies for overcoming the barriers and maximizing the full potential of emerging field phenotyping technologies in African agriculture. This review paper will open new windows and provide new perspectives for breeders and the entire plant science community in Africa.

Frost Damage Index: The Antipode of Growing Degree Days

Abiotic stresses such as heat and frost limit plant growth and productivity. Image-based field phenotyping methods allow quantifying not only plant growth but also plant senescence. Winter crops show senescence caused by cold spells, visible as declines in leaf area. We accurately quantified such declines by monitoring changes in canopy cover based on time-resolved high-resolution imagery in the field. Thirty-six winter wheat genotypes were measured in multiple years. A concept termed "frost damage index" (FDI) was developed that, in analogy to growing degree days, summarizes frost events in a cumulative way. The measured sensitivity of genotypes to the FDI correlated with visual scorings commonly used in breeding to assess winter hardiness. The FDI concept could be adapted to other factors such as drought or heat stress. While commonly not considered in plant growth modeling, integrating such degradation processes may be key to improving the prediction of plant performance for future climate scenarios.

High-throughput phenotyping for non-destructive estimation of soybean fresh biomass using a machine learning model and temporal UAV data

BACKGROUND

Biomass accumulation as a growth indicator can be significant in achieving high and stable soybean yields. More robust genotypes have a better potential for exploiting available resources such as water or sunlight. Biomass data implemented as a new trait in soybean breeding programs could be beneficial in the selection of varieties that are more competitive against weeds and have better radiation use efficiency. The standard techniques for biomass determination are invasive, inefficient, and restricted to one-time point per plot. Machine learning models (MLMs) based on the multispectral (MS) images were created so as to overcome these issues and provide a non-destructive, fast, and accurate tool for in-season estimation of soybean fresh biomass (FB). The MS photos were taken during two growing seasons of 10 soybean varieties, using six-sensor digital camera mounted on the unmanned aerial vehicle (UAV). For model calibration, canopy cover (CC), plant height (PH), and 31 vegetation index (VI) were extracted from the images and used as predictors in the random forest (RF) and partial least squares regression (PLSR) algorithm. To create a more efficient model, highly correlated VIs were excluded and only the triangular greenness index (TGI) and green chlorophyll index (GCI) remained.

RESULTS

More precise results with a lower mean absolute error (MAE) were obtained with RF (MAE = 0.17 kg/m2) compared to the PLSR (MAE = 0.20 kg/m2). High accuracy in the prediction of soybean FB was achieved using only four predictors (CC, PH and two VIs). The selected model was additionally tested in a two-year trial on an independent set of soybean genotypes in drought simulation environments. The results showed that soybean grown under drought conditions accumulated less biomass than the control, which was expected due to the limited resources.

CONCLUSION

The research proved that soybean FB could be successfully predicted using UAV photos and MLM. The filtration of highly correlated variables reduced the final number of predictors, improving the efficiency of remote biomass estimation. The additional testing conducted in the independent environment proved that model is capable to distinguish different values of soybean FB as a consequence of drought. Assessed variability in FB indicates the robustness and effectiveness of the proposed model, as a novel tool for the non-destructive estimation of soybean FB.

Pitfalls and potential of high-throughput plant phenotyping platforms

Automated high-throughput plant phenotyping (HTPP) enables non-invasive, fast and standardized evaluations of a large number of plants for size, development, and certain physiological variables. Many research groups recognize the potential of HTPP and have made significant investments in HTPP infrastructure, or are considering doing so. To make optimal use of limited resources, it is important to plan and use these facilities prudently and to interpret the results carefully. Here we present a number of points that users should consider before purchasing, building or utilizing such equipment. They relate to (1) the financial and time investment for acquisition, operation, and maintenance, (2) the constraints associated with such machines in terms of flexibility and growth conditions, (3) the pros and cons of frequent non-destructive measurements, (4) the level of information provided by proxy traits, and (5) the utilization of calibration curves. Using data from an Arabidopsis experiment, we demonstrate how diurnal changes in leaf angle can impact plant size estimates from top-view cameras, causing deviations of more than 20% over the day. Growth analysis data from another rosette species showed that there was a curvilinear relationship between total and projected leaf area. Neglecting this curvilinearity resulted in linear calibration curves that, although having a high r2 (> 0.92), also exhibited large relative errors. Another important consideration we discussed is the frequency at which calibration curves need to be generated and whether different treatments, seasons, or genotypes require distinct calibration curves. In conclusion, HTPP systems have become a valuable addition to the toolbox of plant biologists, provided that these systems are tailored to the research questions of interest, and users are aware of both the possible pitfalls and potential involved.

Identification of new cold tolerant Zoysia grass species using high-resolution RGB and multi-spectral imaging

Zoysia grass (Zoysia spp.) is the most widely used warm-season turf grass in Korea due to its durability and resistance to environmental stresses. To develop new longer-period greenness cultivars, it is essential to screen germplasm which maintains the greenness at a lower temperature. Conventional methods are time-consuming, laborious, and subjective. Therefore, in this study, we demonstrate an objective and efficient method to screen maintaining longer greenness germplasm using RGB and multispectral images. From August to December, time-series data were acquired and we calculated green cover percentage (GCP), Normalized Difference Vegetation Index (NDVI), Normalized Difference Red Edge Index (NDRE), Soil-adjusted Vegetation Index (SAVI), and Enhanced Vegetation Index (EVI) values of germplasm from RGB and multispectral images by applying vegetation indexs. The result showed significant differences in GCP, NDVI, NDRE, SAVI, and EVI among germplasm (p < 0.05). The GCP, which evaluated the quantity of greenness by counting pixels of the green area from RGB images, exhibited maintenance of greenness over 90% for August and September but, sharply decrease from October. The study found significant differences in GCP and NDVI among germplasm. san208 exhibiting over 90% GCP and high NDVI values during 153 days. In addition, we also conducted assessments using various vegetation indexes, namely NDRE, SAVI, and EVI. san208 exhibited NDRE levels exceeding 3% throughout this period. As for SAVI, it initially started at approximately 38% and gradually decreased to around 4% over the course of these days. Furthermore, for the month of August, it recorded approximately 6%, but experienced a decline from about 9% to 1% between September and October. The complementary use of both indicators could be an efficient method for objectively assessing the greenness of turf both quantitatively and qualitatively.

Opportunity and challenges of phenotyping plant salt tolerance

Salinity is a key factor limiting agricultural production worldwide. Recent advances in field phenotyping have enabled the recording of the environmental history and dynamic response of plants by considering both genotype × environment (G×E) interactions and envirotyping. However, only a few studies have focused on plant salt tolerance phenotyping. Therefore, we analyzed the potential opportunities and major challenges in improving plant salt tolerance using advanced field phenotyping technologies. RGB imaging and spectral and thermal sensors are the most useful and important sensing techniques for assessing key morphological and physiological traits of plant salt tolerance. However, field phenotyping faces challenges owing to its practical applications and high costs, limiting its use in early generation breeding and in developing countries.

LeafSpec-Dicot: An Accurate and Portable Hyperspectral Imaging Device for Dicot Leaves

Soybean is one of the world's most consumed crops. As the human population continuously increases, new phenotyping technology is needed to develop new soybean varieties with high-yield, stress-tolerant, and disease-tolerant traits. Hyperspectral imaging (HSI) is one of the most used technologies for phenotyping. The current HSI techniques with indoor imaging towers and unmanned aerial vehicles (UAVs) suffer from multiple major noise sources, such as changes in ambient lighting conditions, leaf slopes, and environmental conditions. To reduce the noise, a portable single-leaf high-resolution HSI imager named LeafSpec was developed. However, the original design does not work efficiently for the size and shape of dicot leaves, such as soybean leaves. In addition, there is a potential to make the dicot leaf scanning much faster and easier by automating the manual scan effort in the original design. Therefore, a renovated design of a LeafSpec with increased efficiency and imaging quality for dicot leaves is presented in this paper. The new design collects an image of a dicot leaf within 20 s. The data quality of this new device is validated by detecting the effect of nitrogen treatment on soybean plants. The improved spatial resolution allows users to utilize the Normalized Difference Vegetative Index (NDVI) spatial distribution heatmap of the entire leaf to predict the nitrogen content of a soybean plant. This preliminary NDVI distribution analysis result shows a strong correlation (R2 = 0.871) between the image collected by the device and the nitrogen content measured by a commercial laboratory. Therefore, it is concluded that the new LeafSpec-Dicot device can provide high-quality hyperspectral leaf images with high spatial resolution, high spectral resolution, and increased throughput for more accurate phenotyping. This enables phenotyping researchers to develop novel HSI image processing algorithms to utilize both spatial and spectral information to reveal more signals in soybean leaf images.

TSWIFT: Tower Spectrometer on Wheels for Investigating Frequent Timeseries for high-throughput phenotyping of vegetation physiology

BACKGROUND

Remote sensing instruments enable high-throughput phenotyping of plant traits and stress resilience across scale. Spatial (handheld devices, towers, drones, airborne, and satellites) and temporal (continuous or intermittent) tradeoffs can enable or constrain plant science applications. Here, we describe the technical details of TSWIFT (Tower Spectrometer on Wheels for Investigating Frequent Timeseries), a mobile tower-based hyperspectral remote sensing system for continuous monitoring of spectral reflectance across visible-near infrared regions with the capacity to resolve solar-induced fluorescence (SIF).

RESULTS

We demonstrate potential applications for monitoring short-term (diurnal) and long-term (seasonal) variation of vegetation for high-throughput phenotyping applications. We deployed TSWIFT in a field experiment of 300 common bean genotypes in two treatments: control (irrigated) and drought (terminal drought). We evaluated the normalized difference vegetation index (NDVI), photochemical reflectance index (PRI), and SIF, as well as the coefficient of variation (CV) across the visible-near infrared spectral range (400 to 900 nm). NDVI tracked structural variation early in the growing season, following initial plant growth and development. PRI and SIF were more dynamic, exhibiting variation diurnally and seasonally, enabling quantification of genotypic variation in physiological response to drought conditions. Beyond vegetation indices, CV of hyperspectral reflectance showed the most variability across genotypes, treatment, and time in the visible and red-edge spectral regions.

CONCLUSIONS

TSWIFT enables continuous and automated monitoring of hyperspectral reflectance for assessing variation in plant structure and function at high spatial and temporal resolutions for high-throughput phenotyping. Mobile, tower-based systems like this can provide short- and long-term datasets to assess genotypic and/or management responses to the environment, and ultimately enable the spectral prediction of resource-use efficiency, stress resilience, productivity and yield.

Retrieving rice (Oryza sativa L.) net photosynthetic rate from UAV multispectral images based on machine learning methods

Photosynthesis is the key physiological activity in the process of crop growth and plays an irreplaceable role in carbon assimilation and yield formation. This study extracted rice (Oryza sativa L.) canopy reflectance based on the UAV multispectral images and analyzed the correlation between 25 vegetation indices (VIs), three textural indices (TIs), and net photosynthetic rate (Pn) at different growth stages. Linear regression (LR), support vector regression (SVR), gradient boosting decision tree (GBDT), random forest (RF), and multilayer perceptron neural network (MLP) models were employed for Pn estimation, and the modeling accuracy was compared under the input condition of VIs, VIs combined with TIs, and fusion of VIs and TIs with plant height (PH) and SPAD. The results showed that VIs and TIs generally had the relatively best correlation with Pn at the jointing-booting stage and the number of VIs with significant correlation (p< 0.05) was the largest. Therefore, the employed models could achieve the highest overall accuracy [coefficient of determination (R ²) of 0.383-0.938]. However, as the growth stage progressed, the correlation gradually weakened and resulted in accuracy decrease (R ² of 0.258-0.928 and 0.125-0.863 at the heading-flowering and ripening stages, respectively). Among the tested models, GBDT and RF models could attain the best performance based on only VIs input (with R ² ranging from 0.863 to 0.938 and from 0.815 to 0.872, respectively). Furthermore, the fusion input of VIs, TIs with PH, and SPAD could more effectively improve the model accuracy (R ² increased by 0.049-0.249, 0.063-0.470, and 0.113-0.471, respectively, for three growth stages) compared with the input combination of VIs and TIs (R ² increased by 0.015-0.090, 0.001-0.139, and 0.023-0.114). Therefore, the GBDT and RF model with fused input could be highly recommended for rice Pn estimation and the methods could also provide reference for Pn monitoring and further yield prediction at field scale.

Design and Development of a Low-Cost UGV 3D Phenotyping Platform with Integrated LiDAR and Electric Slide Rail

Unmanned ground vehicles (UGV) have attracted much attention in crop phenotype monitoring due to their lightweight and flexibility. This paper describes a new UGV equipped with an electric slide rail and point cloud high-throughput acquisition and phenotype extraction system. The designed UGV is equipped with an autopilot system, a small electric slide rail, and Light Detection and Ranging (LiDAR) to achieve high-throughput, high-precision automatic crop point cloud acquisition and map building. The phenotype analysis system realized single plant segmentation and pipeline extraction of plant height and maximum crown width of the crop point cloud using the Random sampling consistency (RANSAC), Euclidean clustering, and k-means clustering algorithm. This phenotyping system was used to collect point cloud data and extract plant height and maximum crown width for 54 greenhouse-potted lettuce plants. The results showed that the correlation coefficient (R2) between the collected data and manual measurements were 0.97996 and 0.90975, respectively, while the root mean square error (RMSE) was 1.51 cm and 4.99 cm, respectively. At less than a tenth of the cost of the PlantEye F500, UGV achieves phenotypic data acquisition with less error and detects morphological trait differences between lettuce types. Thus, it could be suitable for actual 3D phenotypic measurements of greenhouse crops.

Designing a Proximal Sensing Camera Acquisition System for Vineyard Applications: Results and Feedback on 8 Years of Experiments

The potential of image proximal sensing for agricultural applications has been a prolific scientific subject in the recent literature. Its main appeal lies in the sensing of precise information about plant status, which is either harder or impossible to extract from lower-resolution downward-looking image sensors such as satellite or drone imagery. Yet, many theoretical and practical problems arise when dealing with proximal sensing, especially on perennial crops such as vineyards. Indeed, vineyards exhibit challenging physical obstacles and many degrees of variability in their layout. In this paper, we present the design of a mobile camera suited to vineyards and harsh experimental conditions, as well as the results and assessments of 8 years' worth of studies using that camera. These projects ranged from in-field yield estimation (berry counting) to disease detection, providing new insights on typical viticulture problems that could also be generalized to orchard crops. Different recommendations are then provided using small case studies, such as the difficulties related to framing plots with different structures or the mounting of the sensor on a moving vehicle. While results stress the obvious importance and strong benefits of a thorough experimental design, they also indicate some inescapable pitfalls, illustrating the need for more robust image analysis algorithms and better databases. We believe sharing that experience with the scientific community can only benefit the future development of these innovative approaches.

New strategies on the application of artificial intelligence in the field of phytoremediation

Artificial Intelligence (AI) is expected to play a crucial role in the field of phytoremediation and its effective management in monitoring the growth of the plant in different contaminated soils and their phenotype characteristic such as the biomass of plants. This review focuses on recent applications of various AI techniques and remote sensing approaches in the field of phytoremediation to monitor plant growth with relevant morphological parameters using novel sensors, cameras, and associated modern technologies. Novel sensing and various measurement techniques are highlighted. Input parameters are used to develop futuristic models utilizing AI and statistical approaches. Additionally, a brief discussion has been presented on the use of AI techniques to detect metal hyperaccumulation in all parts of the plant, carbon capture, and sequestration along with its effect on food production to ensure food safety and security. This article highlights the application, limitation, and future perspectives of phytoremediation in monitoring the mobility, bioavailability, seasonal variation, effect of temperature on plant growth, and plant response to the heavy metals in soil by using the AI technique. Suggestions are made for future research in this area to analyze which would help to enhance plant growth and improve food security in long run.

Machine Learning in the Analysis of Multispectral Reads in Maize Canopies Responding to Increased Temperatures and Water Deficit

Real-time monitoring of crop responses to environmental deviations represents a new avenue for applications of remote and proximal sensing. Combining the high-throughput devices with novel machine learning (ML) approaches shows promise in the monitoring of agricultural production. The 3 × 2 multispectral arrays with responses at 610 and 680 nm (red), 730 and 760 nm (red-edge) and 810 and 860 nm (infrared) spectra were used to assess the occurrence of leaf rolling (LR) in 545 experimental maize plots measured four times for calibration dataset (n = 2180) and 145 plots measured once for external validation. Multispectral reads were used to calculate 15 simple normalized vegetation indices. Four ML algorithms were assessed: single and multilayer perceptron (SLP and MLP), convolutional neural network (CNN) and support vector machines (SVM) in three validation procedures, which were stratified cross-validation, random subset validation and validation with external dataset. Leaf rolling occurrence caused visible changes in spectral responses and calculated vegetation indexes. All algorithms showed good performance metrics in stratified cross-validation (accuracy >80%). SLP was the least efficient in predictions with external datasets, while MLP, CNN and SVM showed comparable performance. Combining ML with multispectral sensing shows promise in transition towards agriculture based on data-driven decisions especially considering the novel Internet of Things (IoT) avenues.

Advances in field-based high-throughput photosynthetic phenotyping

Gas exchange techniques revolutionized plant research and advanced understanding, including associated fluxes and efficiencies, of photosynthesis, photorespiration, and respiration of plants from cellular to ecosystem scales. These techniques remain the gold standard for inferring photosynthetic rates and underlying physiology/biochemistry, although their utility for high-throughput phenotyping (HTP) of photosynthesis is limited both by the number of gas exchange systems available and the number of personnel available to operate the equipment. Remote sensing techniques have long been used to assess ecosystem productivity at coarse spatial and temporal resolutions, and advances in sensor technology coupled with advanced statistical techniques are expanding remote sensing tools to finer spatial scales and increasing the number and complexity of phenotypes that can be extracted. In this review, we outline the photosynthetic phenotypes of interest to the plant science community and describe the advances in high-throughput techniques to characterize photosynthesis at spatial scales useful to infer treatment or genotypic variation in field-based experiments or breeding trials. We will accomplish this objective by presenting six lessons learned thus far through the development and application of proximal/remote sensing-based measurements and the accompanying statistical analyses. We will conclude by outlining what we perceive as the current limitations, bottlenecks, and opportunities facing HTP of photosynthesis.

Drought Tolerant Near Isogenic Lines of Pusa 44 Pyramided With qDTY2.1 and qDTY3.1, Show Accelerated Recovery Response in a High Throughput Phenomics Based Phenotyping

Reproductive stage drought stress (RSDS) is a major challenge in rice production worldwide. Cultivar development with drought tolerance has been slow due to the lack of precise high throughput phenotyping tools to quantify drought stress-induced effects. Most of the available techniques are based on destructive sampling and do not assess the progress of the plant's response to drought. In this study, we have used state-of-the-art image-based phenotyping in a phenomics platform that offers a controlled environment, non-invasive phenotyping, high accuracy, speed, and continuity. In rice, several quantitative trait loci (QTLs) which govern grain yield under drought determine RSDS tolerance. Among these, qDTY2.1 and qDTY3.1 were used for marker-assisted breeding. A set of 35 near-isogenic lines (NILs), introgressed with these QTLs in the popular variety, Pusa 44 were used to assess the efficiency of image-based phenotyping for RSDS tolerance. NILs offered the most reliable contrast since they differed from Pusa 44 only for the QTLs. Four traits, namely, the projected shoot area (PSA), water use (WU), transpiration rate (TR), and red-green-blue (RGB) and near-infrared (NIR) values were used. Differential temporal responses could be seen under drought, but not under unstressed conditions. NILs showed significant level of RSDS tolerance as compared to Pusa 44. Among the traits, PSA showed strong association with yield (80%) as well as with two drought tolerances indices, stress susceptibility index (SSI) and tolerance index (TOL), establishing its ability in identifying the best drought tolerant NILs. The results revealed that the introgression of QTLs helped minimize the mean WU per unit of biomass per day, suggesting the potential role of these QTLs in improving WU-efficiency (WUE). We identified 11 NILs based on phenomics traits as well as performance under imposed drought in the field. The study emphasizes the use of phenomics traits as selection criteria for RSDS tolerance at an early stage, and is the first report of using phenomics parameters in RSDS selection in rice.

Wheat Ear Segmentation Based on a Multisensor System and Superpixel Classification

The automatic segmentation of ears in wheat canopy images is an important step to measure ear density or extract relevant plant traits separately for the different organs. Recent deep learning algorithms appear as promising tools to accurately detect ears in a wide diversity of conditions. However, they remain complicated to implement and necessitate a huge training database. This paper is aimed at proposing an easy and quick to train and robust alternative to segment wheat ears from heading to maturity growth stage. The tested method was based on superpixel classification exploiting features from RGB and multispectral cameras. Three classifiers were trained with wheat images acquired from heading to maturity on two cultivars at different levels of fertilizer. The best classifier, the support vector machine (SVM), yielded satisfactory segmentation and reached 94% accuracy. However, the segmentation at the pixel level could not be assessed only by the superpixel classification accuracy. For this reason, a second assessment method was proposed to consider the entire process. A simple graphical tool was developed to annotate pixels. The strategy was to annotate a few pixels per image to be able to quickly annotate the entire image set, and thus account for very diverse conditions. Results showed a lesser segmentation score (F1-score) for the heading and flowering stages and for the zero nitrogen input object. The methodology appeared appropriate for further work on the growth dynamics of the different wheat organs and in the frame of other segmentation challenges.

CBM: An IoT Enabled LiDAR Sensor for In-Field Crop Height and Biomass Measurements

The phenotypic characterization of crop genotypes is an essential, yet challenging, aspect of crop management and agriculture research. Digital sensing technologies are rapidly advancing plant phenotyping and speeding-up crop breeding outcomes. However, off-the-shelf sensors might not be fully applicable and suitable for agricultural research due to the diversity in crop species and specific needs during plant breeding selections. Customized sensing systems with specialized sensor hardware and software architecture provide a powerful and low-cost solution. This study designed and developed a fully integrated Raspberry Pi-based LiDAR sensor named CropBioMass (CBM), enabled by internet of things to provide a complete end-to-end pipeline. The CBM is a low-cost sensor, provides high-throughput seamless data collection in field, small data footprint, injection of data onto the remote server, and automated data processing. The phenotypic traits of crop fresh biomass, dry biomass, and plant height that were estimated by CBM data had high correlation with ground truth manual measurements in a wheat field trial. The CBM is readily applicable for high-throughput plant phenotyping, crop monitoring, and management for precision agricultural applications.

Hyperspectral Reflectance Response of Wild Rocket (Diplotaxis tenuifolia) Baby-Leaf to Bio-Based Disease Resistance Inducers Using a Linear Mixed Effect Model

Baby leaf wild rocket cropping systems feeding the high convenience salad chain are prone to a set of disease agents that require management measures compatible with the sustainability-own features of the ready-to-eat food segment. In this light, bio-based disease resistance inducers able to elicit the plant's defense mechanism(s) against a wide-spectrum of pathogens are proposed as safe and effective remedies as alternatives to synthetic fungicides, to be, however, implemented under practical field applications. Hyperspectral-based proximal sensing was applied here to detect plant reflectance response to treatment of wild rocket beds with Trichoderma atroviride strain TA35, laminarin-based Vacciplant^®, and Saccharomyces cerevisiae strain LAS117 cell wall extract-based Romeo^®, compared to a local standard approach including synthetic fungicides (i.e., cyprodinil, fludioxonil, mandipropamid, and metalaxyl-m) and a not-treated control. Variability of the spectral information acquired in VIS-NIR-SWIR regions per treatment was explained by three principal components associated with foliar absorption of water, structural characteristics of the vegetation, and the ecophysiological plant status. Therefore, the following model-based statistical approach returned the interpretation of the inducers' performances at field scale consistent with their putative biological effects. The study stated that compost and laminarin-based treatments were the highest crop impacting ones, resulting in enhanced water intake and in stress-related pigment adjustment, respectively. Whereas plants under the conventional chemical management proved to be in better vigor and health status than the untreated control.

Semi-Automatic Spectral Image Stitching for a Compact Hybrid Linescan Hyperspectral Camera towards Near Field Remote Monitoring of Potato Crop Leaves

The miniaturization of hyperspectral cameras has opened a new path to capture spectral information. One such camera, called the hybrid linescan camera, requires accurate control of its movement. Contrary to classical linescan cameras, where one line is available for every band in one shot, the latter asks for multiple shots to fill a line with multiple bands. Unfortunately, the reconstruction is corrupted by a parallax effect, which affects each band differently. In this article, we propose a two-step procedure, which first reconstructs an approximate datacube in two different ways, and second, performs a corrective warping on each band based on a multiple homography framework. The second step combines different stitching methods to perform this reconstruction. A complete synthetic and experimental comparison is performed by using geometric indicators of reference points. It appears throughout the course of our experimentation that misalignment is significantly reduced but remains non-negligible at the potato leaf scale.

Large-scale field phenotyping using backpack LiDAR and CropQuant-3D to measure structural variation in wheat

Plant phenomics bridges the gap between traits of agricultural importance and genomic information. Limitations of current field-based phenotyping solutions include mobility, affordability, throughput, accuracy, scalability, and the ability to analyze big data collected. Here, we present a large-scale phenotyping solution that combines a commercial backpack Light Detection and Ranging (LiDAR) device and our analytic software, CropQuant-3D, which have been applied jointly to phenotype wheat (Triticum aestivum) and associated 3D trait analysis. The use of LiDAR can acquire millions of 3D points to represent spatial features of crops, and CropQuant-3D can extract meaningful traits from large, complex point clouds. In a case study examining the response of wheat varieties to three different levels of nitrogen fertilization in field experiments, the combined solution differentiated significant genotype and treatment effects on crop growth and structural variation in the canopy, with strong correlations with manual measurements. Hence, we demonstrate that this system could consistently perform 3D trait analysis at a larger scale and more quickly than heretofore possible and addresses challenges in mobility, throughput, and scalability. To ensure our work could reach non-expert users, we developed an open-source graphical user interface for CropQuant-3D. We, therefore, believe that the combined system is easy-to-use and could be used as a reliable research tool in multi-location phenotyping for both crop research and breeding. Furthermore, together with the fast maturity of LiDAR technologies, the system has the potential for further development in accuracy and affordability, contributing to the resolution of the phenotyping bottleneck and exploiting available genomic resources more effectively.

Detecting Sorghum Plant and Head Features from Multispectral UAV Imagery

In plant breeding, unmanned aerial vehicles (UAVs) carrying multispectral cameras have demonstrated increasing utility for high-throughput phenotyping (HTP) to aid the interpretation of genotype and environment effects on morphological, biochemical, and physiological traits. A key constraint remains the reduced resolution and quality extracted from "stitched" mosaics generated from UAV missions across large areas. This can be addressed by generating high-quality reflectance data from a single nadir image per plot. In this study, a pipeline was developed to derive reflectance data from raw multispectral UAV images that preserve the original high spatial and spectral resolutions and to use these for phenotyping applications. Sequential steps involved (i) imagery calibration, (ii) spectral band alignment, (iii) backward calculation, (iv) plot segmentation, and (v) application. Each step was designed and optimised to estimate the number of plants and count sorghum heads within each breeding plot. Using a derived nadir image of each plot, the coefficients of determination were 0.90 and 0.86 for estimates of the number of sorghum plants and heads, respectively. Furthermore, the reflectance information acquired from the different spectral bands showed appreciably high discriminative ability for sorghum head colours (i.e., red and white). Deployment of this pipeline allowed accurate segmentation of crop organs at the canopy level across many diverse field plots with minimal training needed from machine learning approaches.

Automatic Identification and Monitoring of Plant Diseases Using Unmanned Aerial Vehicles: A Review

Disease diagnosis is one of the major tasks for increasing food production in agriculture. Although precision agriculture (PA) takes less time and provides a more precise application of agricultural activities, the detection of disease using an Unmanned Aerial System (UAS) is a challenging task. Several Unmanned Aerial Vehicles (UAVs) and sensors have been used for this purpose. The UAVs’ platforms and their peripherals have their own limitations in accurately diagnosing plant diseases. Several types of image processing software are available for vignetting and orthorectification. The training and validation of datasets are important characteristics of data analysis. Currently, different algorithms and architectures of machine learning models are used to classify and detect plant diseases. These models help in image segmentation and feature extractions to interpret results. Researchers also use the values of vegetative indices, such as Normalized Difference Vegetative Index (NDVI), Crop Water Stress Index (CWSI), etc., acquired from different multispectral and hyperspectral sensors to fit into the statistical models to deliver results. There are still various drifts in the automatic detection of plant diseases as imaging sensors are limited by their own spectral bandwidth, resolution, background noise of the image, etc. The future of crop health monitoring using UAVs should include a gimble consisting of multiple sensors, large datasets for training and validation, the development of site-specific irradiance systems, and so on. This review briefly highlights the advantages of automatic detection of plant diseases to the growers.

Research on Polarized Multi-Spectral System and Fusion Algorithm for Remote Sensing of Vegetation Status at Night

The monitoring of vegetation via remote sensing has been widely applied in various fields, such as crop diseases and pests, forest coverage and vegetation growth status, but such monitoring activities were mainly carried out in the daytime, resulting in limitations in sensing the status of vegetation at night. In this article, with the aim of monitoring the health status of outdoor plants at night by remote sensing, a polarized multispectral low-illumination-level imaging system (PMSIS) was established, and a fusion algorithm was proposed to detect vegetation by sensing the spectrum and polarization characteristics of the diffuse and specular reflection of vegetation. The normalized vegetation index (NDVI), degree of linear polarization (DoLP) and angle of polarization (AOP) are all calculated in the fusion algorithm to better detect the health status of plants in the night environment. Based on NDVI, DoLP and AOP fusion images (NDAI), a new index of night plant state detection (NPSDI) was proposed. A correlation analysis was made for the chlorophyll content (SPAD), nitrogen content (NC), NDVI and NPSDI to understand their capabilities to detect plants under stress. The scatter plot of NPSDI shows a good distinction between vegetation with different health levels, which can be seen from the high specificity and sensitivity values. It can be seen that NPSDI has a good correlation with NDVI (coefficient of determination R2 = 0.968), PSAD (R2 = 0.882) and NC (R2 = 0.916), which highlights the potential of NPSDI in the identification of plant health status. The results clearly show that the proposed fusion algorithm can enhance the contrast effect and the generated fusion image will carry richer vegetation information, thereby monitoring the health status of plants at night more effectively. This algorithm has a great potential in using remote sensing platform to monitor the health of vegetation and crops.

Broadacre Mapping of Wheat Biomass Using Ground-Based LiDAR Technology

Crop biomass is an important attribute to consider in relation to site-specific nitrogen (N) management as critical N levels in plants vary depending on crop biomass. Whilst LiDAR technology has been used extensively in small plot-based phenomics studies, large-scale crop scanning has not yet been reported for cereal crops. A LiDAR sensing system was implemented to map a commercial 64-ha wheat paddock to assess the spatial variability of crop biomass. A proximal active reflectance sensor providing spectral indices and estimates of crop height was used as a comparison for the LiDAR system. Plant samples were collected at targeted locations across the field for the assessment of relationships between sensed and measured crop parameters. The correlation between crop biomass and LiDAR-derived crop height was 0.79, which is similar to results reported for plot scanning studies and greatly superior to results obtained for the spectral sensor tested. The LiDAR mapping showed significant crop biomass variability across the field, with estimated values ranging between 460 and 1900 kg ha−1. The results are encouraging for the use of LiDAR technology for large-scale operations to support site-specific management. To promote such an approach, we encourage the development of an automated, on-the-go data processing capability and dedicated commercial LiDAR systems for field operation.

Harnessing translational research in wheat for climate resilience

Despite being the world's most widely grown crop, research investments in wheat (Triticum aestivum and Triticum durum) fall behind those in other staple crops. Current yield gains will not meet 2050 needs, and climate stresses compound this challenge. However, there is good evidence that heat and drought resilience can be boosted through translating promising ideas into novel breeding technologies using powerful new tools in genetics and remote sensing, for example. Such technologies can also be applied to identify climate resilience traits from among the vast and largely untapped reserve of wheat genetic resources in collections worldwide. This review describes multi-pronged research opportunities at the focus of the Heat and Drought Wheat Improvement Consortium (coordinated by CIMMYT), which together create a pipeline to boost heat and drought resilience, specifically: improving crop design targets using big data approaches; developing phenomic tools for field-based screening and research; applying genomic technologies to elucidate the bases of climate resilience traits; and applying these outputs in developing next-generation breeding methods. The global impact of these outputs will be validated through the International Wheat Improvement Network, a global germplasm development and testing system that contributes key productivity traits to approximately half of the global wheat-growing area.

High night temperature effects on wheat and rice: Current status and way forward

Rapid increases in minimum night temperature than in maximum day temperature is predicted to continue, posing significant challenges to crop productivity. Rice and wheat are two major staples that are sensitive to high night-temperature (HNT) stress. This review aims to (i) systematically compare the grain yield responses of rice and wheat exposed to HNT stress across scales, and (ii) understand the physiological and biochemical responses that affect grain yield and quality. To achieve this, we combined a synthesis of current literature on HNT effects on rice and wheat with information from a series of independent experiments we conducted across scales, using a common set of genetic materials to avoid confounding our findings with differences in genetic background. In addition, we explored HNT-induced alterations in physiological mechanisms including carbon balance, source-sink metabolite changes and reactive oxygen species. Impacts of HNT on grain developmental dynamics focused on grain-filling duration, post-flowering senescence, changes in grain starch and protein composition, starch metabolism enzymes and chalk formation in rice grains are summarized. Finally, we highlight the need for high-throughput field-based phenotyping facilities for improved assessment of large-diversity panels and mapping populations to aid breeding for increased resilience to HNT in crops.

Ensuring Agricultural Sustainability through Remote Sensing in the Era of Agriculture 5.0

Timely and reliable information about crop management, production, and yield is considered of great utility by stakeholders (e.g., national and international authorities, farmers, commercial units, etc.) to ensure food safety and security. By 2050, according to Food and Agriculture Organization (FAO) estimates, around 70% more production of agricultural products will be needed to fulfil the demands of the world population. Likewise, to meet the Sustainable Development Goals (SDGs), especially the second goal of “zero hunger”, potential technologies like remote sensing (RS) need to be efficiently integrated into agriculture. The application of RS is indispensable today for a highly productive and sustainable agriculture. Therefore, the present study draws a general overview of RS technology with a special focus on the principal platforms of this technology, i.e., satellites and remotely piloted aircrafts (RPAs), and the sensors used, in relation to the 5th industrial revolution. Nevertheless, since 1957, RS technology has found applications, through the use of satellite imagery, in agriculture, which was later enriched by the incorporation of remotely piloted aircrafts (RPAs), which is further pushing the boundaries of proficiency through the upgrading of sensors capable of higher spectral, spatial, and temporal resolutions. More prominently, wireless sensor technologies (WST) have streamlined real time information acquisition and programming for respective measures. Improved algorithms and sensors can, not only add significant value to crop data acquisition, but can also devise simulations on yield, harvesting and irrigation periods, metrological data, etc., by making use of cloud computing. The RS technology generates huge sets of data that necessitate the incorporation of artificial intelligence (AI) and big data to extract useful products, thereby augmenting the adeptness and efficiency of agriculture to ensure its sustainability. These technologies have made the orientation of current research towards the estimation of plant physiological traits rather than the structural parameters possible. Futuristic approaches for benefiting from these cutting-edge technologies are discussed in this study. This study can be helpful for researchers, academics, and young students aspiring to play a role in the achievement of sustainable agriculture.

Scaling up high-throughput phenotyping for abiotic stress selection in the field

High-throughput phenotyping (HTP) is in its infancy for deployment in large-scale breeding programmes. With the ability to measure correlated traits associated with physiological ideotypes, in-field phenotyping methods are available for screening of abiotic stress responses. As cropping environments become more hostile and unpredictable due to the effects of climate change, the need to characterise variability across spatial and temporal scales will become increasingly important. The sensor technologies that have enabled HTP from macroscopic through to satellite sensors may also be utilised here to complement spatial characterisation using envirotyping, which can improve estimations of genotypic performance across environments by better accounting for variation at the plot, trial and inter-trial levels. Climate change is leading to increased variation at all physical and temporal scales in the cropping environment. Maintaining yield stability under circumstances with greater levels of abiotic stress while capitalising upon yield potential in good years, requires approaches to plant breeding that target the physiological limitations to crop performance in specific environments. This requires dynamic modelling of conditions within target populations of environments, GxExM predictions, clustering of environments so breeding trajectories can be defined, and the development of screens that enable selection for genetic gain to occur. High-throughput phenotyping (HTP), combined with related technologies used for envirotyping, can help to address these challenges. Non-destructive analysis of the morphological, biochemical and physiological qualities of plant canopies using HTP has great potential to complement whole-genome selection, which is becoming increasingly common in breeding programmes. A range of novel analytic techniques, such as machine learning and deep learning, combined with a widening range of sensors, allow rapid assessment of large breeding populations that are repeatable and objective. Secondary traits underlying radiation use efficiency and water use efficiency can be screened with HTP for selection at the early stages of a breeding programme. HTP and envirotyping technologies can also characterise spatial variability at trial and within-plot levels, which can be used to correct for spatial variations that confound measurements of genotypic values. This review explores HTP for abiotic stress selection through a physiological trait lens and additionally investigates the use of envirotyping and EC to characterise spatial variability at all physical scales in METs.

Impact of Varying Light and Dew on Ground Cover Estimates from Active NDVI, RGB, and LiDAR

Canopy ground cover (GC) is an important agronomic measure for evaluating crop establishment and early growth. This study evaluates the reliability of GC estimates, in the presence of varying light and dew on leaves, from three different ground-based sensors: (1) normalized difference vegetation index (NDVI) from the commercially available GreenSeeker®; (2) RGB images from a digital camera, where GC was determined as the portion of pixels from each image meeting a greenness criterion (i.e., (Green - Red)/(Green + Red) > 0); and (3) LiDAR using two separate approaches: (a) GC from LiDAR red reflectance (whereby red reflectance less than five was classified as vegetation) and (b) GC from LiDAR height (whereby height greater than 10 cm was classified as vegetation). Hourly measurements were made early in the season at two different growth stages (tillering and stem elongation), among wheat genotypes highly diverse for canopy characteristics. The active NDVI showed the least variation through time and was particularly stable, regardless of the available light or the presence of dew. In addition, between-sample-time Pearson correlations for NDVI were consistently high and significant (P < 0.0001), ranging from 0.89 to 0.98. In comparison, GC from LiDAR and RGB showed greater variation across sampling times, and LiDAR red reflectance was strongly influenced by the presence of dew. Excluding times when the light was exceedingly low, correlations between GC from RGB and NDVI were consistently high (ranging from 0.79 to 0.92). The high reliability of the active NDVI sensor potentially affords a high degree of flexibility for users by enabling sampling across a broad range of acceptable light conditions.

Recent developments and potential of robotics in plant eco-phenotyping

Automated acquisition of plant eco-phenotypic information can serve as a decision-making basis for precision agricultural management and can also provide detailed insights into plant growth status, pest management, water and fertilizer management for plant breeders and plant physiologists. Because the microscopic components and macroscopic morphology of plants will be affected by the ecological environment, research on plant eco-phenotyping is more meaningful than the study of single-plant phenotyping. To achieve high-throughput acquisition of phenotyping information, the combination of high-precision sensors and intelligent robotic platforms have become an emerging research focus. Robotic platforms and automated systems are the important carriers of phenotyping monitoring sensors that enable large-scale screening. Through the diverse design and flexible systems, an efficient operation can be achieved across a range of experimental and field platforms. The combination of robot technology and plant phenotyping monitoring tools provides the data to inform novel artificial intelligence (AI) approaches that will provide steppingstones for new research breakthroughs. Therefore, this article introduces robotics and eco-phenotyping and examines research significant to this novel domain of plant eco-phenotyping. Given the monitoring scenarios of phenotyping information at different scales, the used intelligent robot technology, efficient automation platform, and advanced sensor equipment are summarized in detail. We further discuss the challenges posed to current research as well as the future developmental trends in the application of robot technology and plant eco-phenotyping. These include the use of collected data for AI applications and high-bandwidth data transfer, and large well-structured (meta) data storage approaches in plant sciences and agriculture.

Improving crop yield and resilience through optimization of photosynthesis: panacea or pipe dream?

Increasing the speed of breeding to enhance crop productivity and adaptation to abiotic stresses is urgently needed. The perception that a second Green Revolution should be implemented is widely established within the scientific community and among stakeholders. In recent decades, different alternatives have been proposed for increasing crop yield through manipulation of leaf photosynthetic efficiency. However, none of these has delivered practical or relevant outputs. Indeed, the actual increases in photosynthetic rates are not expected to translate into yield increases beyond 10-15%. Furthermore, instantaneous rates of leaf photosynthesis are not necessarily the reference target for research. Yield is the result of canopy photosynthesis, understood as the contribution of laminar and non-laminar organs over time, within which concepts such as canopy architecture, stay-green, or non-laminar photosynthesis need to be taken into account. Moreover, retrospective studies show that photosynthetic improvements have been more common at the canopy level. Nevertheless, it is crucial to place canopy photosynthesis in the context of whole-plant functioning, which includes sink-source balance and transport of photoassimilates, and the availability and uptake of nutrients, such as nitrogen in particular. Overcoming this challenge will only be feasible if a multiscale crop focus combined with a multidisciplinary scientific approach is adopted.

Registration and Fusion of Close-Range Multimodal Wheat Images in Field Conditions

Multimodal images fusion has the potential to enrich the information gathered by multi-sensor plant phenotyping platforms. Fusion of images from multiple sources is, however, hampered by the technical lock of image registration. The aim of this paper is to provide a solution to the registration and fusion of multimodal wheat images in field conditions and at close range. Eight registration methods were tested on nadir wheat images acquired by a pair of red, green and blue (RGB) cameras, a thermal camera and a multispectral camera array. The most accurate method, relying on a local transformation, aligned the images with an average error of 2 mm but was not reliable for thermal images. More generally, the suggested registration method and the preprocesses necessary before fusion (plant mask erosion, pixel intensity averaging) would depend on the application. As a consequence, the main output of this study was to identify four registration-fusion strategies: (i) the REAL-TIME strategy solely based on the cameras’ positions, (ii) the FAST strategy suitable for all types of images tested, (iii) and (iv) the ACCURATE and HIGHLY ACCURATE strategies handling local distortion but unable to deal with images of very different natures. These suggestions are, however, limited to the methods compared in this study. Further research should investigate how recent cutting-edge registration methods would perform on the specific case of wheat canopy.

Using Unmanned Aerial Vehicle and Ground-Based RGB Indices to Assess Agronomic Performance of Wheat Landraces and Cultivars in a Mediterranean-Type Environment

The adaptability and stability of new bread wheat cultivars that can be successfully grown in rainfed conditions are of paramount importance. Plant improvement can be boosted using effective high-throughput phenotyping tools in dry areas of the Mediterranean basin, where drought and heat stress are expected to increase yield instability. Remote sensing has been of growing interest in breeding programs since it is a cost-effective technology useful for assessing the canopy structure as well as the physiological traits of large genotype collections. The purpose of this study was to evaluate the use of a 4-band multispectral camera on-board an unmanned aerial vehicle (UAV) and ground-based RGB imagery to predict agronomic traits as well as quantify the best estimation of leaf area index (LAI) in rainfed conditions. A collection of 365 bread wheat genotypes, including 181 Mediterranean landraces and 184 modern cultivars, was evaluated during two consecutive growing seasons. Several vegetation indices (VI) derived from multispectral UAV and ground-based RGB images were calculated at different image acquisition dates of the crop cycle. The modified triangular vegetation index (MTVI2) proved to have a good accuracy to estimate LAI (R2 = 0.61). Although the stepwise multiple regression analysis showed that grain yield and number of grains per square meter (NGm2) were the agronomic traits most suitable to be predicted, the R2 were low due to field trials were conducted under rainfed conditions. Moreover, the prediction of agronomic traits was slightly better with ground-based RGB VI rather than with UAV multispectral VIs. NDVI and GNDVI, from multispectral images, were present in most of the prediction equations. Repeated measurements confirmed that the ability of VIs to predict yield depends on the range of phenotypic data. The current study highlights the potential use of VI and RGB images as an efficient tool for high-throughput phenotyping under rainfed Mediterranean conditions.

Remote Sensing Energy Balance Model for the Assessment of Crop Evapotranspiration and Water Status in an Almond Rootstock Collection

One of the objectives of many studies conducted by breeding programs is to characterize and select rootstocks well-adapted to drought conditions. In recent years, field high-throughput phenotyping methods have been developed to characterize plant traits and to identify the most water use efficient varieties and rootstocks. However, none of these studies have been able to quantify the behavior of crop evapotranspiration in almond rootstocks under different water regimes. In this study, remote sensing phenotyping methods were used to assess the evapotranspiration of almond cv. "Marinada" grafted onto a rootstock collection. In particular, the two-source energy balance and Shuttleworth and Wallace models were used to, respectively, estimate the actual and potential evapotranspiration of almonds grafted onto 10 rootstock under three different irrigation treatments. For this purpose, three flights were conducted during the 2018 and 2019 growing seasons with an aircraft equipped with a thermal and multispectral camera. Stem water potential (Ψ _{s t e m} ) was also measured concomitant to image acquisition. Biophysical traits of the vegetation were firstly assessed through photogrammetry techniques, spectral vegetation indices and the radiative transfer model PROSAIL. The estimates of canopy height, leaf area index and daily fraction of intercepted radiation had root mean square errors of 0.57 m, 0.24 m m^-1 and 0.07%, respectively. Findings of this study showed significant differences between rootstocks in all of the evaluated parameters. Cadaman^® and Garnem^® had the highest canopy vigor traits, evapotranspiration, Ψ _{s t e m} and kernel yield. In contrast, Rootpac^® 20 and Rootpac^® R had the lowest values of the same parameters, suggesting that this was due to an incompatibility between plum-almond species or to a lower water absorption capability of the rooting system. Among the rootstocks with medium canopy vigor, Adesoto and IRTA 1 had a lower evapotranspiration than Rootpac^® 40 and Ishtara^®. Water productivity (WP) (kg kernel/mm water evapotranspired) tended to decrease with Ψ _{s t e m} , mainly in 2018. Cadaman^® and Garnem^® had the highest WP, followed by INRA GF-677, IRTA 1, IRTA 2, and Rootpac^® 40. Despite the low Ψ _{s t e m} of Rootpac^® R, the WP of this rootstock was also high.

Compact, UAV-mounted hyperspectral imaging system with automatic geometric distortion rectification

A highly compact hyperspectral imager with an automatic geometric rectification function is developed in this study, which can be mounted on a UAV for ultra-wide range hyperspectral imaging. For better application, the system can provide visible light image transmission and hyperspectral imaging in the real-time mode. A specific design is proposed to allow the visible light camera and hyperspectral camera to share the same telescope optical path, making the system have a high integration level with a total mass of 1.9 kilograms. Thanks to the sharing-optical-path design, the field of view (FOV), frame rate, and spatial resolution are modified the same between the visible light camera and hyperspectral camera. As a result, the geometric rectification is easily performed, and repeated rectifications are eliminated to improve the imaging efficiency. A FOV of 40 degrees in the frame direction and 26 degrees in the flight direction are realized with a focal length of 13mm, providing a large spectral range from 400 nm to 1000 nm and an excellent spectral resolution of 2.5 nm. An automatic geometric rectification workflow is presented and verified in experiments, which can improve the geometric rectification of hyperspectral images in the presence of low-quality UAV navigation data through the incorporation of frame images. Experimental results show that the relative accuracy of geometric rectification is less than 2 pixels when applying the algorithm to our system dataset.

Emerging approaches to measure photosynthesis from the leaf to the ecosystem

Measuring photosynthesis is critical for quantifying and modeling leaf to regional scale productivity of managed and natural ecosystems. This review explores existing and novel advances in photosynthesis measurements that are certain to provide innovative directions in plant science research. First, we address gas exchange approaches from leaf to ecosystem scales. Leaf level gas exchange is a mature method but recent improvements to the user interface and environmental controls of commercial systems have resulted in faster and higher quality data collection. Canopy chamber and micrometeorological methods have also become more standardized tools and have an advanced understanding of ecosystem functioning under a changing environment and through long time series data coupled with community data sharing. Second, we review proximal and remote sensing approaches to measure photosynthesis, including hyperspectral reflectance- and fluorescence-based techniques. These techniques have long been used with aircraft and orbiting satellites, but lower-cost sensors and improved statistical analyses are allowing these techniques to become applicable at smaller scales to quantify changes in the underlying biochemistry of photosynthesis. Within the past decade measurements of chlorophyll fluorescence from earth-orbiting satellites have measured Solar Induced Fluorescence (SIF) enabling estimates of global ecosystem productivity. Finally, we highlight that stronger interactions of scientists across disciplines will benefit our capacity to accurately estimate productivity at regional and global scales. Applying the multiple techniques outlined in this review at scales from the leaf to the globe are likely to advance understanding of plant functioning from the organelle to the ecosystem.

Development of a Miniaturized Mobile Mapping System for In-Row, Under-Canopy Phenotyping

This paper focuses on the development of a miniaturized mobile mapping platform with advantages over current agricultural phenotyping systems in terms of acquiring data that facilitate under-canopy plant trait extraction. The system is based on an unmanned ground vehicle (UGV) for in-row, under-canopy data acquisition to deliver accurately georeferenced 2D and 3D products. The paper addresses three main aspects pertaining to the UGV development: (a) architecture of the UGV mobile mapping system (MMS), (b) quality assessment of acquired data in terms of georeferencing information as well as derived 3D point cloud, and (c) ability to derive phenotypic plant traits using data acquired by the UGV MMS. The experimental results from this study demonstrate the ability of the UGV MMS to acquire dense and accurate data over agricultural fields that would facilitate highly accurate plant phenotyping (better than above-canopy platforms such as unmanned aerial systems and high-clearance tractors). Plant centers and plant count with an accuracy in the 90% range have been achieved.

High-Throughput Plant Phenotyping Platform (HT3P) as a Novel Tool for Estimating Agronomic Traits From the Lab to the Field

Food scarcity, population growth, and global climate change have propelled crop yield growth driven by high-throughput phenotyping into the era of big data. However, access to large-scale phenotypic data has now become a critical barrier that phenomics urgently must overcome. Fortunately, the high-throughput plant phenotyping platform (HT3P), employing advanced sensors and data collection systems, can take full advantage of non-destructive and high-throughput methods to monitor, quantify, and evaluate specific phenotypes for large-scale agricultural experiments, and it can effectively perform phenotypic tasks that traditional phenotyping could not do. In this way, HT3Ps are novel and powerful tools, for which various commercial, customized, and even self-developed ones have been recently introduced in rising numbers. Here, we review these HT3Ps in nearly 7 years from greenhouses and growth chambers to the field, and from ground-based proximal phenotyping to aerial large-scale remote sensing. Platform configurations, novelties, operating modes, current developments, as well the strengths and weaknesses of diverse types of HT3Ps are thoroughly and clearly described. Then, miscellaneous combinations of HT3Ps for comparative validation and comprehensive analysis are systematically present, for the first time. Finally, we consider current phenotypic challenges and provide fresh perspectives on future development trends of HT3Ps. This review aims to provide ideas, thoughts, and insights for the optimal selection, exploitation, and utilization of HT3Ps, and thereby pave the way to break through current phenotyping bottlenecks in botany.

Field Phenomics: Will It Enable Crop Improvement?

Field phenomics has been identified as a promising enabling technology to assist plant breeders with the development of improved cultivars for farmers. Yet, despite much investment, there are few examples demonstrating the application of phenomics within a plant breeding program. We review recent progress in field phenomics and highlight the importance of targeting breeders' needs, rather than perceived technology needs, through developing and enhancing partnerships between phenomics researchers and plant breeders.

Performance of the Two-Source Energy Balance (TSEB) Model as a Tool for Monitoring the Response of Durum Wheat to Drought by High-Throughput Field Phenotyping

The current lack of efficient methods for high throughput field phenotyping is a constraint on the goal of increasing durum wheat yields. This study illustrates a comprehensive methodology for phenotyping this crop's water use through the use of the two-source energy balance (TSEB) model employing very high resolution imagery. An unmanned aerial vehicle (UAV) equipped with multispectral and thermal cameras was used to phenotype 19 durum wheat cultivars grown under three contrasting irrigation treatments matching crop evapotranspiration levels (ETc): 100%ETc treatment meeting all crop water requirements (450 mm), 50%ETc treatment meeting half of them (285 mm), and a rainfed treatment (122 mm). Yield reductions of 18.3 and 48.0% were recorded in the 50%ETc and rainfed treatments, respectively, in comparison with the 100%ETc treatment. UAV flights were carried out during jointing (April 4th), anthesis (April 30th), and grain-filling (May 22nd). Remotely-sensed data were used to estimate: (1) plant height from a digital surface model (H, R ² = 0.95, RMSE = 0.18m), (2) leaf area index from multispectral vegetation indices (LAI, R ² = 0.78, RMSE = 0.63), and (3) actual evapotranspiration (ETa) and transpiration (T) through the TSEB model (R ² = 0.50, RMSE = 0.24 mm/h). Compared with ground measurements, the four traits estimated at grain-filling provided a good prediction of days from sowing to heading (DH, r = 0.58-0.86), to anthesis (DA, r = 0.59-0.85) and to maturity (r = 0.67-0.95), grain-filling duration (GFD, r = 0.54-0.74), plant height (r = 0.62-0.69), number of grains per spike (NGS, r = 0.41-0.64), and thousand kernel weight (TKW, r = 0.37-0.42). The best trait to estimate yield, DH, DA, and GFD was ETa at anthesis or during grain filling. Better forecasts for yield-related traits were recorded in the irrigated treatments than in the rainfed one. These results show a promising perspective in the use of energy balance models for the phenotyping of large numbers of durum wheat genotypes under Mediterranean conditions.

Estimates of Maize Plant Density from UAV RGB Images Using Faster-RCNN Detection Model: Impact of the Spatial Resolution

Early-stage plant density is an essential trait that determines the fate of a genotype under given environmental conditions and management practices. The use of RGB images taken from UAVs may replace the traditional visual counting in fields with improved throughput, accuracy, and access to plant localization. However, high-resolution images are required to detect the small plants present at the early stages. This study explores the impact of image ground sampling distance (GSD) on the performances of maize plant detection at three-to-five leaves stage using Faster-RCNN object detection algorithm. Data collected at high resolution (GSD ≈ 0.3 cm) over six contrasted sites were used for model training. Two additional sites with images acquired both at high and low (GSD ≈ 0.6 cm) resolutions were used to evaluate the model performances. Results show that Faster-RCNN achieved very good plant detection and counting (rRMSE = 0.08) performances when native high-resolution images are used both for training and validation. Similarly, good performances were observed (rRMSE = 0.11) when the model is trained over synthetic low-resolution images obtained by downsampling the native training high-resolution images and applied to the synthetic low-resolution validation images. Conversely, poor performances are obtained when the model is trained on a given spatial resolution and applied to another spatial resolution. Training on a mix of high- and low-resolution images allows to get very good performances on the native high-resolution (rRMSE = 0.06) and synthetic low-resolution (rRMSE = 0.10) images. However, very low performances are still observed over the native low-resolution images (rRMSE = 0.48), mainly due to the poor quality of the native low-resolution images. Finally, an advanced super resolution method based on GAN (generative adversarial network) that introduces additional textural information derived from the native high-resolution images was applied to the native low-resolution validation images. Results show some significant improvement (rRMSE = 0.22) compared to bicubic upsampling approach, while still far below the performances achieved over the native high-resolution images.

A light-induced decrease in the photochemical reflectance index (PRI) can be used to estimate the energy-dependent component of non-photochemical quenching under heat stress and soil drought in pea, wheat, and pumpkin

The remote sensing of a plant's physiological state is a key problem of precision agriculture. The photochemical reflectance index (PRI), which is based on the intensities of the reflected light at 531 and 570 nm, is an important tool for the remote sensing of photosynthetic processes in plants. In particular, the PRI can be strongly connected with the non-photochemical quenching of chlorophyll fluorescence (NPQ) and the quantum yield of photosystem II (ФPSII); however, this connection is dependent on illumination, the intensity of stressor actions, the time scale of measurements, etc. The aim of the present work was to analyze the connection of PRI with the energy-dependent component of NPQ (NPQF) and ФPSII under heating and soil drought conditions. Pea, wheat, and pumpkin seedlings, which were grown under controlled conditions, were investigated. A PAM fluorometer Dual-PAM-100 and spectrometer S-100 were used for measurements of photosynthetic parameters and PRI, respectively. It was shown that heat stress increased the NPQF and the magnitude of light-induced changes in PRI (ΔPRI) and decreased ФPSII in pea seedlings. The decreased ФPSII and increased ΔPRI were observed in wheat after heating, but significant changes in NPQF were absent; the significant decrease in ФPSII was observed in pumpkin seedlings, while there were no significant changes in the other parameters. ΔPRI and NPQF after heating were significantly correlated. However, a significant correlation of the absolute values of PRI with photosynthetic parameters was absent. The soil drought increased NPQF and the magnitude of ΔPRI and decreased ФPSII in peas. ΔPRI was strongly correlated with photosynthetic parameters, but this correlation was absent for the absolute value of PRI. Thus, ΔPRI is strongly connected with the magnitude of NPQF and can be used as an estimator of this parameter.