Closing the Phenotyping Gap: High Resolution UAV Time Series for Soybean Growth Analysis Provides Objective Data from Field Trials

Time-Series Field Phenotyping of Soybean Growth Analysis by Combining Multimodal Deep Learning and Dynamic Modeling

The rate of soybean canopy establishment largely determines photoperiodic sensitivity, subsequently influencing yield potential. However, assessing the rate of soybean canopy development in large-scale field breeding trials is both laborious and time-consuming. High-throughput phenotyping methods based on unmanned aerial vehicle (UAV) systems can be used to monitor and quantitatively describe the development of soybean canopies for different genotypes. In this study, high-resolution and time-series raw data from field soybean populations were collected using UAVs. The RGB (red, green, and blue) and infrared images are used as inputs to construct the multimodal image segmentation model-the RGB & Infrared Feature Fusion Segmentation Network (RIFSeg-Net). Subsequently, the segment anything model was employed to extract complete individual leaves from the segmentation results obtained from RIFSeg-Net. These leaf aspect ratios facilitated the accurate categorization of soybean populations into 2 distinct varieties: oval leaf type variety and lanceolate leaf type variety. Finally, dynamic modeling was conducted to identify 5 phenotypic traits associated with the canopy development rate that differed substantially among the classified soybean varieties. The results showed that the developed multimodal image segmentation model RIFSeg-Net for extracting soybean canopy cover from UAV images outperformed traditional deep learning image segmentation networks (precision = 0.94, recall = 0.93, F1-score = 0.93). The proposed method has high practical value in the field of germplasm resource identification. This approach could lead to the use of a practical tool for further genotypic differentiation analysis and the selection of target genes.

Yield prediction in a peanut breeding program using remote sensing data and machine learning algorithms

Peanut is a critical food crop worldwide, and the development of high-throughput phenotyping techniques is essential for enhancing the crop's genetic gain rate. Given the obvious challenges of directly estimating peanut yields through remote sensing, an approach that utilizes above-ground phenotypes to estimate underground yield is necessary. To that end, this study leveraged unmanned aerial vehicles (UAVs) for high-throughput phenotyping of surface traits in peanut. Using a diverse set of peanut germplasm planted in 2021 and 2022, UAV flight missions were repeatedly conducted to capture image data that were used to construct high-resolution multitemporal sigmoidal growth curves based on apparent characteristics, such as canopy cover and canopy height. Latent phenotypes extracted from these growth curves and their first derivatives informed the development of advanced machine learning models, specifically random forest and eXtreme Gradient Boosting (XGBoost), to estimate yield in the peanut plots. The random forest model exhibited exceptional predictive accuracy (R2 = 0.93), while XGBoost was also reasonably effective (R2 = 0.88). When using confusion matrices to evaluate the classification abilities of each model, the two models proved valuable in a breeding pipeline, particularly for filtering out underperforming genotypes. In addition, the random forest model excelled in identifying top-performing material while minimizing Type I and Type II errors. Overall, these findings underscore the potential of machine learning models, especially random forests and XGBoost, in predicting peanut yield and improving the efficiency of peanut breeding programs.

Phenotypic characterization of drought responses in red clover (Trifolium pratense L.)

Introduction

Red clover (Trifolium pratense) is a protein-rich, short-lived perennial forage crop that can achieve high yields, but suffers increasingly from drought in different cultivation areas. Breeding for increased adaptation to drought is becoming essential, but at this stage it is unclear which traits breeders should target to phenotype responses to drought that allow them to identify the most promising red clover genotypes. In this study, we assessed how prolonged periods of drought affected plant growth in field conditions, and which traits could be used to distinguish better adapted plant material.

Methods

A diverse panel of 395 red clover accessions was evaluated during two growing seasons. We simulated 6-to-8-week drought periods during two consecutive summers, using mobile rain-out shelters, while an irrigated control field was established in an adjacent parcel. Plant growth was monitored throughout both growing seasons using multiple flights with a drone equipped with RGB and thermal sensors. At various observation moments throughout both growing seasons, we measured canopy cover (CC) and canopy height (CH). The crop water stress index (CWSI) was determined at two moments, during or shortly after the drought event.

Results

Manual and UAV-derived measurements for CH were well correlated, indicating that UAV-derived measurements can be reliably used in red clover. In both years, CC, CH and CWSI were affected by drought, with measurable growth reductions by the end of the drought periods, and during the recovery phase. We found that the end of the drought treatment and the recovery phase of approximately 20 days after drought were suitable periods to phenotype drought responses and to distinguish among genotypes.

Discussion

Multifactorial analysis of accession responses revealed interactions of the maturity type with drought responses, which suggests the presence of two independent strategies in red clover: 'drought tolerance' and 'drought recovery'. We further found that a large proportion of the accessions able to perform well under well-watered conditions were also the ones that were less affected by drought. The results of this investigation are interpreted in view of the development of breeding for adaptation to drought in red clover.

Phenomic selection in slash pine multi-temporally using UAV-multispectral imagery

Genomic selection (GS) is an option for plant domestication that offers high efficiency in improving genetics. However, GS is often not feasible for long-lived tree species with large and complex genomes. In this paper, we investigated UAV multispectral imagery in time series to evaluate genetic variation in tree growth and developed a new predictive approach that is independent of sequencing or pedigrees based on multispectral imagery plus vegetation indices (VIs) for slash pine. Results show that temporal factors have a strong influence on the h2 of tree growth traits. High genetic correlations were found in most months, and genetic gain also showed a slight influence on the time series. Using a consistent ranking of family breeding values, optimal slash pine families were selected, obtaining a promising and reliable predictive ability based on multispectral+VIs (MV) alone or on the combination of pedigree and MV. The highest predictive value, ranging from 0.52 to 0.56, was found in July. The methods described in this paper provide new approaches for phenotypic selection (PS) using high-throughput multispectral unmanned aerial vehicle (UAV) technology, which could potentially be used to reduce the generation time for conifer species and increase the genetic granularity independent of sequencing or pedigrees.

Genetic control of tolerance to drought stress in soybean

BACKGROUND

Drought stress limits the production of soybean [Glycine max (L.) Merr.], which is the most grown high-value legume crop worldwide. Breeding for drought tolerance is a difficult endeavor and understanding the genetic basis of drought tolerance in soybean is therefore crucial for harnessing the genomic regions involved in the tolerance mechanisms. A genome-wide association study (GWAS) analysis was applied in a soybean germplasm collection (the EUCLEG collection) of 359 accessions relevant for breeding in Europe, to identify genomic regions and candidate genes involved in the response to short duration and long duration drought stress (SDS and LDS respectively) in soybean.

RESULTS

The phenotypic response to drought was stronger in the long duration drought (LDS) than in the short duration drought (SDS) experiment. Over the four traits considered (canopy wilting, leaf senescence, maximum absolute growth rate and maximum plant height) the variation was in the range of 8.4-25.2% in the SDS, and 14.7-29.7% in the LDS experiments. The GWAS analysis identified a total of 17 and 22 significant marker-trait associations for four traits in the SDS and LDS experiments, respectively. In the genomic regions delimited by these markers we identified a total of 12 and 16 genes with putative functions that are of particular relevance for drought stress responses including stomatal movement, root formation, photosynthesis, ABA signaling, cellular protection and cellular repair mechanisms. Some of these genomic regions co-localized with previously known QTLs for drought tolerance traits including water use efficiency, chlorophyll content and photosynthesis.

CONCLUSION

Our results indicate that the mechanism of slow wilting in the SDS might be associated with the characteristics of the root system, whereas in the LDS, slow wilting could be due to low stomatal conductance and transpiration rates enabling a high WUE. Drought-induced leaf senescence was found to be associated to ABA and ROS responses. The QTLs related to WUE contributed to growth rate and canopy height maintenance under drought stress. Co-localization of several previously known QTLs for multiple agronomic traits with the SNPs identified in this study, highlights the importance of the identified genomic regions for the improvement of agronomic performance in addition to drought tolerance in the EUCLEG collection.

Prediction of heading date, culm length, and biomass from canopy-height-related parameters derived from time-series UAV observations of rice

Unmanned aerial vehicles (UAVs) are powerful tools for monitoring crops for high-throughput phenotyping. Time-series aerial photography of fields can record the whole process of crop growth. Canopy height (CH), which is vertical plant growth, has been used as an indicator for the evaluation of lodging tolerance and the prediction of biomass and yield. However, there have been few attempts to use UAV-derived time-series CH data for field testing of crop lines. Here we provide a novel framework for trait prediction using CH data in rice. We generated UAV-based digital surface models of crops to extract CH data of 30 Japanese rice cultivars in 2019, 2020, and 2021. CH-related parameters were calculated in a non-linear time-series model as an S-shaped plant growth curve. The maximum saturation CH value was the most important predictor for culm length. The time point at the maximum CH contributed to the prediction of days to heading, and was able to predict stem and leaf weight and aboveground weight, possibly reflecting the association of biomass with duration of vegetative growth. These results indicate that the CH-related parameters acquired by UAV can be useful as predictors of traits typically measured by hand.

The field phenotyping platform's next darling: Dicotyledons

The genetic information and functional properties of plants have been further identified with the completion of the whole-genome sequencing of numerous crop species and the rapid development of high-throughput phenotyping technologies, laying a suitable foundation for advanced precision agriculture and enhanced genetic gains. Collecting phenotypic data from dicotyledonous crops in the field has been identified as a key factor in the collection of large-scale phenotypic data of crops. On the one hand, dicotyledonous plants account for 4/5 of all angiosperm species and play a critical role in agriculture. However, their morphology is complex, and an abundance of dicot phenotypic information is available, which is critical for the analysis of high-throughput phenotypic data in the field. As a result, the focus of this paper is on the major advancements in ground-based, air-based, and space-based field phenotyping platforms over the last few decades and the research progress in the high-throughput phenotyping of dicotyledonous field crop plants in terms of morphological indicators, physiological and biochemical indicators, biotic/abiotic stress indicators, and yield indicators. Finally, the future development of dicots in the field is explored from the perspectives of identifying new unified phenotypic criteria, developing a high-performance infrastructure platform, creating a phenotypic big data knowledge map, and merging the data with those of multiomic techniques.

Genomic Prediction of Green Fraction Dynamics in Soybean Using Unmanned Aerial Vehicles Observations

With the widespread use of high-throughput phenotyping systems, growth process data are expected to become more easily available. By applying genomic prediction to growth data, it will be possible to predict the growth of untested genotypes. Predicting the growth process will be useful for crop breeding, as variability in the growth process has a significant impact on the management of plant cultivation. However, the integration of growth modeling and genomic prediction has yet to be studied in depth. In this study, we implemented new prediction models to propose a novel growth prediction scheme. Phenotype data of 198 soybean germplasm genotypes were acquired for 3 years in experimental fields in Tottori, Japan. The longitudinal changes in the green fractions were measured using UAV remote sensing. Then, a dynamic model was fitted to the green fraction to extract the dynamic characteristics of the green fraction as five parameters. Using the estimated growth parameters, we developed models for genomic prediction of the growth process and tested whether the inclusion of the dynamic model contributed to better prediction of growth. Our proposed models consist of two steps: first, predicting the parameters of the dynamics model with genomic prediction, and then substituting the predicted values for the parameters of the dynamics model. By evaluating the heritability of the growth parameters, the dynamic model was able to effectively extract genetic diversity in the growth characteristics of the green fraction. In addition, the proposed prediction model showed higher prediction accuracy than conventional genomic prediction models, especially when the future growth of the test population is a prediction target given the observed values in the first half of growth as training data. This indicates that our model was able to successfully combine information from the early growth period with phenotypic data from the training population for prediction. This prediction method could be applied to selection at an early growth stage in crop breeding, and could reduce the cost and time of field trials.

Estimation of plant height and yield based on UAV imagery in faba bean (Vicia faba L.)

BACKGROUND

Faba bean is an important legume crop in the world. Plant height and yield are important traits for crop improvement. The traditional plant height and yield measurement are labor intensive and time consuming. Therefore, it is essential to estimate these two parameters rapidly and efficiently. The purpose of this study was to provide an alternative way to accurately identify and evaluate faba bean germplasm and breeding materials.

RESULTS

The results showed that 80% of the maximum plant height extracted from two-dimensional red-green-blue (2D-RGB) images had the best fitting degree with the ground measured values, with the coefficient of determination (R²), root-mean-square error (RMSE), and normalized root-mean-square error (NRMSE) were 0.9915, 1.4411 cm and 5.02%, respectively. In terms of yield estimation, support vector machines (SVM) showed the best performance (R² = 0.7238, RMSE = 823.54 kg ha^-1, NRMSE = 18.38%), followed by random forests (RF) and decision trees (DT).

CONCLUSION

The results of this study indicated that it is feasible to monitor the plant height of faba bean during the whole growth period based on UAV imagery. Furthermore, the machine learning algorithms can estimate the yield of faba bean reasonably with the multiple time points data of plant height.

Phenotypic Traits Estimation and Preliminary Yield Assessment in Different Phenophases of Wheat Breeding Experiment Based on UAV Multispectral Images

The utility of unmanned aerial vehicles (UAV) imagery in retrieving phenotypic data to support plant breeding research has been a topic of increasing interest in recent years. The advantages of image-based phenotyping are related to the high spatial and temporal resolution of the retrieved data and the non-destructive and rapid method of data acquisition. This study trains parametric and nonparametric regression models to retrieve leaf area index (LAI), fraction of absorbed photosynthetically active radiation (fAPAR), fractional vegetation cover (fCover), leaf chlorophyll content (LCC), canopy chlorophyll content (CCC), and grain yield (GY) of winter durum wheat breeding experiment from four-bands UAV images. A ground dataset, collected during two field campaigns and complemented with data from a previous study, is used for model development. The dataset is split at random into two parts, one for training and one for testing the models. The tested parametric models use the vegetation index formula and parametric functions. The tested nonparametric models are partial least square regression (PLSR), random forest regression (RFR), support vector regression (SVR), kernel ridge regression (KRR), and Gaussian processes regression (GPR). The retrieved biophysical variables along with traditional phenotypic traits (plant height, yield, and tillering) are analysed for detection of genetic diversity, proximity, and similarity in the studied genotypes. Analysis of variance (ANOVA), Duncan’s multiple range test, correlation analysis, and principal component analysis (PCA) are performed with the phenotypic traits. The parametric and nonparametric models show close results for GY retrieval, with parametric models indicating slightly higher accuracy (R2 = 0.49; MRSE = 0.58 kg/plot; rRMSE = 6.1%). However, the nonparametric model, GPR, computes per pixel uncertainty estimation, making it more appealing for operational use. Furthermore, our results demonstrate that grain filling was better than flowering phenological stage to predict GY. The nonparametric models show better results for biophysical variables retrieval, with GPR presenting the highest prediction performance. Nonetheless, robust models are found only for LAI (R2 = 0.48; MRSE = 0.64; rRMSE = 13.5%) and LCC (R2 = 0.49; MRSE = 31.57 mg m−2; rRMSE = 6.4%) and therefore these are the only remotely sensed phenotypic traits included in the statistical analysis for preliminary assessment of wheat productivity. The results from ANOVA and PCA illustrate that the retrieved remotely sensed phenotypic traits are a valuable addition to the traditional phenotypic traits for plant breeding studies. We believe that these preliminary results could speed up crop improvement programs; however, stronger interdisciplinary research is still needed, as well as uncertainty estimation of the remotely sensed phenotypic traits.

Response of a Diverse European Soybean Collection to "Short Duration" and "Long Duration" Drought Stress

Drought causes significant damage to a high value crop of soybean. Europe has an increasing demand for soybean and its own production is insufficient. Selection and breeding of cultivars adapted to European growth conditions is therefore urgently needed. These new cultivars must have a shorter growing cycle (specifically for adaptation to North-West Europe), high yield potential under European growing conditions, and sufficient drought resistance. We have evaluated the performance of a diverse collection of 359 soybean accessions under drought stress using rain-out shelters for 2 years. The contrasting weather conditions between years and correspondingly the varying plant responses demonstrated that the consequences of drought for an individual accession can vary strongly depending on the characteristics (e.g., duration and intensity) of the drought period. Short duration drought stress, for a period of four to 7 weeks, caused an average reduction of 11% in maximum canopy height (CH), a reduction of 17% in seed number per plant (SN) and a reduction of 16% in seed weight per plant (SW). Long duration drought stress caused an average reduction of 29% in CH, a reduction of 38% in SN and a reduction of 43% in SW. Drought accelerated plant development and caused an earlier cessation of flowering and pod formation. This seemed to help some accessions to better protect the seed yield, under short duration drought stress. Drought resistance for yield-related traits was associated with the maintenance of growth under long duration drought stress. The collection displayed a broad range of variation for canopy wilting and leaf senescence but a very narrow range of variation for crop water stress index (CWSI; derived from canopy temperature data). To the best of our knowledge this is the first study reporting a detailed investigation of the response to drought within a diverse soybean collection relevant for breeding in Europe.

Advances in optical phenotyping of cereal crops

Optical sensors and sensing-based phenotyping techniques have become mainstream approaches in high-throughput phenotyping for improving trait selection and genetic gains in crops. We review recent progress and contemporary applications of optical sensing-based phenotyping (OSP) techniques in cereal crops and highlight optical sensing principles for spectral response and sensor specifications. Further, we group phenotypic traits determined by OSP into four categories - morphological, biochemical, physiological, and performance traits - and illustrate appropriate sensors for each extraction. In addition to the current status, we discuss the challenges of OSP and provide possible solutions. We propose that optical sensing-based traits need to be explored further, and that standardization of the language of phenotyping and worldwide collaboration between phenotyping researchers and other fields need to be established.

An Efficient Method for Estimating Wheat Heading Dates Using UAV Images

Convenient, efficient, and high-throughput estimation of wheat heading dates is of great significance in plant sciences and agricultural research. However, documenting heading dates is time-consuming, labor-intensive, and subjective on a large-scale field. To overcome these challenges, model- and image-based approaches are used to estimate heading dates. Phenology models usually require complicated parameters calibrations, making it difficult to model other varieties and different locations, while in situ field-image recognition usually requires the deployment of a large amount of observational equipment, which is expensive. Therefore, in this study, we proposed a growth curve-based method for estimating wheat heading dates. The method first generates a height-based continuous growth curve based on five time-series unmanned aerial vehicle (UAV) images captured over the entire wheat growth cycle (>200 d). Then estimate the heading date by generated growth curve. As a result, the proposed method had a mean absolute error of 2.81 d and a root mean square error of 3.49 d for 72 wheat plots composed of different varieties and densities sown on different dates. Thus, the proposed method is straightforward, efficient, and affordable and meets the high-throughput estimation requirements of large-scale fields and underdeveloped areas.

UAVs for Vegetation Monitoring: Overview and Recent Scientific Contributions

This paper reviewed a set of twenty-one original and innovative papers included in a special issue on UAVs for vegetation monitoring, which proposed new methods and techniques applied to diverse agricultural and forestry scenarios. Three general categories were considered: (1) sensors and vegetation indices used, (2) technological goals pursued, and (3) agroforestry applications. Some investigations focused on issues related to UAV flight operations, spatial resolution requirements, and computation and data analytics, while others studied the ability of UAVs for characterizing relevant vegetation features (mainly canopy cover and crop height) or for detecting different plant/crop stressors, such as nutrient content/deficiencies, water needs, weeds, and diseases. The general goal was proposing UAV-based technological solutions for a better use of agricultural and forestry resources and more efficient production with relevant economic and environmental benefits.

A Genome-Wide Genetic Diversity Scan Reveals Multiple Signatures of Selection in a European Soybean Collection Compared to Chinese Collections of Wild and Cultivated Soybean Accessions

Targeted and untargeted selections including domestication and breeding efforts can reduce genetic diversity in breeding germplasm and create selective sweeps in crop genomes. The genomic regions at which selective sweeps are detected can reveal important information about signatures of selection. We have analyzed the genetic diversity within a soybean germplasm collection relevant for breeding in Europe (the EUCLEG collection), and have identified selective sweeps through a genome-wide scan comparing that collection to Chinese soybean collections. This work involved genotyping of 480 EUCLEG soybean accessions, including 210 improved varieties, 216 breeding lines and 54 landraces using the 355K SoySNP microarray. SNP calling of 477 EUCLEG accessions together with 328 Chinese soybean accessions identified 224,993 high-quality SNP markers. Population structure analysis revealed a clear differentiation between the EUCLEG collection and the Chinese materials. Further, the EUCLEG collection was sub-structured into five subgroups that were differentiated by geographical origin. No clear association between subgroups and maturity group was detected. The genetic diversity was lower in the EUCLEG collection compared to the Chinese collections. Selective sweep analysis revealed 23 selective sweep regions distributed over 12 chromosomes. Co-localization of these selective sweep regions with previously reported QTLs and genes revealed that various signatures of selection in the EUCLEG collection may be related to domestication and improvement traits including seed protein and oil content, phenology, nitrogen fixation, yield components, diseases resistance and quality. No signatures of selection related to stem determinacy were detected. In addition, absence of signatures of selection for a substantial number of QTLs related to yield, protein content, oil content and phenological traits suggests the presence of substantial genetic diversity in the EUCLEG collection. Taken together, the results obtained demonstrate that the available genetic diversity in the EUCLEG collection can be further exploited for research and breeding purposes. However, incorporation of exotic material can be considered to broaden its genetic base.

Crop Yield Prediction Using Multitemporal UAV Data and Spatio-Temporal Deep Learning Models

Unmanned aerial vehicle (UAV) based remote sensing is gaining momentum worldwide in a variety of agricultural and environmental monitoring and modelling applications. At the same time, the increasing availability of yield monitoring devices in harvesters enables input-target mapping of in-season RGB and crop yield data in a resolution otherwise unattainable by openly availabe satellite sensor systems. Using time series UAV RGB and weather data collected from nine crop fields in Pori, Finland, we evaluated the feasibility of spatio-temporal deep learning architectures in crop yield time series modelling and prediction with RGB time series data. Using Convolutional Neural Networks (CNN) and Long-Short Term Memory (LSTM) networks as spatial and temporal base architectures, we developed and trained CNN-LSTM, convolutional LSTM and 3D-CNN architectures with full 15 week image frame sequences from the whole growing season of 2018. The best performing architecture, the 3D-CNN, was then evaluated with several shorter frame sequence configurations from the beginning of the season. With 3D-CNN, we were able to achieve 218.9 kg/ha mean absolute error (MAE) and 5.51% mean absolute percentage error (MAPE) performance with full length sequences. The best shorter length sequence performance with the same model was 292.8 kg/ha MAE and 7.17% MAPE with four weekly frames from the beginning of the season.

High-Throughput Phenotyping of Soybean Maturity Using Time Series UAV Imagery and Convolutional Neural Networks

Soybean maturity is a trait of critical importance for the development of new soybean cultivars, nevertheless, its characterization based on visual ratings has many challenges. Unmanned aerial vehicles (UAVs) imagery-based high-throughput phenotyping methodologies have been proposed as an alternative to the traditional visual ratings of pod senescence. However, the lack of scalable and accurate methods to extract the desired information from the images remains a significant bottleneck in breeding programs. The objective of this study was to develop an image-based high-throughput phenotyping system for evaluating soybean maturity in breeding programs. Images were acquired twice a week, starting when the earlier lines began maturation until the latest ones were mature. Two complementary convolutional neural networks (CNN) were developed to predict the maturity date. The first using a single date and the second using the five best image dates identified by the first model. The proposed CNN architecture was validated using more than 15,000 ground truth observations from five trials, including data from three growing seasons and two countries. The trained model showed good generalization capability with a root mean squared error lower than two days in four out of five trials. Four methods of estimating prediction uncertainty showed potential at identifying different sources of errors in the maturity date predictions. The architecture developed solves limitations of previous research and can be used at scale in commercial breeding programs.

Multi-Temporal Predictive Modelling of Sorghum Biomass Using UAV-Based Hyperspectral and LiDAR Data

High-throughput phenotyping using high spatial, spectral, and temporal resolution remote sensing (RS) data has become a critical part of the plant breeding chain focused on reducing the time and cost of the selection process for the “best” genotypes with respect to the trait(s) of interest. In this paper, the potential of accurate and reliable sorghum biomass prediction using visible and near infrared (VNIR) and short-wave infrared (SWIR) hyperspectral data as well as light detection and ranging (LiDAR) data acquired by sensors mounted on UAV platforms is investigated. Predictive models are developed using classical regression-based machine learning methods for nine experiments conducted during the 2017 and 2018 growing seasons at the Agronomy Center for Research and Education (ACRE) at Purdue University, Indiana, USA. The impact of the regression method, data source, timing of RS and field-based biomass reference data acquisition, and the number of samples on the prediction results are investigated. R2 values for end-of-season biomass ranged from 0.64 to 0.89 for different experiments when features from all the data sources were included. Geometry-based features derived from the LiDAR point cloud to characterize plant structure and chemistry-based features extracted from hyperspectral data provided the most accurate predictions. Evaluation of the impact of the time of data acquisition during the growing season on the prediction results indicated that although the most accurate and reliable predictions of final biomass were achieved using remotely sensed data from mid-season to end-of-season, predictions in mid-season provided adequate results to differentiate between promising varieties for selection. The analysis of variance (ANOVA) of the accuracies of the predictive models showed that both the data source and regression method are important factors for a reliable prediction; however, the data source was more important with 69% significance, versus 28% significance for the regression method.

Automated 3D Reconstruction Using Optimized View-Planning Algorithms for Iterative Development of Structure-from-Motion Models

Unsupervised machine learning algorithms (clustering, genetic, and principal component analysis) automate Unmanned Aerial Vehicle (UAV) missions as well as the creation and refinement of iterative 3D photogrammetric models with a next best view (NBV) approach. The novel approach uses Structure-from-Motion (SfM) to achieve convergence to a specified orthomosaic resolution by identifying edges in the point cloud and planning cameras that “view” the holes identified by edges without requiring an initial model. This iterative UAV photogrammetric method successfully runs in various Microsoft AirSim environments. Simulated ground sampling distance (GSD) of models reaches as low as 3.4 cm per pixel, and generally, successive iterations improve resolution. Besides analogous application in simulated environments, a field study of a retired municipal water tank illustrates the practical application and advantages of automated UAV iterative inspection of infrastructure using 63 % fewer photographs than a comparable manual flight with analogous density point clouds obtaining a GSD of less than 3 cm per pixel. Each iteration qualitatively increases resolution according to a logarithmic regression, reduces holes in models, and adds details to model edges.