Fusion of Spectral and Structural Information from Aerial Images for Improved Biomass Estimation

An Open-Source Package for Thermal and Multispectral Image Analysis for Plants in Glasshouse

Advanced plant phenotyping techniques to measure biophysical traits of crops are helping to deliver improved crop varieties faster. Phenotyping of plants using different sensors for image acquisition and its analysis with novel computational algorithms are increasingly being adapted to measure plant traits. Thermal and multispectral imagery provides novel opportunities to reliably phenotype crop genotypes tested for biotic and abiotic stresses under glasshouse conditions. However, optimization for image acquisition, pre-processing, and analysis is required to correct for optical distortion, image co-registration, radiometric rescaling, and illumination correction. This study provides a computational pipeline that optimizes these issues and synchronizes image acquisition from thermal and multispectral sensors. The image processing pipeline provides a processed stacked image comprising RGB, green, red, NIR, red edge, and thermal, containing only the pixels present in the object of interest, e.g., plant canopy. These multimodal outputs in thermal and multispectral imageries of the plants can be compared and analysed mutually to provide complementary insights and develop vegetative indices effectively. This study offers digital platform and analytics to monitor early symptoms of biotic and abiotic stresses and to screen a large number of genotypes for improved growth and productivity. The pipeline is packaged as open source and is hosted online so that it can be utilized by researchers working with similar sensors for crop phenotyping.

Breeding has selected for architectural and photosynthetic traits in lentils

Genetic progress in seed yield in lentils (Lens culinaris Medik) has increased by 1.1% per year in Australia over the past 27 years. Knowing which plant traits have changed through breeding during this time can give important insights as to how lentil yield has increased. This study aims to identify morphological and physiological traits that were directly or indirectly selected between 1993 and 2020 in the Australian lentil breeding program using 2 years of experimental data. Major changes occurred in plant architecture during this period. Divergent selection has seen the release of varieties that have sprawling to very upright types of canopies. Despite this genetic diversity in recently released varieties, there is an overall tendency of recently released varieties having increased plant height and leaf size with reduced number of branches. Increased light interception was positively correlated with year of release (YOR) and yield, and likely results from indirect selection of yield and taller plant types. There is an indication that recently released varieties have lower CO₂ assimilation rate, stomatal conductance and canopy temperature depression (CTD) at high ambient temperatures (~30°C). Understanding lentil physiology will assist in identifying traits to increase yield in a changing climate with extreme weather events.

Within and combined season prediction models for perennial ryegrass biomass yield using ground- and air-based sensor data

Across-season biomass assessment is crucial in the cultivar selection process to accurately evaluate the yield performance of lines under different growing conditions. However, it has been difficult to have an accurate, reliable, and repeated fresh biomass (FM) estimation of large populations of plants in the field without destructive harvesting, which incurs significant labor and operation costs. Sensor-based phenotyping platforms have advanced in the data collection of structural and vegetative information of plants, but the developed prediction models are still limited by low correlations at different growth stages and seasons. In this study, our objective was to develop and validate the global prediction models for across-season harvested fresh biomass (FM) yield based on the ground- and air-based sensor data including ground-based LiDAR, ground-based ultrasonic, and air-based multispectral camera to extract LiDAR plant volume (LV), LiDAR point density (LV_Den), height, and Normalized Difference Vegetative Index (NDVI). The study was conducted in a row-plot field trial with 480 rows (3 rows in a plot per cultivar) throughout the whole 2020 growing season up to the reproductive stage. We evaluated the performance of each plant parameter, their relationship, and the best subset prediction models using statistical stepwise selection at the row and plot levels through the seasonal and combined seasonal datasets. The best performing model: F M ~ L V ∗ L V _ D e n ∗ N D V I had a determination of coefficient R ² of at least 0.9 in vegetative stages and 0.8 in the reproductive stage. Similar results can be achieved in a simpler model with just two LiDAR variables- F M ~ L V ∗ L V _ D e n . In addition, LV and LV_Den showed a robust correlation with FM on their own over seasons and growth stages, while NDVI only performed well in some seasons. The simpler model based on only LiDAR data can be widely applied over season without the need of additional sensor data and may thus make the in-field across-season biomass assessment more feasible and practical for fast and cost-effective development of higher biomass yield cultivars.

Optimization of UAV-Based Imaging and Image Processing Orthomosaic and Point Cloud Approaches for Estimating Biomass in a Forage Crop

Forage and field peas provide essential nutrients for livestock diets, and high-quality field peas can influence livestock health and reduce greenhouse gas emissions. Above-ground biomass (AGBM) is one of the vital traits and the primary component of yield in forage pea breeding programs. However, a standard method of AGBM measurement is a destructive and labor-intensive process. This study utilized an unmanned aerial vehicle (UAV) equipped with a true-color RGB and a five-band multispectral camera to estimate the AGBM of winter pea in three breeding trials (two seed yields and one cover crop). Three processing techniques—vegetation index (VI), digital surface model (DSM), and 3D reconstruction model from point clouds—were used to extract the digital traits (height and volume) associated with AGBM. The digital traits were compared with the ground reference data (measured plant height and harvested AGBM). The results showed that the canopy volume estimated from the 3D model (alpha shape, α = 1.5) developed from UAV-based RGB imagery’s point clouds provided consistent and high correlation with fresh AGBM (r = 0.78–0.81, p < 0.001) and dry AGBM (r = 0.70–0.81, p < 0.001), compared with other techniques across the three trials. The DSM-based approach (height at 95th percentile) had consistent and high correlation (r = 0.71–0.95, p < 0.001) with canopy height estimation. Using the UAV imagery, the proposed approaches demonstrated the potential for estimating the crop AGBM across winter pea breeding trials.

The Potential of Widespread UAV Cameras in the Identification of Conifers and the Delineation of Their Crowns

With the ever-improving advances in computer vision and Earth observation capabilities, Unmanned Aerial Vehicles (UAVs) allow extensive forest inventory and the description of stand structure indirectly. We performed several flights with different UAVs and popular sensors over two sites with coniferous forests of various ages and flight levels using the custom settings preset by solution suppliers. The data were processed using image-matching techniques, yielding digital surface models, which were further analyzed using the lidR package in R. Consumer-grade RGB cameras were consistently more successful in the identification of individual trees at all of the flight levels (84–77% for Phantom 4), compared to the success of multispectral cameras, which decreased with higher flight levels and smaller crowns (77–54% for RedEdge-M). Regarding the accuracy of the measured crown diameters, RGB cameras yielded satisfactory results (Mean Absolute Error—MAE of 0.79–0.99 m and 0.88–1.16 m for Phantom 4 and Zenmuse X5S, respectively); multispectral cameras overestimated the height, especially in the full-grown forests (MAE = 1.26–1.77 m). We conclude that widely used low-cost RGB cameras yield very satisfactory results for the description of the structural forest information at a 150 m flight altitude. When (multi)spectral information is needed, we recommend reducing the flight level to 100 m in order to acquire sufficient structural forest information. The study contributes to the current knowledge by directly comparing widely used consumer-grade UAV cameras and providing a clear elementary workflow for inexperienced users, thus helping entry-level users with the initial steps and supporting the usability of such data in practice.

CBM: An IoT Enabled LiDAR Sensor for In-Field Crop Height and Biomass Measurements

The phenotypic characterization of crop genotypes is an essential, yet challenging, aspect of crop management and agriculture research. Digital sensing technologies are rapidly advancing plant phenotyping and speeding-up crop breeding outcomes. However, off-the-shelf sensors might not be fully applicable and suitable for agricultural research due to the diversity in crop species and specific needs during plant breeding selections. Customized sensing systems with specialized sensor hardware and software architecture provide a powerful and low-cost solution. This study designed and developed a fully integrated Raspberry Pi-based LiDAR sensor named CropBioMass (CBM), enabled by internet of things to provide a complete end-to-end pipeline. The CBM is a low-cost sensor, provides high-throughput seamless data collection in field, small data footprint, injection of data onto the remote server, and automated data processing. The phenotypic traits of crop fresh biomass, dry biomass, and plant height that were estimated by CBM data had high correlation with ground truth manual measurements in a wheat field trial. The CBM is readily applicable for high-throughput plant phenotyping, crop monitoring, and management for precision agricultural applications.

Estimation of nitrate nitrogen content in cotton petioles under drip irrigation based on wavelet neural network approach using spectral indices

BACKGROUND

Estimation of nitrate nitrogen (NO3--N) content in petioles is one of the key approaches for monitoring nitrogen (N) nutrition in crops. Rapid, non-destructive, and accurate evaluation of NO3--N contents in cotton petioles under drip irrigation is of great significance.

METHODS

In this study, we discussed the use of hyperspectral data to estimate NO3--N contents in cotton petioles under drip irrigation at different N treatments and growth stages. The correlations among trilateral parameters and six vegetation indices and petiole NO3--N contents were first investigated, after which a traditional regression model for petioles NO3--N content was established. A wavelet neural network (WNN) model for estimating petiole NO3--N content was also established. In addition, the performance of WNN was compared to those of random forest (RF), radial basis function neural network (RBF) and back propagation neural network (BP).

RESULTS

Between the blue edge amplitude (Db) and blue edge area (SDb) of the blue edge parameters was the optimal index for the estimation model of petiole NO3--N content. We found that the prediction results of the blue edge parameters and WNN were 7.3% higher than the coefficient of determination (R2) of the first derivative vegetation index and WNN. Root mean square error (RMSE) and mean absolute error (MAE) were 25.2% and 30.9% lower than first derivative vegetation, respectively, and the performance was better than that of RF, RBF and BP.

CONCLUSIONS

An inexpensive approach consisting of the WNN algorithm and blue edge parameters can be used to enhance the accuracy of NO3--N content estimation in cotton petioles under drip irrigation.

Evaluation of the soil profile quality of subsided land in a coal mining area backfilled with river sediment based on monitoring wheat growth biomass with UAV systems

Underground coal mining leads to land subsidence, and the situation is particularly serious in the Coal-Grain Complex in eastern China, causing the crop production to be reduced or to be taken out. Backfilling with Yellow River sediment is one of the effective methods to solve the land subsidence in this area, but a key issue is how to select the optimal soil reconstruction profile so that the crop yield after backfilling and reclamation is unaffected. The main purpose of this study is to verify the feasibility of selecting the optimal soil reconstruction profile by rapid monitoring of crop growth and judging soil quality with the aid of unmanned aerial vehicle systems (UAVs). A control treatment and 13 experimental treatments were established for the study area. The control treatment consisted of using 30 cm topsoil and 90 cm subsoil and the topsoil is a proxy for native (undisturbed) soil from the study sites. All other treatments consisted of using varying combinations of subsoil and sediment overlain by 30 cm of topsoil. The vegetation indices from the UAV multispectral images, and the plant height and vegetation coverage from the UAV RGB images were used for estimation of the winter wheat biomass in a random forest regression. The results showed that the random forest regression model yielded accurate estimation of the aboveground biomass. Furthermore, knowledge of plant height and vegetation coverage improved the accuracy of prediction such that crop growth was well characterized. The optimal soil profile consisted of 0.3 m topsoil + 0.2 m subsoil + 0.2 m sediment + 0.2 m subsoil + 0.3 m sediment. A fast and effective airborne monitoring method for soil quality was established, thus providing greatly improved monitoring efficiency.

Machine Learning Regression Analysis for Estimation of Crop Emergence Using Multispectral UAV Imagery

Optimal crop emergence is an important trait in crop breeding for genotypic screening and for achieving potential growth and yield. Emergence is conventionally quantified manually by counting the sub-sections of field plots or scoring; these are less reliable, laborious and inefficient. Remote sensing technology is being increasingly used for high-throughput estimation of agronomic traits in field crops. This study developed a method for estimating wheat seedlings using multispectral images captured from an unmanned aerial vehicle. A machine learning regression (MLR) analysis was used by combining spectral and morphological information extracted from the multispectral images. The approach was tested on diverse wheat genotypes varying in seedling emergence. In this study, three supervised MLR models including regression trees, support vector regression and Gaussian process regression (GPR) were evaluated for estimating wheat seedling emergence. The GPR model was the most effective compared to the other methods, with R2 = 0.86, RMSE = 4.07 and MAE = 3.21 when correlated to the manual seedling count. In addition, imagery data collected at multiple flight altitudes and different wheat growth stages suggested that 10 m altitude and 20 days after sowing were desirable for optimal spatial resolution and image analysis. The method is deployable on larger field trials and other crops for effective and reliable seedling emergence estimates.

A New Method for Extracting Individual Plant Bio-Characteristics from High-Resolution Digital Images

The extraction of automated plant phenomics from digital images has advanced in recent years. However, the accuracy of extracted phenomics, especially for individual plants in a field environment, requires improvement. In this paper, a new and efficient method of extracting individual plant areas and their mean normalized difference vegetation index from high-resolution digital images is proposed. The algorithm was applied on perennial ryegrass row field data multispectral images taken from the top view. First, the center points of individual plants from digital images were located to exclude plant positions without plants. Second, the accurate area of each plant was extracted using its center point and radius. Third, the accurate mean normalized difference vegetation index of each plant was extracted and adjusted for overlapping plants. The correlation between the extracted individual plant phenomics and fresh weight ranged between 0.63 and 0.75 across four time points. The methods proposed are applicable to other crops where individual plant phenotypes are of interest.