1
|
Nansen C, Savi PJ, Mantri A. Methods to optimize optical sensing of biotic plant stress - combined effects of hyperspectral imaging at night and spatial binning. PLANT METHODS 2024; 20:163. [PMID: 39468668 PMCID: PMC11520384 DOI: 10.1186/s13007-024-01292-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/26/2024] [Accepted: 10/21/2024] [Indexed: 10/30/2024]
Abstract
In spatio-temporal plant monitoring, optical sensing (including hyperspectral imaging), is being deployed to, non-invasively, detect and diagnose plant responses to abiotic and biotic stressors. Early and accurate detection and diagnosis of stressors are key objectives. Level of radiometric repeatability of optical sensing data and ability to accurately detect and diagnose biotic stress are inversely correlated. Accordingly, it may be argued that one of the most significant frontiers and challenges regarding widespread adoption of optical sensing in plant research and crop production hinges on methods to maximize radiometric repeatability. In this study, we acquired hyperspectral optical sensing data at noon and midnight from soybean (Glycine max) and coleus wizard velvet red (Solenostemon scutellarioides) plants with/without experimentally infestation of two-spotted spider mites (Tetranychus urticae). We addressed three questions related to optimization of radiometric repeatability: (1) are reflectance-based plant responses affected by time of optical sensing? (2) if so, are plant responses to two-spotted spider mite infestations (biotic stressor) more pronounced at midnight versus at noon? (3) Is detection of biotic stress enhanced by spatial binning (smoothing) of hyperspectral imaging data? Results from this study provide insight into calculations of radiometric repeatability. Results strongly support claims that acquisition of optical sensing data to detect and characterize stress responses by plants to detect biotic stressors should be performed at night. Moreover, the combination of midnight imaging and spatial binning increased classification accuracies with 29% and 31% for soybean and coleus, respectively. Practical implications of these findings are discussed. Study results are relevant to virtually all applications of optical sensing to detect and diagnose abiotic and biotic stress responses by plants in both controlled environments and in outdoor crop production systems.
Collapse
Affiliation(s)
- Christian Nansen
- Department of Entomology and Nematology, University of California, UC Davis Briggs Hall, Room 367, Davis, CA, 95616, USA.
| | - Patrice J Savi
- Department of Entomology and Nematology, University of California, UC Davis Briggs Hall, Room 367, Davis, CA, 95616, USA
| | - Anil Mantri
- Department of Entomology and Nematology, University of California, UC Davis Briggs Hall, Room 367, Davis, CA, 95616, USA
| |
Collapse
|
2
|
Krüger M, Zemanek T, Wuttke D, Dinkel M, Serfling A, Böckmann E. Hyperspectral imaging for pest symptom detection in bell pepper. PLANT METHODS 2024; 20:156. [PMID: 39358772 PMCID: PMC11447932 DOI: 10.1186/s13007-024-01273-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/08/2023] [Accepted: 09/12/2024] [Indexed: 10/04/2024]
Abstract
BACKGROUND The automation of pest monitoring is highly important for enhancing integrated pest management in practice. In this context, advanced technologies are becoming increasingly explored. Hyperspectral imaging (HSI) is a technique that has been used frequently in recent years in the context of natural science, and the successful detection of several fungal diseases and some pests has been reported. Various automated measures and image analysis methods offer great potential for enhancing monitoring in practice. RESULTS In this study, the use of hyperspectral imaging over a wide spectrum from 400 to 2500 nm is investigated for noninvasive identification and the distinction of healthy plants and plants infested with Myzus persicae (Sulzer) and Frankliniella occidentalis (Pergande) on bell peppers. Pest infestations were carried out in netted areas, and images of single plants and dissected leaves were used to train the decision algorithm. Additionally, a specially modified spraying robot was converted into an autonomous platform used to carry the hyperspectral imaging system to take images under greenhouse conditions. The algorithm was developed via the XGBoost framework with gradient-boosted trees. Signals from specific wavelengths were found to be associated with the damage patterns of different insects. Under confined conditions, M. persicae and F. occidentalis infestations were distinguished from each other and from the uninfested control for single leaves. Differentiation was still possible when small whole plants were used. However, application under greenhouse conditions did not result in a good fit compared to the results of manual monitoring. CONCLUSION Hyperspectral images can be used to distinguish sucking pests on bell peppers on the basis of single leaves and intact potted bell pepper plants under controlled conditions. Wavelength reduction methods offer options for multispectral camera usage in high-grown vegetable greenhouses. The application of automated platforms similar to the one tested in this study could be possible, but for successful pest detection under greenhouse conditions, algorithms should be further developed fully considering real-world conditions.
Collapse
Affiliation(s)
- Marvin Krüger
- Julius Kühn-Institute, Federal Research Center for Cultivated Plants, Institute for Plant Protection in Horticulture and Urban Green, Braunschweig, Germany
| | | | | | - Maximilian Dinkel
- Julius Kühn-Institute, Federal Research Center for Cultivated Plants, Institute for Plant Protection in Horticulture and Urban Green, Braunschweig, Germany
| | - Albrecht Serfling
- Julius Kühn-Institute, Federal Research Center for Cultivated Plants, Institute for Resistance Research and Stress Tolerance, Quedlinburg, Germany
| | - Elias Böckmann
- Julius Kühn-Institute, Federal Research Center for Cultivated Plants, Institute for Plant Protection in Horticulture and Urban Green, Braunschweig, Germany.
| |
Collapse
|
3
|
Iost Filho FH, Pazini JDB, Alves TM, Koch RL, Yamamoto PT. How does the digital transformation of agriculture affect the implementation of Integrated Pest Management? FRONTIERS IN SUSTAINABLE FOOD SYSTEMS 2022. [DOI: 10.3389/fsufs.2022.972213] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/05/2022] Open
Abstract
Integrated pest management (IPM) has greatly influenced farming in the past decades. Even though it has been effective, its adoption has not been as large as anticipated. Operational issues regarding crop monitoring are among the reasons for the lack of adoption of the IPM philosophy because control decisions cannot be made unless the crop is effectively and constantly monitored. In this way, recent technologies can provide unique information about plants affected by insects. Such information can be very precise and timely, especially with the use of real-time data to allow decision-making for pest control that can prevent local infestation of insects from spreading to the whole field. Some of the digital tools that are commercially available for growers include drones, automated traps, and satellites. In the future, a variety of other technologies, such as autonomous robots, could be widely available. While the traditional IPM approach is generally carried out with control solutions being delivered throughout the whole field, new approaches involving digital technologies will need to consider adaptations in the concepts of economic thresholds, sampling, population forecast, injury identification, and ultimately the localized use of control tactics. Therefore, in this paper, we reviewed how the traditional IPM concepts could be adapted, considering this ongoing digital transformation in agriculture.
Collapse
|
4
|
Eshkabilov S, Stenger J, Knutson EN, Küçüktopcu E, Simsek H, Lee CW. Hyperspectral Image Data and Waveband Indexing Methods to Estimate Nutrient Concentration on Lettuce ( Lactuca sativa L.) Cultivars. SENSORS (BASEL, SWITZERLAND) 2022; 22:8158. [PMID: 36365856 PMCID: PMC9657853 DOI: 10.3390/s22218158] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/13/2022] [Revised: 10/12/2022] [Accepted: 10/14/2022] [Indexed: 06/16/2023]
Abstract
Lettuce is an important vegetable in the human diet and is commonly consumed for salad. It is a source of vitamin A, which plays a vital role in human health. Improvements in lettuce production will be needed to ensure a stable and economically available supply in the future. The influence of nitrogen (N), phosphorus (P), and potassium (K) compounds on the growth dynamics of four hydroponically grown lettuce (Lactuca sativa L.) cultivars (Black Seeded Simpson, Parris Island, Rex RZ, and Tacitus) in tubs and in a nutrient film technique (NFT) system were studied. Hyperspectral images (HSI) were captured at plant harvest. Models developed from the HSI data were used to estimate nutrient levels of leaf tissues by employing principal component analysis (PCA), partial least squares regression (PLSR), multivariate regression, and variable importance projection (VIP) methods. The optimal wavebands were found in six regions, including 390.57-438.02, 497-550, 551-600, 681.34-774, 802-821, and 822-838 nm for tub-grown lettuces and four regions, namely 390.57-438.02, 497-550, 551-600, and 681.34-774 nm for NFT-system-grown lettuces. These fitted models' levels showed high accuracy (R2=0.85-0.99) in estimating the growth dynamics of the studied lettuce cultivars in terms of nutrient content. HSI data of the lettuce leaves and applied N solutions demonstrated a direct positive correlation with an accuracy of 0.82-0.99 for blue and green regions in 400-575 nm wavebands. The results proved that, in most of the tested multivariate regression models, HSI data of freshly cut leaves correlated well with laboratory-measured data.
Collapse
Affiliation(s)
- Sulaymon Eshkabilov
- Department of Agricultural and Biosystems Engineering, North Dakota State University, Fargo, ND 58108, USA
| | - John Stenger
- Department of Agricultural and Biosystems Engineering, North Dakota State University, Fargo, ND 58108, USA
| | - Elizabeth N. Knutson
- Department of Plant Sciences, North Dakota State University, Fargo, ND 58108, USA
| | - Erdem Küçüktopcu
- Department of Agricultural Structures and Irrigation, Ondokuz Mayıs University, Samsun 55139, Turkey
| | - Halis Simsek
- Department of Agricultural and Biological Engineering, Purdue University, West Lafayette, IN 47907, USA
| | - Chiwon W. Lee
- Department of Plant Sciences, North Dakota State University, Fargo, ND 58108, USA
| |
Collapse
|
5
|
Rostami B, Nansen C. Application of active acoustic transducers in monitoring and assessment of terrestrial ecosystem health—A review. Methods Ecol Evol 2022. [DOI: 10.1111/2041-210x.14004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Affiliation(s)
- Bita Rostami
- College of Agricultural and Environmental Sciences University of California Davis Davis California USA
| | - Christian Nansen
- Department of Entomology and Nematology University of California Davis Davis California USA
| |
Collapse
|
6
|
Nansen C, Imtiaz MS, Mesgaran MB, Lee H. Experimental data manipulations to assess performance of hyperspectral classification models of crop seeds and other objects. PLANT METHODS 2022; 18:74. [PMID: 35658997 PMCID: PMC9164469 DOI: 10.1186/s13007-022-00912-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/14/2021] [Accepted: 05/22/2022] [Indexed: 06/15/2023]
Abstract
BACKGROUND Optical sensing solutions are being developed and adopted to classify a wide range of biological objects, including crop seeds. Performance assessment of optical classification models remains both a priority and a challenge. METHODS As training data, we acquired hyperspectral imaging data from 3646 individual tomato seeds (germination yes/no) from two tomato varieties. We performed three experimental data manipulations: (1) Object assignment error: effect of individual object in the training data being assigned to the wrong class. (2) Spectral repeatability: effect of introducing known ranges (0-10%) of stochastic noise to individual reflectance values. (3) Size of training data set: effect of reducing numbers of observations in training data. Effects of each of these experimental data manipulations were characterized and quantified based on classifications with two functions [linear discriminant analysis (LDA) and support vector machine (SVM)]. RESULTS For both classification functions, accuracy decreased linearly in response to introduction of object assignment error and to experimental reduction of spectral repeatability. We also demonstrated that experimental reduction of training data by 20% had negligible effect on classification accuracy. LDA and SVM classification algorithms were applied to independent validation seed samples. LDA-based classifications predicted seed germination with RMSE = 10.56 (variety 1) and 26.15 (variety 2), and SVM-based classifications predicted seed germination with RMSE = 10.44 (variety 1) and 12.58 (variety 2). CONCLUSION We believe this study represents the first, in which optical seed classification included both a thorough performance evaluation of two separate classification functions based on experimental data manipulations, and application of classification models to validation seed samples not included in training data. Proposed experimental data manipulations are discussed in broader contexts and general relevance, and they are suggested as methods for in-depth performance assessments of optical classification models.
Collapse
Affiliation(s)
- Christian Nansen
- Department of Entomology and Nematology, University of California, Davis, USA.
- Department of Entomology and Nematology, UC Davis Briggs Hall, Room 367, Davis, CA, 95616, USA.
| | - Mohammad S Imtiaz
- Department of Electrical & Computer Engineering, Bradley University, Peoria, USA
| | | | - Hyoseok Lee
- Department of Entomology and Nematology, University of California, Davis, USA
| |
Collapse
|
7
|
Nansen C, Murdock M, Purington R, Marshall S. Early infestations by arthropod pests induce unique changes in plant compositional traits and leaf reflectance. PEST MANAGEMENT SCIENCE 2021; 77:5158-5169. [PMID: 34255423 PMCID: PMC9290632 DOI: 10.1002/ps.6556] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/10/2021] [Revised: 06/30/2021] [Accepted: 07/13/2021] [Indexed: 05/15/2023]
Abstract
BACKGROUND With steadily growing interest in the use of remote-sensing technologies to detect and diagnose pest infestations in crops, it is important to investigate and characterize possible associations between crop leaf reflectance and unique pest-induced changes in plant compositional traits. Accordingly, we compiled plant compositional traits from chrysanthemum and gerbera plants in four treatments: non-infested, or infested with mites, thrips or whiteflies, and we acquired hyperspectral leaf reflectance data from the same plants over time (0-14 days). RESULTS Plant compositional traits changed significantly in response to arthropod infestations, and individual chrysanthemum and gerbera plants were classified with 78% and 80% accuracy, respectively. Based on leaf reflectance, individual plants from the four treatments were classified with moderate accuracy levels of 76% (gerbera) and 73% (chrysanthemum) but with a clear distinction between non-infested and infested plants. Accurate and consistent diagnosis of biotic stressors was not achieved. CONCLUSION To our knowledge, this is the first study in which infestations by multiple economically important arthropod pests are directly compared and associated with leaf reflectance responses and changes in plant compositional traits. It is important to highlight that imposed stress levels were low, period of infestation was short, and hyperspectral remote-sensing data were acquired at four time points with analyses based on large data sets (3826 leaf reflectance profiles for chrysanthemum and 4041 for gerbera). This study provides novel insight into crop responses to different biotic stressors and into possible associations between plant compositional traits and hyperspectral leaf reflectance data acquired from crop leaves.
Collapse
Affiliation(s)
- Christian Nansen
- Department of Entomology and NematologyUniversity of California DavisDavisCAUSA
| | - Machiko Murdock
- Department of Entomology and NematologyUniversity of California DavisDavisCAUSA
| | - Rachel Purington
- Department of Entomology and NematologyUniversity of California DavisDavisCAUSA
| | - Stuart Marshall
- Department of Entomology and NematologyUniversity of California DavisDavisCAUSA
| |
Collapse
|
8
|
A Pseudo-Label Guided Artificial Bee Colony Algorithm for Hyperspectral Band Selection. REMOTE SENSING 2020. [DOI: 10.3390/rs12203456] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Hyperspectral remote sensing images have characteristics such as high dimensionality and high redundancy. This paper proposes a pseudo-label guided artificial bee colony band selection algorithm with hypergraph clustering (HC-ABC) to remove redundant and noise bands. Firstly, replacing traditional pixel points by super-pixel centers, a hypergraph evolutionary clustering method with low computational cost is developed to generate high-quality pseudo-labels; Then, on the basis of these pseudo-labels, taking classification accuracy as the optimized objective, a supervised band selection algorithm based on artificial bee colony is proposed. Moreover, a noise filtering mechanism based on grid division is designed to ensure the accuracy of pseudo-labels. Finally, the proposed algorithm is applied in 3 real datasets and compared with 6 classical band selection algorithms. Experimental results show that the proposed algorithm can obtain a band subset with high classification accuracy for all the three classifiers, KNN, Random Forest, and SVM.
Collapse
|