1
|
Yan T, Xu W, Lin J, Duan L, Gao P, Zhang C, Lv X. Combining Multi-Dimensional Convolutional Neural Network (CNN) With Visualization Method for Detection of Aphis gossypii Glover Infection in Cotton Leaves Using Hyperspectral Imaging. FRONTIERS IN PLANT SCIENCE 2021; 12:604510. [PMID: 33659014 PMCID: PMC7917247 DOI: 10.3389/fpls.2021.604510] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/09/2020] [Accepted: 01/11/2021] [Indexed: 05/08/2023]
Abstract
Cotton is a significant economic crop. It is vulnerable to aphids (Aphis gossypii Glovers) during the growth period. Rapid and early detection has become an important means to deal with aphids in cotton. In this study, the visible/near-infrared (Vis/NIR) hyperspectral imaging system (376-1044 nm) and machine learning methods were used to identify aphid infection in cotton leaves. Both tall and short cotton plants (Lumianyan 24) were inoculated with aphids, and the corresponding plants without aphids were used as control. The hyperspectral images (HSIs) were acquired five times at an interval of 5 days. The healthy and infected leaves were used to establish the datasets, with each leaf as a sample. The spectra and RGB images of each cotton leaf were extracted from the hyperspectral images for one-dimensional (1D) and two-dimensional (2D) analysis. The hyperspectral images of each leaf were used for three-dimensional (3D) analysis. Convolutional Neural Networks (CNNs) were used for identification and compared with conventional machine learning methods. For the extracted spectra, 1D CNN had a fine classification performance, and the classification accuracy could reach 98%. For RGB images, 2D CNN had a better classification performance. For HSIs, 3D CNN performed moderately and performed better than 2D CNN. On the whole, CNN performed relatively better than conventional machine learning methods. In the process of 1D, 2D, and 3D CNN visualization, the important wavelength ranges were analyzed in 1D and 3D CNN visualization, and the importance of wavelength ranges and spatial regions were analyzed in 2D and 3D CNN visualization. The overall results in this study illustrated the feasibility of using hyperspectral imaging combined with multi-dimensional CNN to detect aphid infection in cotton leaves, providing a new alternative for pest infection detection in plants.
Collapse
Affiliation(s)
- Tianying Yan
- College of Information Science and Technology, Shihezi University, Shihezi, China
- Key Laboratory of Oasis Ecology Agriculture, Shihezi University, Shihezi, China
| | - Wei Xu
- College of Agriculture, Shihezi University, Shihezi, China
- Xinjiang Production and Construction Corps Key Laboratory of Special Fruits and Vegetables Cultivation Physiology and Germplasm Resources Utilization, Shihezi, China
| | - Jiao Lin
- College of Agriculture, Shihezi University, Shihezi, China
| | - Long Duan
- College of Information Science and Technology, Shihezi University, Shihezi, China
- Key Laboratory of Oasis Ecology Agriculture, Shihezi University, Shihezi, China
| | - Pan Gao
- College of Information Science and Technology, Shihezi University, Shihezi, China
- Key Laboratory of Oasis Ecology Agriculture, Shihezi University, Shihezi, China
| | - Chu Zhang
- College of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou, China
- Key Laboratory of Spectroscopy Sensing, Ministry of Agriculture and Rural Affairs, Hangzhou, China
- School of Information Engineering, Huzhou University, Huzhou, China
| | - Xin Lv
- Key Laboratory of Oasis Ecology Agriculture, Shihezi University, Shihezi, China
- College of Agriculture, Shihezi University, Shihezi, China
| |
Collapse
|
2
|
Discriminant Analysis of the Damage Degree Caused by Pine Shoot Beetle to Yunnan Pine Using UAV-Based Hyperspectral Images. FORESTS 2020. [DOI: 10.3390/f11121258] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Due to the increased frequency and intensity of forest damage caused by diseases and pests, effective methods are needed to accurately monitor the damage degree. Unmanned aerial vehicle (UAV)-based hyperspectral imaging is an effective technique for forest health surveying and monitoring. In this study, a framework is proposed for identifying the severity of damage caused by Tomicus spp. (the pine shoot beetle, PSB) to Yunnan pine (Pinus yunnanensis Franch) using UAV-based hyperspectral images. Four sample plots were set up in Shilin, Yunnan Province, China. A total of 80 trees were investigated, and their hyperspectral data were recorded. The spectral data were subjected to a one-way ANOVA. Two sensitive bands and one sensitive parameter were selected using Pearson correlation analysis and stepwise discriminant analysis to establish a diagnostic model of the damage degree. A discriminant rule was established to identify the degree of damage based on the median value between different degrees of damage. The diagnostic model with R690 and R798 as variables had the highest accuracy (R2 = 0.854, RMSE = 0.427), and the test accuracy of the discriminant rule was 87.50%. The results are important for forest damage caused by the PSB.
Collapse
|
3
|
Nondestructive measurement of pectin polysaccharides using hyperspectral imaging in mulberry fruit. Food Chem 2020; 334:127614. [PMID: 32711282 DOI: 10.1016/j.foodchem.2020.127614] [Citation(s) in RCA: 27] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2019] [Revised: 07/05/2020] [Accepted: 07/16/2020] [Indexed: 12/14/2022]
Abstract
Pectin polysaccharide is an important phytochemical with potential biomedical applications. It is commonly measured by time-consuming destructive chemical methods. This work demonstrates the feasibility of using visible and near-infrared hyperspectral imaging (HSI) techniques to rapidly measure pectin polysaccharides in intact mulberry fruits. Based on spatial information provided by HSI images, the representative spectrum of each whole mulberry was accurately extracted without background. The effects of storage temperature on two varieties of mulberries for model establishment were studied. The performances of two spectral ranges obtained by Si and InGaAs CCD detectors for pectin prediction were compared. The best predictions were obtained from dilute alkali soluble pectin and total soluble pectin in Dashi mulberry fruit stored at room temperature, with residual predictive deviation values of 2.317 and 1.935, respectively. Our results show that HSI is a promising alternative to the chemical method to rapidly and nondestructively measure the pectin content.
Collapse
|
4
|
Jović O, Šmuc T. Combined Machine Learning and Molecular Modelling Workflow for the Recognition of Potentially Novel Fungicides. Molecules 2020; 25:molecules25092198. [PMID: 32397151 PMCID: PMC7249108 DOI: 10.3390/molecules25092198] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2020] [Revised: 05/02/2020] [Accepted: 05/06/2020] [Indexed: 12/31/2022] Open
Abstract
Novel machine learning and molecular modelling filtering procedures for drug repurposing have been carried out for the recognition of the novel fungicide targets of Cyp51 and Erg2. Classification and regression approaches on molecular descriptors have been performed using stepwise multilinear regression (FS-MLR), uninformative-variable elimination partial-least square regression, and a non-linear method called Forward Stepwise Limited Correlation Random Forest (FS-LM-RF). Altogether, 112 prediction models from two different approaches have been built for the descriptor recognition of fungicide hit compounds. Aiming at the fungal targets of sterol biosynthesis in membranes, antifungal hit compounds have been selected for docking experiments from the Drugbank database using the Autodock4 molecular docking program. The results were verified by Gold Protein-Ligand Docking Software. The best-docked conformation, for each high-scored ligand considered, was submitted to quantum mechanics/molecular mechanics (QM/MM) gradient optimization with final single point calculations taking into account both the basis set superposition error and thermal corrections (with frequency calculations). Finally, seven Drugbank lead compounds were selected based on their high QM/MM scores for the Cyp51 target, and three were selected for the Erg2 target. These lead compounds could be recommended for further in vitro studies.
Collapse
|
5
|
Quantitative Analysis of Soil Total Nitrogen Using Hyperspectral Imaging Technology with Extreme Learning Machine. SENSORS 2019; 19:s19204355. [PMID: 31600914 PMCID: PMC6832974 DOI: 10.3390/s19204355] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/29/2019] [Revised: 10/04/2019] [Accepted: 10/07/2019] [Indexed: 11/17/2022]
Abstract
Soil nutrient detection is important for precise fertilization. A total of 150 soil samples were picked from Lishui City. In this work, the total nitrogen (TN) content in soil samples was detected in the spectral range of 900-1700 nm using a hyperspectral imaging (HSI) system. Characteristic wavelengths were extracted using uninformative variable elimination (UVE) and the successive projections algorithm (SPA), separately. Partial least squares (PLS) and extreme learning machine (ELM) were used to establish the calibration models with full spectra and characteristic wavelengths, respectively. The results indicated that the prediction effect of the nonlinear ELM model was superior to the linear PLS model. In addition, the models using the characteristic wavelengths could also achieve good results, and the UVE-ELM model performed better, having a correlation coefficient of prediction (rp), root-mean-square error of prediction (RMSEP), and residual prediction deviation (RPD) of 0.9408, 0.0075, and 2.97, respectively. The UVE-ELM model was then used to estimate the TN content in the soil sample and obtain a distribution map. The research results indicate that HSI can be used for the detection and visualization of the distribution of TN content in soil, providing a basis for future large-scale monitoring of soil nutrient distribution and rational fertilization.
Collapse
|