1
|
Pu H, Yu J, Luo J, Paliwal J, Sun DW. Terahertz spectra reconstructed using convolutional denoising autoencoder for identification of rice grains infested with Sitophilus oryzae at different growth stages. SPECTROCHIMICA ACTA. PART A, MOLECULAR AND BIOMOLECULAR SPECTROSCOPY 2024; 311:124015. [PMID: 38359515 DOI: 10.1016/j.saa.2024.124015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/21/2023] [Revised: 01/31/2024] [Accepted: 02/07/2024] [Indexed: 02/17/2024]
Abstract
Rice grains are often infected by Sitophilus oryzae due to improper storage, resulting in quality and quantity losses. The efficacy of terahertz time-domain spectroscopy (THz-TDS) technology in detecting Sitophilus oryzae at different stages of infestation in stored rice was employed in the current research. Terahertz (THz) spectra for rice grains infested by Sitophilus oryzae at different growth stages were acquired. Then, the convolutional denoising autoencoder (CDAE) was used to reconstruct THz spectra to reduce the noise-to-signal ratio. Finally, a random forest classification (RFC) model was developed to identify the infestation levels. Results showed that the RFC model based on the reconstructed second-order derivative spectrum with an accuracy of 84.78%, a specificity of 86.75%, a sensitivity of 86.36% and an F1-score of 85.87% performed better than the original first-order derivative THz spectrum with an accuracy of 89.13%, a specificity of 91.38%, a sensitivity of 88.18% and an F1-score of 89.16%. In addition, the convolutional layers inside the CDAE were visualized using feature maps to explain the improvement in results, illustrating that the CDAE can eliminate noise in the spectral data. Overall, THz spectra reconstructed with the CDAE provided a novel method for effective THz detection of infected grains.
Collapse
Affiliation(s)
- Hongbin Pu
- School of Food Science and Engineering, South China University of Technology, Guangzhou 510641, China; Academy of Contemporary Food Engineering, South China University of Technology, Guangzhou Higher Education Mega Center, Guangzhou 510006, China; Engineering and Technological Research Centre of Guangdong Province on Intelligent Sensing and Process Control of Cold Chain Foods, & Guangdong Province Engineering Laboratory for Intelligent Cold Chain Logistics Equipment for Agricultural Products, Guangzhou Higher Education Mega Centre, Guangzhou 510006, China
| | - Jingxiao Yu
- School of Food Science and Engineering, South China University of Technology, Guangzhou 510641, China; Academy of Contemporary Food Engineering, South China University of Technology, Guangzhou Higher Education Mega Center, Guangzhou 510006, China; Engineering and Technological Research Centre of Guangdong Province on Intelligent Sensing and Process Control of Cold Chain Foods, & Guangdong Province Engineering Laboratory for Intelligent Cold Chain Logistics Equipment for Agricultural Products, Guangzhou Higher Education Mega Centre, Guangzhou 510006, China
| | - Jie Luo
- School of Food Science and Engineering, South China University of Technology, Guangzhou 510641, China; Academy of Contemporary Food Engineering, South China University of Technology, Guangzhou Higher Education Mega Center, Guangzhou 510006, China; Engineering and Technological Research Centre of Guangdong Province on Intelligent Sensing and Process Control of Cold Chain Foods, & Guangdong Province Engineering Laboratory for Intelligent Cold Chain Logistics Equipment for Agricultural Products, Guangzhou Higher Education Mega Centre, Guangzhou 510006, China
| | - Jitendra Paliwal
- Department of Biosystems Engineering, University of Manitoba, Winnipeg, MB, R3T 2N2, Canada
| | - Da-Wen Sun
- School of Food Science and Engineering, South China University of Technology, Guangzhou 510641, China; Academy of Contemporary Food Engineering, South China University of Technology, Guangzhou Higher Education Mega Center, Guangzhou 510006, China; Engineering and Technological Research Centre of Guangdong Province on Intelligent Sensing and Process Control of Cold Chain Foods, & Guangdong Province Engineering Laboratory for Intelligent Cold Chain Logistics Equipment for Agricultural Products, Guangzhou Higher Education Mega Centre, Guangzhou 510006, China; Food Refrigeration and Computerized Food Technology (FRCFT), Agriculture and Food Science Centre, University College Dublin, National University of Ireland, Belfield, Dublin 4, Ireland.
| |
Collapse
|
2
|
Ning H, Liu S, Zhu Q, Zhou T. Convolutional neural network in rice disease recognition: accuracy, speed and lightweight. FRONTIERS IN PLANT SCIENCE 2023; 14:1269371. [PMID: 38023901 PMCID: PMC10646333 DOI: 10.3389/fpls.2023.1269371] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/29/2023] [Accepted: 10/18/2023] [Indexed: 12/01/2023]
Abstract
There are many rice diseases, which have very serious negative effects on rice growth and final yield. It is very important to identify the categories of rice diseases and control them. In the past, the identification of rice disease types was completely dependent on manual work, which required a high level of human experience. But the method often could not achieve the desired effect, and was difficult to popularize on a large scale. Convolutional neural networks are good at extracting localized features from input data, converting low-level shape and texture features into high-level semantic features. Models trained by convolutional neural network technology based on existing data can extract common features of data and make the framework have generalization ability. Applying ensemble learning or transfer learning techniques to convolutional neural network can further improve the performance of the model. In recent years, convolutional neural network technology has been applied to the automatic recognition of rice diseases, which reduces the manpower burden and ensures the accuracy of recognition. In this paper, the applications of convolutional neural network technology in rice disease recognition are summarized, and the fruitful achievements in rice disease recognition accuracy, speed, and mobile device deployment are described. This paper also elaborates on the lightweighting of convolutional neural networks for real-time applications as well as mobile deployments, and the various improvements in the dataset and model structure to enhance the model recognition performance.
Collapse
Affiliation(s)
- Hongwei Ning
- College of Information and Network Engineering, Anhui Science and Technology University, Bengbu, Anhui, China
| | - Sheng Liu
- Information Network Security College, Yunnan Police College, Kunming, Yunnan, China
| | - Qifei Zhu
- Information Network Security College, Yunnan Police College, Kunming, Yunnan, China
| | - Teng Zhou
- Mechanical and Electrical Engineering College, Hainan University, Haikou, Hainan, China
| |
Collapse
|
3
|
Qi H, Huang Z, Sun Z, Tang Q, Zhao G, Zhu X, Zhang C. Rice seed vigor detection based on near-infrared hyperspectral imaging and deep transfer learning. FRONTIERS IN PLANT SCIENCE 2023; 14:1283921. [PMID: 37936942 PMCID: PMC10627025 DOI: 10.3389/fpls.2023.1283921] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/27/2023] [Accepted: 10/09/2023] [Indexed: 11/09/2023]
Abstract
Vigor is one of the important factors that affects rice yield and quality. Rapid and accurate detection of rice seed vigor is of great importance for rice production. In this study, near-infrared hyperspectral imaging technique and transfer learning were combined to detect rice seed vigor. Four varieties of artificial-aged rice seeds (Yongyou12, Yongyou1540, Suxiangjing100, and Longjingyou1212) were studied. Different convolutional neural network (CNN) models were built to detect the vigor of the rice seeds. Two transfer strategies, fine-tuning and MixStyle, were used to transfer knowledge among different rice varieties for vigor detection. The experimental results showed that the convolutional neural network model of Yongyou12 classified the vigor of Yongyou1540, Suxiangjing100, and Longjingyou1212 through MixStyle transfer knowledge, and the accuracy reached 90.00%, 80.33%, and 85.00% in validation sets, respectively, which was better or close to the initial modeling performances of each variety. MixStyle statistics are based on probabilistic mixed instance-level features of cross-source domain training samples. When training instances, new domains can be synthesized, which increases the domain diversity of the source domain, thereby improving the generalization ability of the trained model. This study would help rapid and accurate detection of a large varieties of crop seeds.
Collapse
Affiliation(s)
- Hengnian Qi
- School of Information Engineering, Huzhou University, Huzhou, China
| | - Zihong Huang
- School of Information Engineering, Huzhou University, Huzhou, China
| | - Zeyu Sun
- School of Information Engineering, Huzhou University, Huzhou, China
| | - Qizhe Tang
- School of Information Engineering, Huzhou University, Huzhou, China
| | - Guangwu Zhao
- College of Advanced Agricultural Sciences, Zhejiang A&F University, Lin’an, China
| | - Xuhua Zhu
- Smart Agriculture Research Institute, Zhejiang Top Cloud-agri Technology Co., Ltd., Hangzhou, China
| | - Chu Zhang
- School of Information Engineering, Huzhou University, Huzhou, China
| |
Collapse
|
4
|
Zhang J, Feng X, Jin J, Fang H. Concise Cascade Methods for Transgenic Rice Seed Discrimination using Spectral Phenotyping. PLANT PHENOMICS (WASHINGTON, D.C.) 2023; 5:0071. [PMID: 37519936 PMCID: PMC10380542 DOI: 10.34133/plantphenomics.0071] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/04/2023] [Accepted: 06/26/2023] [Indexed: 08/01/2023]
Abstract
Currently, the presence of genetically modified (GM) organisms in agro-food markets is strictly regulated by enacted legislation worldwide. It is essential to ensure the traceability of these transgenic products for food safety, consumer choice, environmental monitoring, market integrity, and scientific research. However, detecting the existence of GM organisms involves a combination of complex, time-consuming, and labor-intensive techniques requiring high-level professional skills. In this paper, a concise and rapid pipeline method to identify transgenic rice seeds was proposed on the basis of spectral imaging technologies and the deep learning approach. The composition of metabolome across 3 rice seed lines containing the cry1Ab/cry1Ac gene was compared and studied, substantiating the intrinsic variability induced by these GM traits. Results showed that near-infrared and terahertz spectra from different genotypes could reveal the regularity of GM metabolic variation. The established cascade deep learning model divided GM discrimination into 2 phases including variety classification and GM status identification. It could be found that terahertz absorption spectra contained more valuable features and achieved the highest accuracy of 97.04% for variety classification and 99.71% for GM status identification. Moreover, a modified guided backpropagation algorithm was proposed to select the task-specific characteristic wavelengths for further reducing the redundancy of the original spectra. The experimental validation of the cascade discriminant method in conjunction with spectroscopy confirmed its viability, simplicity, and effectiveness as a valuable tool for the detection of GM rice seeds. This approach also demonstrated its great potential in distilling crucial features for expedited transgenic risk assessment.
Collapse
Affiliation(s)
- Jinnuo Zhang
- Department of Agricultural and Biological Engineering,
Purdue University, West Lafayette, IN 47907, USA
| | - Xuping Feng
- College of Biosystems Engineering and Food Science,
Zhejiang University, Hangzhou, China
| | - Jian Jin
- Department of Agricultural and Biological Engineering,
Purdue University, West Lafayette, IN 47907, USA
| | - Hui Fang
- College of Biosystems Engineering and Food Science,
Zhejiang University, Hangzhou, China
- Huzhou Institute of Zhejiang University, Huzhou, China
| |
Collapse
|
5
|
Kashyap M, Torniainen J, Bertling K, Kundu U, Singh K, Donose BC, Gillespie T, Lim YL, Indjin D, Li L, Linfield EH, Davies AG, Dean P, Smith M, Chapman S, Bandyopadhyay A, Sengupta A, Rakić AD. Coherent terahertz laser feedback interferometry for hydration sensing in leaves. OPTICS EXPRESS 2023; 31:23877-23888. [PMID: 37475228 DOI: 10.1364/oe.490217] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/21/2023] [Accepted: 06/08/2023] [Indexed: 07/22/2023]
Abstract
The response of terahertz to the presence of water content makes it an ideal analytical tool for hydration monitoring in agricultural applications. This study reports on the feasibility of terahertz sensing for monitoring the hydration level of freshly harvested leaves of Celtis sinensis by employing a imaging platform based on quantum cascade lasers and laser feedback interferometry. The imaging platform produces wide angle high resolution terahertz amplitude and phase images of the leaves at high frame rates allowing monitoring of dynamic water transport and other changes across the whole leaf. The complementary information in the resulting images was fed to a machine learning model aiming to predict relative water content from a single frame. The model was used to predict the change in hydration level over time. Results of the study suggest that the technique could have substantial potential in agricultural applications.
Collapse
|
6
|
Liu Y, Pu H, Li Q, Sun DW. Discrimination of Pericarpium Citri Reticulatae in different years using Terahertz Time-Domain spectroscopy combined with convolutional neural network. SPECTROCHIMICA ACTA. PART A, MOLECULAR AND BIOMOLECULAR SPECTROSCOPY 2023; 286:122035. [PMID: 36332396 DOI: 10.1016/j.saa.2022.122035] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/07/2022] [Revised: 09/27/2022] [Accepted: 10/19/2022] [Indexed: 06/16/2023]
Abstract
Pericarpium Citri Reticulatae (PCR) in longer storage years possess higher medicinal values, but their differentiation is difficult due to similar morphological characteristics. Therefore, this study investigated the feasibility of using terahertz time-domain spectroscopy (THz-TDS) combined with a convolutional neural network (CNN) to identify PCR samples stored from 1 to 20 years. The absorption coefficient and refractive index spectra in the range of 0.2-1.5 THz were acquired. Partial least squares discriminant analysis, random forest, least squares support vector machines, and CNN were used to establish discriminant models, showing better performance of the CNN model than the others. In addition, the output data points of the CNN intermediate layer were visualized, illustrating gradual changes in these points from overlapping to clear separation. Overall, THz-TDS combined with CNN models could realize rapid identification of different year PCRs, thus providing an efficient alternative method for PCR quality inspection.
Collapse
Affiliation(s)
- Yao Liu
- School of Mechanical and Electrical Engineering, Zhongkai University of Agriculture and Engineering, Guangzhou 510225, China
| | - Hongbin Pu
- School of Food Science and Engineering, South China University of Technology, Guangzhou 510641, China; Academy of Contemporary Food Engineering, South China University of Technology, Guangzhou Higher Education Mega Center, Guangzhou 510006, China; Engineering and Technological Research Centre of Guangdong Province on Intelligent Sensing and Process Control of Cold Chain Foods, & Guangdong Province Engineering Laboratory for Intelligent Cold Chain Logistics (e) Equipment for Agricultural Products, Guangzhou Higher Education Mega Centre, Guangzhou 510006, China
| | - Qian Li
- Shenzhen Institute of Terahertz Technology and Innovation, Shenzhen, Guangdong 518102, China
| | - Da-Wen Sun
- School of Food Science and Engineering, South China University of Technology, Guangzhou 510641, China; Academy of Contemporary Food Engineering, South China University of Technology, Guangzhou Higher Education Mega Center, Guangzhou 510006, China; Engineering and Technological Research Centre of Guangdong Province on Intelligent Sensing and Process Control of Cold Chain Foods, & Guangdong Province Engineering Laboratory for Intelligent Cold Chain Logistics (e) Equipment for Agricultural Products, Guangzhou Higher Education Mega Centre, Guangzhou 510006, China; Food Refrigeration and Computerized Food Technology, University College Dublin, National University of Ireland, Agriculture and Food Science Centre, Belfield, Dublin 4, Ireland.
| |
Collapse
|
7
|
Xu P, Sun W, Xu K, Zhang Y, Tan Q, Qing Y, Yang R. Identification of Defective Maize Seeds Using Hyperspectral Imaging Combined with Deep Learning. Foods 2022; 12:foods12010144. [PMID: 36613360 PMCID: PMC9818215 DOI: 10.3390/foods12010144] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2022] [Revised: 12/22/2022] [Accepted: 12/23/2022] [Indexed: 12/29/2022] Open
Abstract
Seed quality affects crop yield and the quality of agricultural products, and traditional identification methods are time-consuming, complex, and irreversibly destructive. This study aims to establish a fast, non-destructive, and effective approach for defect detection in maize seeds based on hyperspectral imaging (HSI) technology combined with deep learning. Raw spectra collected from maize seeds (200 each healthy and worm-eaten) were pre-processed using detrending (DE) and multiple scattering correction (MSC) to highlight the spectral differences between samples. A convolutional neural network architecture (CNN-FES) based on a feature selection mechanism was proposed according to the importance of wavelength in the target classification task. The results show that the subset of 24 feature wavelengths selected by the proposed CNN-FES can capture important feature information in the spectral data more effectively than the conventional successive projections algorithm (SPA) and competitive adaptive reweighted sampling (CARS) algorithms. In addition, a convolutional neural network architecture (CNN-ATM) based on an attentional classification mechanism was designed for one-dimensional spectral data classification and compared with three commonly used machine learning methods, linear discriminant analysis (LDA), random forest (RF), and support vector machine (SVM). The results show that the classification performance of the designed CNN-ATM on the full wavelength does not differ much from the above three methods, and the classification accuracy is above 90% on both the training and test sets. Meanwhile, the accuracy, sensitivity, and specificity of CNN-ATM based on feature wavelength modeling can reach up to 97.50%, 98.28%, and 96.77% at the highest, respectively. The study shows that hyperspectral imaging-based defect detection of maize seed is feasible and effective, and the proposed method has great potential for the processing and analysis of complex hyperspectral data.
Collapse
Affiliation(s)
- Peng Xu
- College of Information and Communication Engineering, Hainan University, Haikou 570228, China
| | - Wenbin Sun
- College of Information and Communication Engineering, Hainan University, Haikou 570228, China
| | - Kang Xu
- College of Information and Communication Engineering, Hainan University, Haikou 570228, China
| | - Yunpeng Zhang
- College of Mechanical and Electrical Engineering, Hainan University, Haikou 570228, China
| | - Qian Tan
- College of Mechanical and Electrical Engineering, Hainan University, Haikou 570228, China
| | - Yiren Qing
- College of Mechanical and Electrical Engineering, Hainan University, Haikou 570228, China
| | - Ranbing Yang
- College of Mechanical and Electrical Engineering, Hainan University, Haikou 570228, China
- Correspondence: ; Tel.: +86-0898-66267576
| |
Collapse
|
8
|
Fu J, Liu J, Zhao R, Chen Z, Qiao Y, Li D. Maize disease detection based on spectral recovery from RGB images. FRONTIERS IN PLANT SCIENCE 2022; 13:1056842. [PMID: 36618618 PMCID: PMC9811593 DOI: 10.3389/fpls.2022.1056842] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/29/2022] [Accepted: 11/23/2022] [Indexed: 06/17/2023]
Abstract
Maize is susceptible to infect pest disease, and early disease detection is key to preventing the reduction of maize yields. The raw data used for plant disease detection are commonly RGB images and hyperspectral images (HSI). RGB images can be acquired rapidly and low-costly, but the detection accuracy is not satisfactory. On the contrary, using HSIs tends to obtain higher detection accuracy, but HSIs are difficult and high-cost to obtain in field. To overcome this contradiction, we have proposed the maize spectral recovery disease detection framework which includes two parts: the maize spectral recovery network based on the advanced hyperspectral recovery convolutional neural network (HSCNN+) and the maize disease detection network based on the convolutional neural network (CNN). Taking raw RGB data as input of the framework, the output reconstructed HSIs are used as input of disease detection network to achieve disease detection task. As a result, the detection accuracy obtained by using the low-cost raw RGB data almost as same as that obtained by using HSIs directly. The HSCNN+ is found to be fit to our spectral recovery model and the reconstruction fidelity was satisfactory. Experimental results demonstrate that the reconstructed HSIs efficiently improve detection accuracy compared with raw RGB image in tested scenarios, especially in complex environment scenario, for which the detection accuracy increases by 6.14%. The proposed framework has the advantages of fast, low cost and high detection precision. Moreover, the framework offers the possibility of real-time and precise field disease detection and can be applied in agricultural robots.
Collapse
Affiliation(s)
- Jun Fu
- College of Biological and Agricultural Engineering, Jilin University, Changchun, China
- Key Laboratory of Efficient Sowing and Harvesting Equipment, Ministry of Agriculture and Rural Affairs, Jilin University, Changchun, China
- Key Laboratory of Bionic Engineering, Ministry of Education, Jilin University, Changchun, China
| | - Jindai Liu
- College of Biological and Agricultural Engineering, Jilin University, Changchun, China
- Key Laboratory of Efficient Sowing and Harvesting Equipment, Ministry of Agriculture and Rural Affairs, Jilin University, Changchun, China
| | - Rongqiang Zhao
- College of Biological and Agricultural Engineering, Jilin University, Changchun, China
- Key Laboratory of Efficient Sowing and Harvesting Equipment, Ministry of Agriculture and Rural Affairs, Jilin University, Changchun, China
| | - Zhi Chen
- College of Biological and Agricultural Engineering, Jilin University, Changchun, China
- Department of Science and Technology Development, Chinese Academy of Agricultural Mechanization Sciences, Beijing, China
| | - Yongliang Qiao
- Australian Centre for Field Robotics (ACFR), Faculty of Engineering, The University of Sydney, Sydney, NSW, Australia
| | - Dan Li
- College of Astronautics, Nanjing University of Aeronautics and Astronautics, Nanjing, China
| |
Collapse
|
9
|
Xiao Q, Wu N, Tang W, Zhang C, Feng L, Zhou L, Shen J, Zhang Z, Gao P, He Y. Visible and near-infrared spectroscopy and deep learning application for the qualitative and quantitative investigation of nitrogen status in cotton leaves. FRONTIERS IN PLANT SCIENCE 2022; 13:1080745. [PMID: 36643292 PMCID: PMC9834998 DOI: 10.3389/fpls.2022.1080745] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/26/2022] [Accepted: 11/24/2022] [Indexed: 06/17/2023]
Abstract
Leaf nitrogen concentration (LNC) is a critical indicator of crop nutrient status. In this study, the feasibility of using visible and near-infrared spectroscopy combined with deep learning to estimate LNC in cotton leaves was explored. The samples were collected from cotton's whole growth cycle, and the spectra were from different measurement environments. The random frog (RF), weighted partial least squares regression (WPLS), and saliency map were used for characteristic wavelength selection. Qualitative models (partial least squares discriminant analysis (PLS-DA), support vector machine for classification (SVC), convolutional neural network classification (CNNC) and quantitative models (partial least squares regression (PLSR), support vector machine for regression (SVR), convolutional neural network regression (CNNR)) were established based on the full spectra and characteristic wavelengths. Satisfactory results were obtained by models based on CNN. The classification accuracy of leaves in three different LNC ranges was up to 83.34%, and the root mean square error of prediction (RMSEP) of quantitative prediction models of cotton leaves was as low as 3.36. In addition, the identification of cotton leaves based on the predicted LNC also achieved good results. These results indicated that the nitrogen content of cotton leaves could be effectively detected by deep learning and visible and near-infrared spectroscopy, which has great potential for real-world application.
Collapse
Affiliation(s)
- Qinlin Xiao
- College of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou, China
- Key Laboratory of Spectroscopy Sensing, Ministry of Agriculture and Rural Affairs, Hangzhou, China
| | - Na Wu
- School of Information and Electronic Engineering, Zhejiang University of Science and Technology, Huzhou, China
| | - Wentan Tang
- College of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou, China
- Key Laboratory of Spectroscopy Sensing, Ministry of Agriculture and Rural Affairs, Hangzhou, China
| | - Chu Zhang
- School of Information Engineering, Huzhou University, Huzhou, China
| | - Lei Feng
- College of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou, China
- Key Laboratory of Spectroscopy Sensing, Ministry of Agriculture and Rural Affairs, Hangzhou, China
| | - Lei Zhou
- College of Mechanical and Electronic Engineering, Nanjing Forestry University, Nanjing, China
| | | | - Ze Zhang
- Key Laboratory of Oasis Eco-Agriculture, College of Agriculture, Shihezi University, Shihezi, China
| | - Pan Gao
- College of Information Science and Technology, Shihezi University, Shihezi, China
| | - Yong He
- College of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou, China
- Key Laboratory of Spectroscopy Sensing, Ministry of Agriculture and Rural Affairs, Hangzhou, China
| |
Collapse
|
10
|
Lin Y, Ma J, Wang Q, Sun DW. Applications of machine learning techniques for enhancing nondestructive food quality and safety detection. Crit Rev Food Sci Nutr 2022; 63:1649-1669. [PMID: 36222697 DOI: 10.1080/10408398.2022.2131725] [Citation(s) in RCA: 27] [Impact Index Per Article: 13.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022]
Abstract
In considering the need of people all over the world for high-quality food, there has been a recent increase in interest in the role of nondestructive and rapid detection technologies in the food industry. Moreover, the analysis of data acquired by most nondestructive technologies is complex, time-consuming, and requires highly skilled operators. Meanwhile, the general applicability of various chemometric or statistical methods is affected by noise, sample, variability, and data complexity that vary under various testing conditions. Nowadays, machine learning (ML) techniques have a wide range of applications in the food industry, especially in nondestructive technology and equipment intelligence, due to their powerful ability in handling irrelevant information, extracting feature variables, and building calibration models. The review provides an introduction and comparison of machine learning techniques, and summarizes these algorithms as traditional machine learning (TML), and deep learning (DL). Moreover, several novel nondestructive technologies, namely acoustic analysis, machine vision (MV), electronic nose (E-nose), and spectral imaging, combined with different advanced ML techniques and their applications in food quality assessment such as variety identification and classification, safety inspection and processing control, are presented. In addition to this, the existing challenges and prospects are discussed. The result of this review indicates that nondestructive testing technologies combined with state-of-the-art machine learning techniques show great potential for monitoring the quality and safety of food products and different machine learning algorithms have their characteristics and applicability scenarios. Due to the nature of feature learning, DL is one of the most promising and powerful techniques for real-time applications, which needs further research for full and wide applications in the food industry.
Collapse
Affiliation(s)
- Yuandong Lin
- School of Food Science and Engineering, South China University of Technology, Guangzhou 510641, China.,Academy of Contemporary Food Engineering, Guangzhou Higher Education Mega Centre, South China University of Technology, Guangzhou 510006, China.,Engineering and Technological Research Centre of Guangdong Province on Intelligent Sensing and Process Control of Cold Chain Foods, & Guangdong Province Engineering Laboratory for Intelligent Cold Chain Logistics Equipment for Agricultural Products, Guangzhou Higher Education Mega Centre, Guangzhou 510006, China
| | - Ji Ma
- School of Food Science and Engineering, South China University of Technology, Guangzhou 510641, China.,Academy of Contemporary Food Engineering, Guangzhou Higher Education Mega Centre, South China University of Technology, Guangzhou 510006, China.,Engineering and Technological Research Centre of Guangdong Province on Intelligent Sensing and Process Control of Cold Chain Foods, & Guangdong Province Engineering Laboratory for Intelligent Cold Chain Logistics Equipment for Agricultural Products, Guangzhou Higher Education Mega Centre, Guangzhou 510006, China.,State Key Laboratory of Luminescent Materials and Devices, Center for Aggregation-Induced Emission, South China University of Technology, Guangzhou 510641, China
| | - Qijun Wang
- School of Food Science and Engineering, South China University of Technology, Guangzhou 510641, China.,Academy of Contemporary Food Engineering, Guangzhou Higher Education Mega Centre, South China University of Technology, Guangzhou 510006, China.,Engineering and Technological Research Centre of Guangdong Province on Intelligent Sensing and Process Control of Cold Chain Foods, & Guangdong Province Engineering Laboratory for Intelligent Cold Chain Logistics Equipment for Agricultural Products, Guangzhou Higher Education Mega Centre, Guangzhou 510006, China
| | - Da-Wen Sun
- School of Food Science and Engineering, South China University of Technology, Guangzhou 510641, China.,Academy of Contemporary Food Engineering, Guangzhou Higher Education Mega Centre, South China University of Technology, Guangzhou 510006, China.,Engineering and Technological Research Centre of Guangdong Province on Intelligent Sensing and Process Control of Cold Chain Foods, & Guangdong Province Engineering Laboratory for Intelligent Cold Chain Logistics Equipment for Agricultural Products, Guangzhou Higher Education Mega Centre, Guangzhou 510006, China.,Food Refrigeration and Computerized Food Technology (FRCFT), Agriculture and Food Science Centre, University College Dublin, National University of Ireland, Dublin 4, Ireland
| |
Collapse
|
11
|
Zhao S, Zhang Y, Qiu Z, He Y, Zhang Y. Towards a fast and generalized microplastic quantification method in soil using terahertz spectroscopy. THE SCIENCE OF THE TOTAL ENVIRONMENT 2022; 841:156624. [PMID: 35697211 DOI: 10.1016/j.scitotenv.2022.156624] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/08/2022] [Revised: 05/31/2022] [Accepted: 06/07/2022] [Indexed: 06/15/2023]
Abstract
Extensive investigation of microplastic abundance in soil environment calls for rapid, accurate, efficient and harmonized quantification methods. Development of rapid quantification method requires made-to-measure soil samples with additions of standard polymers. Existing rapid quantification methods ignore the gap between standard polymers in laboratory and household microplastics in soil environment. Here, terahertz (0.6-1.67 thz) and NIR (950-1660 nm) spectroscopy were compared to explore a fast, accurate and potentially generalizable microplastic quantification method in soil. Soil sample was spiked with two standard polymers (polyvinyl chloride (PVC) and polystyrene (PS)) and their additive-containing household microplastics. Two standard sample sets and two household sample sets were prepared in concentrations ranging from 0.5 to 10%. Nine commonly used preprocessing methods and three machine learning algorithms were coupled to develop methods. Models were constructed by training sets from standard sample sets. When models transferred to household samples, prediction error (RMSE) of proposed terahertz method (Wdenosie_PLSR) only increased by 0.4% for PVC and 0.19% for PS, yet that of the NIR method increased by 1.49% and 1.16% respectively. The proposed terahertz method presented a detection limit around 1.12% and the NIR method showed a detection limit around 3.24%. Overall, our results suggest that compared with NIR method, the proposed terahertz method is not only more accurate but also demonstrate stronger generalizability to bridge the gaps between standard PVC/PS polymers and household PVC/PS microplastics. We also propose MMD heatmap for diagnosing spectral preprocessing methods to further improve method efficiency.
Collapse
Affiliation(s)
- Shutao Zhao
- Zhejiang University, Hangzhou, Zhejiang Province 310058, China; Key Laboratory of Coastal Environment and Resources of Zhejiang Province, School of Engineering, Westlake University, Hangzhou, Zhejiang Province 310024, China
| | - Yahui Zhang
- Zhejiang University, Hangzhou, Zhejiang Province 310058, China
| | - Zhengjun Qiu
- Zhejiang University, Hangzhou, Zhejiang Province 310058, China
| | - Yong He
- Zhejiang University, Hangzhou, Zhejiang Province 310058, China
| | - Yuzhong Zhang
- Key Laboratory of Coastal Environment and Resources of Zhejiang Province, School of Engineering, Westlake University, Hangzhou, Zhejiang Province 310024, China; Institute of Advanced Technology, Westlake Institute for Advanced Study, Hangzhou 310024, Zhejiang Province, China.
| |
Collapse
|
12
|
Xiao Q, Tang W, Zhang C, Zhou L, Feng L, Shen J, Yan T, Gao P, He Y, Wu N. Spectral Preprocessing Combined with Deep Transfer Learning to Evaluate Chlorophyll Content in Cotton Leaves. PLANT PHENOMICS 2022; 2022:9813841. [PMID: 36158530 PMCID: PMC9489230 DOI: 10.34133/2022/9813841] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/08/2022] [Accepted: 06/27/2022] [Indexed: 11/16/2022]
Abstract
Rapid determination of chlorophyll content is significant for evaluating cotton's nutritional and physiological status. Hyperspectral technology equipped with multivariate analysis methods has been widely used for chlorophyll content detection. However, the model developed on one batch or variety cannot produce the same effect for another due to variations, such as samples and measurement conditions. Considering that it is costly to establish models for each batch or variety, the feasibility of using spectral preprocessing combined with deep transfer learning for model transfer was explored. Seven different spectral preprocessing methods were discussed, and a self-designed convolutional neural network (CNN) was developed to build models and conduct transfer tasks by fine-tuning. The approach combined first-derivative (FD) and standard normal variate transformation (SNV) was chosen as the best pretreatment. For the dataset of the target domain, fine-tuned CNN based on spectra processed by FD + SNV outperformed conventional partial least squares (PLS) and squares-support vector machine regression (SVR). Although the performance of fine-tuned CNN with a smaller dataset was slightly lower, it was still better than conventional models and achieved satisfactory results. Ensemble preprocessing combined with deep transfer learning could be an effective approach to estimate the chlorophyll content between different cotton varieties, offering a new possibility for evaluating the nutritional status of cotton in the field.
Collapse
Affiliation(s)
- Qinlin Xiao
- College of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou 310058, China
- Key Laboratory of Spectroscopy Sensing, Ministry of Agriculture and Rural Affairs, Hangzhou 310058, China
| | - Wentan Tang
- College of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou 310058, China
- Key Laboratory of Spectroscopy Sensing, Ministry of Agriculture and Rural Affairs, Hangzhou 310058, China
| | - Chu Zhang
- School of Information Engineering, Huzhou University, Huzhou 313000, China
| | - Lei Zhou
- College of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou 310058, China
- Key Laboratory of Spectroscopy Sensing, Ministry of Agriculture and Rural Affairs, Hangzhou 310058, China
- College of Mechanical and Electronic Engineering, Nanjing Forestry University, Nanjing 210037, China
| | - Lei Feng
- College of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou 310058, China
- Key Laboratory of Spectroscopy Sensing, Ministry of Agriculture and Rural Affairs, Hangzhou 310058, China
| | - Jianxun Shen
- Hangzhou Raw Seed Growing Farm, Hangzhou 311115, China
| | - Tianying Yan
- College of Information Science and Technology, Shihezi University, Shihezi 832000, China
| | - Pan Gao
- College of Information Science and Technology, Shihezi University, Shihezi 832000, China
| | - Yong He
- College of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou 310058, China
- Key Laboratory of Spectroscopy Sensing, Ministry of Agriculture and Rural Affairs, Hangzhou 310058, China
| | - Na Wu
- College of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou 310058, China
- Key Laboratory of Spectroscopy Sensing, Ministry of Agriculture and Rural Affairs, Hangzhou 310058, China
| |
Collapse
|
13
|
Tao M, He Y, Bai X, Chen X, Wei Y, Peng C, Feng X. Combination of spectral index and transfer learning strategy for glyphosate-resistant cultivar identification. FRONTIERS IN PLANT SCIENCE 2022; 13:973745. [PMID: 36003818 PMCID: PMC9393615 DOI: 10.3389/fpls.2022.973745] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/21/2022] [Accepted: 07/22/2022] [Indexed: 06/15/2023]
Abstract
Glyphosate is one of the most widely used non-selective herbicides, and the creation of glyphosate-resistant cultivars solves the problem of limited spraying area. Therefore, it is of great significance to quickly identify resistant cultivars without destruction during the development of superior cultivars. This work took maize seedlings as the experimental object, and the spectral indices of leaves were calculated to construct a model with good robustness that could be used in different experiments. Compared with no transfer strategies, transferability of support vector machine learning model was improved by randomly selecting 14% of source domain from target domain to train and applying transfer component analysis algorithm, the accuracy on target domain reached 83% (increased by 71%), recall increased from 10 to 100%, and F1-score increased from 0.17 to 0.86. The overall results showed that both transfer component analysis algorithm and updating source domain could improve the transferability of model among experiments, and these two transfer strategies could complement each other's advantages to achieve the best classification performance. Therefore, this work is beneficial to timely understanding of the physiological status of plants, identifying glyphosate resistant cultivars, and ultimately provides theoretical basis and technical support for new cultivar creation and high-throughput selection.
Collapse
Affiliation(s)
- Mingzhu Tao
- College of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou, China
| | - Yong He
- College of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou, China
| | - Xiulin Bai
- College of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou, China
| | - Xiaoyun Chen
- Key Laboratory of Traceability for Agricultural Genetically Modified Organisms, Ministry of Agriculture and Rural Affairs, Zhejiang Academy of Agricultural Sciences, Hangzhou, China
| | - Yuzhen Wei
- School of Information Engineering, Huzhou University, Huzhou, China
| | - Cheng Peng
- Key Laboratory of Traceability for Agricultural Genetically Modified Organisms, Ministry of Agriculture and Rural Affairs, Zhejiang Academy of Agricultural Sciences, Hangzhou, China
| | - Xuping Feng
- College of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou, China
| |
Collapse
|
14
|
Cao Y, Yuan P, Xu H, Martínez-Ortega JF, Feng J, Zhai Z. Detecting Asymptomatic Infections of Rice Bacterial Leaf Blight Using Hyperspectral Imaging and 3-Dimensional Convolutional Neural Network With Spectral Dilated Convolution. FRONTIERS IN PLANT SCIENCE 2022; 13:963170. [PMID: 35909723 PMCID: PMC9328758 DOI: 10.3389/fpls.2022.963170] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/07/2022] [Accepted: 06/22/2022] [Indexed: 06/15/2023]
Abstract
Rice is one of the most important food crops for human beings. Its total production ranks third in the grain crop output. Bacterial Leaf Blight (BLB), as one of the three major diseases of rice, occurs every year, posing a huge threat to rice production and safety. There is an asymptomatic period between the infection and the onset periods, and BLB will spread rapidly and widely under suitable conditions. Therefore, accurate detection of early asymptomatic BLB is very necessary. The purpose of this study was to test the feasibility of detecting early asymptomatic infection of the rice BLB disease based on hyperspectral imaging and Spectral Dilated Convolution 3-Dimensional Convolutional Neural Network (SDC-3DCNN). First, hyperspectral images were obtained from rice leaves infected with the BLB disease at the tillering stage. The spectrum was smoothed by the Savitzky-Golay (SG) method, and the wavelength between 450 and 950 nm was intercepted for analysis. Then Principal Component Analysis (PCA) and Random Forest (RF) were used to extract the feature information from the original spectra as inputs. The overall performance of the SDC-3DCNN model with different numbers of input features and different spectral dilated ratios was evaluated. Lastly, the saliency map visualization was used to explain the sensitivity of individual wavelengths. The results showed that the performance of the SDC-3DCNN model reached an accuracy of 95.4427% when the number of inputs is 50 characteristic wavelengths (extracted by RF) and the dilated ratio is set at 5. The saliency-sensitive wavelengths were identified in the range from 530 to 570 nm, which overlaps with the important wavelengths extracted by RF. According to our findings, combining hyperspectral imaging and deep learning can be a reliable approach for identifying early asymptomatic infection of the rice BLB disease, providing sufficient support for early warning and rice disease prevention.
Collapse
Affiliation(s)
- Yifei Cao
- College of Artificial Intelligence, Nanjing Agricultural University, Nanjing, China
- College of Engineering, Nanjing Agricultural University, Nanjing, China
| | - Peisen Yuan
- College of Artificial Intelligence, Nanjing Agricultural University, Nanjing, China
| | - Huanliang Xu
- College of Artificial Intelligence, Nanjing Agricultural University, Nanjing, China
| | - José Fernán Martínez-Ortega
- Departamento de Ingeniería Telemática y Electrónica (DTE), Escuela Técnica Superior de Ingeniería y Sistemas de Telecomunicación, Universidad Politécnica de Madrid (UPM), Madrid, Spain
| | - Jiarui Feng
- College of Artificial Intelligence, Nanjing Agricultural University, Nanjing, China
- College of Engineering, Nanjing Agricultural University, Nanjing, China
| | - Zhaoyu Zhai
- College of Artificial Intelligence, Nanjing Agricultural University, Nanjing, China
| |
Collapse
|
15
|
Wang Z, Huang W, Tian X, Long Y, Li L, Fan S. Rapid and Non-destructive Classification of New and Aged Maize Seeds Using Hyperspectral Image and Chemometric Methods. FRONTIERS IN PLANT SCIENCE 2022; 13:849495. [PMID: 35620676 PMCID: PMC9127793 DOI: 10.3389/fpls.2022.849495] [Citation(s) in RCA: 15] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/06/2022] [Accepted: 04/05/2022] [Indexed: 06/15/2023]
Abstract
The aged seeds have a significant influence on seed vigor and corn growth. Therefore, it is vital for the planting industry to identify aged seeds. In this study, hyperspectral reflectance imaging (1,000-2,000 nm) was employed for identifying aged maize seeds using seeds harvested in different years. The average spectra of the embryo side, endosperm side, and both sides were extracted. The support vector machine (SVM) algorithm was used to develop classification models based on full spectra to evaluate the potential of hyperspectral imaging for maize seed detection and using the principal component analysis (PCA) and ANOVA to reduce data dimensionality and extract feature wavelengths. The classification models achieved perfect performance using full spectra with an accuracy of 100% for the prediction set. The performance of models established with the first three principal components was similar to full spectrum models, but that of PCA loading models was worse. Compared to other spectra, the two-band ratio (1,987 nm/1,079 nm) selected by ANOVA from embryo-side spectra achieved a better classification accuracy of 95% for the prediction set. The image texture features, including histogram statistics (HS) and gray-level co-occurrence matrix (GLCM), were extracted from the two-band ratio image to establish fusion models. The results demonstrated that the two-band ratio selected from embryo-side spectra combined with image texture features achieved the classification of maize seeds harvested in different years with an accuracy of 97.5% for the prediction set. The overall results indicated that combining the two wavelengths with image texture features could detect aged maize seeds effectively. The proposed method was conducive to the development of multi-spectral detection equipment.
Collapse
Affiliation(s)
- Zheli Wang
- Intelligent Equipment Research Center, Beijing Academy of Agriculture and Forestry Sciences, Beijing, China
- College of Information and Electrical Engineering, China Agricultural University, Beijing, China
| | - Wenqian Huang
- Intelligent Equipment Research Center, Beijing Academy of Agriculture and Forestry Sciences, Beijing, China
| | - Xi Tian
- Intelligent Equipment Research Center, Beijing Academy of Agriculture and Forestry Sciences, Beijing, China
| | - Yuan Long
- Intelligent Equipment Research Center, Beijing Academy of Agriculture and Forestry Sciences, Beijing, China
| | - Lianjie Li
- Intelligent Equipment Research Center, Beijing Academy of Agriculture and Forestry Sciences, Beijing, China
| | - Shuxiang Fan
- Intelligent Equipment Research Center, Beijing Academy of Agriculture and Forestry Sciences, Beijing, China
| |
Collapse
|
16
|
Lei T, Li Q, Sun DW. A dual AE-GAN guided THz spectral dehulling model for mapping energy and moisture distribution on sunflower seed kernels. Food Chem 2021; 380:131971. [PMID: 35078691 DOI: 10.1016/j.foodchem.2021.131971] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2021] [Revised: 12/21/2021] [Accepted: 12/27/2021] [Indexed: 01/24/2023]
Abstract
Energy and moisture contents are important food chemical attributes. In the current study, a nondestructive Terahertz (THz) time-domain imaging system was first time used for evaluating the energy and moisture distributions of sunflower seed kernels inside shells. For this task, a dual autoencoders (AE)-generative adversarial nets (GAN) spectral dehulling semi-supervised model was developed. The model could automatically learn the kernel information from the latent representations of the spectra of the intact seeds through adversarial learning to achieve feature disentanglement. Results indicated that the generated kernel images had similar features to the original kernel images and high-quality chemical distribution maps for energy and moisture contents of sunflower seed kernels inside shells were successfully obtained. As the current method took the advantage of the characteristics of THz imaging and selected a suitable deep learning algorithm, it has the potential to generalize for imaging other chemical substances of other dry shelled seeds or biological samples (moisture content and thickness below 15% and 5 mm, respectively).
Collapse
Affiliation(s)
- Tong Lei
- Food Refrigeration and Computerized Food Technology (FRCFT), Agriculture and Food Science Centre, University College Dublin, National University of Ireland, Belfield, Dublin 4, Ireland
| | - Qingxia Li
- Food Refrigeration and Computerized Food Technology (FRCFT), Agriculture and Food Science Centre, University College Dublin, National University of Ireland, Belfield, Dublin 4, Ireland
| | - Da-Wen Sun
- Food Refrigeration and Computerized Food Technology (FRCFT), Agriculture and Food Science Centre, University College Dublin, National University of Ireland, Belfield, Dublin 4, Ireland.
| |
Collapse
|
17
|
Li X, Kong W, Liu X, Zhang X, Wang W, Chen R, Sun Y, Liu F. Application of Laser-Induced Breakdown Spectroscopy Coupled With Spectral Matrix and Convolutional Neural Network for Identifying Geographical Origins of Gentiana rigescens Franch. Front Artif Intell 2021; 4:735533. [PMID: 34957390 PMCID: PMC8703168 DOI: 10.3389/frai.2021.735533] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2021] [Accepted: 11/22/2021] [Indexed: 11/13/2022] Open
Abstract
Accurate geographical origin identification is of great significance to ensure the quality of traditional Chinese medicine (TCM). Laser-induced breakdown spectroscopy (LIBS) was applied to achieve the fast geographical origin identification of wild Gentiana rigescens Franch (G. rigescens Franch). However, LIBS spectra with too many variables could increase the training time of models and reduce the discrimination accuracy. In order to solve the problems, we proposed two methods. One was reducing the number of variables through two consecutive variable selections. The other was transforming the spectrum into spectral matrix by spectrum segmentation and recombination. Combined with convolutional neural network (CNN), both methods could improve the accuracy of discrimination. For the underground parts of G. rigescens Franch, the optimal accuracy in the prediction set for the two methods was 92.19 and 94.01%, respectively. For the aerial parts, the two corresponding accuracies were the same with the value of 94.01%. Saliency map was used to explain the rationality of discriminant analysis by CNN combined with spectral matrix. The first method could provide some support for LIBS portable instrument development. The second method could offer some reference for the discriminant analysis of LIBS spectra with too many variables by the end-to-end learning of CNN. The present results demonstrated that LIBS combined with CNN was an effective tool to quickly identify the geographical origin of G. rigescens Franch.
Collapse
Affiliation(s)
- Xiaolong Li
- College of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou, China
| | - Wenwen Kong
- College of Mathematics and Computer Science, Zhejiang A&F University, Hangzhou, China
| | - Xiaoli Liu
- School of Chinese Materia Medica, Yunnan University of Chinese Medicine, Kunming, China.,Yunnan Provincial Key Laboratory of Molecular Biology for Sinomedicine, Kunming, China
| | - Xi Zhang
- School of Chinese Materia Medica, Yunnan University of Chinese Medicine, Kunming, China
| | - Wei Wang
- College of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou, China
| | - Rongqin Chen
- College of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou, China
| | - Yongqi Sun
- Hangzhou Landa Science and Technology Co., Ltd, Hangzhou, China
| | - Fei Liu
- College of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou, China.,Key Laboratory of Spectroscopy Sensing, Ministry of Agriculture and Rural Affairs, Hangzhou, China
| |
Collapse
|
18
|
Li X, He Z, Liu F, Chen R. Fast Identification of Soybean Seed Varieties Using Laser-Induced Breakdown Spectroscopy Combined With Convolutional Neural Network. FRONTIERS IN PLANT SCIENCE 2021; 12:714557. [PMID: 34691095 PMCID: PMC8527016 DOI: 10.3389/fpls.2021.714557] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/25/2021] [Accepted: 09/09/2021] [Indexed: 06/13/2023]
Abstract
Soybean seed purity is a critical factor in agricultural products, standardization of seed quality, and food processing. In this study, laser-induced breakdown spectroscopy (LIBS) as an effective technology was successfully used to identify ten varieties of soybean seeds. We improved the traditional sample preparation scheme for LIBS. Instead of grinding and squashing, we propose a time-efficient method by pressing soybean seeds into rubber sand filled with culture plates through a ruler to ensure a relatively uniform surface height. In our experimental scheme, three LIBS spectra were finally collected for each soybean seed. A majority vote based on three spectra was applied as the final decision judging the attribution of a single soybean seed. The results showed that the support vector machine (SVM) obtained the optimal identification accuracy of 90% in the prediction set. In addition, PCA-ResNet (propagation coefficient adaptive ResNet) and PCSA-ResNet (propagation coefficient synchronous adaptive ResNet) were designed based on typical ResNet structure by changing the way of self-adaption of propagation coefficients. Combined with a new form of input data called spectral matrix, PCSA-ResNet obtained the optimal performance with the discriminate accuracy of 91.75% in the prediction set. T-distributed stochastic neighbor embedding (t-SNE) was used to visualize the clustering process of the extracted features by PCSA-ResNet. For the interpretation of the good performance of PCSA-ResNet coupled with the spectral matrix, saliency maps were further applied to visually show the pixel positions of the spectral matrix that had a significant influence on the discrimination results, indicating that the content and proportion of elements in soybean seeds could reflect the variety differences.
Collapse
Affiliation(s)
- Xiaolong Li
- College of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou, China
| | - Zhenni He
- College of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou, China
| | - Fei Liu
- College of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou, China
- Huanan Industrial Technology Research Institute of Zhejiang University, Guangzhou, China
| | - Rongqin Chen
- College of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou, China
| |
Collapse
|
19
|
Wu N, Liu F, Meng F, Li M, Zhang C, He Y. Rapid and Accurate Varieties Classification of Different Crop Seeds Under Sample-Limited Condition Based on Hyperspectral Imaging and Deep Transfer Learning. Front Bioeng Biotechnol 2021; 9:696292. [PMID: 34368096 PMCID: PMC8343196 DOI: 10.3389/fbioe.2021.696292] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2021] [Accepted: 06/23/2021] [Indexed: 11/13/2022] Open
Abstract
Rapid varieties classification of crop seeds is significant for breeders to screen out seeds with specific traits and market regulators to detect seed purity. However, collecting high-quality, large-scale samples takes high costs in some cases, making it difficult to build an accurate classification model. This study aimed to explore a rapid and accurate method for varieties classification of different crop seeds under the sample-limited condition based on hyperspectral imaging (HSI) and deep transfer learning. Three deep neural networks with typical structures were designed based on a sample-rich Pea dataset. Obtained the highest accuracy of 99.57%, VGG-MODEL was transferred to classify four target datasets (rice, oat, wheat, and cotton) with limited samples. Accuracies of the deep transferred model achieved 95, 99, 80.8, and 83.86% on the four datasets, respectively. Using training sets with different sizes, the deep transferred model could always obtain higher performance than other traditional methods. The visualization of the deep features and classification results confirmed the portability of the shared features of seed spectra, providing an interpreted method for rapid and accurate varieties classification of crop seeds. The overall results showed great superiority of HSI combined with deep transfer learning for seed detection under sample-limited condition. This study provided a new idea for facilitating a crop germplasm screening process under the scenario of sample scarcity and the detection of other qualities of crop seeds under sample-limited condition based on HSI.
Collapse
Affiliation(s)
- Na Wu
- College of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou, China
| | - Fei Liu
- College of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou, China
| | - Fanjia Meng
- College of Information and Electrical Engineering, China Agricultural University, Beijing, China
| | - Mu Li
- Maize Research Institute, Jilin Academy of Agricultural Sciences, Gongzhuling, China
| | - Chu Zhang
- School of Information Engineering, Huzhou University, Huzhou, China
| | - Yong He
- College of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou, China
| |
Collapse
|
20
|
Efficient extraction of deep image features using convolutional neural network (CNN) for applications in detecting and analysing complex food matrices. Trends Food Sci Technol 2021. [DOI: 10.1016/j.tifs.2021.04.042] [Citation(s) in RCA: 32] [Impact Index Per Article: 10.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
21
|
Liu W, Zeng S, Wu G, Li H, Chen F. Rice Seed Purity Identification Technology Using Hyperspectral Image with LASSO Logistic Regression Model. SENSORS (BASEL, SWITZERLAND) 2021; 21:4384. [PMID: 34206783 PMCID: PMC8271842 DOI: 10.3390/s21134384] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/29/2021] [Revised: 06/22/2021] [Accepted: 06/24/2021] [Indexed: 11/25/2022]
Abstract
Hyperspectral technology is used to obtain spectral and spatial information of samples simultaneously and demonstrates significant potential for use in seed purity identification. However, it has certain limitations, such as high acquisition cost and massive redundant information. This study integrates the advantages of the sparse feature of the least absolute shrinkage and selection operator (LASSO) algorithm and the classification feature of the logistic regression model (LRM). We propose a hyperspectral rice seed purity identification method based on the LASSO logistic regression model (LLRM). The feasibility of using LLRM for the selection of feature wavelength bands and seed purity identification are discussed using four types of rice seeds as research objects. The results of 13 different adulteration cases revealed that the value of the regularisation parameter was different in each case. The recognition accuracy of LLRM and average recognition accuracy were 91.67-100% and 98.47%, respectively. Furthermore, the recognition accuracy of full-band LRM was 71.60-100%. However, the average recognition accuracy was merely 89.63%. These results indicate that LLRM can select the feature wavelength bands stably and improve the recognition accuracy of rice seeds, demonstrating the feasibility of developing a hyperspectral technology with LLRM for seed purity identification.
Collapse
Affiliation(s)
- Weihua Liu
- School of Electric & Electronic Engineering, Wuhan Polytechnic University, Wuhan 430023, China;
| | - Shan Zeng
- School of Mathematics & Computer Science, Wuhan Polytechnic University, Wuhan 430023, China; (H.L.); (F.C.)
| | - Guiju Wu
- The Key Laboratory of Earthquake Geodesy, Institute of Seismology, China Earthquake Administration, Wuhan 430023, China;
| | - Hao Li
- School of Mathematics & Computer Science, Wuhan Polytechnic University, Wuhan 430023, China; (H.L.); (F.C.)
| | - Feifei Chen
- School of Mathematics & Computer Science, Wuhan Polytechnic University, Wuhan 430023, China; (H.L.); (F.C.)
| |
Collapse
|
22
|
Khalili E, Kouchaki S, Ramazi S, Ghanati F. Machine Learning Techniques for Soybean Charcoal Rot Disease Prediction. FRONTIERS IN PLANT SCIENCE 2020; 11:590529. [PMID: 33381132 PMCID: PMC7767839 DOI: 10.3389/fpls.2020.590529] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/01/2020] [Accepted: 11/23/2020] [Indexed: 06/01/2023]
Abstract
Early prediction of pathogen infestation is a key factor to reduce the disease spread in plants. Macrophomina phaseolina (Tassi) Goid, as one of the main causes of charcoal rot disease, suppresses the plant productivity significantly. Charcoal rot disease is one of the most severe threats to soybean productivity. Prediction of this disease in soybeans is very tedious and non-practical using traditional approaches. Machine learning (ML) techniques have recently gained substantial traction across numerous domains. ML methods can be applied to detect plant diseases, prior to the full appearance of symptoms. In this paper, several ML techniques were developed and examined for prediction of charcoal rot disease in soybean for a cohort of 2,000 healthy and infected plants. A hybrid set of physiological and morphological features were suggested as inputs to the ML models. All developed ML models were performed better than 90% in terms of accuracy. Gradient Tree Boosting (GBT) was the best performing classifier which obtained 96.25% and 97.33% in terms of sensitivity and specificity. Our findings supported the applicability of ML especially GBT for charcoal rot disease prediction in a real environment. Moreover, our analysis demonstrated the importance of including physiological featured in the learning. The collected dataset and source code can be found in https://github.com/Elham-khalili/Soybean-Charcoal-Rot-Disease-Prediction-Dataset-code.
Collapse
Affiliation(s)
- Elham Khalili
- Department of Plant Science, Faculty of Science, Tarbiat Modarres University, Tehran, Iran
| | - Samaneh Kouchaki
- Faculty of Engineering and Physical Sciences, Centre for Vision, Speech, and Signal Processing, University of Surrey, Guildford, United Kingdom
| | - Shahin Ramazi
- Department of Biophysics, Faculty of Biological Science, Tarbiat Modares University, Tehran, Iran
| | - Faezeh Ghanati
- Department of Plant Science, Faculty of Science, Tarbiat Modarres University, Tehran, Iran
| |
Collapse
|
23
|
Yang Y, Chen J, He Y, Liu F, Feng X, Zhang J. Assessment of the vigor of rice seeds by near-infrared hyperspectral imaging combined with transfer learning. RSC Adv 2020; 10:44149-44158. [PMID: 35517156 PMCID: PMC9058448 DOI: 10.1039/d0ra06938h] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2020] [Accepted: 11/17/2020] [Indexed: 11/21/2022] Open
Abstract
Rice seed vigor plays a significant role in determining the quality and quantity of rice production. Thus, the quick and non-destructive identification of seed vigor is not only beneficial to fully obtain the state of rice seeds but also the intelligent development of agriculture by instant monitoring. Thus, herein, near-infrared hyperspectral imaging technology, as an information acquisition tool, was introduced combined with a deep learning algorithm to identify the rice seed vigor. Both the spectral images and average spectra of the rice seeds were sent to discriminant models including deep learning models and traditional machine learning models, and the highest accuracy of vigor identification reached 99.5018% using the self-built model. The parameters of the established deep learning models were frozen to be feature extractor for transfer learning. The identification results whose highest number also reached almost 98% indicated the possibility of applying transfer learning to improve the universality of the models. Moreover, by visualizing the output of convolutional layers, the progress and mechanism of spectral image feature extraction in the established deep learning model was explored. Overall, the self-built deep learning models combined with near-infrared hyperspectral images in the determination of rice seed vigor have potential to efficiently perform this task.
Collapse
Affiliation(s)
- Yong Yang
- State Key Laboratory for Managing Biotic and Chemical Treats to the Quality and Safety of Agro-products, Key Laboratory of Biotechnology for Plant Protection, Ministry of Agriculture, and Rural Affairs, Zhejiang Provincial Key Laboratory of Biotechnology for Plant Protection, Institute of Virology and Biotechnology, Zhejiang Academy of Agricultural Science Hangzhou China
| | - Jianping Chen
- State Key Laboratory for Managing Biotic and Chemical Treats to the Quality and Safety of Agro-products, Key Laboratory of Biotechnology for Plant Protection, Ministry of Agriculture, and Rural Affairs, Zhejiang Provincial Key Laboratory of Biotechnology for Plant Protection, Institute of Virology and Biotechnology, Zhejiang Academy of Agricultural Science Hangzhou China
- State Key Laboratory for Managing Biotic and Chemical Treats to the Quality and Safety of Agro-products, Key Laboratory of Biotechnology for Plant Protection, Ministry of Agriculture, and Rural Affairs, Zhejiang Provincial Key Laboratory of Biotechnology for Plant Protection, Institute of Plant Virology, Ningbo University Ningbo China
| | - Yong He
- College of Biosystems Engineering and Food Science, Key Laboratory of Spectroscopy, Ministry of Agriculture and Rural Affairs, Zhejiang University Hangzhou China +86-137-773-88835
- Huanan Industrial Technology Research Institute of Zhejiang University Guangzhou China
| | - Feng Liu
- College of Life Sciences, Nanjing Agricultural University Nanjing China
| | - Xuping Feng
- College of Biosystems Engineering and Food Science, Key Laboratory of Spectroscopy, Ministry of Agriculture and Rural Affairs, Zhejiang University Hangzhou China +86-137-773-88835
- Huanan Industrial Technology Research Institute of Zhejiang University Guangzhou China
| | - Jinnuo Zhang
- College of Biosystems Engineering and Food Science, Key Laboratory of Spectroscopy, Ministry of Agriculture and Rural Affairs, Zhejiang University Hangzhou China +86-137-773-88835
- Huanan Industrial Technology Research Institute of Zhejiang University Guangzhou China
| |
Collapse
|