1
|
Treepong P, Theera-Ampornpunt N. Early bread mold detection through microscopic images using convolutional neural network. Curr Res Food Sci 2023; 7:100574. [PMID: 37664007 PMCID: PMC10474362 DOI: 10.1016/j.crfs.2023.100574] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2023] [Revised: 07/25/2023] [Accepted: 08/20/2023] [Indexed: 09/05/2023] Open
Abstract
Mold on bread in the early stages of growth is difficult to discern with the naked eye. Visual inspection and expiration dates are imprecise approaches that consumers rely on to detect bread spoilage. Existing methods for detecting microbial contamination, such as inspection through a microscope and hyperspectral imaging, are unsuitable for consumer use. This paper proposes a novel early bread mold detection method through microscopic images taken using clip-on lenses. These low-cost lenses are used together with a smartphone to capture images of bread at 50× magnification. The microscopic images are automatically classified using state-of-the-art convolutional neural networks (CNNs) with transfer learning. We extensively compared image preprocessing methods, CNN models, and data augmentation methods to determine the best configuration in terms of classification accuracy. The top models achieved near-perfect F 1 scores of 0.9948 for white sandwich bread and 0.9972 for whole wheat bread.
Collapse
Affiliation(s)
- Panisa Treepong
- College of Computing, Prince of Songkla University, Phuket, Thailand
| | | |
Collapse
|
2
|
Reis Pereira M, dos Santos FN, Tavares F, Cunha M. Enhancing host-pathogen phenotyping dynamics: early detection of tomato bacterial diseases using hyperspectral point measurement and predictive modeling. FRONTIERS IN PLANT SCIENCE 2023; 14:1242201. [PMID: 37662158 PMCID: PMC10468592 DOI: 10.3389/fpls.2023.1242201] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/18/2023] [Accepted: 07/27/2023] [Indexed: 09/05/2023]
Abstract
Early diagnosis of plant diseases is needed to promote sustainable plant protection strategies. Applied predictive modeling over hyperspectral spectroscopy (HS) data can be an effective, fast, cost-effective approach for improving plant disease diagnosis. This study aimed to investigate the potential of HS point-of-measurement (POM) data for in-situ, non-destructive diagnosis of tomato bacterial speck caused by Pseudomonas syringae pv. tomato (Pst), and bacterial spot, caused by Xanthomonas euvesicatoria (Xeu), on leaves (cv. cherry). Bacterial artificial infection was performed on tomato plants at the same phenological stage. A sensing system composed by a hyperspectral spectrometer, a transmission optical fiber bundle with a slitted probe and a white light source were used for spectral data acquisition, allowing the assessment of 3478 spectral points. An applied predictive classification model was developed, consisting of a normalizing pre-processing strategy allied with a Linear Discriminant Analysis (LDA) for reducing data dimensionality and a supervised machine learning algorithm (Support Vector Machine - SVM) for the classification task. The predicted model achieved classification accuracies of 100% and 74% for Pst and Xeu test set assessments, respectively, before symptom appearance. Model predictions were coherent with host-pathogen interactions mentioned in the literature (e.g., changes in photosynthetic pigment levels, production of bacterial-specific molecules, and activation of plants' defense mechanisms). Furthermore, these results were coherent with visual phenotyping inspection and PCR results. The reported outcomes support the application of spectral point measurements acquired in-vivo for plant disease diagnosis, aiming for more precise and eco-friendly phytosanitary approaches.
Collapse
Affiliation(s)
- Mafalda Reis Pereira
- Faculdade de Ciências da Universidade do Porto (FCUP), Rua do Campo Alegre, Porto, Portugal
- Institute for Systems and Computer Engineering, Technology and Science (INESC TEC), Campus da Faculdade de Engenharia da Universidade do Porto, Rua Dr. Roberto Frias, Porto, Portugal
| | - Filipe Neves dos Santos
- Institute for Systems and Computer Engineering, Technology and Science (INESC TEC), Campus da Faculdade de Engenharia da Universidade do Porto, Rua Dr. Roberto Frias, Porto, Portugal
| | - Fernando Tavares
- Faculdade de Ciências da Universidade do Porto (FCUP), Rua do Campo Alegre, Porto, Portugal
- CIBIO, Centro de Investigação em Biodiversidade e Recursos Genéticos, InBIO Laboratório Associado, Campus de Vairão, Universidade do Porto, Vairão, Portugal
- BIOPOLIS Program in Genomics, Biodiversity and Land Planning, CIBIO, Campus de Vairão, Vairão, Portugal
| | - Mário Cunha
- Faculdade de Ciências da Universidade do Porto (FCUP), Rua do Campo Alegre, Porto, Portugal
- Institute for Systems and Computer Engineering, Technology and Science (INESC TEC), Campus da Faculdade de Engenharia da Universidade do Porto, Rua Dr. Roberto Frias, Porto, Portugal
| |
Collapse
|
3
|
Kiwi Plant Canker Diagnosis Using Hyperspectral Signal Processing and Machine Learning: Detecting Symptoms Caused by Pseudomonas syringae pv. actinidiae. PLANTS 2022; 11:plants11162154. [PMID: 36015456 PMCID: PMC9414239 DOI: 10.3390/plants11162154] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/17/2022] [Revised: 07/26/2022] [Accepted: 08/04/2022] [Indexed: 11/16/2022]
Abstract
Pseudomonas syringae pv. actinidiae (Psa) has been responsible for numerous epidemics of bacterial canker of kiwi (BCK), resulting in high losses in kiwi production worldwide. Current diagnostic approaches for this disease usually depend on visible signs of the infection (disease symptoms) to be present. Since these symptoms frequently manifest themselves in the middle to late stages of the infection process, the effectiveness of phytosanitary measures can be compromised. Hyperspectral spectroscopy has the potential to be an effective, non-invasive, rapid, cost-effective, high-throughput approach for improving BCK diagnostics. This study aimed to investigate the potential of hyperspectral UV–VIS reflectance for in-situ, non-destructive discrimination of bacterial canker on kiwi leaves. Spectral reflectance (325–1075 nm) of twenty plants were obtained with a handheld spectroradiometer in two commercial kiwi orchards located in Portugal, for 15 weeks, totaling 504 spectral measurements. Several modeling approaches based on continuous hyperspectral data or specific wavelengths, chosen by different feature selection algorithms, were tested to discriminate BCK on leaves. Spectral separability of asymptomatic and symptomatic leaves was observed in all multi-variate and machine learning models, including the FDA, GLM, PLS, and SVM methods. The combination of a stepwise forward variable selection approach using a support vector machine algorithm with a radial kernel and class weights was selected as the final model. Its overall accuracy was 85%, with a 0.70 kappa score and 0.84 F-measure. These results were coherent with leaves classified as asymptomatic or symptomatic by visual inspection. Overall, the findings herein reported support the implementation of spectral point measurements acquired in situ for crop disease diagnosis.
Collapse
|
4
|
Classification of Southern Corn Rust Severity Based on Leaf-Level Hyperspectral Data Collected under Solar Illumination. REMOTE SENSING 2022. [DOI: 10.3390/rs14112551] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/07/2022]
Abstract
Maize is one of the most important crops in China, and it is under a serious, ever-increasing threat from southern corn rust (SCR). The identification of wheat rust based on hyperspectral data has been proved effective, but little research on detecting maize rust has been reported. In this study, full-range hyperspectral data (350~2500 nm) were collected under solar illumination, and spectra collected under solar illumination (SCUSI) were separated into several groups according to the disease severity, measuring height and leaf curvature (the smoothness of the leaf surface). Ten indices were selected as candidate indicators for SCR classification, and their sensitivities to the disease severity, measuring height and leaf curvature, were subjected to analysis of variance (ANOVA). The better-performing indices according to the ANOVA test were applied to a random forest classifier, and the classification results were evaluated by using a confusion matrix. The results indicate that the PRI was the optimal index for SCR classification based on the SCUSI, with an overall accuracy of 81.30% for mixed samples. The results lay the foundation for SCR detection in the incubation period and reveal potential for SCR detection based on UAV and satellite imageries, which may provide a rapid, timely and cost-effective detection method for SCR monitoring.
Collapse
|
5
|
Zhang J, Feng X, Wu Q, Yang G, Tao M, Yang Y, He Y. Rice bacterial blight resistant cultivar selection based on visible/near-infrared spectrum and deep learning. PLANT METHODS 2022; 18:49. [PMID: 35428329 PMCID: PMC9013134 DOI: 10.1186/s13007-022-00882-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/09/2021] [Accepted: 03/31/2022] [Indexed: 05/10/2023]
Abstract
BACKGROUND Rice bacterial blight (BB) has caused serious damage in rice yield and quality leading to huge economic loss and food safety problems. Breeding disease resistant cultivar becomes the eco-friendliest and most effective alternative to regulate its outburst, since the propagation of pathogenic bacteria is restrained. However, the BB resistance cultivar selection suffers tremendous labor cost, low efficiency, and subjective human error. And dynamic rice BB phenotyping study is absent from exploring the pattern of BB growth with different genotypes. RESULTS In this paper, with the aim of alleviating the labor burden of plant breeding experts in the resistant cultivar screening processing and exploring the disease resistance phenotyping variation pattern, visible/near-infrared (VIS-NIR) hyperspectral images of rice leaves from three varieties after inoculation were collected and sent into a self-built deep learning model LPnet for disease severity assessment. The growth status of BB lesion at the time scale was fully revealed. On the strength of the attention mechanism inside LPnet, the most informative spectral features related to lesion proportion were further extracted and combined into a novel and refined leaf spectral index. The effectiveness and feasibility of the proposed wavelength combination were verified by identifying the resistant cultivar, assessing the resistant ability, and spectral image visualization. CONCLUSIONS This study illustrated that informative VIS-NIR spectrums coupled with attention deep learning had great potential to not only directly assess disease severity but also excavate spectral characteristics for rapid screening disease resistant cultivars in high-throughput phenotyping.
Collapse
Affiliation(s)
- Jinnuo Zhang
- College of Biosystems Engineering and Food Science, Key Laboratory of Spectroscopy, Ministry of Agriculture and Rural Affairs, Zhejiang University, Hangzhou, 310058, China
| | - Xuping Feng
- College of Biosystems Engineering and Food Science, Key Laboratory of Spectroscopy, Ministry of Agriculture and Rural Affairs, Zhejiang University, Hangzhou, 310058, China
| | - Qingguan Wu
- College of Biosystems Engineering and Food Science, Key Laboratory of Spectroscopy, Ministry of Agriculture and Rural Affairs, Zhejiang University, Hangzhou, 310058, China
| | - Guofeng Yang
- College of Biosystems Engineering and Food Science, Key Laboratory of Spectroscopy, Ministry of Agriculture and Rural Affairs, Zhejiang University, Hangzhou, 310058, China
| | - Mingzhu Tao
- College of Biosystems Engineering and Food Science, Key Laboratory of Spectroscopy, Ministry of Agriculture and Rural Affairs, Zhejiang University, Hangzhou, 310058, China
| | - Yong Yang
- State Key Laboratory for Managing Biotic and Chemical Treats to the Quality and Safety of Agro-Products, Key Laboratory of Biotechnology for Plant Protection, Ministry of Agriculture, and Rural Affairs, Zhejiang Provincial Key Laboratory of Biotechnology for Plant Protection, Institute of Virology and Biotechnology, Zhejiang Academy of Agricultural Science, Hangzhou, 310021, China.
| | - Yong He
- College of Biosystems Engineering and Food Science, Key Laboratory of Spectroscopy, Ministry of Agriculture and Rural Affairs, Zhejiang University, Hangzhou, 310058, China.
| |
Collapse
|
6
|
Machine Learning-Based Approaches for Predicting SPAD Values of Maize Using Multi-Spectral Images. REMOTE SENSING 2022. [DOI: 10.3390/rs14061337] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
Precisely monitoring the growth condition and nutritional status of maize is crucial for optimizing agronomic management and improving agricultural production. Multi-spectral sensors are widely applied in ecological and agricultural domains. However, the images collected under varying weather conditions on multiple days show a lack of data consistency. In this study, the Mini MCA 6 Camera from UAV platform was used to collect images covering different growth stages of maize. The empirical line calibration method was applied to establish generic equations for radiometric calibration. The coefficient of determination (R2) of the reflectance from calibrated images and ASD Handheld-2 ranged from 0.964 to 0.988 (calibration), and from 0.874 to 0.927 (validation), respectively. Similarly, the root mean square errors (RMSE) were 0.110, 0.089, and 0.102% for validation using data of 5 August, 21 September, and both days in 2019, respectively. The soil and plant analyzer development (SPAD) values were measured and applied to build the linear regression relationships with spectral and textural indices of different growth stages. The Stepwise regression model (SRM) was applied to identify the optimal combination of spectral and textural indices for estimating SPAD values. The support vector machine (SVM) and random forest (RF) models were independently applied for estimating SPAD values based on the optimal combinations. SVM performed better than RF in estimating SPAD values with R2 (0.81) and RMSE (0.14), respectively. This study contributed to the retrieval of SPAD values based on both spectral and textural indices extracted from multi-spectral images using machine learning methods.
Collapse
|
7
|
Making Sense of Light: The Use of Optical Spectroscopy Techniques in Plant Sciences and Agriculture. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12030997] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/01/2023]
Abstract
As a result of the development of non-invasive optical spectroscopy, the number of prospective technologies of plant monitoring is growing. Being implemented in devices with different functions and hardware, these technologies are increasingly using the most advanced data processing algorithms, including machine learning and more available computing power each time. Optical spectroscopy is widely used to evaluate plant tissues, diagnose crops, and study the response of plants to biotic and abiotic stress. Spectral methods can also assist in remote and non-invasive assessment of the physiology of photosynthetic biofilms and the impact of plant species on biodiversity and ecosystem stability. The emergence of high-throughput technologies for plant phenotyping and the accompanying need for methods for rapid and non-contact assessment of plant productivity has generated renewed interest in the application of optical spectroscopy in fundamental plant sciences and agriculture. In this perspective paper, starting with a brief overview of the scientific and technological backgrounds of optical spectroscopy and current mainstream techniques and applications, we foresee the future development of this family of optical spectroscopic methodologies.
Collapse
|
8
|
Zubler AV, Yoon JY. Proximal Methods for Plant Stress Detection Using Optical Sensors and Machine Learning. BIOSENSORS 2020; 10:E193. [PMID: 33260412 PMCID: PMC7760370 DOI: 10.3390/bios10120193] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/25/2020] [Revised: 11/10/2020] [Accepted: 11/26/2020] [Indexed: 11/16/2022]
Abstract
Plant stresses have been monitored using the imaging or spectrometry of plant leaves in the visible (red-green-blue or RGB), near-infrared (NIR), infrared (IR), and ultraviolet (UV) wavebands, often augmented by fluorescence imaging or fluorescence spectrometry. Imaging at multiple specific wavelengths (multi-spectral imaging) or across a wide range of wavelengths (hyperspectral imaging) can provide exceptional information on plant stress and subsequent diseases. Digital cameras, thermal cameras, and optical filters have become available at a low cost in recent years, while hyperspectral cameras have become increasingly more compact and portable. Furthermore, smartphone cameras have dramatically improved in quality, making them a viable option for rapid, on-site stress detection. Due to these developments in imaging technology, plant stresses can be monitored more easily using handheld and field-deployable methods. Recent advances in machine learning algorithms have allowed for images and spectra to be analyzed and classified in a fully automated and reproducible manner, without the need for complicated image or spectrum analysis methods. This review will highlight recent advances in portable (including smartphone-based) detection methods for biotic and abiotic stresses, discuss data processing and machine learning techniques that can produce results for stress identification and classification, and suggest future directions towards the successful translation of these methods into practical use.
Collapse
Affiliation(s)
| | - Jeong-Yeol Yoon
- Department of Biosystems Engineering, The University of Arizona, Tucson, AZ 85721, USA;
| |
Collapse
|