1
|
Pourdarbani R, Sabzi S, Zohrabi R, García-Mateos G, Fernandez-Beltran R, Molina-Martínez JM, Rohban MH. Comparison of 2D and 3D convolutional neural networks in hyperspectral image analysis of fruits applied to orange bruise detection. J Food Sci 2023; 88:5149-5163. [PMID: 37876302 DOI: 10.1111/1750-3841.16801] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2023] [Revised: 09/06/2023] [Accepted: 09/30/2023] [Indexed: 10/26/2023]
Abstract
Recent advances in hyperspectral imaging (HSI) have demonstrated its ability to detect defects in fruit that may not be visible in RGB images. HSIs can be considered 3D images containing two spatial dimensions and one spectral dimension. Therefore, the first question that arises is how to process this type of information, either using 2D or 3D models. In this study, HSI in the 550-900 nm spectral range was used to detect bruising in oranges. Sixty samples of Thompson oranges were subjected to a mechanical bruising process, and HSIs were taken at different time intervals: before bruising, and 8 and 16 h after bruising. The samples were then classified using two convolutional neural network (CNN) models, a shallow 7-layer network (CNN-7) and a deep 18-layer network (CNN-18). In addition, two different input processing approaches are used: using 2D information from each band, and using the full 3D data from each HSI. The 3D models were the most accurate, with 94% correct classification for 3D-CNN-18, compared to 90% for 3D-CNN-7, and less than 83% for the 2D models. Our study suggests that 3D HSI may be a more effective technique for detecting fruit bruising, allowing the development of a fast, accurate, and nondestructive method for fruit sorting. PRACTICAL APPLICATION: Orange bruises can reduce the market value of food, which is why the food processing industry needs to carry out quality inspections. An effective way to perform this inspection is by using hyperspectral images that can be processed with 2D or 3D models, either with deep or shallow neural networks. The results of the comparison performed in this work can be useful for the development of more accurate and efficient bruise detection methods for fruit inspection.
Collapse
Affiliation(s)
- Raziyeh Pourdarbani
- Department of Biosystems Engineering, University of Mohaghegh Ardabili, Ardabil, Iran
| | - Sajad Sabzi
- Department of Computer Engineering, Sharif University of Technology, Tehran, Iran
| | - Reihaneh Zohrabi
- Department of Computer Engineering, Sharif University of Technology, Tehran, Iran
| | - Ginés García-Mateos
- Computer Science and Systems Department, University of Murcia, Murcia, Spain
| | | | | | - Mohammad H Rohban
- Department of Computer Engineering, Sharif University of Technology, Tehran, Iran
| |
Collapse
|
2
|
Classification of bread wheat genotypes by machine learning algorithms. J Food Compost Anal 2023. [DOI: 10.1016/j.jfca.2023.105253] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/05/2023]
|
3
|
Sanaeifar A, Yang C, de la Guardia M, Zhang W, Li X, He Y. Proximal hyperspectral sensing of abiotic stresses in plants. THE SCIENCE OF THE TOTAL ENVIRONMENT 2023; 861:160652. [PMID: 36470376 DOI: 10.1016/j.scitotenv.2022.160652] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/27/2022] [Revised: 11/27/2022] [Accepted: 11/29/2022] [Indexed: 06/17/2023]
Abstract
Recent attempts, advances and challenges, as well as future perspectives regarding the application of proximal hyperspectral sensing (where sensors are placed within 10 m above plants, either on land-based platforms or in controlled environments) to assess plant abiotic stresses have been critically reviewed. Abiotic stresses, caused by either physical or chemical reasons such as nutrient deficiency, drought, salinity, heavy metals, herbicides, extreme temperatures, and so on, may be more damaging than biotic stresses (affected by infectious agents such as bacteria, fungi, insects, etc.) on crop yields. The proximal hyperspectral sensing provides images at a sub-millimeter spatial resolution for doing an in-depth study of plant physiology and thus offers a global view of the plant's status and allows for monitoring spatio-temporal variations from large geographical areas reliably and economically. The literature update has been based on 362 research papers in this field, published from 2010, most of which are from four years ago and, in our knowledge, it is the first paper that provides a comprehensive review of the applications of the technique for the detection of various types of abiotic stresses in plants.
Collapse
Affiliation(s)
- Alireza Sanaeifar
- College of Biosystems Engineering and Food Science, Zhejiang University, 866 Yuhangtang Road, Hangzhou 310058, China.
| | - Ce Yang
- Department of Bioproducts and Biosystems Engineering, University of Minnesota, Saint Paul, MN 55108, United States.
| | - Miguel de la Guardia
- Department of Analytical Chemistry, University of Valencia, Dr. Moliner 50, 46100 Burjassot, Valencia, Spain.
| | - Wenkai Zhang
- College of Biosystems Engineering and Food Science, Zhejiang University, 866 Yuhangtang Road, Hangzhou 310058, China.
| | - Xiaoli Li
- College of Biosystems Engineering and Food Science, Zhejiang University, 866 Yuhangtang Road, Hangzhou 310058, China.
| | - Yong He
- College of Biosystems Engineering and Food Science, Zhejiang University, 866 Yuhangtang Road, Hangzhou 310058, China.
| |
Collapse
|
4
|
Benmouna B, García-Mateos G, Sabzi S, Fernandez-Beltran R, Parras-Burgos D, Molina-Martínez JM. Convolutional Neural Networks for Estimating the Ripening State of Fuji Apples Using Visible and Near-Infrared Spectroscopy. FOOD BIOPROCESS TECH 2022. [DOI: 10.1007/s11947-022-02880-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
AbstractThe quality of fresh apple fruits is a major concern for consumers and manufacturers. Classification of these fruits according to their ripening stage is one of the most decisive factors in determining their quality. In this regard, the aim of this work is to develop a new method for non-destructive classification of the ripening state of Fuji apples using hyperspectral information in the visible and near-infrared (Vis/NIR) regions. Spectra of 172 apple samples in the range from 450 to 1000 nm were studied, which were selected from four different ripening stages. A convolutional neural network (CNN) model was proposed to perform the classification of the samples. The proposed method was compared with three alternative methods based on artificial neural networks (ANN), support vector machines (SVM), and k-nearest neighbors (KNN). The results revealed that the CNN method outperformed the alternative methods, achieving a correct classification rate (CCR) of 96.5%, compared with an average of 89.5%, 95.93%, and 91.68% for ANN, SVM, and KNN, respectively. These results will help in the development of a new device for fast and accurate estimation of the quality of apples.
Collapse
|
5
|
Khan MA, Alqahtani A, Khan A, Alsubai S, Binbusayyis A, Ch MMI, Yong HS, Cha J. Cucumber Leaf Diseases Recognition Using Multi Level Deep Entropy-ELM Feature Selection. APPLIED SCIENCES 2022; 12:593. [DOI: 10.3390/app12020593] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Abstract
Agriculture has becomes an immense area of research and is ascertained as a key element in the area of computer vision. In the agriculture field, image processing acts as a primary part. Cucumber is an important vegetable and its production in Pakistan is higher as compared to the other vegetables because of its use in salads. However, the diseases of cucumber such as Angular leaf spot, Anthracnose, blight, Downy mildew, and powdery mildew widely decrease the quality and quantity. Lately, numerous methods have been proposed for the identification and classification of diseases. Early detection and then treatment of the diseases in plants is important to prevent the crop from a disastrous decrease in yields. Many classification techniques have been proposed but still, they are facing some challenges such as noise, redundant features, and extraction of relevant features. In this work, an automated framework is proposed using deep learning and best feature selection for cucumber leaf diseases classification. In the proposed framework, initially, an augmentation technique is applied to the original images by creating more training data from existing samples and handling the problem of the imbalanced dataset. Then two different phases are utilized. In the first phase, fine-tuned four pre-trained models and select the best of them based on the accuracy. Features are extracted from the selected fine-tuned model and refined through the Entropy-ELM technique. In the second phase, fused the features of all four fine-tuned models and apply the Entropy-ELM technique, and finally fused with phase 1 selected feature. Finally, the fused features are recognized using machine learning classifiers for the final classification. The experimental process is conducted on five different datasets. On these datasets, the best-achieved accuracy is 98.4%. The proposed framework is evaluated on each step and also compared with some recent techniques. The comparison with some recent techniques showed that the proposed method obtained an improved performance.
Collapse
Affiliation(s)
| | - Abdullah Alqahtani
- College of Computer Engineering and Sciences, Prince Sattam bin Abdulaziz University, Al-Kharj 16273, Saudi Arabia
| | - Aimal Khan
- Department of Computer & Software Engineering, CEME NUST Rawalpindi, Rawalpindi 46000, Pakistan
| | - Shtwai Alsubai
- College of Computer Engineering and Sciences, Prince Sattam bin Abdulaziz University, Al-Kharj 16273, Saudi Arabia
| | - Adel Binbusayyis
- College of Computer Engineering and Sciences, Prince Sattam bin Abdulaziz University, Al-Kharj 16273, Saudi Arabia
| | - M Munawwar Iqbal Ch
- Institute of Information Technology, Quaid-i-Azam University, Islamabad 44000, Pakistan
| | - Hwan-Seung Yong
- Department of Computer Science & Engineering, Ewha Womans University, Seoul 03760, Korea
| | - Jaehyuk Cha
- Department of Computer Science, Hanyang University, Seoul 04763, Korea
| |
Collapse
|
6
|
Ishmukhametov I, Batasheva S, Fakhrullin R. Identification of micro- and nanoplastics released from medical masks using hyperspectral imaging and deep learning. Analyst 2022; 147:4616-4628. [DOI: 10.1039/d2an01139e] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
Abstract
In this study, dark-field microscopy-based hyperspectral imaging augmented with deep learning data analysis was applied for effective visualisation, detection and identification of microplastics released from polypropylene medical masks.
Collapse
Affiliation(s)
- Ilnur Ishmukhametov
- Bionanotechnology Lab, Institute of Fundamental Medicine and Biology, Kazan Federal University, Kreml uramı 18, Kazan, Republic of Tatarstan, 420008, Russian Federation
| | - Svetlana Batasheva
- Bionanotechnology Lab, Institute of Fundamental Medicine and Biology, Kazan Federal University, Kreml uramı 18, Kazan, Republic of Tatarstan, 420008, Russian Federation
| | - Rawil Fakhrullin
- Bionanotechnology Lab, Institute of Fundamental Medicine and Biology, Kazan Federal University, Kreml uramı 18, Kazan, Republic of Tatarstan, 420008, Russian Federation
| |
Collapse
|