1
|
Matenda RT, Rip D, Marais J, Williams PJ. Exploring the potential of hyperspectral imaging for microbial assessment of meat: A review. SPECTROCHIMICA ACTA. PART A, MOLECULAR AND BIOMOLECULAR SPECTROSCOPY 2024; 315:124261. [PMID: 38608560 DOI: 10.1016/j.saa.2024.124261] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/28/2023] [Revised: 04/04/2024] [Accepted: 04/06/2024] [Indexed: 04/14/2024]
Abstract
Food safety is always of paramount importance globally due to the devasting social and economic effects of foodborne disease outbreaks. There is a high consumption rate of meat worldwide, making it an essential protein source in the human diet, hence its microbial safety is of great importance. The food industry stakeholders are always in search of methods that ensure safe food whilst maintaining food quality and excellent sensory attributes. Currently, there are several methods used in microbial food analysis, however, these methods are often time-consuming and do not allow real-time analysis. Considering the recent technological breakthroughs in artificial intelligence and machine learning, it raises the question of whether these advancements could be leveraged within the meat industry to improve turnaround time for microbial assessments. Hyperspectral imaging (HSI) is a highly prospective technology worth exploring for microbial analysis. The rapid, non-destructive method has the potential to be integrated into food production systems and allows foodborne pathogen detection in food samples, thus saving time. Although there has been a substantial increase in research on the utilisation of HSI in food applications over the past years, its use in the microbial assessment of meat is not yet optimal. This review aims to provide a basic understanding of the visible-near infrared HSI system, recent applications in the microbial assessment of meat products, challenges, and possible future applications.
Collapse
Affiliation(s)
- Rumbidzai T Matenda
- Department of Food Science, Stellenbosch University, Private Bag X1, Matieland, Stellenbosch 7602, South Africa
| | - Diane Rip
- Department of Food Science, Stellenbosch University, Private Bag X1, Matieland, Stellenbosch 7602, South Africa
| | - Jeannine Marais
- Department of Food Science, Stellenbosch University, Private Bag X1, Matieland, Stellenbosch 7602, South Africa
| | - Paul J Williams
- Department of Food Science, Stellenbosch University, Private Bag X1, Matieland, Stellenbosch 7602, South Africa.
| |
Collapse
|
2
|
Zhang X, Dai Y, Zhang G, Zhang X, Hu B. A Snapshot Multi-Spectral Demosaicing Method for Multi-Spectral Filter Array Images Based on Channel Attention Network. SENSORS (BASEL, SWITZERLAND) 2024; 24:943. [PMID: 38339660 PMCID: PMC10856948 DOI: 10.3390/s24030943] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/09/2024] [Revised: 01/26/2024] [Accepted: 01/29/2024] [Indexed: 02/12/2024]
Abstract
Multi-spectral imaging technologies have made great progress in the past few decades. The development of snapshot cameras equipped with a specific multi-spectral filter array (MSFA) allow dynamic scenes to be captured on a miniaturized platform across multiple spectral bands, opening up extensive applications in quantitative and visualized analysis. However, a snapshot camera based on MSFA captures a single band per pixel; thus, the other spectral band components of pixels are all missed. The raw images, which are captured by snapshot multi-spectral imaging systems, require a reconstruction procedure called demosaicing to estimate a fully defined multi-spectral image (MSI). With increasing spectral bands, the challenge of demosaicing becomes more difficult. Furthermore, the existing demosaicing methods will produce adverse artifacts and aliasing because of the adverse effects of spatial interpolation and the inadequacy of the number of layers in the network structure. In this paper, a novel multi-spectral demosaicing method based on a deep convolution neural network (CNN) is proposed for the reconstruction of full-resolution multi-spectral images from raw MSFA-based spectral mosaic images. The CNN is integrated with the channel attention mechanism to protect important channel features. We verify the merits of the proposed method using 5 × 5 raw mosaic images on synthetic as well as real-world data. The experimental results show that the proposed method outperforms the existing demosaicing methods in terms of spatial details and spectral fidelity.
Collapse
Affiliation(s)
- Xuejun Zhang
- Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi’an 710119, China; (X.Z.); (Y.D.)
- University of Chinese Academy of Sciences, Beijing 100049, China
| | - Yidan Dai
- Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi’an 710119, China; (X.Z.); (Y.D.)
- University of Chinese Academy of Sciences, Beijing 100049, China
| | - Geng Zhang
- Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi’an 710119, China; (X.Z.); (Y.D.)
| | - Xuemin Zhang
- Institute of Aerospace Science and Technology, School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430072, China;
| | - Bingliang Hu
- Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi’an 710119, China; (X.Z.); (Y.D.)
| |
Collapse
|
3
|
Wang Y, Wang S, Bai R, Li X, Yuan Y, Nan T, Kang C, Yang J, Huang L. Prediction performance and reliability evaluation of three ginsenosides in Panax ginseng using hyperspectral imaging combined with a novel ensemble chemometric model. Food Chem 2024; 430:136917. [PMID: 37557029 DOI: 10.1016/j.foodchem.2023.136917] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2023] [Revised: 06/30/2023] [Accepted: 07/15/2023] [Indexed: 08/11/2023]
Abstract
Panax ginseng C. A. Meyer (PG) is a health-promoting food, and its ginsenosides (Rb1, Rg1, Re) content, as the quality indicator, is affected by the planting modes (garden or forest ginsengs) and years. Effective prediction of this content remains to be investigated. In this study, hyperspectral (HSI) combined with ensemble model (CGRU-GPR) including the convolutional neural network (CNN), gate recurrent unit (GRU), and Gaussian process regression (GPR) realized a comprehensive evaluation of the prediction performance and predictive uncertainty. With effective wavelengths, the proposed CGRU-GPR model improved operation efficiency and obtained satisfactory prediction results with relative percent deviation (RPD) values all higher than 2.70 in three ginsenosides. Meanwhile, the interval prediction with a high prediction interval coverage probability (PICP) of 0.97 - 1.0 and a low mean width percentage (MWP) of 0.7 - 1.66 indicated a low prediction uncertainty. This study provides a rapid and reliable method for predicting ginsenosides contents in PG.
Collapse
Affiliation(s)
- Youyou Wang
- State Key Laboratory for Quality Ensurance and Sustainable Use of Dao-di Herbs, National Resource Center for Chinese Materia Medica, China Academy of Chinese Medical Sciences, Beijing, 100700, PR China
| | - Siman Wang
- State Key Laboratory for Quality Ensurance and Sustainable Use of Dao-di Herbs, National Resource Center for Chinese Materia Medica, China Academy of Chinese Medical Sciences, Beijing, 100700, PR China
| | - Ruibin Bai
- State Key Laboratory for Quality Ensurance and Sustainable Use of Dao-di Herbs, National Resource Center for Chinese Materia Medica, China Academy of Chinese Medical Sciences, Beijing, 100700, PR China; Dexing Research and Training Center of Chinese Medical Sciences, Dexing 334220, PR China
| | - Xiaoyong Li
- State SCNU Environmental Research Institute, Guangdong Provincial Key Laboratory of Chemical Pollution and Environmental Safety & MOE Key Laboratory of Theoretical Chemistry of Environment, School of Environment, South China Normal University, Guangzhou 510006, PR China
| | - Yuwei Yuan
- Institute of Agro-product Safety and Nutrition, Zhejiang Academy of Agricultural Sciences, Key Laboratory of Information Traceability for Agricultural Products, Ministry of Agriculture and Rural Affairs, Hangzhou 310021, PR China
| | - Tiegui Nan
- State Key Laboratory for Quality Ensurance and Sustainable Use of Dao-di Herbs, National Resource Center for Chinese Materia Medica, China Academy of Chinese Medical Sciences, Beijing, 100700, PR China
| | - Chuanzhi Kang
- State Key Laboratory for Quality Ensurance and Sustainable Use of Dao-di Herbs, National Resource Center for Chinese Materia Medica, China Academy of Chinese Medical Sciences, Beijing, 100700, PR China; Dexing Research and Training Center of Chinese Medical Sciences, Dexing 334220, PR China
| | - Jian Yang
- State Key Laboratory for Quality Ensurance and Sustainable Use of Dao-di Herbs, National Resource Center for Chinese Materia Medica, China Academy of Chinese Medical Sciences, Beijing, 100700, PR China; Dexing Research and Training Center of Chinese Medical Sciences, Dexing 334220, PR China.
| | - Luqi Huang
- State Key Laboratory for Quality Ensurance and Sustainable Use of Dao-di Herbs, National Resource Center for Chinese Materia Medica, China Academy of Chinese Medical Sciences, Beijing, 100700, PR China.
| |
Collapse
|
4
|
Tian C, Hao D, Ma M, Zhuang J, Mu Y, Zhang Z, Zhao X, Lu Y, Zuo X, Li W. Graded diagnosis of Helicobacter pylori infection using hyperspectral images of gastric juice. JOURNAL OF BIOPHOTONICS 2024; 17:e202300254. [PMID: 37577839 DOI: 10.1002/jbio.202300254] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/03/2023] [Revised: 07/26/2023] [Accepted: 08/11/2023] [Indexed: 08/15/2023]
Abstract
Helicobacter pylori is a potential underlying cause of many diseases. Although the Carbon 13 breath test is considered the gold standard for detection, it is high cost and low public accessibility in certain areas limit its widespread use. In this study, we sought to use machine learning and deep learning algorithm models to classify and diagnose H. pylori infection status. We used hyperspectral imaging system to gather gastric juice images and then retrieved spectral feature information between 400 and 1000 nm. Two different data processing methods were employed, resulting in the establishment of one-dimensional (1D) and two-dimensional (2D) datasets. In the binary classification task, the random forest model achieved a prediction accuracy of 83.27% when learning features from 1D data, with a specificity of 84.56% and a sensitivity of 92.31%. In the ternary classification task, the ResNet model learned from 2D data and achieved a classification accuracy of 91.48%.
Collapse
Affiliation(s)
- Chongxuan Tian
- School of Control Science and Engineering, Shandong University, Jinan, Shandong Province, China
| | - Di Hao
- School of Control Science and Engineering, Shandong University, Jinan, Shandong Province, China
| | - Mingjun Ma
- Department of Gastroenterology, Qilu Hospital of Shandong University, Jinan, Shandong Province, China
| | - Ji Zhuang
- School of Control Science and Engineering, Shandong University, Jinan, Shandong Province, China
| | - Yijun Mu
- Department of Gastroenterology, Qilu Hospital of Shandong University, Jinan, Shandong Province, China
| | - Zhanhao Zhang
- School of Control Science and Engineering, Shandong University, Jinan, Shandong Province, China
| | - Xin Zhao
- School of Control Science and Engineering, Shandong University, Jinan, Shandong Province, China
| | - Yushan Lu
- School of Control Science and Engineering, Shandong University, Jinan, Shandong Province, China
| | - Xiuli Zuo
- Department of Gastroenterology, Qilu Hospital of Shandong University, Jinan, Shandong Province, China
| | - Wei Li
- School of Control Science and Engineering, Shandong University, Jinan, Shandong Province, China
| |
Collapse
|
5
|
Yan H, Neves MDG, Wise BM, Moraes IA, Barbin DF, Siesler HW. The Application of Handheld Near-Infrared Spectroscopy and Raman Spectroscopic Imaging for the Identification and Quality Control of Food Products. Molecules 2023; 28:7891. [PMID: 38067622 PMCID: PMC10708147 DOI: 10.3390/molecules28237891] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2023] [Revised: 11/29/2023] [Accepted: 11/29/2023] [Indexed: 12/18/2023] Open
Abstract
The following investigations describe the potential of handheld NIR spectroscopy and Raman imaging measurements for the identification and authentication of food products. On the one hand, during the last decade, handheld NIR spectroscopy has made the greatest progress among vibrational spectroscopic methods in terms of miniaturization and price/performance ratio, and on the other hand, the Raman spectroscopic imaging method can achieve the best lateral resolution when examining the heterogeneous composition of samples. The utilization of both methods is further enhanced via the combination with chemometric evaluation methods with respect to the detection, identification, and discrimination of illegal counterfeiting of food products. To demonstrate the solution to practical problems with these two spectroscopic techniques, the results of our recent investigations obtained for various industrial processes and customer-relevant product examples have been discussed in this article. Specifically, the monitoring of food extraction processes (e.g., ethanol extraction of clove and water extraction of wolfberry) and the identification of food quality (e.g., differentiation of cocoa nibs and cocoa beans) via handheld NIR spectroscopy, and the detection and quantification of adulterations in powdered dairy products via Raman imaging were outlined in some detail. Although the present work only demonstrates exemplary product and process examples, the applications provide a balanced overview of materials with different physical properties and manufacturing processes in order to be able to derive modified applications for other products or production processes.
Collapse
Affiliation(s)
- Hui Yan
- School of Biotechnology, Jiangsu University of Science and Technology, Zhenjiang 212100, China;
| | - Marina D. G. Neves
- Department of Physical Chemistry, University Duisburg-Essen, 45117 Essen, Germany;
| | | | - Ingrid A. Moraes
- Department of Food Engineering and Technology, School of Food Engineering, University of Campinas, Campinas 13083-862, Brazil; (I.A.M.); (D.F.B.)
| | - Douglas F. Barbin
- Department of Food Engineering and Technology, School of Food Engineering, University of Campinas, Campinas 13083-862, Brazil; (I.A.M.); (D.F.B.)
| | - Heinz W. Siesler
- Department of Physical Chemistry, University Duisburg-Essen, 45117 Essen, Germany;
| |
Collapse
|
6
|
Monvoisin N, Hemsley E, Laplanche L, Almuneau G, Calvez S, Monmayrant A. Spectrally-shaped illumination for improved optical inspection of lateral III-V-semiconductor oxidation. OPTICS EXPRESS 2023; 31:12955-12966. [PMID: 37157444 DOI: 10.1364/oe.480753] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/10/2023]
Abstract
We report an hyperspectral imaging microscopy system based on a spectrally-shaped illumination and its use to offer an enhanced in-situ inspection of a technological process that is critical in Vertical-Cavity Surface-Emitting Laser (VCSEL) manufacturing, the lateral III-V-semiconductor oxidation (AlOx). The implemented illumination source exploits a digital micromirror device (DMD) to arbitrarily tailor its emission spectrum. When combined to an imager, this source is shown to provide an additional ability to detect minute surface reflectance contrasts on any VCSEL or AlOx-based photonic structure and, in turn, to offer improved in-situ inspection of the oxide aperture shapes and dimensions down to the best-achievable optical resolution. The demonstrated technique is very versatile and could be readily extended to the real-time monitoring of oxidation or other semiconductor technological processes as soon as they rely on a real-time yet accurate measurement of spatio-spectral (reflectance) maps.
Collapse
|
7
|
Zhang X, Song H, Wang Y, Hu L, Wang P, Mao H. Detection of Rice Fungal Spores Based on Micro- Hyperspectral and Microfluidic Techniques. BIOSENSORS 2023; 13:278. [PMID: 36832044 PMCID: PMC9954447 DOI: 10.3390/bios13020278] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/17/2022] [Revised: 02/01/2023] [Accepted: 02/10/2023] [Indexed: 06/18/2023]
Abstract
As rice is one of the world's most important food crops, protecting it from fungal diseases is very important for agricultural production. At present, it is difficult to diagnose rice fungal diseases at an early stage using relevant technologies, and there are a lack of rapid detection methods. This study proposes a microfluidic chip-based method combined with microscopic hyperspectral detection of rice fungal disease spores. First, a microfluidic chip with a dual inlet and three-stage structure was designed to separate and enrich Magnaporthe grisea spores and Ustilaginoidea virens spores in air. Then, the microscopic hyperspectral instrument was used to collect the hyperspectral data of the fungal disease spores in the enrichment area, and the competitive adaptive reweighting algorithm (CARS) was used to screen the characteristic bands of the spectral data collected from the spores of the two fungal diseases. Finally, the support vector machine (SVM) and convolutional neural network (CNN) were used to build the full-band classification model and the CARS filtered characteristic wavelength classification model, respectively. The results showed that the actual enrichment efficiency of the microfluidic chip designed in this study on Magnaporthe grisea spores and Ustilaginoidea virens spores was 82.67% and 80.70%, respectively. In the established model, the CARS-CNN classification model is the best for the classification of Magnaporthe grisea spores and Ustilaginoidea virens spores, and its F1-core index can reach 0.960 and 0.949, respectively. This study can effectively isolate and enrich Magnaporthe grisea spores and Ustilaginoidea virens spores, providing new methods and ideas for early detection of rice fungal disease spores.
Collapse
Affiliation(s)
- Xiaodong Zhang
- School of Agricultural Engineering, Jiangsu University, Zhenjiang 212013, China
- Key Laboratory of Modern Agricultural Equipment and Technology, Ministry of Education, Jiangsu University, Zhenjiang 212013, China
| | - Houjian Song
- School of Agricultural Engineering, Jiangsu University, Zhenjiang 212013, China
- Key Laboratory of Modern Agricultural Equipment and Technology, Ministry of Education, Jiangsu University, Zhenjiang 212013, China
| | - Yafei Wang
- School of Agricultural Engineering, Jiangsu University, Zhenjiang 212013, China
- Key Laboratory of Modern Agricultural Equipment and Technology, Ministry of Education, Jiangsu University, Zhenjiang 212013, China
| | - Lian Hu
- Key Laboratory of Key Technology on Agricultural Machine and Equipment, Ministry of Education, South China Agricultural University, Guangzhou 510642, China
| | - Pei Wang
- Key Laboratory of Key Technology on Agricultural Machine and Equipment, Ministry of Education, South China Agricultural University, Guangzhou 510642, China
| | - Hanping Mao
- School of Agricultural Engineering, Jiangsu University, Zhenjiang 212013, China
- Key Laboratory of Modern Agricultural Equipment and Technology, Ministry of Education, Jiangsu University, Zhenjiang 212013, China
| |
Collapse
|
8
|
Tao C, Du J, Wang J, Hu B, Zhang Z. Rapid Identification of Infectious Pathogens at the Single-Cell Level via Combining Hyperspectral Microscopic Images and Deep Learning. Cells 2023; 12:cells12030379. [PMID: 36766719 PMCID: PMC9913624 DOI: 10.3390/cells12030379] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2022] [Revised: 12/17/2022] [Accepted: 01/06/2023] [Indexed: 01/22/2023] Open
Abstract
Identifying infectious pathogens quickly and accurately is significant for patients and doctors. Identifying single bacterial strains is significant in eliminating culture and speeding up diagnosis. We present an advanced optical method for the rapid detection of infectious (including common and uncommon) pathogens by combining hyperspectral microscopic imaging and deep learning. To acquire more information regarding the pathogens, we developed a hyperspectral microscopic imaging system with a wide wavelength range and fine spectral resolution. Furthermore, an end-to-end deep learning network based on feature fusion, called BI-Net, was designed to extract the species-dependent features encoded in cell-level hyperspectral images as the fingerprints for species differentiation. After being trained based on a large-scale dataset that we built to identify common pathogens, BI-Net was used to classify uncommon pathogens via transfer learning. An extensive analysis demonstrated that BI-Net was able to learn species-dependent characteristics, with the classification accuracy and Kappa coefficients being 92% and 0.92, respectively, for both common and uncommon species. Our method outperformed state-of-the-art methods by a large margin and its excellent performance demonstrates its excellent potential in clinical practice.
Collapse
Affiliation(s)
- Chenglong Tao
- Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi’an 710119, China
- University of Chinese Academy of Sciences, Beijing 100049, China
- Key Laboratory of Biomedical Spectroscopy of Xi’an, Xi’an 710119, China
| | - Jian Du
- Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi’an 710119, China
- Key Laboratory of Biomedical Spectroscopy of Xi’an, Xi’an 710119, China
| | - Junjie Wang
- Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi’an 710119, China
- University of Chinese Academy of Sciences, Beijing 100049, China
- Key Laboratory of Biomedical Spectroscopy of Xi’an, Xi’an 710119, China
| | - Bingliang Hu
- Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi’an 710119, China
- Key Laboratory of Biomedical Spectroscopy of Xi’an, Xi’an 710119, China
- Correspondence: (B.H.); (Z.Z.)
| | - Zhoufeng Zhang
- Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi’an 710119, China
- Key Laboratory of Biomedical Spectroscopy of Xi’an, Xi’an 710119, China
- Correspondence: (B.H.); (Z.Z.)
| |
Collapse
|
9
|
Liu Z, Wu J, Cai C, Yang B, Qi ZM. Flexible hyperspectral surface plasmon resonance microscopy. Nat Commun 2022; 13:6475. [PMID: 36309515 PMCID: PMC9617892 DOI: 10.1038/s41467-022-34196-7] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2022] [Accepted: 10/13/2022] [Indexed: 12/25/2022] Open
Abstract
Optical techniques for visualization and quantification of chemical and biological analytes are always highly desirable. Here we show a hyperspectral surface plasmon resonance microscopy (HSPRM) system that uses a hyperspectral microscope to analyze the selected area of SPR image produced by a prism-based spectral SPR sensor. The HSPRM system enables monochromatic and polychromatic SPR imaging and single-pixel spectral SPR sensing, as well as two-dimensional quantification of thin films with the measured resonance-wavelength images. We performed pixel-by-pixel calibration of the incident angle to remove pixel-to-pixel differences in SPR sensitivity, and demonstrated the HSPRM's capabilities by using it to quantify monolayer graphene thickness distribution, inhomogeneous protein adsorption and single-cell adhesion. The HSPRM system has a wide spectral range from 400 nm to 1000 nm, an optional field of view from 0.884 mm2 to 0.003 mm2 and a high lateral resolution of 1.2 μm, demonstrating an innovative breakthrough in SPR sensor technology.
Collapse
Affiliation(s)
- Ziwei Liu
- grid.9227.e0000000119573309State Key Laboratory of Transducer Technology, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing, 100190 China ,grid.410726.60000 0004 1797 8419School of Electronic, Electrical, and Communication Engineering, University of Chinese Academy of Sciences, Beijing, 100049 China
| | - Jingning Wu
- grid.9227.e0000000119573309State Key Laboratory of Transducer Technology, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing, 100190 China ,grid.410726.60000 0004 1797 8419School of Electronic, Electrical, and Communication Engineering, University of Chinese Academy of Sciences, Beijing, 100049 China
| | - Chen Cai
- grid.9227.e0000000119573309State Key Laboratory of Transducer Technology, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing, 100190 China ,grid.410726.60000 0004 1797 8419School of Electronic, Electrical, and Communication Engineering, University of Chinese Academy of Sciences, Beijing, 100049 China
| | - Bo Yang
- grid.9227.e0000000119573309State Key Laboratory of Transducer Technology, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing, 100190 China ,grid.410726.60000 0004 1797 8419School of Electronic, Electrical, and Communication Engineering, University of Chinese Academy of Sciences, Beijing, 100049 China
| | - Zhi-mei Qi
- grid.9227.e0000000119573309State Key Laboratory of Transducer Technology, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing, 100190 China ,grid.410726.60000 0004 1797 8419School of Electronic, Electrical, and Communication Engineering, University of Chinese Academy of Sciences, Beijing, 100049 China ,grid.410726.60000 0004 1797 8419School of Optoelectronics, University of Chinese Academy of Sciences, Beijing, 100049 China
| |
Collapse
|
10
|
Lin Y, Ma J, Wang Q, Sun DW. Applications of machine learning techniques for enhancing nondestructive food quality and safety detection. Crit Rev Food Sci Nutr 2022; 63:1649-1669. [PMID: 36222697 DOI: 10.1080/10408398.2022.2131725] [Citation(s) in RCA: 19] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022]
Abstract
In considering the need of people all over the world for high-quality food, there has been a recent increase in interest in the role of nondestructive and rapid detection technologies in the food industry. Moreover, the analysis of data acquired by most nondestructive technologies is complex, time-consuming, and requires highly skilled operators. Meanwhile, the general applicability of various chemometric or statistical methods is affected by noise, sample, variability, and data complexity that vary under various testing conditions. Nowadays, machine learning (ML) techniques have a wide range of applications in the food industry, especially in nondestructive technology and equipment intelligence, due to their powerful ability in handling irrelevant information, extracting feature variables, and building calibration models. The review provides an introduction and comparison of machine learning techniques, and summarizes these algorithms as traditional machine learning (TML), and deep learning (DL). Moreover, several novel nondestructive technologies, namely acoustic analysis, machine vision (MV), electronic nose (E-nose), and spectral imaging, combined with different advanced ML techniques and their applications in food quality assessment such as variety identification and classification, safety inspection and processing control, are presented. In addition to this, the existing challenges and prospects are discussed. The result of this review indicates that nondestructive testing technologies combined with state-of-the-art machine learning techniques show great potential for monitoring the quality and safety of food products and different machine learning algorithms have their characteristics and applicability scenarios. Due to the nature of feature learning, DL is one of the most promising and powerful techniques for real-time applications, which needs further research for full and wide applications in the food industry.
Collapse
Affiliation(s)
- Yuandong Lin
- School of Food Science and Engineering, South China University of Technology, Guangzhou 510641, China.,Academy of Contemporary Food Engineering, Guangzhou Higher Education Mega Centre, South China University of Technology, Guangzhou 510006, China.,Engineering and Technological Research Centre of Guangdong Province on Intelligent Sensing and Process Control of Cold Chain Foods, & Guangdong Province Engineering Laboratory for Intelligent Cold Chain Logistics Equipment for Agricultural Products, Guangzhou Higher Education Mega Centre, Guangzhou 510006, China
| | - Ji Ma
- School of Food Science and Engineering, South China University of Technology, Guangzhou 510641, China.,Academy of Contemporary Food Engineering, Guangzhou Higher Education Mega Centre, South China University of Technology, Guangzhou 510006, China.,Engineering and Technological Research Centre of Guangdong Province on Intelligent Sensing and Process Control of Cold Chain Foods, & Guangdong Province Engineering Laboratory for Intelligent Cold Chain Logistics Equipment for Agricultural Products, Guangzhou Higher Education Mega Centre, Guangzhou 510006, China.,State Key Laboratory of Luminescent Materials and Devices, Center for Aggregation-Induced Emission, South China University of Technology, Guangzhou 510641, China
| | - Qijun Wang
- School of Food Science and Engineering, South China University of Technology, Guangzhou 510641, China.,Academy of Contemporary Food Engineering, Guangzhou Higher Education Mega Centre, South China University of Technology, Guangzhou 510006, China.,Engineering and Technological Research Centre of Guangdong Province on Intelligent Sensing and Process Control of Cold Chain Foods, & Guangdong Province Engineering Laboratory for Intelligent Cold Chain Logistics Equipment for Agricultural Products, Guangzhou Higher Education Mega Centre, Guangzhou 510006, China
| | - Da-Wen Sun
- School of Food Science and Engineering, South China University of Technology, Guangzhou 510641, China.,Academy of Contemporary Food Engineering, Guangzhou Higher Education Mega Centre, South China University of Technology, Guangzhou 510006, China.,Engineering and Technological Research Centre of Guangdong Province on Intelligent Sensing and Process Control of Cold Chain Foods, & Guangdong Province Engineering Laboratory for Intelligent Cold Chain Logistics Equipment for Agricultural Products, Guangzhou Higher Education Mega Centre, Guangzhou 510006, China.,Food Refrigeration and Computerized Food Technology (FRCFT), Agriculture and Food Science Centre, University College Dublin, National University of Ireland, Dublin 4, Ireland
| |
Collapse
|
11
|
Lourenco A, Handschuh S, Fenelon M, Gómez-Mascaraque LG. X-ray computerized microtomography and confocal Raman microscopy as complementary techniques to conventional imaging tools for the microstructural characterization of Cheddar cheese. J Dairy Sci 2022; 105:9387-9403. [DOI: 10.3168/jds.2022-22048] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2022] [Accepted: 07/17/2022] [Indexed: 11/07/2022]
|
12
|
Pu H, Wei Q, Sun DW. Recent advances in muscle food safety evaluation: Hyperspectral imaging analyses and applications. Crit Rev Food Sci Nutr 2022; 63:1297-1313. [PMID: 36123794 DOI: 10.1080/10408398.2022.2121805] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/24/2023]
Abstract
As there is growing interest in process control for quality and safety in the meat industry, by integrating spectroscopy and imaging technologies into one system, hyperspectral imaging, or chemical or spectroscopic imaging has become an alternative analytical technique that can provide the spatial distribution of spectrum for fast and nondestructive detection of meat safety. This review addresses the configuration of the hyperspectral imaging system and safety indicators of muscle foods involving biological, chemical, and physical attributes and other associated hazards or poisons, which could cause safety problems. The emphasis focuses on applications of hyperspectral imaging techniques in the safety evaluation of muscle foods, including pork, beef, lamb, chicken, fish and other meat products. Although HSI can provide the spatial distribution of spectrum, characterized by overtones and combinations of the C-H, N-H, and O-H groups using different combinations of a light source, imaging spectrograph and camera, there still needs improvement to overcome the disadvantages of HSI technology for further applications at the industrial level.
Collapse
Affiliation(s)
- Hongbin Pu
- School of Food Science and Engineering, South China University of Technology, Guangzhou, China.,Academy of Contemporary Food Engineering, South China University of Technology, Guangzhou Higher Education Mega Center, Guangzhou, China.,Engineering and Technological Research Centre of Guangdong Province on Intelligent Sensing and Process Control of Cold Chain Foods, & Guangdong Province Engineering Laboratory for Intelligent Cold Chain Logistics Equipment for Agricultural Products, Guangzhou Higher Education Mega Centre, Guangzhou, China
| | - Qingyi Wei
- School of Food Science and Engineering, South China University of Technology, Guangzhou, China.,Academy of Contemporary Food Engineering, South China University of Technology, Guangzhou Higher Education Mega Center, Guangzhou, China.,Engineering and Technological Research Centre of Guangdong Province on Intelligent Sensing and Process Control of Cold Chain Foods, & Guangdong Province Engineering Laboratory for Intelligent Cold Chain Logistics Equipment for Agricultural Products, Guangzhou Higher Education Mega Centre, Guangzhou, China
| | - Da-Wen Sun
- School of Food Science and Engineering, South China University of Technology, Guangzhou, China.,Academy of Contemporary Food Engineering, South China University of Technology, Guangzhou Higher Education Mega Center, Guangzhou, China.,Engineering and Technological Research Centre of Guangdong Province on Intelligent Sensing and Process Control of Cold Chain Foods, & Guangdong Province Engineering Laboratory for Intelligent Cold Chain Logistics Equipment for Agricultural Products, Guangzhou Higher Education Mega Centre, Guangzhou, China.,Food Refrigeration and Computerized Food Technology, University College Dublin, National University of Ireland, Agriculture and Food Science Centre, Belfield, Ireland
| |
Collapse
|
13
|
Abstract
Food quality and safety are the essential hot issues of social concern. In recent years, there has been a growing demand for real-time food information, and non-destructive testing is gradually replacing traditional manual sensory testing and chemical analysis methods with lagging and destructive effects and has strong potential for application in the food supply chain. With the maturity and development of computer science and spectroscopic techniques, machine learning and hyperspectral imaging (HSI) have been widely demonstrated as efficient detection techniques that can be applied to rapidly evaluate sensory characteristics and quality attributes of food products nondestructively and efficiently. This paper first briefly described the basic concepts of hyperspectral imaging and machine learning, including the imaging process of HSI, the type of algorithms contained in machine learning, and the data processing flow. Secondly, this paper provided an objective and comprehensive overview of the current applications of machine learning and HSI in the food supply chain for sorting, packaging, transportation, storage, and sales, based on the state-of-art literature from 2017 to 2022. Finally, the potential of the technology is further discussed to provide optimized ideas for practical application.
Collapse
|
14
|
Detection of moisture content in salted sea cucumbers by hyperspectral and low field nuclear magnetic resonance based on deep learning network framework. Food Res Int 2022; 156:111174. [DOI: 10.1016/j.foodres.2022.111174] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2022] [Revised: 03/16/2022] [Accepted: 03/17/2022] [Indexed: 11/23/2022]
|
15
|
Intelligent biosensing strategies for rapid detection in food safety: A review. Biosens Bioelectron 2022; 202:114003. [DOI: 10.1016/j.bios.2022.114003] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2021] [Revised: 11/15/2021] [Accepted: 01/13/2022] [Indexed: 12/26/2022]
|
16
|
Hu X, Liu H, Qiu C, Liu D. Inspection of Line Defects in Transition Metal Dichalcogenides Using a Microscopic Hyperspectral Imaging Technique. J Phys Chem Lett 2022; 13:2226-2230. [PMID: 35238568 DOI: 10.1021/acs.jpclett.1c03968] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
The line defects of two-dimensional (2D) transition metal dichalcogenides (TMDs) play a vital role in determining their device performance. In this work, a microscopic hyperspectral imaging technique based on differential reflectance was introduced for the online inspection of line defects in TMDs. Upon comparison of the measurement results of imaging and spectra, the relationship between optical contrast and differential reflectance spectra was established. A light selection method was proposed to optimize the optical contrast of line defects. Via application of an image processing algorithm, an automatic detection of the line defects with a classification accuracy of 95% was achieved for WS2, MoS2, and MoSe2. This work not only provides a microscopic hyperspectral imaging technique for detecting 2D material defects but also introduces a versatile design strategy for developing an advanced machine vision spectroscopic system.
Collapse
Affiliation(s)
- Xiangmin Hu
- State Key Laboratory of Tribology, Tsinghua University, Beijing 100084, China
| | - Huixian Liu
- State Key Laboratory of Tribology, Tsinghua University, Beijing 100084, China
| | - Cuicui Qiu
- State Key Laboratory of Tribology, Tsinghua University, Beijing 100084, China
| | - Dameng Liu
- State Key Laboratory of Tribology, Tsinghua University, Beijing 100084, China
| |
Collapse
|
17
|
Saita Y, Shimoyama D, Takahashi R, Nomura T. Single-shot compressive hyperspectral imaging with dispersed and undispersed light using a generally available grating. APPLIED OPTICS 2022; 61:1106-1111. [PMID: 35201161 DOI: 10.1364/ao.441568] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/25/2021] [Accepted: 12/21/2021] [Indexed: 06/14/2023]
Abstract
Commercially available hyperspectral cameras are useful for remote sensing, but in most cases snapshot imaging is difficult due to the need for scanning. The coded aperture snapshot spectral imager (CASSI) has been proposed to simultaneously acquire a target scene's spatial and spectral dimensional data, employing a refractive prism as a disperser. This paper proposes a CASSI-based technique using a generally available diffraction grating of a Ronchi ruling and blazed grating and its improvement using the undispersed zeroth-order light. The feasibility and performance of the proposed technique are experimentally validated, and the grating parameters are identified.
Collapse
|
18
|
Xu D. Application of Microspectral Imaging in Motor and Sensory Nerve Classification. JOURNAL OF HEALTHCARE ENGINEERING 2021; 2021:4954540. [PMID: 34912533 PMCID: PMC8668288 DOI: 10.1155/2021/4954540] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/27/2021] [Accepted: 11/06/2021] [Indexed: 11/24/2022]
Abstract
Objective It aimed to explore the application of the microscopic hyperspectral technique in motor and sensory nerve classification. Methods The self-developed microscopic hyperspectral acquisition system was applied to collect the data of anterior and posterior spinal cord sections of white rabbits. The joint correction algorithm was employed to preprocess the collected data, such as noise reduction. On the basis of pure linear light source index, a new pixel purification algorithm based on cross contrast was proposed to extract more regions of interest, which was used for feature extraction of motor and sensory nerves. Besides, the ML algorithm was employed to classify motor and sensory nerves based on feature extraction results. Results The joint correction algorithm was adopted to preprocess the data collected by the microscopic hyperspectral technique, so as to eliminate the influence of the incident light source and the system and improve the classification accuracy. The axon and myelin spectrum curves of the two kinds of nerves in the stained specimens had the same trend, but the values of all kinds of spectrum of sensory nerves were higher than those of motor nerves. However, the myelin sheath spectrum curves of motor nerves in the unstained specimens were greatly different from the curves of sensory nerves. The axon spectrum curves had the same trend, but the axon spectrum values of sensory nerves were higher than those of motor nerves. The ML algorithm had high accuracy and fast speed in motor and sensory nerve classification, and the classification effect of stained specimens was better than that of unstained specimens. Conclusion The microscopic hyperspectral technique had high feasibility in sensory and motor nerve classification and was worthy of further research and promotion.
Collapse
Affiliation(s)
- Du Xu
- Xi'an University of Posts and Telecommunications, Shanxi, Xi'an 710100, China
| |
Collapse
|
19
|
Jiao C, Xu Z, Bian Q, Forsberg E, Tan Q, Peng X, He S. Machine learning classification of origins and varieties of Tetrastigma hemsleyanum using a dual-mode microscopic hyperspectral imager. SPECTROCHIMICA ACTA. PART A, MOLECULAR AND BIOMOLECULAR SPECTROSCOPY 2021; 261:120054. [PMID: 34119773 DOI: 10.1016/j.saa.2021.120054] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/22/2021] [Revised: 05/26/2021] [Accepted: 06/02/2021] [Indexed: 06/12/2023]
Abstract
A dual-mode microscopic hyperspectral imager (DMHI) combined with a machine learning algorithm for the purpose of classifying origins and varieties of Tetrastigma hemsleyanum (T. hemsleyanum) was developed. By switching the illumination source, the DMHI can operate in reflection imaging and fluorescence detection modes. The DMHI system has excellent performance with spatial and spectral resolutions of 27.8 μm and 3 nm, respectively. To verify the capability of the DMHI system, a series of classification experiments of T. hemsleyanum were conducted. Captured hyperspectral datasets were analyzed using principal component analysis (PCA) for dimensional reduction, and a support vector machine (SVM) model was used for classification. In reflection microscopic hyperspectral imaging (RMHI) mode, the classification accuracies of T. hemsleyanum origins and varieties were 96.3% and 97.3%, respectively, while in fluorescence microscopic hyperspectral imaging (FMHI) mode, the classification accuracies were 97.3% and 100%, respectively. Combining datasets in dual mode, excellent predictions of origin and variety were realized by the trained model, both with a 97.5% accuracy on a newly measured test set. The results show that the DMHI system is capable of T. hemsleyanum origin and variety classification, and has the potential for non-invasive detection and rapid quality assessment of various kinds of medicinal herbs.
Collapse
Affiliation(s)
- Changwei Jiao
- Centre for Optical and Electromagnetic Research, National Engineering Research Center for Optical Instruments, Zhejiang Provincial Key Laboratory for Sensing Technologies, Zhejiang University, Hangzhou 310058, China
| | - Zhanpeng Xu
- Centre for Optical and Electromagnetic Research, National Engineering Research Center for Optical Instruments, Zhejiang Provincial Key Laboratory for Sensing Technologies, Zhejiang University, Hangzhou 310058, China.
| | - Qiuwan Bian
- Centre for Optical and Electromagnetic Research, National Engineering Research Center for Optical Instruments, Zhejiang Provincial Key Laboratory for Sensing Technologies, Zhejiang University, Hangzhou 310058, China
| | - Erik Forsberg
- Centre for Optical and Electromagnetic Research, National Engineering Research Center for Optical Instruments, Zhejiang Provincial Key Laboratory for Sensing Technologies, Zhejiang University, Hangzhou 310058, China
| | - Qin Tan
- Centre for Optical and Electromagnetic Research, National Engineering Research Center for Optical Instruments, Zhejiang Provincial Key Laboratory for Sensing Technologies, Zhejiang University, Hangzhou 310058, China
| | - Xin Peng
- Ningbo Research Institute, Zhejiang University, Ningbo 315100, China.
| | - Sailing He
- Centre for Optical and Electromagnetic Research, National Engineering Research Center for Optical Instruments, Zhejiang Provincial Key Laboratory for Sensing Technologies, Zhejiang University, Hangzhou 310058, China.
| |
Collapse
|
20
|
Current and emergent analytical methods for monitoring the behavior of agricultural functional nanoparticles in relevant matrices: a review. Curr Opin Chem Eng 2021. [DOI: 10.1016/j.coche.2021.100706] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
21
|
Yu HD, Qing LW, Yan DT, Xia G, Zhang C, Yun YH, Zhang W. Hyperspectral imaging in combination with data fusion for rapid evaluation of tilapia fillet freshness. Food Chem 2021; 348:129129. [PMID: 33515952 DOI: 10.1016/j.foodchem.2021.129129] [Citation(s) in RCA: 34] [Impact Index Per Article: 11.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2020] [Revised: 01/09/2021] [Accepted: 01/13/2021] [Indexed: 01/01/2023]
Abstract
The potential of two different hyperspectral imaging systems (visible near infrared spectroscopy (Vis-NIR) and NIR) was investigated to determine TVB-N contents in tilapia fillets during cold storage. With Vis-NIR and NIR data, calibration models were established between the average spectra of tilapia fillets in the hyperspectral image and their corresponding TVB-N contents and optimized with various variable selection and data fusion methods. Superior models were obtained with variable selection methods based on low-level fusion data when compared with the corresponding methods based on single data blocks. Mid-level fusion data achieved the best model based on CARS, in comparison with all others. Finally, the respective optimized models of single Vis-NIR and NIR data were employed to visualize TVB-N contents distribution in tilapia fillets. In general, the results showed the great feasibility of hyperspectral imaging in combination with data fusion analysis in the nondestructive evaluation of tilapia fillet freshness.
Collapse
Affiliation(s)
- Hai-Dong Yu
- College of Food Science and Engineering, Hainan University, 58 Renmin Road, Haikou 570228, China
| | - Li-Wei Qing
- College of Food Science and Engineering, Hainan University, 58 Renmin Road, Haikou 570228, China
| | - Dan-Ting Yan
- College of Food Science and Engineering, Hainan University, 58 Renmin Road, Haikou 570228, China
| | - Guanghua Xia
- College of Food Science and Engineering, Hainan University, 58 Renmin Road, Haikou 570228, China; Hainan Engineering Research Center of Aquatic Resources Efficient Utilization in South China Sea, Hainan University, Haikou 570228, China
| | - Chenghui Zhang
- College of Food Science and Engineering, Hainan University, 58 Renmin Road, Haikou 570228, China
| | - Yong-Huan Yun
- College of Food Science and Engineering, Hainan University, 58 Renmin Road, Haikou 570228, China; Hainan Engineering Research Center of Aquatic Resources Efficient Utilization in South China Sea, Hainan University, Haikou 570228, China.
| | - Weimin Zhang
- College of Food Science and Engineering, Hainan University, 58 Renmin Road, Haikou 570228, China.
| |
Collapse
|
22
|
Hyperspectral imaging and deep learning for quantification of Clostridium sporogenes spores in food products using 1D- convolutional neural networks and random forest model. Food Res Int 2021; 147:110577. [PMID: 34399549 DOI: 10.1016/j.foodres.2021.110577] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2020] [Revised: 06/24/2021] [Accepted: 06/27/2021] [Indexed: 11/23/2022]
Abstract
Clostridium sporogenes spores are used as surrogates for Clostridium botulinum, to verify thermal exposure and lethality in sterilization regimes by food industries. Conventional methods to detect spores are time-consuming and labour intensive. The objectives of this study were to evaluate the feasibility of using hyperspectral imaging (HSI) and deep learning approaches, firstly to identify dead and live forms of C. sporogenes spores and secondly, to estimate the concentration of spores on culture media plates and ready-to-eat mashed potato (food matrix). C. sporogenes spores were inoculated by either spread plating or drop plating on sheep blood agar (SBA) and tryptic soy agar (TSA) plates and by spread plating on the surface of mashed potato. Reflectance in the spectral range of 547-1701 nm from the region of interest was used for principal component analysis (PCA). PCA was successful in distinguishing dead and live spores and different levels of inoculum (102 to 106 CFU/ml) on both TSA and SBA plates, however, was not efficient on the mashed potato (food matrix). Hence, deep learning classification frameworks namely 1D- convolutional neural networks (CNN) and random forest (RF) model were used. CNN model outperformed the RF model and the accuracy for quantification of spores was improved by 4% and 8% in the presence and absence, respectively of dead spores. The screening system used in this study was a combination of HSI and deep learning modelling, which resulted in an overall accuracy of 90-94% when the dead/inactivated spores were present and absent, respectively. The only discrepancy detected was during the prediction of samples with low inoculum levels (<102 CFU/ml). In summary, it was evident that HSI in combination with a deep learning approach showed immense potential as a tool to detect and quantify spores on nutrient media as well as on specific food matrix (mashed potato). However, the presence of dead spores in any sample is postulated to affect the accuracy and would need replicates and confirmatory assays.
Collapse
|
23
|
Dong X, Tong G, Song X, Xiao X, Yu Y. DMD-based hyperspectral microscopy with flexible multiline parallel scanning. MICROSYSTEMS & NANOENGINEERING 2021; 7:68. [PMID: 34567780 PMCID: PMC8433375 DOI: 10.1038/s41378-021-00299-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/24/2021] [Revised: 07/21/2021] [Accepted: 07/23/2021] [Indexed: 05/16/2023]
Abstract
As one of the most common hyperspectral microscopy (HSM) techniques, line-scanning HSM is currently utilized in many fields. However, its scanning efficiency is still considered to be inadequate since many biological and chemical processes occur too rapidly to be captured. Accordingly, in this work, a digital micromirror device (DMD) based on microelectromechanical systems (MEMS) is utilized to demonstrate a flexible multiline scanning HSM system. To the best of our knowledge, this is the first line-scanning HSM system in which the number of scanning lines N can be tuned by simply changing the DMD's parallel scanning units according to diverse applications. This brilliant strategy of effortless adjustability relies only on on-chip scanning methods and totally exploits the benefits of parallelization, aiming to achieve nearly an N-time improvement in the detection efficiency and an N-time decrease in the scanning time and data volume compared with the single-line method under the same operating conditions. To validate this, we selected a few samples of different spectral wavebands to perform reflection imaging, transmission imaging, and fluorescence imaging with varying numbers of scanning lines. The results show the great potential of our DMD-based HSM system for the rapid development of cellular biology, material analysis, and so on. In addition, its on-chip scanning process eliminates the inherent microscopic architecture, making the whole system compact, lightweight, portable, and not subject to site constraints.
Collapse
Affiliation(s)
- Xue Dong
- Research & Development Institute of Northwestern Polytechnical University in Shenzhen, Shenzhen, 518057 China
- Ningbo Institute of Northwestern Polytechnical University, Ningbo, 315103 China
- Key Laboratory of Micro/Nano Systems for Aerospace (Ministry of Education), Northwestern Polytechnical University, Xi’an, 710072 China
- Shaanxi Province Key Laboratory of Micro and Nano Electro-Mechanical Systems, Northwestern Polytechnical University, Xi’an, 710072 China
| | - Geng Tong
- Research & Development Institute of Northwestern Polytechnical University in Shenzhen, Shenzhen, 518057 China
- Ningbo Institute of Northwestern Polytechnical University, Ningbo, 315103 China
- Key Laboratory of Micro/Nano Systems for Aerospace (Ministry of Education), Northwestern Polytechnical University, Xi’an, 710072 China
- Shaanxi Province Key Laboratory of Micro and Nano Electro-Mechanical Systems, Northwestern Polytechnical University, Xi’an, 710072 China
| | - Xuankun Song
- Research & Development Institute of Northwestern Polytechnical University in Shenzhen, Shenzhen, 518057 China
- Ningbo Institute of Northwestern Polytechnical University, Ningbo, 315103 China
- Key Laboratory of Micro/Nano Systems for Aerospace (Ministry of Education), Northwestern Polytechnical University, Xi’an, 710072 China
- Shaanxi Province Key Laboratory of Micro and Nano Electro-Mechanical Systems, Northwestern Polytechnical University, Xi’an, 710072 China
| | - Xingchen Xiao
- Research & Development Institute of Northwestern Polytechnical University in Shenzhen, Shenzhen, 518057 China
- Ningbo Institute of Northwestern Polytechnical University, Ningbo, 315103 China
- Key Laboratory of Micro/Nano Systems for Aerospace (Ministry of Education), Northwestern Polytechnical University, Xi’an, 710072 China
- Shaanxi Province Key Laboratory of Micro and Nano Electro-Mechanical Systems, Northwestern Polytechnical University, Xi’an, 710072 China
| | - Yiting Yu
- Research & Development Institute of Northwestern Polytechnical University in Shenzhen, Shenzhen, 518057 China
- Ningbo Institute of Northwestern Polytechnical University, Ningbo, 315103 China
- Key Laboratory of Micro/Nano Systems for Aerospace (Ministry of Education), Northwestern Polytechnical University, Xi’an, 710072 China
- Shaanxi Province Key Laboratory of Micro and Nano Electro-Mechanical Systems, Northwestern Polytechnical University, Xi’an, 710072 China
| |
Collapse
|
24
|
Jie D, Wu S, Wang P, Li Y, Ye D, Wei X. Research on Citrus grandis Granulation Determination Based on Hyperspectral Imaging through Deep Learning. FOOD ANAL METHOD 2020. [DOI: 10.1007/s12161-020-01873-6] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
25
|
Wang Z, Erasmus SW, Liu X, van Ruth SM. Study on the Relations between Hyperspectral Images of Bananas ( Musa spp.) from Different Countries, Their Compositional Traits and Growing Conditions. SENSORS (BASEL, SWITZERLAND) 2020; 20:E5793. [PMID: 33066269 PMCID: PMC7602010 DOI: 10.3390/s20205793] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/07/2020] [Revised: 10/02/2020] [Accepted: 10/12/2020] [Indexed: 12/11/2022]
Abstract
Bananas are some of the most popular fruits around the world. However, there is limited research that explores hyperspectral imaging of bananas and its relationship with the chemical composition and growing conditions. In the study, the relations that exist between the visible near-infrared hyperspectral reflectance imaging data in the 400-1000 nm range of the bananas collected from different countries, the compositional traits and local growing conditions (altitude, temperature and rainfall) and production management (organic/conventional) were explored. The main compositional traits included moisture, starch, dietary fibre, protein, carotene content and the CIE L*a*b* colour values were also determined. The principal component analysis showed the preliminary separation of bananas from different geographical origins and production systems. The compositional and spectral data revealed positively and negatively moderate correlations (r around ±0.50, p < 0.05) between the carotene, starch content, and colour values (a*, b*) on the one hand and the wavelength ranges 405-525 nm, 615-645 nm, 885-985 nm on the other hand. Since the variation in composition and colour values were related to rainfall and temperature, the spectral information is likely also influenced by the growing conditions. The results could be useful to the industry for the improvement of banana quality and traceability.
Collapse
Affiliation(s)
- Zhijun Wang
- Food Quality and Design Group, Wageningen University and Research, P.O. Box 17, 6700 AA Wageningen, The Netherlands; (Z.W.); (S.W.E.); (X.L.)
| | - Sara Wilhelmina Erasmus
- Food Quality and Design Group, Wageningen University and Research, P.O. Box 17, 6700 AA Wageningen, The Netherlands; (Z.W.); (S.W.E.); (X.L.)
| | - Xiaotong Liu
- Food Quality and Design Group, Wageningen University and Research, P.O. Box 17, 6700 AA Wageningen, The Netherlands; (Z.W.); (S.W.E.); (X.L.)
| | - Saskia M. van Ruth
- Food Quality and Design Group, Wageningen University and Research, P.O. Box 17, 6700 AA Wageningen, The Netherlands; (Z.W.); (S.W.E.); (X.L.)
- Wageningen Food Safety Research, Wageningen University and Research, P.O. Box 230, 6700 AE Wageningen, The Netherlands
| |
Collapse
|
26
|
Mehta N, Sahu SP, Shaik S, Devireddy R, Gartia MR. Dark-field hyperspectral imaging for label free detection of nano-bio-materials. WILEY INTERDISCIPLINARY REVIEWS-NANOMEDICINE AND NANOBIOTECHNOLOGY 2020; 13:e1661. [PMID: 32755036 DOI: 10.1002/wnan.1661] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/11/2019] [Revised: 05/21/2020] [Accepted: 06/19/2020] [Indexed: 12/12/2022]
Abstract
Nanomaterials are playing an increasingly important role in cancer diagnosis and treatment. Nanoparticle (NP)-based technologies have been utilized for targeted drug delivery during chemotherapies, photodynamic therapy, and immunotherapy. Another active area of research is the toxicity studies of these nanomaterials to understand the cellular uptake and transport of these materials in cells, tissues, and environment. Traditional techniques such as transmission electron microscopy, and mass spectrometry to analyze NP-based cellular transport or toxicity effect are expensive, require extensive sample preparation, and are low-throughput. Dark-field hyperspectral imaging (DF-HSI), an integration of spectroscopy and microscopy/imaging, provides the ability to investigate cellular transport of these NPs and to quantify the distribution of them within bio-materials. DF-HSI also offers versatility in non-invasively monitoring microorganisms, single cell, and proteins. DF-HSI is a low-cost, label-free technique that is minimally invasive and is a viable choice for obtaining high-throughput quantitative molecular analyses. Multimodal imaging modalities such as Fourier transform infrared and Raman spectroscopy are also being integrated with HSI systems to enable chemical imaging of the samples. HSI technology is being applied in surgeries to obtain molecular information about the tissues in real-time. This article provides brief overview of fundamental principles of DF-HSI and its application for nanomaterials, protein-detection, single-cell analysis, microbiology, surgical procedures along with technical challenges and future integrative approach with other imaging and measurement modalities. This article is categorized under: Diagnostic Tools > in vitro Nanoparticle-Based Sensing Diagnostic Tools > in vivo Nanodiagnostics and Imaging Implantable Materials and Surgical Technologies > Nanoscale Tools and Techniques in Surgery.
Collapse
Affiliation(s)
- Nishir Mehta
- Department of Mechanical and Industrial Engineering, Louisiana State University, Baton Rouge, Louisiana, USA
| | - Sushant P Sahu
- Department of Mechanical and Industrial Engineering, Louisiana State University, Baton Rouge, Louisiana, USA
| | - Shahensha Shaik
- Department of Mechanical and Industrial Engineering, Louisiana State University, Baton Rouge, Louisiana, USA
| | - Ram Devireddy
- Department of Mechanical and Industrial Engineering, Louisiana State University, Baton Rouge, Louisiana, USA
| | - Manas Ranjan Gartia
- Department of Mechanical and Industrial Engineering, Louisiana State University, Baton Rouge, Louisiana, USA
| |
Collapse
|
27
|
Tsakanikas P, Karnavas A, Panagou EZ, Nychas GJ. A machine learning workflow for raw food spectroscopic classification in a future industry. Sci Rep 2020; 10:11212. [PMID: 32641761 PMCID: PMC7343812 DOI: 10.1038/s41598-020-68156-2] [Citation(s) in RCA: 34] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2019] [Accepted: 06/07/2020] [Indexed: 12/24/2022] Open
Abstract
Over the years, technology has changed the way we produce and have access to our food through the development of applications, robotics, data analysis, and processing techniques. The implementation of these approaches by the food industry ensure quality and affordability, reducing at the same time the costs of keeping the food fresh and increase productivity. A system, as the one presented herein, for raw food categorization is needed in future food industries to automate food classification according to type, the process of algorithm approaches that will be applied to every different food origin and also for serving disabled people. The purpose of this work was to develop a machine learning workflow based on supervised PLS regression and SVM classification, towards automated raw food categorization from FTIR. The system exhibited high efficiency in multi-class classification of 7 different types of raw food. The selected food samples, were diverse in terms of storage conditions (temperature, storage time and packaging), while the variability within each food was also taken into account by several different batches; leading in a classifier able to embed this variation towards increased robustness and efficiency, ready for real life applications targeting to the digital transformation of the food industry.
Collapse
Affiliation(s)
- Panagiotis Tsakanikas
- School of Food and Nutritional Sciences, Department of Food Science and Human Nutrition, Laboratory of Microbiology and Biotechnology of Foods, Agricultural University of Athens, Iera Odos 75, 11855, Athens, Greece.
| | - Apostolos Karnavas
- School of Food and Nutritional Sciences, Department of Food Science and Human Nutrition, Laboratory of Microbiology and Biotechnology of Foods, Agricultural University of Athens, Iera Odos 75, 11855, Athens, Greece
| | - Efstathios Z Panagou
- School of Food and Nutritional Sciences, Department of Food Science and Human Nutrition, Laboratory of Microbiology and Biotechnology of Foods, Agricultural University of Athens, Iera Odos 75, 11855, Athens, Greece
| | - George-John Nychas
- School of Food and Nutritional Sciences, Department of Food Science and Human Nutrition, Laboratory of Microbiology and Biotechnology of Foods, Agricultural University of Athens, Iera Odos 75, 11855, Athens, Greece.
| |
Collapse
|
28
|
Huang X, Guo Q, Zhang R, Zhao Z, Leng Y, Lam JWY, Xiong Y, Tang BZ. AIEgens: An emerging fluorescent sensing tool to aid food safety and quality control. Compr Rev Food Sci Food Saf 2020; 19:2297-2329. [PMID: 33337082 DOI: 10.1111/1541-4337.12591] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2020] [Revised: 05/06/2020] [Accepted: 05/20/2020] [Indexed: 12/17/2022]
Abstract
As a global public health problem, food safety has attracted increasing concern. To minimize the risk exposure of food to harmful ingredients, food quality and safety inspection that covers the whole process of "from farm to fork" is much desired. Fluorescent sensing is a promising and powerful screening tool for sensing hazardous substances in food and thus plays a crucial role in promoting food safety assurance. However, traditional fluorphores generally suffer the problem of aggregation-caused quenching (ACQ) effect, which limit their application in food quality and safety inspection. In this regard, luminogens with aggregation-induced emission property (AIEgens) showed large potential in food analysis since AIEgens effectively surmount the ACQ effect with much better detection sensitivity, accuracy, and robustness. In this contribution, we review the latest developments of food safety monitoring by AIEgens, which will focus on the molecular design of AIEgens and their sensing principles. Several examples of AIE-based sensing applications for screening food contaminations are highlighted, and future perspectives and challenges in this emerging field are tentatively elaborated. We hope this review can motivate new research ideas and interest to aid food safety and quality control, and facilitate more collaborative endeavors to advance the state-of-the-art sensing developments and reduce actual translational gap between laboratory research and industrial production.
Collapse
Affiliation(s)
- Xiaolin Huang
- State Key Laboratory of Food Science and Technology, Nanchang University, Nanchang, P. R. China.,Department of Chemistry, the Hong Kong Branch of Chinese National Engineering Research Center for Tissue Restoration and Reconstruction, Institute for Advanced Study, the Hong Kong University of Science and Technology, Kowloon, Hong Kong, China.,School of Food Science and Technology, Nanchang University, Nanchang, P. R. China
| | - Qian Guo
- State Key Laboratory of Food Science and Technology, Nanchang University, Nanchang, P. R. China.,School of Food Science and Technology, Nanchang University, Nanchang, P. R. China
| | - Ruoyao Zhang
- Department of Chemistry, the Hong Kong Branch of Chinese National Engineering Research Center for Tissue Restoration and Reconstruction, Institute for Advanced Study, the Hong Kong University of Science and Technology, Kowloon, Hong Kong, China
| | - Zheng Zhao
- Department of Chemistry, the Hong Kong Branch of Chinese National Engineering Research Center for Tissue Restoration and Reconstruction, Institute for Advanced Study, the Hong Kong University of Science and Technology, Kowloon, Hong Kong, China
| | - Yuankui Leng
- State Key Laboratory of Food Science and Technology, Nanchang University, Nanchang, P. R. China.,School of Food Science and Technology, Nanchang University, Nanchang, P. R. China
| | - Jacky W Y Lam
- Department of Chemistry, the Hong Kong Branch of Chinese National Engineering Research Center for Tissue Restoration and Reconstruction, Institute for Advanced Study, the Hong Kong University of Science and Technology, Kowloon, Hong Kong, China
| | - Yonghua Xiong
- State Key Laboratory of Food Science and Technology, Nanchang University, Nanchang, P. R. China.,School of Food Science and Technology, Nanchang University, Nanchang, P. R. China
| | - Ben Zhong Tang
- Department of Chemistry, the Hong Kong Branch of Chinese National Engineering Research Center for Tissue Restoration and Reconstruction, Institute for Advanced Study, the Hong Kong University of Science and Technology, Kowloon, Hong Kong, China
| |
Collapse
|
29
|
Beć KB, Grabska J, Huck CW. Biomolecular and bioanalytical applications of infrared spectroscopy - A review. Anal Chim Acta 2020; 1133:150-177. [PMID: 32993867 DOI: 10.1016/j.aca.2020.04.015] [Citation(s) in RCA: 67] [Impact Index Per Article: 16.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2019] [Revised: 04/05/2020] [Accepted: 04/06/2020] [Indexed: 12/11/2022]
Abstract
Infrared (IR; or mid-infrared, MIR; 4000-400 cm-1; 2500-25,000 nm) spectroscopy has become one of the most powerful and versatile tools at the disposal of modern bioscience. Because of its high molecular specificity, applicability to wide variety of samples, rapid measurement and non-invasivity, IR spectroscopy forms a potent approach to elucidate qualitative and quantitative information from various kinds of biological material. For these reasons, it became an established bioanalytical technique with diverse applications. This work aims to be a comprehensive and critical review of the recent accomplishments in the field of biomolecular and bioanalytical IR spectroscopy. That progress is presented on a wider background, with fundamental characteristics, the basic principles of the technique outlined, and its scientific capability directly compared with other methods being used in similar fields (e.g. near-infrared, Raman, fluorescence). The article aims to present a complete examination of the topic, as it touches the background phenomena, instrumentation, spectra processing and data analytical methods, spectra interpretation and related information. To suit this goal, the article includes a tutorial information essential to obtain a thorough perspective of bio-related applications of the reviewed methodologies. The importance of the fundamental factors to the final performance and applicability of IR spectroscopy in various areas of bioscience is explained. This information is interpreted in critical way, with aim to gain deep understanding why IR spectroscopy finds extraordinarily intensive use in this remarkably diverse and dynamic field of research and utility. The major focus is placed on the diversity of the applications in which IR biospectroscopy has been established so far and those onto which it is expanding nowadays. This includes qualitative and quantitative analytical spectroscopy, spectral imaging, medical diagnosis, monitoring of biophysical processes, and studies of physicochemical properties and dynamics of biomolecules. The application potential of IR spectroscopy in light of the current accomplishments and the future prospects is critically evaluated and its significance in the progress of bioscience is comprehensively presented.
Collapse
Affiliation(s)
- Krzysztof B Beć
- Institute of Analytical Chemistry and Radiochemistry, Center for Chemistry and Biomedicine, University of Innsbruck, Innrain 80/82, A-6020, Innsbruck, Austria.
| | - Justyna Grabska
- Institute of Analytical Chemistry and Radiochemistry, Center for Chemistry and Biomedicine, University of Innsbruck, Innrain 80/82, A-6020, Innsbruck, Austria
| | - Christian W Huck
- Institute of Analytical Chemistry and Radiochemistry, Center for Chemistry and Biomedicine, University of Innsbruck, Innrain 80/82, A-6020, Innsbruck, Austria.
| |
Collapse
|
30
|
Ren H, Sun WF. Characterizing Dielectric Permittivity of Nanoscale Dielectric Films by Electrostatic Micro-Probe Technology: Finite Element Simulations. SENSORS (BASEL, SWITZERLAND) 2019; 19:E5405. [PMID: 31817944 PMCID: PMC6960583 DOI: 10.3390/s19245405] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/29/2019] [Revised: 11/26/2019] [Accepted: 12/06/2019] [Indexed: 11/16/2022]
Abstract
Finite element simulations for detecting the dielectric permittivity of planar nanoscale dielectrics by electrostatic probe are performed to explore the microprobe technology of characterizing nanomaterials. The electrostatic force produced by the polarization of nanoscale dielectrics is analyzed by a capacitance gradient between the probe and nano-sample in an electrostatic detection system, in which sample thickness is varied in the range of 1 nm-10 μm, the width (diameter) encompasses from 100 nm to 10 μm, the tilt angle of probe alters between 0° and 20°, and the relative dielectric constant covers 2-1000 to represent a majority of dielectric materials. For dielectric thin films with infinite lateral dimension, the critical diameter is determined, not only by the geometric shape and tilt angle of detecting probe, but also by the thickness of the tested nanofilm. Meanwhile, for the thickness greater than 100 nm, the critical diameter is almost independent on the probe geometry while being primarily dominated by the thickness and dielectric permittivity of nanomaterials, which approximately complies a variation as exponential functions. For nanofilms with a plane size which can be regarded as infinite, a pertaining analytical formalism is established and verified for the film thickness in an ultrathin limit of 10-100 nm, with the probe axis being perpendicular and tilt to film plane, respectively. The present research suggests a general testing scheme for characterizing flat, nanoscale, dielectric materials on metal substrates by means of electrostatic microscopy, which can realize an accurate quantitative analysis of dielectric permittivity.
Collapse
Affiliation(s)
| | - Wei-Feng Sun
- Key Laboratory of Engineering Dielectrics and Its Application, Ministry of Education, School of Electrical and Electronic Engineering, Harbin University of Science and Technology, Harbin 150080, China;
| |
Collapse
|