1
|
Tang T, Zhang M, Mujumdar AS. Intelligent detection for fresh-cut fruit and vegetable processing: Imaging technology. Compr Rev Food Sci Food Saf 2022; 21:5171-5198. [PMID: 36156851 DOI: 10.1111/1541-4337.13039] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2022] [Revised: 07/31/2022] [Accepted: 08/23/2022] [Indexed: 01/28/2023]
Abstract
Fresh-cut fruits and vegetables are healthy and convenient ready-to-eat foods, and the final quality is related to the raw materials and each step of the cutting unit. It is necessary to integrate suitable intelligent detection technologies into the production chain so as to inspect each operation to ensure high product quality. In this paper, several imaging technologies that can be applied online to the processing of fresh-cut products are reviewed, including: multispectral/hyperspectral imaging (M/HSI), fluorescence imaging (FI), X-ray imaging (XRI), ultrasonic imaging, thermal imaging (TI), magnetic resonance imaging (MRI), terahertz imaging, and microwave imaging (MWI). The principles, advantages, and limitations of these imaging technologies are critically summarized. The potential applications of these technologies in online quality control and detection during the fresh-cut processing are comprehensively discussed, including quality of raw materials, contamination of cutting equipment, foreign bodies mixed in the processing, browning and microorganisms of the cutting surface, quality/shelf-life evaluation, and so on. Finally, the challenges and future application prospects of imaging technology in industrialization are presented.
Collapse
Affiliation(s)
- Tiantian Tang
- State Key Laboratory of Food Science and Technology, Jiangnan University, Wuxi, Jiangsu, China.,Jiangsu Province International Joint Laboratory on Fresh Food Smart Processing and Quality Monitoring, Jiangnan University, Wuxi, Jiangsu, China
| | - Min Zhang
- State Key Laboratory of Food Science and Technology, Jiangnan University, Wuxi, Jiangsu, China.,China General Chamber of Commerce Key Laboratory on Fresh Food Processing & Preservation, Jiangnan University, Wuxi, Jiangsu, China
| | - Arun S Mujumdar
- Department of Bioresource Engineering, Macdonald Campus, McGill University, Montreal, Quebec, Canada
| |
Collapse
|
2
|
Application of Graphic Design with Computer Graphics and Image Processing: Taking Packaging Design of Agricultural Products as an Example. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2022; 2022:6554371. [PMID: 35693271 PMCID: PMC9184173 DOI: 10.1155/2022/6554371] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/10/2022] [Revised: 05/03/2022] [Accepted: 05/07/2022] [Indexed: 11/24/2022]
Abstract
With development of economy, all industries have undergone earthshaking changes. Various new technologies are starting to be employed in all aspects of life, and graphic design is no exception. The use of computer graphics and image processing technologies in graphic design can substantially improve design efficiency and make graphic design job more convenient to develop. The requirements for the quality of graphic design are higher. Quality inspection has become a necessary step in the production process, in which the detection of graphic design defects is an indispensable and important link. The traditional graphic design defect detection adopts the method of manual visual inspection, which has the disadvantages of poor stability, long consumption time, and high labor cost. As an efficient computer graphics and image processing technology, convolutional neural network has received extensive attention in graphic design defect detection because of its advantages of high speed, efficiency, and high degree of automation. Taking agricultural product packaging as an example, this paper studies application technology for graphic design defect detection with convolutional neural network (CNN). The main contents are as follows: construct the original YOLOv3 network model, input the graphic design images of agricultural product packaging into the network model in batches according to the computing power of the hardware equipment, train the YOLOv3 network, and deeply study and analyze the experimental results. The related improvement techniques are then given, based on the characteristics of agricultural product packaging design faults. The backbone network, multiscale feature map, a priori frame, and activation function of YOLOv3 are improved, and then performance of the improved model is verified by experiments.
Collapse
|
3
|
Banús N, Boada I, Xiberta P, Toldrà P, Bustins N. Deep learning for the quality control of thermoforming food packages. Sci Rep 2021; 11:21887. [PMID: 34750436 PMCID: PMC8576017 DOI: 10.1038/s41598-021-01254-x] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2021] [Accepted: 10/25/2021] [Indexed: 11/24/2022] Open
Abstract
Quality control is a key process designed to ensure that only products satisfying the defined quality requirements reach the end consumer or the next step in a production line. In the food industry, in the packaging step, there are many products that are still evaluated by human operators. To automate the process and improve efficiency and effectiveness, computer vision and artificial intelligence techniques can be applied. This automation is challenging since specific strategies designed according to the application scenario are required. Focusing on the quality control of the sealing and closure of matrix-shaped thermoforming food packages, the aim of the article is to propose a deep-learning-based solution designed to automatically perform the quality control while satisfying production cadence and ensuring 100% inline inspection of the products. Particularly, the designed computer vision system and the image-based criteria defined to determine when a product has to be accepted or rejected are presented. In addition, the vision control software is described with special emphasis on the different convolutional neural network (CNN) architectures that have been considered (ResNet18, ResNet50, Vgg19 and DenseNet161, non-pre-trained and pre-trained on ImageNet) and on the specifically designed dataset. To test the solution, different experiments are carried out in the laboratory and also in a real scenario, concluding that the proposed CNN-based approach improves the efficiency and security of the quality control process. Optimal results are obtained with the pre-trained DenseNet161, achieving false positive rates that range from 0.03 to 0.30% and false negative rates that range from 0 to 0.07%, with a rejection rate between 0.64 and 5.09% of production, and being able to detect at least 99.93% of the sealing defects that occur in any production. The modular design of our solution as well as the provided description allow it to adapt to similar scenarios and to new deep-learning models to prevent the arrival of faulty products to end consumers by removing them from the automated production line.
Collapse
Affiliation(s)
- Núria Banús
- Graphics and Imaging Laboratory, University of Girona, 17003, Girona, Catalonia, Spain.,Vision Department (R&D), TAVIL Ind. S.A.U., 17854, Girona, Catalonia, Spain
| | - Imma Boada
- Graphics and Imaging Laboratory, University of Girona, 17003, Girona, Catalonia, Spain.
| | - Pau Xiberta
- Graphics and Imaging Laboratory, University of Girona, 17003, Girona, Catalonia, Spain
| | - Pol Toldrà
- Vision Department (R&D), TAVIL Ind. S.A.U., 17854, Girona, Catalonia, Spain
| | - Narcís Bustins
- Vision Department (R&D), TAVIL Ind. S.A.U., 17854, Girona, Catalonia, Spain
| |
Collapse
|
4
|
Benouis M, Medus LD, Saban M, Ghemougui A, Rosado-Muñoz A. Food Tray Sealing Fault Detection in Multi-Spectral Images Using Data Fusion and Deep Learning Techniques. J Imaging 2021; 7:jimaging7090186. [PMID: 34564112 PMCID: PMC8470697 DOI: 10.3390/jimaging7090186] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2021] [Revised: 08/13/2021] [Accepted: 08/16/2021] [Indexed: 12/04/2022] Open
Abstract
A correct food tray sealing is required to preserve food properties and safety for consumers. Traditional food packaging inspections are made by human operators to detect seal defects. Recent advances in the field of food inspection have been related to the use of hyperspectral imaging technology and automated vision-based inspection systems. A deep learning-based approach for food tray sealing fault detection using hyperspectral images is described. Several pixel-based image fusion methods are proposed to obtain 2D images from the 3D hyperspectral image datacube, which feeds the deep learning (DL) algorithms. Instead of considering all spectral bands in region of interest around a contaminated or faulty seal area, only relevant bands are selected using data fusion. These techniques greatly improve the computation time while maintaining a high classification ratio, showing that the fused image contains enough information for checking a food tray sealing state (faulty or normal), avoiding feeding a large image datacube to the DL algorithms. Additionally, the proposed DL algorithms do not require any prior handcraft approach, i.e., no manual tuning of the parameters in the algorithms are required since the training process adjusts the algorithm. The experimental results, validated using an industrial dataset for food trays, along with different deep learning methods, demonstrate the effectiveness of the proposed approach. In the studied dataset, an accuracy of 88.7%, 88.3%, 89.3%, and 90.1% was achieved for Deep Belief Network (DBN), Extreme Learning Machine (ELM), Stacked Auto Encoder (SAE), and Convolutional Neural Network (CNN), respectively.
Collapse
Affiliation(s)
- Mohamed Benouis
- Laboratory of Informatics and Its Applications of M’sila (LIAM), Department of Computer Science, University of M’Sila, BP 166 Ichbilia, Msila 28000, Algeria;
- Correspondence:
| | - Leandro D. Medus
- Department of Electronic Engineering, ETSE, University Valencia, Av. Universitat, s/n-46100, Burjassot, 46100 Valencia, Spain; (L.D.M.); (M.S.); (A.R.-M.)
| | - Mohamed Saban
- Department of Electronic Engineering, ETSE, University Valencia, Av. Universitat, s/n-46100, Burjassot, 46100 Valencia, Spain; (L.D.M.); (M.S.); (A.R.-M.)
| | - Abdessattar Ghemougui
- Laboratory of Informatics and Its Applications of M’sila (LIAM), Department of Computer Science, University of M’Sila, BP 166 Ichbilia, Msila 28000, Algeria;
| | - Alfredo Rosado-Muñoz
- Department of Electronic Engineering, ETSE, University Valencia, Av. Universitat, s/n-46100, Burjassot, 46100 Valencia, Spain; (L.D.M.); (M.S.); (A.R.-M.)
| |
Collapse
|
5
|
Achouri IE, Rhoden A, Hudon S, Gosselin R, Simard JS, Abatzoglou N. Non-invasive detection technologies of solid foreign matter and their applications to lyophilized pharmaceutical products: A review. Talanta 2021; 224:121885. [PMID: 33379094 DOI: 10.1016/j.talanta.2020.121885] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2020] [Revised: 10/15/2020] [Accepted: 10/19/2020] [Indexed: 01/28/2023]
Abstract
Good Manufacturing Practice Regulations, under the Food and Drug Administration (FDA), stipulate that all pharmaceutical products must be free of any contaminants, including, namely, any foreign solid objects. Lyophilization is a common manufacturing method that consists of several steps where foreign materials may enter the product. The presence of unintended particles in freeze drying, which will herein be referred to under the term 'Lyophilization', is of great concern to the authorities responsible for drug safety and effectiveness. In the pharmaceutical industry, presently, the inspection of lyophilized products for foreign matter particulates relies on visual inspection where only the outer surface of the lyophilized cake is visible. This review is motivated by the need for new control strategies for foreign matter (FM) detection in lyophilized products; more specifically, it assesses the reliability of non-destructive technologies for FM detection in dried samples. Emerging technologies applied in other industries, such as various types of spectroscopies and imaging (e.g. chemical, X-ray, ultrasound, thermal and terahertz), are evaluated based on compatibility with the intended application, with identification of the possible technical challenges.
Collapse
Affiliation(s)
- Inès E Achouri
- Département de Génie Chimique et de Génie Biotechnologique, Université de Sherbrooke, Sherbrooke, QC, Canada.
| | - Alan Rhoden
- Pfizer USA, 100 route 206 North, Peapack, NJ, 07977, USA
| | - Sophie Hudon
- Pfizer Canada, 17300 route transcanadienne, Kirkland, QC, H9J 2M5, Canada
| | - Ryan Gosselin
- Département de Génie Chimique et de Génie Biotechnologique, Université de Sherbrooke, Sherbrooke, QC, Canada
| | | | - Nicolas Abatzoglou
- Département de Génie Chimique et de Génie Biotechnologique, Université de Sherbrooke, Sherbrooke, QC, Canada
| |
Collapse
|
6
|
Cruz S, Paulino A, Duraes J, Mendes M. Real-Time Quality Control of Heat Sealed Bottles Using Thermal Images and Artificial Neural Network. J Imaging 2021; 7:jimaging7020024. [PMID: 34460623 PMCID: PMC8321283 DOI: 10.3390/jimaging7020024] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2020] [Revised: 01/07/2021] [Accepted: 01/27/2021] [Indexed: 12/02/2022] Open
Abstract
Quality control of heat sealed bottles is very important to minimize waste and in some cases protect people’s health. The present paper describes a case study where an automated non invasive and non destructive quality control system was designed to assess the quality of the seals of bottles containing pesticide. In this case study, the integrity of the seals is evaluated using an artificial neural network based on images of the seals processed with computer vision techniques. Because the seals are not directly visible from the bottle exterior, the images are infrared pictures obtained using a thermal camera. The method is non invasive, automated, and can be applied to common conveyor belts currently used in industrial plants. The results show that the inspection process is effective in identifying defective seals with a precision of 98.6% and a recall of 100% and because it is automated it can be scaled up to large bottle processing plants.
Collapse
Affiliation(s)
- Samuel Cruz
- Polytechnic of Coimbra, Coimbra Engineering Academy, R. Pedro Nunes, 3030-199 Coimbra, Portugal; (S.C.); (J.D.)
| | - António Paulino
- Polytechnic of Coimbra, Higher School of Technology and Management, R. General Santos Costa, 3400-124 Oliveira do Hospital, Portugal;
| | - Joao Duraes
- Polytechnic of Coimbra, Coimbra Engineering Academy, R. Pedro Nunes, 3030-199 Coimbra, Portugal; (S.C.); (J.D.)
- Centre for Informatics and Systems, Uiversity of Coimbra, Polo II, Pinhal de Marrocos, 3030-290 Coimbra, Portugal
| | - Mateus Mendes
- Polytechnic of Coimbra, Coimbra Engineering Academy, R. Pedro Nunes, 3030-199 Coimbra, Portugal; (S.C.); (J.D.)
- Institute of Systems and Robotics, University of Coimbra, Rua Silvio Lima, Polo II, 3030-290 Coimbra, Portugal
- Correspondence:
| |
Collapse
|
7
|
Voss M, Alessio KO, Vianna Santos RC, de Souza ME, Clerici DJ, Wagner R, Cichoski AJ, Costa ABD, Helfer GA, Machado GS, Barbosa JLV, Müller EI, Barin JS. Rapid, Noninvasive, and Nondestructive Method for Biofilm Imaging on Metallic Surfaces Using Active Thermography. Anal Chem 2020; 92:5682-5687. [PMID: 32207608 DOI: 10.1021/acs.analchem.9b05713] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Abstract
A simple, rapid, low-cost method was proposed for the imaging of Pseudomonas aeruginosa biofilms on metallic surfaces using an infrared camera. Stainless steel coupons were cooled to generate a thermal gradient in relation to biofilm for active thermography (AT). Both cooling and image acquisition times were optimized and the images obtained with AT were compared with those from scanning electron microscopy. A free software (Thermofilm) was developed for image processing and the results were compared with the software ImageJ, with good agreement (from 87.7 to 103.8%). Images of coupons treated with sanitizer (peracetic acid) were obtained to show the applicability of the proposed method for biofilm studies. All analytical steps could be performed in 3 min in a noncontact, nondestructive, low-cost, portable, and easy-to-use way.
Collapse
Affiliation(s)
| | | | | | - Márcia Ebling de Souza
- Laboratório de Pesquisa Microbiológica, Universidade Franciscana, 97010-491, Santa Maria, RS Brazil
| | | | | | | | - Adilson Ben da Costa
- Grupo de Pesquisa em Quimiometria- Programa de Pós-Graduação em Sistemas e Processos Industriais, Universidade de Santa Cruz do Sul, 96815-900, Santa Cruz do Sul, RS Brazil
| | - Gilson Augusto Helfer
- Grupo de Pesquisa em Quimiometria- Programa de Pós-Graduação em Sistemas e Processos Industriais, Universidade de Santa Cruz do Sul, 96815-900, Santa Cruz do Sul, RS Brazil.,Programa de Pós-Graduação em Computação Aplicada, Universidade Vale do Rio dos Sinos, 93022-750, São Leopoldo, RS Brazil
| | - Guilherme Saldanha Machado
- Grupo de Pesquisa em Quimiometria- Programa de Pós-Graduação em Sistemas e Processos Industriais, Universidade de Santa Cruz do Sul, 96815-900, Santa Cruz do Sul, RS Brazil
| | - Jorge Luis Victoria Barbosa
- Programa de Pós-Graduação em Computação Aplicada, Universidade Vale do Rio dos Sinos, 93022-750, São Leopoldo, RS Brazil
| | | | | |
Collapse
|