1
|
Silenzi A, Castorani V, Tomassini S, Falcionelli N, Contardo P, Bonci A, Dragoni AF, Sernani P. Quality Control of Carbon Look Components via Surface Defect Classification with Deep Neural Networks. SENSORS (BASEL, SWITZERLAND) 2023; 23:7607. [PMID: 37688059 PMCID: PMC10490784 DOI: 10.3390/s23177607] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/10/2023] [Revised: 08/11/2023] [Accepted: 08/30/2023] [Indexed: 09/10/2023]
Abstract
Many "Industry 4.0" applications rely on data-driven methodologies such as Machine Learning and Deep Learning to enable automatic tasks and implement smart factories. Among these applications, the automatic quality control of manufacturing materials is of utmost importance to achieve precision and standardization in production. In this regard, most of the related literature focused on combining Deep Learning with Nondestructive Testing techniques, such as Infrared Thermography, requiring dedicated settings to detect and classify defects in composite materials. Instead, the research described in this paper aims at understanding whether deep neural networks and transfer learning can be applied to plain images to classify surface defects in carbon look components made with Carbon Fiber Reinforced Polymers used in the automotive sector. To this end, we collected a database of images from a real case study, with 400 images to test binary classification (defect vs. no defect) and 1500 for the multiclass classification (components with no defect vs. recoverable vs. non-recoverable). We developed and tested ten deep neural networks as classifiers, comparing ten different pre-trained CNNs as feature extractors. Specifically, we evaluated VGG16, VGG19, ResNet50 version 2, ResNet101 version 2, ResNet152 version 2, Inception version 3, MobileNet version 2, NASNetMobile, DenseNet121, and Xception, all pre-trainined with ImageNet, combined with fully connected layers to act as classifiers. The best classifier, i.e., the network based on DenseNet121, achieved a 97% accuracy in classifying components with no defects, recoverable components, and non-recoverable components, demonstrating the viability of the proposed methodology to classify surface defects from images taken with a smartphone in varying conditions, without the need for dedicated settings. The collected images and the source code of the experiments are available in two public, open-access repositories, making the presented research fully reproducible.
Collapse
Affiliation(s)
- Andrea Silenzi
- Dipartimento di Ingegneria dell’Informazione, Università Politecnica delle Marche, Via Brecce Bianche 12, 60131 Ancona, Italy; (A.S.); (S.T.); (N.F.); (P.C.); (A.B.); (A.F.D.)
| | - Vincenzo Castorani
- HP Composites S.p.A., Via del Lampo S.N., Z.Ind.le Campolungo, 63100 Ascoli Piceno, Italy;
| | - Selene Tomassini
- Dipartimento di Ingegneria dell’Informazione, Università Politecnica delle Marche, Via Brecce Bianche 12, 60131 Ancona, Italy; (A.S.); (S.T.); (N.F.); (P.C.); (A.B.); (A.F.D.)
| | - Nicola Falcionelli
- Dipartimento di Ingegneria dell’Informazione, Università Politecnica delle Marche, Via Brecce Bianche 12, 60131 Ancona, Italy; (A.S.); (S.T.); (N.F.); (P.C.); (A.B.); (A.F.D.)
| | - Paolo Contardo
- Dipartimento di Ingegneria dell’Informazione, Università Politecnica delle Marche, Via Brecce Bianche 12, 60131 Ancona, Italy; (A.S.); (S.T.); (N.F.); (P.C.); (A.B.); (A.F.D.)
| | - Andrea Bonci
- Dipartimento di Ingegneria dell’Informazione, Università Politecnica delle Marche, Via Brecce Bianche 12, 60131 Ancona, Italy; (A.S.); (S.T.); (N.F.); (P.C.); (A.B.); (A.F.D.)
| | - Aldo Franco Dragoni
- Dipartimento di Ingegneria dell’Informazione, Università Politecnica delle Marche, Via Brecce Bianche 12, 60131 Ancona, Italy; (A.S.); (S.T.); (N.F.); (P.C.); (A.B.); (A.F.D.)
| | - Paolo Sernani
- Department of Law, University of Macerata, Piaggia dell’Università 2, 62100 Macerata, Italy
| |
Collapse
|
2
|
Atzeni D, Ramjattan R, Figliè R, Baldi G, Mazzei D. Data-Driven Insights through Industrial Retrofitting: An Anonymized Dataset with Machine Learning Use Cases. SENSORS (BASEL, SWITZERLAND) 2023; 23:6078. [PMID: 37447927 DOI: 10.3390/s23136078] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/26/2023] [Revised: 06/22/2023] [Accepted: 06/26/2023] [Indexed: 07/15/2023]
Abstract
Small and medium-sized enterprises (SMEs) often encounter practical challenges and limitations when extracting valuable insights from the data of retrofitted or brownfield equipment. The existing literature fails to reflect the full reality and potential of data-driven analysis in current SME environments. In this paper, we provide an anonymized dataset obtained from two medium-sized companies leveraging a non-invasive and scalable data-collection procedure. The dataset comprises mainly power consumption machine data collected over a period of 7 months and 1 year from two medium-sized companies. Using this dataset, we demonstrate how machine learning (ML) techniques can enable SMEs to extract useful information even in the short term, even from a small variety of data types. We develop several ML models to address various tasks, such as power consumption forecasting, item classification, next machine state prediction, and item production count forecasting. By providing this anonymized dataset and showcasing its application through various ML use cases, our paper aims to provide practical insights for SMEs seeking to leverage ML techniques with their limited data resources. The findings contribute to a better understanding of how ML can be effectively utilized in extracting actionable insights from limited datasets, offering valuable implications for SMEs in practical settings.
Collapse
Affiliation(s)
- Daniele Atzeni
- Department of Computer Science, University of Pisa, 56126 Pisa, Italy
| | - Reshawn Ramjattan
- Department of Computer Science, University of Pisa, 56126 Pisa, Italy
| | - Roberto Figliè
- Department of Computer Science, University of Pisa, 56126 Pisa, Italy
| | | | - Daniele Mazzei
- Department of Computer Science, University of Pisa, 56126 Pisa, Italy
- Zerynth, 56124 Pisa, Italy
| |
Collapse
|
3
|
Brunthaler J, Grabski P, Sturm V, Lubowski W, Efrosinin D. On the Problem of State Recognition in Injection Molding Based on Accelerometer Data Sets. SENSORS (BASEL, SWITZERLAND) 2022; 22:s22166165. [PMID: 36015925 PMCID: PMC9413099 DOI: 10.3390/s22166165] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/06/2022] [Revised: 08/04/2022] [Accepted: 08/11/2022] [Indexed: 05/11/2023]
Abstract
The last few decades have been characterised by a very active application of smart technologies in various fields of industry. This paper deals with industrial activities, such as injection molding, where it is required to monitor continuously the manufacturing process to identify both the effective running time and down-time periods. Supervised machine learning algorithms are developed to recognize automatically the periods of the injection molding machines. The former algorithm uses directly the features of the descriptive statistics, while the latter one utilizes a convolutional neural network. The automatic state recognition system is equipped with an 3D-accelerometer sensor whose datasets are used to train and verify the proposed algorithms. The novelty of our contribution is that accelerometer data-based machine learning models are used to distinguish producing and non-producing periods by means of recognition of key steps in an injection molding cycle. The first testing results show the approximate overall balanced accuracy of 72-92% that illustrates the large potential of the monitoring system with the accelerometer. According to the ANOVA test, there are no sufficient statistical differences between the comparative algorithms, but the results of the neural network exhibit higher variances of the defined accuracy metrics.
Collapse
Affiliation(s)
| | | | | | | | - Dmitry Efrosinin
- Institute of Stochastics, Johannes Kepler University Linz, 4040 Linz, Austria
| |
Collapse
|