1
|
Lin JD, Han YH, Huang PH, Tan J, Chen JC, Tanveer M, Hua KL. DEFAEK: Domain Effective Fast Adaptive Network for Face Anti-Spoofing. Neural Netw 2023; 161:83-91. [PMID: 36736002 DOI: 10.1016/j.neunet.2023.01.018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2022] [Revised: 12/24/2022] [Accepted: 01/18/2023] [Indexed: 01/26/2023]
Abstract
Existing deep learning based face anti-spoofing (FAS) or deepfake detection approaches usually rely on large-scale datasets and powerful networks with significant amount of parameters to achieve satisfactory performance. However, these make them resource-heavy and unsuitable for handheld devices. Moreover, they are limited by the types of spoof in the dataset they train on and require considerable training time. To produce a robust FAS model, they need large datasets covering the widest variety of predefined presentation attacks possible. Testing on new or unseen attacks or environments generally results in poor performance. Ideally, the FAS model should learn discriminative features that can generalize well even on unseen spoof types. In this paper, we propose a fast learning approach called Domain Effective Fast Adaptive nEt-worK (DEFAEK), a face anti-spoofing approach based on the optimization-based meta-learning paradigm that effectively and quickly adapts to new tasks. DEFAEK treats differences in an environment as domains and simulates multiple domain shifts during training. To further improve the effectiveness and efficiency of meta-learning, we adopt the metric learning in the inner loop update with careful sample selection. With extensive experiments on the challenging CelebA-Spoof and FaceForensics++ datasets, the evaluation results show that DEFAEK can learn cues independent of the environment with good generalization capability. In addition, the resulting model is lightweight following the design principle of modern lightweight network architecture and still generalizes well on unseen classes. In addition, we also demonstrate our model's capabilities by comparing the numbers of parameters, FLOPS, and model performance with other state-of-the-art methods.
Collapse
Affiliation(s)
- Jiun-Da Lin
- Department of Computer Science and Information Engineering, National Taiwan University of Science and Technology, Taipei, 106335, Taiwan, ROC; Research Center for Information Technology Innovation, Academia Sinica, Taipei, 115201, Taiwan, ROC.
| | - Yue-Hua Han
- Department of Computer Science and Information Engineering, National Taiwan University of Science and Technology, Taipei, 106335, Taiwan, ROC; Research Center for Information Technology Innovation, Academia Sinica, Taipei, 115201, Taiwan, ROC.
| | - Po-Han Huang
- Department of Computer Science and Information Engineering, National Taiwan University of Science and Technology, Taipei, 106335, Taiwan, ROC; Research Center for Information Technology Innovation, Academia Sinica, Taipei, 115201, Taiwan, ROC.
| | - Julianne Tan
- Department of Computer Science and Information Engineering, National Taiwan University of Science and Technology, Taipei, 106335, Taiwan, ROC.
| | - Jun-Cheng Chen
- Research Center for Information Technology Innovation, Academia Sinica, Taipei, 115201, Taiwan, ROC.
| | - M Tanveer
- Department of Mathematics, Indian Institute of Technology Indore, Simrol, 453552, India.
| | - Kai-Lung Hua
- Department of Computer Science and Information Engineering, National Taiwan University of Science and Technology, Taipei, 106335, Taiwan, ROC.
| |
Collapse
|
2
|
Nawaz M, Nazir T, Masood M, Ali F, Khan MA, Tariq U, Sahar N, Damaševičius R. Melanoma segmentation: A framework of improved DenseNet77 and UNET convolutional neural network. INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY 2022; 32:2137-2153. [DOI: 10.1002/ima.22750] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/09/2022] [Accepted: 05/03/2022] [Indexed: 08/25/2024]
Abstract
AbstractMelanoma is the most fatal type of skin cancer which can cause the death of victims at the advanced stage. Extensive work has been presented by the researcher on computer vision for skin lesion localization. However, correct and effective melanoma segmentation is still a tough job because of the extensive variations found in the shape, color, and sizes of skin moles. Moreover, the presence of light and brightness variations further complicates the segmentation task. We have presented improved deep learning (DL)‐based approach, namely, the DenseNet77‐based UNET model. More clearly, we have introduced the DenseNet77 network at the encoder unit of the UNET approach to computing the more representative set of image features. The calculated keypoints are later segmented by the decoder of the UNET model. We have used two standard datasets, namely, the ISIC‐2017 and ISIC‐2018 to evaluate the performance of the proposed approach and acquired the segmentation accuracies of 99.21% and 99.51% for the ISIC‐2017 and ISIC‐2018 datasets, respectively. We have confirmed through both the quantitative and qualitative results that the proposed improved UNET approach is robust to skin lesions segmentation and can accurately recognize the moles of varying colors and sizes.
Collapse
Affiliation(s)
- Marriam Nawaz
- Department of Computer Science University of Engineering and Technology Taxila Pakistan
- Department of Software Engineering University of Enginering and Technology Taxila Pakistan
| | - Tahira Nazir
- Department of Computing Riphah International University Islamabad Pakistan
| | - Momina Masood
- Department of Computer Science University of Engineering and Technology Taxila Pakistan
| | - Farooq Ali
- Department of Computer Science University of Engineering and Technology Taxila Pakistan
| | | | - Usman Tariq
- College of Computer Engineering and Science Prince Sattam Bin Abdulaziz University Al‐Kharj Saudi Arabia
| | - Naveera Sahar
- Department of Computer Science University of Wah Wah Cantt Pakistan
| | | |
Collapse
|
3
|
Nawaz M, Nazir T, Khan MA, Alhaisoni M, Kim JY, Nam Y. MSeg-Net: A Melanoma Mole Segmentation Network Using CornerNet and Fuzzy K-Means Clustering. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2022; 2022:7502504. [PMID: 36276999 PMCID: PMC9586776 DOI: 10.1155/2022/7502504] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/18/2022] [Accepted: 09/17/2022] [Indexed: 11/18/2022]
Abstract
Melanoma is a dangerous form of skin cancer that results in the demise of patients at the developed stage. Researchers have attempted to develop automated systems for the timely recognition of this deadly disease. However, reliable and precise identification of melanoma moles is a tedious and complex activity as there exist huge differences in the mass, structure, and color of the skin lesions. Additionally, the incidence of noise, blurring, and chrominance changes in the suspected images further enhance the complexity of the detection procedure. In the proposed work, we try to overcome the limitations of the existing work by presenting a deep learning (DL) model. Descriptively, after accomplishing the preprocessing task, we have utilized an object detection approach named CornerNet model to detect melanoma lesions. Then the localized moles are passed as input to the fuzzy K-means (FLM) clustering approach to perform the segmentation task. To assess the segmentation power of the proposed approach, two standard databases named ISIC-2017 and ISIC-2018 are employed. Extensive experimentation has been conducted to demonstrate the robustness of the proposed approach through both numeric and pictorial results. The proposed approach is capable of detecting and segmenting the moles of arbitrary shapes and orientations. Furthermore, the presented work can tackle the presence of noise, blurring, and brightness variations as well. We have attained the segmentation accuracy values of 99.32% and 99.63% over the ISIC-2017 and ISIC-2018 databases correspondingly which clearly depicts the effectiveness of our model for the melanoma mole segmentation.
Collapse
Affiliation(s)
- Marriam Nawaz
- Department of Software Engineering, University of Engineering and Technology Taxila, 47050, Pakistan
- Department of Computer Science, University of Engineering and Technology Taxila, 47050, Pakistan
| | - Tahira Nazir
- Department of Computing, Riphah International University, Islamabad, Pakistan
| | | | - Majed Alhaisoni
- Computer Sciences Department, College of Computer and Information Sciences, Princess Nourah Bint Abdulrahman University, Riyadh 11671, Saudi Arabia
| | - Jung-Yeon Kim
- Department of ICT Convergence, Soonchunhyang University, Asan 31538, Republic of Korea
| | - Yunyoung Nam
- Department of ICT Convergence, Soonchunhyang University, Asan 31538, Republic of Korea
| |
Collapse
|