1
|
Guo Z, Guo J, Huang Y, Zhang Y, Ren H. DDP-FedFV: A Dual-Decoupling Personalized Federated Learning Framework for Finger Vein Recognition. SENSORS (BASEL, SWITZERLAND) 2024; 24:4779. [PMID: 39123826 PMCID: PMC11314924 DOI: 10.3390/s24154779] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/20/2024] [Revised: 07/21/2024] [Accepted: 07/22/2024] [Indexed: 08/12/2024]
Abstract
Finger vein recognition methods, as emerging biometric technologies, have attracted increasing attention in identity verification due to their high accuracy and live detection capabilities. However, as privacy protection awareness increases, traditional centralized finger vein recognition algorithms face privacy and security issues. Federated learning, a distributed training method that protects data privacy without sharing data across endpoints, is gradually being promoted and applied. Nevertheless, its performance is severely limited by heterogeneity among datasets. To address these issues, this paper proposes a dual-decoupling personalized federated learning framework for finger vein recognition (DDP-FedFV). The DDP-FedFV method combines generalization and personalization. In the first stage, the DDP-FedFV method implements a dual-decoupling mechanism involving model and feature decoupling to optimize feature representations and enhance the generalizability of the global model. In the second stage, the DDP-FedFV method implements a personalized weight aggregation method, federated personalization weight ratio reduction (FedPWRR), to optimize the parameter aggregation process based on data distribution information, thereby enhancing the personalization of the client models. To evaluate the performance of the DDP-FedFV method, theoretical analyses and experiments were conducted based on six public finger vein datasets. The experimental results indicate that the proposed algorithm outperforms centralized training models without increasing communication costs or privacy leakage risks.
Collapse
Affiliation(s)
- Zijie Guo
- School of Computer Science, Nanjing University of Posts and Telecommunications, Nanjing 210023, China; (Z.G.); (Y.Z.)
- Jiangsu High Technology Research Key Laboratory for Wireless Sensor Networks, Nanjing University of Posts and Telecommunications, Nanjing 210023, China;
| | - Jian Guo
- School of Computer Science, Nanjing University of Posts and Telecommunications, Nanjing 210023, China; (Z.G.); (Y.Z.)
- Jiangsu High Technology Research Key Laboratory for Wireless Sensor Networks, Nanjing University of Posts and Telecommunications, Nanjing 210023, China;
| | - Yanan Huang
- Jiangsu High Technology Research Key Laboratory for Wireless Sensor Networks, Nanjing University of Posts and Telecommunications, Nanjing 210023, China;
- College of Automation & College of Artificial Intelligence, Nanjing University of Posts and Telecommunications, Nanjing 210023, China
| | - Yibo Zhang
- School of Computer Science, Nanjing University of Posts and Telecommunications, Nanjing 210023, China; (Z.G.); (Y.Z.)
- Jiangsu High Technology Research Key Laboratory for Wireless Sensor Networks, Nanjing University of Posts and Telecommunications, Nanjing 210023, China;
| | - Hengyi Ren
- College of Information Science and Technology and College of Artificial Intelligence, Nanjing Forestry University, Nanjing 210037, China;
| |
Collapse
|
2
|
Feng D, Feng P, Mao Y, Zhou Y, Zeng Y, Zhang Y. A Degraded Finger Vein Image Recovery and Enhancement Algorithm Based on Atmospheric Scattering Theory. SENSORS (BASEL, SWITZERLAND) 2024; 24:2684. [PMID: 38732790 PMCID: PMC11085492 DOI: 10.3390/s24092684] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/15/2024] [Revised: 04/09/2024] [Accepted: 04/17/2024] [Indexed: 05/13/2024]
Abstract
With the development of biometric identification technology, finger vein identification has received more and more widespread attention for its security, efficiency, and stability. However, because of the performance of the current standard finger vein image acquisition device and the complex internal organization of the finger, the acquired images are often heavily degraded and have lost their texture characteristics. This makes the topology of the finger veins inconspicuous or even difficult to distinguish, greatly affecting the identification accuracy. Therefore, this paper proposes a finger vein image recovery and enhancement algorithm using atmospheric scattering theory. Firstly, to normalize the local over-bright and over-dark regions of finger vein images within a certain threshold, the Gamma transform method is improved in this paper to correct and measure the gray value of a given image. Then, we reconstruct the image based on atmospheric scattering theory and design a pixel mutation filter to segment the venous and non-venous contact zones. Finally, the degraded finger vein images are recovered and enhanced by global image gray value normalization. Experiments on SDUMLA-HMT and ZJ-UVM datasets show that our proposed method effectively achieves the recovery and enhancement of degraded finger vein images. The image restoration and enhancement algorithm proposed in this paper performs well in finger vein recognition using traditional methods, machine learning, and deep learning. The recognition accuracy of the processed image is improved by more than 10% compared to the original image.
Collapse
Affiliation(s)
- Dingzhong Feng
- College of Mechanical Engineering, Zhejiang University of Technology, Hangzhou 310014, China; (D.F.); (P.F.); (Y.M.); (Y.Z.); (Y.Z.)
- Zhejiang Jinghong Intelligent Technology Co., Ltd., Lishui 321400, China
| | - Peng Feng
- College of Mechanical Engineering, Zhejiang University of Technology, Hangzhou 310014, China; (D.F.); (P.F.); (Y.M.); (Y.Z.); (Y.Z.)
| | - Yongbo Mao
- College of Mechanical Engineering, Zhejiang University of Technology, Hangzhou 310014, China; (D.F.); (P.F.); (Y.M.); (Y.Z.); (Y.Z.)
| | - Yang Zhou
- College of Mechanical Engineering, Zhejiang University of Technology, Hangzhou 310014, China; (D.F.); (P.F.); (Y.M.); (Y.Z.); (Y.Z.)
| | - Yuqing Zeng
- College of Mechanical Engineering, Zhejiang University of Technology, Hangzhou 310014, China; (D.F.); (P.F.); (Y.M.); (Y.Z.); (Y.Z.)
| | - Ye Zhang
- College of Mechanical Engineering, Zhejiang University of Technology, Hangzhou 310014, China; (D.F.); (P.F.); (Y.M.); (Y.Z.); (Y.Z.)
- Zhejiang Jinghong Intelligent Technology Co., Ltd., Lishui 321400, China
| |
Collapse
|
3
|
Li X, Feng J, Cai J, Lin G. FV-MViT: Mobile Vision Transformer for Finger Vein Recognition. SENSORS (BASEL, SWITZERLAND) 2024; 24:1331. [PMID: 38400488 PMCID: PMC10892637 DOI: 10.3390/s24041331] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/06/2024] [Revised: 02/07/2024] [Accepted: 02/14/2024] [Indexed: 02/25/2024]
Abstract
In addressing challenges related to high parameter counts and limited training samples for finger vein recognition, we present the FV-MViT model. It serves as a lightweight deep learning solution, emphasizing high accuracy, portable design, and low latency. The FV-MViT introduces two key components. The Mul-MV2 Block utilizes a dual-path inverted residual connection structure for multi-scale convolutions, extracting additional local features. Simultaneously, the Enhanced MobileViT Block eliminates the large-scale convolution block at the beginning of the original MobileViT Block. It converts the Transformer's self-attention into separable self-attention with linear complexity, optimizing the back end of the original MobileViT Block with depth-wise separable convolutions. This aims to extract global features and effectively reduce parameter counts and feature extraction times. Additionally, we introduce a soft target center cross-entropy loss function to enhance generalization and increase accuracy. Experimental results indicate that the FV-MViT achieves a recognition accuracy of 99.53% and 100.00% on the Shandong University (SDU) and Universiti Teknologi Malaysia (USM) datasets, with equal error rates of 0.47% and 0.02%, respectively. The model has a parameter count of 5.26 million and exhibits a latency of 10.00 milliseconds from the sample input to the recognition output. Comparison with state-of-the-art (SOTA) methods reveals competitive performance for FV-MViT.
Collapse
Affiliation(s)
- Xiongjun Li
- College of Physics and Optoelectronic Engineering, Shenzhen University, Shenzhen 518060, China
| | - Jin Feng
- College of Physics and Optoelectronic Engineering, Shenzhen University, Shenzhen 518060, China
| | | | | |
Collapse
|
4
|
Li M, Gong Y, Zheng Z. Finger Vein Identification Based on Large Kernel Convolution and Attention Mechanism. SENSORS (BASEL, SWITZERLAND) 2024; 24:1132. [PMID: 38400290 PMCID: PMC10892868 DOI: 10.3390/s24041132] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/07/2024] [Revised: 02/04/2024] [Accepted: 02/06/2024] [Indexed: 02/25/2024]
Abstract
FV (finger vein) identification is a biometric identification technology that extracts the features of FV images for identity authentication. To address the limitations of CNN-based FV identification, particularly the challenge of small receptive fields and difficulty in capturing long-range dependencies, an FV identification method named Let-Net (large kernel and attention mechanism network) was introduced, which combines local and global information. Firstly, Let-Net employs large kernels to capture a broader spectrum of spatial contextual information, utilizing deep convolution in conjunction with residual connections to curtail the volume of model parameters. Subsequently, an integrated attention mechanism is applied to augment information flow within the channel and spatial dimensions, effectively modeling global information for the extraction of crucial FV features. The experimental results on nine public datasets show that Let-Net has excellent identification performance, and the EER and accuracy rate on the FV_USM dataset can reach 0.04% and 99.77%. The parameter number and FLOPs of Let-Net are only 0.89M and 0.25G, which means that the time cost of training and reasoning of the model is low, and it is easier to deploy and integrate into various applications.
Collapse
Affiliation(s)
- Meihui Li
- School of Computer Science and Technology, Soochow University, Suzhou 215006, China;
- Jiangsu Engineering Laboratory of Cyberspace Security, Suzhou 215006, China
| | - Yufei Gong
- School of Software Engineering, Xi’an Jiaotong University, Xi’an 710049, China;
| | - Zhaohui Zheng
- School of Computer Science and Technology, Soochow University, Suzhou 215006, China;
- Jiangsu Engineering Laboratory of Cyberspace Security, Suzhou 215006, China
| |
Collapse
|
5
|
Haider SA, Ashraf S, Larik RM, Husain N, Muqeet HA, Humayun U, Yahya A, Arfeen ZA, Khan MF. An Improved Multimodal Biometric Identification System Employing Score-Level Fuzzification of Finger Texture and Finger Vein Biometrics. SENSORS (BASEL, SWITZERLAND) 2023; 23:9706. [PMID: 38139551 PMCID: PMC10748327 DOI: 10.3390/s23249706] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/05/2023] [Revised: 11/28/2023] [Accepted: 12/05/2023] [Indexed: 12/24/2023]
Abstract
This research work focuses on a Near-Infra-Red (NIR) finger-images-based multimodal biometric system based on Finger Texture and Finger Vein biometrics. The individual results of the biometric characteristics are fused using a fuzzy system, and the final identification result is achieved. Experiments are performed for three different databases, i.e., the Near-Infra-Red Hand Images (NIRHI), Hong Kong Polytechnic University (HKPU) and University of Twente Finger Vein Pattern (UTFVP) databases. First, the Finger Texture biometric employs an efficient texture feature extracting algorithm, i.e., Linear Binary Pattern. Then, the classification is performed using Support Vector Machine, a proven machine learning classification algorithm. Second, the transfer learning of pre-trained convolutional neural networks (CNNs) is performed for the Finger Vein biometric, employing two approaches. The three selected CNNs are AlexNet, VGG16 and VGG19. In Approach 1, before feeding the images for the training of the CNN, the necessary preprocessing of NIR images is performed. In Approach 2, before the pre-processing step, image intensity optimization is also employed to regularize the image intensity. NIRHI outperforms HKPU and UTFVP for both of the modalities of focus, in a unimodal setup as well as in a multimodal one. The proposed multimodal biometric system demonstrates a better overall identification accuracy of 99.62% in comparison with 99.51% and 99.50% reported in the recent state-of-the-art systems.
Collapse
Affiliation(s)
- Syed Aqeel Haider
- Department of Computer & Information Systems Engineering, Faculty of Computer & Electrical Engineering, N.E.D. University of Engineering and Technology, Karachi 75270, Pakistan
| | - Shahzad Ashraf
- Department of Electrical Engineering, NFC Institute of Engineering and Technology, Multan 60000, Pakistan;
| | - Raja Masood Larik
- Department of Electrical Engineering, N.E.D University of Engineering and Technology, Karachi 75270, Pakistan;
| | - Nusrat Husain
- Department of Electronics & Power Engineering, Pakistan Navy Engineering College, National University of Sciences and Technology (NUST), Islamabad 44000, Pakistan; (N.H.); (A.Y.); (M.F.K.)
| | - Hafiz Abdul Muqeet
- Electrical Engineering Technology Department, Punjab Tianjin University of Technology, Lahore 54770, Pakistan;
| | - Usman Humayun
- Department of Computer Engineering, Faculty of Engineering, Bahauddin Zakariya University (BZU), Multan 60800, Pakistan;
| | - Ashraf Yahya
- Department of Electronics & Power Engineering, Pakistan Navy Engineering College, National University of Sciences and Technology (NUST), Islamabad 44000, Pakistan; (N.H.); (A.Y.); (M.F.K.)
| | - Zeeshan Ahmad Arfeen
- Department of Electrical Engineering, The Islamia University of Bahawalpur, Bahawalpur 63100, Pakistan;
| | - Muhammad Farhan Khan
- Department of Electronics & Power Engineering, Pakistan Navy Engineering College, National University of Sciences and Technology (NUST), Islamabad 44000, Pakistan; (N.H.); (A.Y.); (M.F.K.)
| |
Collapse
|
6
|
Fiolka J, Bernacki K, Farah A, Popowicz A. Multi-Wavelength Biometric Acquisition System Utilizing Finger Vasculature NIR Imaging. SENSORS (BASEL, SWITZERLAND) 2023; 23:1981. [PMID: 36850577 PMCID: PMC9962154 DOI: 10.3390/s23041981] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/30/2022] [Revised: 01/31/2023] [Accepted: 02/08/2023] [Indexed: 06/18/2023]
Abstract
Personal identification using analysis of the internal and external characteristics of the human finger is currently an intensively developed topic. The work in this field concerns new methods of feature extraction and image analysis, mainly using modern artificial intelligence algorithms. However, the quality of the data and the way in which it is obtained determines equally the effectiveness of identification. In this article, we present a novel device for extracting vision data from the internal as well as external structures of the human finger. We use spatially selective backlight consisting of NIR diodes of three wavelengths. The fast image acquisition allows for insight into the pulse waveform. Thanks to the external illuminator, images of the skin folds of the finger are acquired as well. This rich collection of images is expected to significantly enhance identification capabilities using existing and future classic and AI-based computer vision techniques. Sample data from our device, before and after data processing, have been shared in a publicly available database.
Collapse
Affiliation(s)
- Jerzy Fiolka
- Faculty of Automatic Control, Electronics and Computer Science, Silesian University of Technology, Akademicka 16, 44-100 Gliwice, Poland
| | - Krzysztof Bernacki
- Faculty of Automatic Control, Electronics and Computer Science, Silesian University of Technology, Akademicka 16, 44-100 Gliwice, Poland
| | - Alejandro Farah
- Instituto de Astronomía, Universidad Nacional Autónoma de México (UNAM), Ciudad Universitaria, Mexico City 04510, Mexico
| | - Adam Popowicz
- Faculty of Automatic Control, Electronics and Computer Science, Silesian University of Technology, Akademicka 16, 44-100 Gliwice, Poland
| |
Collapse
|
7
|
Liu C, Qin H, Song Q, Yan H, Luo F. A deep ensemble learning method for single finger-vein identification. Front Neurorobot 2023; 16:1065099. [PMID: 36714153 PMCID: PMC9876037 DOI: 10.3389/fnbot.2022.1065099] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2022] [Accepted: 12/14/2022] [Indexed: 01/12/2023] Open
Abstract
Finger-vein biometrics has been extensively investigated for personal verification. Single sample per person (SSPP) finger-vein recognition is one of the open issues in finger-vein recognition. Despite recent advances in deep neural networks for finger-vein recognition, current approaches depend on a large number of training data. However, they lack the robustness of extracting robust and discriminative finger-vein features from a single training image sample. A deep ensemble learning method is proposed to solve the SSPP finger-vein recognition in this article. In the proposed method, multiple feature maps were generated from an input finger-vein image, based on various independent deep learning-based classifiers. A shared learning scheme is investigated among classifiers to improve their feature representation captivity. The learning speed of weak classifiers is also adjusted to achieve the simultaneously best performance. A deep learning model is proposed by an ensemble of all these adjusted classifiers. The proposed method is tested with two public finger vein databases. The result shows that the proposed approach has a distinct advantage over all the other tested popular solutions for the SSPP problem.
Collapse
Affiliation(s)
- Chongwen Liu
- College of Artificial Intelligence, Chongqing Technology and Business University, Chongqing, China,Chongqing Key Laboratory of Intelligent Perception and BlockChain Technology, Chongqing Technology and Business University, Chongqing, China
| | - Huafeng Qin
- College of Artificial Intelligence, Chongqing Technology and Business University, Chongqing, China,Chongqing Key Laboratory of Intelligent Perception and BlockChain Technology, Chongqing Technology and Business University, Chongqing, China,*Correspondence: Huafeng Qin ✉ ; ✉
| | - Qun Song
- College of Artificial Intelligence, Chongqing Technology and Business University, Chongqing, China,Chongqing Key Laboratory of Intelligent Perception and BlockChain Technology, Chongqing Technology and Business University, Chongqing, China
| | - Huyong Yan
- College of Artificial Intelligence, Chongqing Technology and Business University, Chongqing, China,Chongqing Key Laboratory of Intelligent Perception and BlockChain Technology, Chongqing Technology and Business University, Chongqing, China
| | - Fen Luo
- College of Artificial Intelligence, Chongqing Technology and Business University, Chongqing, China,Chongqing Key Laboratory of Intelligent Perception and BlockChain Technology, Chongqing Technology and Business University, Chongqing, China
| |
Collapse
|
8
|
A Sparsified Densely Connected Network with Separable Convolution for Finger-Vein Recognition. Symmetry (Basel) 2022. [DOI: 10.3390/sym14122686] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022] Open
Abstract
At present, ResNet and DenseNet have achieved significant performance gains in the field of finger-vein biometric recognition, which is partially attributed to the dominant design of cross-layer skip connection. In this manner, features from multiple layers can be effectively aggregated to provide sufficient discriminant representation. Nevertheless, an over-dense connection pattern may induce channel expansion of feature maps and excessive memory consumption. To address these issues, we proposed a low memory overhead and fairly lightweight network architecture for finger-vein recognition. The core components of the proposed network are a sequence of sparsified densely connected blocks with symmetric structure. In each block, a novel connection cropping strategy is adopted to balance the channel ratio of input/output feature maps. Beyond this, to facilitate smaller model volume and faster convergence, we substitute the standard convolutional kernels with separable convolutional kernels and introduce a robust loss metric that is defined on the geodesic distance of angular space. Our proposed sparsified densely connected network with separable convolution (hereinafter dubbed ‘SC-SDCN’) has been tested on two benchmark finger-vein datasets, including the Multimedia Lab of Chonbuk National University (MMCBNU)and Finger Vein of Universiti Sains Malaysia (FV-USM), and the advantages of our SC-SDCN can be evident from the experimental results. Specifically, an equal error rate (EER) of 0.01% and an accuracy of 99.98% are obtained on the MMCBNU dataset, and an EER of 0.45% and an accuracy of 99.74% are obtained on the FV-USM dataset.
Collapse
|
9
|
Convolutional neural network based on multi-directional local coding for finger vein recognition. Inf Sci (N Y) 2022. [DOI: 10.1016/j.ins.2022.12.032] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
|
10
|
Finger Vein Verification on Different Datasets Based on Deep Learning with Triplet Loss. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2022; 2022:4868435. [PMID: 36311254 PMCID: PMC9613401 DOI: 10.1155/2022/4868435] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/29/2022] [Revised: 10/02/2022] [Accepted: 10/05/2022] [Indexed: 11/30/2022]
Abstract
In this study, deep learning and triplet loss function methods are used for finger vein verification research, and the model is trained and validated between different kinds of datasets including FV-USM, HKPU, and SDUMLA-HMT datasets. This work gives the accuracy and other evaluation indexes of finger vein verification calculated for different training-validation set combinations and gives the corresponding ROC curves and AUC values. The accuracy of the best result has reached 98%, and all the ROC AUC values are above 0.98, indicating that the obtained model can identify the finger veins well. Since the experiments are cross-validated between different kinds of datasets, the model has good adaptability and applicability. From the experimental results, it is also found that the model trained on the dataset that is more difficult to be distinguished will be a better and more robust model.
Collapse
|
11
|
El-Rahiem BA, El-Samie FEA, Amin M. Multimodal biometric authentication based on deep fusion of electrocardiogram (ECG) and finger vein. MULTIMEDIA SYSTEMS 2022; 28:1325-1337. [DOI: 10.1007/s00530-021-00810-9] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/09/2020] [Accepted: 05/13/2021] [Indexed: 09/01/2023]
|
12
|
FVR-Net: Finger Vein Recognition with Convolutional Neural Network Using Hybrid Pooling. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12157538] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
In this paper, we present FVR-Net, which is a novel finger vein recognition network using a convolutional neural network (CNN) with a hybrid pooling mechanism. The scheme is based on the use of a block-wise feature extraction network to extract discrete features from interclass vein image samples, regardless of their visual quality. Input images to FVR-Net are subjected to preprocessing prior to being fed into the network in order to segment the vein patterns from the background. We designed a feature extraction network in which each block consists of a convolutional layer followed by hybrid pooling, whose output activation maps are concatenated before passing features to another block within the network. In the hybrid pooling layer, two subsampling layers of maxpooling and average pooling are placed in parallel where the former activates the most discrete features of the input, and the latter considers the complete extent of the input volume so better localization of features can be accessed. After the features are extracted, they are passed to three fully connected layers (FCLs) for classification. We conduct several experiments on two publicly available finger vein datasets based on visual quality of the images. When compared to conventional studies, the proposed model achieves outstanding recognition performance with accuracies of up to 97.84% and 97.22% for good and poor-quality images, respectively. By varying multiple network hyperparameters, we obtain optimal settings such that the model can guarantee the best recognition accuracy for a finger vein biometric system.
Collapse
|
13
|
Chai T, Li J, Wang Y, Sun G, Guo C, Zhang Z. Vascular Enhancement Analysis in Lightweight Deep Feature Space. Neural Process Lett 2022. [DOI: 10.1007/s11063-022-10937-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2022]
|
14
|
Chai T, Li J, Prasad S, Lu Q, Zhang Z. Shape-driven lightweight CNN for finger-vein biometrics. JOURNAL OF INFORMATION SECURITY AND APPLICATIONS 2022. [DOI: 10.1016/j.jisa.2022.103211] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
|
15
|
Fang C, Ma H, Yang Z, Tian W. A finger-vein recognition method based on double-weighted group sparse representation classification. INT J MACH LEARN CYB 2022. [DOI: 10.1007/s13042-022-01558-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
|
16
|
An ROI Extraction Method of Finger Vein Images Based on Large Receptive Field Gradient Operator for Accurate Localization of Joint Cavity. JOURNAL OF HEALTHCARE ENGINEERING 2022; 2022:9231637. [PMID: 35677780 PMCID: PMC9170421 DOI: 10.1155/2022/9231637] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/23/2022] [Accepted: 05/13/2022] [Indexed: 11/25/2022]
Abstract
Region of interest (ROI) extraction is a key step in finger vein recognition preprocessing. The current method takes the finger region in the vein image as the ROI, but this method cannot obtain better recognition accuracy because it only removes the background noise of the image and ignores factors such as the position and shape of the finger. To solve this problem, we limited the ROI to a fixed region between two finger joint cavities, proposed a new large receptive field gradient operator, and designed and implemented a new method for ROI extraction. It uses a large receptive field to search the target, which is similar to human vision, thus solving the problem of difficult ROI localization for images with large gradient areas. Moreover, for external factors such as noise and uneven illumination in the vein image, the interference factors can be eliminated by averaging them to a larger range with a larger size operator to improve the accuracy of the subsequent matching recognition. To verify the effectiveness of the proposed method, we conducted sufficient matching experiments on three public finger vein datasets. On various datasets, our method significantly reduced the identified EER value, with the lowest EER value reaching 0.96%. The experimental results show that the proposed ROI extraction method can effectively eliminate the influence of finger position, finger shape, and other factors on the subsequent recognition performance, accurately locate the finger joint cavity, and effectively improve the recognition performance.
Collapse
|
17
|
Zhang Z, Wang M. A Simple and Efficient Method for Finger Vein Recognition. SENSORS 2022; 22:s22062234. [PMID: 35336406 PMCID: PMC8949429 DOI: 10.3390/s22062234] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/10/2022] [Revised: 03/07/2022] [Accepted: 03/11/2022] [Indexed: 12/10/2022]
Abstract
Finger vein recognition has drawn increasing attention as one of the most popular and promising biometrics due to its high distinguishing ability, security, and non-invasive procedure. The main idea of traditional schemes is to directly extract features from finger vein images and then compare features to find the best match. However, the features extracted from images contain much redundant data, while the features extracted from patterns are greatly influenced by image segmentation methods. To tackle these problems, this paper proposes a new finger vein recognition algorithm by generating code. The proposed method does not require an image segmentation algorithm, is simple to calculate, and has a small amount of data. Firstly, the finger vein images were divided into blocks to calculate the mean value. Then, the centrosymmetric coding was performed using the matrix generated by blocking and averaging. The obtained codewords were concatenated as the feature codewords of the image. The similarity between vein codes is measured by the ratio of minimum Hamming distance to codeword length. Extensive experiments on two public finger vein databases verify the effectiveness of the proposed method. The results indicate that our method outperforms the state-of-the-art methods and has competitive potential in performing the matching task.
Collapse
|
18
|
Score level fusion of major and minor finger knuckle patterns based symmetric sum-based rules for person authentication. EVOLVING SYSTEMS 2022. [DOI: 10.1007/s12530-022-09430-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
19
|
Moroń T, Bernacki K, Fiołka J, Peng J, Popowicz A. Recognition of the finger vascular system using multi‐wavelength imaging. IET BIOMETRICS 2022. [DOI: 10.1049/bme2.12068] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Affiliation(s)
- Tomasz Moroń
- Department of Cybernetics, Nanotechnology and Data Processing Silesian University of Technology Gliwice Poland
| | - Krzysztof Bernacki
- Department of Electronics, Electrical Engineering and Microelectronics Silesian University of Technology Gliwice Poland
| | - Jerzy Fiołka
- Department of Electronics, Electrical Engineering and Microelectronics Silesian University of Technology Gliwice Poland
| | - Jia Peng
- Department of Physics Durham University Durham UK
| | - Adam Popowicz
- Department of Electronics, Electrical Engineering and Microelectronics Silesian University of Technology Gliwice Poland
| |
Collapse
|
20
|
Muthusamy D, Rakkimuthu P. Steepest deep bipolar Cascade correlation for finger-vein verification. APPL INTELL 2022. [DOI: 10.1007/s10489-021-02619-5] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
21
|
Kauba C, Piciucco E, Maiorana E, Gomez-Barrero M, Prommegger B, Campisi P, Uhl A. Towards practical cancelable biometrics for finger vein recognition. Inf Sci (N Y) 2022. [DOI: 10.1016/j.ins.2021.11.018] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
22
|
Improving finger vein discriminant representation using dynamic margin softmax loss. Neural Comput Appl 2022. [DOI: 10.1007/s00521-021-06630-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
23
|
Jirayupat C, Nagashima K, Hosomi T, Takahashi T, Samransuksamer B, Hanai Y, Nakao A, Nakatani M, Liu J, Zhang G, Tanaka W, Kanai M, Yasui T, Baba Y, Yanagida T. Breath odor-based individual authentication by an artificial olfactory sensor system and machine learning. Chem Commun (Camb) 2022; 58:6377-6380. [DOI: 10.1039/d1cc06384g] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
Abstract
The potential feasibility of breath odor sensing-based individual authentication was demonstrated by a 16-channel chemiresistive sensor array and machine learning.
Collapse
Affiliation(s)
- Chaiyanut Jirayupat
- Department of Applied Chemistry, Graduate School of Engineering, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8656, Japan
- Interdisciplinary Graduate School of Engineering Sciences, Kyushu University, 6-1 Kasuga-Koen, Kasuga, Fukuoka, 816-8580, Japan
| | - Kazuki Nagashima
- Department of Applied Chemistry, Graduate School of Engineering, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8656, Japan
- PRESTO, Japan Science and Technology Agency, 4-1-8, Honcho, Kawaguchi-Shi, Saitama 332-0012, Japan
| | - Takuro Hosomi
- Department of Applied Chemistry, Graduate School of Engineering, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8656, Japan
- PRESTO, Japan Science and Technology Agency, 4-1-8, Honcho, Kawaguchi-Shi, Saitama 332-0012, Japan
| | - Tsunaki Takahashi
- Department of Applied Chemistry, Graduate School of Engineering, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8656, Japan
- PRESTO, Japan Science and Technology Agency, 4-1-8, Honcho, Kawaguchi-Shi, Saitama 332-0012, Japan
| | - Benjarong Samransuksamer
- Department of Applied Chemistry, Graduate School of Engineering, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8656, Japan
| | - Yosuke Hanai
- Panasonic Corporation, Industry Company, Sensing Solutions Development Center, Kadoma 1006, Kadoma, Osaka 571-8506, Japan
| | - Atsuo Nakao
- Panasonic Corporation, Industry Company, Sensing Solutions Development Center, Kadoma 1006, Kadoma, Osaka 571-8506, Japan
| | - Masaya Nakatani
- Panasonic Corporation, Industry Company, Sensing Solutions Development Center, Kadoma 1006, Kadoma, Osaka 571-8506, Japan
| | - Jiangyang Liu
- Department of Applied Chemistry, Graduate School of Engineering, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8656, Japan
| | - Guozhu Zhang
- Department of Applied Chemistry, Graduate School of Engineering, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8656, Japan
| | - Wataru Tanaka
- Department of Applied Chemistry, Graduate School of Engineering, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8656, Japan
| | - Masaki Kanai
- Institute for Materials Chemistry and Engineering, Kyushu University, 6-1 Kasuga-Koen, Kasuga, Fukuoka 816-8580, Japan
| | - Takao Yasui
- PRESTO, Japan Science and Technology Agency, 4-1-8, Honcho, Kawaguchi-Shi, Saitama 332-0012, Japan
- Department of Biomolecular Engineering, Graduate School of Engineering, Nagoya University, Furo-cho, Chikusa-ku, Nagoya, 464-8603, Japan
| | - Yoshinobu Baba
- Department of Biomolecular Engineering, Graduate School of Engineering, Nagoya University, Furo-cho, Chikusa-ku, Nagoya, 464-8603, Japan
| | - Takeshi Yanagida
- Department of Applied Chemistry, Graduate School of Engineering, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8656, Japan
- Interdisciplinary Graduate School of Engineering Sciences, Kyushu University, 6-1 Kasuga-Koen, Kasuga, Fukuoka, 816-8580, Japan
- Institute for Materials Chemistry and Engineering, Kyushu University, 6-1 Kasuga-Koen, Kasuga, Fukuoka 816-8580, Japan
| |
Collapse
|
24
|
Zhang R, Jing X. Device-Free Human Identification Using Behavior Signatures in WiFi Sensing. SENSORS 2021; 21:s21175921. [PMID: 34502812 PMCID: PMC8434234 DOI: 10.3390/s21175921] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/27/2021] [Revised: 08/24/2021] [Accepted: 08/31/2021] [Indexed: 11/29/2022]
Abstract
Wireless sensing can be used for human identification by mining and quantifying individual behavior effects on wireless signal propagation. This work proposes a novel device-free biometric (DFB) system, WirelessID, that explores the joint human fine-grained behavior and body physical signatures embedded in channel state information (CSI) by extracting spatiotemporal features. In addition, the signal fluctuations corresponding to different parts of the body contribute differently to the identification performance. Inspired by the success of the attention mechanism in computer vision (CV), thus, to extract more robust features, we introduce the spatiotemporal attention function into our system. To evaluate the performance, commercial WiFi devices are used for prototyping WirelessID in a real laboratory environment with an average accuracy of 93.14% and a best accuracy of 97.72% for five individuals.
Collapse
|
25
|
Matsuda S, Yoshimura H. Personal identification systems for persons with dementia: a systematic review. Psychogeriatrics 2021; 21:832-838. [PMID: 34355469 DOI: 10.1111/psyg.12752] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/14/2021] [Revised: 07/20/2021] [Accepted: 07/26/2021] [Indexed: 12/11/2022]
Abstract
People with dementia can become missing and unable to be identified due to their cognitive decline and may not have belongings, including personally identifiable information. The aim of this systematic review was to summarise and discuss the current status of personal identification systems for missing and unidentified persons with dementia. An electronic systematic literature search was conducted by using PubMed, Web of Science, Cochrane Library, and CINAHL. By performing an electronic literature search, 128 texts were extracted. However, only three eligible texts were included in this review, and these were divided on the basis of the analysis target as follows: medical and human community support systems and digital systems. It is important to develop medical and social care systems and to construct and advance social personal identification systems, including medical and human community support systems and digital systems, for persons with dementia. However, this systematic review clarified that there have only been a few reports about the development and construction of social systems for missing and unidentified persons with dementia. People who interact with persons with dementia should consider this problem, which is increasing each year, and strive to build a social system that can be applied to personal identification as soon as possible.
Collapse
Affiliation(s)
- Shinpei Matsuda
- Department of Dentistry and Oral Surgery, Unit of Sensory and Locomotor Medicine, Division of Medicine, Faculty of Medical Sciences, University of Fukui, Fukui, Japan
| | - Hitoshi Yoshimura
- Department of Dentistry and Oral Surgery, Unit of Sensory and Locomotor Medicine, Division of Medicine, Faculty of Medical Sciences, University of Fukui, Fukui, Japan
| |
Collapse
|
26
|
Finger vein recognition system with template protection based on convolutional neural network. Knowl Based Syst 2021. [DOI: 10.1016/j.knosys.2021.107159] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
|
27
|
Sun M, Ma Y, Tong Z, Wang Z, Zhang W, Yang S. High-security photoacoustic identity recognition by capturing hierarchical vascular structure of finger. JOURNAL OF BIOPHOTONICS 2021; 14:e202100086. [PMID: 34008295 DOI: 10.1002/jbio.202100086] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/16/2021] [Revised: 05/14/2021] [Accepted: 05/17/2021] [Indexed: 06/12/2023]
Abstract
Currently, most biometric methods mainly use single features, making them easily forged and cracked. In this study, a novel triple-layers biometric recognition method, based on photoacoustic microscopy, is proposed to improve the security of biometric identity recognition. Using the photoacoustic (PA) dermoscope, three-dimensional absorption-structure information of the fingers was obtained. Then, by combining U-Net, Gabor filtering, wavelet analysis and morphological transform, a lightweight algorithm called photoacoustic depth feature recognition algorithm (PADFR) was developed to automatically realize stratification (the fingerprint, blood vessel fingerprint and venous vascular), extracting feature points and identity recognition. The experimental results show that PADFR can automatically recognize the PA hierarchical features with an average accuracy equal to 92.99%. The proposed method is expected to be widely used in biometric identification system due to its high security.
Collapse
Affiliation(s)
- Mingman Sun
- MOE Key Laboratory of Laser Life Science and Institute of Laser Life Science, College of Biophotonics, South China Normal University, Guangzhou, China
- Guangdong Provincial Key Laboratory of Laser Life Science, College of Biophotonics, South China Normal University, Guangzhou, China
| | - Yuanzheng Ma
- MOE Key Laboratory of Laser Life Science and Institute of Laser Life Science, College of Biophotonics, South China Normal University, Guangzhou, China
- Guangdong Provincial Key Laboratory of Laser Life Science, College of Biophotonics, South China Normal University, Guangzhou, China
| | - Zhuangzhuang Tong
- MOE Key Laboratory of Laser Life Science and Institute of Laser Life Science, College of Biophotonics, South China Normal University, Guangzhou, China
- Guangdong Provincial Key Laboratory of Laser Life Science, College of Biophotonics, South China Normal University, Guangzhou, China
| | - Zhiyang Wang
- MOE Key Laboratory of Laser Life Science and Institute of Laser Life Science, College of Biophotonics, South China Normal University, Guangzhou, China
- Guangdong Provincial Key Laboratory of Laser Life Science, College of Biophotonics, South China Normal University, Guangzhou, China
| | - Wuyu Zhang
- MOE Key Laboratory of Laser Life Science and Institute of Laser Life Science, College of Biophotonics, South China Normal University, Guangzhou, China
- Guangdong Provincial Key Laboratory of Laser Life Science, College of Biophotonics, South China Normal University, Guangzhou, China
| | - Sihua Yang
- MOE Key Laboratory of Laser Life Science and Institute of Laser Life Science, College of Biophotonics, South China Normal University, Guangzhou, China
- Guangdong Provincial Key Laboratory of Laser Life Science, College of Biophotonics, South China Normal University, Guangzhou, China
| |
Collapse
|
28
|
Choi J, Hong JS, Owais M, Kim SG, Park KR. Restoration of Motion Blurred Image by Modified DeblurGAN for Enhancing the Accuracies of Finger-Vein Recognition. SENSORS 2021; 21:s21144635. [PMID: 34300373 PMCID: PMC8309672 DOI: 10.3390/s21144635] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/10/2021] [Revised: 07/01/2021] [Accepted: 07/03/2021] [Indexed: 11/29/2022]
Abstract
Among many available biometrics identification methods, finger-vein recognition has an advantage that is difficult to counterfeit, as finger veins are located under the skin, and high user convenience as a non-invasive image capturing device is used for recognition. However, blurring can occur when acquiring finger-vein images, and such blur can be mainly categorized into three types. First, skin scattering blur due to light scattering in the skin layer; second, optical blur occurs due to lens focus mismatching; and third, motion blur exists due to finger movements. Blurred images generated in these kinds of blur can significantly reduce finger-vein recognition performance. Therefore, restoration of blurred finger-vein images is necessary. Most of the previous studies have addressed the restoration method of skin scattering blurred images and some of the studies have addressed the restoration method of optically blurred images. However, there has been no research on restoration methods of motion blurred finger-vein images that can occur in actual environments. To address this problem, this study proposes a new method for improving the finger-vein recognition performance by restoring motion blurred finger-vein images using a modified deblur generative adversarial network (modified DeblurGAN). Based on an experiment conducted using two open databases, the Shandong University homologous multi-modal traits (SDUMLA-HMT) finger-vein database and Hong Kong Polytechnic University finger-image database version 1, the proposed method demonstrates outstanding performance that is better than those obtained using state-of-the-art methods.
Collapse
|
29
|
Adaptive Management of Multimodal Biometrics—A Deep Learning and Metaheuristic Approach. Appl Soft Comput 2021. [DOI: 10.1016/j.asoc.2021.107344] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
30
|
Lu H, Wang Y, Gao R, Zhao C, Li Y. A Novel ROI Extraction Method Based on the Characteristics of the Original Finger Vein Image. SENSORS 2021; 21:s21134402. [PMID: 34199052 PMCID: PMC8272092 DOI: 10.3390/s21134402] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/05/2021] [Revised: 06/18/2021] [Accepted: 06/22/2021] [Indexed: 11/23/2022]
Abstract
As the second generation of biometric technology, finger vein recognition has become a research hotspot due to its advantages such as high security, and living body recognition. In recent years, the global pandemic has promoted the development of contactless identification. However, the unconstrained finger vein acquisition process will introduce more uneven illumination, finger image deformation, and some other factors that may affect the recognition, so it puts forward higher requirements for the acquisition speed, accuracy and other performance. Considering the universal, obvious, and stable characteristics of the original finger vein imaging, we proposed a new Region Of Interest (ROI) extraction method based on the characteristics of finger vein image, which contains three innovative elements: a horizontal Sobel operator with additional weights; an edge detection method based on finger contour imaging characteristics; a gradient detection operator based on large receptive field. The proposed methods were evaluated and compared with some representative methods by using four different public datasets of finger veins. The experimental results show that, compared with the existing representative methods, our proposed ROI extraction method is 1/10th of the processing time of the threshold-based methods, and it is similar to the time spent for coarse extraction in the mask-based methods. The ROI extraction results show that the proposed method has better robustness for different quality images. Moreover, the results of recognition matching experiments on different datasets indicate that our method achieves the best Equal Error Rate (EER) of 0.67% without the refinement of feature extraction parameters, and all the EERs are significantly lower than those of the representative methods.
Collapse
Affiliation(s)
- Huimin Lu
- Correspondence: ; Tel.: +86-139-4490-8258
| | | | | | | | | |
Collapse
|
31
|
A Novel Finger Vein Recognition Method Based on Aggregation of Radon-Like Features. SENSORS 2021; 21:s21051885. [PMID: 33800280 PMCID: PMC7962657 DOI: 10.3390/s21051885] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/02/2021] [Revised: 02/27/2021] [Accepted: 03/04/2021] [Indexed: 11/17/2022]
Abstract
Finger vein (FV) biometrics is one of the most promising individual recognition traits, which has the capabilities of uniqueness, anti-forgery, and bio-assay, etc. However, due to the restricts of imaging environments, the acquired FV images are easily degraded to low-contrast, blur, as well as serious noise disturbance. Therefore, how to extract more efficient and robust features from these low-quality FV images, remains to be addressed. In this paper, a novel feature extraction method of FV images is presented, which combines curvature and radon-like features (RLF). First, an enhanced vein pattern image is obtained by calculating the mean curvature of each pixel in the original FV image. Then, a specific implementation of RLF is developed and performed on the previously obtained vein pattern image, which can effectively aggregate the dispersed spatial information around the vein structures, thus highlight vein patterns and suppress spurious non-boundary responses and noises. Finally, a smoother vein structure image is obtained for subsequent matching and verification. Compared with the existing curvature-based recognition methods, the proposed method can not only preserve the inherent vein patterns, but also eliminate most of the pseudo vein information, so as to restore more smoothing and genuine vein structure information. In order to assess the performance of our proposed RLF-based method, we conducted comprehensive experiments on three public FV databases and a self-built FV database (which contains 37,080 samples that derived from 1030 individuals). The experimental results denoted that RLF-based feature extraction method can obtain more complete and continuous vein patterns, as well as better recognition accuracy.
Collapse
|
32
|
Prommegger B, Uhl A. A fully rotation invariant multi‐camera finger vein recognition system. IET BIOMETRICS 2021. [DOI: 10.1049/bme2.12019] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022] Open
Affiliation(s)
- Bernhard Prommegger
- Department of Computer Sciences University of Salzburg Jakob‐Haringer‐Str. 2 Salzburg Austria
| | - Andreas Uhl
- Department of Computer Sciences University of Salzburg Jakob‐Haringer‐Str. 2 Salzburg Austria
| |
Collapse
|
33
|
Kim K, Jeong HW, Lee Y. Performance Evaluation of Dorsal Vein Network of Hand Imaging Using Relative Total Variation-Based Regularization for Smoothing Technique in a Miniaturized Vein Imaging System: A Pilot Study. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2021; 18:ijerph18041548. [PMID: 33561967 PMCID: PMC7915855 DOI: 10.3390/ijerph18041548] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/07/2021] [Revised: 02/02/2021] [Accepted: 02/03/2021] [Indexed: 11/16/2022]
Abstract
Vein puncture is commonly used for blood sampling, and accurately locating the blood vessel is an important challenge in the field of diagnostic tests. Imaging systems based on near-infrared (NIR) light are widely used for accurate human vein puncture. In particular, segmentation of a region of interest using the obtained NIR image is an important field, and research for improving the image quality by removing noise and enhancing the image contrast is being widely conducted. In this paper, we propose an effective model in which the relative total variation (RTV) regularization algorithm and contrast-limited adaptive histogram equalization (CLAHE) are combined, whereby some major edge information can be better preserved. In our previous study, we developed a miniaturized NIR imaging system using light with a wavelength of 720–1100 nm. We evaluated the usefulness of the proposed algorithm by applying it to images acquired by the developed NIR imaging system. Compared with the conventional algorithm, when the proposed method was applied to the NIR image, the visual evaluation performance and quantitative evaluation performance were enhanced. In particular, when the proposed algorithm was applied, the coefficient of variation was improved by a factor of 15.77 compared with the basic image. The main advantages of our algorithm are the high noise reduction efficiency, which is beneficial for reducing the amount of undesirable information, and better contrast. In conclusion, the applicability and usefulness of the algorithm combining the RTV approach and CLAHE for NIR images were demonstrated, and the proposed model can achieve a high image quality.
Collapse
Affiliation(s)
- Kyuseok Kim
- Electro-Medical Device Research Center, Korea Electrotechnology Research Institute (KERI), Gyeonggi-do 15588, Korea;
| | - Hyun-Woo Jeong
- Department of Biomedical Engineering, Eulji University, Seongnam 13135, Korea
- Correspondence: (H.-W.J.); (Y.L.); Tel.: +82-31-740-7135 (H.-W.J.); +82-32-820-4362 (Y.L.)
| | - Youngjin Lee
- Department of Radiological Science, Gachon University, Incheon 21936, Korea
- Correspondence: (H.-W.J.); (Y.L.); Tel.: +82-31-740-7135 (H.-W.J.); +82-32-820-4362 (Y.L.)
| |
Collapse
|
34
|
Lei L, Xi F, Chen S, Liu Z. Iterated graph cut method for automatic and accurate segmentation of finger-vein images. APPL INTELL 2021. [DOI: 10.1007/s10489-020-01828-8] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
35
|
Noh KJ, Choi J, Hong JS, Park KR. Finger-Vein Recognition Using Heterogeneous Databases by Domain Adaption Based on a Cycle-Consistent Adversarial Network. SENSORS 2021; 21:s21020524. [PMID: 33451009 PMCID: PMC7828566 DOI: 10.3390/s21020524] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/24/2020] [Revised: 01/09/2021] [Accepted: 01/10/2021] [Indexed: 11/16/2022]
Abstract
The conventional finger-vein recognition system is trained using one type of database and entails the serious problem of performance degradation when tested with different types of databases. This degradation is caused by changes in image characteristics due to variable factors such as position of camera, finger, and lighting. Therefore, each database has varying characteristics despite the same finger-vein modality. However, previous researches on improving the recognition accuracy of unobserved or heterogeneous databases is lacking. To overcome this problem, we propose a method to improve the finger-vein recognition accuracy using domain adaptation between heterogeneous databases using cycle-consistent adversarial networks (CycleGAN), which enhances the recognition accuracy of unobserved data. The experiments were performed with two open databases—Shandong University homologous multi-modal traits finger-vein database (SDUMLA-HMT-DB) and Hong Kong Polytech University finger-image database (HKPolyU-DB). They showed that the equal error rate (EER) of finger-vein recognition was 0.85% in case of training with SDUMLA-HMT-DB and testing with HKPolyU-DB, which had an improvement of 33.1% compared to the second best method. The EER was 3.4% in case of training with HKPolyU-DB and testing with SDUMLA-HMT-DB, which also had an improvement of 4.8% compared to the second best method.
Collapse
|
36
|
Meng X, Zheng J, Xi X, Zhang Q, Yin Y. Finger vein recognition based on zone-based minutia matching. Neurocomputing 2021. [DOI: 10.1016/j.neucom.2020.10.029] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
37
|
Li X, Li Z, Yang D, Zhong L, Huang L, Lin J. Research on Finger Vein Image Segmentation and Blood Sampling Point Location in Automatic Blood Collection. SENSORS 2020; 21:s21010132. [PMID: 33379213 PMCID: PMC7795357 DOI: 10.3390/s21010132] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/27/2020] [Revised: 12/22/2020] [Accepted: 12/23/2020] [Indexed: 11/16/2022]
Abstract
In the fingertip blood automatic sampling process, when the blood sampling point in the fingertip venous area, it will greatly increase the amount of bleeding without being squeezed. In order to accurately locate the blood sampling point in the venous area, we propose a new finger vein image segmentation approach basing on Gabor transform and Gaussian mixed model (GMM). Firstly, Gabor filter parameter can be set adaptively according to the differential excitation of image and we use the local binary pattern (LBP) to fuse the same-scale and multi-orientation Gabor features of the image. Then, finger vein image segmentation is achieved by Gabor-GMM system and optimized by the max flow min cut method which is based on the relative entropy of the foreground and the background. Finally, the blood sampling point can be localized with corner detection. The experimental results show that the proposed approach has significant performance in segmenting finger vein images which the average accuracy of segmentation images reach 91.6%.
Collapse
Affiliation(s)
- Xi Li
- School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing 400065, China; (X.L.); (D.Y.); (L.Z.); (L.H.)
- Foundation Department, Chongqing Medical and Pharmaceutical College, Chongqing 401331, China
| | - Zhangyong Li
- School of Bioinformatics, Chongqing University of Posts and Telecommunications, Chongqing 400065, China;
| | - Dewei Yang
- School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing 400065, China; (X.L.); (D.Y.); (L.Z.); (L.H.)
| | - Lisha Zhong
- School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing 400065, China; (X.L.); (D.Y.); (L.Z.); (L.H.)
| | - Lian Huang
- School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing 400065, China; (X.L.); (D.Y.); (L.Z.); (L.H.)
| | - Jinzhao Lin
- School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing 400065, China; (X.L.); (D.Y.); (L.Z.); (L.H.)
- Correspondence:
| |
Collapse
|
38
|
Galdi C, Boyle J, Chen L, Chiesa V, Debiasi L, Dugelay J, Ferryman J, Grudzień A, Kauba C, Kirchgasser S, Kowalski M, Linortner M, Maik P, Michoń K, Patino L, Prommegger B, Sequeira AF, Szklarski Ł, Uhl A. PROTECT: Pervasive and useR fOcused biomeTrics bordEr projeCT – a case study. IET BIOMETRICS 2020. [DOI: 10.1049/iet-bmt.2020.0033] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Affiliation(s)
- Chiara Galdi
- Digital Security Department EURECOM 450 Route des Chappes Sophia Antipolis France
| | - Jonathan Boyle
- Department of Computer Science University of Reading Whiteknights Reading RG6 6AY UK
| | - Lulu Chen
- Department of Computer Science University of Reading Whiteknights Reading RG6 6AY UK
| | - Valeria Chiesa
- Digital Security Department EURECOM 450 Route des Chappes Sophia Antipolis France
| | - Luca Debiasi
- Department of Computer Sciences University of Salzburg Jakob‐Haringer‐Str. 2 Salzburg Austria
| | - Jean‐Luc Dugelay
- Digital Security Department EURECOM 450 Route des Chappes Sophia Antipolis France
| | - James Ferryman
- Department of Computer Science University of Reading Whiteknights Reading RG6 6AY UK
| | - Artur Grudzień
- Institute of Optoelectronics Military University of Technology Gen. S. Kaliskiego 2 Warsaw Poland
| | - Christof Kauba
- Department of Computer Sciences University of Salzburg Jakob‐Haringer‐Str. 2 Salzburg Austria
| | - Simon Kirchgasser
- Department of Computer Sciences University of Salzburg Jakob‐Haringer‐Str. 2 Salzburg Austria
| | - Marcin Kowalski
- Institute of Optoelectronics Military University of Technology Gen. S. Kaliskiego 2 Warsaw Poland
| | - Michael Linortner
- Department of Computer Sciences University of Salzburg Jakob‐Haringer‐Str. 2 Salzburg Austria
| | - Patryk Maik
- Research and Development Department ITTI Sp. z o.o. ul. Rubież 46, 61–612 Poznań Poland
| | - Kacper Michoń
- Research and Development Department ITTI Sp. z o.o. ul. Rubież 46, 61–612 Poznań Poland
| | - Luis Patino
- Department of Computer Science University of Reading Whiteknights Reading RG6 6AY UK
| | - Bernhard Prommegger
- Department of Computer Sciences University of Salzburg Jakob‐Haringer‐Str. 2 Salzburg Austria
| | - Ana F. Sequeira
- INESC TEC University of Porto Rua Dr. Roberto Frias, 4200–465 Porto Portugal
| | - Łukasz Szklarski
- Research and Development Department ITTI Sp. z o.o. ul. Rubież 46, 61–612 Poznań Poland
| | - Andreas Uhl
- Department of Computer Sciences University of Salzburg Jakob‐Haringer‐Str. 2 Salzburg Austria
| |
Collapse
|
39
|
Genser N, Seiler J, Kaup A. Camera Array for Multi-Spectral Imaging. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2020; PP:9234-9249. [PMID: 32970597 DOI: 10.1109/tip.2020.3024738] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Recently, many new applications arose for multispectral and hyper-spectral imaging. Besides modern biometric systems for identity verification, also agricultural and medical applications came up, which measure the health condition of plants and humans. Despite the growing demand, the acquisition of multi-spectral data is up to the present complicated. Often, expensive, inflexible, or low resolution acquisition setups are only obtainable for specific professional applications. To overcome these limitations, a novel camera array for multi-spectral imaging is presented in this article for generating consistent multispectral videos. As differing spectral images are acquired at various viewpoints, a geometrically constrained multi-camera sensor layout is introduced, which enables the formulation of novel registration and reconstruction algorithms to globally set up robust models. On average, the novel acquisition approach achieves a gain of 2.5 dB PSNR compared to recently published multi-spectral filter array imaging systems. At the same time, the proposed acquisition system ensures not only a superior spatial, but also a high spectral, and temporal resolution, while filters are flexibly exchangeable by the user depending on the application. Moreover, depth information is generated, so that 3D imaging applications, e.g., for augmented or virtual reality, become possible. The proposed camera array for multi-spectral imaging can be set up using off-the-shelf hardware, which allows for a compact design and employment in, e.g., mobile devices or drones, while being cost-effective.
Collapse
|
40
|
|
41
|
Yao Q, Song D, Xu X. Robust Finger-vein ROI Localization Based on the 3 σ Criterion Dynamic Threshold Strategy. SENSORS 2020; 20:s20143997. [PMID: 32708410 PMCID: PMC7412349 DOI: 10.3390/s20143997] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/25/2020] [Revised: 07/12/2020] [Accepted: 07/17/2020] [Indexed: 11/16/2022]
Abstract
Region of interest (ROI) localization is one of the key preprocessing technologies for a finger-vein identification system, so an effective ROI definition can improve the matching accuracy. However, due to the impact of uneven illumination, equipment noise, as well as the distortion of finger position, etc., these make accurate ROI localization a very difficult task. To address these issues, in this paper, we propose a robust finger-vein ROI localization method, which is based on the 3σ criterion dynamic threshold strategy. The proposed method includes three main steps: First, the Kirsch edge detector is introduced to detect the horizontal-like edges in the acquired finger-vein image. Then, the obtained edge gradient image is divided into four parts: upper-left, upper-right, lower-left, and lower-right. For each part of the image, the three-level dynamic threshold, which is based on the 3σ criterion of the normal distribution, is imposed to obtain more distinct and complete edge information. Finally, through labeling the longest connected component at the same horizontal line, two reliable finger boundaries, which represent the upper and lower boundaries, respectively, are defined, and the ROI is localized in the region between these two boundaries. Extensive experiments are carried out on four different finger-vein image datasets, including three publicly available datasets and one of our newly developed finger-vein datasets with 37,080 finger-vein samples and 1030 individuals. The experimental results indicate that our proposed method has very competitive ROI localization performance, as well as satisfactory matching results on different datasets.
Collapse
Affiliation(s)
| | | | - Xiang Xu
- Correspondence: ; Tel.: +86-0760-882-27202
| |
Collapse
|
42
|
Category-preserving binary feature learning and binary codebook learning for finger vein recognition. INT J MACH LEARN CYB 2020. [DOI: 10.1007/s13042-020-01143-1] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
43
|
Vein Pattern Verification and Identification Based on Local Geometric Invariants Constructed from Minutia Points and Augmented with Barcoded Local Feature. APPLIED SCIENCES-BASEL 2020. [DOI: 10.3390/app10093192] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/04/2023]
Abstract
This paper presents the development of a hybrid feature—dorsal hand vein and dorsal geometry—modality for human recognition. Our proposed hybrid feature extraction method exploits two types of features: dorsal hand geometric-related and local vein pattern. Using geometric affine invariants, the peg-free system extracts minutia points and vein termination and bifurcation and constructs a set of geometric invariants, which are then used to establish the correspondence between two sets of minutiae—one for the query vein image and the other for the reference vein image. When the correspondence is established, geometric transformation parameters are computed to align the query with the reference image. Once aligned, hybrid features are extracted for identification. In this study, the algorithm was tested on a database of 140 subjects, in which ten different dorsal hand geometric-related images were taken for each individual, and yielded the promising results. In this regard, we have achieved an equal error rate (EER) of 0.243%, indicating that our method is feasible and effective for dorsal vein recognition with high accuracy. This hierarchical scheme significantly improves the performance of personal verification and/or identification.
Collapse
|
44
|
Kauba C, Prommegger B, Uhl A. Combined Fully Contactless Finger and Hand Vein Capturing Device with a Corresponding Dataset. SENSORS 2019; 19:s19225014. [PMID: 31744197 PMCID: PMC6891606 DOI: 10.3390/s19225014] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/15/2019] [Revised: 11/08/2019] [Accepted: 11/13/2019] [Indexed: 11/28/2022]
Abstract
Vascular pattern based biometric recognition is gaining more and more attention, with a trend towards contactless acquisition. An important requirement for conducting research in vascular pattern recognition are available datasets. These datasets can be established using a suitable biometric capturing device. A sophisticated capturing device design is important for good image quality and, furthermore, at a decent recognition rate. We propose a novel contactless capturing device design, including technical details of its individual parts. Our capturing device is suitable for finger and hand vein image acquisition and is able to acquire palmar finger vein images using light transmission as well as palmar hand vein images using reflected light. An experimental evaluation using several well-established vein recognition schemes on a dataset acquired with the proposed capturing device confirms its good image quality and competitive recognition performance. This challenging dataset, which is one of the first publicly available contactless finger and hand vein datasets, is published as well.
Collapse
|
45
|
|
46
|
Qin H, El-Yacoubi MA. Finger-Vein Quality Assessment Based on Deep Features From Grayscale and Binary Images. INT J PATTERN RECOGN 2019. [DOI: 10.1142/s0218001419400226] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Finger-vein verification is a highly secure biometric authentication that has been widely investigated over the last years. One of its challenges, however, is the possible degradation of image quality, that results in spurious and missing vein patterns, which increases the verification error. Despite recent advances in finger-vein quality assessment, the proposed solutions are limited as they depend on human expertise and domain knowledge to extract handcrafted features for assessing quality. We have proposed, recently, the first deep neural network (DNN) framework for assessing finger-vein quality, that does not require manual labeling of high and low quality images, as is the case for state of the art methods, but infers such annotations automatically based on an objective indicator, the biometric verification decision. This framework has significantly outperformed the existing methods, whether the input image is in grayscale or is binary. Motivated by these performances, we propose, in this work, a representation learning of finger vein image quality, where a DNN takes as input conjointly the grayscale and binary versions of the input image to predict vein quality. Our model allows to learn the joint representation from grayscale and binary images, for quality assessment. The experimental results, obtained on a large public dataset, demonstrates that our proposed method accurately identifies high and low quality images, and outperforms other techniques in terms of equal error rate (EER) minimization, including our previous DNN models, based either on grayscale or binary input.
Collapse
Affiliation(s)
- Huafeng Qin
- Chongqing Engineering Laboratory of Detection Control and Integrated System, Chongqing Technology and Business University, Chonqing 500000, P. R. China
| | - Mounim A. El-Yacoubi
- Department EPH, Telecom-SudParis/Institut Mines-Telecom, 9 rue Charles Fourier 91011, Evry, France
| |
Collapse
|
47
|
Fast Finger Vein Recognition Based on Sparse Matching Algorithm under a Multicore Platform for Real-Time Individuals Identification. Symmetry (Basel) 2019. [DOI: 10.3390/sym11091167] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
Nowadays, individual identification is a problem in many private companies, but also in governmental and public order entities. Currently, there are multiple biometric methods, each with different advantages. Finger vein recognition is a modern biometric technique, which has several advantages, especially in terms of security and accuracy. However, image deformations and time efficiency are two of the major limitations of state-of-the-art contributions. In spite of affine transformations produced during the acquisition process, the geometric structure of finger vein images remains invariant. This consideration of the symmetry phenomena presented in finger vein images is exploited in the present work. We combine an image enhancement procedure, the DAISY descriptor, and an optimized Coarse-to-fine PatchMatch (CPM) algorithm under a multicore parallel platform, to develop a fast finger vein recognition method for real-time individuals identification. Our proposal provides an effective and efficient technique to obtain the displacement between finger vein images and considering it as discriminatory information. Experimental results on two well-known databases, PolyU and SDUMLA, show that our proposed approach achieves results comparable to deformation-based techniques of the state-of-the-art, finding statistical differences respect to non-deformation-based approaches. Moreover, our method highly outperforms the baseline method in time efficiency.
Collapse
|
48
|
Hom Choudhury S, Kumar A, Laskar SH. Biometric Authentication through Unification of Finger Dorsal Biometric Traits. Inf Sci (N Y) 2019. [DOI: 10.1016/j.ins.2019.05.045] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/19/2023]
|
49
|
Murakami T, Ohki T, Kaga Y, Fujio M, Takahashi K. Cancelable indexing based on low-rank approximation of correlation-invariant random filtering for fast and secure biometric identification. Pattern Recognit Lett 2019. [DOI: 10.1016/j.patrec.2018.04.005] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2022]
|
50
|
Design and implementation of secure ATM system using machine learning and crypto–stego methodology. SN APPLIED SCIENCES 2019. [DOI: 10.1007/s42452-019-0988-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022] Open
|