1
|
Lu J, Yan T, Yang L, Zhang X, Li J, Li D, Xiang J, Wang B. Brain fingerprinting and cognitive behavior predicting using functional connectome of high inter-subject variability. Neuroimage 2024; 295:120651. [PMID: 38788914 DOI: 10.1016/j.neuroimage.2024.120651] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2024] [Revised: 05/16/2024] [Accepted: 05/22/2024] [Indexed: 05/26/2024] Open
Abstract
The functional connectivity (FC) graph of the brain has been widely recognized as a ``fingerprint'' that can be used to identify individuals from a group of subjects. Research has indicated that individual identification accuracy can be improved by eliminating the impact of shared information among individuals. However, current research extracts not only shared information of inter-subject but also individual-specific information from FC graphs, resulting in incomplete separation of shared information and fingerprint information among individuals, leading to lower individual identification accuracy across all functional magnetic resonance imaging (fMRI) states session pairs and poor cognitive behavior prediction performance. In this paper, we propose a method to enhance inter-subject variability combining conditional variational autoencoder (CVAE) network and sparse dictionary learning (SDL) module. By embedding fMRI state information in the encoding and decoding processes, the CVAE network can better capture and represent the common features among individuals and enhance inter-subject variability by residual. Our experimental results on Human Connectome Project (HCP) data show that the refined connectomes obtained by using CVAE with SDL can accurately distinguish an individual from the remaining participants. The success accuracies reached 99.7 % and 99.6 % in the session pair rest1-rest2 and reverse rest2-rest1, respectively. In the identification experiment involving task-task combinations carried out on the same day, the identification accuracies ranged from 94.2 % to 98.8 %. Furthermore, we showed the Frontoparietal and Default networks make the most significant contributions to individual identification and the edges that significantly contribute to individual identification are found within and between the Frontoparietal and Default networks. Additionally, high-level cognitive behaviors can also be better predicted with the obtained refined connectomes, suggesting that higher fingerprinting can be useful for resulting in higher behavioral associations. In summary, our proposed framework provides a promising approach to use functional connectivity networks for studying cognition and behavior, promoting a deeper understanding of brain functions.
Collapse
Affiliation(s)
- Jiayu Lu
- College of Computer Science and Technology, Taiyuan University of Technology, Taiyuan, 030024, China
| | - Tianyi Yan
- School of Life Science, Beijing Institute of Technology, 100081, China
| | - Lan Yang
- College of Computer Science and Technology, Taiyuan University of Technology, Taiyuan, 030024, China
| | - Xi Zhang
- College of Computer Science and Technology, Taiyuan University of Technology, Taiyuan, 030024, China
| | - Jiaxin Li
- College of Computer Science and Technology, Taiyuan University of Technology, Taiyuan, 030024, China
| | - Dandan Li
- College of Computer Science and Technology, Taiyuan University of Technology, Taiyuan, 030024, China
| | - Jie Xiang
- College of Computer Science and Technology, Taiyuan University of Technology, Taiyuan, 030024, China
| | - Bin Wang
- College of Computer Science and Technology, Taiyuan University of Technology, Taiyuan, 030024, China.
| |
Collapse
|
2
|
Zhang Y, Li J. Identification of individuals using functional near-infrared spectroscopy based on a one-dimensional convolutional neural network. JOURNAL OF BIOPHOTONICS 2024; 17:e202300453. [PMID: 38282446 DOI: 10.1002/jbio.202300453] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/01/2023] [Revised: 12/25/2023] [Accepted: 01/14/2024] [Indexed: 01/30/2024]
Abstract
In recent years, the application of functional near-infrared spectroscopy (fNIRS) and deep learning techniques has emerged as a promising method for personal identification. In this study, we innovatively utilized a deep learning framework and fNIRS data for personal identification. The framework is a one-dimensional convolutional neural network (Conv1D) trained on resting-state fNIRS signals collected from the frontal cortex of adults. In data preprocessing, we employed a sliding window-based data augmentation technique and high-pass filter, which could result in the highest identification accuracy through multiple experiments. Based on a data set consisting of 56 adult participants, the identification accuracy of 90.36% is achieved for training data with a window size of approximately 4.62 s; with the increase in training data window size, the identification accuracy can reach (97.65 ± 2.35)%. Our results suggest that deep learning is valuable for fNIRS-based personal identification, with potential applications in security, biometrics, and healthcare.
Collapse
Affiliation(s)
- Yichen Zhang
- South China Academy of Advanced Optoelectronics, South China Normal University, Guangzhou, China
| | - Jun Li
- South China Academy of Advanced Optoelectronics, South China Normal University, Guangzhou, China
| |
Collapse
|
3
|
Jiang X, Fan J, Zhu Z, Wang Z, Guo Y, Liu X, Jia F, Dai C. Cybersecurity in neural interfaces: Survey and future trends. Comput Biol Med 2023; 167:107604. [PMID: 37883851 DOI: 10.1016/j.compbiomed.2023.107604] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2023] [Revised: 09/23/2023] [Accepted: 10/17/2023] [Indexed: 10/28/2023]
Abstract
With the joint advancement in areas such as pervasive neural data sensing, neural computing, neuromodulation and artificial intelligence, neural interface has become a promising technology facilitating both the closed-loop neurorehabilitation for neurologically impaired patients and the intelligent man-machine interactions for general application purposes. However, although neural interface has been widely studied, few previous studies focused on the cybersecurity issues in related applications. In this survey, we systematically investigated possible cybersecurity risks in neural interfaces, together with potential solutions to these problems. Importantly, our survey considers interfacing techniques on both central nervous systems (i.e., brain-computer interfaces) and peripheral nervous systems (i.e., general neural interfaces), covering diverse neural modalities such as electroencephalography, electromyography and more. Moreover, our survey is organized on three different levels: (1) the data level, which mainly focuses on the privacy leakage issue via attacking and analyzing neural database of users; (2) the permission level, which mainly focuses on the prospects and risks to directly use real time neural signals as biometrics for continuous and unobtrusive user identity verification; and (3) the model level, which mainly focuses on adversarial attacks and defenses on both the forward neural decoding models (e.g. via machine learning) and the backward feedback implementation models (e.g. via neuromodulation and stimulation). This is the first study to systematically investigate cybersecurity risks and possible solutions in neural interfaces which covers both central and peripheral nervous systems, and considers multiple different levels to provide a complete picture of this issue.
Collapse
Affiliation(s)
- Xinyu Jiang
- School of Information Science and Technology, Fudan University, Shanghai, China
| | - Jiahao Fan
- The Department of Mechanical Engineering, The Pennsylvania State University, University Park, PA 16802, USA
| | - Ziyue Zhu
- The Department of Bioengineering, Imperial College London, SW7 2AZ London, UK
| | - Zihao Wang
- School of Information Science and Technology, Fudan University, Shanghai, China
| | - Yao Guo
- School of Information Science and Technology, Fudan University, Shanghai, China
| | - Xiangyu Liu
- The College of Communication and Art Design, University of Shanghai for Science and Technology, Shanghai, 200093, China
| | - Fumin Jia
- Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, China.
| | - Chenyun Dai
- School of Information Science and Technology, Fudan University, Shanghai, China.
| |
Collapse
|
4
|
Novi SL, Carvalho AC, Forti RM, Cendes F, Yasuda CL, Mesquita RC. Revealing the spatiotemporal requirements for accurate subject identification with resting-state functional connectivity: a simultaneous fNIRS-fMRI study. NEUROPHOTONICS 2023; 10:013510. [PMID: 36756003 PMCID: PMC9896013 DOI: 10.1117/1.nph.10.1.013510] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/27/2022] [Accepted: 01/10/2023] [Indexed: 06/18/2023]
Abstract
SIGNIFICANCE Brain fingerprinting refers to identifying participants based on their functional patterns. Despite its success with functional magnetic resonance imaging (fMRI), brain fingerprinting with functional near-infrared spectroscopy (fNIRS) still lacks adequate validation. AIM We investigated how fNIRS-specific acquisition features (limited spatial information and nonneural contributions) influence resting-state functional connectivity (rsFC) patterns at the intra-subject level and, therefore, brain fingerprinting. APPROACH We performed multiple simultaneous fNIRS and fMRI measurements in 29 healthy participants at rest. Data were preprocessed following the best practices, including the removal of motion artifacts and global physiology. The rsFC maps were extracted with the Pearson correlation coefficient. Brain fingerprinting was tested with pairwise metrics and a simple linear classifier. RESULTS Our results show that average classification accuracy with fNIRS ranges from 75% to 98%, depending on the number of runs and brain regions used for classification. Under the right conditions, brain fingerprinting with fNIRS is close to the 99.9% accuracy found with fMRI. Overall, the classification accuracy is more impacted by the number of runs and the spatial coverage than the choice of the classification algorithm. CONCLUSIONS This work provides evidence that brain fingerprinting with fNIRS is robust and reliable for extracting unique individual features at the intra-subject level once relevant spatiotemporal constraints are correctly employed.
Collapse
Affiliation(s)
- Sergio L. Novi
- University of Campinas, “Gleb Wataghin” Institute of Physics, Campinas, Brazil
- Western University, Department of Physiology and Pharmacology, London, Ontario, Canada
| | - Alex C. Carvalho
- University of Campinas, “Gleb Wataghin” Institute of Physics, Campinas, Brazil
- University of Campinas, Laboratory of Neuroimaging, Campinas, Brazil
| | - R. M. Forti
- University of Campinas, “Gleb Wataghin” Institute of Physics, Campinas, Brazil
- The Children’s Hospital of Philadelphia, Division of Neurology, Philadelphia, Pennsylvania, United States
| | - Fernado Cendes
- Brazilian Institute of Neuroscience and Neurotechnology, Campinas, Brazil
- University of Campinas, School of Medical Sciences, Department of Neurology, Campinas, Brazil
| | - Clarissa L. Yasuda
- University of Campinas, Laboratory of Neuroimaging, Campinas, Brazil
- Brazilian Institute of Neuroscience and Neurotechnology, Campinas, Brazil
- University of Campinas, School of Medical Sciences, Department of Neurology, Campinas, Brazil
| | - Rickson C. Mesquita
- University of Campinas, “Gleb Wataghin” Institute of Physics, Campinas, Brazil
- Brazilian Institute of Neuroscience and Neurotechnology, Campinas, Brazil
| |
Collapse
|
5
|
Adamovich T, Zakharov I, Tabueva A, Malykh S. The thresholding problem and variability in the EEG graph network parameters. Sci Rep 2022; 12:18659. [PMID: 36333413 PMCID: PMC9636266 DOI: 10.1038/s41598-022-22079-2] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2022] [Accepted: 10/10/2022] [Indexed: 11/06/2022] Open
Abstract
Graph thresholding is a frequently used practice of eliminating the weak connections in brain functional connectivity graphs. The main aim of the procedure is to delete the spurious connections in the data. However, the choice of the threshold is arbitrary, and the effect of the threshold choice is not fully understood. Here we present the description of the changes in the global measures of a functional connectivity graph depending on the different proportional thresholds based on the 146 resting-state EEG recordings. The dynamics is presented in five different synchronization measures (wPLI, ImCoh, Coherence, ciPLV, PPC) in sensors and source spaces. The analysis shows significant changes in the graph's global connectivity measures as a function of the chosen threshold which may influence the outcome of the study. The choice of the threshold could lead to different study conclusions; thus it is necessary to improve the reasoning behind the choice of the different analytic options and consider the adoption of different analytic approaches. We also proposed some ways of improving the procedure of thresholding in functional connectivity research.
Collapse
Affiliation(s)
- Timofey Adamovich
- grid.466465.3Psychological Institute of Russian Academy of Education, Moscow, Russia ,grid.412761.70000 0004 0645 736XUral Federal University Named After the First President of Russia B. N. Yeltsin, Yekaterinburg, Russia
| | - Ilya Zakharov
- grid.466465.3Psychological Institute of Russian Academy of Education, Moscow, Russia ,grid.412761.70000 0004 0645 736XUral Federal University Named After the First President of Russia B. N. Yeltsin, Yekaterinburg, Russia
| | - Anna Tabueva
- grid.466465.3Psychological Institute of Russian Academy of Education, Moscow, Russia ,grid.412761.70000 0004 0645 736XUral Federal University Named After the First President of Russia B. N. Yeltsin, Yekaterinburg, Russia
| | - Sergey Malykh
- grid.466465.3Psychological Institute of Russian Academy of Education, Moscow, Russia ,grid.412761.70000 0004 0645 736XUral Federal University Named After the First President of Russia B. N. Yeltsin, Yekaterinburg, Russia
| |
Collapse
|