1
|
Niu L, Bin J, Wang JKS, Zhan G, Jia J, Zhang L, Gan Z, Kang X. Effect of 3D paradigm synchronous motion for SSVEP-based hybrid BCI-VR system. Med Biol Eng Comput 2023; 61:2481-2495. [PMID: 37191865 DOI: 10.1007/s11517-023-02845-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2022] [Accepted: 05/05/2023] [Indexed: 05/17/2023]
Abstract
A brain-computer interface (BCI) system and virtual reality (VR) are integrated as a more interactive hybrid system (BCI-VR) that allows the user to manipulate the car. A virtual scene in the VR system that is the same as the physical environment is built, and the object's movement can be observed in the VR scene. The four-class three-dimensional (3D) paradigm is designed and moves synchronously in virtual reality. The dynamic paradigm may affect their attention according to the experimenters' feedback. Fifteen subjects in our experiment steered the car according to a specified motion trajectory. According to our online experimental result, different motion trajectories of the paradigm have various effects on the system's performance, and training can mitigate this adverse effect. Moreover, the hybrid system using frequencies between 5 and 10 Hz indicates better performance than those using lower or higher stimulation frequencies. The experiment results show a maximum average accuracy of 0.956 and a maximum information transfer rate (ITR) of 41.033 bits/min. It suggests that a hybrid system provides a high-performance way of brain-computer interaction. This research could encourage more interesting applications involving BCI and VR technologies.
Collapse
Affiliation(s)
- Lan Niu
- Laboratory for Neural Interface and Brain Computer Interface, Engineering Research Center of AI & Robotics, Shanghai Engineering Research Center of AI & Robotics, MOE Frontiers Center for Brain Science, State Key Laboratory of Medical Neurobiology, Institute of AI & Robotics, Institute of Meta-Medical, Academy for Engineering & Technology, Ministry of Education, FudanUniversity, Shanghai, China
- Ji Hua Laboratory, Foshan, 528000, Guangdong Province, China
| | - Jianxiong Bin
- Laboratory for Neural Interface and Brain Computer Interface, Engineering Research Center of AI & Robotics, Shanghai Engineering Research Center of AI & Robotics, MOE Frontiers Center for Brain Science, State Key Laboratory of Medical Neurobiology, Institute of AI & Robotics, Institute of Meta-Medical, Academy for Engineering & Technology, Ministry of Education, FudanUniversity, Shanghai, China
- Ji Hua Laboratory, Foshan, 528000, Guangdong Province, China
| | | | - Gege Zhan
- Ji Hua Laboratory, Foshan, 528000, Guangdong Province, China
| | - Jie Jia
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, Shanghai, 200040, China
| | - Lihua Zhang
- Laboratory for Neural Interface and Brain Computer Interface, Engineering Research Center of AI & Robotics, Shanghai Engineering Research Center of AI & Robotics, MOE Frontiers Center for Brain Science, State Key Laboratory of Medical Neurobiology, Institute of AI & Robotics, Institute of Meta-Medical, Academy for Engineering & Technology, Ministry of Education, FudanUniversity, Shanghai, China
- Ji Hua Laboratory, Foshan, 528000, Guangdong Province, China
| | - Zhongxue Gan
- Laboratory for Neural Interface and Brain Computer Interface, Engineering Research Center of AI & Robotics, Shanghai Engineering Research Center of AI & Robotics, MOE Frontiers Center for Brain Science, State Key Laboratory of Medical Neurobiology, Institute of AI & Robotics, Institute of Meta-Medical, Academy for Engineering & Technology, Ministry of Education, FudanUniversity, Shanghai, China
- Ji Hua Laboratory, Foshan, 528000, Guangdong Province, China
| | - Xiaoyang Kang
- Laboratory for Neural Interface and Brain Computer Interface, Engineering Research Center of AI & Robotics, Shanghai Engineering Research Center of AI & Robotics, MOE Frontiers Center for Brain Science, State Key Laboratory of Medical Neurobiology, Institute of AI & Robotics, Institute of Meta-Medical, Academy for Engineering & Technology, Ministry of Education, FudanUniversity, Shanghai, China.
- Ji Hua Laboratory, Foshan, 528000, Guangdong Province, China.
- Yiwu Research Institute of Fudan University, Chengbei Road, Yiwu City, 322000, Zhejiang, China.
- Research Center for Intelligent Sensing, Zhejiang Lab, Hangzhou, 311100, China.
| |
Collapse
|
2
|
Niu L, Bin J, kong shuai Wang J, Zhan G, Zhang L, Gan Z, Kang X. A dynamically optimized time-window length for SSVEP based hybrid BCI-VR system. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2023.104826] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/14/2023]
|
3
|
Liu C, Wang S, Yuan H, Dang Y, Liu X. Detecting Trivariate Associations in High-Dimensional Datasets. SENSORS (BASEL, SWITZERLAND) 2022; 22:2806. [PMID: 35408419 PMCID: PMC9003031 DOI: 10.3390/s22072806] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/01/2022] [Revised: 03/29/2022] [Accepted: 04/04/2022] [Indexed: 01/27/2023]
Abstract
Detecting correlations in high-dimensional datasets plays an important role in data mining and knowledge discovery. While recent works achieve promising results, detecting multivariable correlations especially trivariate associations still remains a challenge. For example, maximal information coefficient (MIC) introduces generality and equitability to detect bivariate correlations but fails to detect multivariable correlation. To solve the problem mentioned above, we proposed quadratic optimized trivariate information coefficient (QOTIC). Specifically, QOTIC equitably measures dependence among three variables. Our contributions are three-fold: (1) we present a novel quadratic optimization procedure to approach the correlation with high accuracy; (2) QOTIC exceeds existing methods in generality and equitability as QOTIC has general test functions and is applicable in detecting multivariable correlation in datasets of various sample sizes and noise levels; (3) QOTIC achieved both higher accuracy and higher time-efficiency than previous methods. Extensive experiments demonstrate the excellent performance of QOTIC.
Collapse
Affiliation(s)
- Chuanlu Liu
- School of Computer Science and Technology, Beijing Institute of Technology, Beijing 100081, China; (C.L.); (H.Y.); (Y.D.); (X.L.)
| | - Shuliang Wang
- School of Computer Science and Technology, Beijing Institute of Technology, Beijing 100081, China; (C.L.); (H.Y.); (Y.D.); (X.L.)
- Institute of E-Government, Beijing Institute of Technology, Beijing 100081, China
| | - Hanning Yuan
- School of Computer Science and Technology, Beijing Institute of Technology, Beijing 100081, China; (C.L.); (H.Y.); (Y.D.); (X.L.)
| | - Yingxu Dang
- School of Computer Science and Technology, Beijing Institute of Technology, Beijing 100081, China; (C.L.); (H.Y.); (Y.D.); (X.L.)
| | - Xiaojia Liu
- School of Computer Science and Technology, Beijing Institute of Technology, Beijing 100081, China; (C.L.); (H.Y.); (Y.D.); (X.L.)
| |
Collapse
|