1
|
孙 静, 孟 佳, 尤 佳, 杨 明, 江 京, 许 敏, 明 东. [Research progress of brain-computer interface application paradigms based on rapid serial visual presentation]. SHENG WU YI XUE GONG CHENG XUE ZA ZHI = JOURNAL OF BIOMEDICAL ENGINEERING = SHENGWU YIXUE GONGCHENGXUE ZAZHI 2023; 40:1235-1241. [PMID: 38151948 PMCID: PMC10753308 DOI: 10.7507/1001-5515.202305061] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Subscribe] [Scholar Register] [Received: 05/30/2023] [Revised: 11/08/2023] [Indexed: 12/29/2023]
Abstract
Rapid serial visual presentation (RSVP) is a type of psychological visual stimulation experimental paradigm that requires participants to identify target stimuli presented continuously in a stream of stimuli composed of numbers, letters, words, images, and so on at the same spatial location, allowing them to discern a large amount of information in a short period of time. The RSVP-based brain-computer interface (BCI) can not only be widely used in scenarios such as assistive interaction and information reading, but also has the advantages of stability and high efficiency, which has become one of the common techniques for human-machine intelligence fusion. In recent years, brain-controlled spellers, image recognition and mind games are the most popular fields of RSVP-BCI research. Therefore, aiming to provide reference and new ideas for RSVP-BCI related research, this paper reviewed the paradigm design and system performance optimization of RSVP-BCI in these three fields. It also looks ahead to its potential applications in cutting-edge fields such as entertainment, clinical medicine, and special military operations.
Collapse
Affiliation(s)
- 静敏 孙
- 天津大学 精密仪器与光电子工程学院(天津 300072)School of Precision Instruments and Opto-Electronic Engineering, Tianjin University, Tianjin 300072, P. R. China
| | - 佳圆 孟
- 天津大学 精密仪器与光电子工程学院(天津 300072)School of Precision Instruments and Opto-Electronic Engineering, Tianjin University, Tianjin 300072, P. R. China
- 天津大学 医学工程与转化医学研究院(天津 300072)Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, P. R. China
| | - 佳 尤
- 天津大学 精密仪器与光电子工程学院(天津 300072)School of Precision Instruments and Opto-Electronic Engineering, Tianjin University, Tianjin 300072, P. R. China
| | - 明明 杨
- 天津大学 精密仪器与光电子工程学院(天津 300072)School of Precision Instruments and Opto-Electronic Engineering, Tianjin University, Tianjin 300072, P. R. China
| | - 京 江
- 天津大学 精密仪器与光电子工程学院(天津 300072)School of Precision Instruments and Opto-Electronic Engineering, Tianjin University, Tianjin 300072, P. R. China
| | - 敏鹏 许
- 天津大学 精密仪器与光电子工程学院(天津 300072)School of Precision Instruments and Opto-Electronic Engineering, Tianjin University, Tianjin 300072, P. R. China
- 天津大学 医学工程与转化医学研究院(天津 300072)Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, P. R. China
| | - 东 明
- 天津大学 精密仪器与光电子工程学院(天津 300072)School of Precision Instruments and Opto-Electronic Engineering, Tianjin University, Tianjin 300072, P. R. China
- 天津大学 医学工程与转化医学研究院(天津 300072)Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, P. R. China
| |
Collapse
|
2
|
Nobre AC, van Ede F. Attention in flux. Neuron 2023; 111:971-986. [PMID: 37023719 DOI: 10.1016/j.neuron.2023.02.032] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Revised: 02/20/2023] [Accepted: 02/22/2023] [Indexed: 04/08/2023]
Abstract
Selective attention comprises essential infrastructural functions supporting cognition-anticipating, prioritizing, selecting, routing, integrating, and preparing signals to guide adaptive behavior. Most studies have examined its consequences, systems, and mechanisms in a static way, but attention is at the confluence of multiple sources of flux. The world advances, we operate within it, our minds change, and all resulting signals progress through multiple pathways within the dynamic networks of our brains. Our aim in this review is to raise awareness of and interest in three important facets of how timing impacts our understanding of attention. These include the challenges posed to attention by the timing of neural processing and psychological functions, the opportunities conferred to attention by various temporal structures in the environment, and how tracking the time courses of neural and behavioral modulations with continuous measures yields surprising insights into the workings and principles of attention.
Collapse
Affiliation(s)
- Anna C Nobre
- Department of Experimental Psychology, University of Oxford, Oxford OX2 6GG, UK; Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford OX3 7JX, UK.
| | - Freek van Ede
- Institute for Brain and Behavior Amsterdam, Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Amsterdam 1081BT, the Netherlands.
| |
Collapse
|
3
|
Consequences of predictable temporal structure in multi-task situations. Cognition 2022; 225:105156. [DOI: 10.1016/j.cognition.2022.105156] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2021] [Revised: 04/26/2022] [Accepted: 04/28/2022] [Indexed: 11/21/2022]
|
4
|
Miyawaki EK. Review: Subjective Time Perception, Dopamine Signaling, and Parkinsonian Slowness. Front Neurol 2022; 13:927160. [PMID: 35899266 PMCID: PMC9311331 DOI: 10.3389/fneur.2022.927160] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2022] [Accepted: 06/16/2022] [Indexed: 11/25/2022] Open
Abstract
The association between idiopathic Parkinson's disease, a paradigmatic dopamine-deficiency syndrome, and problems in the estimation of time has been studied experimentally for decades. I review that literature, which raises a question about whether and if dopamine deficiency relates not only to the motor slowness that is an objective and cardinal parkinsonian sign, but also to a compromised neural substrate for time perception. Why does a clinically (motorically) significant deficiency in dopamine play a role in the subjective perception of time's passage? After a discussion of a classical conception of basal ganglionic control of movement under the influence of dopamine, I describe recent work in healthy mice using optogenetics; the methodology visualizes dopaminergic neuronal firing in very short time intervals, then allows for correlation with motor behaviors in trained tasks. Moment-to-moment neuronal activity is both highly dynamic and variable, as assessed by photometry of genetically defined dopaminergic neurons. I use those animal data as context to review a large experimental experience in humans, spanning decades, that has examined subjective time perception mainly in Parkinson's disease, but also in other movement disorders. Although the human data are mixed in their findings, I argue that loss of dynamic variability in dopaminergic neuronal activity over very short intervals may be a fundamental sensory aspect in the pathophysiology of parkinsonism. An important implication is that therapeutic response in Parkinson's disease needs to be understood in terms of short-term alterations in dynamic neuronal firing, as has already been examined in novel ways—for example, in the study of real-time changes in neuronal network oscillations across very short time intervals. A finer analysis of a treatment's network effects might aid in any effort to augment clinical response to either medications or functional neurosurgical interventions in Parkinson's disease.
Collapse
Affiliation(s)
- Edison K. Miyawaki
- Department of Neurology, Mass General Brigham, Boston, MA, United States
- Harvard Medical School, Boston, MA, United States
- *Correspondence: Edison K. Miyawaki
| |
Collapse
|
5
|
Zokaei N, Gillebert CR, Chauvin JJ, Gresch D, Board AG, Rolinski M, Hu MT, Nobre AC. Temporal orienting in Parkinson's disease. Eur J Neurosci 2021; 53:2713-2725. [PMID: 33450082 PMCID: PMC8290223 DOI: 10.1111/ejn.15114] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2020] [Revised: 12/29/2020] [Accepted: 12/30/2020] [Indexed: 12/18/2022]
Abstract
Temporal orienting of attention can affect multiple stages of processing to guide adaptive behaviour. We tested whether temporal expectation in different task contexts is compromised in individuals with Parkinson's disease (PD). In Experiment 1 two temporal-orienting tasks were used: a speeded task emphasizing motor preparation and a non-speeded task emphasizing perceptual discrimination using rapid serial visual presentation. In both tasks, auditory cues indicated the likelihood of a target appearing after a short or long interval. In the speeded-response task, participants used the cues to anticipate an easily detectable target stimulus. In the non-speeded perceptual-discrimination task, participants used the cues to help discriminate a target letter embedded in a stream of letters. Relative to healthy participants, participants with PD did not show altered temporal orienting effects in the speeded-response task. However, they were impaired in using temporal cues to improve perceptual discrimination. In Experiment 2, we tested whether the temporal-orienting deficits in the perceptual-discrimination task depended on the requirement to ignore temporally distracting stimuli. We replicated the impaired temporal orienting for perceptual discrimination in an independent group of individuals with PD, and showed the impairment was abolished when individuals were on their dopaminergic medication. In a task without any distracting letters, however, patients off or on medication benefited normally from temporal orienting cues. Our findings suggest that deficits in temporal orienting in individuals with PD interact with specific task demands, such as the requirement to select target from temporally competing distractors.
Collapse
Affiliation(s)
- Nahid Zokaei
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford, UK.,Department of Experimental Psychology, University of Oxford, Oxford, UK
| | - Celine R Gillebert
- Department of Experimental Psychology, University of Oxford, Oxford, UK.,Department of Brain and Cognition, KU Leuven, Leuven, Belgium
| | - Joshua J Chauvin
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford, UK.,Department of Experimental Psychology, University of Oxford, Oxford, UK
| | - Daniela Gresch
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford, UK.,Department of Experimental Psychology, University of Oxford, Oxford, UK
| | - Alexander G Board
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford, UK.,Department of Experimental Psychology, University of Oxford, Oxford, UK
| | - Michal Rolinski
- Translational Health Sciences, University of Bristol, Bristol, UK
| | - Michele T Hu
- Department of Neurology, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, UK
| | - Anna Christina Nobre
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford, UK.,Department of Experimental Psychology, University of Oxford, Oxford, UK
| |
Collapse
|