3
|
Souza RHCE, Naves ELM. Attention Detection in Virtual Environments Using EEG Signals: A Scoping Review. Front Physiol 2021; 12:727840. [PMID: 34887770 PMCID: PMC8650681 DOI: 10.3389/fphys.2021.727840] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2021] [Accepted: 10/25/2021] [Indexed: 11/25/2022] Open
Abstract
The competitive demand for attention is present in our daily lives, and the identification of neural processes in the EEG signals associated with the demand for specific attention can be useful to the individual’s interactions in virtual environments. Since EEG-based devices can be portable, non-invasive, and present high temporal resolution technology for recording neural signal, the interpretations of virtual systems user’s attention, fatigue and cognitive load based on parameters extracted from the EEG signal are relevant for several purposes, such as games, rehabilitation, and therapies. However, despite the large amount of studies on this subject, different methodological forms are highlighted and suggested in this work, relating virtual environments, demand of attention, workload and fatigue applications. In our summarization, we discuss controversies, current research gaps and future directions together with the background and final sections.
Collapse
Affiliation(s)
- Rhaíra Helena Caetano E Souza
- Assistive Technology Laboratory, Electrical Engineering Faculty, Federal University of Uberlândia, Uberlândia, Brazil.,Federal Institute of Education, Science and Technology of Brasília, Brasília, Brazil
| | - Eduardo Lázaro Martins Naves
- Assistive Technology Laboratory, Electrical Engineering Faculty, Federal University of Uberlândia, Uberlândia, Brazil
| |
Collapse
|
4
|
LEDPatNet19: Automated Emotion Recognition Model based on Nonlinear LED Pattern Feature Extraction Function using EEG Signals. Cogn Neurodyn 2021; 16:779-790. [PMID: 35847545 PMCID: PMC9279545 DOI: 10.1007/s11571-021-09748-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2020] [Revised: 10/23/2021] [Accepted: 11/03/2021] [Indexed: 11/20/2022] Open
Abstract
Electroencephalography (EEG) signals collected from human brains have generally been used to diagnose diseases. Moreover, EEG signals can be used in several areas such as emotion recognition, driving fatigue detection. This work presents a new emotion recognition model by using EEG signals. The primary aim of this model is to present a highly accurate emotion recognition framework by using both a hand-crafted feature generation and a deep classifier. The presented framework uses a multilevel fused feature generation network. This network has three primary phases, which are tunable Q-factor wavelet transform (TQWT), statistical feature generation, and nonlinear textural feature generation phases. TQWT is applied to the EEG data for decomposing signals into different sub-bands and create a multilevel feature generation network. In the nonlinear feature generation, an S-box of the LED block cipher is utilized to create a pattern, which is named as Led-Pattern. Moreover, statistical feature extraction is processed using the widely used statistical moments. The proposed LED pattern and statistical feature extraction functions are applied to 18 TQWT sub-bands and an original EEG signal. Therefore, the proposed hand-crafted learning model is named LEDPatNet19. To select the most informative features, ReliefF and iterative Chi2 (RFIChi2) feature selector is deployed. The proposed model has been developed on the two EEG emotion datasets, which are GAMEEMO and DREAMER datasets. Our proposed hand-crafted learning network achieved 94.58%, 92.86%, and 94.44% classification accuracies for arousal, dominance, and valance cases of the DREAMER dataset. Furthermore, the best classification accuracy of the proposed model for the GAMEEMO dataset is equal to 99.29%. These results clearly illustrate the success of the proposed LEDPatNet19.
Collapse
|
5
|
Neri F, Smeralda CL, Momi D, Sprugnoli G, Menardi A, Ferrone S, Rossi S, Rossi A, Di Lorenzo G, Santarnecchi E. Personalized Adaptive Training Improves Performance at a Professional First-Person Shooter Action Videogame. Front Psychol 2021; 12:598410. [PMID: 34177682 PMCID: PMC8224404 DOI: 10.3389/fpsyg.2021.598410] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2020] [Accepted: 04/07/2021] [Indexed: 11/13/2022] Open
Abstract
First-Person Shooter (FPS) game experience can be transferred to untrained cognitive functions such as attention, visual short-term memory, spatial cognition, and decision-making. However, previous studies have been using off-the-shelf FPS games based on predefined gaming settings, therefore it is not known whether such improvement of in game performance and transfer of abilities can be further improved by creating a in-game, adaptive in-game training protocol. To address this question, we compared the impact of a popular FPS-game (Counter-Strike:Global-Offensive–CS:GO) with an ad hoc version of the game based on a personalized, adaptive algorithm modifying the artificial intelligence of opponents as well as the overall game difficulty on the basis of individual gaming performance. Two groups of FPS-naïve healthy young participants were randomly assigned to playing one of the two game versions (11 and 10 participants, respectively) 2 h/day for 3 weeks in a controlled laboratory setting, including daily in-game performance monitoring and extensive cognitive evaluations administered before, immediately after, and 3 months after training. Participants exposed to the adaptive version of the game were found to progress significantly faster in terms of in-game performance, reaching gaming scenarios up to 2.5 times more difficult than the group exposed to standard CS:GO (p < 0.05). A significant increase in cognitive performance was also observed. Personalized FPS gaming can significantly speed-up the learning curve of action videogame-players, with possible future applications for expert-video-gamers and potential relevance for clinical-rehabilitative applications.
Collapse
Affiliation(s)
- Francesco Neri
- Siena Brain Investigation & Neuromodulation Lab, Department of Medicine, Surgery and Neuroscience, Neurology and Clinical Neurophysiology Section, University of Siena, Siena, Italy
| | - Carmelo Luca Smeralda
- Siena Brain Investigation & Neuromodulation Lab, Department of Medicine, Surgery and Neuroscience, Neurology and Clinical Neurophysiology Section, University of Siena, Siena, Italy
| | - Davide Momi
- Siena Brain Investigation & Neuromodulation Lab, Department of Medicine, Surgery and Neuroscience, Neurology and Clinical Neurophysiology Section, University of Siena, Siena, Italy
| | - Giulia Sprugnoli
- Siena Brain Investigation & Neuromodulation Lab, Department of Medicine, Surgery and Neuroscience, Neurology and Clinical Neurophysiology Section, University of Siena, Siena, Italy
| | - Arianna Menardi
- Siena Brain Investigation & Neuromodulation Lab, Department of Medicine, Surgery and Neuroscience, Neurology and Clinical Neurophysiology Section, University of Siena, Siena, Italy
| | - Salvatore Ferrone
- Siena Brain Investigation & Neuromodulation Lab, Department of Medicine, Surgery and Neuroscience, Neurology and Clinical Neurophysiology Section, University of Siena, Siena, Italy
| | - Simone Rossi
- Siena Brain Investigation & Neuromodulation Lab, Department of Medicine, Surgery and Neuroscience, Neurology and Clinical Neurophysiology Section, University of Siena, Siena, Italy.,Human Physiology Section, Department of Medicine, Surgery and Neuroscience, University of Siena, Siena, Italy
| | - Alessandro Rossi
- Siena Brain Investigation & Neuromodulation Lab, Department of Medicine, Surgery and Neuroscience, Neurology and Clinical Neurophysiology Section, University of Siena, Siena, Italy.,Department of Medicine, Surgery and Neuroscience, University of Siena, Siena, Italy
| | - Giorgio Di Lorenzo
- Laboratory of Psychophysiology and Cognitive Neuroscience, Chair of Psychiatry, Department of Systems Medicine, University of Rome Tor Vergata, Rome, Italy.,Psychiatry and Clinical Psychology Unit, Fondazione Policlinico Tor Vergata, Rome, Italy.,IRCCS Fondazione Santa Lucia, Rome, Italy
| | - Emiliano Santarnecchi
- Berenson-Allen Center for Non-Invasive Brain Stimulation, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, United States
| |
Collapse
|
8
|
Hilla Y, von Mankowski J, Föcker J, Sauseng P. Faster Visual Information Processing in Video Gamers Is Associated With EEG Alpha Amplitude Modulation. Front Psychol 2020; 11:599788. [PMID: 33363498 PMCID: PMC7753097 DOI: 10.3389/fpsyg.2020.599788] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2020] [Accepted: 11/04/2020] [Indexed: 12/03/2022] Open
Abstract
Video gaming, specifically action video gaming, seems to improve a range of cognitive functions. The basis for these improvements may be attentional control in conjunction with reward-related learning to amplify the execution of goal-relevant actions while suppressing goal-irrelevant actions. Given that EEG alpha power reflects inhibitory processing, a core component of attentional control, it might represent the electrophysiological substrate of cognitive improvement in video gaming. The aim of this study was to test whether non-video gamers (NVGs), non-action video gamers (NAVGs) and action video gamers (AVGs) exhibit differences in EEG alpha power, and whether this might account for differences in visual information processing as operationalized by the theory of visual attention (TVA). Forty male volunteers performed a visual short-term memory paradigm where they memorized shape stimuli depicted on circular stimulus displays at six different exposure durations while their EEGs were recorded. Accuracy data was analyzed using TVA-algorithms. There was a positive correlation between the extent of post-stimulus EEG alpha power attenuation (10–12 Hz) and speed of information processing across all participants. Moreover, both EEG alpha power attenuation and speed of information processing were modulated by an interaction between group affiliation and time on task, indicating that video gamers showed larger EEG alpha power attenuations and faster information processing over time than NVGs – with AVGs displaying the largest increase. An additional regression analysis affirmed this observation. From this we concluded that EEG alpha power might be a promising neural substrate for explaining cognitive improvement in video gaming.
Collapse
Affiliation(s)
- Yannik Hilla
- Research Unit of Biological Psychology, Department of Psychology, Ludwig-Maximilians-Universität München, Munich, Germany
| | - Jörg von Mankowski
- Chair of Communication Networks, Technische Universität München, Munich, Germany
| | - Julia Föcker
- School of Psychology, College of Social Sciences, University of Lincoln, Lincoln, United Kingdom
| | - Paul Sauseng
- Research Unit of Biological Psychology, Department of Psychology, Ludwig-Maximilians-Universität München, Munich, Germany
| |
Collapse
|
9
|
Exposure to first-person shooter videogames is associated with multisensory temporal precision and migraine incidence. Cortex 2020; 134:223-238. [PMID: 33291047 DOI: 10.1016/j.cortex.2020.10.009] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2020] [Revised: 10/03/2020] [Accepted: 10/19/2020] [Indexed: 02/06/2023]
Abstract
Adaptive interactions with the environment require optimal integration and segregation of sensory information. Yet, temporal misalignments in the presentation of visual and auditory stimuli may generate illusory phenomena such as the sound-induced flash illusion, in which a single flash paired with multiple auditory stimuli induces the perception of multiple illusory flashes. This phenomenon has been shown to be robust and resistant to feedback training. According to a Bayesian account, this is due to a statistically optimal combination of the signals operated by the nervous system. From this perspective, individual susceptibility to the illusion might be moulded through prolonged experience. For example, repeated exposure to the illusion and prolonged training sessions partially impact on the reported illusion. Therefore, extensive and immersive audio-visual experience, such as first-person shooter videogames, should sharpen individual capacity to correctly integrate multisensory information over time, leading to more veridical perception. We tested this hypothesis by comparing the temporal profile of the sound-induced illusion in a group of expert first-person shooter gamers and a non-players group. In line with the hypotheses, gamers experience significantly narrower windows of illusion (~87 ms) relative to non-players (~105 ms), leading to higher veridical reports in gamers (~68%) relative to non-players (~59%). Moreover, according to recent literature, we tested whether audio-visual intensive training in gamers could be related to the incidence of migraine, and found that its severity may be directly proportioned to the time spent on videogames. Overall, these results suggest that continued training within audio-visual environments such as first-person shooter videogames improves temporal discrimination and sensory integration. This finding may pave the way for future therapeutic strategies based on self-administered multisensory training. On the other hand, the impact of intensive training on visual-related stress disorders, such as migraine incidence, should be taken into account as a risk factor during therapeutic planning.
Collapse
|