1
|
Barnes L, Davidson MJ, Alais D. The speed and phase of locomotion dictate saccade probability and simultaneous low-frequency power spectra. Atten Percept Psychophys 2024:10.3758/s13414-024-02932-4. [PMID: 39048846 DOI: 10.3758/s13414-024-02932-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/14/2024] [Indexed: 07/27/2024]
Abstract
Every day we make thousands of saccades and take thousands of steps as we explore our environment. Despite their common co-occurrence in a typical active state, we know little about the coordination between eye movements, walking behaviour and related changes in cortical activity. Technical limitations have been a major impediment, which we overcome here by leveraging the advantages of an immersive wireless virtual reality (VR) environment with three-dimensional (3D) position tracking, together with simultaneous recording of eye movements and mobile electroencephalography (EEG). Using this approach with participants engaged in unencumbered walking along a clear, level path, we find that the likelihood of eye movements at both slow and natural walking speeds entrains to the rhythm of footfall, peaking after the heel-strike of each step. Compared to previous research, this entrainment was captured in a task that did not require visually guided stepping - suggesting a persistent interaction between locomotor and visuomotor functions. Simultaneous EEG recordings reveal a concomitant modulation entrained to heel-strike, with increases and decreases in oscillatory power for a broad range of frequencies. The peak of these effects occurred in the theta and alpha range for slow and natural walking speeds, respectively. Together, our data show that the phase of the step-cycle influences other behaviours such as eye movements, and produces related modulations of simultaneous EEG following the same rhythmic pattern. These results reveal gait as an important factor to be considered when interpreting saccadic and time-frequency EEG data in active observers, and demonstrate that saccadic entrainment to gait may persist throughout everyday activities.
Collapse
Affiliation(s)
- Lydia Barnes
- School of Psychology, The University of Sydney, Sydney, NSW, Australia
| | | | - David Alais
- School of Psychology, The University of Sydney, Sydney, NSW, Australia
| |
Collapse
|
2
|
Jeung S, Cockx H, Appelhoff S, Berg T, Gramann K, Grothkopp S, Warmerdam E, Hansen C, Oostenveld R, Welzel J. Motion-BIDS: an extension to the brain imaging data structure to organize motion data for reproducible research. Sci Data 2024; 11:716. [PMID: 38956071 PMCID: PMC11219788 DOI: 10.1038/s41597-024-03559-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2024] [Accepted: 06/20/2024] [Indexed: 07/04/2024] Open
Affiliation(s)
- Sein Jeung
- Technical University of Berlin, Berlin, Germany.
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany.
| | - Helena Cockx
- Radboud University, Nijmegen, the Netherlands
- Donders Institute for Brain, Cognition and Behaviour, Nijmegen, the Netherlands
| | | | | | | | | | | | | | - Robert Oostenveld
- Donders Institute for Brain, Cognition and Behaviour, Nijmegen, the Netherlands
- Karolinska Institutet, Stockholm, Sweden
| | | |
Collapse
|
3
|
Griffiths BJ, Schreiner T, Schaefer JK, Vollmar C, Kaufmann E, Quach S, Remi J, Noachtar S, Staudigl T. Electrophysiological signatures of veridical head direction in humans. Nat Hum Behav 2024; 8:1334-1350. [PMID: 38710766 DOI: 10.1038/s41562-024-01872-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2023] [Accepted: 03/22/2024] [Indexed: 05/08/2024]
Abstract
Information about heading direction is critical for navigation as it provides the means to orient ourselves in space. However, given that veridical head-direction signals require physical rotation of the head and most human neuroimaging experiments depend upon fixing the head in position, little is known about how the human brain is tuned to such heading signals. Here we adress this by asking 52 healthy participants undergoing simultaneous electroencephalography and motion tracking recordings (split into two experiments) and 10 patients undergoing simultaneous intracranial electroencephalography and motion tracking recordings to complete a series of orientation tasks in which they made physical head rotations to target positions. We then used a series of forward encoding models and linear mixed-effects models to isolate electrophysiological activity that was specifically tuned to heading direction. We identified a robust posterior central signature that predicts changes in veridical head orientation after regressing out confounds including sensory input and muscular activity. Both source localization and intracranial analysis implicated the medial temporal lobe as the origin of this effect. Subsequent analyses disentangled head-direction signatures from signals relating to head rotation and those reflecting location-specific effects. Lastly, when directly comparing head direction and eye-gaze-related tuning, we found that the brain maintains both codes while actively navigating, with stronger tuning to head direction in the medial temporal lobe. Together, these results reveal a taxonomy of population-level head-direction signals within the human brain that is reminiscent of those reported in the single units of rodents.
Collapse
Affiliation(s)
- Benjamin J Griffiths
- Department of Psychology, Ludwig-Maximilians-Universität München, Munich, Germany
- Centre for Human Brain Health, University of Birmingham, Birmingham, UK
| | - Thomas Schreiner
- Department of Psychology, Ludwig-Maximilians-Universität München, Munich, Germany
| | - Julia K Schaefer
- Department of Psychology, Ludwig-Maximilians-Universität München, Munich, Germany
| | - Christian Vollmar
- Epilepsy Center, Department of Neurology, Ludwig-Maximilians-Universität University Hospital, Ludwig-Maximilians-Universität München, Munich, Germany
| | - Elisabeth Kaufmann
- Epilepsy Center, Department of Neurology, Ludwig-Maximilians-Universität University Hospital, Ludwig-Maximilians-Universität München, Munich, Germany
| | - Stefanie Quach
- Department of Neurosurgery, University Hospital Munich, Ludwig-Maximilians-Universität München, Munich, Germany
| | - Jan Remi
- Epilepsy Center, Department of Neurology, Ludwig-Maximilians-Universität University Hospital, Ludwig-Maximilians-Universität München, Munich, Germany
| | - Soheyl Noachtar
- Epilepsy Center, Department of Neurology, Ludwig-Maximilians-Universität University Hospital, Ludwig-Maximilians-Universität München, Munich, Germany
| | - Tobias Staudigl
- Department of Psychology, Ludwig-Maximilians-Universität München, Munich, Germany.
| |
Collapse
|
4
|
Klug M, Berg T, Gramann K. Optimizing EEG ICA decomposition with data cleaning in stationary and mobile experiments. Sci Rep 2024; 14:14119. [PMID: 38898069 PMCID: PMC11187149 DOI: 10.1038/s41598-024-64919-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2023] [Accepted: 06/14/2024] [Indexed: 06/21/2024] Open
Abstract
Electroencephalography (EEG) studies increasingly utilize more mobile experimental protocols, leading to more and stronger artifacts in the recorded data. Independent Component Analysis (ICA) is commonly used to remove these artifacts. It is standard practice to remove artifactual samples before ICA to improve the decomposition, for example using automatic tools such as the sample rejection option of the AMICA algorithm. However, the effects of movement intensity and the strength of automatic sample rejection on ICA decomposition have not been systematically evaluated. We conducted AMICA decompositions on eight open-access datasets with varying degrees of motion intensity using varying sample rejection criteria. We evaluated decomposition quality using mutual information of the components, the proportion of brain, muscle, and 'other' components, residual variance, and an exemplary signal-to-noise ratio. Within individual studies, increased movement significantly decreased decomposition quality, though this effect was not found across different studies. Cleaning strength significantly improved the decomposition, but the effect was smaller than expected. Our results suggest that the AMICA algorithm is robust even with limited data cleaning. Moderate cleaning, such as 5 to 10 iterations of the AMICA sample rejection, is likely to improve the decomposition of most datasets, regardless of motion intensity.
Collapse
Affiliation(s)
- M Klug
- Young Investigator Group Intuitive XR, Neuroadaptive Human-Computer Interaction, Institute of Medical Technology, BTU Cottbus-Senftenberg, Cottbus, Germany.
- Biopsychology and Neuroergonomics, Institute of Psychology and Ergonomics, TU Berlin, Berlin, Germany.
| | - T Berg
- Biopsychology and Neuroergonomics, Institute of Psychology and Ergonomics, TU Berlin, Berlin, Germany
| | - K Gramann
- Biopsychology and Neuroergonomics, Institute of Psychology and Ergonomics, TU Berlin, Berlin, Germany
| |
Collapse
|
5
|
Martarelli CS, Chiquet S, Ertl M. Keeping track of reality: embedding visual memory in natural behaviour. Memory 2023; 31:1295-1305. [PMID: 37727126 DOI: 10.1080/09658211.2023.2260148] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2023] [Accepted: 07/21/2023] [Indexed: 09/21/2023]
Abstract
Since immersive virtual reality (IVR) emerged as a research method in the 1980s, the focus has been on the similarities between IVR and actual reality. In this vein, it has been suggested that IVR methodology might fill the gap between laboratory studies and real life. IVR allows for high internal validity (i.e., a high degree of experimental control and experimental replicability), as well as high external validity by letting participants engage with the environment in an almost natural manner. Despite internal validity being crucial to experimental designs, external validity also matters in terms of the generalizability of results. In this paper, we first highlight and summarise the similarities and differences between IVR, desktop situations (both non-immersive VR and computer experiments), and reality. In the second step, we propose that IVR is a promising tool for visual memory research in terms of investigating the representation of visual information embedded in natural behaviour. We encourage researchers to carry out experiments on both two-dimensional computer screens and in immersive virtual environments to investigate visual memory and validate and replicate the findings. IVR is valuable because of its potential to improve theoretical understanding and increase the psychological relevance of the findings.
Collapse
Affiliation(s)
| | - Sandra Chiquet
- Faculty of Psychology, UniDistance Suisse, Brig, Switzerland
| | - Matthias Ertl
- Department of Psychology, University of Bern, Bern, Switzerland
| |
Collapse
|
6
|
Borodaeva Z, Winkler S, Brade J, Klimant P, Jahn G. Spatial updating in virtual reality for reproducing object locations in vista space-Boundaries, landmarks, and idiothetic cues. Front Psychol 2023; 14:1144861. [PMID: 37425154 PMCID: PMC10325663 DOI: 10.3389/fpsyg.2023.1144861] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2023] [Accepted: 05/30/2023] [Indexed: 07/11/2023] Open
Abstract
Keeping track of locations across self-motion is possible by continuously updating spatial representations or by encoding and later instantaneously retrieving spatial representations. In virtual reality (VR), sensory cues to self-motion used in continuous updating are typically reduced. In passive translation compared to real walking in VR, optic flow is available but body-based (idiothetic) cues are missing. With both kinds of translation, boundaries and landmarks as static visual cues can be used for instantaneous updating. In two experiments, we let participants encode two target locations, one of which had to be reproduced by pointing after forward translation in immersive VR (HMD). We increased sensory cues to self-motion in comparison to passive translation either by strengthening optic flow or by real walking. Furthermore, we varied static visual cues in the form of boundaries and landmarks inside boundaries. Increased optic flow and real walking did not reliably increase performance suggesting that optic flow even in a sparse environment was sufficient for continuous updating or that merely instantaneous updating took place. Boundaries and landmarks, however, did support performance as quantified by decreased bias and increased precision, particularly if they were close to or even enclosed target locations. Thus, enriched spatial context is a viable method to support spatial updating in VR and synthetic environments (teleoperation). Spatial context does not only provide a static visual reference in offline updating and continuous allocentric self-location updating but also, according to recent neuroscientific evidence on egocentric bearing cells, contributes to continuous egocentric location updating as well.
Collapse
Affiliation(s)
- Zhanna Borodaeva
- Applied Geropsychology and Cognition, Institute of Psychology, Faculty of Behavioural and Social Sciences, Chemnitz University of Technology, Chemnitz, Germany
| | - Sven Winkler
- Production Systems and Processes, Institute for Machine Tools and Production Processes, Faculty of Mechanical Engineering, Chemnitz University of Technology, Chemnitz, Germany
| | - Jennifer Brade
- Production Systems and Processes, Institute for Machine Tools and Production Processes, Faculty of Mechanical Engineering, Chemnitz University of Technology, Chemnitz, Germany
| | - Philipp Klimant
- Production Systems and Processes, Institute for Machine Tools and Production Processes, Faculty of Mechanical Engineering, Chemnitz University of Technology, Chemnitz, Germany
| | - Georg Jahn
- Applied Geropsychology and Cognition, Institute of Psychology, Faculty of Behavioural and Social Sciences, Chemnitz University of Technology, Chemnitz, Germany
| |
Collapse
|
7
|
Cheng B, Lin E, Wunderlich A, Gramann K, Fabrikant SI. Using spontaneous eye blink-related brain activity to investigate cognitive load during mobile map-assisted navigation. Front Neurosci 2023; 17:1024583. [PMID: 36866330 PMCID: PMC9971562 DOI: 10.3389/fnins.2023.1024583] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2022] [Accepted: 01/26/2023] [Indexed: 02/16/2023] Open
Abstract
The continuous assessment of pedestrians' cognitive load during a naturalistic mobile map-assisted navigation task is challenging because of limited experimental control over stimulus presentation, human-map-interactions, and other participant responses. To overcome this challenge, the present study takes advantage of navigators' spontaneous eye blinks during navigation to serve as event markers in continuously recorded electroencephalography (EEG) data to assess cognitive load in a mobile map-assisted navigation task. We examined if and how displaying different numbers of landmarks (3 vs. 5 vs. 7) on mobile maps along a given route would influence navigators' cognitive load during navigation in virtual urban environments. Cognitive load was assessed by the peak amplitudes of the blink-related fronto-central N2 and parieto-occipital P3. Our results show increased parieto-occipital P3 amplitude indicating higher cognitive load in the 7-landmark condition, compared to showing 3 or 5 landmarks. Our prior research already demonstrated that participants acquire more spatial knowledge in the 5- and 7-landmark conditions compared to the 3-landmark condition. Together with the current study, we find that showing 5 landmarks, compared to 3 or 7 landmarks, improved spatial learning without overtaxing cognitive load during navigation in different urban environments. Our findings also indicate a possible cognitive load spillover effect during map-assisted wayfinding whereby cognitive load during map viewing might have affected cognitive load during goal-directed locomotion in the environment or vice versa. Our research demonstrates that users' cognitive load and spatial learning should be considered together when designing the display of future navigation aids and that navigators' eye blinks can serve as useful event makers to parse continuous human brain dynamics reflecting cognitive load in naturalistic settings.
Collapse
Affiliation(s)
- Bingjie Cheng
- Department of Geography and Digital Society Initiative, University of Zurich, Zurich, Switzerland,*Correspondence: Bingjie Cheng,
| | - Enru Lin
- Department of Geography and Digital Society Initiative, University of Zurich, Zurich, Switzerland
| | - Anna Wunderlich
- Department of Biopsychology and Neuroergonomics, Technical University of Berlin, Berlin, Germany
| | - Klaus Gramann
- Department of Biopsychology and Neuroergonomics, Technical University of Berlin, Berlin, Germany
| | - Sara I. Fabrikant
- Department of Geography and Digital Society Initiative, University of Zurich, Zurich, Switzerland
| |
Collapse
|
8
|
Jeung S, Hilton C, Berg T, Gehrke L, Gramann K. Virtual Reality for Spatial Navigation. Curr Top Behav Neurosci 2023; 65:103-129. [PMID: 36512288 DOI: 10.1007/7854_2022_403] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/17/2023]
Abstract
Immersive virtual reality (VR) allows its users to experience physical space in a non-physical world. It has developed into a powerful research tool to investigate the neural basis of human spatial navigation as an embodied experience. The task of wayfinding can be carried out by using a wide range of strategies, leading to the recruitment of various sensory modalities and brain areas in real-life scenarios. While traditional desktop-based VR setups primarily focus on vision-based navigation, immersive VR setups, especially mobile variants, can efficiently account for motor processes that constitute locomotion in the physical world, such as head-turning and walking. When used in combination with mobile neuroimaging methods, immersive VR affords a natural mode of locomotion and high immersion in experimental settings, designing an embodied spatial experience. This in turn facilitates ecologically valid investigation of the neural underpinnings of spatial navigation.
Collapse
Affiliation(s)
- Sein Jeung
- Department of Biological Psychology and Neuroergonomics, Technische Universität Berlin, Berlin, Germany
- Kavli Institute for Systems Neuroscience, Norwegian University of Science and Technology, Trondheim, Norway
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Christopher Hilton
- Department of Biological Psychology and Neuroergonomics, Technische Universität Berlin, Berlin, Germany
| | - Timotheus Berg
- Department of Biological Psychology and Neuroergonomics, Technische Universität Berlin, Berlin, Germany
| | - Lukas Gehrke
- Department of Biological Psychology and Neuroergonomics, Technische Universität Berlin, Berlin, Germany
| | - Klaus Gramann
- Department of Biological Psychology and Neuroergonomics, Technische Universität Berlin, Berlin, Germany.
- Center for Advanced Neurological Engineering, University of California, San Diego, CA, USA.
| |
Collapse
|
9
|
Harmening N, Klug M, Gramann K, Miklody D. HArtMuT-modeling eye and muscle contributors in neuroelectric imaging. J Neural Eng 2022; 19. [PMID: 36536595 DOI: 10.1088/1741-2552/aca8ce] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2022] [Accepted: 12/05/2022] [Indexed: 12/08/2022]
Abstract
Objective.Magneto- and electroencephalography (M/EEG) measurements record a mix of signals from the brain, eyes, and muscles. These signals can be disentangled for artifact cleaning e.g. using spatial filtering techniques. However, correctly localizing and identifying these components relies on head models that so far only take brain sources into account.Approach.We thus developed the Head Artifact Model using Tripoles (HArtMuT). This volume conduction head model extends to the neck and includes brain sources as well as sources representing eyes and muscles that can be modeled as single dipoles, symmetrical dipoles, and tripoles. We compared a HArtMuT four-layer boundary element model (BEM) with the EEGLAB standard head model on their localization accuracy and residual variance (RV) using a HArtMuT finite element model (FEM) as ground truth. We also evaluated the RV on real-world data of mobile participants, comparing different HArtMuT BEM types with the EEGLAB standard head model.Main results.We found that HArtMuT improves localization for all sources, especially non-brain, and localization error and RV of non-brain sources were in the same range as those of brain sources. The best results were achieved by using cortical dipoles, muscular tripoles, and ocular symmetric dipoles, but dipolar sources alone can already lead to convincing results.Significance.We conclude that HArtMuT is well suited for modeling eye and muscle contributions to the M/EEG signal. It can be used to localize sources and to identify brain, eye, and muscle components. HArtMuT is freely available and can be integrated into standard software.
Collapse
Affiliation(s)
- Nils Harmening
- Neurotechnology, Technische Universität Berlin, Berlin, Germany
| | - Marius Klug
- Biological Psychology and Neuroergonomics, Technische Universität Berlin, Berlin, Germany
| | - Klaus Gramann
- Biological Psychology and Neuroergonomics, Technische Universität Berlin, Berlin, Germany
| | - Daniel Miklody
- Neurotechnology, Technische Universität Berlin, Berlin, Germany
| |
Collapse
|
10
|
Jacobsen NSJ, Blum S, Scanlon JEM, Witt K, Debener S. Mobile electroencephalography captures differences of walking over even and uneven terrain but not of single and dual-task gait. Front Sports Act Living 2022; 4:945341. [PMID: 36275441 PMCID: PMC9582531 DOI: 10.3389/fspor.2022.945341] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2022] [Accepted: 09/13/2022] [Indexed: 11/09/2022] Open
Abstract
Walking on natural terrain while performing a dual-task, such as typing on a smartphone is a common behavior. Since dual-tasking and terrain change gait characteristics, it is of interest to understand how altered gait is reflected by changes in gait-associated neural signatures. A study was performed with 64-channel electroencephalography (EEG) of healthy volunteers, which was recorded while they walked over uneven and even terrain outdoors with and without performing a concurrent task (self-paced button pressing with both thumbs). Data from n = 19 participants (M = 24 years, 13 females) were analyzed regarding gait-phase related power modulations (GPM) and gait performance (stride time and stride time-variability). GPMs changed significantly with terrain, but not with the task. Descriptively, a greater beta power decrease following right-heel strikes was observed on uneven compared to even terrain. No evidence of an interaction was observed. Beta band power reduction following the initial contact of the right foot was more pronounced on uneven than on even terrain. Stride times were longer on uneven compared to even terrain and during dual- compared to single-task gait, but no significant interaction was observed. Stride time variability increased on uneven terrain compared to even terrain but not during single- compared to dual-tasking. The results reflect that as the terrain difficulty increases, the strides become slower and more irregular, whereas a secondary task slows stride duration only. Mobile EEG captures GPM differences linked to terrain changes, suggesting that the altered gait control demands and associated cortical processes can be identified. This and further studies may help to lay the foundation for protocols assessing the cognitive demand of natural gait on the motor system.
Collapse
Affiliation(s)
- Nadine Svenja Josée Jacobsen
- Neuropsychology Lab, Department of Psychology, School of Medicine and Health Sciences, University of Oldenburg, Oldenburg, Germany,*Correspondence: Nadine Svenja Josée Jacobsen
| | - Sarah Blum
- Neuropsychology Lab, Department of Psychology, School of Medicine and Health Sciences, University of Oldenburg, Oldenburg, Germany,Hörzentrum Oldenburg GmbH, Oldenburg, Germany,Cluster of Excellence Hearing4all, Oldenburg, Germany
| | - Joanna Elizabeth Mary Scanlon
- Neuropsychology Lab, Department of Psychology, School of Medicine and Health Sciences, University of Oldenburg, Oldenburg, Germany,Branch for Hearing, Speech and Audio Technology HSA, Fraunhofer Institute for Digital Media Technology IDMT, Oldenburg, Germany
| | - Karsten Witt
- Department of Neurology and Research Center Neurosensory Science, School of Medicine and Health Sciences, University of Oldenburg, Oldenburg, Germany
| | - Stefan Debener
- Neuropsychology Lab, Department of Psychology, School of Medicine and Health Sciences, University of Oldenburg, Oldenburg, Germany,Cluster of Excellence Hearing4all, Oldenburg, Germany
| |
Collapse
|
11
|
Studnicki A, Downey RJ, Ferris DP. Characterizing and Removing Artifacts Using Dual-Layer EEG during Table Tennis. SENSORS (BASEL, SWITZERLAND) 2022; 22:s22155867. [PMID: 35957423 PMCID: PMC9371038 DOI: 10.3390/s22155867] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/01/2022] [Revised: 07/28/2022] [Accepted: 08/02/2022] [Indexed: 05/27/2023]
Abstract
Researchers can improve the ecological validity of brain research by studying humans moving in real-world settings. Recent work shows that dual-layer EEG can improve the fidelity of electrocortical recordings during gait, but it is unclear whether these positive results extrapolate to non-locomotor paradigms. For our study, we recorded brain activity with dual-layer EEG while participants played table tennis, a whole-body, responsive sport that could help investigate visuomotor feedback, object interception, and performance monitoring. We characterized artifacts with time-frequency analyses and correlated scalp and reference noise data to determine how well different sensors captured artifacts. As expected, individual scalp channels correlated more with noise-matched channel time series than with head and body acceleration. We then compared artifact removal methods with and without the use of the dual-layer noise electrodes. Independent Component Analysis separated channels into components, and we counted the number of high-quality brain components based on the fit of a dipole model and using an automated labeling algorithm. We found that using noise electrodes for data processing provided cleaner brain components. These results advance technological approaches for recording high fidelity brain dynamics in human behaviors requiring whole body movement, which will be useful for brain science research.
Collapse
|
12
|
The impact of external and internal focus of attention on visual dependence and EEG alpha oscillations during postural control. J Neuroeng Rehabil 2022; 19:81. [PMID: 35883085 PMCID: PMC9316701 DOI: 10.1186/s12984-022-01059-7] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2022] [Accepted: 07/07/2022] [Indexed: 11/10/2022] Open
Abstract
Background The ability to maintain upright posture requires successful integration of multiple sensory inputs (visual, vestibular, and somatosensory). When one or more sensory systems become unreliable, the postural control system must “down-weight” (or reduce the influence of) those senses and rely on other senses to maintain postural stability. As individuals age, their ability to successfully reweight sensory inputs diminishes, leading to increased fall risk. The present study investigates whether manipulating attentional focus can improve the ability to prioritize different sensory inputs for postural control. Methods Forty-two healthy adults stood on a balance board while wearing a virtual reality (VR) head-mounted display. The VR environment created a multisensory conflict amongst the different sensory signals as participants were tasked with maintaining postural stability on the balance board. Postural sway and scalp electroencephalography (EEG) were measured to assess visual weighting and cortical activity changes. Participants were randomized into groups that received different instructions on where to focus their attention during the balance task. Results Following the instructions to direct attention toward the movement of the board (external focus group) was associated with lower visual weighting and better balance performance than when not given any instructions on attentional focus (control group). Following the instructions to direct attention towards movement of the feet (internal focus group) did not lead to any changes in visual weighting or balance performance. Both external and internal focus groups exhibited increased EEG alpha power (8–13 Hz) activity over the occipital cortex as compared to the control group. Conclusions Current results suggest that directing one’s attention externally, away from one’s body, may optimize sensory integration for postural control when visual inputs are incongruent with somatosensory and vestibular inputs. Current findings may be helpful for clinicians and researchers in developing strategies to improve sensorimotor mechanisms for balance.
Collapse
|
13
|
Liu J, Singh AK, Wunderlich A, Gramann K, Lin CT. Redesigning navigational aids using virtual global landmarks to improve spatial knowledge retrieval. NPJ SCIENCE OF LEARNING 2022; 7:17. [PMID: 35853945 PMCID: PMC9296625 DOI: 10.1038/s41539-022-00132-z] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/15/2021] [Accepted: 07/01/2022] [Indexed: 06/15/2023]
Abstract
Although beacon- and map-based spatial strategies are the default strategies for navigation activities, today's navigational aids mostly follow a beacon-based design where one is provided with turn-by-turn instructions. Recent research, however, shows that our reliance on these navigational aids is causing a decline in our spatial skills. We are processing less of our surrounding environment and relying too heavily on the instructions given. To reverse this decline, we need to engage more in map-based learning, which encourages the user to process and integrate spatial knowledge into a cognitive map built to benefit flexible and independent spatial navigation behaviour. In an attempt to curb our loss of skills, we proposed a navigation assistant to support map-based learning during active navigation. Called the virtual global landmark (VGL) system, this augmented reality (AR) system is based on the kinds of techniques used in traditional orienteering. Specifically, a notable landmark is always present in the user's sight, allowing the user to continuously compute where they are in relation to that specific location. The efficacy of the unit as a navigational aid was tested in an experiment with 27 students from the University of Technology Sydney via a comparison of brain dynamics and behaviour. From an analysis of behaviour and event-related spectral perturbation, we found that participants were encouraged to process more spatial information with a map-based strategy where a silhouette of the compass-like landmark was perpetually in view. As a result of this technique, they consistently navigated with greater efficiency and better accuracy.
Collapse
Affiliation(s)
- Jia Liu
- CIBCI Centre, Australian AI Institute, School of Computer Science, Faculty of Engineering and Information Technology, University of Technology Sydney, Ultimo, NSW, Australia
| | - Avinash Kumar Singh
- CIBCI Centre, Australian AI Institute, School of Computer Science, Faculty of Engineering and Information Technology, University of Technology Sydney, Ultimo, NSW, Australia.
| | - Anna Wunderlich
- Biological Psychology and Neuroergonomics, Berlin Institute of Technology, Berlin, Germany
| | - Klaus Gramann
- CIBCI Centre, Australian AI Institute, School of Computer Science, Faculty of Engineering and Information Technology, University of Technology Sydney, Ultimo, NSW, Australia
- Biological Psychology and Neuroergonomics, Berlin Institute of Technology, Berlin, Germany
| | - Chin-Teng Lin
- CIBCI Centre, Australian AI Institute, School of Computer Science, Faculty of Engineering and Information Technology, University of Technology Sydney, Ultimo, NSW, Australia
| |
Collapse
|
14
|
Djebbara Z, Jensen OB, Parada FJ, Gramann K. Neuroscience and architecture: Modulating behavior through sensorimotor responses to the built environment. Neurosci Biobehav Rev 2022; 138:104715. [PMID: 35654280 DOI: 10.1016/j.neubiorev.2022.104715] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2022] [Revised: 05/23/2022] [Accepted: 05/25/2022] [Indexed: 11/18/2022]
Abstract
As we move through the world, natural and built environments implicitly guide behavior by appealing to certain sensory and motor dynamics. This process can be motivated by automatic attention to environmental features that resonate with specific sensorimotor responses. This review aims at providing a psychobiological framework describing how environmental features can lead to automated sensorimotor responses through defined neurophysiological mechanisms underlying attention. Through the use of automated processes in subsets of cortical structures, the goal of this framework is to describe on a neuronal level the functional link between the designed environment and sensorimotor responses. By distinguishing between environmental features and sensorimotor responses we elaborate on how automatic behavior employs the environment for sensorimotor adaptation. This is realized through a thalamo-cortical network integrating environmental features with motor aspects of behavior. We highlight the underlying transthalamic transmission from an Enactive and predictive perspective and review recent studies that effectively modulated behavior by systematically manipulating environmental features. We end by suggesting a promising combination of neuroimaging and computational analysis for future studies.
Collapse
Affiliation(s)
- Zakaria Djebbara
- Department of Architecture, Design, Media, and Technology, Aalborg University, Aalborg, Denmark; Biopsychology and Neuroergonomics, Technical University Berlin, Berlin, Germany.
| | - Ole B Jensen
- Department of Architecture, Design, Media, and Technology, Aalborg University, Aalborg, Denmark
| | - Francisco J Parada
- Centro de Estudios en Neurociencia Humana y Neuropsicología, Facultad de Psicología, Universidad Diego Portales, Santiago, Chile
| | - Klaus Gramann
- Biopsychology and Neuroergonomics, Technical University Berlin, Berlin, Germany
| |
Collapse
|
15
|
Gehrke L, Lopes P, Klug M, Akman S, Gramann K. Neural Sources of Prediction Errors Detect Unrealistic VR Interactions. J Neural Eng 2022; 19. [DOI: 10.1088/1741-2552/ac69bc] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2021] [Accepted: 04/22/2022] [Indexed: 11/12/2022]
Abstract
Abstract
Objective Neural interfaces hold significant promise to implicitly track user experience. Their application in VR/AR simulations is especially favorable as it allows user assessment without breaking the immersive experience. In VR, designing immersion is one key challenge. Subjective questionnaires are the established metrics to assess the effectiveness of immersive VR simulations. However, administering such questionnaires requires breaking the immersive experience they are supposed to assess. Approach We present a complimentary metric based on a ERPs. For the metric to be robust, the neural signal employed must be reliable. Hence, it is beneficial to target the neural signal's cortical origin directly, efficiently separating signal from noise. To test this new complementary metric, we designed a reach-to-tap paradigm in VR to probe EEG and movement adaptation to visuo-haptic glitches. Our working hypothesis was, that these glitches, or violations of the predicted action outcome, may indicate a disrupted user experience. Main Results Using prediction error negativity features, we classified VR glitches with ~77\% accuracy. We localized the EEG sources driving the classification and found midline cingulate EEG sources and a distributed network of parieto-occipital EEG sources to enable the classification success. Significance Prediction error signatures from these sources reflect violations of user's predictions during interaction with AR/VR, promising a robust and targeted marker for adaptive user interfaces.
Collapse
|
16
|
Welke D, Vessel EA. Naturalistic viewing conditions can increase task engagement and aesthetic preference but have only minimal impact on EEG quality. Neuroimage 2022; 256:119218. [PMID: 35443219 DOI: 10.1016/j.neuroimage.2022.119218] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2021] [Revised: 04/06/2022] [Accepted: 04/14/2022] [Indexed: 10/18/2022] Open
Abstract
Free gaze and moving images are typically avoided in EEG experiments due to the expected generation of artifacts and noise. Yet for a growing number of research questions, loosening these rigorous restrictions would be beneficial. Among these is research on visual aesthetic experiences, which often involve open-ended exploration of highly variable stimuli. Here we systematically compare the effect of conservative vs. more liberal experimental settings on various measures of behavior, brain activity and physiology in an aesthetic rating task. Our primary aim was to assess EEG signal quality. 43 participants either maintained fixation or were allowed to gaze freely, and viewed either static images or dynamic (video) stimuli consisting of dance performances or nature scenes. A passive auditory background task (auditory steady-state response; ASSR) was added as a proxy measure for overall EEG recording quality. We recorded EEG, ECG and eyetracking data, and participants rated their aesthetic preference and state of boredom on each trial. Whereas both behavioral ratings and gaze behavior were affected by task and stimulus manipulations, EEG SNR was barely affected and generally robust across all conditions, despite only minimal preprocessing and no trial rejection. In particular, we show that using video stimuli does not necessarily result in lower EEG quality and can, on the contrary, significantly reduce eye movements while increasing both the participants' aesthetic response and general task engagement. We see these as encouraging results indicating that - at least in the lab - more liberal experimental conditions can be adopted without significant loss of signal quality.
Collapse
Affiliation(s)
- Dominik Welke
- Department of Neuroscience, Max Planck Institute for Empirical Aesthetics, Frankfurt (Main), Germany.
| | - Edward A Vessel
- Department of Neuroscience, Max Planck Institute for Empirical Aesthetics, Frankfurt (Main), Germany.
| |
Collapse
|
17
|
Palacios-García I, Mhuireach GA, Grasso-Cladera A, Cryan JF, Parada FJ. The 4E approach to the human microbiome: Nested interactions between the gut-brain/body system within natural and built environments. Bioessays 2022; 44:e2100249. [PMID: 35338496 DOI: 10.1002/bies.202100249] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2021] [Revised: 03/13/2022] [Accepted: 03/15/2022] [Indexed: 12/17/2022]
Abstract
The complexity of the human mind and its interaction with the environment is one of the main epistemological debates throughout history. Recent ideas, framed as the 4E perspective to cognition, highlight that human experience depends causally on both cerebral and extracranial processes, but also is embedded in a particular sociomaterial context and is a product of historical accumulation of trajectory changes throughout life. Accordingly, the human microbiome is one of the most intriguing actors modulating brain function and physiology. Here, we present the 4E approach to the Human Microbiome for understanding mental processes from a broader perspective, encompassing one's body physiology and environment throughout their lifespan, interconnected by microbiome community structure and dynamics. We review evidence supporting the approach theoretically and motivates the study of the global set of microbial ecosystem networks encountered by a person across their lifetime (from skin to gut to natural and built environments). We furthermore trace future empirical implementation of the approach. We finally discuss novel research opportunities and clinical interventions aimed toward developing low-cost/high-benefit integrative and personalized bio-psycho-socio-environmental treatments for mental health and including the brain-gut-microbiome axis.
Collapse
Affiliation(s)
- Ismael Palacios-García
- Centro de Estudios en Neurociencia Humana y Neuropsicología. Facultad de Psicología, Universidad Diego Portales, Santiago, Chile.,Laboratorio de Psicofisiología, Escuela de Psicología, Pontificia Universidad Católica de Chile, Santiago, Chile
| | - Gwynne A Mhuireach
- Biology and the Built Environment Center, University of Oregon, Oregon, USA
| | - Aitana Grasso-Cladera
- Centro de Estudios en Neurociencia Humana y Neuropsicología. Facultad de Psicología, Universidad Diego Portales, Santiago, Chile
| | - John F Cryan
- Department of Anatomy & Neuroscience, School of Medicine, College of Medicine & Health, University College Cork, Cork, Ireland.,APC Microbiome Ireland, University College Cork, Cork, Ireland
| | - Francisco J Parada
- Centro de Estudios en Neurociencia Humana y Neuropsicología. Facultad de Psicología, Universidad Diego Portales, Santiago, Chile
| |
Collapse
|
18
|
Klug M, Kloosterman NA. Zapline‐plus: A Zapline extension for automatic and adaptive removal of frequency‐specific noise artifacts in M/
EEG. Hum Brain Mapp 2022; 43:2743-2758. [PMID: 35278015 PMCID: PMC9120550 DOI: 10.1002/hbm.25832] [Citation(s) in RCA: 15] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2021] [Revised: 02/17/2022] [Accepted: 03/01/2022] [Indexed: 11/29/2022] Open
Abstract
Removing power line noise and other frequency‐specific artifacts from electrophysiological data without affecting neural signals remains a challenging task. Recently, an approach was introduced that combines spectral and spatial filtering to effectively remove line noise: Zapline. This algorithm, however, requires manual selection of the noise frequency and the number of spatial components to remove during spatial filtering. Moreover, it assumes that noise frequency and spatial topography are stable over time, which is often not warranted. To overcome these issues, we introduce Zapline‐plus, which allows adaptive and automatic removal of frequency‐specific noise artifacts from M/electroencephalography (EEG) and LFP data. To achieve this, our extension first segments the data into periods (chunks) in which the noise is spatially stable. Then, for each chunk, it searches for peaks in the power spectrum, and finally applies Zapline. The exact noise frequency around the found target frequency is also determined separately for every chunk to allow fluctuations of the peak noise frequency over time. The number of to‐be‐removed components by Zapline is automatically determined using an outlier detection algorithm. Finally, the frequency spectrum after cleaning is analyzed for suboptimal cleaning, and parameters are adapted accordingly if necessary before re‐running the process. The software creates a detailed plot for monitoring the cleaning. We highlight the efficacy of the different features of our algorithm by applying it to four openly available data sets, two EEG sets containing both stationary and mobile task conditions, and two magnetoencephalography sets containing strong line noise.
Collapse
Affiliation(s)
- Marius Klug
- Biopsychology and Neuroergonomics, Institute of Psychology and Ergonomics Technische Universität Berlin Berlin Germany
| | - Niels A. Kloosterman
- Max Planck UCL Centre for Computational Psychiatry and Ageing Research Berlin Germany
- Center for Lifespan Psychology Max Planck Institute for Human Development Berlin Germany
| |
Collapse
|
19
|
Ramanoël S, Durteste M, Delaux A, de Saint Aubert JB, Arleo A. Future trends in brain aging research: Visuo-cognitive functions at stake during mobility and spatial navigation. AGING BRAIN 2022; 2:100034. [PMID: 36908887 PMCID: PMC9997160 DOI: 10.1016/j.nbas.2022.100034] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2022] [Revised: 01/31/2022] [Accepted: 02/02/2022] [Indexed: 11/28/2022] Open
Abstract
Aging leads to a complex pattern of structural and functional changes, gradually affecting sensorimotor, perceptual, and cognitive processes. These multiscale changes can hinder older adults' interaction with their environment, progressively reducing their autonomy in performing tasks relevant to everyday life. Autonomy loss can further be aggravated by the onset and progression of neurodegenerative disorders (e.g., age-related macular degeneration at the sensory input level; and Alzheimer's disease at the cognitive level). In this context, spatial cognition offers a representative case of high-level brain function that involves multimodal sensory processing, postural control, locomotion, spatial orientation, and wayfinding capabilities. Hence, studying spatial behavior and its neural bases can help identify early markers of pathogenic age-related processes. Until now, the neural correlates of spatial cognition have mostly been studied in static conditions thereby disregarding perceptual (other than visual) and motor aspects of natural navigation. In this review, we first demonstrate how visuo-motor integration and the allocation of cognitive resources during locomotion lie at the heart of real-world spatial navigation. Second, we present how technological advances such as immersive virtual reality and mobile neuroimaging solutions can enable researchers to explore the interplay between perception and action. Finally, we argue that the future of brain aging research in spatial navigation demands a widespread shift toward the use of naturalistic, ecologically valid experimental paradigms to address the challenges of mobility and autonomy decline across the lifespan.
Collapse
Affiliation(s)
- Stephen Ramanoël
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, 17 rue Moreau, F-75012 Paris, France.,Université Côte d'Azur, LAMHESS, Nice, France
| | - Marion Durteste
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, 17 rue Moreau, F-75012 Paris, France
| | - Alexandre Delaux
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, 17 rue Moreau, F-75012 Paris, France
| | | | - Angelo Arleo
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, 17 rue Moreau, F-75012 Paris, France
| |
Collapse
|
20
|
Mastropasqua A, Vural G, Taylor PCJ. Elements of exogenous attentional cueing preserved during optokinetic motion of the visual scene. Eur J Neurosci 2021; 55:746-761. [PMID: 34964525 DOI: 10.1111/ejn.15582] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2021] [Revised: 12/14/2021] [Accepted: 12/18/2021] [Indexed: 11/27/2022]
Abstract
Navigating through our environment raises challenges for perception by generating salient background visual motion, and eliciting prominent eye movements to stabilise the retinal image. It remains unclear if exogenous spatial attentional orienting is possible during background motion and the eye movements it causes, and whether this compromises the underlying neural processing. To test this, we combined exogenous orienting, visual scene motion, and EEG. 26 participants viewed a background of moving black and grey bars (optokinetic stimulation). We tested for effects of non-spatially predictive peripheral cueing on visual motion discrimination of a target dot, presented either at the same (valid) or opposite (invalid) location as the preceding cue. Valid cueing decreased reaction times not only when participants kept their gaze fixed on a central point (fixation blocks), but even when there was no fixation point, so that participants performed intensive, repetitive tracking eye movements (eye movements blocks). Overall, manual response reaction times were slower during eye movements. Cueing also produced reliable effects on neural activity on either block, including within the first 120 milliseconds of neural processing of the target. The key pattern with larger ERP amplitudes on invalid versus valid trials showed that the neural substrate of exogenous cueing was highly similar during eye movements or fixation. Exogenous peripheral cueing and its neural correlates are robust against distraction from the moving visual scene, important for perceptual cognition during navigation.
Collapse
Affiliation(s)
- Angela Mastropasqua
- Danish Research Centre for Magnetic Resonance, Centre for Functional and Diagnostic Imaging and Research, Copenhagen University Hospital - Amager and Hvidovre, Copenhagen, Denmark
| | - Gizem Vural
- Department of Forensic Psychiatry, Psychiatric Hospital of the LMU Munich, Germany
| | - Paul C J Taylor
- Department of Neurology, University Hospital, LMU Munich, Germany.,German Center for Vertigo and Balance Disorders, University Hospital, LMU Munich, Germany.,Department of Psychology, LMU Munich, Germany.,Faculty of Philosophy and Philosophy of Science, LMU Munich, Germany.,Munich Center for Neuroscience, LMU Munich, Germany
| |
Collapse
|
21
|
Miyakoshi M. Correcting whole-body motion capture data using rigid body transformation. Eur J Neurosci 2021; 54:7946-7958. [PMID: 34799874 DOI: 10.1111/ejn.15531] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2021] [Revised: 11/02/2021] [Accepted: 11/03/2021] [Indexed: 11/29/2022]
Abstract
Using motion capture data as a part of mobile brain-body imaging (MoBI) recording has been increasing. With minimal linear algebra background, this paper explains how the rigid body transformation can be a useful preprocessing step for denoising and missing marker recovery. Such a transformation can provide insight and necessary-and-sufficient solutions requiring no assumption other than the minimum number of markers present. First, a simulation test using the empirical datasets from the AudioMaze project published from this journal's same volume demonstrates theoretical accuracy. The simulation results show that the rigid-body method perfectly recovers missing markers on a rigid body if a minimum of three marker positions is available. Second, the same transformation is applied to the empirical dataset. Before preprocessing, the raw data show that 15-80% of data frames had all markers present for rigid-body defined body parts. After using the rigid-body correction, most body parts recovered full markers in 90-95% of the data frames. The result also suggests the necessity for performing across-trial corrections for within-participant (42% missing detected in one of the body parts) and across-participants (11% missing). The discussion section introduces a solution and a performance summary for non-rigid-body marker correction using a neural network. Data support that the rigid body transformation is an intuitive and powerful correction method necessary for preprocessing motion capture data for neurocognitive experiments. The supporting information section contains a URL link to Matlab code and example data.
Collapse
Affiliation(s)
- Makoto Miyakoshi
- Swartz Center for Computational Neuroscience, Institute for Neural Computation, University of California San Diego, La Jolla, California, USA
| |
Collapse
|