1
|
Eklund N, Engels C, Neumann M, Strug A, van Enckevort E, Baber R, Bloemers M, Debucquoy A, van der Lugt A, Müller H, Parkkonen L, Quinlan PR, Urwin E, Holub P, Silander K, Anton G. Update of the Minimum Information About BIobank Data Sharing (MIABIS) Core Terminology to the 3 rd Version. Biopreserv Biobank 2024. [PMID: 38497765 DOI: 10.1089/bio.2023.0074] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/19/2024] Open
Abstract
Introduction: The Minimum Information About BIobank Data Sharing (MIABIS) is a biobank-specific terminology enabling the sharing of biobank-related data for different purposes across a wide range of database implementations. After 4 years in use and with the first version of the individual-level MIABIS component Sample, Sample donor, and Event, it was necessary to revise the terminology, especially to include biobanks that work more in the data domain than with samples. Materials & Methods: Nine use-cases representing different types of biobanks, studies, and networks participated in the development work. They represent types of data, specific sample types, or levels of organization that were not included earlier in MIABIS. To support our revision of the Biobank entity, we conducted a survey of European biobanks to chart the services they provide. An important stakeholder group for biobanks include researchers as the main users of biobanks. To be able to render MIABIS more researcher-friendly, we collected different sample/data requests to analyze the terminology adjustment needs in detail. During the update process, the Core terminology was iteratively reviewed by a large group of experts until a consensus was reached. Results: With this update, MIABIS was adjusted to encompass data-driven biobanks and to include data collections, while also describing the services and capabilities biobanks offer to their users, besides the retrospective samples. The terminology was also extended to accommodate sample and data collections of nonhuman origin. Additionally, a set of organizational attributes was compiled to describe networks. Discussion: The usability of MIABIS Core v3 was increased by extending it to cover more topics of the biobanking domain. Additionally, the focus was on a more general terminology and harmonization of attributes with the individual-level entities Sample, Sample donor, and Event to keep the overall terminology minimal. With this work, the internal semantics of the MIABIS terminology was improved.
Collapse
Affiliation(s)
- Niina Eklund
- Finnish Institute for Health and Welfare, Helsinki, Finland
| | - Cäcilia Engels
- German Biobank Node (GBN), Charité - Universitätsmedizin Berlin, Berlin, Germany
- German Cancer Consortium (DKTK), Heidelberg, Germany
- Charité University Hospital Berlin, Berlin, Germany
| | | | - Andrzej Strug
- Department of Medical Laboratory Diagnostics, Medical University of Gdansk, Gdansk, Poland
| | - Esther van Enckevort
- University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Ronny Baber
- Leipzig Medical Biobank, Leipzig, Germany and Institute of Laboratory Medicine, Clinical Chemistry and Molecular Diagnostics, University of Leipzig Medical Center, Leipzig, Germany
| | - Margreet Bloemers
- ZonMw Organisation for Health Research and Development, the Hague, The Netherlands
| | | | | | | | - Lauri Parkkonen
- Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland
| | | | - Esmond Urwin
- University of Nottingham, Nottingham, United Kingdom
| | | | - Kaisa Silander
- Finnish Institute for Health and Welfare, Helsinki, Finland
| | | |
Collapse
|
2
|
Heinilä E, Hyvärinen A, Parkkonen L, Parviainen T. Penalized canonical correlation analysis reveals a relationship between temperament traits and brain oscillations during mind wandering. Brain Behav 2024; 14:e3428. [PMID: 38361323 PMCID: PMC10869894 DOI: 10.1002/brb3.3428] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/01/2023] [Revised: 12/13/2023] [Accepted: 01/29/2024] [Indexed: 02/17/2024] Open
Abstract
INTRODUCTION There has been a growing interest in studying brain activity under naturalistic conditions. However, the relationship between individual differences in ongoing brain activity and psychological characteristics is not well understood. We investigated this connection, focusing on the association between oscillatory activity in the brain and individually characteristic dispositional traits. Given the variability of unconstrained resting states among individuals, we devised a paradigm that could harmonize the state of mind across all participants. METHODS We constructed task contrasts that included focused attention (FA), self-centered future planning, and rumination on anxious thoughts triggered by visual imagery. Magnetoencephalography was recorded from 28 participants under these 3 conditions for a duration of 16 min. The oscillatory power in the alpha and beta bands was converted into spatial contrast maps, representing the difference in brain oscillation power between the two conditions. We performed permutation cluster tests on these spatial contrast maps. Additionally, we applied penalized canonical correlation analysis (CCA) to study the relationship between brain oscillation patterns and behavioral traits. RESULTS The data revealed that the FA condition, as compared to the other conditions, was associated with higher alpha and beta power in the temporal areas of the left hemisphere and lower alpha and beta power in the parietal areas of the right hemisphere. Interestingly, the penalized CCA indicated that behavioral inhibition was positively correlated, whereas anxiety was negatively correlated, with a pattern of high oscillatory power in the bilateral precuneus and low power in the bilateral temporal regions. This unique association was found in the anxious-thoughts condition when contrasted with the focused-attention condition. CONCLUSION Our findings suggest individual temperament traits significantly affect brain engagement in naturalistic conditions. This research underscores the importance of considering individual traits in neuroscience and offers an effective method for analyzing brain activity and psychological differences.
Collapse
Affiliation(s)
- Erkka Heinilä
- Faculty of Information TechnologyUniversity of JyväskyläJyväskyläFinland
| | - Aapo Hyvärinen
- Department of Computer ScienceUniversity of HelsinkiHelsinkiFinland
- Université Paris‐Saclay, Inria, CEAGif‐sur‐YvetteFrance
| | - Lauri Parkkonen
- Department of Neuroscience and Biomedical EngineeringAalto University School of ScienceEspooFinland
| | - Tiina Parviainen
- Centre of Interdisciplinary Brain Research, Department of Psychology, Faculty of Education and PsychologyUniversity of JyväskyläJyväskyläFinland
| |
Collapse
|
3
|
Itälinna V, Kaltiainen H, Forss N, Liljeström M, Parkkonen L. Using normative modeling and machine learning for detecting mild traumatic brain injury from magnetoencephalography data. PLoS Comput Biol 2023; 19:e1011613. [PMID: 37943963 PMCID: PMC10662745 DOI: 10.1371/journal.pcbi.1011613] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2023] [Revised: 11/21/2023] [Accepted: 10/18/2023] [Indexed: 11/12/2023] Open
Abstract
New biomarkers are urgently needed for many brain disorders; for example, the diagnosis of mild traumatic brain injury (mTBI) is challenging as the clinical symptoms are diverse and nonspecific. EEG and MEG studies have demonstrated several population-level indicators of mTBI that could serve as objective markers of brain injury. However, deriving clinically useful biomarkers for mTBI and other brain disorders from EEG/MEG signals is hampered by the large inter-individual variability even across healthy people. Here, we used a multivariate machine-learning approach to detect mTBI from resting-state MEG measurements. To address the heterogeneity of the condition, we employed a normative modeling approach and modeled MEG signal features of individual mTBI patients as deviations with respect to the normal variation. To this end, a normative dataset comprising 621 healthy participants was used to determine the variation in power spectra across the cortex. In addition, we constructed normative datasets based on age-matched subsets of the full normative data. To discriminate patients from healthy control subjects, we trained support-vector-machine classifiers on the quantitative deviation maps for 25 mTBI patients and 20 controls not included in the normative dataset. The best performing classifier made use of the full normative data across the entire age and frequency ranges. This classifier was able to distinguish patients from controls with an accuracy of 79%. Inspection of the trained model revealed that low-frequency activity in the theta frequency band (4-8 Hz) is a significant indicator of mTBI, consistent with earlier studies. The results demonstrate the feasibility of using normative modeling of MEG data combined with machine learning to advance diagnosis of mTBI and identify patients that would benefit from treatment and rehabilitation. The current approach could be applied to a wide range of brain disorders, thus providing a basis for deriving MEG/EEG-based biomarkers.
Collapse
Affiliation(s)
- Veera Itälinna
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Aalto, Finland
| | - Hanna Kaltiainen
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Aalto, Finland
- Department of Neurology, Helsinki University Hospital and Clinical Neurosciences, Neurology, University of Helsinki, Helsinki, Finland
| | - Nina Forss
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Aalto, Finland
- Department of Neurology, Helsinki University Hospital and Clinical Neurosciences, Neurology, University of Helsinki, Helsinki, Finland
| | - Mia Liljeström
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Aalto, Finland
- BioMag Laboratory, HUS Medical Imaging Center, Helsinki University Hospital, Helsinki, Finland
| | - Lauri Parkkonen
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Aalto, Finland
- Aalto NeuroImaging, Aalto University School of Science, Aalto, Finland
| |
Collapse
|
4
|
Kurmanavičiūtė D, Kataja H, Jas M, Välilä A, Parkkonen L. Target of selective auditory attention can be robustly followed with MEG. Sci Rep 2023; 13:10959. [PMID: 37414861 PMCID: PMC10325959 DOI: 10.1038/s41598-023-37959-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2023] [Accepted: 06/30/2023] [Indexed: 07/08/2023] Open
Abstract
Selective auditory attention enables filtering of relevant acoustic information from irrelevant. Specific auditory responses, measurable by magneto- and electroencephalography (MEG/EEG), are known to be modulated by attention to the evoking stimuli. However, such attention effects have typically been studied in unnatural conditions (e.g. during dichotic listening of pure tones) and have been demonstrated mostly in averaged auditory evoked responses. To test how reliably we can detect the attention target from unaveraged brain responses, we recorded MEG data from 15 healthy subjects that were presented with two human speakers uttering continuously the words "Yes" and "No" in an interleaved manner. The subjects were asked to attend to one speaker. To investigate which temporal and spatial aspects of the responses carry the most information about the target of auditory attention, we performed spatially and temporally resolved classification of the unaveraged MEG responses using a support vector machine. Sensor-level decoding of the responses to attended vs. unattended words resulted in a mean accuracy of [Formula: see text] (N = 14) for both stimulus words. The discriminating information was mostly available 200-400 ms after the stimulus onset. Spatially-resolved source-level decoding indicated that the most informative sources were in the auditory cortices, in both the left and right hemisphere. Our result corroborates attention modulation of auditory evoked responses and shows that such modulations are detectable in unaveraged MEG responses at high accuracy, which could be exploited e.g. in an intuitive brain-computer interface.
Collapse
Affiliation(s)
- Dovilė Kurmanavičiūtė
- Department of Neuroscience and Biomedical Engineering, Aalto University, P.O. Box 12200, 00076, Aalto, Finland.
| | - Hanna Kataja
- Department of Neuroscience and Biomedical Engineering, Aalto University, P.O. Box 12200, 00076, Aalto, Finland
| | - Mainak Jas
- Department of Neuroscience and Biomedical Engineering, Aalto University, P.O. Box 12200, 00076, Aalto, Finland
- Athinoula A. Martinos Center for Biomedical Imaging, 149 Thirteenth Street, Charlestown, MA, 02129, USA
| | - Anne Välilä
- Department of Neuroscience and Biomedical Engineering, Aalto University, P.O. Box 12200, 00076, Aalto, Finland
| | - Lauri Parkkonen
- Department of Neuroscience and Biomedical Engineering, Aalto University, P.O. Box 12200, 00076, Aalto, Finland
- Aalto NeuroImaging, Aalto University, 00076, Aalto, Finland
| |
Collapse
|
5
|
Zhu Y, Parviainen T, Heinilä E, Parkkonen L, Hyvärinen A. Unsupervised representation learning of spontaneous MEG data with Nonlinear ICA. Neuroimage 2023; 274:120142. [PMID: 37120044 DOI: 10.1016/j.neuroimage.2023.120142] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2022] [Revised: 04/26/2023] [Accepted: 04/27/2023] [Indexed: 05/01/2023] Open
Abstract
Resting-state magnetoencephalography (MEG) data show complex but structured spatiotemporal patterns. However, the neurophysiological basis of these signal patterns is not fully known and the underlying signal sources are mixed in MEG measurements. Here, we developed a method based on the nonlinear independent component analysis (ICA), a generative model trainable with unsupervised learning, to learn representations from resting-state MEG data. After being trained with a large dataset from the Cam-CAN repository, the model has learned to represent and generate patterns of spontaneous cortical activity using latent nonlinear components, which reflects principal cortical patterns with specific spectral modes. When applied to the downstream classification task of audio-visual MEG, the nonlinear ICA model achieves competitive performance with deep neural networks despite limited access to labels. We further validate the generalizability of the model across different datasets by applying it to an independent neurofeedback dataset for decoding the subject's attentional states, providing a real-time feature extraction and decoding mindfulness and thought-inducing tasks with an accuracy of around 70% at the individual level, which is much higher than obtained by linear ICA or other baseline methods. Our results demonstrate that nonlinear ICA is a valuable addition to existing tools, particularly suited for unsupervised representation learning of spontaneous MEG activity which can then be applied to specific goals or tasks when labelled data are scarce.
Collapse
Affiliation(s)
- Yongjie Zhu
- Department of Computer Science, University of Helsinki, 00560 Helsinki, Finland; Department of Neuroscience and Biomedical Engineering, Aalto University, 00076 Espoo, Finland
| | - Tiina Parviainen
- Centre for Interdisciplinary Brain Research, Department of Psychology, University of Jyväskylä, 40014 Jyväskylä, Finland
| | - Erkka Heinilä
- Centre for Interdisciplinary Brain Research, Department of Psychology, University of Jyväskylä, 40014 Jyväskylä, Finland
| | - Lauri Parkkonen
- Department of Neuroscience and Biomedical Engineering, Aalto University, 00076 Espoo, Finland
| | - Aapo Hyvärinen
- Department of Computer Science, University of Helsinki, 00560 Helsinki, Finland.
| |
Collapse
|
6
|
Youssofzadeh V, Roy S, Chowdhury A, Izadysadr A, Parkkonen L, Raghavan M, Prasad G. Mapping and decoding cortical engagement during motor imagery, mental arithmetic, and silent word generation using MEG. Hum Brain Mapp 2023; 44:3324-3342. [PMID: 36987698 PMCID: PMC10171552 DOI: 10.1002/hbm.26284] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2022] [Revised: 02/25/2023] [Accepted: 03/06/2023] [Indexed: 03/30/2023] Open
Abstract
Accurate quantification of cortical engagement during mental imagery tasks remains a challenging brain-imaging problem with immediate relevance to developing brain-computer interfaces. We analyzed magnetoencephalography (MEG) data from 18 individuals completing cued motor imagery, mental arithmetic, and silent word generation tasks. Participants imagined movements of both hands (HANDS) and both feet (FEET), subtracted two numbers (SUB), and silently generated words (WORD). The task-related cortical engagement was inferred from beta band (17-25 Hz) power decrements estimated using a frequency-resolved beamforming method. In the hands and feet motor imagery tasks, beta power consistently decreased in premotor and motor areas. In the word and subtraction tasks, beta-power decrements showed engagements in language and arithmetic processing within the temporal, parietal, and inferior frontal regions. A support vector machine classification of beta power decrements yielded high accuracy rates of 74 and 68% for classifying motor-imagery (HANDS vs. FEET) and cognitive (WORD vs. SUB) tasks, respectively. From the motor-versus-nonmotor contrasts, excellent accuracy rates of 85 and 80% were observed for hands-versus-word and hands-versus-sub, respectively. A multivariate Gaussian-process classifier provided an accuracy rate of 60% for the four-way (HANDS-FEET-WORD-SUB) classification problem. Individual task performance was revealed by within-subject correlations of beta-decrements. Beta-power decrements are helpful metrics for mapping and decoding cortical engagement during mental processes in the absence of sensory stimuli or overt behavioral outputs. Markers derived based on beta decrements may be suitable for rehabilitation purposes, to characterize motor or cognitive impairments, or to treat patients recovering from a cerebral stroke.
Collapse
Affiliation(s)
- Vahab Youssofzadeh
- Department of Neurology, Medical College of Wisconsin, Milwaukee, Wisconsin, USA
| | - Sujit Roy
- BrainAlive Research Pvt Ltd, Kanpur, Uttar Pradesh, India
| | - Anirban Chowdhury
- School of Computer Science and Electronic Engineering, University of Essex, Colchester, UK
| | - Aqil Izadysadr
- Wake Forest School of Medicine, Winston-Salem, Winston-Salem, North Carolina, USA
| | - Lauri Parkkonen
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Espoo, Finland
| | - Manoj Raghavan
- Department of Neurology, Medical College of Wisconsin, Milwaukee, Wisconsin, USA
| | - Girijesh Prasad
- School of Computing, Engineering and Intelligent Systems, Ulster University, Londonderry, UK
| |
Collapse
|
7
|
Jaiswal A, Nenonen J, Parkkonen L. On electromagnetic head digitization in MEG and EEG. Sci Rep 2023; 13:3801. [PMID: 36882438 PMCID: PMC9992397 DOI: 10.1038/s41598-023-30223-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2022] [Accepted: 02/17/2023] [Indexed: 03/09/2023] Open
Abstract
In MEG and EEG studies, the accuracy of the head digitization impacts the co-registration between functional and structural data. The co-registration is one of the major factors that affect the spatial accuracy in MEG/EEG source imaging. Precisely digitized head-surface (scalp) points do not only improve the co-registration but can also deform a template MRI. Such an individualized-template MRI can be used for conductivity modeling in MEG/EEG source imaging if the individual's structural MRI is unavailable. Electromagnetic tracking (EMT) systems (particularly Fastrak, Polhemus Inc., Colchester, VT, USA) have been the most common solution for digitization in MEG and EEG. However, they may occasionally suffer from ambient electromagnetic interference which makes it challenging to achieve (sub-)millimeter digitization accuracy. The current study-(i) evaluated the performance of the Fastrak EMT system under different conditions in MEG/EEG digitization, and (ii) explores the usability of two alternative EMT systems (Aurora, NDI, Waterloo, ON, Canada; Fastrak with a short-range transmitter) for digitization. Tracking fluctuation, digitization accuracy, and robustness of the systems were evaluated in several test cases using test frames and human head models. The performance of the two alternative systems was compared against the Fastrak system. The results showed that the Fastrak system is accurate and robust for MEG/EEG digitization if the recommended operating conditions are met. The Fastrak with the short-range transmitter shows comparatively higher digitization error if digitization is not carried out very close to the transmitter. The study also evinces that the Aurora system can be used for MEG/EEG digitization within a constrained range; however, some modifications would be required to make the system a practical and easy-to-use digitizer. Its real-time error estimation feature can potentially improve digitization accuracy.
Collapse
Affiliation(s)
- Amit Jaiswal
- MEGIN Oy, Espoo, Finland. .,Department of Neuroscience and Biomedical Engineering, School of Science, Aalto University, Espoo, Finland.
| | | | - Lauri Parkkonen
- MEGIN Oy, Espoo, Finland.,Department of Neuroscience and Biomedical Engineering, School of Science, Aalto University, Espoo, Finland
| |
Collapse
|
8
|
van Bijnen S, Parkkonen L, Parviainen T. Activity level in left auditory cortex predicts behavioral performance in inhibition tasks in children. Neuroimage 2022; 258:119371. [PMID: 35700945 DOI: 10.1016/j.neuroimage.2022.119371] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2021] [Revised: 06/07/2022] [Accepted: 06/10/2022] [Indexed: 10/18/2022] Open
Abstract
Sensory processing during development is important for the emerging cognitive skills underlying goal-directed behavior. Yet, it is not known how auditory processing in children is related to their cognitive functions. Here, we utilized combined magneto- and electroencephalographic (M/EEG) measurements in school-aged children (6-14y) to show that child auditory cortical activity at ∼250 ms after auditory stimulation predicts the performance in inhibition tasks. While unaffected by task demands, the amplitude of the left-hemisphere activation pattern was significantly correlated with the variability of behavioral response time. Since this activation pattern is typically not present in adults, our results suggest divergent brain mechanisms in adults and children for consistent performance in auditory-based cognitive tasks. This difference can be explained as a shift in cortical resources for cognitive control from sensorimotor associations in the auditory cortex of children to top-down regulated control processes involving (pre)frontal and cingulate areas in adults.
Collapse
Affiliation(s)
- Sam van Bijnen
- Centre for Interdisciplinary Brain Research, Department of Psychology, University of Jyväskylä, P.O. Box 35, FI-40014, Jyväskylä, Finland; Faculty of Science, University of Amsterdam, 1012 WX, Amsterdam, the Netherlands.
| | - Lauri Parkkonen
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Espoo, Finland
| | - Tiina Parviainen
- Centre for Interdisciplinary Brain Research, Department of Psychology, University of Jyväskylä, P.O. Box 35, FI-40014, Jyväskylä, Finland
| |
Collapse
|
9
|
Abstract
Brain–computer interfaces (BCI) can be designed with several feedback modalities. To promote appropriate brain plasticity in therapeutic applications, the feedback should guide the user to elicit the desired brain activity and preferably be similar to the imagined action. In this study, we employed magnetoencephalography (MEG) to measure neurophysiological changes in healthy subjects performing motor imagery (MI) -based BCI training with two different feedback modalities. The MI-BCI task used in this study lasted 40–60 min and involved imagery of right- or left-hand movements. 8 subjects performed the task with visual and 14 subjects with proprioceptive feedback. We analysed power changes across the session at multiple frequencies in the range of 4–40 Hz with a generalized linear model to find those frequencies at which the power increased significantly during training. In addition, the power increase was analysed for each gradiometer, separately for alpha (8–13 Hz), beta (14–30 Hz) and gamma (30–40 Hz) bands, to find channels showing significant linear power increase over the session. These analyses were applied during three different conditions: rest, preparation, and MI. Visual feedback enhanced the amplitude of mainly high beta and gamma bands (24–40 Hz) in all conditions in occipital and left temporal channels. During proprioceptive feedback, in contrast, power increased mainly in alpha and beta bands. The alpha-band enhancement was found in multiple parietal, occipital, and temporal channels in all conditions, whereas the beta-band increase occurred during rest and preparation mainly in the parieto-occipital region and during MI in the parietal channels above hand motor regions. Our results show that BCI training with proprioceptive feedback increases the power of sensorimotor rhythms in the motor cortex, whereas visual feedback causes mainly a gamma-band increase in the visual cortex. MI-BCIs should involve proprioceptive feedback to facilitate plasticity in the motor cortex.
Collapse
Affiliation(s)
- Hanna-Leena Halme
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Espoo, Finland
- * E-mail:
| | - Lauri Parkkonen
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Espoo, Finland
- MEG Core, Aalto Neuroimaging, Aalto University School of Science, Espoo, Finland
| |
Collapse
|
10
|
Iivanainen J, Mäkinen AJ, Zetter R, Stenroos M, Ilmoniemi RJ, Parkkonen L. Spatial sampling of MEG and EEG based on generalized spatial-frequency analysis and optimal design. Neuroimage 2021; 245:118747. [PMID: 34852277 PMCID: PMC8752968 DOI: 10.1016/j.neuroimage.2021.118747] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2021] [Revised: 10/10/2021] [Accepted: 11/19/2021] [Indexed: 11/25/2022] Open
Abstract
We analyze spatial sampling of MEG and EEG using a realistic head model. On-scalp MEG may benefit from three times more samples than EEG and off-scalp MEG. We optimize sample positions to convey the most information from the brain. Optimized sampling can be useful when the sensor number is limited. The sample positions can be optimized to target a region of interest in the brain.
In this paper, we analyze spatial sampling of electro- (EEG) and magnetoencephalography (MEG), where the electric or magnetic field is typically sampled on a curved surface such as the scalp. By simulating fields originating from a representative adult-male head, we study the spatial-frequency content in EEG as well as in on- and off-scalp MEG. This analysis suggests that on-scalp MEG, off-scalp MEG and EEG can benefit from up to 280, 90 and 110 spatial samples, respectively. In addition, we suggest a new approach to obtain sensor locations that are optimal with respect to prior assumptions. The approach also allows to control, e.g., the uniformity of the sensor locations. Based on our simulations, we argue that for a low number of spatial samples, model-informed non-uniform sampling can be beneficial. For a large number of samples, uniform sampling grids yield nearly the same total information as the model-informed grids.
Collapse
Affiliation(s)
- Joonas Iivanainen
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Aalto FI-00076, Finland.
| | - Antti J Mäkinen
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Aalto FI-00076, Finland.
| | - Rasmus Zetter
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Aalto FI-00076, Finland
| | - Matti Stenroos
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Aalto FI-00076, Finland
| | - Risto J Ilmoniemi
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Aalto FI-00076, Finland
| | - Lauri Parkkonen
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Aalto FI-00076, Finland
| |
Collapse
|
11
|
Helle L, Nenonen J, Larson E, Simola J, Parkkonen L, Taulu S. Extended Signal-Space Separation Method for Improved Interference Suppression in MEG. IEEE Trans Biomed Eng 2021; 68:2211-2221. [PMID: 33232223 PMCID: PMC8513798 DOI: 10.1109/tbme.2020.3040373] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Objective: Magnetoencephalography (MEG) signals typically reflect a mixture of neuromagnetic fields, subject-related artifacts, external interference and sensor noise. Even inside a magnetically shielded room, external interference can be significantly stronger than brain signals. Methods such as signal-space projection (SSP) and signal-space separation (SSS) have been developed to suppress this residual interference, but their performance might not be sufficient in cases of strong interference or when the sources of interference change over time. Methods: Here we suggest a new method, extended signal-space separation (eSSS), which combines a physical model of the magnetic fields (as in SSS) with a statistical description of the interference (as in SSP). We demonstrate the performance of this method via simulations and experimental MEG data. Results: The eSSS method clearly outperforms SSS and SSP in interference suppression regardless of the extent of a priori information available on the interference sources. We also show that the method does not cause location or amplitude bias in dipole modeling. Conclusion: Our eSSS method provides better data quality than SSP or SSS and can be readily combined with other SSS-based methods, such as spatiotemporal SSS or head movement compensation. Thus, eSSS extends and complements the interference suppression techniques currently available for MEG. Significance: Due to its ability to suppress external interference to the level of sensor noise, eSSS can facilitate single-trial data analysis, exemplified in automated analysis of epileptic data. Such an enhanced suppression is especially important in environments with large interference fields.
Collapse
|
12
|
Kujala MV, Kauppi JP, Törnqvist H, Helle L, Vainio O, Kujala J, Parkkonen L. Publisher Correction: Time-resolved classification of dog brain signals reveals early processing of faces, species and emotion. Sci Rep 2021; 11:6885. [PMID: 33742006 PMCID: PMC7979922 DOI: 10.1038/s41598-021-85718-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022] Open
Abstract
An amendment to this paper has been published and can be accessed via a link at the top of the paper.
Collapse
Affiliation(s)
- Miiamaaria V Kujala
- Department of Psychology, Faculty of Education and Psychology, University of Jyväskylä, PO Box 35, 40014, Jyväskylä, Finland. .,Department of Equine and Small Animal Medicine, Faculty of Veterinary Medicine, University of Helsinki, PL 57, 00014, Helsinki, Finland. .,Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, P.O. Box 12200, 00076, Aalto, Finland.
| | - Jukka-Pekka Kauppi
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, P.O. Box 12200, 00076, Aalto, Finland.,Faculty of Information Technology, University of Jyväskylä, P.O. Box 35, 40014, Jyväskylä, Finland
| | - Heini Törnqvist
- Department of Equine and Small Animal Medicine, Faculty of Veterinary Medicine, University of Helsinki, PL 57, 00014, Helsinki, Finland
| | - Liisa Helle
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, P.O. Box 12200, 00076, Aalto, Finland
| | - Outi Vainio
- Department of Equine and Small Animal Medicine, Faculty of Veterinary Medicine, University of Helsinki, PL 57, 00014, Helsinki, Finland
| | - Jan Kujala
- Department of Psychology, Faculty of Education and Psychology, University of Jyväskylä, PO Box 35, 40014, Jyväskylä, Finland
| | - Lauri Parkkonen
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, P.O. Box 12200, 00076, Aalto, Finland
| |
Collapse
|
13
|
Kujala MV, Kauppi JP, Törnqvist H, Helle L, Vainio O, Kujala J, Parkkonen L. Time-resolved classification of dog brain signals reveals early processing of faces, species and emotion. Sci Rep 2020; 10:19846. [PMID: 33199715 PMCID: PMC7669855 DOI: 10.1038/s41598-020-76806-8] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2020] [Accepted: 10/30/2020] [Indexed: 11/22/2022] Open
Abstract
Dogs process faces and emotional expressions much like humans, but the time windows important for face processing in dogs are largely unknown. By combining our non-invasive electroencephalography (EEG) protocol on dogs with machine-learning algorithms, we show category-specific dog brain responses to pictures of human and dog facial expressions, objects, and phase-scrambled faces. We trained a support vector machine classifier with spatiotemporal EEG data to discriminate between responses to pairs of images. The classification accuracy was highest for humans or dogs vs. scrambled images, with most informative time intervals of 100–140 ms and 240–280 ms. We also detected a response sensitive to threatening dog faces at 30–40 ms; generally, responses differentiating emotional expressions were found at 130–170 ms, and differentiation of faces from objects occurred at 120–130 ms. The cortical sources underlying the highest-amplitude EEG signals were localized to the dog visual cortex.
Collapse
Affiliation(s)
- Miiamaaria V Kujala
- Department of Psychology, Faculty of Education and Psychology, University of Jyväskylä, PO Box 35, 40014, Jyväskylä, Finland. .,Department of Equine and Small Animal Medicine, Faculty of Veterinary Medicine, University of Helsinki, PL 57, 00014, Helsinki, Finland. .,Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, P.O. Box 12200, 00076, Aalto, Finland.
| | - Jukka-Pekka Kauppi
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, P.O. Box 12200, 00076, Aalto, Finland.,Faculty of Information Technology, University of Jyväskylä, P.O. Box 35, 40014, Jyväskylä, Finland
| | - Heini Törnqvist
- Department of Equine and Small Animal Medicine, Faculty of Veterinary Medicine, University of Helsinki, PL 57, 00014, Helsinki, Finland
| | - Liisa Helle
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, P.O. Box 12200, 00076, Aalto, Finland
| | - Outi Vainio
- Department of Equine and Small Animal Medicine, Faculty of Veterinary Medicine, University of Helsinki, PL 57, 00014, Helsinki, Finland
| | - Jan Kujala
- Department of Psychology, Faculty of Education and Psychology, University of Jyväskylä, PO Box 35, 40014, Jyväskylä, Finland
| | - Lauri Parkkonen
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, P.O. Box 12200, 00076, Aalto, Finland
| |
Collapse
|
14
|
Thiede A, Glerean E, Kujala T, Parkkonen L. Atypical MEG inter-subject correlation during listening to continuous natural speech in dyslexia. Neuroimage 2020; 216:116799. [DOI: 10.1016/j.neuroimage.2020.116799] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2019] [Revised: 02/21/2020] [Accepted: 03/30/2020] [Indexed: 10/24/2022] Open
|
15
|
Thiede A, Parkkonen L, Virtala P, Laasonen M, Mäkelä J, Kujala T. Neuromagnetic speech discrimination responses are associated with reading-related skills in dyslexic and typical readers. Heliyon 2020; 6:e04619. [PMID: 32904386 PMCID: PMC7452546 DOI: 10.1016/j.heliyon.2020.e04619] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2020] [Revised: 06/09/2020] [Accepted: 07/30/2020] [Indexed: 11/28/2022] Open
Abstract
Poor neural speech discrimination has been connected to dyslexia, and may represent phonological processing deficits that are hypothesized to be the main cause for reading impairments. Thus far, neural speech discrimination impairments have rarely been investigated in adult dyslexics, and even less by examining sources of neuromagnetic responses. We compared neuromagnetic speech discrimination in dyslexic and typical readers with mismatch fields (MMF) and determined the associations between MMFs and reading-related skills. We expected weak and atypically lateralized MMFs in dyslexic readers, and positive associations between reading-related skills and MMF strength. MMFs were recorded to a repeating pseudoword /ta-ta/ with occasional changes in vowel identity, duration, or syllable frequency from 43 adults, 21 with confirmed dyslexia. Phonetic (vowel and duration) changes elicited left-lateralized MMFs in the auditory cortices. Contrary to our hypothesis, MMF source strengths or lateralization did not differ between groups. However, better verbal working memory was associated with stronger left-hemispheric MMFs to duration changes across groups, and better reading was associated with stronger right-hemispheric late MMFs across speech-sound changes in dyslexic readers. This suggests a link between neural speech processing and reading-related skills, in line with previous work. Furthermore, our findings suggest a right-hemispheric compensatory mechanism for language processing in dyslexia. The results obtained promote the use of MMFs in investigating reading-related brain processes.
Collapse
Affiliation(s)
- A. Thiede
- Cognitive Brain Research Unit, Department of Psychology and Logopedics, Faculty of Medicine, University of Helsinki, Finland
| | - L. Parkkonen
- Department of Neuroscience and Biomedical Engineering, School of Science, Aalto University, Finland
- Aalto Neuroimaging, Aalto University, Finland
| | - P. Virtala
- Cognitive Brain Research Unit, Department of Psychology and Logopedics, Faculty of Medicine, University of Helsinki, Finland
| | - M. Laasonen
- Department of Psychology and Logopedics, Faculty of Medicine, University of Helsinki, Finland
- Department of Phoniatrics, Helsinki University Hospital, Finland
| | - J.P. Mäkelä
- BioMag Laboratory, HUS Medical Imaging Center, Helsinki University Central Hospital, Finland
| | - T. Kujala
- Cognitive Brain Research Unit, Department of Psychology and Logopedics, Faculty of Medicine, University of Helsinki, Finland
| |
Collapse
|
16
|
Iivanainen J, Zetter R, Parkkonen L. Potential of on-scalp MEG: Robust detection of human visual gamma-band responses. Hum Brain Mapp 2019; 41:150-161. [PMID: 31571310 PMCID: PMC7267937 DOI: 10.1002/hbm.24795] [Citation(s) in RCA: 37] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2019] [Revised: 08/09/2019] [Accepted: 09/03/2019] [Indexed: 11/25/2022] Open
Abstract
Electrophysiological signals recorded intracranially show rich frequency content spanning from near‐DC to hundreds of hertz. Noninvasive electromagnetic signals measured with electroencephalography (EEG) or magnetoencephalography (MEG) typically contain less signal power in high frequencies than invasive recordings. Particularly, noninvasive detection of gamma‐band activity (>30 Hz) is challenging since coherently active source areas are small at such frequencies and the available imaging methods have limited spatial resolution. Compared to EEG and conventional SQUID‐based MEG, on‐scalp MEG should provide substantially improved spatial resolution, making it an attractive method for detecting gamma‐band activity. Using an on‐scalp array comprised of eight optically pumped magnetometers (OPMs) and a conventional whole‐head SQUID array, we measured responses to a dynamic visual stimulus known to elicit strong gamma‐band responses. OPMs had substantially higher signal power than SQUIDs, and had a slightly larger relative gamma‐power increase over the baseline. With only eight OPMs, we could obtain gamma‐activity source estimates comparable to those of SQUIDs at the group level. Our results show the feasibility of OPMs to measure gamma‐band activity. To further facilitate the noninvasive detection of gamma‐band activity, the on‐scalp OPM arrays should be optimized with respect to sensor noise, the number of sensors and intersensor spacing.
Collapse
Affiliation(s)
- Joonas Iivanainen
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Espoo, Finland
| | - Rasmus Zetter
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Espoo, Finland
| | - Lauri Parkkonen
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Espoo, Finland.,Aalto Neuroimaging, Aalto University, Espoo, Finland
| |
Collapse
|
17
|
Camara C, Subramaniyam NP, Warwick K, Parkkonen L, Aziz T, Pereda E. Non-Linear Dynamical Analysis of Resting Tremor for Demand-Driven Deep Brain Stimulation. Sensors (Basel) 2019; 19:E2507. [PMID: 31159311 PMCID: PMC6603524 DOI: 10.3390/s19112507] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/15/2019] [Revised: 05/21/2019] [Accepted: 05/24/2019] [Indexed: 11/26/2022]
Abstract
Parkinson's Disease (PD) is currently the second most common neurodegenerative disease. One of the most characteristic symptoms of PD is resting tremor. Local Field Potentials (LFPs) have been widely studied to investigate deviations from the typical patterns of healthy brain activity. However, the inherent dynamics of the Sub-Thalamic Nucleus (STN) LFPs and their spatiotemporal dynamics have not been well characterized. In this work, we study the non-linear dynamical behaviour of STN-LFPs of Parkinsonian patients using ε -recurrence networks. RNs are a non-linear analysis tool that encodes the geometric information of the underlying system, which can be characterised (for example, using graph theoretical measures) to extract information on the geometric properties of the attractor. Results show that the activity of the STN becomes more non-linear during the tremor episodes and that ε -recurrence network analysis is a suitable method to distinguish the transitions between movement conditions, anticipating the onset of the tremor, with the potential for application in a demand-driven deep brain stimulation system.
Collapse
Affiliation(s)
- Carmen Camara
- Department of Computer Science, Carlos III University of Madrid, 28903 Madrid, Spain.
- Centre for Biomedical Technology, Technical University of Madrid, 28040 Madrid, Spain.
- Department of Neuroscience and Biomedical Engineering, School of Science, Aalto University, FI-00076 Helsinki, Finland.
| | - Narayan P Subramaniyam
- Department of Neuroscience and Biomedical Engineering, School of Science, Aalto University, FI-00076 Helsinki, Finland.
| | - Kevin Warwick
- Vice Chancellors Office, Coventry University, Coventry CV1 5FB, UK.
| | - Lauri Parkkonen
- Department of Neuroscience and Biomedical Engineering, School of Science, Aalto University, FI-00076 Helsinki, Finland.
| | - Tipu Aziz
- Nuffield Department of Clinical Neuroscience, University of Oxford, Oxford OX1 2JD, UK.
| | - Ernesto Pereda
- Centre for Biomedical Technology, Technical University of Madrid, 28040 Madrid, Spain.
- Department of Industrial Engineering, Laboratory of Electrical Engineering and Bioengineering, Universidad de La Laguna, 38200 Tenerife, Spain.
| |
Collapse
|
18
|
Zubarev I, Zetter R, Halme HL, Parkkonen L. Adaptive neural network classifier for decoding MEG signals. Neuroimage 2019; 197:425-434. [PMID: 31059799 PMCID: PMC6609925 DOI: 10.1016/j.neuroimage.2019.04.068] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2018] [Revised: 03/30/2019] [Accepted: 04/25/2019] [Indexed: 11/15/2022] Open
Abstract
We introduce two Convolutional Neural Network (CNN) classifiers optimized for inferring brain states from magnetoencephalographic (MEG) measurements. Network design follows a generative model of the electromagnetic (EEG and MEG) brain signals allowing explorative analysis of neural sources informing classification. The proposed networks outperform traditional classifiers as well as more complex neural networks when decoding evoked and induced responses to different stimuli across subjects. Importantly, these models can successfully generalize to new subjects in real-time classification enabling more efficient brain–computer interfaces (BCI). We introduce neural-network classifiers optimized for electromagnetic brain signals. Our models outperform other classifiers/methods in across-subject classification. Online updating/adaptation enables efficient brain–computer interfaces. The trained model is interpretable in neurophysiological terms. Implementation is publicly available.
Collapse
Affiliation(s)
- Ivan Zubarev
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, FI-00076, Aalto, Finland.
| | - Rasmus Zetter
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, FI-00076, Aalto, Finland
| | - Hanna-Leena Halme
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, FI-00076, Aalto, Finland
| | - Lauri Parkkonen
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, FI-00076, Aalto, Finland; Aalto NeuroImaging, Aalto University, FI-00076, Aalto, Finland
| |
Collapse
|
19
|
Chella F, Marzetti L, Stenroos M, Parkkonen L, Ilmoniemi RJ, Romani GL, Pizzella V. The impact of improved MEG-MRI co-registration on MEG connectivity analysis. Neuroimage 2019; 197:354-367. [PMID: 31029868 DOI: 10.1016/j.neuroimage.2019.04.061] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2018] [Revised: 04/13/2019] [Accepted: 04/23/2019] [Indexed: 02/07/2023] Open
Abstract
Co-registration between structural head images and functional MEG data is needed for anatomically-informed MEG data analysis. Despite the efforts to minimize the co-registration error, conventional landmark- and surface-based strategies for co-registering head and MEG device coordinates achieve an accuracy of typically 5-10 mm. Recent advances in instrumentation and technical solutions, such as the development of hybrid ultra-low-field (ULF) MRI-MEG devices or the use of 3D-printed individualized foam head-casts, promise unprecedented co-registration accuracy, i.e., 2 mm or better. In the present study, we assess through simulations the impact of such an improved co-registration on MEG connectivity analysis. We generated synthetic MEG recordings for pairs of connected cortical sources with variable locations. We then assessed the capability to reconstruct source-level connectivity from these recordings for 0-15-mm co-registration error, three levels of head modeling detail (one-, three- and four-compartment models), two source estimation techniques (linearly constrained minimum-variance beamforming and minimum-norm estimation MNE) and five separate connectivity metrics (imaginary coherency, phase-locking value, amplitude-envelope correlation, phase-slope index and frequency-domain Granger causality). We found that beamforming can better take advantage of an accurate co-registration than MNE. Specifically, when the co-registration error was smaller than 3 mm, the relative error in connectivity estimates was down to one-third of that observed with typical co-registration errors. MNE provided stable results for a wide range of co-registration errors, while the performance of beamforming rapidly degraded as the co-registration error increased. Furthermore, we found that even moderate co-registration errors (>6 mm, on average) essentially decrease the difference of four- and three- or one-compartment models. Hence, a precise co-registration is important if one wants to take full advantage of highly accurate head models for connectivity analysis. We conclude that an improved co-registration will be beneficial for reliable connectivity analysis and effective use of highly accurate head models in future MEG connectivity studies.
Collapse
Affiliation(s)
- Federico Chella
- Department of Neuroscience, Imaging and Clinical Sciences, G. d'Annunzio University of Chieti-Pescara, via dei Vestini 31, 66100 Chieti, Italy; Institute for Advanced Biomedical Technologies, G. d'Annunzio University of Chieti-Pescara, via dei Vestini 31, 66100 Chieti, Italy.
| | - Laura Marzetti
- Department of Neuroscience, Imaging and Clinical Sciences, G. d'Annunzio University of Chieti-Pescara, via dei Vestini 31, 66100 Chieti, Italy; Institute for Advanced Biomedical Technologies, G. d'Annunzio University of Chieti-Pescara, via dei Vestini 31, 66100 Chieti, Italy
| | - Matti Stenroos
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, P.O. Box 12200, FI, 00076, Aalto, Finland
| | - Lauri Parkkonen
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, P.O. Box 12200, FI, 00076, Aalto, Finland
| | - Risto J Ilmoniemi
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, P.O. Box 12200, FI, 00076, Aalto, Finland
| | - Gian Luca Romani
- Institute for Advanced Biomedical Technologies, G. d'Annunzio University of Chieti-Pescara, via dei Vestini 31, 66100 Chieti, Italy
| | - Vittorio Pizzella
- Department of Neuroscience, Imaging and Clinical Sciences, G. d'Annunzio University of Chieti-Pescara, via dei Vestini 31, 66100 Chieti, Italy; Institute for Advanced Biomedical Technologies, G. d'Annunzio University of Chieti-Pescara, via dei Vestini 31, 66100 Chieti, Italy
| |
Collapse
|
20
|
Iivanainen J, Zetter R, Grön M, Hakkarainen K, Parkkonen L. On-scalp MEG system utilizing an actively shielded array of optically-pumped magnetometers. Neuroimage 2019; 194:244-258. [PMID: 30885786 PMCID: PMC6536327 DOI: 10.1016/j.neuroimage.2019.03.022] [Citation(s) in RCA: 80] [Impact Index Per Article: 16.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2018] [Revised: 03/08/2019] [Accepted: 03/11/2019] [Indexed: 12/02/2022] Open
Abstract
The spatial resolution of magnetoencephalography (MEG) can be increased from that of conventional SQUID-based systems by employing on-scalp sensor arrays of e.g. optically-pumped magnetometers (OPMs). However, OPMs reach sufficient sensitivity for neuromagnetic measurements only when operated in a very low absolute magnetic field of few nanoteslas or less, usually not reached in a typical magnetically shielded room constructed for SQUID-based MEG. Moreover, field drifts affect the calibration of OPMs. Static and dynamic suppression of interfering fields is thus necessary for good-quality neuromagnetic measurements with OPMs. Here, we describe an on-scalp MEG system that utilizes OPMs and external compensation coils that provide static and dynamic shielding against ambient fields. In a conventional two-layer magnetically shielded room, our coil system reduced the maximum remanent DC-field component within an 8-channel OPM array from 70 to less than 1 nT, enabling the sensors to operate in the sensitive spin exchange relaxation-free regime. When compensating field drifts below 4 Hz, a low-frequency shielding factor of 22 dB was achieved, which reduced the peak-to-peak drift from 1.3 to 0.4 nT and thereby the standard deviation of the sensor calibration from 1.7% to 0.5%. Without band-limiting the field that was compensated, a low-frequency shielding factor of 43 dB was achieved. We validated the system by measuring brain responses to electric stimulation of the median nerve. With dynamic shielding and digital interference suppression methods, single-trial somatosensory evoked responses could be detected. Our results advance the deployment of OPM-based on-scalp MEG in lighter magnetic shields.
Collapse
Affiliation(s)
- Joonas Iivanainen
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, FI-00076, Aalto, Finland.
| | - Rasmus Zetter
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, FI-00076, Aalto, Finland
| | - Mikael Grön
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, FI-00076, Aalto, Finland
| | - Karoliina Hakkarainen
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, FI-00076, Aalto, Finland
| | - Lauri Parkkonen
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, FI-00076, Aalto, Finland; Aalto NeuroImaging, Aalto University, FI-00076, Aalto, Finland
| |
Collapse
|
21
|
|
22
|
Tronarp F, Subramaniyam NP, Sarkka S, Parkkonen L. Tracking of dynamic functional connectivity from MEG data with Kalman filtering. Annu Int Conf IEEE Eng Med Biol Soc 2018; 2018:1003-1006. [PMID: 30440560 DOI: 10.1109/embc.2018.8512456] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Owing to their millisecond-scale temporal resolution, magnetoencephalography (MEG) and electroencephalography (EEG) are well-suited tools to study dynamic functional connectivity between regions in the human brain. However, current techniques to estimate functional connectivity from MEG/EEG are based on a two-step approach; first, the MEG/EEG inverse problem is solved to estimate the source activity, and second, connectivity is estimated between the sources. In this work, we propose a method for simultaneous estimation of source activities and their dynamic functional connectivity using a Kalman filter. Based on simulations, our approach can reliably estimate source activities and resolve their time-varying interactions even at low SNR (< 1). When applied on empirical MEG responses to simple visual stimuli, our approach could capture the dynamic patterns of the underlying functional connectivity changes between the lower (pericalcarine) and higher (fusiform and parahippocampal) visual areas. In conclusion, we demonstrate that our approach is capable of tracking changes in functional connectivity at the millisecond resolution of MEG/EEG and thus making it suitable for real-time tracking of functional connectivity, which none of the current techniques are capable of.
Collapse
|
23
|
Abstract
Recent advances in magnetic sensing has made on-scalp magnetoencephalography (MEG) possible. In particular, optically-pumped magnetometers (OPMs) have reached sensitivity levels that enable their use in MEG. In contrast to the SQUID sensors used in current MEG systems, OPMs do not require cryogenic cooling and can thus be placed within millimetres from the head, enabling the construction of sensor arrays that conform to the shape of an individual's head. To properly estimate the location of neural sources within the brain, one must accurately know the position and orientation of sensors in relation to the head. With the adaptable on-scalp MEG sensor arrays, this coregistration becomes more challenging than in current SQUID-based MEG systems that use rigid sensor arrays. Here, we used simulations to quantify how accurately one needs to know the position and orientation of sensors in an on-scalp MEG system. The effects that different types of localisation errors have on forward modelling and source estimates obtained by minimum-norm estimation, dipole fitting, and beamforming are detailed. We found that sensor position errors generally have a larger effect than orientation errors and that these errors affect the localisation accuracy of superficial sources the most. To obtain similar or higher accuracy than with current SQUID-based MEG systems, RMS sensor position and orientation errors should be [Formula: see text] and [Formula: see text], respectively.
Collapse
Affiliation(s)
- Rasmus Zetter
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, 00076, Aalto, Finland.
| | - Joonas Iivanainen
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, 00076, Aalto, Finland
| | - Matti Stenroos
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, 00076, Aalto, Finland
| | - Lauri Parkkonen
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, 00076, Aalto, Finland
- Aalto NeuroImaging, Aalto University, 00076, Aalto, Finland
| |
Collapse
|
24
|
Lankinen K, Saari J, Hlushchuk Y, Tikka P, Parkkonen L, Hari R, Koskinen M. MEG and fMRI dynamics during movie viewing. J Vis 2018. [DOI: 10.1167/18.10.965] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
- Kaisu Lankinen
- Department of Neuroscience and Biomedical Engineering, School of Science, Aalto University, P.O. Box 12200, FI-00076 AALTO, Finland Aalto NeuroImaging (AMI Centre and MEG Core), Aalto University, FI-00076 AALTO, Finland
| | - Jukka Saari
- Department of Neuroscience and Biomedical Engineering, School of Science, Aalto University, P.O. Box 12200, FI-00076 AALTO, Finland
| | - Yevhen Hlushchuk
- Department of Film, Television and Scenography, School of Arts, Design and Architecture, Aalto University, P.O. Box 16500, FI-00076 AALTO, Finland Department of Radiology, Hospital District of Helsinki and Uusimaa (HUS), HUS Medical Imaging Center, Helsinki University Central Hospital (HUCH), University of Helsinki, Helsinki, Finland
| | - Pia Tikka
- Department of Film, Television and Scenography, School of Arts, Design and Architecture, Aalto University, P.O. Box 16500, FI-00076 AALTO, Finland
| | - Lauri Parkkonen
- Department of Neuroscience and Biomedical Engineering, School of Science, Aalto University, P.O. Box 12200, FI-00076 AALTO, Finland
| | - Riitta Hari
- Department of Neuroscience and Biomedical Engineering, School of Science, Aalto University, P.O. Box 12200, FI-00076 AALTO, Finland Department of Art, School of Arts, Design and Architecture, Aalto University, P.O. Box 31000, FI-00076 AALTO, Finland
| | - Miika Koskinen
- Department of Neuroscience and Biomedical Engineering, School of Science, Aalto University, P.O. Box 12200, FI-00076 AALTO, Finland Department of Physiology, Faculty of Medicine, P.O. Box 63, FI-00014 University of Helsinki, Finland
| |
Collapse
|
25
|
Abstract
Long calibration time hinders the feasibility of brain-computer interfaces (BCI). If other subjects’ data were used for training the classifier, BCI-based neurofeedback practice could start without the initial calibration. Here, we compare methods for inter-subject decoding of left- vs. right-hand motor imagery (MI) from MEG and EEG. Six methods were tested on data involving MEG and EEG measurements of healthy participants. Inter-subject decoders were trained on subjects showing good within-subject accuracy, and tested on all subjects, including poor performers. Three methods were based on Common Spatial Patterns (CSP), and three others on logistic regression with l1 - or l2,1 -norm regularization. The decoding accuracy was evaluated using (1) MI and (2) passive movements (PM) for training, separately for MEG and EEG. With MI training, the best accuracies across subjects (mean 70.6% for MEG, 67.7% for EEG) were obtained using multi-task learning (MTL) with logistic regression and l2,1-norm regularization. MEG yielded slightly better average accuracies than EEG. With PM training, none of the inter-subject methods yielded above chance level (58.7%) accuracy. In conclusion, MTL and training with other subject’s MI is efficient for inter-subject decoding of MI. Passive movements of other subjects are likely suboptimal for training the MI classifiers.
Collapse
Affiliation(s)
- Hanna-Leena Halme
- Department of Neuroscience and Biomedical Engineering NBE, Aalto University School of Science, P.O. Box 12200, FI-00076, Aalto, Finland.
| | - Lauri Parkkonen
- Department of Neuroscience and Biomedical Engineering NBE, Aalto University School of Science, P.O. Box 12200, FI-00076, Aalto, Finland.,Aalto Neuroimaging, MEG Core, Aalto University School of Science, Espoo, Finland
| |
Collapse
|
26
|
Abstract
Long calibration time hinders the feasibility of brain-computer interfaces (BCI). If other subjects' data were used for training the classifier, BCI-based neurofeedback practice could start without the initial calibration. Here, we compare methods for inter-subject decoding of left- vs. right-hand motor imagery (MI) from MEG and EEG. Six methods were tested on data involving MEG and EEG measurements of healthy participants. Inter-subject decoders were trained on subjects showing good within-subject accuracy, and tested on all subjects, including poor performers. Three methods were based on Common Spatial Patterns (CSP), and three others on logistic regression with l1 - or l2,1 -norm regularization. The decoding accuracy was evaluated using (1) MI and (2) passive movements (PM) for training, separately for MEG and EEG. With MI training, the best accuracies across subjects (mean 70.6% for MEG, 67.7% for EEG) were obtained using multi-task learning (MTL) with logistic regression and l2,1-norm regularization. MEG yielded slightly better average accuracies than EEG. With PM training, none of the inter-subject methods yielded above chance level (58.7%) accuracy. In conclusion, MTL and training with other subject's MI is efficient for inter-subject decoding of MI. Passive movements of other subjects are likely suboptimal for training the MI classifiers.
Collapse
Affiliation(s)
- Hanna-Leena Halme
- Department of Neuroscience and Biomedical Engineering NBE, Aalto University School of Science, P.O. Box 12200, FI-00076, Aalto, Finland.
| | - Lauri Parkkonen
- Department of Neuroscience and Biomedical Engineering NBE, Aalto University School of Science, P.O. Box 12200, FI-00076, Aalto, Finland
- Aalto Neuroimaging, MEG Core, Aalto University School of Science, Espoo, Finland
| |
Collapse
|
27
|
Zubarev I, Parkkonen L. Evidence for a general performance-monitoring system in the human brain. Hum Brain Mapp 2018; 39:4322-4333. [PMID: 29974560 PMCID: PMC6220993 DOI: 10.1002/hbm.24273] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2018] [Revised: 06/04/2018] [Accepted: 06/05/2018] [Indexed: 01/12/2023] Open
Abstract
Adaptive behavior relies on the ability of the brain to form predictions and monitor action outcomes. In the human brain, the same system is thought to monitor action outcomes regardless of whether the information originates from internal (e.g., proprioceptive) and external (e.g., visual) sensory channels. Neural signatures of processing motor errors and action outcomes communicated by external feedback have been studied extensively; however, the existence of such a general action‐monitoring system has not been tested directly. Here, we use concurrent EEG‐MEG measurements and a probabilistic learning task to demonstrate that event‐related responses measured by electroencephalography and magnetoencephalography display spatiotemporal patterns that allow an effective transfer of a multivariate statistical model discriminating the outcomes across the following conditions: (a) erroneous versus correct motor output, (b) negative versus positive feedback, (c) high‐ versus low‐surprise negative feedback, and (d) erroneous versus correct brain–computer‐interface output. We further show that these patterns originate from highly‐overlapping neural sources in the medial frontal and the medial parietal cortices. We conclude that information about action outcomes arriving from internal or external sensory channels converges to the same neural system in the human brain, that matches this information to the internal predictions.
Collapse
Affiliation(s)
- Ivan Zubarev
- Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland
| | - Lauri Parkkonen
- Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland.,Aalto Neuroimaging, Aalto University, Espoo, Finland
| |
Collapse
|
28
|
Lankinen K, Saari J, Hlushchuk Y, Tikka P, Parkkonen L, Hari R, Koskinen M. Consistency and similarity of MEG- and fMRI-signal time courses during movie viewing. Neuroimage 2018; 173:361-369. [DOI: 10.1016/j.neuroimage.2018.02.045] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2017] [Revised: 02/20/2018] [Accepted: 02/22/2018] [Indexed: 02/02/2023] Open
|
29
|
Chen Z, Parkkonen L, Wei J, Dong JR, Ma Y, Carlson S. Prepulse Inhibition of Auditory Cortical Responses in the Caudolateral Superior Temporal Gyrus in Macaca mulatta. Neurosci Bull 2017; 34:291-302. [PMID: 29022224 DOI: 10.1007/s12264-017-0181-7] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2017] [Accepted: 08/05/2017] [Indexed: 11/30/2022] Open
Abstract
Prepulse inhibition (PPI) refers to a decreased response to a startling stimulus when another weaker stimulus precedes it. Most PPI studies have focused on the physiological startle reflex and fewer have reported the PPI of cortical responses. We recorded local field potentials (LFPs) in four monkeys and investigated whether the PPI of auditory cortical responses (alpha, beta, and gamma oscillations and evoked potentials) can be demonstrated in the caudolateral belt of the superior temporal gyrus (STGcb). We also investigated whether the presence of a conspecific, which draws attention away from the auditory stimuli, affects the PPI of auditory cortical responses. The PPI paradigm consisted of Pulse-only and Prepulse + Pulse trials that were presented randomly while the monkey was alone (ALONE) and while another monkey was present in the same room (ACCOMP). The LFPs to the Pulse were significantly suppressed by the Prepulse thus, demonstrating PPI of cortical responses in the STGcb. The PPI-related inhibition of the N1 amplitude of the evoked responses and cortical oscillations to the Pulse were not affected by the presence of a conspecific. In contrast, gamma oscillations and the amplitude of the N1 response to Pulse-only were suppressed in the ACCOMP condition compared to the ALONE condition. These findings demonstrate PPI in the monkey STGcb and suggest that the PPI of auditory cortical responses in the monkey STGcb is a pre-attentive inhibitory process that is independent of attentional modulation.
Collapse
Affiliation(s)
- Zuyue Chen
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, 00076, Espoo, Finland.
- Department of Physiology, Faculty of Medicine, University of Helsinki, 00014, Helsinki, Finland.
| | - Lauri Parkkonen
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, 00076, Espoo, Finland
| | - Jingkuan Wei
- Laboratory of Primate Neurosciences, Kunming Institute of Zoology, Chinese Academy of Sciences, Kunming, 650223, China
| | - Jin-Run Dong
- Laboratory of Primate Neurosciences, Kunming Institute of Zoology, Chinese Academy of Sciences, Kunming, 650223, China
| | - Yuanye Ma
- Laboratory of Primate Neurosciences, Kunming Institute of Zoology, Chinese Academy of Sciences, Kunming, 650223, China
| | - Synnöve Carlson
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, 00076, Espoo, Finland
- Department of Physiology, Faculty of Medicine, University of Helsinki, 00014, Helsinki, Finland
| |
Collapse
|
30
|
Parkkonen E, Laaksonen K, Piitulainen H, Pekkola J, Parkkonen L, Tatlisumak T, Forss N. Strength of ~20-Hz Rebound and Motor Recovery After Stroke. Neurorehabil Neural Repair 2017; 31:475-486. [PMID: 28164736 DOI: 10.1177/1545968316688795] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
BACKGROUND Stroke is a major cause of disability worldwide, and effective rehabilitation is crucial to regain skills for independent living. Recently, novel therapeutic approaches manipulating the excitatory-inhibitory balance of the motor cortex have been introduced to boost recovery after stroke. However, stroke-induced neurophysiological changes of the motor cortex may vary despite of similar clinical symptoms. Therefore, better understanding of excitability changes after stroke is essential when developing and targeting novel therapeutic approaches. OBJECTIVE AND METHODS We identified recovery-related alterations in motor cortex excitability after stroke using magnetoencephalography. Dynamics (suppression and rebound) of the ~20-Hz motor cortex rhythm were monitored during passive movement of the index finger in 23 stroke patients with upper limb paresis at acute phase, 1 month, and 1 year after stroke. RESULTS After stroke, the strength of the ~20-Hz rebound to stimulation of both impaired and healthy hand was decreased with respect to the controls in the affected (AH) and unaffected (UH) hemispheres, and increased during recovery. Importantly, the rebound strength was lower than that of the controls in the AH and UH also to healthy-hand stimulation despite of intact afferent input. In the AH, the rebound strength to impaired-hand stimulation correlated with hand motor recovery. CONCLUSIONS Motor cortex excitability is increased bilaterally after stroke and decreases concomitantly with recovery. Motor cortex excitability changes are related to both alterations in local excitatory-inhibitory circuits and changes in afferent input. Fluent sensorimotor integration, which is closely coupled with excitability changes, seems to be a key factor for motor recovery.
Collapse
Affiliation(s)
- Eeva Parkkonen
- 1 Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Espoo, Finland.,2 Department of Neurology, Helsinki University Hospital, Helsinki, Finland.,3 Clinical Neurosciences, University of Helsinki, Helsinki, Finland
| | - Kristina Laaksonen
- 1 Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Espoo, Finland.,2 Department of Neurology, Helsinki University Hospital, Helsinki, Finland.,3 Clinical Neurosciences, University of Helsinki, Helsinki, Finland
| | - Harri Piitulainen
- 1 Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Espoo, Finland
| | - Johanna Pekkola
- 4 HUS Medical Imaging Center, Radiology, University of Helsinki and Helsinki University Hospital, Finland
| | - Lauri Parkkonen
- 1 Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Espoo, Finland
| | - Turgut Tatlisumak
- 2 Department of Neurology, Helsinki University Hospital, Helsinki, Finland.,3 Clinical Neurosciences, University of Helsinki, Helsinki, Finland.,5 Department of Neurology, Sahlgrenska University Hospital, Gothenburg, Sweden.,6 Department of Clinical Neurosciences, Institute of Neuroscience and Physiology, Sahlgrenska Academy at University of Gothenburg, Gothenburg, Sweden
| | - Nina Forss
- 1 Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Espoo, Finland.,2 Department of Neurology, Helsinki University Hospital, Helsinki, Finland.,3 Clinical Neurosciences, University of Helsinki, Helsinki, Finland
| |
Collapse
|
31
|
Kujala MV, Somppi S, Jokela M, Vainio O, Parkkonen L. Human Empathy, Personality and Experience Affect the Emotion Ratings of Dog and Human Facial Expressions. PLoS One 2017; 12:e0170730. [PMID: 28114335 PMCID: PMC5257001 DOI: 10.1371/journal.pone.0170730] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2016] [Accepted: 01/10/2017] [Indexed: 11/30/2022] Open
Abstract
Facial expressions are important for humans in communicating emotions to the conspecifics and enhancing interpersonal understanding. Many muscles producing facial expressions in humans are also found in domestic dogs, but little is known about how humans perceive dog facial expressions, and which psychological factors influence people’s perceptions. Here, we asked 34 observers to rate the valence, arousal, and the six basic emotions (happiness, sadness, surprise, disgust, fear, and anger/aggressiveness) from images of human and dog faces with Pleasant, Neutral and Threatening expressions. We investigated how the subjects’ personality (the Big Five Inventory), empathy (Interpersonal Reactivity Index) and experience of dog behavior affect the ratings of dog and human faces. Ratings of both species followed similar general patterns: human subjects classified dog facial expressions from pleasant to threatening very similarly to human facial expressions. Subjects with higher emotional empathy evaluated Threatening faces of both species as more negative in valence and higher in anger/aggressiveness. More empathetic subjects also rated the happiness of Pleasant humans but not dogs higher, and they were quicker in their valence judgments of Pleasant human, Threatening human and Threatening dog faces. Experience with dogs correlated positively with ratings of Pleasant and Neutral dog faces. Personality also had a minor effect on the ratings of Pleasant and Neutral faces in both species. The results imply that humans perceive human and dog facial expression in a similar manner, and the perception of both species is influenced by psychological factors of the evaluators. Especially empathy affects both the speed and intensity of rating dogs’ emotional facial expressions.
Collapse
Affiliation(s)
- Miiamaaria V. Kujala
- Department of Equine and Small Animal Medicine, Faculty of Veterinary Medicine, PL, University of Helsinki, Helsinki, Finland
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Aalto, Espoo, Finland
- * E-mail:
| | - Sanni Somppi
- Department of Equine and Small Animal Medicine, Faculty of Veterinary Medicine, PL, University of Helsinki, Helsinki, Finland
| | - Markus Jokela
- Psychology, Institute of Behavioural Sciences, Faculty of Behavioural Sciences, University of Helsinki, Helsinki, Finland
| | - Outi Vainio
- Department of Equine and Small Animal Medicine, Faculty of Veterinary Medicine, PL, University of Helsinki, Helsinki, Finland
| | - Lauri Parkkonen
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Aalto, Espoo, Finland
| |
Collapse
|
32
|
Abstract
BACKGROUND Motor imagery (MI) with real-time neurofeedback could be a viable approach, e.g., in rehabilitation of cerebral stroke. Magnetoencephalography (MEG) noninvasively measures electric brain activity at high temporal resolution and is well-suited for recording oscillatory brain signals. MI is known to modulate 10- and 20-Hz oscillations in the somatomotor system. In order to provide accurate feedback to the subject, the most relevant MI-related features should be extracted from MEG data. In this study, we evaluated several MEG signal features for discriminating between left- and right-hand MI and between MI and rest. METHODS MEG was measured from nine healthy participants imagining either left- or right-hand finger tapping according to visual cues. Data preprocessing, feature extraction and classification were performed offline. The evaluated MI-related features were power spectral density (PSD), Morlet wavelets, short-time Fourier transform (STFT), common spatial patterns (CSP), filter-bank common spatial patterns (FBCSP), spatio-spectral decomposition (SSD), and combined SSD+CSP, CSP+PSD, CSP+Morlet, and CSP+STFT. We also compared four classifiers applied to single trials using 5-fold cross-validation for evaluating the classification accuracy and its possible dependence on the classification algorithm. In addition, we estimated the inter-session left-vs-right accuracy for each subject. RESULTS The SSD+CSP combination yielded the best accuracy in both left-vs-right (mean 73.7%) and MI-vs-rest (mean 81.3%) classification. CSP+Morlet yielded the best mean accuracy in inter-session left-vs-right classification (mean 69.1%). There were large inter-subject differences in classification accuracy, and the level of the 20-Hz suppression correlated significantly with the subjective MI-vs-rest accuracy. Selection of the classification algorithm had only a minor effect on the results. CONCLUSIONS We obtained good accuracy in sensor-level decoding of MI from single-trial MEG data. Feature extraction methods utilizing both the spatial and spectral profile of MI-related signals provided the best classification results, suggesting good performance of these methods in an online MEG neurofeedback system.
Collapse
Affiliation(s)
- Hanna-Leena Halme
- Department of Neuroscience and Biomedical Engineering (NBE), Aalto University School of Science, Espoo, Finland
- Radiology Unit, HUS Medical Imaging Center, Helsinki University Hospital, Helsinki, Finland
| | - Lauri Parkkonen
- Department of Neuroscience and Biomedical Engineering (NBE), Aalto University School of Science, Espoo, Finland
- Aalto Neuroimaging, MEG Core, Aalto University School of Science, Espoo, Finland
| |
Collapse
|
33
|
Abstract
We discuss the importance of timing in brain function: how temporal dynamics of the world has left its traces in the brain during evolution and how we can monitor the dynamics of the human brain with non-invasive measurements. Accurate timing is important for the interplay of neurons, neuronal circuitries, brain areas and human individuals. In the human brain, multiple temporal integration windows are hierarchically organized, with temporal scales ranging from microseconds to tens and hundreds of milliseconds for perceptual, motor and cognitive functions, and up to minutes, hours and even months for hormonal and mood changes. Accurate timing is impaired in several brain diseases. From the current repertoire of non-invasive brain imaging methods, only magnetoencephalography (MEG) and scalp electroencephalography (EEG) provide millisecond time-resolution; our focus in this paper is on MEG. Since the introduction of high-density whole-scalp MEG/EEG coverage in the 1990s, the instrumentation has not changed drastically; yet, novel data analyses are advancing the field rapidly by shifting the focus from the mere pinpointing of activity hotspots to seeking stimulus- or task-specific information and to characterizing functional networks. During the next decades, we can expect increased spatial resolution and accuracy of the time-resolved brain imaging and better understanding of brain function, especially its temporal constraints, with the development of novel instrumentation and finer-grained, physiologically inspired generative models of local and network activity. Merging both spatial and temporal information with increasing accuracy and carrying out recordings in naturalistic conditions, including social interaction, will bring much new information about human brain function.
Collapse
Affiliation(s)
- Riitta Hari
- Department of Neuroscience and Biomedical Engineering, Aalto University, FI-AALTO 00076, Espoo, Finland
| | - Lauri Parkkonen
- Department of Neuroscience and Biomedical Engineering, Aalto University, FI-AALTO 00076, Espoo, Finland
| |
Collapse
|
34
|
Zhou G, Bourguignon M, Parkkonen L, Hari R. Neural signatures of hand kinematics in leaders vs. followers: A dual-MEG study. Neuroimage 2015; 125:731-738. [PMID: 26546864 PMCID: PMC4692514 DOI: 10.1016/j.neuroimage.2015.11.002] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2015] [Revised: 10/30/2015] [Accepted: 11/01/2015] [Indexed: 11/18/2022] Open
Abstract
During joint actions, people typically adjust their own actions according to the ongoing actions of the partner, which implies that the interaction modulates the behavior of both participants. However, the neural substrates of such mutual adaptation are still poorly understood. Here, we set out to identify the kinematics-related brain activity of leaders and followers performing hand actions. Sixteen participants as 8 pairs performed continuous, repetitive right-hand opening and closing actions with ~3-s cycles in a leader–follower task. Subjects played each role for 5 min. Magnetoencephalographic (MEG) brain signals were recorded simultaneously from both partners with a dual-MEG setup, and hand kinematics was monitored with accelerometers. Modulation index, a cross-frequency coupling measure, was computed between the hand acceleration and the MEG signals in the alpha (7–13 Hz) and beta (13–25 Hz) bands. Regardless of the participants' role, the strongest alpha and beta modulations occurred bilaterally in the sensorimotor cortices. In the occipital region, beta modulation was stronger in followers than leaders; these oscillations originated, according to beamformer source reconstructions, in early visual cortices. Despite differences in the modulation indices, alpha and beta power did not differ between the conditions. Our results indicate that the beta modulation in the early visual cortices depends on the subject's role as a follower or leader in a joint hand-action task. This finding could reflect the different strategies employed by leaders and followers in integrating kinematics-related visual information to control their own actions. Pairs of subjects performed hand movements as a leader and follower in a dual-MEG setup. Alpha and beta powers did not differ between followers and leaders. Alpha and beta modulation indices were strongest at bilateral sensorimotor cortices. Beta modulation was stronger in leaders than followers in the early visual cortex. The role might influence the integration of kinematics-related visual information to control one's own movements.
Collapse
Affiliation(s)
- Guangyu Zhou
- Department of Neuroscience and Biomedical Engineering, School of Science, Aalto University, Espoo 02150, Finland.
| | - Mathieu Bourguignon
- Department of Neuroscience and Biomedical Engineering, School of Science, Aalto University, Espoo 02150, Finland
| | - Lauri Parkkonen
- Department of Neuroscience and Biomedical Engineering, School of Science, Aalto University, Espoo 02150, Finland
| | - Riitta Hari
- Department of Neuroscience and Biomedical Engineering, School of Science, Aalto University, Espoo 02150, Finland
| |
Collapse
|
35
|
Maestú F, Peña JM, Garcés P, González S, Bajo R, Bagic A, Cuesta P, Funke M, Mäkelä JP, Menasalvas E, Nakamura A, Parkkonen L, López ME, Del Pozo F, Sudre G, Zamrini E, Pekkonen E, Henson RN, Becker JT. A multicenter study of the early detection of synaptic dysfunction in Mild Cognitive Impairment using Magnetoencephalography-derived functional connectivity. Neuroimage Clin 2015; 9:103-9. [PMID: 26448910 PMCID: PMC4552812 DOI: 10.1016/j.nicl.2015.07.011] [Citation(s) in RCA: 56] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Synaptic disruption is an early pathological sign of the neurodegeneration of Dementia of the Alzheimer's type (DAT). The changes in network synchronization are evident in patients with Mild Cognitive Impairment (MCI) at the group level, but there are very few Magnetoencephalography (MEG) studies regarding discrimination at the individual level. In an international multicenter study, we used MEG and functional connectivity metrics to discriminate MCI from normal aging at the individual person level. A labeled sample of features (links) that distinguished MCI patients from controls in a training dataset was used to classify MCI subjects in two testing datasets from four other MEG centers. We identified a pattern of neuronal hypersynchronization in MCI, in which the features that best discriminated MCI were fronto-parietal and interhemispheric links. The hypersynchronization pattern found in the MCI patients was stable across the five different centers, and may be considered an early sign of synaptic disruption and a possible preclinical biomarker for MCI/DAT. Across centers reliable abnormalities in the neuronal network organization of MCI patients These findings are consistent with the view that AD may, in its earliest stages, represent a disconnection syndrome. A high rate of classification accuracy in a blind study, especially for individuals who were cognitively normal All these suggest that MEG may be a useful marker of preclinical synaptic disruption. The hypersynchronization found in MCI patients may represent a compensatory response.
Collapse
Affiliation(s)
- Fernando Maestú
- Laboratory of Cognitive and Computational Neuroscience, Center for Biomedical Technology, Complutense University of Madrid and Technical University of Madrid, Madrid, Spain
| | - Jose-Maria Peña
- Laboratory of Cognitive and Computational Neuroscience, Center for Biomedical Technology, Complutense University of Madrid and Technical University of Madrid, Madrid, Spain
| | - Pilar Garcés
- Laboratory of Cognitive and Computational Neuroscience, Center for Biomedical Technology, Complutense University of Madrid and Technical University of Madrid, Madrid, Spain
| | - Santiago González
- Laboratory of Cognitive and Computational Neuroscience, Center for Biomedical Technology, Complutense University of Madrid and Technical University of Madrid, Madrid, Spain
| | - Ricardo Bajo
- Laboratory of Cognitive and Computational Neuroscience, Center for Biomedical Technology, Complutense University of Madrid and Technical University of Madrid, Madrid, Spain
| | - Anto Bagic
- Department of Neurology, University of Pittsburgh, Pittsburgh, USA
| | - Pablo Cuesta
- Laboratory of Cognitive and Computational Neuroscience, Center for Biomedical Technology, Complutense University of Madrid and Technical University of Madrid, Madrid, Spain
| | - Michael Funke
- Department of Pediatrics, University of Texas Health Science Center, Houston, USA
| | - Jyrki P Mäkelä
- BioMag Laboratory, HUS Medical Imaging Center, Helsinki University Central Hospital, Hensinki, Finland
| | - Ernestina Menasalvas
- Laboratory of Cognitive and Computational Neuroscience, Center for Biomedical Technology, Complutense University of Madrid and Technical University of Madrid, Madrid, Spain
| | - Akinori Nakamura
- Department of Clinical and Experimental Neuroimaging, National Center for Geriatrics and Gerontology, Obu, Japan
| | - Lauri Parkkonen
- Department of Biomedical Engineering and Computational Science, Aalto University School of Science, Aalto, Espoo, Finland ; Elekta Oy, Helsinki, Finland
| | - Maria E López
- Laboratory of Cognitive and Computational Neuroscience, Center for Biomedical Technology, Complutense University of Madrid and Technical University of Madrid, Madrid, Spain
| | - Francisco Del Pozo
- Laboratory of Cognitive and Computational Neuroscience, Center for Biomedical Technology, Complutense University of Madrid and Technical University of Madrid, Madrid, Spain
| | - Gustavo Sudre
- Human Genome Research Institute, National Institutes of Health, Bethesda, USA
| | - Edward Zamrini
- Department of Neurology, University of Utah, Salt Lake City, USA
| | - Eero Pekkonen
- Department of Neurology, University of Helsinki, Finland
| | - Richard N Henson
- Medical Research Council Cognition and Brain Sciences Unit, Cambridge, UK
| | - James T Becker
- Department of Neurology, University of Pittsburgh, Pittsburgh, USA ; Department of Psychiatry, University of Pittsburgh, Pittsburgh, USA ; Department of Psychology, University of Pittsburgh, Pittsburgh, USA
| |
Collapse
|
36
|
Zhdanov A, Nurminen J, Baess P, Hirvenkari L, Jousmäki V, Mäkelä JP, Mandel A, Meronen L, Hari R, Parkkonen L. An Internet-Based Real-Time Audiovisual Link for Dual MEG Recordings. PLoS One 2015; 10:e0128485. [PMID: 26098628 PMCID: PMC4476621 DOI: 10.1371/journal.pone.0128485] [Citation(s) in RCA: 24] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2014] [Accepted: 04/27/2015] [Indexed: 11/19/2022] Open
Abstract
HYPERSCANNING Most neuroimaging studies of human social cognition have focused on brain activity of single subjects. More recently, "two-person neuroimaging" has been introduced, with simultaneous recordings of brain signals from two subjects involved in social interaction. These simultaneous "hyperscanning" recordings have already been carried out with a spectrum of neuroimaging modalities, such as functional magnetic resonance imaging (fMRI), electroencephalography (EEG), and functional near-infrared spectroscopy (fNIRS). DUAL MEG SETUP We have recently developed a setup for simultaneous magnetoencephalographic (MEG) recordings of two subjects that communicate in real time over an audio link between two geographically separated MEG laboratories. Here we present an extended version of the setup, where we have added a video connection and replaced the telephone-landline-based link with an Internet connection. Our setup enabled transmission of video and audio streams between the sites with a one-way communication latency of about 130 ms. Our software that allows reproducing the setup is publicly available. VALIDATION We demonstrate that the audiovisual Internet-based link can mediate real-time interaction between two subjects who try to mirror each others' hand movements that they can see via the video link. All the nine pairs were able to synchronize their behavior. In addition to the video, we captured the subjects' movements with accelerometers attached to their index fingers; we determined from these signals that the average synchronization accuracy was 215 ms. In one subject pair we demonstrate inter-subject coherence patterns of the MEG signals that peak over the sensorimotor areas contralateral to the hand used in the task.
Collapse
Affiliation(s)
- Andrey Zhdanov
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Espoo, Finland
- MEG Core, Aalto Neuroimaging, Aalto University, Espoo, Finland
- BioMag Laboratory, HUS Medical Imaging Center, University of Helsinki and Helsinki University Hospital, Helsinki, Finland
| | - Jussi Nurminen
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Espoo, Finland
| | - Pamela Baess
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Espoo, Finland
| | - Lotta Hirvenkari
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Espoo, Finland
| | - Veikko Jousmäki
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Espoo, Finland
| | - Jyrki P. Mäkelä
- BioMag Laboratory, HUS Medical Imaging Center, University of Helsinki and Helsinki University Hospital, Helsinki, Finland
| | - Anne Mandel
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Espoo, Finland
| | - Lassi Meronen
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Espoo, Finland
| | - Riitta Hari
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Espoo, Finland
| | - Lauri Parkkonen
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Espoo, Finland
| |
Collapse
|
37
|
Salti M, Monto S, Charles L, King JR, Parkkonen L, Dehaene S. Distinct cortical codes and temporal dynamics for conscious and unconscious percepts. eLife 2015; 4. [PMID: 25997100 PMCID: PMC4467230 DOI: 10.7554/elife.05652] [Citation(s) in RCA: 72] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2014] [Accepted: 05/20/2015] [Indexed: 12/24/2022] Open
Abstract
The neural correlates of consciousness are typically sought by comparing the overall brain responses to perceived and unperceived stimuli. However, this comparison may be contaminated by non-specific attention, alerting, performance, and reporting confounds. Here, we pursue a novel approach, tracking the neuronal coding of consciously and unconsciously perceived contents while keeping behavior identical (blindsight). EEG and MEG were recorded while participants reported the spatial location and visibility of a briefly presented target. Multivariate pattern analysis demonstrated that considerable information about spatial location traverses the cortex on blindsight trials, but that starting ≈270 ms post-onset, information unique to consciously perceived stimuli, emerges in superior parietal and superior frontal regions. Conscious access appears characterized by the entry of the perceived stimulus into a series of additional brain processes, each restricted in time, while the failure of conscious access results in the breaking of this chain and a subsequent slow decay of the lingering unconscious activity. DOI:http://dx.doi.org/10.7554/eLife.05652.001 Our senses constantly receive information from the world around us, but we consciously perceive only a small portion of it. Nonetheless, even stimuli that are not consciously perceived are registered in our brain and influence our behavior. This is known as unconscious perception. Researchers disagree about how brain activity differs during conscious and unconscious perception. Some think that both consciously and unconsciously perceived objects are processed in the same way in the brain, but that the brain is more active during conscious perception. Others think that different neurons process the information in different types of perception. Salti et al. have now investigated this issue. While recording participants' brain activity, a line was briefly presented in one of eight different possible locations on a screen. The line was masked so it would be consciously perceived in roughly half of the presentations. Participants had to report the location of the line and then say whether they had seen it or had merely guessed its location. Even when they reported that they were guessing, participants identified the location of the line better than by chance, indicating unconscious perception on ‘guess’ trials. This enabled Salti et al. to compare how the brain encodes consciously perceived and unconsciously perceived stimuli. Unlike previous studies in which the brain activity associated with ‘seen’ and ‘unseen’ stimuli was compared, Salti et al. used a different approach to extract the neural activity underlying consciousness. A classifying algorithm was trained on a subset of the data to recognize from the recorded brain activity where on the screen a line had appeared. Applying this algorithm to the remaining data revealed the dynamics of stimulus encoding. Consciously and unconsciously perceived stimuli are encoded by the same neural responses for about a quater of a second. From this point on, consciously perceived stimuli benefit from a series of additional brain processes, each restricted in time. For unconsciously perceived stimuli, this chain of processing breaks and a slow decay of encoding is observed. Salti et al., therefore, conclude that conscious perception is represented differently to unconscious perception in the brain and produces more extensive and structured brain activity. Future work will focus on understanding these differences in neural coding and their contribution to the interplay between conscious and unconscious perception. DOI:http://dx.doi.org/10.7554/eLife.05652.002
Collapse
Affiliation(s)
- Moti Salti
- Cognitive Neuroimaging Unit, Institut National de la Santé et de la Recherche Médicale, Gif sur Yvette, France
| | - Simo Monto
- Cognitive Neuroimaging Unit, Institut National de la Santé et de la Recherche Médicale, Gif sur Yvette, France
| | - Lucie Charles
- Cognitive Neuroimaging Unit, Institut National de la Santé et de la Recherche Médicale, Gif sur Yvette, France
| | - Jean-Remi King
- Cognitive Neuroimaging Unit, Institut National de la Santé et de la Recherche Médicale, Gif sur Yvette, France
| | - Lauri Parkkonen
- Cognitive Neuroimaging Unit, Institut National de la Santé et de la Recherche Médicale, Gif sur Yvette, France
| | - Stanislas Dehaene
- Cognitive Neuroimaging Unit, Institut National de la Santé et de la Recherche Médicale, Gif sur Yvette, France
| |
Collapse
|
38
|
Parkkonen E, Laaksonen K, Piitulainen H, Parkkonen L, Forss N. Modulation of the ∽20-Hz motor-cortex rhythm to passive movement and tactile stimulation. Brain Behav 2015; 5:e00328. [PMID: 25874163 PMCID: PMC4396160 DOI: 10.1002/brb3.328] [Citation(s) in RCA: 26] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/12/2014] [Revised: 12/21/2014] [Accepted: 01/25/2015] [Indexed: 11/08/2022] Open
Abstract
BACKGROUND Integration of afferent somatosensory input with motor-cortex output is essential for accurate movements. Prior studies have shown that tactile input modulates motor-cortex excitability, which is reflected in the reactivity of the ∽ 20-Hz motor-cortex rhythm. ∽ 20-Hz rebound is connected to inhibition or deactivation of motor cortex whereas suppression has been associated with increased motor cortex activity. Although tactile sense carries important information for controlling voluntary actions, proprioception likely provides the most essential feedback for motor control. METHODS To clarify how passive movement modulates motor-cortex excitability, we studied with magnetoencephalography (MEG) the amplitudes and peak latencies of suppression and rebound of the ∽ 20-Hz rhythm elicited by tactile stimulation and passive movement of right and left index fingers in 22 healthy volunteers. RESULTS Passive movement elicited a stronger and more robust ∽ 20-Hz rebound than tactile stimulation. In contrast, the suppression amplitudes did not differ between the two stimulus types. CONCLUSION Our findings suggest that suppression and rebound represent activity of two functionally distinct neuronal populations. The ∽ 20-Hz rebound to passive movement could be a suitable tool to study the functional state of the motor cortex both in healthy subjects and in patients with motor disorders.
Collapse
Affiliation(s)
- Eeva Parkkonen
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science Espoo, Finland ; Aalto NeuroImaging, MEG-Core, Aalto University School of Science Espoo, Finland ; Clinical Neurosciences, Neurology, University of Helsinki and Helsinki University Hospital Finland
| | - Kristina Laaksonen
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science Espoo, Finland ; Aalto NeuroImaging, MEG-Core, Aalto University School of Science Espoo, Finland ; Clinical Neurosciences, Neurology, University of Helsinki and Helsinki University Hospital Finland
| | - Harri Piitulainen
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science Espoo, Finland ; Aalto NeuroImaging, MEG-Core, Aalto University School of Science Espoo, Finland
| | - Lauri Parkkonen
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science Espoo, Finland ; Aalto NeuroImaging, MEG-Core, Aalto University School of Science Espoo, Finland
| | - Nina Forss
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science Espoo, Finland ; Aalto NeuroImaging, MEG-Core, Aalto University School of Science Espoo, Finland ; Clinical Neurosciences, Neurology, University of Helsinki and Helsinki University Hospital Finland
| |
Collapse
|
39
|
Kauppi JP, Kandemir M, Saarinen VM, Hirvenkari L, Parkkonen L, Klami A, Hari R, Kaski S. Towards brain-activity-controlled information retrieval: Decoding image relevance from MEG signals. Neuroimage 2015; 112:288-298. [PMID: 25595505 DOI: 10.1016/j.neuroimage.2014.12.079] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2014] [Revised: 11/25/2014] [Accepted: 12/31/2014] [Indexed: 10/24/2022] Open
Abstract
We hypothesize that brain activity can be used to control future information retrieval systems. To this end, we conducted a feasibility study on predicting the relevance of visual objects from brain activity. We analyze both magnetoencephalographic (MEG) and gaze signals from nine subjects who were viewing image collages, a subset of which was relevant to a predetermined task. We report three findings: i) the relevance of an image a subject looks at can be decoded from MEG signals with performance significantly better than chance, ii) fusion of gaze-based and MEG-based classifiers significantly improves the prediction performance compared to using either signal alone, and iii) non-linear classification of the MEG signals using Gaussian process classifiers outperforms linear classification. These findings break new ground for building brain-activity-based interactive image retrieval systems, as well as for systems utilizing feedback both from brain activity and eye movements.
Collapse
Affiliation(s)
- Jukka-Pekka Kauppi
- Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland; Helsinki Institute for Information Technology HIIT, Department of Computer Science, University of Helsinki, Helsinki, Finland.
| | - Melih Kandemir
- Heidelberg University HCI/IWR, Heidelberg, Germany; Helsinki Institute for Information Technology HIIT, Department of Computer Science, Aalto University, Espoo, Finland.
| | - Veli-Matti Saarinen
- Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland.
| | - Lotta Hirvenkari
- Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland.
| | - Lauri Parkkonen
- Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland; MEG Core, Aalto NeuroImaging, Aalto University, Espoo, Finland.
| | - Arto Klami
- Helsinki Institute for Information Technology HIIT, Department of Computer Science, University of Helsinki, Helsinki, Finland.
| | - Riitta Hari
- Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland; MEG Core, Aalto NeuroImaging, Aalto University, Espoo, Finland.
| | - Samuel Kaski
- Helsinki Institute for Information Technology HIIT, Department of Computer Science, University of Helsinki, Helsinki, Finland; Helsinki Institute for Information Technology HIIT, Department of Computer Science, Aalto University, Espoo, Finland.
| |
Collapse
|
40
|
Parkkonen E, Laaksonen K, Parkkonen L, Forss N. P528: Modulation of the 20-Hz motor cortex rhythm to passive movement and tactile stimulation. Clin Neurophysiol 2014. [DOI: 10.1016/s1388-2457(14)50626-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
41
|
Gramfort A, Luessi M, Larson E, Engemann DA, Strohmeier D, Brodbeck C, Goj R, Jas M, Brooks T, Parkkonen L, Hämäläinen M. MEG and EEG data analysis with MNE-Python. Front Neurosci 2013; 7:267. [PMID: 24431986 PMCID: PMC3872725 DOI: 10.3389/fnins.2013.00267] [Citation(s) in RCA: 1062] [Impact Index Per Article: 96.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2013] [Accepted: 12/09/2013] [Indexed: 11/22/2022] Open
Abstract
Magnetoencephalography and electroencephalography (M/EEG) measure the weak electromagnetic signals generated by neuronal activity in the brain. Using these signals to characterize and locate neural activation in the brain is a challenge that requires expertise in physics, signal processing, statistics, and numerical methods. As part of the MNE software suite, MNE-Python is an open-source software package that addresses this challenge by providing state-of-the-art algorithms implemented in Python that cover multiple methods of data preprocessing, source localization, statistical analysis, and estimation of functional connectivity between distributed brain regions. All algorithms and utility functions are implemented in a consistent manner with well-documented interfaces, enabling users to create M/EEG data analysis pipelines by writing Python scripts. Moreover, MNE-Python is tightly integrated with the core Python libraries for scientific comptutation (NumPy, SciPy) and visualization (matplotlib and Mayavi), as well as the greater neuroimaging ecosystem in Python via the Nibabel package. The code is provided under the new BSD license allowing code reuse, even in commercial products. Although MNE-Python has only been under heavy development for a couple of years, it has rapidly evolved with expanded analysis capabilities and pedagogical tutorials because multiple labs have collaborated during code development to help share best practices. MNE-Python also gives easy access to preprocessed datasets, helping users to get started quickly and facilitating reproducibility of methods by other researchers. Full documentation, including dozens of examples, is available at http://martinos.org/mne.
Collapse
Affiliation(s)
- Alexandre Gramfort
- Institut Mines-Telecom, Telecom ParisTech, CNRS LTCI Paris, France ; Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, and Harvard Medical School Charlestown MA, USA ; NeuroSpin, CEA Saclay Gif-sur-Yvette, France
| | - Martin Luessi
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, and Harvard Medical School Charlestown MA, USA
| | - Eric Larson
- Institute for Learning and Brain Sciences, University of Washington Seattle WA, USA
| | - Denis A Engemann
- Institute of Neuroscience and Medicine - Cognitive Neuroscience (INM-3) Forschungszentrum Juelich, Germany ; Brain Imaging Lab, Department of Psychiatry, University Hospital Cologne, Germany
| | - Daniel Strohmeier
- Institute of Biomedical Engineering and Informatics, Ilmenau University of Technology Ilmenau, Germany
| | | | - Roman Goj
- Psychological Imaging Laboratory, Psychology, School of Natural Sciences, University of Stirling Stirling, UK
| | - Mainak Jas
- Department of Biomedical Engineering and Computational Science, Aalto University School of Science Espoo, Finland ; Brain Research Unit, O.V. Lounasmaa Laboratory, Aalto University School of Science Espoo, Finland
| | - Teon Brooks
- Department of Psychology, New York University New York, NY, USA
| | - Lauri Parkkonen
- Department of Biomedical Engineering and Computational Science, Aalto University School of Science Espoo, Finland ; Brain Research Unit, O.V. Lounasmaa Laboratory, Aalto University School of Science Espoo, Finland
| | - Matti Hämäläinen
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, and Harvard Medical School Charlestown MA, USA ; Brain Research Unit, O.V. Lounasmaa Laboratory, Aalto University School of Science Espoo, Finland
| |
Collapse
|
42
|
Kauppi JP, Parkkonen L, Hari R, Hyvärinen A. Decoding magnetoencephalographic rhythmic activity using spectrospatial information. Neuroimage 2013; 83:921-36. [DOI: 10.1016/j.neuroimage.2013.07.026] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2013] [Revised: 06/29/2013] [Accepted: 07/05/2013] [Indexed: 10/26/2022] Open
|
43
|
Ora H, Takano K, Kawase T, Iwaki S, Parkkonen L, Kansaku K. Implementation of a beam forming technique in real-time magnetoencephalography. J Integr Neurosci 2013; 12:331-41. [PMID: 24070057 DOI: 10.1142/s0219635213500192] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
Abstract
Real-time magnetoencephalography (rtMEG) is an emerging neurofeedback technology that could potentially benefit multiple areas of basic and clinical neuroscience. In the present study, we implemented voxel-based real-time coherence measurements in a rtMEG system in which we employed a beamformer to localize signal sources in the anatomical space prior to computing imaginary coherence. Our rtMEG experiment showed that a healthy subject could increase coherence between the parietal cortex and visual cortex when attending to a flickering visual stimulus. This finding suggests that our system is suitable for neurofeedback training and can be useful for practical brain-machine interface applications or neurofeedback rehabilitation.
Collapse
Affiliation(s)
- Hiroki Ora
- Systems Neuroscience Section, Department of Rehabilitation for Brain Functions, Research Institute of National Rehabilitation Center for Persons with Disabilities, Tokorozawa 359-8555, Japan , Department of Computational Intelligence and Systems Science, Tokyo Institute of Technology, Yokohama 226-8503, Japan
| | | | | | | | | | | |
Collapse
|
44
|
Molinaro N, Barber HA, Pérez A, Parkkonen L, Carreiras M. Left fronto-temporal dynamics during agreement processing: Evidence for feature-specific computations. Neuroimage 2013; 78:339-52. [DOI: 10.1016/j.neuroimage.2013.04.025] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2013] [Revised: 03/18/2013] [Accepted: 04/10/2013] [Indexed: 11/28/2022] Open
|
45
|
Campi C, Parkkonen L, Hari R, Hyvärinen A. Non-linear canonical correlation for joint analysis of MEG signals from two subjects. Front Neurosci 2013; 7:107. [PMID: 23785311 PMCID: PMC3682120 DOI: 10.3389/fnins.2013.00107] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2013] [Accepted: 05/25/2013] [Indexed: 11/13/2022] Open
Abstract
Traditional stimulus-based analysis methods of magnetoencephalography (MEG) data are often dissatisfactory when applied to naturalistic experiments where two or more subjects are measured either simultaneously or sequentially. To uncover the commonalities in the brain activity of the two subjects, we propose a method that searches for linear transformations that output maximally correlated signals between the two brains. Our method is based on canonical correlation analysis (CCA), which provides linear transformations, one for each subject, such that the temporal correlation between the transformed MEG signals is maximized. Here, we present a non-linear version of CCA which measures the correlation of energies and allows for a variable delay between the time series to accommodate, e.g., leader-follower changes. We test the method with simulations and with MEG data from subjects who received the same naturalistic stimulus sequence. The method may help analyse future experiments where the two subjects are measured simultaneously while engaged in social interaction.
Collapse
Affiliation(s)
- Cristina Campi
- Department of Computer Science/HIIT, University of Helsinki Helsinki, Finland ; CNR-SPIN Genova, Italy
| | | | | | | |
Collapse
|
46
|
Hsu YC, Vesanen PT, Nieminen JO, Zevenhoven KCJ, Dabek J, Parkkonen L, Chern IL, Ilmoniemi RJ, Lin FH. Efficient concomitant and remanence field artifact reduction in ultra-low-field MRI using a frequency-space formulation. Magn Reson Med 2013; 71:955-65. [PMID: 23670955 DOI: 10.1002/mrm.24745] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
PURPOSE For ultra-low-field MRI, the spatial-encoding magnetic fields generated by gradient coils can have strong concomitant fields leading to prominent image distortion. Additionally, using superconducting magnet to pre-polarize magnetization can improve the signal-to-noise ratio of ultra-low-field MRI. Yet the spatially inhomogeneous remanence field due to the permanently trapped flux inside a superconducting pre-polarizing coil modulates magnetization and causes further image distortion. METHOD We propose a two-stage frequency-space (f-x) formulation to accurately describe the dynamics of spatially-encoded magnetization under the influence of concomitant and remanence fields, which allows for correcting image distortion due to concomitant and remanence fields. RESULTS Our method is computationally efficient as it uses a combination of the fast Fourier transform algorithm and a linear equation solver. With sufficiently dense discretization in solving the linear equation, the performance of this f-x method was found to be stable among different choices of the regularization parameter and the regularization matrix. CONCLUSION We present this method together with numerical simulations and experimental data to demonstrate how concomitant and remanence field artifacts in ultra-low-field MRI can be corrected efficiently.
Collapse
Affiliation(s)
- Yi-Cheng Hsu
- Department of Mathematics, National Taiwan University, Taipei, Taiwan; Department of Biomedical Engineering and Computational Science, Aalto University School of Science, Espoo, Finland
| | | | | | | | | | | | | | | | | |
Collapse
|
47
|
Laaksonen K, Helle L, Parkkonen L, Kirveskari E, Mäkelä JP, Mustanoja S, Tatlisumak T, Kaste M, Forss N. Alterations in spontaneous brain oscillations during stroke recovery. PLoS One 2013; 8:e61146. [PMID: 23593414 PMCID: PMC3623808 DOI: 10.1371/journal.pone.0061146] [Citation(s) in RCA: 37] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2012] [Accepted: 03/07/2013] [Indexed: 11/18/2022] Open
Abstract
Amplitude or frequency alterations of spontaneous brain oscillations may reveal pathological phenomena in the brain or predict recovery from brain lesions, but the temporal evolution and the functional significance of these changes is not well known. We performed follow-up recordings of spontaneous brain oscillations with whole-head MEG in 16 patients with first-ever stroke in the middle cerebral artery territory, affecting upper limb motor function, 1-7 days (T0), 1 month (T1), and 3 months (T2) after stroke, with concomitant clinical examination. Clinical test results improved significantly from T0 to T1 or T2. During recovery (at T1 and T2), the strength of temporo-parietal ≈ 10-Hz oscillations in the affected hemisphere (AH) was increased as compared with the unaffected hemisphere. Abnormal low-frequency magnetic activity (ALFMA) at ≈ 1 Hz in the AH was detected in the perilesional cortex in seven patients at T0. In four of these, ALFMA persisted at T2. In patients with ALFMA, the lesion size was significantly larger than in the rest of the patients, and worse clinical outcome was observed in patients with persisting ALFMA. Our results indicate that temporo-parietal ≈ 10-Hz oscillations are enhanced in the AH during recovery from stroke. Moreover, stroke causes ALFMA, which seems to persist in patients with worse clinical outcome.
Collapse
Affiliation(s)
- Kristina Laaksonen
- Brain Research Unit, O.V. Lounasmaa Laboratory and MEG Core, Aalto Neuroimaging, Aalto University, Aalto, Espoo, Finland.
| | | | | | | | | | | | | | | | | |
Collapse
|
48
|
Hari R, Himberg T, Nummenmaa L, Hämäläinen M, Parkkonen L. Synchrony of brains and bodies during implicit interpersonal interaction. Trends Cogn Sci 2013; 17:105-6. [PMID: 23384658 DOI: 10.1016/j.tics.2013.01.003] [Citation(s) in RCA: 50] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2013] [Accepted: 01/23/2013] [Indexed: 11/24/2022]
Abstract
To successfully interact with others, people automatically mimic their actions and feelings. Yet, neurobehavioral studies of interaction are few because of lacking conceptual and experimental frameworks. A recent study introduced an elegantly simple motor task to unravel implicit interpersonal behavioral synchrony and brain function during face-to-face interaction.
Collapse
Affiliation(s)
- Riitta Hari
- Brain Research Unit, O.V. Lounasmaa Laboratory, Aalto University, Espoo, Finland.
| | | | | | | | | |
Collapse
|
49
|
Gross J, Baillet S, Barnes GR, Henson RN, Hillebrand A, Jensen O, Jerbi K, Litvak V, Maess B, Oostenveld R, Parkkonen L, Taylor JR, van Wassenhove V, Wibral M, Schoffelen JM. Good practice for conducting and reporting MEG research. Neuroimage 2013; 65:349-63. [PMID: 23046981 PMCID: PMC3925794 DOI: 10.1016/j.neuroimage.2012.10.001] [Citation(s) in RCA: 414] [Impact Index Per Article: 37.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2012] [Revised: 08/23/2012] [Accepted: 10/01/2012] [Indexed: 11/20/2022] Open
Abstract
Magnetoencephalographic (MEG) recordings are a rich source of information about the neural dynamics underlying cognitive processes in the brain, with excellent temporal and good spatial resolution. In recent years there have been considerable advances in MEG hardware developments and methods. Sophisticated analysis techniques are now routinely applied and continuously improved, leading to fascinating insights into the intricate dynamics of neural processes. However, the rapidly increasing level of complexity of the different steps in a MEG study make it difficult for novices, and sometimes even for experts, to stay aware of possible limitations and caveats. Furthermore, the complexity of MEG data acquisition and data analysis requires special attention when describing MEG studies in publications, in order to facilitate interpretation and reproduction of the results. This manuscript aims at making recommendations for a number of important data acquisition and data analysis steps and suggests details that should be specified in manuscripts reporting MEG studies. These recommendations will hopefully serve as guidelines that help to strengthen the position of the MEG research community within the field of neuroscience, and may foster discussion in order to further enhance the quality and impact of MEG research.
Collapse
Affiliation(s)
- Joachim Gross
- Centre for Cognitive Neuroimaging, University of Glasgow, Glasgow, UK.
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
50
|
Abstract
The auditory octave illusion arises when dichotically presented tones, one octave apart, alternate rapidly between the ears. Most subjects perceive an illusory sequence of monaural tones: A high tone in the right ear (RE) alternates with a low tone, incorrectly localized to the left ear (LE). Behavioral studies suggest that the perceived pitch follows the RE input, and the perceived location the higher-frequency sound. To explore the link between the perceived pitches and brain-level interactions of dichotic tones, magnetoencephalographic responses were recorded to 4 binaural combinations of 2-min long continuous 400- and 800-Hz tones and to 4 monaural tones. Responses to LE and RE inputs were distinguished by frequency-tagging the ear-specific stimuli at different modulation frequencies. During dichotic presentation, ipsilateral LE tones elicited weaker and ipsilateral RE tones stronger responses than when both ears received the same tone. During the most paradoxical stimulus-high tone to LE and low tone to RE perceived as a low tone in LE during the illusion-also the contralateral responses to LE tones were diminished. The results demonstrate modified binaural interaction of dichotic tones one octave apart, suggesting that this interaction contributes to pitch perception during the octave illusion.
Collapse
Affiliation(s)
- Satu Lamminmäki
- Brain Research Unit, O.V. Lounasmaa Laboratory, School of Science, Aalto University, P.O. Box 15100, FI-00076 AALTO, Espoo, Finland.
| | | | | | | |
Collapse
|