Measuring the cortical tracking of speech with optically-pumped magnetometers

Neural Decoding of Spontaneous Overt and Intended Speech

PURPOSE

The aim of this study was to decode intended and overt speech from neuromagnetic signals while the participants performed spontaneous overt speech tasks without cues or prompts (stimuli).

METHOD

Magnetoencephalography (MEG), a noninvasive neuroimaging technique, was used to collect neural signals from seven healthy adult English speakers performing spontaneous, overt speech tasks. The participants randomly spoke the words yes or no at a self-paced rate without cues. Two machine learning models, namely, linear discriminant analysis (LDA) and one-dimensional convolutional neural network (1D CNN), were employed to classify the two words from the recorded MEG signals.

RESULTS

LDA and 1D CNN achieved average decoding accuracies of 79.02% and 90.40%, respectively, in decoding overt speech, significantly surpassing the chance level (50%). The accuracy for decoding intended speech was 67.19% using 1D CNN.

CONCLUSIONS

This study showcases the possibility of decoding spontaneous overt and intended speech directly from neural signals in the absence of perceptual interference. We believe that these findings make a steady step toward the future spontaneous speech-based brain-computer interface.

Decoding N400m Evoked Component: A Tutorial on Multivariate Pattern Analysis for OP-MEG Data

Multivariate pattern analysis (MVPA) has played an extensive role in interpreting brain activity, which has been applied in studies with modalities such as functional Magnetic Resonance Imaging (fMRI), Magnetoencephalography (MEG) and Electroencephalography (EEG). The advent of wearable MEG systems based on optically pumped magnetometers (OPMs), i.e., OP-MEG, has broadened the application of bio-magnetism in the realm of neuroscience. Nonetheless, it also raises challenges in temporal decoding analysis due to the unique attributes of OP-MEG itself. The efficacy of decoding performance utilizing multimodal fusion, such as MEG-EEG, also remains to be elucidated. In this regard, we investigated the impact of several factors, such as processing methods, models and modalities, on the decoding outcomes of OP-MEG. Our findings indicate that the number of averaged trials, dimensionality reduction (DR) methods, and the number of cross-validation folds significantly affect the decoding performance of OP-MEG data. Additionally, decoding results vary across modalities and fusion strategy. In contrast, decoder type, resampling frequency, and sliding window length exert marginal effects. Furthermore, we introduced mutual information (MI) to investigate how information loss due to OP-MEG data processing affect decoding accuracy. Our study offers insights for linear decoding research using OP-MEG and expand its application in the fields of cognitive neuroscience.

Mapping brain function in adults and young children during naturalistic viewing with high-density diffuse optical tomography

Human studies of early brain development have been limited by extant neuroimaging methods. MRI scanners present logistical challenges for imaging young children, while alternative modalities like functional near-infrared spectroscopy have traditionally been limited by image quality due to sparse sampling. In addition, conventional tasks for brain mapping elicit low task engagement, high head motion, and considerable participant attrition in pediatric populations. As a result, typical and atypical developmental trajectories of processes such as language acquisition remain understudied during sensitive periods over the first years of life. We evaluate high-density diffuse optical tomography (HD-DOT) imaging combined with movie stimuli for high resolution optical neuroimaging in awake children ranging from 1 to 7 years of age. We built an HD-DOT system with design features geared towards enhancing both image quality and child comfort. Furthermore, we characterized a library of animated movie clips as a stimulus set for brain mapping and we optimized associated data analysis pipelines. Together, these tools could map cortical responses to movies and contained features such as speech in both adults and awake young children. This study lays the groundwork for future research to investigate response variability in larger pediatric samples and atypical trajectories of early brain development in clinical populations.

Discrimination of finger movements by magnetomyography with optically pumped magnetometers

Optically pumped magnetometers (OPM) are quantum sensors that offer new possibilities to measure biomagnetic signals. Compared to the current standard surface electromyography (EMG), in magnetomyography (MMG), OPM sensors offer the advantage of contactless measurements of muscle activity. However, little is known about the relative performance of OPM-MMG and EMG, e.g. in their ability to detect and classify finger movements. To address this in a proof-of-principle study, we recorded simultaneous OPM-MMG and EMG of finger flexor muscles for the discrimination of individual finger movements on a single human participant. Using a deep learning model for movement classification, we found that both sensor modalities were able to discriminate finger movements with above 89% accuracy. Furthermore, model predictions for the two sensor modalities showed high agreement in movement detection (85% agreement; Cohen's kappa: 0.45). Our findings show that OPM sensors can be employed for contactless discrimination of finger movements and incentivize future applications of OPM in magnetomyography.

Measurement of Frontal Midline Theta Oscillations using OPM-MEG

Optically pumped magnetometers (OPMs) are an emerging lightweight and compact sensor that can measure magnetic fields generated by the human brain. OPMs enable construction of wearable magnetoencephalography (MEG) systems, which offer advantages over conventional instrumentation. However, when trying to measure signals at low frequency, higher levels of inherent sensor noise, magnetic interference and movement artefact introduce a significant challenge. Accurate characterisation of low frequency brain signals is important for neuroscientific, clinical, and paediatric MEG applications and consequently, demonstrating the viability of OPMs in this area is critical. Here, we undertake measurement of theta band (4-8 Hz) neural oscillations and contrast a newly developed 174 channel triaxial wearable OPM-MEG system with conventional (cryogenic-MEG) instrumentation. Our results show that visual steady state responses at 4 Hz, 6 Hz and 8 Hz can be recorded using OPM-MEG with a signal-to-noise ratio (SNR) that is not significantly different to conventional MEG. Moreover, we measure frontal midline theta oscillations during a 2-back working memory task, again demonstrating comparable SNR for both systems. We show that individual differences in both the amplitude and spatial signature of induced frontal-midline theta responses are maintained across systems. Finally, we show that our OPM-MEG results could not have been achieved without a triaxial sensor array, or the use of postprocessing techniques. Our results demonstrate the viability of OPMs for characterising theta oscillations and add weight to the argument that OPMs can replace cryogenic sensors as the fundamental building block of MEG systems.

Quantum enabled functional neuroimaging: the why and how of magnetoencephalography using optically pumped magnetometers

Non-invasive imaging has transformed neuroscientific discovery and clinical practice, providing a non-invasive window into the human brain. However, whilst techniques like MRI generate ever more precise images of brain structure, in many cases, it's the function within neural networks that underlies disease. Here, we review the potential for quantum-enabled magnetic field sensors to shed light on such activity. Specifically, we describe how optically pumped magnetometers (OPMs) enable magnetoencephalographic (MEG) recordings with higher accuracy and improved practicality compared to the current state-of-the-art. The paper is split into two parts: first, we describe the work to date on OPM-MEG, detailing why this novel biomagnetic imaging technique is proving disruptive. Second, we explain how fundamental physics, including quantum mechanics and electromagnetism, underpins this developing technology. We conclude with a look to the future, outlining the potential for OPM-MEG to initiate a step change in the understanding and management of brain health.

Non-invasive measurements of ictal and interictal epileptiform activity using optically pumped magnetometers

Magneto- and electroencephalography (MEG/EEG) are important techniques for the diagnosis and pre-surgical evaluation of epilepsy. Yet, in current cryogen-based MEG systems the sensors are offset from the scalp, which limits the signal-to-noise ratio (SNR) and thereby the sensitivity to activity from deep structures such as the hippocampus. This effect is amplified in children, for whom adult-sized fixed-helmet systems are typically too big. Moreover, ictal recordings with fixed-helmet systems are problematic because of limited movement tolerance and/or logistical considerations. Optically Pumped Magnetometers (OPMs) can be placed directly on the scalp, thereby improving SNR and enabling recordings during seizures. We aimed to demonstrate the performance of OPMs in a clinical population. Seven patients with challenging cases of epilepsy underwent MEG recordings using a 12-channel OPM-system and a 306-channel cryogen-based whole-head system: three adults with known deep or weak (low SNR) sources of interictal epileptiform discharges (IEDs), along with three children with focal epilepsy and one adult with frequent seizures. The consistency of the recorded IEDs across the two systems was assessed. In one patient the OPMs detected IEDs that were not found with the SQUID-system, and in two patients no IEDs were found with either system. For the other patients the OPM data were remarkably consistent with the data from the cryogenic system, noting that these were recorded in different sessions, with comparable SNRs and IED-yields overall. Importantly, the wearability of OPMs enabled the recording of seizure activity in a patient with hyperkinetic movements during the seizure. The observed ictal onset and semiology were in agreement with previous video- and stereo-EEG recordings. The relatively affordable technology, in combination with reduced running and maintenance costs, means that OPM-based MEG could be used more widely than current MEG systems, and may become an affordable alternative to scalp EEG, with the potential benefits of increased spatial accuracy, reduced sensitivity to volume conduction/field spread, and increased sensitivity to deep sources. Wearable MEG thus provides an unprecedented opportunity for epilepsy, and given its patient-friendliness, we envisage that it will not only be used for presurgical evaluation of epilepsy patients, but also for diagnosis after a first seizure.

Cortical tracking of lexical speech units in a multi-talker background is immature in school-aged children

Children have more difficulty perceiving speech in noise than adults. Whether this difficulty relates to an immature processing of prosodic or linguistic elements of the attended speech is still unclear. To address the impact of noise on linguistic processing per se, we assessed how babble noise impacts the cortical tracking of intelligible speech devoid of prosody in school-aged children and adults. Twenty adults and twenty children (7-9 years) listened to synthesized French monosyllabic words presented at 2.5 Hz, either randomly or in 4-word hierarchical structures wherein 2 words formed a phrase at 1.25 Hz, and 2 phrases formed a sentence at 0.625 Hz, with or without babble noise. Neuromagnetic responses to words, phrases and sentences were identified and source-localized. Children and adults displayed significant cortical tracking of words in all conditions, and of phrases and sentences only when words formed meaningful sentences. In children compared with adults, the cortical tracking was lower for all linguistic units in conditions without noise. In the presence of noise, the cortical tracking was similarly reduced for sentence units in both groups, but remained stable for phrase units. Critically, when there was noise, adults increased the cortical tracking of monosyllabic words in the inferior frontal gyri and supratemporal auditory cortices but children did not. This study demonstrates that the difficulties of school-aged children in understanding speech in a multi-talker background might be partly due to an immature tracking of lexical but not supra-lexical linguistic units.

Detection of the 40 Hz auditory steady-state response with optically pumped magnetometers

Magnetoencephalography (MEG) is a functional neuroimaging technique that noninvasively detects the brain magnetic field from neuronal activations. Conventional MEG measures brain signals using superconducting quantum interference devices (SQUIDs). SQUID-MEG requires a cryogenic environment involving a bulky non-magnetic Dewar flask and the consumption of liquid helium, which restricts the variability of the sensor array and the gap between the cortical sources and sensors. Recently, miniature optically pumped magnetometers (OPMs) have been developed and commercialized. OPMs do not require cryogenic cooling and can be placed within millimeters from the scalp. In the present study, we arranged six OPM sensors on the temporal area to detect auditory-related brain responses in a two-layer magnetically shielded room. We presented the auditory stimuli of 1 kHz pure-tone bursts with 200 ms duration and obtained the M50 and M100 components of auditory-evoked fields. We delivered the periodic stimuli with a 40 Hz repetition rate and observed the gamma-band power changes and inter-trial phase coherence of auditory steady-state responses at 40 Hz. We found that the OPM sensors have a performance comparable to that of conventional SQUID-MEG sensors, and our results suggest the feasibility of using OPM sensors for functional neuroimaging and brain-computer interface applications.

Magnetoencephalography with optically pumped magnetometers (OPM-MEG): the next generation of functional neuroimaging

Magnetoencephalography (MEG) measures human brain function via assessment of the magnetic fields generated by electrical activity in neurons. Despite providing high-quality spatiotemporal maps of electrophysiological activity, current MEG instrumentation is limited by cumbersome field sensing technologies, resulting in major barriers to utility. Here, we review a new generation of MEG technology that is beginning to lift many of these barriers. By exploiting quantum sensors, known as optically pumped magnetometers (OPMs), 'OPM-MEG' has the potential to dramatically outperform the current state of the art, promising enhanced data quality (better sensitivity and spatial resolution), adaptability to any head size/shape (from babies to adults), motion robustness (participants can move freely during scanning), and a less complex imaging platform (without reliance on cryogenics). We discuss the current state of this emerging technique and describe its far-reaching implications for neuroscience.

Interference suppression techniques for OPM-based MEG: Opportunities and challenges

One of the primary technical challenges facing magnetoencephalography (MEG) is that the magnitude of neuromagnetic fields is several orders of magnitude lower than interfering signals. Recently, a new type of sensor has been developed - the optically pumped magnetometer (OPM). These sensors can be placed directly on the scalp and move with the head during participant movement, making them wearable. This opens up a range of exciting experimental and clinical opportunities for OPM-based MEG experiments, including paediatric studies, and the incorporation of naturalistic movements into neuroimaging paradigms. However, OPMs face some unique challenges in terms of interference suppression, especially in situations involving mobile participants, and when OPMs are integrated with electrical equipment required for naturalistic paradigms, such as motion capture systems. Here we briefly review various hardware solutions for OPM interference suppression. We then outline several signal processing strategies aimed at increasing the signal from neuromagnetic sources. These include regression-based strategies, temporal filtering and spatial filtering approaches. The focus is on the practical application of these signal processing algorithms to OPM data. In a similar vein, we include two worked-through experiments using OPM data collected from a whole-head sensor array. These tutorial-style examples illustrate how the steps for suppressing external interference can be implemented, including the associated data and code so that researchers can try the pipelines for themselves. With the popularity of OPM-based MEG rising, there will be an increasing need to deal with interference suppression. We hope this practical paper provides a resource for OPM-based MEG researchers to build upon.

Gratifying Gizmos for Research and Clinical MEG

Experimental designs are of utmost importance in neuroimaging. Experimental repertoire needs to be designed with the understanding of physiology, clinical feasibility, and constraints posed by a particular neuroimaging method. Innovations in introducing natural, ecologically-relevant stimuli, with successful collaboration across disciplines, correct timing, and a bit of luck may cultivate novel experiments, new discoveries, and open pathways to new clinical practices. Here I introduce some gizmos that I have initiated in magnetoencephalography (MEG) and applied with my collaborators in my home laboratory and in several other laboratories. These gizmos have been applied to address neuronal correlates of audiotactile interactions, tactile sense, active and passive movements, speech processing, and intermittent photic stimulation (IPS) in humans. This review also includes additional notes on the ideas behind the gizmos, their evolution, and results obtained.