Predictability modulates motor-auditory interactions in self-triggered audio-visual apparent motion

Large-scale cortical travelling waves predict localized future cortical signals

Predicting future brain signal is highly sought-after, yet difficult to achieve. To predict the future phase of cortical activity at localized ECoG and MEG recording sites, we exploit its predominant, large-scale, spatiotemporal dynamics. The dynamics are extracted from the brain signal through Fourier analysis and principal components analysis (PCA) only, and cast in a data model that predicts future signal at each site and frequency of interest. The dominant eigenvectors of the PCA that map the large-scale patterns of past cortical phase to future ones take the form of smoothly propagating waves over the entire measurement array. In ECoG data from 3 subjects and MEG data from 20 subjects collected during a self-initiated motor task, mean phase prediction errors were as low as 0.5 radians at local sites, surpassing state-of-the-art methods of within-time-series or event-related models. Prediction accuracy was highest in delta to beta bands, depending on the subject, was more accurate during episodes of high global power, but was not strongly dependent on the time-course of the task. Prediction results did not require past data from the to-be-predicted site. Rather, best accuracy depended on the availability in the model of long wavelength information. The utility of large-scale, low spatial frequency traveling waves in predicting future phase activity at local sites allows estimation of the error introduced by failing to account for irreducible trajectories in the activity dynamics.

Prediction is an important step in scientific progress, often leading to real-world applications. Prediction of future brain activity could lead to improvements in detecting driver and pilot error or real-time brain testing using transcranial magnetic stimulation. Previous studies have either supposed that the ‘noise’ level in the cortex is high, setting the prediction bar rather low; or used localized measurements to predict future activity, with modest success. A long-held but controversial hypothesis is that the cortex is best characterized as a multi-scale dynamic structure, in which the flow of activity at one scale, say, the area responsible for motor control, is inextricably tied to activity at smaller and larger scales, for example within a cortical column and the whole cortex. We test this hypothesis by analyzing large-scale traveling waves of cortical activity. Like waves arriving on a beach, the ongoing wave motion allows better prediction of future activity compared to monitoring the local rise and fall; in the best cases the future wave cycle is predicted with as low as 20° average error angle. The prediction techniques developed for the present research rely on mathematics related to quantifying large-scale weather patterns or analysis of fluid dynamics.

Interpretation of Social Interactions: Functional Imaging of Cognitive-Semiotic Categories During Naturalistic Viewing

Social interactions arise from patterns of communicative signs, whose perception and interpretation require a multitude of cognitive functions. The semiotic framework of Peirce's Universal Categories (UCs) laid ground for a novel cognitive-semiotic typology of social interactions. During functional magnetic resonance imaging (fMRI), 16 volunteers watched a movie narrative encompassing verbal and non-verbal social interactions. Three types of non-verbal interactions were coded ("unresolved," "non-habitual," and "habitual") based on a typology reflecting Peirce's UCs. As expected, the auditory cortex responded to verbal interactions, but non-verbal interactions modulated temporal areas as well. Conceivably, when speech was lacking, ambiguous visual information (unresolved interactions) primed auditory processing in contrast to learned behavioral patterns (habitual interactions). The latter recruited a parahippocampal-occipital network supporting conceptual processing and associative memory retrieval. Requesting semiotic contextualization, non-habitual interactions activated visuo-spatial and contextual rule-learning areas such as the temporo-parietal junction and right lateral prefrontal cortex. In summary, the cognitive-semiotic typology reflected distinct sensory and association networks underlying the interpretation of observed non-verbal social interactions.

Global Neuromagnetic Cortical Fields Have Non-Zero Velocity

Globally coherent patterns of phase can be obscured by analysis techniques that aggregate brain activity measures across-trials, whether prior to source localization or for estimating inter-areal coherence. We analyzed, at single-trial level, whole head MEG recorded during an observer-triggered apparent motion task. Episodes of globally coherent activity occurred in the delta, theta, alpha and beta bands of the signal in the form of large-scale waves, which propagated with a variety of velocities. Their mean speed at each frequency band was proportional to temporal frequency, giving a range of 0.06 to 4.0 m/s, from delta to beta. The wave peaks moved over the entire measurement array, during both ongoing activity and task-relevant intervals; direction of motion was more predictable during the latter. A large proportion of the cortical signal, measurable at the scalp, exists as large-scale coherent motion. We argue that the distribution of observable phase velocities in MEG is dominated by spatial filtering considerations in combination with group velocity of cortical activity. Traveling waves may index processes involved in global coordination of cortical activity.

Spatially congruent visual motion modulates activity of the primary auditory cortex

We investigated the brain responses to the transitions from the static to moving audiovisual stimuli using magnetoencephalography. The spatially congruent auditory and visual stimuli moved in the same direction whereas the incongruent stimuli moved in the opposite directions. Using dipole modeling we found that the static-to-moving transitions evoked a neural response in the primary auditory cortex bilaterally. The response started about 100 ms after the motion onset from a negative component (mvN1) and lasted during the entire interval of the stimulus motion. The mvN1 component was similar to the classical auditory N1 response to the static sound, but had smaller amplitude and later latency. The coordinates of the mvN1 and N1 dipoles in the primary auditory cortex were also similar. The amplitude of the auditory response to the moving stimuli appears to be sensitive to spatial congruency of the audiovisual motion; it was larger in the incongruent than congruent condition. This is evidence that the moving visual stimuli modulate the early sensory activity in the primary auditory cortex. Such early audiovisual integration may be specific for motion processing.