1
|
Michalareas G, Rudwan IM, Lehr C, Gessini P, Tavano A, Grabenhorst M. A scalable and robust system for audience EEG recordings. Heliyon 2023; 9:e20725. [PMID: 37876480 PMCID: PMC10590850 DOI: 10.1016/j.heliyon.2023.e20725] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2022] [Revised: 07/25/2023] [Accepted: 10/04/2023] [Indexed: 10/26/2023] Open
Abstract
The neural mechanisms that unfold when humans form a large group defined by an overarching context, such as audiences in theater or sports, are largely unknown and unexplored. This is mainly due to the lack of availability of a scalable system that can record the brain activity from a significantly large portion of such an audience simultaneously. Although the technology for such a system has been readily available for a long time, the high cost as well as the large overhead in human resources and logistic planning have prohibited the development of such a system. However, during the recent years reduction in technology costs and size have led to the emergence of low-cost, consumer-oriented EEG systems, developed primarily for recreational use. Here by combining such a low-cost EEG system with other off-the-shelve hardware and tailor-made software, we develop in the lab and test in a cinema such a scalable EEG hyper-scanning system. The system has a robust and stable performance and achieves accurate unambiguous alignment of the recorded data of the different EEG headsets. These characteristics combined with small preparation time and low-cost make it an ideal candidate for recording large portions of audiences.
Collapse
Affiliation(s)
- Georgios Michalareas
- Department of Cognitive Neuropsychology, Max Planck Institute for Empirical Aesthetics, Frankfurt, Germany
| | | | - Claudia Lehr
- Department of Cognitive Neuropsychology, Max Planck Institute for Empirical Aesthetics, Frankfurt, Germany
| | - Paolo Gessini
- Department of Aerospace Engineering, University of Brasilia, Brazil
| | - Alessandro Tavano
- Department of Cognitive Neuropsychology, Max Planck Institute for Empirical Aesthetics, Frankfurt, Germany
| | - Matthias Grabenhorst
- Department of Cognitive Neuropsychology, Max Planck Institute for Empirical Aesthetics, Frankfurt, Germany
- Ernst Strüngmann Institute (ESI) for Neuroscience, Frankfurt, Germany
| |
Collapse
|
2
|
Michalareas G, Kusnir F, Thut G, Gross J. The timing of cortical activation in associator grapheme-colour synaesthetes using MEG. Neuropsychologia 2023; 181:108491. [PMID: 36707026 DOI: 10.1016/j.neuropsychologia.2023.108491] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2022] [Revised: 01/17/2023] [Accepted: 01/20/2023] [Indexed: 01/26/2023]
Abstract
Grapheme-colour synaesthetes experience an anomalous form of perception in which graphemes systematically induce specific colour concurrents in their mind's eye ("associator" type). Although grapheme-colour synaesthesia has been well characterised behaviourally, its neural mechanisms remain largely unresolved. There are currently several competing models, which can primarily be distinguished according to the anatomical and temporal predictions of synaesthesia-inducing neural activity. The first main model (Cross-Activation/Cascaded Cross-Tuning and its variants) posits early recruitment of occipital colour areas in the initial feed-forward sweep of brain activity. The second (Disinhibited Feedback) posits: (i) later involvement of a multisensory convergence zone (for example, in parietal cortices) after graphemes have been processed in their entirety; and (ii) subsequent feedback to early visual areas (i.e., occipital colour areas). In this study, we examine both the timing and anatomical correlates of associator grapheme-colour synaesthetes (n = 6) using MEG. Using innovative and unbiased analysis methods with little a priori assumptions, we applied Independent Component Analysis (ICA) on a single-subject level to identify the dominant patterns of activity corresponding to the induced, synaesthetic percept. We observed evoked activity that significantly dissociates between synaesthesia-inducing and non-inducing graphemes at approximately 190 ms following grapheme presentation. This effect is present in grapheme-colour synaesthetes, but not in matched controls, and exhibits an occipito-parietal topology localised consistently within individuals to extrastriate visual cortices and superior parietal lobes. Due to the observed timing of this evoked activity and its localization, our results support a model predicting relatively late synaesthesia-inducing activity, more akin to the Disinhibited Feedback model.
Collapse
Affiliation(s)
- Georgios Michalareas
- Max Planck Institute for Empirical Aesthetics, Grueneburgweg 14, 60322, Frankfurt, Germany.
| | - Flor Kusnir
- Department of Psychology, The Hebrew University of Jerusalem, Israel
| | - Gregor Thut
- Centre for Cognitive Neuroimaging, Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, United Kingdom
| | - Joachim Gross
- Centre for Cognitive Neuroimaging, Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, United Kingdom; Institute for Biomagnetism and Biosignal Analysis, University of Münster, Malmedyweg, Muenster, Germany; Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Münster, Muenster, Germany
| |
Collapse
|
3
|
Rimmele JM, Sun Y, Michalareas G, Ghitza O, Poeppel D. Dynamics of Functional Networks for Syllable and Word-Level Processing. Neurobiol Lang (Camb) 2023; 4:120-144. [PMID: 37229144 PMCID: PMC10205074 DOI: 10.1162/nol_a_00089] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/18/2021] [Accepted: 11/07/2022] [Indexed: 05/27/2023]
Abstract
Speech comprehension requires the ability to temporally segment the acoustic input for higher-level linguistic analysis. Oscillation-based approaches suggest that low-frequency auditory cortex oscillations track syllable-sized acoustic information and therefore emphasize the relevance of syllabic-level acoustic processing for speech segmentation. How syllabic processing interacts with higher levels of speech processing, beyond segmentation, including the anatomical and neurophysiological characteristics of the networks involved, is debated. In two MEG experiments, we investigate lexical and sublexical word-level processing and the interactions with (acoustic) syllable processing using a frequency-tagging paradigm. Participants listened to disyllabic words presented at a rate of 4 syllables/s. Lexical content (native language), sublexical syllable-to-syllable transitions (foreign language), or mere syllabic information (pseudo-words) were presented. Two conjectures were evaluated: (i) syllable-to-syllable transitions contribute to word-level processing; and (ii) processing of words activates brain areas that interact with acoustic syllable processing. We show that syllable-to-syllable transition information compared to mere syllable information, activated a bilateral superior, middle temporal and inferior frontal network. Lexical content resulted, additionally, in increased neural activity. Evidence for an interaction of word- and acoustic syllable-level processing was inconclusive. Decreases in syllable tracking (cerebroacoustic coherence) in auditory cortex and increases in cross-frequency coupling between right superior and middle temporal and frontal areas were found when lexical content was present compared to all other conditions; however, not when conditions were compared separately. The data provide experimental insight into how subtle and sensitive syllable-to-syllable transition information for word-level processing is.
Collapse
Affiliation(s)
- Johanna M. Rimmele
- Departments of Neuroscience and Cognitive Neuropsychology, Max-Planck-Institute for Empirical Aesthetics, Frankfurt am Main, Germany
- Max Planck NYU Center for Language, Music and Emotion, Frankfurt am Main, Germany; New York, NY, USA
| | - Yue Sun
- Departments of Neuroscience and Cognitive Neuropsychology, Max-Planck-Institute for Empirical Aesthetics, Frankfurt am Main, Germany
| | - Georgios Michalareas
- Departments of Neuroscience and Cognitive Neuropsychology, Max-Planck-Institute for Empirical Aesthetics, Frankfurt am Main, Germany
| | - Oded Ghitza
- Departments of Neuroscience and Cognitive Neuropsychology, Max-Planck-Institute for Empirical Aesthetics, Frankfurt am Main, Germany
- College of Biomedical Engineering & Hearing Research Center, Boston University, Boston, MA, USA
| | - David Poeppel
- Departments of Neuroscience and Cognitive Neuropsychology, Max-Planck-Institute for Empirical Aesthetics, Frankfurt am Main, Germany
- Department of Psychology and Center for Neural Science, New York University, New York, NY, USA
- Max Planck NYU Center for Language, Music and Emotion, Frankfurt am Main, Germany; New York, NY, USA
- Ernst Strüngmann Institute for Neuroscience, Frankfurt am Main, Germany
| |
Collapse
|
4
|
Mencke I, Quiroga-Martinez DR, Omigie D, Michalareas G, Schwarzacher F, Haumann NT, Vuust P, Brattico E. Prediction under uncertainty: Dissociating sensory from cognitive expectations in highly uncertain musical contexts. Brain Res 2021; 1773:147664. [PMID: 34560052 DOI: 10.1016/j.brainres.2021.147664] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2021] [Revised: 09/16/2021] [Accepted: 09/17/2021] [Indexed: 10/20/2022]
Abstract
Predictive models in the brain rely on the continuous extraction of regularities from the environment. These models are thought to be updated by novel information, as reflected in prediction error responses such as the mismatch negativity (MMN). However, although in real life individuals often face situations in which uncertainty prevails, it remains unclear whether and how predictive models emerge in high-uncertainty contexts. Recent research suggests that uncertainty affects the magnitude of MMN responses in the context of music listening. However, musical predictions are typically studied with MMN stimulation paradigms based on Western tonal music, which are characterized by relatively high predictability. Hence, we developed an MMN paradigm to investigate how the high uncertainty of atonal music modulates predictive processes as indexed by the MMN and behavior. Using MEG in a group of 20 subjects without musical training, we demonstrate that the magnetic MMN in response to pitch, intensity, timbre, and location deviants is evoked in both tonal and atonal melodies, with no significant differences between conditions. In contrast, in a separate behavioral experiment involving 39 non-musicians, participants detected pitch deviants more accurately and rated confidence higher in the tonal than in the atonal musical context. These results indicate that contextual tonal uncertainty modulates processing stages in which conscious awareness is involved, although deviants robustly elicit low-level pre-attentive responses such as the MMN. The achievement of robust MMN responses, despite high tonal uncertainty, is relevant for future studies comparing groups of listeners' MMN responses to increasingly ecological music stimuli.
Collapse
Affiliation(s)
- Iris Mencke
- Department of Music, Max Planck Institute for Empirical Aesthetics, Grüneburgweg 14, 60322 Frankfurt/Main, Germany; Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music, Aarhus/Aalborg, Nørrebrogade 44, 8000 Aarhus C, Denmark.
| | - David Ricardo Quiroga-Martinez
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music, Aarhus/Aalborg, Nørrebrogade 44, 8000 Aarhus C, Denmark
| | - Diana Omigie
- Department of Psychology, University of London, Goldsmiths, SE14 6NW London, United Kingdom
| | - Georgios Michalareas
- Department of Neuroscience, Max Planck Institute for Empirical Aesthetics, Grüneburgweg 14, 60322 Frankfurt/Main, Germany
| | - Franz Schwarzacher
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music, Aarhus/Aalborg, Nørrebrogade 44, 8000 Aarhus C, Denmark
| | - Niels Trusbak Haumann
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music, Aarhus/Aalborg, Nørrebrogade 44, 8000 Aarhus C, Denmark
| | - Peter Vuust
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music, Aarhus/Aalborg, Nørrebrogade 44, 8000 Aarhus C, Denmark
| | - Elvira Brattico
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music, Aarhus/Aalborg, Nørrebrogade 44, 8000 Aarhus C, Denmark; Department of Education, Psychology and Communication, University of Bari Aldo Moro, Piazza Umberto I, 70121 Bari, Italy
| |
Collapse
|
5
|
Sun Y, Michalareas G, Poeppel D. The impact of phase entrainment on auditory detection is highly variable: Revisiting a key finding. Eur J Neurosci 2021; 55:3373-3390. [PMID: 34155728 DOI: 10.1111/ejn.15367] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2020] [Revised: 06/13/2021] [Accepted: 06/15/2021] [Indexed: 11/29/2022]
Abstract
Ample evidence shows that the human brain carefully tracks acoustic temporal regularities in the input, perhaps by entraining cortical neural oscillations to the rate of the stimulation. To what extent the entrained oscillatory activity influences processing of upcoming auditory events remains debated. Here, we revisit a critical finding from Hickok et al. (2015) that demonstrated a clear impact of auditory entrainment on subsequent auditory detection. Participants were asked to detect tones embedded in stationary noise, following a noise that was amplitude modulated at 3 Hz. Tonal targets occurred at various phases relative to the preceding noise modulation. The original study (N = 5) showed that the detectability of the tones (presented at near-threshold intensity) fluctuated cyclically at the same rate as the preceding noise modulation. We conducted an exact replication of the original paradigm (N = 23) and a conceptual replication using a shorter experimental procedure (N = 24). Neither experiment revealed significant entrainment effects at the group level. A restricted analysis on the subset of participants (36%) who did show the entrainment effect revealed no consistent phase alignment between detection facilitation and the preceding rhythmic modulation. Interestingly, both experiments showed group-wide presence of a non-cyclic behavioural pattern, wherein participants' detection of the tonal targets was lower at early and late time points of the target period. The two experiments highlight both the sensitivity of the task to elicit oscillatory entrainment and the striking individual variability in performance.
Collapse
Affiliation(s)
- Yue Sun
- Department of Neuroscience, Max Planck Institute for Empirical Aesthetics, Frankfurt, Germany
| | - Georgios Michalareas
- Department of Neuroscience, Max Planck Institute for Empirical Aesthetics, Frankfurt, Germany
| | - David Poeppel
- Department of Neuroscience, Max Planck Institute for Empirical Aesthetics, Frankfurt, Germany.,Department of Psychology, New York University, New York, New York, USA.,Max Planck-NYU Center for Language, Music, and Emotion (CLaME), New York, New York, USA.,Ernst Strüngmann Institute for Neuroscience, Frankfurt, Germany
| |
Collapse
|
6
|
Dikker S, Michalareas G, Oostrik M, Serafimaki A, Kahraman HM, Struiksma ME, Poeppel D. Crowdsourcing neuroscience: Inter-brain coupling during face-to-face interactions outside the laboratory. Neuroimage 2020; 227:117436. [PMID: 33039619 DOI: 10.1016/j.neuroimage.2020.117436] [Citation(s) in RCA: 47] [Impact Index Per Article: 11.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2019] [Revised: 09/23/2020] [Accepted: 10/01/2020] [Indexed: 12/24/2022] Open
Abstract
When we feel connected or engaged during social behavior, are our brains in fact "in sync" in a formal, quantifiable sense? Most studies addressing this question use highly controlled tasks with homogenous subject pools. In an effort to take a more naturalistic approach, we collaborated with art institutions to crowdsource neuroscience data: Over the course of 5 years, we collected electroencephalogram (EEG) data from thousands of museum and festival visitors who volunteered to engage in a 10-min face-to-face interaction. Pairs of participants with various levels of familiarity sat inside the Mutual Wave Machine-an artistic neurofeedback installation that translates real-time correlations of each pair's EEG activity into light patterns. Because such inter-participant EEG correlations are prone to noise contamination, in subsequent offline analyses we computed inter-brain coupling using Imaginary Coherence and Projected Power Correlations, two synchrony metrics that are largely immune to instantaneous, noise-driven correlations. When applying these methods to two subsets of recorded data with the most consistent protocols, we found that pairs' trait empathy, social closeness, engagement, and social behavior (joint action and eye contact) consistently predicted the extent to which their brain activity became synchronized, most prominently in low alpha (~7-10 Hz) and beta (~20-22 Hz) oscillations. These findings support an account where shared engagement and joint action drive coupled neural activity and behavior during dynamic, naturalistic social interactions. To our knowledge, this work constitutes a first demonstration that an interdisciplinary, real-world, crowdsourcing neuroscience approach may provide a promising method to collect large, rich datasets pertaining to real-life face-to-face interactions. Additionally, it is a demonstration of how the general public can participate and engage in the scientific process outside of the laboratory. Institutions such as museums, galleries, or any other organization where the public actively engages out of self-motivation, can help facilitate this type of citizen science research, and support the collection of large datasets under scientifically controlled experimental conditions. To further enhance the public interest for the out-of-the-lab experimental approach, the data and results of this study are disseminated through a website tailored to the general public (wp.nyu.edu/mutualwavemachine).
Collapse
Affiliation(s)
- Suzanne Dikker
- Max Planck - NYU Center for Language, Music and Emotion, New York, USA; Department of Psychology, New York University, New York, USA; Department of Clinical Psychology, Free University Amsterdam, Amsterdam, The Netherlands.
| | | | | | | | | | - Marijn E Struiksma
- Department of Language and Communication, Utrecht University, Utrecht, The Netherlands
| | - David Poeppel
- Max Planck - NYU Center for Language, Music and Emotion, New York, USA; Max Planck Institute for Empirical Aesthetics, Frankfurt, Germany; Department of Psychology, New York University, New York, USA
| |
Collapse
|
7
|
Abstract
Humans anticipate events signaled by sensory cues. It is commonly assumed that two uncertainty parameters modulate the brain's capacity to predict: the hazard rate (HR) of event probability and the uncertainty in time estimation which increases with elapsed time. We investigate both assumptions by presenting event probability density functions (PDFs) in each of three sensory modalities. We show that perceptual systems use the reciprocal PDF and not the HR to model event probability density. We also demonstrate that temporal uncertainty does not necessarily grow with elapsed time but can also diminish, depending on the event PDF. Previous research identified neuronal activity related to event probability in multiple levels of the cortical hierarchy (sensory (V4), association (LIP), motor and other areas) proposing the HR as an elementary neuronal computation. Our results-consistent across vision, audition, and somatosensation-suggest that the neurobiological implementation of event anticipation is based on a different, simpler and more stable computation than HR: the reciprocal PDF of events in time.
Collapse
Affiliation(s)
- Matthias Grabenhorst
- Neuroscience Department, Max-Planck-Institute for Empirical Aesthetics, Grüneburgweg 14, 60322, Frankfurt, Germany.
| | - Georgios Michalareas
- Neuroscience Department, Max-Planck-Institute for Empirical Aesthetics, Grüneburgweg 14, 60322, Frankfurt, Germany
| | - Laurence T Maloney
- Department of Psychology, Center for Neural Science, 6 Washington Place, New York, NY, 10003, USA
| | - David Poeppel
- Neuroscience Department, Max-Planck-Institute for Empirical Aesthetics, Grüneburgweg 14, 60322, Frankfurt, Germany.,Department of Psychology, Center for Neural Science, 6 Washington Place, New York, NY, 10003, USA
| |
Collapse
|
8
|
Gehrig J, Michalareas G, Forster MT, Lei J, Hok P, Laufs H, Senft C, Seifert V, Schoffelen JM, Hanslmayr S, Kell CA. Low-Frequency Oscillations Code Speech during Verbal Working Memory. J Neurosci 2019; 39:6498-6512. [PMID: 31196933 PMCID: PMC6697399 DOI: 10.1523/jneurosci.0018-19.2019] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2019] [Revised: 05/09/2019] [Accepted: 05/10/2019] [Indexed: 11/21/2022] Open
Abstract
The way the human brain represents speech in memory is still unknown. An obvious characteristic of speech is its evolvement over time. During speech processing, neural oscillations are modulated by the temporal properties of the acoustic speech signal, but also acquired knowledge on the temporal structure of language influences speech perception-related brain activity. This suggests that speech could be represented in the temporal domain, a form of representation that the brain also uses to encode autobiographic memories. Empirical evidence for such a memory code is lacking. We investigated the nature of speech memory representations using direct cortical recordings in the left perisylvian cortex during delayed sentence reproduction in female and male patients undergoing awake tumor surgery. Our results reveal that the brain endogenously represents speech in the temporal domain. Temporal pattern similarity analyses revealed that the phase of frontotemporal low-frequency oscillations, primarily in the beta range, represents sentence identity in working memory. The positive relationship between beta power during working memory and task performance suggests that working memory representations benefit from increased phase separation.SIGNIFICANCE STATEMENT Memory is an endogenous source of information based on experience. While neural oscillations encode autobiographic memories in the temporal domain, little is known on their contribution to memory representations of human speech. Our electrocortical recordings in participants who maintain sentences in memory identify the phase of left frontotemporal beta oscillations as the most prominent information carrier of sentence identity. These observations provide evidence for a theoretical model on speech memory representations and explain why interfering with beta oscillations in the left inferior frontal cortex diminishes verbal working memory capacity. The lack of sentence identity coding at the syllabic rate suggests that sentences are represented in memory in a more abstract form compared with speech coding during speech perception and production.
Collapse
Affiliation(s)
- Johannes Gehrig
- Department of Neurology, Goethe University, 60528 Frankfurt, Germany
| | | | | | - Juan Lei
- Department of Neurology, Goethe University, 60528 Frankfurt, Germany
- Institute for Cell Biology and Neuroscience, Goethe University, 60438 Frankfurt, Germany
| | - Pavel Hok
- Department of Neurology, Goethe University, 60528 Frankfurt, Germany
- Department of Neurology, Palacky University and University Hospital Olomouc, 77147 Olomouc, Czech Republic
| | - Helmut Laufs
- Department of Neurology, Goethe University, 60528 Frankfurt, Germany
- Department of Neurology, Christian-Albrechts-University, 24105 Kiel, Germany
| | - Christian Senft
- Department of Neurosurgery, Goethe University, 60528 Frankfurt, Germany
| | - Volker Seifert
- Department of Neurosurgery, Goethe University, 60528 Frankfurt, Germany
| | - Jan-Mathijs Schoffelen
- Radboud University, Donders Institute for Brain, Cognition and Behaviour, 6525 HR Nijmegen, The Netherlands, and
| | - Simon Hanslmayr
- School of Psychology at University of Birmingham, B15 2TT Birmingham, United Kingdom
| | - Christian A Kell
- Department of Neurology, Goethe University, 60528 Frankfurt, Germany,
| |
Collapse
|
9
|
Dikker S, Wan L, Davidesco I, Kaggen L, Oostrik M, McClintock J, Rowland J, Michalareas G, Van Bavel JJ, Ding M, Poeppel D. Brain-to-Brain Synchrony Tracks Real-World Dynamic Group Interactions in the Classroom. Curr Biol 2017; 27:1375-1380. [PMID: 28457867 DOI: 10.1016/j.cub.2017.04.002] [Citation(s) in RCA: 276] [Impact Index Per Article: 39.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2016] [Revised: 02/27/2017] [Accepted: 04/04/2017] [Indexed: 10/19/2022]
Abstract
The human brain has evolved for group living [1]. Yet we know so little about how it supports dynamic group interactions that the study of real-world social exchanges has been dubbed the "dark matter of social neuroscience" [2]. Recently, various studies have begun to approach this question by comparing brain responses of multiple individuals during a variety of (semi-naturalistic) tasks [3-15]. These experiments reveal how stimulus properties [13], individual differences [14], and contextual factors [15] may underpin similarities and differences in neural activity across people. However, most studies to date suffer from various limitations: they often lack direct face-to-face interaction between participants, are typically limited to dyads, do not investigate social dynamics across time, and, crucially, they rarely study social behavior under naturalistic circumstances. Here we extend such experimentation drastically, beyond dyads and beyond laboratory walls, to identify neural markers of group engagement during dynamic real-world group interactions. We used portable electroencephalogram (EEG) to simultaneously record brain activity from a class of 12 high school students over the course of a semester (11 classes) during regular classroom activities (Figures 1A-1C; Supplemental Experimental Procedures, section S1). A novel analysis technique to assess group-based neural coherence demonstrates that the extent to which brain activity is synchronized across students predicts both student class engagement and social dynamics. This suggests that brain-to-brain synchrony is a possible neural marker for dynamic social interactions, likely driven by shared attention mechanisms. This study validates a promising new method to investigate the neuroscience of group interactions in ecologically natural settings.
Collapse
Affiliation(s)
- Suzanne Dikker
- Department of Psychology, New York University, 6 Washington Place, New York, NY 10003, USA; Department of Language and Communication, Utrecht Institute of Linguistics OTS, Utrecht University, Trans 10, 3512 JK Utrecht, the Netherlands.
| | - Lu Wan
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, 1275 Center Drive, Gainesville, FL 32611, USA
| | - Ido Davidesco
- Department of Psychology, New York University, 6 Washington Place, New York, NY 10003, USA
| | - Lisa Kaggen
- Department of Psychology, New York University, 6 Washington Place, New York, NY 10003, USA
| | | | | | - Jess Rowland
- Department of Psychology, New York University, 6 Washington Place, New York, NY 10003, USA
| | - Georgios Michalareas
- Max Planck Institute for Empirical Aesthetics, Grüneburgweg 14, 60322 Frankfurt am Main, Germany
| | - Jay J Van Bavel
- Department of Psychology, New York University, 6 Washington Place, New York, NY 10003, USA
| | - Mingzhou Ding
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, 1275 Center Drive, Gainesville, FL 32611, USA
| | - David Poeppel
- Department of Psychology, New York University, 6 Washington Place, New York, NY 10003, USA; Max Planck Institute for Empirical Aesthetics, Grüneburgweg 14, 60322 Frankfurt am Main, Germany.
| |
Collapse
|
10
|
Michalareas G, Vezoli J, van Pelt S, Schoffelen JM, Kennedy H, Fries P. Alpha-Beta and Gamma Rhythms Subserve Feedback and Feedforward Influences among Human Visual Cortical Areas. Neuron 2016; 89:384-97. [PMID: 26777277 DOI: 10.1016/j.neuron.2015.12.018] [Citation(s) in RCA: 407] [Impact Index Per Article: 50.9] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2015] [Revised: 11/06/2015] [Accepted: 12/08/2015] [Indexed: 01/01/2023]
Abstract
Primate visual cortex is hierarchically organized. Bottom-up and top-down influences are exerted through distinct frequency channels, as was recently revealed in macaques by correlating inter-areal influences with laminar anatomical projection patterns. Because this anatomical data cannot be obtained in human subjects, we selected seven homologous macaque and human visual areas, and we correlated the macaque laminar projection patterns to human inter-areal directed influences as measured with magnetoencephalography. We show that influences along feedforward projections predominate in the gamma band, whereas influences along feedback projections predominate in the alpha-beta band. Rhythmic inter-areal influences constrain a functional hierarchy of the seven homologous human visual areas that is in close agreement with the respective macaque anatomical hierarchy. Rhythmic influences allow an extension of the hierarchy to 26 human visual areas including uniquely human brain areas. Hierarchical levels of ventral- and dorsal-stream visual areas are differentially affected by inter-areal influences in the alpha-beta band.
Collapse
Affiliation(s)
- Georgios Michalareas
- 1Ernst Strungmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, Deutschordenstraße 46, 60528 Frankfurt, Germany
| | | | | | | | | | | |
Collapse
|
11
|
Van Essen DC, Ugurbil K, Auerbach E, Barch D, Behrens TEJ, Bucholz R, Chang A, Chen L, Corbetta M, Curtiss SW, Della Penna S, Feinberg D, Glasser MF, Harel N, Heath AC, Larson-Prior L, Marcus D, Michalareas G, Moeller S, Oostenveld R, Petersen SE, Prior F, Schlaggar BL, Smith SM, Snyder AZ, Xu J, Yacoub E. The Human Connectome Project: a data acquisition perspective. Neuroimage 2012; 62:2222-31. [PMID: 22366334 DOI: 10.1016/j.neuroimage.2012.02.018] [Citation(s) in RCA: 1309] [Impact Index Per Article: 109.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2011] [Revised: 10/24/2011] [Accepted: 02/08/2012] [Indexed: 11/28/2022] Open
Abstract
The Human Connectome Project (HCP) is an ambitious 5-year effort to characterize brain connectivity and function and their variability in healthy adults. This review summarizes the data acquisition plans being implemented by a consortium of HCP investigators who will study a population of 1200 subjects (twins and their non-twin siblings) using multiple imaging modalities along with extensive behavioral and genetic data. The imaging modalities will include diffusion imaging (dMRI), resting-state fMRI (R-fMRI), task-evoked fMRI (T-fMRI), T1- and T2-weighted MRI for structural and myelin mapping, plus combined magnetoencephalography and electroencephalography (MEG/EEG). Given the importance of obtaining the best possible data quality, we discuss the efforts underway during the first two years of the grant (Phase I) to refine and optimize many aspects of HCP data acquisition, including a new 7T scanner, a customized 3T scanner, and improved MR pulse sequences.
Collapse
Affiliation(s)
- D C Van Essen
- Department of Anatomy & Neurobiology, Washington University, St. Louis, MO, USA.
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
12
|
Michalareas G, Schoffelen J, Gross J. Investigating causality between interacting brain areas with multivariate autoregressive models of MEG sensor data. Neuroimage 2009. [DOI: 10.1016/s1053-8119(09)71488-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022] Open
|