1
|
Grasso-Cladera A, Bremer M, Ladouce S, Parada F. A systematic review of mobile brain/body imaging studies using the P300 event-related potentials to investigate cognition beyond the laboratory. COGNITIVE, AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2024:10.3758/s13415-024-01190-z. [PMID: 38834886 DOI: 10.3758/s13415-024-01190-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 04/15/2024] [Indexed: 06/06/2024]
Abstract
The P300 ERP component, related to the onset of task-relevant or infrequent stimuli, has been widely used in the Mobile Brain/Body Imaging (MoBI) literature. This systematic review evaluates the quality and breadth of P300 MoBI studies, revealing a maturing field with well-designed research yet grappling with standardization and global representation challenges. While affirming the reliability of measuring P300 ERP components in mobile settings, the review identifies significant hurdles in standardizing data cleaning and processing techniques, impacting comparability and reproducibility. Geographical disparities emerge, with studies predominantly in the Global North and a dearth of research from the Global South, emphasizing the need for broader inclusivity to counter the WEIRD bias in psychology. Collaborative projects and mobile EEG systems showcase the feasibility of reaching diverse populations, which is essential to advance precision psychiatry and to integrate varied data streams. Methodologically, a trend toward ecological validity is noted, shifting from lab-based to real-world settings with portable EEG system advancements. Future hardware developments are expected to balance signal quality and sensor intrusiveness, enriching data collection in everyday contexts. Innovative methodologies reflect a move toward more natural experimental settings, prompting critical questions about the applicability of traditional ERP markers, such as the P300 outside structured paradigms. The review concludes by highlighting the crucial role of integrating mobile technologies, physiological sensors, and machine learning to advance cognitive neuroscience. It advocates for an operational definition of ecological validity to bridge the gap between controlled experiments and the complexity of embodied cognitive experiences, enhancing both theoretical understanding and practical application in study design.
Collapse
Affiliation(s)
| | - Marko Bremer
- Facultad de Psicología, Centro de Estudios en Neurociencia Humana y Neuropsicología (CENHN), Diego Portales University, Santiago, Chile
- Facultad de Psicología, Programa de Magíster en Neurociencia Social, Diego Portales University, Santiago, Chile
| | - Simon Ladouce
- Department Brain and Cognition, Leuven Brain Institute, KU Leuven, Leuven, Belgium
| | - Francisco Parada
- Facultad de Psicología, Centro de Estudios en Neurociencia Humana y Neuropsicología (CENHN), Diego Portales University, Santiago, Chile.
| |
Collapse
|
2
|
Grootjans Y, Harrewijn A, Fornari L, Janssen T, de Bruijn ERA, van Atteveldt N, Franken IHA. Getting closer to social interactions using electroencephalography in developmental cognitive neuroscience. Dev Cogn Neurosci 2024; 67:101391. [PMID: 38759529 PMCID: PMC11127236 DOI: 10.1016/j.dcn.2024.101391] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2024] [Revised: 04/12/2024] [Accepted: 05/10/2024] [Indexed: 05/19/2024] Open
Abstract
The field of developmental cognitive neuroscience is advancing rapidly, with large-scale, population-wide, longitudinal studies emerging as a key means of unraveling the complexity of the developing brain and cognitive processes in children. While numerous neuroscientific techniques like functional magnetic resonance imaging (fMRI), functional near-infrared spectroscopy (fNIRS), magnetoencephalography (MEG), and transcranial magnetic stimulation (TMS) have proved advantageous in such investigations, this perspective proposes a renewed focus on electroencephalography (EEG), leveraging underexplored possibilities of EEG. In addition to its temporal precision, low costs, and ease of application, EEG distinguishes itself with its ability to capture neural activity linked to social interactions in increasingly ecologically valid settings. Specifically, EEG can be measured during social interactions in the lab, hyperscanning can be used to study brain activity in two (or more) people simultaneously, and mobile EEG can be used to measure brain activity in real-life settings. This perspective paper summarizes research in these three areas, making a persuasive argument for the renewed inclusion of EEG into the toolkit of developmental cognitive and social neuroscientists.
Collapse
Affiliation(s)
- Yvette Grootjans
- Department of Psychology, Education and Child Studies, Erasmus University Rotterdam, the Netherlands.
| | - Anita Harrewijn
- Department of Psychology, Education and Child Studies, Erasmus University Rotterdam, the Netherlands
| | - Laura Fornari
- Department of Clinical, Neuro, and Developmental Psychology & Institute LEARN!, Vrije Universiteit Amsterdam, the Netherlands
| | - Tieme Janssen
- Department of Clinical, Neuro, and Developmental Psychology & Institute LEARN!, Vrije Universiteit Amsterdam, the Netherlands
| | | | - Nienke van Atteveldt
- Department of Clinical, Neuro, and Developmental Psychology & Institute LEARN!, Vrije Universiteit Amsterdam, the Netherlands
| | - Ingmar H A Franken
- Department of Psychology, Education and Child Studies, Erasmus University Rotterdam, the Netherlands
| |
Collapse
|
3
|
Zamm A, Loehr JD, Vesper C, Konvalinka I, Kappel SL, Heggli OA, Vuust P, Keller PE. A practical guide to EEG hyperscanning in joint action research: from motivation to implementation. Soc Cogn Affect Neurosci 2024; 19:nsae026. [PMID: 38584414 PMCID: PMC11086947 DOI: 10.1093/scan/nsae026] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2023] [Revised: 12/31/2023] [Accepted: 03/15/2024] [Indexed: 04/09/2024] Open
Abstract
Developments in cognitive neuroscience have led to the emergence of hyperscanning, the simultaneous measurement of brain activity from multiple people. Hyperscanning is useful for investigating social cognition, including joint action, because of its ability to capture neural processes that occur within and between people as they coordinate actions toward a shared goal. Here, we provide a practical guide for researchers considering using hyperscanning to study joint action and seeking to avoid frequently raised concerns from hyperscanning skeptics. We focus specifically on Electroencephalography (EEG) hyperscanning, which is widely available and optimally suited for capturing fine-grained temporal dynamics of action coordination. Our guidelines cover questions that are likely to arise when planning a hyperscanning project, ranging from whether hyperscanning is appropriate for answering one's research questions to considerations for study design, dependent variable selection, data analysis and visualization. By following clear guidelines that facilitate careful consideration of the theoretical implications of research design choices and other methodological decisions, joint action researchers can mitigate interpretability issues and maximize the benefits of hyperscanning paradigms.
Collapse
Affiliation(s)
- Anna Zamm
- Department of Linguistics, Cognitive Science and Semiotics, Aarhus University, Aarhus 8000, Denmark
- Interacting Minds Center, Aarhus University, Aarhus 8000, Denmark
| | - Janeen D Loehr
- Department of Psychology and Health Studies, University of Saskatchewan, Saskatoon, SK S7N 5A5, Canada
| | - Cordula Vesper
- Department of Linguistics, Cognitive Science and Semiotics, Aarhus University, Aarhus 8000, Denmark
- Interacting Minds Center, Aarhus University, Aarhus 8000, Denmark
| | - Ivana Konvalinka
- Section for Cognitive Systems, DTU Compute, Technical University of Denmark, Kongens Lyngby DK-2800, Denmark
| | - Simon L Kappel
- Department of Electrical and Computer Engineering, Aarhus University, Aarhus N 8200, Denmark
| | - Ole A Heggli
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Aarhus 8000, Denmark
| | - Peter Vuust
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Aarhus 8000, Denmark
| | - Peter E Keller
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Aarhus 8000, Denmark
- MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, New South Wales 2751, Australia
| |
Collapse
|
4
|
Zgonnikov A, Abbink D. Should I Stay or Should I Go? Cognitive Modeling of Left-Turn Gap Acceptance Decisions in Human Drivers. HUMAN FACTORS 2024; 66:1399-1413. [PMID: 36534014 PMCID: PMC10958748 DOI: 10.1177/00187208221144561] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/23/2021] [Accepted: 11/16/2022] [Indexed: 06/17/2023]
Abstract
OBJECTIVE We aim to bridge the gap between naturalistic studies of driver behavior and modern cognitive and neuroscientific accounts of decision making by modeling the cognitive processes underlying left-turn gap acceptance by human drivers. BACKGROUND Understanding decisions of human drivers is essential for the development of safe and efficient transportation systems. Current models of decision making in drivers provide little insight into the underlying cognitive processes. On the other hand, laboratory studies of abstract, highly controlled tasks point towards noisy evidence accumulation as a key mechanism governing decision making. However, it is unclear whether the cognitive processes implicated in these tasks are as paramount to decisions that are ingrained in more complex behaviors, such as driving. RESULTS The drivers' probability of accepting the available gap increased with the size of the gap; importantly, response time increased with time gap but not distance gap. The generalized drift-diffusion model explained the observed decision outcomes and response time distributions, as well as substantial individual differences in those. Through cross-validation, we demonstrate that the model not only explains the data, but also generalizes to out-of-sample conditions. CONCLUSION Our results suggest that dynamic evidence accumulation is an essential mechanism underlying left-turn gap acceptance decisions in human drivers, and exemplify how simple cognitive process models can help to understand human behavior in complex real-world tasks. APPLICATION Potential applications of our results include real-time prediction of human behavior by automated vehicles and simulating realistic human-like behaviors in virtual environments for automated vehicles.
Collapse
|
5
|
Peng K, Moussavi Z, Karunakaran KD, Borsook D, Lesage F, Nguyen DK. iVR-fNIRS: studying brain functions in a fully immersive virtual environment. NEUROPHOTONICS 2024; 11:020601. [PMID: 38577629 PMCID: PMC10993907 DOI: 10.1117/1.nph.11.2.020601] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/17/2023] [Revised: 03/05/2024] [Accepted: 03/06/2024] [Indexed: 04/06/2024]
Abstract
Immersive virtual reality (iVR) employs head-mounted displays or cave-like environments to create a sensory-rich virtual experience that simulates the physical presence of a user in a digital space. The technology holds immense promise in neuroscience research and therapy. In particular, virtual reality (VR) technologies facilitate the development of diverse tasks and scenarios closely mirroring real-life situations to stimulate the brain within a controlled and secure setting. It also offers a cost-effective solution in providing a similar sense of interaction to users when conventional stimulation methods are limited or unfeasible. Although combining iVR with traditional brain imaging techniques may be difficult due to signal interference or instrumental issues, recent work has proposed the use of functional near infrared spectroscopy (fNIRS) in conjunction with iVR for versatile brain stimulation paradigms and flexible examination of brain responses. We present a comprehensive review of current research studies employing an iVR-fNIRS setup, covering device types, stimulation approaches, data analysis methods, and major scientific findings. The literature demonstrates a high potential for iVR-fNIRS to explore various types of cognitive, behavioral, and motor functions in a fully immersive VR (iVR) environment. Such studies should set a foundation for adaptive iVR programs for both training (e.g., in novel environments) and clinical therapeutics (e.g., pain, motor and sensory disorders and other psychiatric conditions).
Collapse
Affiliation(s)
- Ke Peng
- University of Manitoba, Department of Electrical and Computer Engineering, Price Faculty of Engineering, Winnipeg, Manitoba, Canada
| | - Zahra Moussavi
- University of Manitoba, Department of Electrical and Computer Engineering, Price Faculty of Engineering, Winnipeg, Manitoba, Canada
| | - Keerthana Deepti Karunakaran
- Massachusetts General Hospital, Harvard Medical School, Department of Psychiatry, Boston, Massachusetts, United States
| | - David Borsook
- Massachusetts General Hospital, Harvard Medical School, Department of Psychiatry, Boston, Massachusetts, United States
- Massachusetts General Hospital, Harvard Medical School, Department of Radiology, Boston, Massachusetts, United States
| | - Frédéric Lesage
- University of Montreal, Institute of Biomedical Engineering, Department of Electrical Engineering, Ecole Polytechnique, Montreal, Quebec, Canada
- Montreal Heart Institute, Montreal, Quebec, Canada
| | - Dang Khoa Nguyen
- University of Montreal, Department of Neurosciences, Montreal, Quebec, Canada
- Research Center of the Hospital Center of the University of Montreal, Department of Neurology, Montreal, Quebec, Canada
| |
Collapse
|
6
|
Jain S, Vo VA, Wehbe L, Huth AG. Computational Language Modeling and the Promise of In Silico Experimentation. NEUROBIOLOGY OF LANGUAGE (CAMBRIDGE, MASS.) 2024; 5:80-106. [PMID: 38645624 PMCID: PMC11025654 DOI: 10.1162/nol_a_00101] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/28/2022] [Accepted: 01/18/2023] [Indexed: 04/23/2024]
Abstract
Language neuroscience currently relies on two major experimental paradigms: controlled experiments using carefully hand-designed stimuli, and natural stimulus experiments. These approaches have complementary advantages which allow them to address distinct aspects of the neurobiology of language, but each approach also comes with drawbacks. Here we discuss a third paradigm-in silico experimentation using deep learning-based encoding models-that has been enabled by recent advances in cognitive computational neuroscience. This paradigm promises to combine the interpretability of controlled experiments with the generalizability and broad scope of natural stimulus experiments. We show four examples of simulating language neuroscience experiments in silico and then discuss both the advantages and caveats of this approach.
Collapse
Affiliation(s)
- Shailee Jain
- Department of Computer Science, University of Texas at Austin, Austin, TX, USA
| | - Vy A. Vo
- Brain-Inspired Computing Lab, Intel Labs, Hillsboro, OR, USA
| | - Leila Wehbe
- Machine Learning Department, Carnegie Mellon University, Pittsburgh, PA, USA
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA, USA
| | - Alexander G. Huth
- Department of Computer Science, University of Texas at Austin, Austin, TX, USA
- Department of Neuroscience, University of Texas at Austin, Austin, TX, USA
| |
Collapse
|
7
|
Wyly S, Jinon N, Francis T, Evans H, Kao TL, Lambert S, Montgomery S, Newlove M, Mariscal H, Nguyen H, Cole H, Aispuro I, Robledo D, Tenaglia O, Weinberger N, Nguyen B, Waits H, Jorian D, Koch-Kreher L, Myrdal H, Antoniou V, Warrier M, Wunsch L, Arce I, Kirchner K, Campos E, Nguyen A, Rodriguez K, Cao L, Halmekangas A, Wilson RC. The psychophysiology of Mastermind: Characterizing response times and blinking in a high-stakes television game show. Psychophysiology 2024; 61:e14485. [PMID: 37966011 DOI: 10.1111/psyp.14485] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2023] [Revised: 10/20/2023] [Accepted: 10/21/2023] [Indexed: 11/16/2023]
Abstract
Television game shows have proven to be a valuable resource for studying human behavior under conditions of high stress and high stakes. However, previous work has focused mostly on choices-ignoring much of the rich visual information that is available on screen. Here, we take a first step to extracting more of this information by investigating the response times and blinking of contestants in the BBC show Mastermind. In Mastermind, contestants answer rapid-fire quiz questions while a camera slowly zooms in on their faces. By labeling contestants' behavior and blinks from 25 episodes, we asked how accuracy, response times, and blinking varied over the course of the game. For accuracy and response times, we tested whether contestants responded more accurately and more slowly after an error-exhibiting the "post-error increase in accuracy" and "post-error slowing" which has been repeatedly observed in the lab. For blinking, we tested whether blink rates varied according to the cognitive demands of the game-decreasing during periods of cognitive load, such as when pondering a response, and increasing at event boundaries in the task, such as the start of a question. In contrast to the lab, evidence for post-error changes in accuracy and response time was weak, with only marginal effects observed. In line with the lab, blinking varied over the course of the game much as we predicted. Overall, our findings demonstrate the potential of extracting dynamic signals from game shows to study the psychophysiology of behavior in the real world.
Collapse
Affiliation(s)
- Skyler Wyly
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Neryanne Jinon
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Timothy Francis
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Hailey Evans
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Tsai Lieh Kao
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Shelby Lambert
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Shayne Montgomery
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Marvelene Newlove
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Haley Mariscal
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Henry Nguyen
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Harrison Cole
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Israel Aispuro
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Daniela Robledo
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Olivia Tenaglia
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Nina Weinberger
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Bill Nguyen
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Hailey Waits
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Daisy Jorian
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Lucas Koch-Kreher
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Hunter Myrdal
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Victoria Antoniou
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Meghana Warrier
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Leah Wunsch
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Iram Arce
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Kayla Kirchner
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Elena Campos
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - An Nguyen
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | | | - Lanqin Cao
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Avery Halmekangas
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Robert C Wilson
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
- McKnight Brain Research Foundation, University of Arizona, Tucson, Arizona, USA
- Cognitive Science Program, University of Arizona, Tucson, Arizona, USA
| |
Collapse
|
8
|
Parsons TD. High-dimensional Metaverse Platforms and the Virtually Extended Self. J Cogn 2024; 7:2. [PMID: 38223229 PMCID: PMC10785999 DOI: 10.5334/joc.327] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2023] [Accepted: 10/17/2023] [Indexed: 01/16/2024] Open
Abstract
The study of cognition has traditionally used low-dimensional measures and stimulus presentations that emphasize laboratory control over high-dimensional (i.e., ecologically valid) tools that reflect the activities and interactions in everyday living. Although controlled experimental presentations in laboratories have enhanced our understanding of cognition for both healthy and clinical cohorts, high dimensionality may extend reality and cognition. High-dimensional Metaverse approaches use extended reality (XR) platforms with dynamic stimulus presentations that couple humans and simulation technologies to extend cognition. The plan for this paper is as follows: The "Extending from low to high-dimensional studies of cognition" section discusses current needs for high-dimensional stimulus presentations that reflect everyday cognitive activities. In the "Algorithmic devices and digital extension of cognition" section, technologies of the extended mind are introduced with the Metaverse as a candidate cognitive process for extension. Next, in the "A neurocognitive framework for understanding technologies of the extended mind" section, a framework and model are proposed for understanding the neural correlates of human technology couplings in terms of automatic algorithmic processes (limbic-ventral striatal loop); reflective cognition (prefrontal-dorsal striatal loop); and algorithmic processing (insular cortex). The algorithmic processes of human-technology interactions can, over time, become an automated and algorithmic coupling of brain and technology. The manuscript ends with a brief summary and discussion of the ways in which the Metaverse can be used for studying how persons respond to high-dimensional stimuli in simulations that approximate real-world activities and interactions.
Collapse
Affiliation(s)
- Thomas D. Parsons
- Grace Center, Edson College, Arizona State University, Tempe, AZ, US
- Computational Neuropsychology & Simulation (CNS) Lab, Arizona State University, Tempe, AZ, US
| |
Collapse
|
9
|
Salselas I, Pereira F, Sousa E. Inducing visual attention through audiovisual stimuli: Can synchronous sound be a salient event? Perception 2024; 53:31-43. [PMID: 37872670 PMCID: PMC10798022 DOI: 10.1177/03010066231208127] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2023] [Accepted: 09/29/2023] [Indexed: 10/25/2023]
Abstract
We present an experimental research aiming to explore how spatial attention may be biased through auditory stimuli. In particular, we investigate how synchronous sound and image may affect attention and increase the saliency of the audiovisual event. We have designed and implemented an experimental study where subjects, wearing an eye-tracking system, were examined regarding their gaze toward the audiovisual stimuli being displayed. The audiovisual stimuli were specifically tailored for this experiment, consisting of videos contrasting in terms of Synch Points (i.e., moments where a visual event is associated with a visible trigger movement, synchronous with its correspondent sound). While consistency across audiovisual sensory modalities revealed to be an attention-drawing feature, when combined with synchrony, it clearly emphasized the biasing, triggering orienting, that is, focal attention towards the particular scene that contains the Synch Point. Consequently, results revealed synchrony to be a saliency factor, contributing to the strengthening of the focal attention.
Collapse
Affiliation(s)
| | | | - Emanuel Sousa
- Centro de computação Gráfica, Portugal
- Centro Algoritmi, Portugal
| |
Collapse
|
10
|
Morgenroth E, Vilaclara L, Muszynski M, Gaviria J, Vuilleumier P, Van De Ville D. Probing neurodynamics of experienced emotions-a Hitchhiker's guide to film fMRI. Soc Cogn Affect Neurosci 2023; 18:nsad063. [PMID: 37930850 PMCID: PMC10656947 DOI: 10.1093/scan/nsad063] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2023] [Revised: 08/04/2023] [Accepted: 11/01/2023] [Indexed: 11/08/2023] Open
Abstract
Film functional magnetic resonance imaging (fMRI) has gained tremendous popularity in many areas of neuroscience. However, affective neuroscience remains somewhat behind in embracing this approach, even though films lend themselves to study how brain function gives rise to complex, dynamic and multivariate emotions. Here, we discuss the unique capabilities of film fMRI for emotion research, while providing a general guide of conducting such research. We first give a brief overview of emotion theories as these inform important design choices. Next, we discuss films as experimental paradigms for emotion elicitation and address the process of annotating them. We then situate film fMRI in the context of other fMRI approaches, and present an overview of results from extant studies so far with regard to advantages of film fMRI. We also give an overview of state-of-the-art analysis techniques including methods that probe neurodynamics. Finally, we convey limitations of using film fMRI to study emotion. In sum, this review offers a practitioners' guide to the emerging field of film fMRI and underscores how it can advance affective neuroscience.
Collapse
Affiliation(s)
- Elenor Morgenroth
- Neuro-X Institute, École Polytechnique Fédérale de Lausanne, Geneva 1202, Switzerland
- Department of Radiology and Medical Informatics, University of Geneva, Geneva 1202, Switzerland
- Swiss Center for Affective Sciences, University of Geneva, Geneva 1202, Switzerland
| | - Laura Vilaclara
- Neuro-X Institute, École Polytechnique Fédérale de Lausanne, Geneva 1202, Switzerland
- Department of Radiology and Medical Informatics, University of Geneva, Geneva 1202, Switzerland
| | - Michal Muszynski
- Department of Basic Neurosciences, University of Geneva, Geneva 1202, Switzerland
| | - Julian Gaviria
- Swiss Center for Affective Sciences, University of Geneva, Geneva 1202, Switzerland
- Department of Basic Neurosciences, University of Geneva, Geneva 1202, Switzerland
- Department of Psychiatry, University of Geneva, Geneva 1202, Switzerland
| | - Patrik Vuilleumier
- Swiss Center for Affective Sciences, University of Geneva, Geneva 1202, Switzerland
- Department of Basic Neurosciences, University of Geneva, Geneva 1202, Switzerland
- CIBM Center for Biomedical Imaging, Geneva 1202, Switzerland
| | - Dimitri Van De Ville
- Neuro-X Institute, École Polytechnique Fédérale de Lausanne, Geneva 1202, Switzerland
- Department of Radiology and Medical Informatics, University of Geneva, Geneva 1202, Switzerland
- CIBM Center for Biomedical Imaging, Geneva 1202, Switzerland
| |
Collapse
|
11
|
Lingelbach K, Gado S, Wirzberger M, Vukelić M. Workload-dependent hemispheric asymmetries during the emotion-cognition interaction: a close-to-naturalistic fNIRS study. FRONTIERS IN NEUROERGONOMICS 2023; 4:1273810. [PMID: 38234490 PMCID: PMC10790862 DOI: 10.3389/fnrgo.2023.1273810] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/07/2023] [Accepted: 10/23/2023] [Indexed: 01/19/2024]
Abstract
Introduction We investigated brain activation patterns of interacting emotional distractions and cognitive processes in a close-to-naturalistic functional near-infrared spectroscopy (fNIRS) study. Methods Eighteen participants engaged in a monitoring-control task, mimicking common air traffic controller requirements. The scenario entailed experiencing both low and high workload, while concurrently being exposed to emotional speech distractions of positive, negative, and neutral valence. Results Our investigation identified hemispheric asymmetries in prefrontal cortex (PFC) activity during the presentation of negative and positive emotional speech distractions at different workload levels. Thereby, in particular, activation in the left inferior frontal gyrus (IFG) and orbitofrontal cortex (OFC) seems to play a crucial role. Brain activation patterns revealed a cross-over interaction indicating workload-dependent left hemispheric inhibition processes during negative distractions and high workload. For positive emotional distractions under low workload, we observed left-hemispheric PFC recruitment potentially associated with speech-related processes. Furthermore, we found a workload-independent negativity bias for neutral distractions, showing brain activation patterns similar to those of negative distractions. Discussion In conclusion, lateralized hemispheric processing, regulating emotional speech distractions and integrating emotional and cognitive processes, is influenced by workload levels and stimulus characteristics. These findings advance our understanding of the factors modulating hemispheric asymmetries during the processing and inhibition of emotional distractions, as well as the interplay between emotion and cognition. Moreover, they emphasize the significance of exploring emotion-cognition interactions in more naturalistic settings to gain a deeper understanding of their implications in real-world application scenarios (e.g., working and learning environments).
Collapse
Affiliation(s)
- Katharina Lingelbach
- Applied Neurocognitive Systems, Fraunhofer Institute for Industrial Engineering IAO, Stuttgart, Germany
- Applied Neurocognitive Psychology, Carl von Ossietzky University, Oldenburg, Germany
| | - Sabrina Gado
- Experimental Clinical Psychology, Department of Psychology, University of Würzburg, Würzburg, Germany
| | - Maria Wirzberger
- Department of Teaching and Learning with Intelligent Systems, University of Stuttgart, Stuttgart, Germany
- LEAD Graduate School and Research Network, University of Tübingen, Tübingen, Germany
| | - Mathias Vukelić
- Applied Neurocognitive Systems, Fraunhofer Institute for Industrial Engineering IAO, Stuttgart, Germany
| |
Collapse
|
12
|
Church JA. The Brain's Control Networks in Reading: Insights From Cross-Task Studies of Youth. MIND, BRAIN AND EDUCATION : THE OFFICIAL JOURNAL OF THE INTERNATIONAL MIND, BRAIN, AND EDUCATION SOCIETY 2023; 17:257-266. [PMID: 38745918 PMCID: PMC11091959 DOI: 10.1111/mbe.12372] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/19/2022] [Accepted: 06/04/2023] [Indexed: 05/16/2024]
Abstract
Humans engage multiple brain systems to read successfully, including using regions important for vision, language, and control. Control refers to the set of executive processes in the brain that guide moment-to-moment behavior in service of our goals. There is a growing appreciation for the role of the brain's control system in reading comprehension, in reading skill change over time, and in those who have difficulty with the reading process. One way to understand the brain's control engagement in reading may be to study control engagement across multiple tasks in order to study consistencies, or cross-task similarities, relative to reading-specific variations. In this commentary, I briefly summarize some of our recent work studying the brain's control networks across different tasks (e.g., when reading, or doing different executive function tasks). I then review our findings of when control activation does or does not relate to measures of reading ability, and reading growth over time. The utility of cross-task comparisons in neuroimaging is noted, as well as the need to better understand multiple sources of heterogeneity in our developmental samples. I end by discussing a few of the many future directions for further study of the brain with regard to the brain's control processing and academic achievement.
Collapse
|
13
|
Kurteff GL, Lester-Smith RA, Martinez A, Currens N, Holder J, Villarreal C, Mercado VR, Truong C, Huber C, Pokharel P, Hamilton LS. Speaker-induced Suppression in EEG during a Naturalistic Reading and Listening Task. J Cogn Neurosci 2023; 35:1538-1556. [PMID: 37584593 DOI: 10.1162/jocn_a_02037] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/17/2023]
Abstract
Speaking elicits a suppressed neural response when compared with listening to others' speech, a phenomenon known as speaker-induced suppression (SIS). Previous research has focused on investigating SIS at constrained levels of linguistic representation, such as the individual phoneme and word level. Here, we present scalp EEG data from a dual speech perception and production task where participants read sentences aloud then listened to playback of themselves reading those sentences. Playback was separated into immediate repetition of the previous trial and randomized repetition of a former trial to investigate if forward modeling of responses during passive listening suppresses the neural response. Concurrent EMG was recorded to control for movement artifact during speech production. In line with previous research, ERP analyses at the sentence level demonstrated suppression of early auditory components of the EEG for production compared with perception. To evaluate whether linguistic abstractions (in the form of phonological feature tuning) are suppressed during speech production alongside lower-level acoustic information, we fit linear encoding models that predicted scalp EEG based on phonological features, EMG activity, and task condition. We found that phonological features were encoded similarly between production and perception. However, this similarity was only observed when controlling for movement by using the EMG response as an additional regressor. Our results suggest that SIS operates at a sensory representational level and is dissociated from higher order cognitive and linguistic processing that takes place during speech perception and production. We also detail some important considerations when analyzing EEG during continuous speech production.
Collapse
|
14
|
Maidhof C, Müller V, Lartillot O, Agres K, Bloska J, Asano R, Odell-Miller H, Fachner J. Intra- and inter-brain coupling and activity dynamics during improvisational music therapy with a person with dementia: an explorative EEG-hyperscanning single case study. Front Psychol 2023; 14:1155732. [PMID: 37842703 PMCID: PMC10570426 DOI: 10.3389/fpsyg.2023.1155732] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2023] [Accepted: 09/06/2023] [Indexed: 10/17/2023] Open
Abstract
Objective Real-life research into the underlying neural dynamics of improvisational music therapy, used with various clinical populations, is largely lacking. This single case study explored within-session differences in musical features and in within- and between-brain coupling between a Person with Dementia (PwD) and a music therapist during a music therapy session. Methods Dual-EEG from a music therapist and a PwD (male, 31 years) was recorded. Note density, pulse clarity and synchronicity were extracted from audio-visual data. Three music therapists identified moments of interest and no interest (MOI/MONI) in two drum improvisations. The Integrative Coupling Index, reflecting time-lagged neural synchronization, and musical features were compared between the MOI and MONI. Results Between-brain coupling of 2 Hz activity was increased during the MOI, showing anteriority of the therapist's neural activity. Within-brain coupling for the PwD was stronger from frontal and central areas during the MOI, but within-brain coupling for the therapist was stronger during MONI. Differences in musical features indicated that both acted musically more similar to one another during the MOI. Conclusion Within-session differences in neural synchronization and musical features highlight the dynamic nature of music therapy. Significance The findings contribute to a better understanding of social and affective processes in the brain and (interactive) musical behaviors during specific moments in a real-life music therapy session. This may provide insights into the role of such moments for relational-therapeutic processes.
Collapse
Affiliation(s)
- Clemens Maidhof
- Cambridge Institute for Music Therapy Research, Anglia Ruskin University, Cambridge, United Kingdom
- Josef Ressel Centre for Personalized Music Therapy, University of Applied Sciences IMC Krems, Krems an der Donau, Austria
| | - Viktor Müller
- Center for Lifespan Psychology, Max Planck Institute for Human Development, Berlin, Germany
| | - Olivier Lartillot
- RITMO Centre for Interdisciplinary Studies in Rhythm, Time and Motion, University of Oslo, Oslo, Norway
| | - Kat Agres
- Yong Siew Toh Conservatory of Music, National University of Singapore, Singapore, Singapore
- Centre for Music and Health, National University of Singapore, Singapore, Singapore
| | - Jodie Bloska
- Cambridge Institute for Music Therapy Research, Anglia Ruskin University, Cambridge, United Kingdom
| | - Rie Asano
- Institute of Musicology, University of Cologne, Cologne, Germany
- Advanced Comprehensive Research Organization, Teikyo University, Tokyo, Japan
| | - Helen Odell-Miller
- Cambridge Institute for Music Therapy Research, Anglia Ruskin University, Cambridge, United Kingdom
| | - Jörg Fachner
- Cambridge Institute for Music Therapy Research, Anglia Ruskin University, Cambridge, United Kingdom
- Josef Ressel Centre for Personalized Music Therapy, University of Applied Sciences IMC Krems, Krems an der Donau, Austria
| |
Collapse
|
15
|
Maisson DJN, Cervera RL, Voloh B, Conover I, Zambre M, Zimmermann J, Hayden BY. Widespread coding of navigational variables in prefrontal cortex. Curr Biol 2023; 33:3478-3488.e3. [PMID: 37541250 PMCID: PMC10984098 DOI: 10.1016/j.cub.2023.07.024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2023] [Revised: 06/01/2023] [Accepted: 07/13/2023] [Indexed: 08/06/2023]
Abstract
To navigate effectively, we must represent information about our location in the environment. Traditional research highlights the role of the hippocampal complex in this process. Spurred by recent research highlighting the widespread cortical encoding of cognitive and motor variables previously thought to have localized function, we hypothesized that navigational variables would be likewise encoded widely, especially in the prefrontal cortex, which is associated with volitional behavior. We recorded neural activity from six prefrontal regions while macaques performed a foraging task in an open enclosure. In all regions, we found strong encoding of allocentric position, allocentric head direction, boundary distance, and linear and angular velocity. These encodings were not accounted for by distance, time to reward, or motor factors. The strength of coding of all variables increased along a ventral-to-dorsal gradient. Together, these results argue that encoding of navigational variables is not localized to the hippocampus and support the hypothesis that navigation is continuous with other forms of flexible cognition in the service of action.
Collapse
Affiliation(s)
- David J-N Maisson
- Department of Neuroscience, Center for Magnetic Resonance Research, Center for Neuroengineering, Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN 55455, USA
| | - Roberto Lopez Cervera
- Department of Neuroscience, Center for Magnetic Resonance Research, Center for Neuroengineering, Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN 55455, USA
| | - Benjamin Voloh
- Department of Neuroscience, Center for Magnetic Resonance Research, Center for Neuroengineering, Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN 55455, USA
| | - Indirah Conover
- Department of Neuroscience, Center for Magnetic Resonance Research, Center for Neuroengineering, Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN 55455, USA
| | - Mrunal Zambre
- Department of Neuroscience, Center for Magnetic Resonance Research, Center for Neuroengineering, Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN 55455, USA
| | - Jan Zimmermann
- Department of Neuroscience, Center for Magnetic Resonance Research, Center for Neuroengineering, Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN 55455, USA
| | - Benjamin Y Hayden
- Department of Neuroscience, Center for Magnetic Resonance Research, Center for Neuroengineering, Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN 55455, USA.
| |
Collapse
|
16
|
Parsons MH, Stryjek R, Fendt M, Kiyokawa Y, Bebas P, Blumstein DT. Making a case for the free exploratory paradigm: animal welfare-friendly assays that enhance heterozygosity and ecological validity. Front Behav Neurosci 2023; 17:1228478. [PMID: 37600759 PMCID: PMC10436217 DOI: 10.3389/fnbeh.2023.1228478] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2023] [Accepted: 07/12/2023] [Indexed: 08/22/2023] Open
Affiliation(s)
- Michael H. Parsons
- Department of Biological Sciences, Fordham University, Bronx, NY, United States
| | - Rafal Stryjek
- Institute of Psychology, Polish Academy of Sciences, Warsaw, Poland
| | - Markus Fendt
- Institute for Pharmacology and Toxicology, Center for Behavioral Brain Sciences, Otto-von-Guericke University Magdeburg, Magdeburg, Germany
| | - Yasushi Kiyokawa
- Laboratory of Veterinary Ethology, The University of Tokyo, Tokyo, Japan
| | - Piotr Bebas
- Department of Animal Physiology, Institute of Functional Biology and Ecology, Faculty of Biology, University of Warsaw, Warsaw, Poland
| | - Daniel T. Blumstein
- Department of Ecology and Evolutionary Biology, University of California, Los Angeles, Los Angeles, CA, United States
| |
Collapse
|
17
|
Alreja A, Ward MJ, Ma Q, Russ BE, Bickel S, Van Wouwe NC, González-Martínez JA, Neimat JS, Abel TJ, Bagić A, Parker LS, Richardson RM, Schroeder CE, Morency LP, Ghuman AS. A new paradigm for investigating real-world social behavior and its neural underpinnings. Behav Res Methods 2023; 55:2333-2352. [PMID: 35877024 PMCID: PMC10841340 DOI: 10.3758/s13428-022-01882-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/15/2022] [Indexed: 11/08/2022]
Abstract
Eye tracking and other behavioral measurements collected from patient-participants in their hospital rooms afford a unique opportunity to study natural behavior for basic and clinical translational research. We describe an immersive social and behavioral paradigm implemented in patients undergoing evaluation for surgical treatment of epilepsy, with electrodes implanted in the brain to determine the source of their seizures. Our studies entail collecting eye tracking with other behavioral and psychophysiological measurements from patient-participants during unscripted behavior, including social interactions with clinical staff, friends, and family in the hospital room. This approach affords a unique opportunity to study the neurobiology of natural social behavior, though it requires carefully addressing distinct logistical, technical, and ethical challenges. Collecting neurophysiological data synchronized to behavioral and psychophysiological measures helps us to study the relationship between behavior and physiology. Combining across these rich data sources while participants eat, read, converse with friends and family, etc., enables clinical-translational research aimed at understanding the participants' disorders and clinician-patient interactions, as well as basic research into natural, real-world behavior. We discuss data acquisition, quality control, annotation, and analysis pipelines that are required for our studies. We also discuss the clinical, logistical, and ethical and privacy considerations critical to working in the hospital setting.
Collapse
Affiliation(s)
- Arish Alreja
- Center for the Neural Basis of Cognition, Carnegie Mellon University and University of Pittsburgh, Pittsburgh, USA.
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, USA.
- Machine Learning Department, Carnegie Mellon University, Pittsburgh, USA.
- Department of Neurological Surgery, University of Pittsburgh, Pittsburgh, USA.
| | - Michael J Ward
- Department of Neurological Surgery, University of Pittsburgh, Pittsburgh, USA
- David Geffen School of Medicine, University of California Los Angeles, Los Angeles, USA
| | - Qianli Ma
- Language Technologies Institute, Carnegie Mellon University, Pittsburgh, USA
| | - Brian E Russ
- Nathan Kline Institute for Psychiatric Research, Orangeburg, USA
| | - Stephan Bickel
- Department of Neurosurgery and Neurology, Northwell Health, The Feinstein Institutes for Medical Research, Manhasset, USA
| | - Nelleke C Van Wouwe
- Department of Neurological Surgery, University of Louisville, Louisville, USA
| | | | - Joseph S Neimat
- Department of Neurological Surgery, University of Louisville, Louisville, USA
| | - Taylor J Abel
- Center for the Neural Basis of Cognition, Carnegie Mellon University and University of Pittsburgh, Pittsburgh, USA
- Department of Neurological Surgery, University of Pittsburgh, Pittsburgh, USA
- Brain Institute, University of Pittsburgh, Pittsburgh, USA
| | - Anto Bagić
- Department of Neurology, University of Pittsburgh, Pittsburgh, USA
| | - Lisa S Parker
- School of Public Health, University of Pittsburgh, Pittsburgh, USA
| | - R Mark Richardson
- Department of Neurological Surgery, University of Pittsburgh, Pittsburgh, USA
- Department of Neurosurgery, Harvard Medical School and Massachusetts General Hospital, Boston, USA
| | - Charles E Schroeder
- Nathan Kline Institute for Psychiatric Research, Orangeburg, USA
- Departments of Neurosurgery and Psychiatry, Columbia University, New York, USA
| | | | - Avniel Singh Ghuman
- Center for the Neural Basis of Cognition, Carnegie Mellon University and University of Pittsburgh, Pittsburgh, USA
- Department of Neurological Surgery, University of Pittsburgh, Pittsburgh, USA
- Brain Institute, University of Pittsburgh, Pittsburgh, USA
- Departments of Psychology, Neurobiology, and Psychiatry, University of Pittsburgh, Pittsburgh, USA
| |
Collapse
|
18
|
Sanz-Aznar J, Bruni LE, Soto-Faraco S. Cinematographic continuity edits across shot scales and camera angles: an ERP analysis. Front Neurosci 2023; 17:1173704. [PMID: 37521689 PMCID: PMC10375706 DOI: 10.3389/fnins.2023.1173704] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2023] [Accepted: 06/27/2023] [Indexed: 08/01/2023] Open
Abstract
Film editing has attracted great theoretical and practical interest since the beginnings of cinematography. In recent times, the neural correlates of visual transitions at edit cuts have been at the focus of attention in neurocinematics. Many Event Related Potential (ERP) studies studies have reported the consequences of cuts involving narrative discontinuities, and violations of standard montage rules. However, less is known about edits that are meant to induce continuity. Here, we addressed the neural correlates of continuity editing involving scale, and angle variations across the cut within the same scene, two of the most popular devices used for continuity editing. We recorded the electroencephalographic signal obtained from 20 viewers as they watched four different cinematographic excerpts to extract ERPs at edit points. First, we were able to reproduce the general time and scalp distribution of the typical ERPs to filmic cuts in prior studies. Second, we found significant ERP modulations triggered by scale changes (scale out, scale in, or maintaining the same scale). Edits involving an increase in scale (scale out) led to amplification of the ERP deflection, and scale reduction (scale in) led to decreases, compared to edits that kept scale across the cut. These modulations coincide with the time window of the N300 and N400 components and, according to previous findings, their amplitude has been associated with the likelihood of consciously detecting the edit. Third, we did not detect similar modulations as a function of angle variations across the cut. Based on these findings, we suggest that cuts involving reduction of scale are more likely to go unnoticed, than ones that scale out. This relationship between scale in/out and visibility is documented in film edition manuals. Specifically, in order to achieve fluidity in a scene, the edition is designed from the most opened shots to the most closed ones.
Collapse
Affiliation(s)
- Javier Sanz-Aznar
- Section of Communication, Department of Hispanic Studies, Literary Theory and Communication, University of Barcelona, Barcelona, Spain
| | - Luis Emilio Bruni
- Augmented Cognition Lab, Section for Media Technology, Department of Architecture, Design and Media Technology, The Technical Faculty of IT and Design, Aalborg University, Copenhagen, Denmark
| | - Salvador Soto-Faraco
- Multisensory Research Group, The Center for Brain and Cognition, Pompeu Fabra University, Barcelona, Spain
- Institució Catalana de Recerca i Estudis Avançats (ICREA), Barcelona, Spain
| |
Collapse
|
19
|
Schröer L, Cooper RP, Mareschal D. Assessing executive functions in free-roaming 2- to 3-year-olds. Front Psychol 2023; 14:1210109. [PMID: 37457086 PMCID: PMC10338926 DOI: 10.3389/fpsyg.2023.1210109] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2023] [Accepted: 06/02/2023] [Indexed: 07/18/2023] Open
Abstract
Introduction Core aspects of executive functions (EFs) are known to be related to academic skills such as literacy and numeracy. However, school outcomes may also be related to higher-level functions such as planning. Nevertheless, few studies have considered assessing natural manifestations of higher-level EFs in children who are on the cusp of entering formal schooling. One reason for this is the difficulty of obtaining ecologically valid measures of EFs in preschool-aged children. Method We describe a novel task - building a striped Duplo tower subject to two constraints - designed to assess planning in real-world multi-action situation. Children were instructed to build a tower to a certain height by alternating between two different colors of blocks. Results Performance on one of the constraints in this task was found to vary with age. Importantly, distinct components of multiple constraints planning performance predicted laboratory-based measures of inhibitory control and working memory efficacy. Discussion Thus, this task provides a simple, cheap and effective way of assessing executive function in toddlers through the observation of natural behavior. It also opens up possibilities to investigate the neurodevelopment of EF in the real world.
Collapse
Affiliation(s)
- Lisanne Schröer
- Centre for Brain and Cognitive Development, Birkbeck, University of London, London, United Kingdom
| | - Richard P. Cooper
- Centre for Cognition, Computation and Modelling, Birkbeck, University of London, London, United Kingdom
| | - Denis Mareschal
- Centre for Brain and Cognitive Development, Birkbeck, University of London, London, United Kingdom
- Centre for Cognition, Computation and Modelling, Birkbeck, University of London, London, United Kingdom
| |
Collapse
|
20
|
López-Larraz E, Escolano C, Robledo-Menéndez A, Morlas L, Alda A, Minguez J. A garment that measures brain activity: proof of concept of an EEG sensor layer fully implemented with smart textiles. Front Hum Neurosci 2023; 17:1135153. [PMID: 37305362 PMCID: PMC10250743 DOI: 10.3389/fnhum.2023.1135153] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2022] [Accepted: 04/20/2023] [Indexed: 06/13/2023] Open
Abstract
This paper presents the first garment capable of measuring brain activity with accuracy comparable to that of state-of-the art dry electroencephalogram (EEG) systems. The main innovation is an EEG sensor layer (i.e., the electrodes, the signal transmission, and the cap support) made entirely of threads, fabrics, and smart textiles, eliminating the need for metal or plastic materials. The garment is connected to a mobile EEG amplifier to complete the measurement system. As a first proof of concept, the new EEG system (Garment-EEG) was characterized with respect to a state-of-the-art Ag/AgCl dry-EEG system (Dry-EEG) over the forehead area of healthy participants in terms of: (1) skin-electrode impedance; (2) EEG activity; (3) artifacts; and (4) user ergonomics and comfort. The results show that the Garment-EEG system provides comparable recordings to Dry-EEG, but it is more susceptible to artifacts under adverse recording conditions due to poorer contact impedances. The textile-based sensor layer offers superior ergonomics and comfort compared to its metal-based counterpart. We provide the datasets recorded with Garment-EEG and Dry-EEG systems, making available the first open-access dataset of an EEG sensor layer built exclusively with textile materials. Achieving user acceptance is an obstacle in the field of neurotechnology. The introduction of EEG systems encapsulated in wearables has the potential to democratize neurotechnology and non-invasive brain-computer interfaces, as they are naturally accepted by people in their daily lives. Furthermore, supporting the EEG implementation in the textile industry may result in lower cost and less-polluting manufacturing processes compared to metal and plastic industries.
Collapse
|
21
|
Han CZ, Donoghue T, Cao R, Kunz L, Wang S, Jacobs J. Using multi-task experiments to test principles of hippocampal function. Hippocampus 2023; 33:646-657. [PMID: 37042212 PMCID: PMC10249632 DOI: 10.1002/hipo.23540] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2023] [Revised: 03/30/2023] [Accepted: 03/31/2023] [Indexed: 04/13/2023]
Abstract
Investigations of hippocampal functions have revealed a dizzying array of findings, from lesion-based behavioral deficits, to a diverse range of characterized neural activations, to computational models of putative functionality. Across these findings, there remains an ongoing debate about the core function of the hippocampus and the generality of its representation. Researchers have debated whether the hippocampus's primary role relates to the representation of space, the neural basis of (episodic) memory, or some more general computation that generalizes across various cognitive domains. Within these different perspectives, there is much debate about the nature of feature encodings. Here, we suggest that in order to evaluate hippocampal responses-investigating, for example, whether neuronal representations are narrowly targeted to particular tasks or if they subserve domain-general purposes-a promising research strategy may be the use of multi-task experiments, or more generally switching between multiple task contexts while recording from the same neurons in a given session. We argue that this strategy-when combined with explicitly defined theoretical motivations that guide experiment design-could be a fruitful approach to better understand how hippocampal representations support different behaviors. In doing so, we briefly review key open questions in the field, as exemplified by articles in this special issue, as well as previous work using multi-task experiments, and extrapolate to consider how this strategy could be further applied to probe fundamental questions about hippocampal function.
Collapse
Affiliation(s)
- Claire Z. Han
- Department of Biomedical Engineering, Columbia University
| | | | - Runnan Cao
- Department of Radiology, Washington University in St. Louis
| | - Lukas Kunz
- Department of Epileptology, University of Bonn Medical Center, Bonn, Germany
| | - Shuo Wang
- Department of Radiology, Washington University in St. Louis
| | - Joshua Jacobs
- Department of Biomedical Engineering, Columbia University
- Department of Neurological Surgery, Columbia University
| |
Collapse
|
22
|
Xu S, Zhang Z, Li L, Zhou Y, Lin D, Zhang M, Zhang L, Huang G, Liu X, Becker B, Liang Z. Functional connectivity profiles of the default mode and visual networks reflect temporal accumulative effects of sustained naturalistic emotional experience. Neuroimage 2023; 269:119941. [PMID: 36791897 DOI: 10.1016/j.neuroimage.2023.119941] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2022] [Revised: 01/30/2023] [Accepted: 02/11/2023] [Indexed: 02/15/2023] Open
Abstract
Determining and decoding emotional brain processes under ecologically valid conditions remains a key challenge in affective neuroscience. The current functional Magnetic Resonance Imaging (fMRI) based emotion decoding studies are mainly based on brief and isolated episodes of emotion induction, while sustained emotional experience in naturalistic environments that mirror daily life experiences are scarce. Here we used 12 different 10-minute movie clips as ecologically valid emotion-evoking procedures in n = 52 individuals to explore emotion-specific fMRI functional connectivity (FC) profiles on the whole-brain level at high spatial resolution (432 parcellations including cortical and subcortical structures). Employing machine-learning based decoding and cross validation procedures allowed to investigate FC profiles contributing to classification that can accurately distinguish sustained happiness and sadness and that generalize across subjects, movie clips, and parcellations. Both functional brain network-based and subnetwork-based emotion classification results suggested that emotion manifests as distributed representation of multiple networks, rather than a single functional network or subnetwork. Further, the results showed that the Visual Network (VN) and Default Mode Network (DMN) associated functional networks, especially VN-DMN, exhibited a strong contribution to emotion classification. To further estimate the temporal accumulative effect of naturalistic long-term movie-based video-evoking emotions, we divided the 10-min episode into three stages: early stimulation (1∼200 s), middle stimulation (201∼400 s), and late stimulation (401∼600 s) and examined the emotion classification performance at different stimulation stages. We found that the late stimulation contributes most to the classification (accuracy=85.32%, F1-score=85.62%) compared to early and middle stimulation stages, implying that continuous exposure to emotional stimulation can lead to more intense emotions and further enhance emotion-specific distinguishable representations. The present work demonstrated that sustained happiness and sadness under naturalistic conditions are presented in emotion-specific network profiles and these expressions may play different roles in the generation and modulation of emotions. These findings elucidated the importance of network level adaptations for sustained emotional experiences during naturalistic contexts and open new venues for imaging network level contributions under naturalistic conditions.
Collapse
Affiliation(s)
- Shuyue Xu
- School of Biomedical Engineering, Medical School, Shenzhen University, Shenzhen 518060, China; Guangdong Provincial Key Laboratory of Biomedical Measurements and Ultrasound Imaging, Shenzhen 518060, China
| | - Zhiguo Zhang
- Institute of Computing and Intelligence, Harbin Institute of Technology, Shenzhen, China; Peng Cheng Laboratory, Shenzhen 518055, China; Marshall Laboratory of Biomedical Engineering, Shenzhen 518060, China
| | - Linling Li
- School of Biomedical Engineering, Medical School, Shenzhen University, Shenzhen 518060, China; Guangdong Provincial Key Laboratory of Biomedical Measurements and Ultrasound Imaging, Shenzhen 518060, China
| | - Yongjie Zhou
- Department of Psychiatric Rehabilitation, Shenzhen Kangning Hospital, Shenzhen, China
| | - Danyi Lin
- School of Biomedical Engineering, Medical School, Shenzhen University, Shenzhen 518060, China; Guangdong Provincial Key Laboratory of Biomedical Measurements and Ultrasound Imaging, Shenzhen 518060, China
| | - Min Zhang
- Institute of Computing and Intelligence, Harbin Institute of Technology, Shenzhen, China
| | - Li Zhang
- School of Biomedical Engineering, Medical School, Shenzhen University, Shenzhen 518060, China; Guangdong Provincial Key Laboratory of Biomedical Measurements and Ultrasound Imaging, Shenzhen 518060, China
| | - Gan Huang
- School of Biomedical Engineering, Medical School, Shenzhen University, Shenzhen 518060, China; Guangdong Provincial Key Laboratory of Biomedical Measurements and Ultrasound Imaging, Shenzhen 518060, China
| | - Xiqin Liu
- Center of Psychosomatic Medicine, Sichuan Provincial Center for Mental Health, MOE Key Laboratory for Neuroinformation, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu 611731, China
| | - Benjamin Becker
- Center of Psychosomatic Medicine, Sichuan Provincial Center for Mental Health, MOE Key Laboratory for Neuroinformation, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu 611731, China.
| | - Zhen Liang
- School of Biomedical Engineering, Medical School, Shenzhen University, Shenzhen 518060, China; Guangdong Provincial Key Laboratory of Biomedical Measurements and Ultrasound Imaging, Shenzhen 518060, China; Marshall Laboratory of Biomedical Engineering, Shenzhen 518060, China.
| |
Collapse
|
23
|
Rosenkranz M, Cetin T, Uslar VN, Bleichner MG. Investigating the attentional focus to workplace-related soundscapes in a complex audio-visual-motor task using EEG. FRONTIERS IN NEUROERGONOMICS 2023; 3:1062227. [PMID: 38235454 PMCID: PMC10790850 DOI: 10.3389/fnrgo.2022.1062227] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/05/2022] [Accepted: 12/16/2022] [Indexed: 01/19/2024]
Abstract
Introduction In demanding work situations (e.g., during a surgery), the processing of complex soundscapes varies over time and can be a burden for medical personnel. Here we study, using mobile electroencephalography (EEG), how humans process workplace-related soundscapes while performing a complex audio-visual-motor task (3D Tetris). Specifically, we wanted to know how the attentional focus changes the processing of the soundscape as a whole. Method Participants played a game of 3D Tetris in which they had to use both hands to control falling blocks. At the same time, participants listened to a complex soundscape, similar to what is found in an operating room (i.e., the sound of machinery, people talking in the background, alarm sounds, and instructions). In this within-subject design, participants had to react to instructions (e.g., "place the next block in the upper left corner") and to sounds depending on the experimental condition, either to a specific alarm sound originating from a fixed location or to a beep sound that originated from varying locations. Attention to the alarm reflected a narrow attentional focus, as it was easy to detect and most of the soundscape could be ignored. Attention to the beep reflected a wide attentional focus, as it required the participants to monitor multiple different sound streams. Results and discussion Results show the robustness of the N1 and P3 event related potential response during this dynamic task with a complex auditory soundscape. Furthermore, we used temporal response functions to study auditory processing to the whole soundscape. This work is a step toward studying workplace-related sound processing in the operating room using mobile EEG.
Collapse
Affiliation(s)
- Marc Rosenkranz
- Neurophysiology of Everyday Life Group, Department of Psychology, University of Oldenburg, Oldenburg, Germany
| | - Timur Cetin
- Pius-Hospital Oldenburg, University Hospital for Visceral Surgery, University of Oldenburg, Oldenburg, Germany
| | - Verena N. Uslar
- Pius-Hospital Oldenburg, University Hospital for Visceral Surgery, University of Oldenburg, Oldenburg, Germany
| | - Martin G. Bleichner
- Neurophysiology of Everyday Life Group, Department of Psychology, University of Oldenburg, Oldenburg, Germany
- Research Center for Neurosensory Science, University of Oldenburg, Oldenburg, Germany
| |
Collapse
|
24
|
de Vries LP, van de Weijer MP, Bartels M. A systematic review of the neural correlates of well-being reveals no consistent associations. Neurosci Biobehav Rev 2023; 145:105036. [PMID: 36621584 DOI: 10.1016/j.neubiorev.2023.105036] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2022] [Revised: 12/20/2022] [Accepted: 01/03/2023] [Indexed: 01/07/2023]
Abstract
Findings from behavioral and genetic studies indicate a potential role for the involvement of brain structures and brain functioning in well-being. We performed a systematic review on the association between brain structures or brain functioning and well-being, including 56 studies. The 11 electroencephalography (EEG) studies suggest a larger alpha asymmetry (more left than right brain activation) to be related to higher well-being. The 18 Magnetic Resonance Imaging (MRI) studies, 26 resting-state functional MRI studies and two functional near-infrared spectroscopy (fNIRS) studies identified a wide range of brain regions involved in well-being, but replication across studies was scarce, both in direction and strength of the associations. The inconsistency could result from small sample sizes of most studies and a possible wide-spread network of brain regions with small effects involved in well-being. Future directions include well-powered brain-wide association studies and innovative methods to more reliably measure brain activity in daily life.
Collapse
Affiliation(s)
- Lianne P de Vries
- Department of Biological Psychology, Vrije Universiteit Amsterdam, the Netherlands; Amsterdam Public Health Research Institute, Amsterdam University Medical Centres, Amsterdam, the Netherlands.
| | - Margot P van de Weijer
- Department of Biological Psychology, Vrije Universiteit Amsterdam, the Netherlands; Amsterdam Public Health Research Institute, Amsterdam University Medical Centres, Amsterdam, the Netherlands
| | - Meike Bartels
- Department of Biological Psychology, Vrije Universiteit Amsterdam, the Netherlands; Amsterdam Public Health Research Institute, Amsterdam University Medical Centres, Amsterdam, the Netherlands
| |
Collapse
|
25
|
Alonso L, Peeva P, Stasko S, Bader M, Alenina N, Winter Y, Rivalan M. Constitutive depletion of brain serotonin differentially affects rats' social and cognitive abilities. iScience 2023; 26:105998. [PMID: 36798444 PMCID: PMC9926123 DOI: 10.1016/j.isci.2023.105998] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2021] [Revised: 09/30/2022] [Accepted: 01/12/2023] [Indexed: 01/19/2023] Open
Abstract
Central serotonin appears a promising transdiagnostic marker of psychiatric disorders and a modulator of some of their key behavioral symptoms. In adult male Tph2 -/- rats, constitutively lacking central serotonin, we tested individual's cognitive, social and non-social abilities and characterized group's social organization under classical and ethological testing conditions. Using unsupervised machine learning, we identified the functions most dependent on serotonin. Although serotonin depletion did not affect cognitive performances in classical testing, in the home-cage it induced compulsive aggression and sexual behavior, hyperactive and hypervigilant stereotyped behavior, reduced self-care and exacerbated corticosterone levels. This profile recalled symptoms of impulse control and anxiety disorders. Serotonin appeared essential for behavioral adaptation to dynamic social environments. Our animal model challenges the essential role of serotonin in decision-making, flexibility, impulsivity, and risk-taking. These findings highlight the importance of studying everyday life functions within the dynamic social living environment to model complexity in animal models.
Collapse
Affiliation(s)
- Lucille Alonso
- Humboldt-Universität zu Berlin, Berlin, Germany,Charité – Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Berlin, Germany
| | - Polina Peeva
- Max Delbrück Center for Molecular Medicine in the Helmholtz Association, Berlin, Germany
| | | | - Michael Bader
- Charité – Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Berlin, Germany,Max Delbrück Center for Molecular Medicine in the Helmholtz Association, Berlin, Germany
| | - Natalia Alenina
- Max Delbrück Center for Molecular Medicine in the Helmholtz Association, Berlin, Germany,Corresponding author
| | - York Winter
- Humboldt-Universität zu Berlin, Berlin, Germany,Charité – Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Berlin, Germany
| | - Marion Rivalan
- Humboldt-Universität zu Berlin, Berlin, Germany,Charité – Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Berlin, Germany,Corresponding author
| |
Collapse
|
26
|
Palenciano AF, Senoussi M, Formica S, González-García C. Canonical template tracking: Measuring the activation state of specific neural representations. FRONTIERS IN NEUROIMAGING 2023; 1:974927. [PMID: 37555182 PMCID: PMC10406196 DOI: 10.3389/fnimg.2022.974927] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/21/2022] [Accepted: 12/13/2022] [Indexed: 08/10/2023]
Abstract
Multivariate analyses of neural data have become increasingly influential in cognitive neuroscience since they allow to address questions about the representational signatures of neurocognitive phenomena. Here, we describe Canonical Template Tracking: a multivariate approach that employs independent localizer tasks to assess the activation state of specific representations during the execution of cognitive paradigms. We illustrate the benefits of this methodology in characterizing the particular content and format of task-induced representations, comparing it with standard (cross-)decoding and representational similarity analyses. Then, we discuss relevant design decisions for experiments using this analysis approach, focusing on the nature of the localizer tasks from which the canonical templates are derived. We further provide a step-by-step tutorial of this method, stressing the relevant analysis choices for functional magnetic resonance imaging and magneto/electroencephalography data. Importantly, we point out the potential pitfalls linked to canonical template tracking implementation and interpretation of the results, together with recommendations to mitigate them. To conclude, we provide some examples from previous literature that highlight the potential of this analysis to address relevant theoretical questions in cognitive neuroscience.
Collapse
Affiliation(s)
- Ana F. Palenciano
- Mind, Brain, and Behavior Research Center, University of Granada, Granada, Spain
| | - Mehdi Senoussi
- CLLE Lab, CNRS UMR 5263, University of Toulouse, Toulouse, France
- Department of Experimental Psychology, Ghent University, Ghent, Belgium
| | - Silvia Formica
- Department of Psychology, Berlin School of Mind and Brain, Humboldt Universität zu Berlin, Berlin, Germany
| | | |
Collapse
|
27
|
Parsons MH, Stryjek R, Bebas P, Fendt M, Blumstein DT, Kiyokawa Y, Chrzanowski MM, Munshi-South J. Why are predator cues in the field not more evocative? A ‘real world’ assay elicits subtle, but meaningful, responses by wild rodents to predator scents. Front Ecol Evol 2023. [DOI: 10.3389/fevo.2022.1054568] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/06/2023] Open
Abstract
Mismatches between highly-standardized laboratory predatory assays and more realistic environmental conditions may lead to different outcomes. Understanding rodents’ natural responses to predator scents is important. Thus, field studies on the same and related species are essential to corroborate laboratory findings to better understand the contexts and motivational drives that affect laboratory responses to predator scents. However, there are too few field assays to enable researchers to study factors that influence these responses in genetically variable populations of wild rodents. Therefore, we placed laboratory-style chambers and remote-sensing devices near multiple colonies of two species of wild mice (Apodemus agrarius and Apodemus flavicollis) to test dual-motivational drives (appetitive and aversive) in a ‘familiar’, yet natural environment. A highly-palatable food reward was offered daily alongside scents from coyotes, lions, rabbits, and both wet and dry controls. In all but two instances (n = 264), animals entered chambers and remained inside for several minutes. Animals initiated flight twice, but they never froze. Rather, they visited chambers more often and stayed inside longer when predatory scents were deployed. The total time spent inside was highest for lion urine (380% longer than the dry control), followed by coyote scent (75% longer), dry control and lastly, herbivore scents (no difference). Once inside the chamber, animals spent more time physically interacting with predatory scents than the herbivore scent or controls. Our findings support the common assumption that rodents fail to respond as overtly to predatory scents in the field compared to what has been observed in the laboratory, possibly due to their varying motivational levels to obtain food. More time spent interacting with scents in the field was likely a function of ‘predator inspection’ (risk assessment) once subjects were in a presumed safe enclosure. We conclude this sort of chamber assay can be useful in understanding the contexts and motivational drives inherent to field studies, and may help interpret laboratory results. Our results also suggest more attention should be given to subtle behaviors such as scent inspection in order to better understand how, and when, environmental stimuli evoke fear in rodents.
Collapse
|
28
|
Yu W, Jiang Y, Wu Y, Cheng Y. Multisensory reading promotion in academic libraries. Front Psychol 2023; 13:987180. [PMID: 36687914 PMCID: PMC9845269 DOI: 10.3389/fpsyg.2022.987180] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2022] [Accepted: 11/23/2022] [Indexed: 01/06/2023] Open
Abstract
To confront college students' new reading patterns and the continuous decline in academic library borrowing rates, we conducted empirical research on promoting multisensory reading as a way to attract students' attention, and to stimulate interest in, and promote the practice of, reading through a library program called "Reading Today Listening Everyday" (RTLE) on a library's WeChat public account. The program involved 48 librarians and 105 students who were recruited into different groups to co-create, edit and release multisensory tweets every workday. Multisensory contents including text-based content, audio-based content and emotional resonance were presented to evoke readers' visual, audio, and emotional senses to induce more reading practice. Using the Context, Input, Process and Product (CIPP) evaluation method, the multisensory presentation in RTLE program was proven to be effective in promoting library reading with a high number of tweeted page views and an increased borrowing rate for recommended books. In 2020, 269 issues accompanied by 269 audio frequencies garnered 80,268 page views, depending on the caliber of the reading promoter out of the 48 librarians and 52 student anchors behind it. The 484 RTLE-recommended books were borrowed 113 times in 2020, which was a rate 1.46 times higher than in 2019 (77 times). The analysis of the relationship between tweet views and borrowing rates for recommended books indicates that more page views indicate greater reader interest, leading to increased borrowing. From readers' feedback and comments, the gain afforded by multisensory reading can improve higher-level reading trends such as the number of reading interests, enjoyment, engagement, etc.
Collapse
|
29
|
Congruence-based contextual plausibility modulates cortical activity during vibrotactile perception in virtual multisensory environments. Commun Biol 2022; 5:1360. [PMID: 36509971 PMCID: PMC9744907 DOI: 10.1038/s42003-022-04318-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2022] [Accepted: 11/29/2022] [Indexed: 12/14/2022] Open
Abstract
How congruence cues and congruence-based expectations may together shape perception in virtual reality (VR) still need to be unravelled. We linked the concept of plausibility used in VR research with congruence-based modulation by assessing brain responses while participants experienced vehicle riding experiences in VR scenarios. Perceptual plausibility was manipulated by sensory congruence, with multisensory stimulations confirming with common expectations of road scenes being plausible. We hypothesized that plausible scenarios would elicit greater cortical responses. The results showed that: (i) vibrotactile stimulations at expected intensities, given embedded audio-visual information, engaged greater cortical activities in frontal and sensorimotor regions; (ii) weaker plausible stimulations resulted in greater responses in the sensorimotor cortex than stronger but implausible stimulations; (iii) frontal activities under plausible scenarios negatively correlated with plausibility violation costs in the sensorimotor cortex. These results potentially indicate frontal regulation of sensory processing and extend previous evidence of contextual modulation to the tactile sense.
Collapse
|
30
|
Abstract
The experimental method has promoted the popularity of neuroscientific research on the human mind. In this interdisciplinary enterprise, the experimental method, with its roots in natural science and experimental psychology, is often uncritically accepted as the royal road to investigate the human mind not only by neuroscientists, but by many philosophers as well, especially those inclined to some form of naturalism. It is rarely disputed that experiments reveal actual states of nature (here: of mind and/or brain). Experimental results are used to picture the human person or subject as an illusionary construct resulting from neuronal interactions. The present paper sketches some of the limitations of neuroscientific experiments in order to demonstrate that cognitive neuroscience is far from relying on firm methodological grounds. Numerous issues still have to be solved, some of which date back to the early days of modern science. At least, to make experiments work, many theoretical presuppositions have to be accepted and decisions of relevance have to be made in the scientific process. This implies that all scientific endeavor is constituted by persons making free decisions for good reasons, despite all reductionist claims to the contrary. The fact that we as scientists have to distinguish relevant from irrelevant aspects of experimental procedures is also crucial for dealing with the current replicability crisis in the life sciences including neuroscience.
Collapse
Affiliation(s)
- Stefan Frisch
- Department of Gerontopsychiatry, Psychosomatic Medicine and Psychotherapy, Pfalzklinikum, Weinstr. 100, 76889, Klingenmünster, Germany.
- Institute of Psychology, Goethe University, Frankfurt am Main, Germany.
| |
Collapse
|
31
|
Volkmer S, Wetzel N, Widmann A, Scharf F. Attentional control in middle childhood is highly dynamic-Strong initial distraction is followed by advanced attention control. Dev Sci 2022; 25:e13275. [PMID: 35538048 DOI: 10.1111/desc.13275] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2021] [Revised: 02/21/2022] [Accepted: 04/22/2022] [Indexed: 01/13/2023]
Abstract
The ability to shield against distraction while focusing on a task requires the operation of executive functions and is essential for successful learning. We investigated the short-term dynamics of distraction control in a data set of 269 children aged 4-10 years and 51 adults pooled from three studies using multilevel models. Participants performed a visual categorization task while a task-irrelevant sequence of sounds was presented which consisted of frequently repeated standard sounds and rarely interspersed novel sounds. On average, participants responded slower in the categorization task after novel sounds. This distraction effect was more pronounced in children. Throughout the experiment, the initially strong distraction effects declined to the level of adults in the groups of 6- to 10-year-olds. Such a decline was neither observed in the groups of the 4- and 5-year-olds, who consistently showed a high level of distraction, nor in adults, who showed a constantly low level of distraction throughout the experimental session. Results indicate that distraction control is a highly dynamic process that qualitatively and quantitatively differs between age groups. We conclude that the analysis of short-term dynamics provides valuable insights into the development of attention control and might explain inconsistent findings regarding distraction control in middle childhood. In addition, models of attention control need to be refined to account for age-dependent rapid learning mechanisms. Our findings have implications for the design of learning situations and provide an additional source of information for the diagnosis and treatment of children with attention deficit disorders.
Collapse
Affiliation(s)
- Sindram Volkmer
- Institute of Psychology, Leipzig University, Leipzig, Germany
| | - Nicole Wetzel
- Leibniz Institute for Neurobiology, Magdeburg, Germany.,Center for Behavioral Brain Sciences Magdeburg, Magdeburg, Germany.,University of Applied Sciences Magdeburg-Stendal, Magdeburg, Germany
| | - Andreas Widmann
- Institute of Psychology, Leipzig University, Leipzig, Germany.,Leibniz Institute for Neurobiology, Magdeburg, Germany
| | - Florian Scharf
- Institute of Psychology, University of Münster, Münster, Germany.,Institute of Psychology, Kassel University, Kassel, Germany
| |
Collapse
|
32
|
Li J, Deng SW. Facilitation and interference effects of the multisensory context on learning: a systematic review and meta-analysis. PSYCHOLOGICAL RESEARCH 2022; 87:1334-1352. [DOI: 10.1007/s00426-022-01733-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2022] [Accepted: 08/28/2022] [Indexed: 11/24/2022]
|
33
|
Xu K, Torgrimson SJ, Torres R, Lenartowicz A, Grammer JK. EEG Data Quality in Real-World Settings: Examining Neural Correlates of Attention in School-Aged Children. MIND, BRAIN AND EDUCATION : THE OFFICIAL JOURNAL OF THE INTERNATIONAL MIND, BRAIN, AND EDUCATION SOCIETY 2022; 16:221-227. [PMID: 38169954 PMCID: PMC10760994 DOI: 10.1111/mbe.12314] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/09/2020] [Accepted: 12/27/2021] [Indexed: 01/05/2024]
Abstract
Advances in mobile electroencephalography (EEG) technology have made it possible to examine covert cognitive processes in real-world settings such as student attention in the classroom. Here, we outline research using wired and wireless EEG technology to examine attention in elementary school children across increasingly naturalistic paradigms in schools, ranging from a lab-based paradigm where children met one-on-one with an experimenter in a field laboratory to mobile EEG testing conducted in the same school during semi-naturalistic classroom lessons. Despite an increase of data loss with the classroom-based paradigm, we demonstrate that it is feasible to collect quality data in classroom settings with young children. We also provide a test case for how robust EEG signals, such as alpha oscillations, can be used to identify measurable differences in covert processes like attention in classrooms. We end with pragmatic suggestions for researchers interested in employing naturalistic EEG methods in real-world, multisensory contexts.
Collapse
Affiliation(s)
- Keye Xu
- School of Education and Information Studies, University of California, Los Angeles
| | - Sarah Jo Torgrimson
- School of Education and Information Studies, University of California, Los Angeles
| | - Remi Torres
- School of Education and Information Studies, University of California, Los Angeles
| | - Agatha Lenartowicz
- Semel Institute for Neuroscience and Behavior, University of California, Los Angeles
| | - Jennie K. Grammer
- School of Education and Information Studies, University of California, Los Angeles
| |
Collapse
|
34
|
Kirwan CB, Vance A, Jenkins JL, Anderson BB. Embracing brain and behaviour: Designing programs of complementary neurophysiological and behavioural studies. INFORMATION SYSTEMS JOURNAL 2022. [DOI: 10.1111/isj.12402] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Affiliation(s)
- C. Brock Kirwan
- Department of Psychology and Neuroscience Center Brigham Young University Provo Utah USA
| | - Anthony Vance
- Department of Business Information Technology Pamplin College of Business, Virginia Tech Blacksburg Virginia USA
| | - Jeffrey L. Jenkins
- Information Systems Department, Marriott School of Business Brigham Young University Provo Utah USA
| | - Bonnie Brinton Anderson
- Information Systems Department, Marriott School of Business Brigham Young University Provo Utah USA
| |
Collapse
|
35
|
Mercier MR, Dubarry AS, Tadel F, Avanzini P, Axmacher N, Cellier D, Vecchio MD, Hamilton LS, Hermes D, Kahana MJ, Knight RT, Llorens A, Megevand P, Melloni L, Miller KJ, Piai V, Puce A, Ramsey NF, Schwiedrzik CM, Smith SE, Stolk A, Swann NC, Vansteensel MJ, Voytek B, Wang L, Lachaux JP, Oostenveld R. Advances in human intracranial electroencephalography research, guidelines and good practices. Neuroimage 2022; 260:119438. [PMID: 35792291 DOI: 10.1016/j.neuroimage.2022.119438] [Citation(s) in RCA: 41] [Impact Index Per Article: 20.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2021] [Revised: 05/23/2022] [Accepted: 06/30/2022] [Indexed: 12/11/2022] Open
Abstract
Since the second-half of the twentieth century, intracranial electroencephalography (iEEG), including both electrocorticography (ECoG) and stereo-electroencephalography (sEEG), has provided an intimate view into the human brain. At the interface between fundamental research and the clinic, iEEG provides both high temporal resolution and high spatial specificity but comes with constraints, such as the individual's tailored sparsity of electrode sampling. Over the years, researchers in neuroscience developed their practices to make the most of the iEEG approach. Here we offer a critical review of iEEG research practices in a didactic framework for newcomers, as well addressing issues encountered by proficient researchers. The scope is threefold: (i) review common practices in iEEG research, (ii) suggest potential guidelines for working with iEEG data and answer frequently asked questions based on the most widespread practices, and (iii) based on current neurophysiological knowledge and methodologies, pave the way to good practice standards in iEEG research. The organization of this paper follows the steps of iEEG data processing. The first section contextualizes iEEG data collection. The second section focuses on localization of intracranial electrodes. The third section highlights the main pre-processing steps. The fourth section presents iEEG signal analysis methods. The fifth section discusses statistical approaches. The sixth section draws some unique perspectives on iEEG research. Finally, to ensure a consistent nomenclature throughout the manuscript and to align with other guidelines, e.g., Brain Imaging Data Structure (BIDS) and the OHBM Committee on Best Practices in Data Analysis and Sharing (COBIDAS), we provide a glossary to disambiguate terms related to iEEG research.
Collapse
|
36
|
Armeni K, Güçlü U, van Gerven M, Schoffelen JM. A 10-hour within-participant magnetoencephalography narrative dataset to test models of language comprehension. Sci Data 2022; 9:278. [PMID: 35676293 PMCID: PMC9177538 DOI: 10.1038/s41597-022-01382-7] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2021] [Accepted: 05/10/2022] [Indexed: 11/13/2022] Open
Abstract
Recently, cognitive neuroscientists have increasingly studied the brain responses to narratives. At the same time, we are witnessing exciting developments in natural language processing where large-scale neural network models can be used to instantiate cognitive hypotheses in narrative processing. Yet, they learn from text alone and we lack ways of incorporating biological constraints during training. To mitigate this gap, we provide a narrative comprehension magnetoencephalography (MEG) data resource that can be used to train neural network models directly on brain data. We recorded from 3 participants, 10 separate recording hour-long sessions each, while they listened to audiobooks in English. After story listening, participants answered short questions about their experience. To minimize head movement, the participants wore MEG-compatible head casts, which immobilized their head position during recording. We report a basic evoked-response analysis showing that the responses accurately localize to primary auditory areas. The responses are robust and conserved across 10 sessions for every participant. We also provide usage notes and briefly outline possible future uses of the resource.
Collapse
Affiliation(s)
- Kristijan Armeni
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
| | - Umut Güçlü
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
| | - Marcel van Gerven
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
| | - Jan-Mathijs Schoffelen
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands.
| |
Collapse
|
37
|
Tucek G, Maidhof C, Vogl J, Heine A, Zeppelzauer M, Steinhoff N, Fachner J. EEG Hyperscanning and Qualitative Analysis of Moments of Interest in Music Therapy for Stroke Rehabilitation—A Feasibility Study. Brain Sci 2022; 12:brainsci12050565. [PMID: 35624953 PMCID: PMC9139517 DOI: 10.3390/brainsci12050565] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2022] [Revised: 04/23/2022] [Accepted: 04/24/2022] [Indexed: 02/04/2023] Open
Abstract
Interdisciplinary research into the underlying neural processes of music therapy (MT) and subjective experiences of patients and therapists are largely lacking. The aim of the current study was to assess the feasibility of newly developed procedures (including electroencephalography/electrocardiography hyperscanning, synchronous audio–video monitoring, and qualitative interviews) to study the personal experiences and neuronal dynamics of moments of interest during MT with stroke survivors. The feasibility of our mobile setup and procedures as well as their clinical implementation in a rehabilitation centre and an acute hospital ward were tested with four phase C patients. Protocols and interviews were used for the documentation and analysis of the feasibility. Recruiting patients for MT sessions was feasible, although data collection on three consecutive weeks was not always possible due to organisational constraints, especially in the hospital with acute ward routines. Research procedures were successfully implemented, and according to interviews, none of the patients reported any burden, tiredness, or increased stress due to the research procedures, which lasted approx. 3 h (ranging from 135 min to 209 min) for each patient. Implementing the research procedures in a rehabilitation unit with stroke patients was feasible, and only small adaptations were made for further research.
Collapse
Affiliation(s)
- Gerhard Tucek
- Josef Ressel Centre for Horizons of Personalised Music Therapy, Department of Health Sciences, Institute for Therapeutic Sciences, IMC University of Applied Sciences Krems, 3500 Krems, Austria; (G.T.); (C.M.); (J.V.); (A.H.)
| | - Clemens Maidhof
- Josef Ressel Centre for Horizons of Personalised Music Therapy, Department of Health Sciences, Institute for Therapeutic Sciences, IMC University of Applied Sciences Krems, 3500 Krems, Austria; (G.T.); (C.M.); (J.V.); (A.H.)
- Cambridge Institute for Music Therapy Research, Anglia Ruskin University, Cambridge CB1 2LZ, UK
| | - Julia Vogl
- Josef Ressel Centre for Horizons of Personalised Music Therapy, Department of Health Sciences, Institute for Therapeutic Sciences, IMC University of Applied Sciences Krems, 3500 Krems, Austria; (G.T.); (C.M.); (J.V.); (A.H.)
| | - Astrid Heine
- Josef Ressel Centre for Horizons of Personalised Music Therapy, Department of Health Sciences, Institute for Therapeutic Sciences, IMC University of Applied Sciences Krems, 3500 Krems, Austria; (G.T.); (C.M.); (J.V.); (A.H.)
| | - Matthias Zeppelzauer
- Department of Media & Digital Technologies, Institute of Creative Media Technologies, St. Poelten University of Applied Sciences, 3100 St. Poelten, Austria;
| | - Nikolaus Steinhoff
- OptimaMed Neurological Rehabilitation Centre Kittsee GmbH, 2421 Kittsee, Austria;
| | - Jörg Fachner
- Josef Ressel Centre for Horizons of Personalised Music Therapy, Department of Health Sciences, Institute for Therapeutic Sciences, IMC University of Applied Sciences Krems, 3500 Krems, Austria; (G.T.); (C.M.); (J.V.); (A.H.)
- Cambridge Institute for Music Therapy Research, Anglia Ruskin University, Cambridge CB1 2LZ, UK
- Correspondence: ; Tel.: +44-1223-698-416
| |
Collapse
|
38
|
Tibon R, Geerligs L, Campbell K. Bridging the big (data) gap: levels of control in small- and large-scale cognitive neuroscience research. Trends Neurosci 2022; 45:507-516. [DOI: 10.1016/j.tins.2022.03.011] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2021] [Revised: 03/11/2022] [Accepted: 03/29/2022] [Indexed: 12/16/2022]
|
39
|
Palacios-García I, Mhuireach GA, Grasso-Cladera A, Cryan JF, Parada FJ. The 4E approach to the human microbiome: Nested interactions between the gut-brain/body system within natural and built environments. Bioessays 2022; 44:e2100249. [PMID: 35338496 DOI: 10.1002/bies.202100249] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2021] [Revised: 03/13/2022] [Accepted: 03/15/2022] [Indexed: 12/17/2022]
Abstract
The complexity of the human mind and its interaction with the environment is one of the main epistemological debates throughout history. Recent ideas, framed as the 4E perspective to cognition, highlight that human experience depends causally on both cerebral and extracranial processes, but also is embedded in a particular sociomaterial context and is a product of historical accumulation of trajectory changes throughout life. Accordingly, the human microbiome is one of the most intriguing actors modulating brain function and physiology. Here, we present the 4E approach to the Human Microbiome for understanding mental processes from a broader perspective, encompassing one's body physiology and environment throughout their lifespan, interconnected by microbiome community structure and dynamics. We review evidence supporting the approach theoretically and motivates the study of the global set of microbial ecosystem networks encountered by a person across their lifetime (from skin to gut to natural and built environments). We furthermore trace future empirical implementation of the approach. We finally discuss novel research opportunities and clinical interventions aimed toward developing low-cost/high-benefit integrative and personalized bio-psycho-socio-environmental treatments for mental health and including the brain-gut-microbiome axis.
Collapse
Affiliation(s)
- Ismael Palacios-García
- Centro de Estudios en Neurociencia Humana y Neuropsicología. Facultad de Psicología, Universidad Diego Portales, Santiago, Chile.,Laboratorio de Psicofisiología, Escuela de Psicología, Pontificia Universidad Católica de Chile, Santiago, Chile
| | - Gwynne A Mhuireach
- Biology and the Built Environment Center, University of Oregon, Oregon, USA
| | - Aitana Grasso-Cladera
- Centro de Estudios en Neurociencia Humana y Neuropsicología. Facultad de Psicología, Universidad Diego Portales, Santiago, Chile
| | - John F Cryan
- Department of Anatomy & Neuroscience, School of Medicine, College of Medicine & Health, University College Cork, Cork, Ireland.,APC Microbiome Ireland, University College Cork, Cork, Ireland
| | - Francisco J Parada
- Centro de Estudios en Neurociencia Humana y Neuropsicología. Facultad de Psicología, Universidad Diego Portales, Santiago, Chile
| |
Collapse
|
40
|
Kumar M, Anderson MJ, Antony JW, Baldassano C, Brooks PP, Cai MB, Chen PHC, Ellis CT, Henselman-Petrusek G, Huberdeau D, Hutchinson JB, Li YP, Lu Q, Manning JR, Mennen AC, Nastase SA, Richard H, Schapiro AC, Schuck NW, Shvartsman M, Sundaram N, Suo D, Turek JS, Turner D, Vo VA, Wallace G, Wang Y, Williams JA, Zhang H, Zhu X, Capota˘ M, Cohen JD, Hasson U, Li K, Ramadge PJ, Turk-Browne NB, Willke TL, Norman KA. BrainIAK: The Brain Imaging Analysis Kit. APERTURE NEURO 2022; 1. [PMID: 35939268 PMCID: PMC9351935 DOI: 10.52294/31bb5b68-2184-411b-8c00-a1dacb61e1da] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/01/2022]
Abstract
Functional magnetic resonance imaging (fMRI) offers a rich source of data for studying the neural basis of cognition. Here, we describe the Brain Imaging Analysis Kit (BrainIAK), an open-source, free Python package that provides computationally optimized solutions to key problems in advanced fMRI analysis. A variety of techniques are presently included in BrainIAK: intersubject correlation (ISC) and intersubject functional connectivity (ISFC), functional alignment via the shared response model (SRM), full correlation matrix analysis (FCMA), a Bayesian version of representational similarity analysis (BRSA), event segmentation using hidden Markov models, topographic factor analysis (TFA), inverted encoding models (IEMs), an fMRI data simulator that uses noise characteristics from real data (fmrisim), and some emerging methods. These techniques have been optimized to leverage the efficiencies of high-performance compute (HPC) clusters, and the same code can be seamlessly transferred from a laptop to a cluster. For each of the aforementioned techniques, we describe the data analysis problem that the technique is meant to solve and how it solves that problem; we also include an example Jupyter notebook for each technique and an annotated bibliography of papers that have used and/or described that technique. In addition to the sections describing various analysis techniques in BrainIAK, we have included sections describing the future applications of BrainIAK to real-time fMRI, tutorials that we have developed and shared online to facilitate learning the techniques in BrainIAK, computational innovations in BrainIAK, and how to contribute to BrainIAK. We hope that this manuscript helps readers to understand how BrainIAK might be useful in their research.
Collapse
Affiliation(s)
- Manoj Kumar
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ
| | - Michael J. Anderson
- Work done while at Parallel Computing Lab, Intel Corporation, Santa Clara, CA
| | - James W. Antony
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ
| | | | - Paula P. Brooks
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ
| | - Ming Bo Cai
- International Research Center for Neurointelligence (WPI-IRCN), UTIAS, The University of Tokyo, Japan
| | - Po-Hsuan Cameron Chen
- Work done while at Princeton Neuroscience Institute, Princeton University, Princeton, NJ
| | | | | | | | | | - Y. Peeta Li
- Department of Psychology, University of Oregon, Eugene, OR
| | - Qihong Lu
- Department of Psychology, Princeton University, Princeton, NJ
| | - Jeremy R. Manning
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH
| | - Anne C. Mennen
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ
| | - Samuel A. Nastase
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ
| | - Hugo Richard
- Parietal Team, Inria, Neurospin, CEA, Université Paris-Saclay, France
| | - Anna C. Schapiro
- Department of Psychology, University of Pennsylvania, Philadelphia, PA
| | - Nicolas W. Schuck
- Max Planck Research Group NeuroCode, Max Planck Institute for Human Development, Berlin, Germany; Max Planck UCL Centre for Computational Psychiatry and Ageing Research, Berlin, Germany
| | - Michael Shvartsman
- Work done while at Princeton Neuroscience Institute, Princeton University, Princeton, NJ
| | - Narayanan Sundaram
- Work done while at Parallel Computing Lab, Intel Corporation, Santa Clara, CA
| | - Daniel Suo
- epartment of Computer Science, Princeton University, Princeton, NJ
| | - Javier S. Turek
- Brain-Inspired Computing Lab, Intel Corporation, Hillsboro, OR
| | - David Turner
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ
| | - Vy A. Vo
- Brain-Inspired Computing Lab, Intel Corporation, Hillsboro, OR
| | - Grant Wallace
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ
| | - Yida Wang
- Work done while at Parallel Computing Lab, Intel Corporation, Santa Clara, CA
| | - Jamal A. Williams
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ; Department of Psychology, Princeton University, Princeton, NJ
| | - Hejia Zhang
- Work done while at Princeton Neuroscience Institute, Princeton University, Princeton, NJ
| | - Xia Zhu
- Brain-Inspired Computing Lab, Intel Corporation, Hillsboro, OR
| | - Mihai Capota˘
- Brain-Inspired Computing Lab, Intel Corporation, Hillsboro, OR
| | - Jonathan D. Cohen
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ; Department of Psychology, Princeton University, Princeton, NJ
| | - Uri Hasson
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ; Department of Psychology, Princeton University, Princeton, NJ
| | - Kai Li
- Department of Computer Science, Princeton University, Princeton, NJ
| | - Peter J. Ramadge
- Department of Electrical Engineering, and the Center for Statistics and Machine Learning, Princeton University, Princeton, NJ
| | | | | | - Kenneth A. Norman
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ; Department of Psychology, Princeton University, Princeton, NJ
| |
Collapse
|
41
|
Towards real-world neuroscience using mobile EEG and augmented reality. Sci Rep 2022; 12:2291. [PMID: 35145166 PMCID: PMC8831466 DOI: 10.1038/s41598-022-06296-3] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2021] [Accepted: 01/25/2022] [Indexed: 01/10/2023] Open
Abstract
Our visual environment impacts multiple aspects of cognition including perception, attention and memory, yet most studies traditionally remove or control the external environment. As a result, we have a limited understanding of neurocognitive processes beyond the controlled lab environment. Here, we aim to study neural processes in real-world environments, while also maintaining a degree of control over perception. To achieve this, we combined mobile EEG (mEEG) and augmented reality (AR), which allows us to place virtual objects into the real world. We validated this AR and mEEG approach using a well-characterised cognitive response-the face inversion effect. Participants viewed upright and inverted faces in three EEG tasks (1) a lab-based computer task, (2) walking through an indoor environment while seeing face photographs, and (3) walking through an indoor environment while seeing virtual faces. We find greater low frequency EEG activity for inverted compared to upright faces in all experimental tasks, demonstrating that cognitively relevant signals can be extracted from mEEG and AR paradigms. This was established in both an epoch-based analysis aligned to face events, and a GLM-based approach that incorporates continuous EEG signals and face perception states. Together, this research helps pave the way to exploring neurocognitive processes in real-world environments while maintaining experimental control using AR.
Collapse
|
42
|
Mangalam M, Fragaszy DM, Wagman JB, Day BM, Kelty-Stephen DG, Bongers RM, Stout DW, Osiurak F. On the psychological origins of tool use. Neurosci Biobehav Rev 2022; 134:104521. [PMID: 34998834 DOI: 10.1016/j.neubiorev.2022.104521] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2021] [Revised: 12/01/2021] [Accepted: 01/01/2022] [Indexed: 01/13/2023]
Abstract
The ubiquity of tool use in human life has generated multiple lines of scientific and philosophical investigation to understand the development and expression of humans' engagement with tools and its relation to other dimensions of human experience. However, existing literature on tool use faces several epistemological challenges in which the same set of questions generate many different answers. At least four critical questions can be identified, which are intimately intertwined-(1) What constitutes tool use? (2) What psychological processes underlie tool use in humans and nonhuman animals? (3) Which of these psychological processes are exclusive to tool use? (4) Which psychological processes involved in tool use are exclusive to Homo sapiens? To help advance a multidisciplinary scientific understanding of tool use, six author groups representing different academic disciplines (e.g., anthropology, psychology, neuroscience) and different theoretical perspectives respond to each of these questions, and then point to the direction of future work on tool use. We find that while there are marked differences among the responses of the respective author groups to each question, there is a surprising degree of agreement about many essential concepts and questions. We believe that this interdisciplinary and intertheoretical discussion will foster a more comprehensive understanding of tool use than any one of these perspectives (or any one of these author groups) would (or could) on their own.
Collapse
Affiliation(s)
- Madhur Mangalam
- Department of Physical Therapy, Movement and Rehabilitation Science, Northeastern University, Boston, Massachusetts 02115, USA.
| | | | - Jeffrey B Wagman
- Department of Psychology, Illinois State University, Normal, IL 61761, USA
| | - Brian M Day
- Department of Psychology, Butler University, Indianapolis, IN 46208, USA
| | | | - Raoul M Bongers
- Department of Human Movement Sciences, University Medical Center Groningen, University of Groningen, 9713 GZ Groningen, Netherlands
| | - Dietrich W Stout
- Department of Anthropology, Emory University, Atlanta, GA 30322, USA
| | - François Osiurak
- Laboratoire d'Etude des Mécanismes Cognitifs, Université de Lyon, Lyon 69361, France; Institut Universitaire de France, Paris 75231, France
| |
Collapse
|
43
|
Ancora LA, Blanco-Mora DA, Alves I, Bonifácio A, Morgado P, Miranda B. Cities and neuroscience research: A systematic literature review. Front Psychiatry 2022; 13:983352. [PMID: 36440407 PMCID: PMC9684645 DOI: 10.3389/fpsyt.2022.983352] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/30/2022] [Accepted: 10/21/2022] [Indexed: 11/11/2022] Open
Abstract
BACKGROUND Cities are becoming the socio-economic hubs for most of the world's population. Understanding how our surroundings can mentally affect everyday life has become crucial to integrate environmental sustainability into urban development. The present review aims to explore the empirical studies investigating neural mechanisms underlying cognitive and emotional processes elicited by the exposure to different urban built and natural spaces. It also tries to identify new research questions and to leverage neurourbanism as a framework to achieve healthier and sustainable cities. METHODS By following the PRISMA framework, we conducted a structured search on PubMed, ProQuest, Web of Science, and Scopus databases. Only articles related to how urban environment-built or natural-affects brain activity through objective measurement (with either imaging or electrophysiological techniques) were considered. Further inclusion criteria were studies on human adult populations, peer-reviewed, and in English language. RESULTS Sixty-two articles met the inclusion criteria. They were qualitatively assessed and analyzed to determine the main findings and emerging concepts. Overall, the results suggest that urban built exposure (when compared to natural spaces) elicit activations in brain regions or networks strongly related to perceptual, attentional, and (spatial) cognitive demands. The city's-built environment also triggers neural circuits linked to stress and negative affect. Convergence of these findings was observed across neuroscience techniques, and for both laboratory and real-life settings. Additionally, evidence also showed associations between neural social stress processing with urban upbringing or current city living-suggesting a mechanistic link to certain mood and anxiety disorders. Finally, environmental diversity was found to be critical for positive affect and individual well-being. CONCLUSION Contemporary human-environment interactions and planetary challenges imply greater understanding of the neurological underpinnings on how the urban space affects cognition and emotion. This review provides scientific evidence that could be applied for policy making on improved urban mental health. Several studies showed that high-quality green or blue spaces, and bio-diverse urban areas, are important allies for positive neural, cognitive, and emotional processes. Nonetheless, the spatial perception in social contexts (e.g., city overcrowding) deserves further attention by urban planners and scientists. The implications of these observations for some theories in environmental psychology and research are discussed. Future work should take advantage of technological advancements to better characterize behavior, brain physiology, and environmental factors and apply them to the remaining complexity of contemporary cities.
Collapse
Affiliation(s)
- Leonardo A Ancora
- Institute of Physiology, Lisbon School of Medicine, University of Lisbon, Lisbon, Portugal
| | | | - Inês Alves
- Institute of Molecular Medicine, Lisbon School of Medicine, University of Lisbon, Lisbon, Portugal
| | - Ana Bonifácio
- Centre of Geographical Studies, Institute of Geography and Spatial Planning, University of Lisbon, Lisbon, Portugal
| | - Paulo Morgado
- Centre of Geographical Studies, Institute of Geography and Spatial Planning, University of Lisbon, Lisbon, Portugal
| | - Bruno Miranda
- Institute of Physiology, Lisbon School of Medicine, University of Lisbon, Lisbon, Portugal.,Institute of Molecular Medicine, Lisbon School of Medicine, University of Lisbon, Lisbon, Portugal
| |
Collapse
|
44
|
A Review of EEG and fMRI Measuring Aesthetic Processing in Visual User Experience Research. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2021; 2021:2070209. [PMID: 34956344 PMCID: PMC8702354 DOI: 10.1155/2021/2070209] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/28/2021] [Accepted: 11/21/2021] [Indexed: 11/18/2022]
Abstract
In human-computer interaction, the visual interaction of user experience (UX) and user interface (UI) plays an important role in enriching the quality of daily life. The purpose of our study analyzes the use of brain-computer interface (BCI), wearable technology, and functional magnetic resonance imaging (fMRI) to explore the aesthetic processing of visual neural response to UI and UX designs. Specifically, this review aims to understand neuroaesthetic processing knowledge, aesthetic appreciation models, and the ways in which visual brain studies can improve the quality of current and future UI and UX designs. Recent research has found that subjective evaluations of aesthetic appreciation produce different results for objective evaluations of brain research analysis. We applied SWOT analysis and examined the advantages and disadvantages of both evaluation methods. Furthermore, we conducted a traditional literature review on topics pertaining to the use of aesthetic processing knowledge in the visual interaction field in terms of art therapy, information visualization, website or mobile applications, and other interactive platforms. Our main research findings from current studies have helped and motivated researchers and designers to use convincing scientific knowledge of brain event-related potential, electroencephalography, and fMRI to understand aesthetic judgment. The key trend finds that many designers, artists, and engineers use artistic BCI technology in the visual interaction experience. Herein, the scientific methods applied in the aesthetic appreciation to human-computer interface are summarized, and the influence of the latest wearable brain technology on visual interaction design is discussed. Furthermore, current possible research entry points for aesthetics, usability, and creativity in UI and UX designs are explicated. The study results have implications for the visual user experience research domain as well as for interaction industries, which produce interactive projects to improve people's daily lives.
Collapse
|
45
|
Turoman N, Tivadar RI, Retsa C, Murray MM, Matusz PJ. Towards understanding how we pay attention in naturalistic visual search settings. Neuroimage 2021; 244:118556. [PMID: 34492292 DOI: 10.1016/j.neuroimage.2021.118556] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2020] [Revised: 08/31/2021] [Accepted: 09/03/2021] [Indexed: 10/20/2022] Open
Abstract
Research on attentional control has largely focused on single senses and the importance of behavioural goals in controlling attention. However, everyday situations are multisensory and contain regularities, both likely influencing attention. We investigated how visual attentional capture is simultaneously impacted by top-down goals, the multisensory nature of stimuli, and the contextual factors of stimuli's semantic relationship and temporal predictability. Participants performed a multisensory version of the Folk et al. (1992) spatial cueing paradigm, searching for a target of a predefined colour (e.g. a red bar) within an array preceded by a distractor. We manipulated: 1) stimuli's goal-relevance via distractor's colour (matching vs. mismatching the target), 2) stimuli's multisensory nature (colour distractors appearing alone vs. with tones), 3) the relationship between the distractor sound and colour (arbitrary vs. semantically congruent) and 4) the temporal predictability of distractor onset. Reaction-time spatial cueing served as a behavioural measure of attentional selection. We also recorded 129-channel event-related potentials (ERPs), analysing the distractor-elicited N2pc component both canonically and using a multivariate electrical neuroimaging framework. Behaviourally, arbitrary target-matching distractors captured attention more strongly than semantically congruent ones, with no evidence for context modulating multisensory enhancements of capture. Notably, electrical neuroimaging of surface-level EEG analyses revealed context-based influences on attention to both visual and multisensory distractors, in how strongly they activated the brain and type of activated brain networks. For both processes, the context-driven brain response modulations occurred long before the N2pc time-window, with topographic (network-based) modulations at ∼30 ms, followed by strength-based modulations at ∼100 ms post-distractor onset. Our results reveal that both stimulus meaning and predictability modulate attentional selection, and they interact while doing so. Meaning, in addition to temporal predictability, is thus a second source of contextual information facilitating goal-directed behaviour. More broadly, in everyday situations, attention is controlled by an interplay between one's goals, stimuli's perceptual salience, meaning and predictability. Our study calls for a revision of attentional control theories to account for the role of contextual and multisensory control.
Collapse
Affiliation(s)
- Nora Turoman
- The LINE (Laboratory for Investigative Neurophysiology), Department of Radiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland; MEDGIFT Lab, Institute of Information Systems, School of Management, HES-SO Valais-Wallis University of Applied Sciences and Arts Western Switzerland, Techno-Pôle 3, 3960 Sierre, Switzerland; Working Memory, Cognition and Development lab, Department of Psychology and Educational Sciences, University of Geneva, Geneva, Switzerland
| | - Ruxandra I Tivadar
- The LINE (Laboratory for Investigative Neurophysiology), Department of Radiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland; Department of Ophthalmology, Fondation Asile des Aveugles, Lausanne, Switzerland; Cognitive Computational Neuroscience group, Institute of Computer Science, Faculty of Science, University of Bern, Switzerland
| | - Chrysa Retsa
- The LINE (Laboratory for Investigative Neurophysiology), Department of Radiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland; CIBM Center for Biomedical Imaging, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland
| | - Micah M Murray
- The LINE (Laboratory for Investigative Neurophysiology), Department of Radiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland; Department of Ophthalmology, Fondation Asile des Aveugles, Lausanne, Switzerland; CIBM Center for Biomedical Imaging, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland; Department of Hearing and Speech Sciences, Vanderbilt University, Nashville, TN, USA
| | - Pawel J Matusz
- The LINE (Laboratory for Investigative Neurophysiology), Department of Radiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland; MEDGIFT Lab, Institute of Information Systems, School of Management, HES-SO Valais-Wallis University of Applied Sciences and Arts Western Switzerland, Techno-Pôle 3, 3960 Sierre, Switzerland; Department of Hearing and Speech Sciences, Vanderbilt University, Nashville, TN, USA
| |
Collapse
|
46
|
Janssen TW, Grammer JK, Bleichner MG, Bulgarelli C, Davidesco I, Dikker S, Jasińska KK, Siugzdaite R, Vassena E, Vatakis A, Zion‐Golumbic E, van Atteveldt N. Opportunities and Limitations of Mobile Neuroimaging Technologies in Educational Neuroscience. MIND, BRAIN AND EDUCATION : THE OFFICIAL JOURNAL OF THE INTERNATIONAL MIND, BRAIN, AND EDUCATION SOCIETY 2021; 15:354-370. [PMID: 35875415 PMCID: PMC9292610 DOI: 10.1111/mbe.12302] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/11/2020] [Revised: 06/18/2021] [Accepted: 09/01/2021] [Indexed: 05/20/2023]
Abstract
As the field of educational neuroscience continues to grow, questions have emerged regarding the ecological validity and applicability of this research to educational practice. Recent advances in mobile neuroimaging technologies have made it possible to conduct neuroscientific studies directly in naturalistic learning environments. We propose that embedding mobile neuroimaging research in a cycle (Matusz, Dikker, Huth, & Perrodin, 2019), involving lab-based, seminaturalistic, and fully naturalistic experiments, is well suited for addressing educational questions. With this review, we take a cautious approach, by discussing the valuable insights that can be gained from mobile neuroimaging technology, including electroencephalography and functional near-infrared spectroscopy, as well as the challenges posed by bringing neuroscientific methods into the classroom. Research paradigms used alongside mobile neuroimaging technology vary considerably. To illustrate this point, studies are discussed with increasingly naturalistic designs. We conclude with several ethical considerations that should be taken into account in this unique area of research.
Collapse
Affiliation(s)
- Tieme W.P. Janssen
- Department of Clinical, Neuro‐ & Developmental Psychology, Vrije Universiteit
| | - Jennie K. Grammer
- Graduate School of Education and Information Studies, University of California Los Angeles
| | | | - Chiara Bulgarelli
- Centre for Brain and Cognitive Development, Birkbeck University of London
| | - Ido Davidesco
- Department of Educational Psychology, University of Connecticut
| | | | - Kaja K. Jasińska
- Department of Applied Psychology and Human Development, University of Toronto
| | | | - Eliana Vassena
- Donders Institute for Brain, Cognition and Behaviour, Radboud University
| | | | | | | |
Collapse
|
47
|
Lende DH, Casper BI, Hoyt KB, Collura GL. Elements of Neuroanthropology. Front Psychol 2021; 12:509611. [PMID: 34712160 PMCID: PMC8545903 DOI: 10.3389/fpsyg.2021.509611] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2019] [Accepted: 07/26/2021] [Indexed: 11/16/2022] Open
Abstract
Neuroanthropology is the integration of neuroscience into anthropology and aims to understand “brains in the wild.” This interdisciplinary field examines patterns of human variation in field settings and provides empirical research that complements work done in clinical and laboratory settings. Neuroanthropology often uses ethnography in combination with theories and methods from cognitive science as a way to capture how culture, mind, and brain interact. This article describes nine elements that outline how to do neuroanthropology research: (1) integrating biology and culture through neuroscience and biocultural anthropology; (2) extending focus of anthropology on what people say and do to include what people process; (3) sizing culture appropriately, from broad patterns of culture to culture in small-scale settings; (4) understanding patterns of cultural variation, in particular how culture produces patterns of shared variation; (5) considering individuals in interaction with culture, with levels of analysis that can go from biology to social structures; (6) focusing on interactive elements that bring together biological and cultural processes; (7) conceptual triangulation, which draws on anthropology, psychology, and neuroscience in conjunction with field, clinic, and laboratory; (8) critical complementarity as a way to integrate the strengths of critical scholarship with interdisciplinary work; and (9) using methodological triangulation as a way to advance interdisciplinary research. These elements are illustrated through three case studies: research on US combat veterans and how they use Brazilian Jiu Jitsu as a way to manage the transition to becoming civilians, work on human-raptor interactions to understand how and why these interactions can prove beneficial for human handlers, and adapting cue reactivity research on addiction to a field-based approach to understand how people interact with cues in naturalistic settings.
Collapse
Affiliation(s)
- Daniel H Lende
- Department of Anthropology, University of South Florida, Tampa, FL, United States
| | - Breanne I Casper
- Department of Anthropology, University of South Florida, Tampa, FL, United States
| | - Kaleigh B Hoyt
- Department of Anthropology, University of South Florida, Tampa, FL, United States
| | - Gino L Collura
- Department of Anthropology, University of South Florida, Tampa, FL, United States
| |
Collapse
|
48
|
Hofmann SM, Klotzsche F, Mariola A, Nikulin V, Villringer A, Gaebler M. Decoding subjective emotional arousal from EEG during an immersive virtual reality experience. eLife 2021; 10:e64812. [PMID: 34708689 PMCID: PMC8673835 DOI: 10.7554/elife.64812] [Citation(s) in RCA: 24] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2020] [Accepted: 10/27/2021] [Indexed: 02/06/2023] Open
Abstract
Immersive virtual reality (VR) enables naturalistic neuroscientific studies while maintaining experimental control, but dynamic and interactive stimuli pose methodological challenges. We here probed the link between emotional arousal, a fundamental property of affective experience, and parieto-occipital alpha power under naturalistic stimulation: 37 young healthy adults completed an immersive VR experience, which included rollercoaster rides, while their EEG was recorded. They then continuously rated their subjective emotional arousal while viewing a replay of their experience. The association between emotional arousal and parieto-occipital alpha power was tested and confirmed by (1) decomposing the continuous EEG signal while maximizing the comodulation between alpha power and arousal ratings and by (2) decoding periods of high and low arousal with discriminative common spatial patterns and a long short-term memory recurrent neural network. We successfully combine EEG and a naturalistic immersive VR experience to extend previous findings on the neurophysiology of emotional arousal towards real-world neuroscience.
Collapse
Affiliation(s)
- Simon M Hofmann
- Department of Neurology, Max Planck Institute for Human Cognitive and Brain SciencesLeipzigGermany
| | - Felix Klotzsche
- Department of Neurology, Max Planck Institute for Human Cognitive and Brain SciencesLeipzigGermany
- Humboldt-Universität zu Berlin, Faculty of Philosophy, Berlin School of Mind and BrainBerlinGermany
| | - Alberto Mariola
- Sackler Centre for Consciousness Science, School of Engineering and Informatics, University of SussexBrightonUnited Kingdom
- Sussex Neuroscience, School of Life Sciences, University of SussexBrightonUnited Kingdom
| | - Vadim Nikulin
- Department of Neurology, Max Planck Institute for Human Cognitive and Brain SciencesLeipzigGermany
- Bernstein Center for Computational Neuroscience BerlinBerlinGermany
| | - Arno Villringer
- Department of Neurology, Max Planck Institute for Human Cognitive and Brain SciencesLeipzigGermany
- Humboldt-Universität zu Berlin, Faculty of Philosophy, Berlin School of Mind and BrainBerlinGermany
| | - Michael Gaebler
- Department of Neurology, Max Planck Institute for Human Cognitive and Brain SciencesLeipzigGermany
- Humboldt-Universität zu Berlin, Faculty of Philosophy, Berlin School of Mind and BrainBerlinGermany
| |
Collapse
|
49
|
Nastase SA, Liu YF, Hillman H, Zadbood A, Hasenfratz L, Keshavarzian N, Chen J, Honey CJ, Yeshurun Y, Regev M, Nguyen M, Chang CHC, Baldassano C, Lositsky O, Simony E, Chow MA, Leong YC, Brooks PP, Micciche E, Choe G, Goldstein A, Vanderwal T, Halchenko YO, Norman KA, Hasson U. The "Narratives" fMRI dataset for evaluating models of naturalistic language comprehension. Sci Data 2021; 8:250. [PMID: 34584100 PMCID: PMC8479122 DOI: 10.1038/s41597-021-01033-3] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2021] [Accepted: 08/18/2021] [Indexed: 02/08/2023] Open
Abstract
The "Narratives" collection aggregates a variety of functional MRI datasets collected while human subjects listened to naturalistic spoken stories. The current release includes 345 subjects, 891 functional scans, and 27 diverse stories of varying duration totaling ~4.6 hours of unique stimuli (~43,000 words). This data collection is well-suited for naturalistic neuroimaging analysis, and is intended to serve as a benchmark for models of language and narrative comprehension. We provide standardized MRI data accompanied by rich metadata, preprocessed versions of the data ready for immediate use, and the spoken story stimuli with time-stamped phoneme- and word-level transcripts. All code and data are publicly available with full provenance in keeping with current best practices in transparent and reproducible neuroimaging.
Collapse
Affiliation(s)
- Samuel A Nastase
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA.
| | - Yun-Fei Liu
- Department of Psychological and Brain Sciences, Johns Hopkins University, Baltimore, MD, USA
| | - Hanna Hillman
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Asieh Zadbood
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Liat Hasenfratz
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Neggin Keshavarzian
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Janice Chen
- Department of Psychological and Brain Sciences, Johns Hopkins University, Baltimore, MD, USA
| | - Christopher J Honey
- Department of Psychological and Brain Sciences, Johns Hopkins University, Baltimore, MD, USA
| | - Yaara Yeshurun
- School of Psychological Sciences, Tel Aviv University, Tel Aviv, Israel
| | - Mor Regev
- Montreal Neurological Institute, McGill University, Montreal, QC, Canada
| | - Mai Nguyen
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Claire H C Chang
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | | | - Olga Lositsky
- Department of Cognitive, Linguistic and Psychological Sciences, Brown University, Providence, RI, USA
| | - Erez Simony
- Faculty of Electrical Engineering, Holon Institute of Technology, Holon, Israel
- Department of Neurobiology, Weizmann Institute of Science, Rehovot, Israel
| | | | - Yuan Chang Leong
- Helen Wills Neuroscience Institute, University of California, Berkeley, CA, USA
| | - Paula P Brooks
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Emily Micciche
- Peabody College, Vanderbilt University, Nashville, TN, USA
| | - Gina Choe
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Ariel Goldstein
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Tamara Vanderwal
- Department of Psychiatry, University of British Columbia, and BC Children's Hospital Research Institute, Vancouver, BC, Canada
| | - Yaroslav O Halchenko
- Department of Psychological and Brain Sciences and Department of Computer Science, Dartmouth College, Hanover, NH, USA
| | - Kenneth A Norman
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Uri Hasson
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| |
Collapse
|
50
|
Geng JJ, Duarte SE. Unresolved issues in distractor suppression: Proactive and reactive mechanisms, implicit learning, and naturalistic distraction. VISUAL COGNITION 2021. [DOI: 10.1080/13506285.2021.1928806] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Affiliation(s)
- Joy J. Geng
- Department of Psychology and Center for Mind and Brain, University of California, Davis, USA
| | - Shea E. Duarte
- Department of Psychology and Center for Mind and Brain, University of California, Davis, USA
| |
Collapse
|