Sensorimotor brain dynamics reflect architectural affordances

A systematic review of mobile brain/body imaging studies using the P300 event-related potentials to investigate cognition beyond the laboratory

The P300 ERP component, related to the onset of task-relevant or infrequent stimuli, has been widely used in the Mobile Brain/Body Imaging (MoBI) literature. This systematic review evaluates the quality and breadth of P300 MoBI studies, revealing a maturing field with well-designed research yet grappling with standardization and global representation challenges. While affirming the reliability of measuring P300 ERP components in mobile settings, the review identifies significant hurdles in standardizing data cleaning and processing techniques, impacting comparability and reproducibility. Geographical disparities emerge, with studies predominantly in the Global North and a dearth of research from the Global South, emphasizing the need for broader inclusivity to counter the WEIRD bias in psychology. Collaborative projects and mobile EEG systems showcase the feasibility of reaching diverse populations, which is essential to advance precision psychiatry and to integrate varied data streams. Methodologically, a trend toward ecological validity is noted, shifting from lab-based to real-world settings with portable EEG system advancements. Future hardware developments are expected to balance signal quality and sensor intrusiveness, enriching data collection in everyday contexts. Innovative methodologies reflect a move toward more natural experimental settings, prompting critical questions about the applicability of traditional ERP markers, such as the P300 outside structured paradigms. The review concludes by highlighting the crucial role of integrating mobile technologies, physiological sensors, and machine learning to advance cognitive neuroscience. It advocates for an operational definition of ecological validity to bridge the gap between controlled experiments and the complexity of embodied cognitive experiences, enhancing both theoretical understanding and practical application in study design.

Human brain dynamics dissociate early perceptual and late motor-related stages of affordance processing

Affordances, the opportunities for action offered by the environment to an agent, are vital for meaningful behaviour and exist in every interaction with the environment. There is an ongoing debate in the field about whether the perception of affordances is an automated process. Some studies suggest that affordance perception is an automated process that is independent from the visual context and bodily interaction with the environment, whereas others argue that it is modulated by the visual and motor context in which affordances are perceived. The present paper aims to resolve this debate by examining affordance automaticity from the perspective of sensorimotor time windows. To investigate the impact of different forms of bodily interactions with an environment, that is, the movement context (physical vs. joystick movement), we replicated a previous study on affordance perception in which participants actively moved through differently wide doors in an immersive 3D virtual environment. In the present study, we displayed the same environment on a 2D screen with participants moving through doors of different widths using the keys on a standard keyboard. We compared components of the event-related potential (ERP) from the continuously recorded electroencephalogram (EEG) that were previously reported to be related to affordance perception of architectural transitions (passable and impassable doors). Comparing early sensory and later motor-related ERPs, our study replicated ERPs reflecting early affordance perception but found differences in later motor-related components. These results indicate a shift from automated perception of affordances during early sensorimotor time windows to movement context dependence of affordance perception at later stages, suggesting that affordance perception is a dynamic and flexible process that changes over sensorimotor stages.

The moving wave: Applications of the mobile EEG approach to study human attention

Although historically confined to traditional research laboratories, electroencephalography (EEG) paradigms are now being applied to study a wide array of behaviors, from daily activities to specialized tasks in diverse fields such as sports science, neurorehabilitation, and education. This transition from traditional to real-world mobile research can provide new tools for understanding attentional processes as they occur naturally. Early mobile EEG research has made progress, despite the large size and wired connections. Recent developments in hardware and software have expanded the possibilities of mobile EEG, enabling a broader range of applications. Despite these advancements, limitations influencing mobile EEG remain that must be overcome to achieve adequate reliability and validity. In this review, we first assess the feasibility of mobile paradigms, including electrode selection, artifact correction techniques, and methodological considerations. This review underscores the importance of ecological, construct, and predictive validity in ensuring the trustworthiness and applicability of mobile EEG findings. Second, we explore studies on attention in naturalistic settings, focusing on replicating classic P3 component studies in mobile paradigms like stationary biking in our lab, and activities such as walking, cycling, and dual-tasking outside of the lab. We emphasize how the mobile approach complements traditional laboratory paradigms and the types of insights gained in naturalistic research settings. Third, we discuss promising applications of portable EEG in workplace safety and other areas including road safety, rehabilitation medicine, and brain-computer interfaces. In summary, this review explores the expanding possibilities of mobile EEG while recognizing the existing challenges in fully realizing its potential.

Comparing episodic memory outcomes from walking augmented reality and stationary virtual reality encoding experiences

Episodic Memory (EM) is the neurocognitive capacity to consciously recollect personally experienced events in specific spatio-temporal contexts. Although the relevance of spatial and temporal information is widely acknowledged in the EM literature, it remains unclear whether and how EM performance and organisation is modulated by self-motion, and by motor- and visually- salient environmental features (EFs) of the encoding environment. This study examines whether and how EM is modulated by locomotion and the EFs encountered in a controlled lifelike learning route within a large-scale building. Twenty-eight healthy participants took part in a museum-tour encoding task implemented in walking Augmented Reality (AR) and stationary Virtual Reality (VR) conditions. EM performance and organisation were assessed immediately and 48-hours after trials using a Remember/Familiar recognition paradigm. Results showed a significant positive modulation effect of locomotion on distinctive EM aspects. Findings highlighted a significant performance enhancement effect of stairway-adjacent locations compared to dead-end and mid-route stimuli-presentation locations. The results of this study may serve as design criteria to facilitate neurocognitive rehabilitative interventions of EM. The underlying technological framework developed for this study represents a novel and ecologically sound method for evaluating EM processes in lifelike situations, allowing researchers a naturalistic perspective into the complex nature of EM.

Fixation-related potentials during mobile map assisted navigation in the real world: The effect of landmark visualization style

An often-proposed enhancement for mobile maps to aid assisted navigation is the presentation of landmark information, yet understanding of the manner in which they should be displayed is limited. In this study, we investigated whether the visualization of landmarks as 3D map symbols with either an abstract or realistic style influenced the subsequent processing of those landmarks during route navigation. We utilized a real-world mobile electroencephalography approach to this question by combining several tools developed to overcome the challenges typically encountered in real-world neuroscience research. We coregistered eye-movement and EEG recordings from 45 participants as they navigated through a real-world environment using a mobile map. Analyses of fixation event-related potentials revealed that the amplitude of the parietal P200 component was enhanced when participants fixated landmarks in the real world that were visualized on the mobile map in a realistic style, and that frontal P200 latencies were prolonged for landmarks depicted in either a realistic or abstract style compared with features of the environment that were not presented on the map, but only for the male participants. In contrast, we did not observe any significant effects of landmark visualization style on visual P1-N1 peaks or the parietal late positive component. Overall, the findings indicate that the cognitive matching process between landmarks seen in the environment and those previously seen on a map is facilitated by more realistic map display, while low-level perceptual processing of landmarks and recall of associated information are unaffected by map visualization style.

Visual features are processed before navigational affordances in the human brain

To navigate through their immediate environment humans process scene information rapidly. How does the cascade of neural processing elicited by scene viewing to facilitate navigational planning unfold over time? To investigate, we recorded human brain responses to visual scenes with electroencephalography and related those to computational models that operationalize three aspects of scene processing (2D, 3D, and semantic information), as well as to a behavioral model capturing navigational affordances. We found a temporal processing hierarchy: navigational affordance is processed later than the other scene features (2D, 3D, and semantic) investigated. This reveals the temporal order with which the human brain computes complex scene information and suggests that the brain leverages these pieces of information to plan navigation.

On natural attunement: Shared rhythms between the brain and the environment

Rhythms exist both in the embodied brain and the built environment. Becoming attuned to the rhythms of the environment, such as repetitive columns, can greatly affect perception. Here, we explore how the built environment affects human cognition and behavior through the concept of natural attunement, often resulting from the coordination of a person's sensory and motor systems with the rhythmic elements of the environment. We argue that the built environment should not be reduced to mere states, representations, and single variables but instead be considered a bundle of highly related continuous signals with which we can resonate. Resonance and entrainment are dynamic processes observed when intrinsic frequencies of the oscillatory brain are influenced by the oscillations of an external signal. This allows visual rhythmic stimulations of the environment to affect the brain and body through neural entrainment, cross-frequency coupling, and phase resetting. We review how real-world architectural settings can affect neural dynamics, cognitive processes, and behavior in people, suggesting the crucial role of everyday rhythms in the brain-body-environment relationship.

Architectural experience influences the processing of others' body expressions

The interplay between space and cognition is a crucial issue in Neuroscience leading to the development of multiple research fields. However, the relationship between architectural space and the movement of the inhabitants and their interactions has been too often neglected, failing to provide a unifying view of architecture's capacity to modulate social cognition broadly. We bridge this gap by requesting participants to judge avatars' emotional expression (high vs. low arousal) at the end of their promenade inside high- or low-arousing architectures. Stimuli were presented in virtual reality to ensure a dynamic, naturalistic experience. High-density electroencephalography (EEG) was recorded to assess the neural responses to the avatar's presentation. Observing highly aroused avatars increased Late Positive Potentials (LPP), in line with previous evidence. Strikingly, 250 ms before the occurrence of the LPP, P200 amplitude increased due to the experience of low-arousing architectures, reflecting an early greater attention during the processing of body expressions. In addition, participants stared longer at the avatar's head and judged the observed posture as more arousing. Source localization highlighted a contribution of the dorsal premotor cortex to both P200 and LPP. In conclusion, the immersive and dynamic architectural experience modulates human social cognition. In addition, the motor system plays a role in processing architecture and body expressions suggesting that the space and social cognition interplay is rooted in overlapping neural substrates. This study demonstrates that the manipulation of mere architectural space is sufficient to influence human social cognition.

Affordances and curvature preference: The case of real objects and spaces

Chuquichambi and colleagues recently questioned the prevailing belief that a universal human visual preference exists for curved shapes and lines. Their comprehensive meta-analysis demonstrated that while curvature preference is widespread, it is not universally constant or invariant. By revisiting their dataset, we made an intriguing discovery: a negative relationship between curvature preference and an object's "affordances." Taking an embodiment perspective into account, we propose an explanation for this phenomenon, suggesting that the diminished curvature preference in objects with abundant affordances can be understood through the lens of embodied cognition.

Diversity and Suitability of the State-of-the-Art Wearable and Wireless EEG Systems Review

Wireless electroencephalography (EEG) systems have been attracting increasing attention in recent times. Both the number of articles discussing wireless EEG and their proportion relative to general EEG publications have increased over years. These trends indicate that wireless EEG systems could be more accessible to researchers and the research community has recognized the potential of wireless EEG systems. To explore the development and diverse applications of wireless EEG systems, this review highlights the trends in wearable and wireless EEG systems over the past decade and compares the specifications and research applications of the major wireless systems marketed by 16 companies. For each product, five parameters (number of channels, sampling rate, cost, battery life, and resolution) were assessed for comparison. Currently, these wearable and portable wireless EEG systems have three main application areas: consumer, clinical, and research. To address this multitude of options, the article also discussed the thought process to find a suitable device that meets personalization and use cases specificities. These investigations suggest that low-price and convenience are key factors for consumer applications, wireless EEG systems with FDA or CE-certification may be more suitable for clinical settings, and devices that provide raw EEG data with high-density channels are important for laboratory research. This article presents an overview of the current state of the wireless EEG systems specifications and possible applications and serves as a guide point as it is expected that more influential and novel research will cyclically promote the development of such EEG systems.

The role of the body in the experience of installation art: a case study of visitors' bodily, emotional, and transformative experiences in Tomás Saraceno's "in orbit"

Installation art, with its immersive and participatory character, has been argued to require the use and awareness of the body, which potentially constitute key parts of the artwork's experience and appreciation. Heightened body awareness is even argued to be a key to particularly profound emotional or even transformative states, which have been frequently ascribed to this genre. However, the body in the experience of installation art has rarely been empirically considered. To address this gap, we investigated the body's role in the experience of Tomás Saraceno's in orbit installation. Based on a list of self-report items created from a review of the theoretical literature, we-for the first time-captured (quantitatively and qualitatively): what kind of subjective bodily experiences visitors (N = 230) reported, how these items grouped into clusters (using network science), and how these relate to emotion, art appraisal, and transformative outcomes. Network analysis of the items determined four communities related to "interoception," "presence," "disturbance," and "proprioception." Proprioception (e.g., awareness of balance/movement/weight) turned out to be a significant determinant of art appreciation in our study, and, together with "disturbing" body experiences (feeling awkward/watched/chills), coincided with transformation. We also assessed individual differences in body awareness yet did not find that these moderate those relationships. We suggest future research on installation art based on a more unified assessment of the role of the body in embodied-enactive aesthetics and its relation to the intensity and impact of art experience in general.

Wireless EEG: A survey of systems and studies

The popular brain monitoring method of electroencephalography (EEG) has seen a surge in commercial attention in recent years, focusing mostly on hardware miniaturization. This has led to a varied landscape of portable EEG devices with wireless capability, allowing them to be used by relatively unconstrained users in real-life conditions outside of the laboratory. The wide availability and relative affordability of these devices provide a low entry threshold for newcomers to the field of EEG research. The large device variety and the at times opaque communication from their manufacturers, however, can make it difficult to obtain an overview of this hardware landscape. Similarly, given the breadth of existing (wireless) EEG knowledge and research, it can be challenging to get started with novel ideas. Therefore, this paper first provides a list of 48 wireless EEG devices along with a number of important-sometimes difficult-to-obtain-features and characteristics to enable their side-by-side comparison, along with a brief introduction to each of these aspects and how they may influence one's decision. Secondly, we have surveyed previous literature and focused on 110 high-impact journal publications making use of wireless EEG, which we categorized by application and analyzed for device used, number of channels, sample size, and participant mobility. Together, these provide a basis for informed decision making with respect to hardware and experimental precedents when considering new, wireless EEG devices and research. At the same time, this paper provides background material and commentary about pitfalls and caveats regarding this increasingly accessible line of research.

Neuroergonomics on the Go: An Evaluation of the Potential of Mobile EEG for Workplace Assessment and Design

OBJECTIVE

We demonstrate and discuss the use of mobile electroencephalogram (EEG) for neuroergonomics. Both technical state of the art as well as measures and cognitive concepts are systematically addressed.

BACKGROUND

Modern work is increasingly characterized by information processing. Therefore, the examination of mental states, mental load, or cognitive processing during work is becoming increasingly important for ergonomics.

RESULTS

Mobile EEG allows to measure mental states and processes under real live conditions. It can be used for various research questions in cognitive neuroergonomics. Besides measures in the frequency domain that have a long tradition in the investigation of mental fatigue, task load, and task engagement, new approaches-like blink-evoked potentials-render event-related analyses of the EEG possible also during unrestricted behavior.

CONCLUSION

Mobile EEG has become a valuable tool for evaluating mental states and mental processes on a highly objective level during work. The main advantage of this technique is that working environments don't have to be changed while systematically measuring brain functions at work. Moreover, the workflow is unaffected by such neuroergonomic approaches.

Virtual reality does not fool the brain only: spinal excitability changes during virtually simulated falling

Virtual reality (VR) is known to induce substantial activation of brain's motor regions. It remains unclear to what extent virtual reality can trigger the sensorimotor system, and more particularly, whether it can affect lower nervous levels. In this study, we aimed to assess whether VR simulation of challenging and stressful postural situations (Richie's plank experience) could interfere with spinal excitability of postural muscles in 15 healthy young participants. The H-reflex of the triceps surae muscles was elicited with electrical nerve stimulation while participants were standing and wearing a VR headset. Participants went through several conditions, during which stimulations were evoked: standing still (noVR), standing in VR on the ground (groundVR), standing on the edge of a building (plankVR), and falling from the building (fallingVR). Myoelectrical activity of the triceps surae muscles was measured throughout the experiment. Leg and head movements were also measured by means of accelerometers to account for body oscillations. First, no differences in head rotations and myoelectrical activity were to be noted between conditions. Second, triceps H-reflex (H_MAX/M_MAX) was not affected from noVR to groundVR and plankVR. The most significant finding was a drastic decrease in H-reflex during falling (-47 ± 26.9% between noVR and fallingVR, P = 0.015). It is suggested that experiencing a postural threat in VR efficiently modulates spinal excitability, despite remaining in a quiet standing posture. This study suggests that simulated falling mimics the neural adjustments observed during actual postural challenge tasks.NEW & NOTEWORTHY The present study showed a modulation of spinal excitability induced by virtual reality (VR). In the standing position, soleus H-reflex was downmodulated during a simulated falling, in the absence of apparent changes in body oscillations. Since the same behavior is usually observed during real falling, it was suggested that the visual cues provided by VR were sufficiently strong to lead the neuromuscular system to mimic the actual modulation.

Virtual Reality for Spatial Navigation

Immersive virtual reality (VR) allows its users to experience physical space in a non-physical world. It has developed into a powerful research tool to investigate the neural basis of human spatial navigation as an embodied experience. The task of wayfinding can be carried out by using a wide range of strategies, leading to the recruitment of various sensory modalities and brain areas in real-life scenarios. While traditional desktop-based VR setups primarily focus on vision-based navigation, immersive VR setups, especially mobile variants, can efficiently account for motor processes that constitute locomotion in the physical world, such as head-turning and walking. When used in combination with mobile neuroimaging methods, immersive VR affords a natural mode of locomotion and high immersion in experimental settings, designing an embodied spatial experience. This in turn facilitates ecologically valid investigation of the neural underpinnings of spatial navigation.

A mobile EEG study on the psychophysiological effects of walking and crowding in indoor and outdoor urban environments

Environmental psychologists have established multiple psychological benefits of interaction with natural, compared to urban, environments on emotion, cognition, and attention. Yet, given the increasing urbanisation worldwide, it is equally important to understand how differences within different urban environments influence human psychological experience. We developed a laboratory experiment to examine the psychophysiological effects of the physical (outdoor or indoor) and social (crowded versus uncrowded) environment in healthy young adults, and to validate the use of mobile electroencephalography (EEG) and electrodermal activity (EDA) measurements during active walking. Participants (N = 42) were randomly assigned into a walking or a standing group, and watched six 1-min walk-through videos of green, urban indoor and urban outdoor environments, depicting high or low levels of social density. Self-reported emotional states show that green spaces is perceived as more calm and positive, and reduce attentional demands. Further, the outdoor urban space is perceived more positively than the indoor environment. These findings are consistent with earlier studies on the psychological benefits of nature and confirm the effectiveness of our paradigm and stimuli. In addition, we hypothesised that even short-term exposure to crowded scenes would have negative psychological effects. We found that crowded scenes evoked higher self-reported arousal, more negative self-reported valence, and recruited more cognitive and attentional resources. However, in walking participants, they evoked higher frontal alpha asymmetry, suggesting more positive affective responses. Furthermore, we found that using recent signal-processing methods, the EEG data produced a comparable signal-to-noise ratio between walking and standing, and that despite differences between walking and standing, skin-conductance also captured effectively psychophysiological responses to stimuli. These results suggest that emotional responses to visually presented stimuli can be measured effectively using mobile EEG and EDA in ambulatory settings, and that there is complex interaction between active walking, the social density of urban spaces, and direct and indirect affective responses to such environments.

Functional brain connectivity during exposure to the scale and color of interior built environments

Understanding brain activity linked to built environment exposure is important, as it may affect underlying cognitive, perceptual, and emotional processes, which have a critical influence in our daily life. As our time spent inside buildings is rising, and mental health problems have become more prevalent, it is important we investigate how design characteristics of the built environment impact brain function. In this study, we utilized electroencephalography to understand whether the design elements of scale and color of interior built environments modulate functional brain connectivity (i.e., brain network communication). Using a Cave Automatic Virtual Environment, while controlling indoor environmental quality responsible for physiological comfort, healthy adult participants aged 18-55 years (66 for scale, subset of 18 for color), were exposed to context-neutral indoor room scenes presented for two-minutes each. Our results show that both enlarging and reducing scale enhanced theta connectivity across the left temporoparietal region and right frontal region. We also found when reducing the built environment scale, there was a network exhibiting greater high-gamma connectivity, over the right frontoparietal region. For color, the condition (blue) contrasted to our achromatic control (white) increased theta connectivity in the frontal hemispheres. These findings identify a link between theta and gamma oscillations during exposure to the scale and color of the built environment, showing that design characteristics of the built environment could affect our cognitive processes and mental health. This suggests that, through the design of buildings, we may be able to mediate performance and health outcomes, which could lead to major health and economic benefits for society.

Measuring arousal and valence generated by the dynamic experience of architectural forms in virtual environments

The built environment represents the stage surrounding our everyday life activities. To investigate how architectural design impacts individuals' affective states, we measured subjective judgments of perceived valence (pleasant and unpleasant) and arousal after the dynamic experience of a progressive change of macro visuospatial dimensions of virtual spaces. To this aim, we developed a parametric model that allowed us to create 54 virtual architectural designs characterized by a progressive change of sidewalls distance, ceiling and windows height, and color of the environment. Decreasing sidewalls distance, ceiling height variation, and increasing windows height significantly affected the participants' emotional state within virtual environments. Indeed, such architectural designs generated high arousing and unpleasant states according to subjective judgment. Overall, we observed that valence and arousal scores are affected by all the dynamic form factors which modulated the spaciousness of the surrounding. Showing that the dynamic experience of virtual environments enables the possibility of measuring the emotional impact of macro spatial architectural features, the present findings may lay the groundwork for future experiments investigating the effects that the architectural design has on individuals' mental state as a fundamental factor for the creation of future spaces.

Neuroscience and architecture: Modulating behavior through sensorimotor responses to the built environment

As we move through the world, natural and built environments implicitly guide behavior by appealing to certain sensory and motor dynamics. This process can be motivated by automatic attention to environmental features that resonate with specific sensorimotor responses. This review aims at providing a psychobiological framework describing how environmental features can lead to automated sensorimotor responses through defined neurophysiological mechanisms underlying attention. Through the use of automated processes in subsets of cortical structures, the goal of this framework is to describe on a neuronal level the functional link between the designed environment and sensorimotor responses. By distinguishing between environmental features and sensorimotor responses we elaborate on how automatic behavior employs the environment for sensorimotor adaptation. This is realized through a thalamo-cortical network integrating environmental features with motor aspects of behavior. We highlight the underlying transthalamic transmission from an Enactive and predictive perspective and review recent studies that effectively modulated behavior by systematically manipulating environmental features. We end by suggesting a promising combination of neuroimaging and computational analysis for future studies.

The Embodiment of Architectural Experience: A Methodological Perspective on Neuro-Architecture

People spend a large portion of their time inside built environments. Research in neuro-architecture—the neural basis of human perception of and interaction with the surrounding architecture—promises to advance our understanding of the cognitive processes underlying this common human experience and also to inspire evidence-based architectural design principles. This article examines the current state of the field and offers a path for moving closer to fulfilling this promise. The paper is structured in three sections, beginning with an introduction to neuro-architecture, outlining its main objectives and giving an overview of experimental research in the field. Afterward, two methodological limitations attending current brain-imaging architectural research are discussed: the first concerns the limited focus of the research, which is often restricted to the aesthetic dimension of architectural experience; the second concerns practical limitations imposed by the typical experimental tools and methods, which often require participants to remain stationary and prevent naturalistic interaction with architectural surroundings. Next, we propose that the theoretical basis of ecological psychology provides a framework for addressing these limitations and motivates emphasizing the role of embodied exploration in architectural experience, which encompasses but is not limited to aesthetic contemplation. In this section, some basic concepts within ecological psychology and their convergences with architecture are described. Lastly, we introduce Mobile Brain/Body Imaging (MoBI) as one emerging brain imaging approach with the potential to improve the ecological validity of neuro-architecture research. Accordingly, we suggest that combining theoretical and conceptual resources from ecological psychology with state-of-the-art neuroscience methods (Mobile Brain/Body Imaging) is a promising way to bring neuro-architecture closer to accomplishing its scientific and practical goals.

Compensative movement ameliorates reduced efficacy of rapidly-embodied decisions in humans

Dynamic environments, such as sports, often demand rapid decision-making and motor execution. The concept of embodied decision refers to the mutual link between both processes, but little is known about how these processes are balanced under severe time constraints. We address this problem by using a baseball-like hitting paradigm with and without Go/No-go judgment; participants were required to hit (Go) a moving target in the strike area or not to hit (No-go) other targets. We found that Go/No-go judgments were effective with regard to task performance, but efficacy was lost below the time constraint of 0.5 seconds mainly due to a reduction in judgment accuracy rather than movement accuracy. However, either slowing movement initiation in Go trials or canceling the movement in progress in No-go trials improved judgment accuracy. Our findings suggest that embodied decision efficacy is limited in split-second periods, but compensation is possible by changing ongoing movement strategies.

The 4E approach to the human microbiome: Nested interactions between the gut-brain/body system within natural and built environments

The complexity of the human mind and its interaction with the environment is one of the main epistemological debates throughout history. Recent ideas, framed as the 4E perspective to cognition, highlight that human experience depends causally on both cerebral and extracranial processes, but also is embedded in a particular sociomaterial context and is a product of historical accumulation of trajectory changes throughout life. Accordingly, the human microbiome is one of the most intriguing actors modulating brain function and physiology. Here, we present the 4E approach to the Human Microbiome for understanding mental processes from a broader perspective, encompassing one's body physiology and environment throughout their lifespan, interconnected by microbiome community structure and dynamics. We review evidence supporting the approach theoretically and motivates the study of the global set of microbial ecosystem networks encountered by a person across their lifetime (from skin to gut to natural and built environments). We furthermore trace future empirical implementation of the approach. We finally discuss novel research opportunities and clinical interventions aimed toward developing low-cost/high-benefit integrative and personalized bio-psycho-socio-environmental treatments for mental health and including the brain-gut-microbiome axis.

Early Electrophysiological Markers of Navigational Affordances in Scenes

Scene perception and spatial navigation are interdependent cognitive functions, and there is increasing evidence that cortical areas that process perceptual scene properties also carry information about the potential for navigation in the environment (navigational affordances). However, the temporal stages by which visual information is transformed into navigationally relevant information are not yet known. We hypothesized that navigational affordances are encoded during perceptual processing and therefore should modulate early visually evoked ERPs, especially the scene-selective P2 component. To test this idea, we recorded ERPs from participants while they passively viewed computer-generated room scenes matched in visual complexity. By simply changing the number of doors (no doors, 1 door, 2 doors, 3 doors), we were able to systematically vary the number of pathways that afford movement in the local environment, while keeping the overall size and shape of the environment constant. We found that rooms with no doors evoked a higher P2 response than rooms with three doors, consistent with prior research reporting higher P2 amplitude to closed relative to open scenes. Moreover, we found P2 amplitude scaled linearly with the number of doors in the scenes. Navigability effects on the ERP waveform were also observed in a multivariate analysis, which showed significant decoding of the number of doors and their location at earlier time windows. Together, our results suggest that navigational affordances are represented in the early stages of scene perception. This complements research showing that the occipital place area automatically encodes the structure of navigable space and strengthens the link between scene perception and navigation.

Sensory-Motor Modulations of EEG Event-Related Potentials Reflect Walking-Related Macro-Affordances

One fundamental principle of the brain functional organization is the elaboration of sensory information for the specification of action plans that are most appropriate for interaction with the environment. Using an incidental go/no-go priming paradigm, we have previously shown a facilitation effect for the execution of a walking-related action in response to far vs. near objects/locations in the extrapersonal space, and this effect has been called “macro-affordance” to reflect the role of locomotion in the coverage of extrapersonal distance. Here, we investigated the neurophysiological underpinnings of such an effect by recording scalp electroencephalography (EEG) from 30 human participants during the same paradigm. The results of a whole-brain analysis indicated a significant modulation of the event-related potentials (ERPs) both during prime and target stimulus presentation. Specifically, consistent with a mechanism of action anticipation and automatic activation of affordances, a stronger ERP was observed in response to prime images framing the environment from a far vs. near distance, and this modulation was localized in dorso-medial motor regions. In addition, an inversion of polarity for far vs. near conditions was observed during the subsequent target period in dorso-medial parietal regions associated with spatially directed foot-related actions. These findings were interpreted within the framework of embodied models of brain functioning as arising from a mechanism of motor-anticipation and subsequent prediction error which was guided by the preferential affordance relationship between the distant large-scale environment and locomotion. More in general, our findings reveal a sensory-motor mechanism for the processing of walking-related environmental affordances.

The road towards understanding embodied decisions

Most current decision-making research focuses on classical economic scenarios, where choice offers are prespecified and where action dynamics play no role in the decision. However, our brains evolved to deal with different choice situations: "embodied decisions". As examples of embodied decisions, consider a lion that has to decide which gazelle to chase in the savannah or a person who has to select the next stone to jump on when crossing a river. Embodied decision settings raise novel questions, such as how people select from time-varying choice options and how they track the most relevant choice attributes; but they have long remained challenging to study empirically. Here, we summarize recent progress in the study of embodied decisions in sports analytics and experimental psychology. Furthermore, we introduce a formal methodology to identify the relevant dimensions of embodied choices (present and future affordances) and to map them into the attributes of classical economic decisions (probabilities and utilities), hence aligning them. Studying embodied decisions will greatly expand our understanding of what decision-making is.

Differences in regional gray matter volume predict the extent to which openness influences judgments of beauty and pleasantness of interior architectural spaces

Hedonic evaluation of sensory objects varies from person to person. While this variability has been linked to differences in experience, little is known about why stimuli lead to different evaluations in different people. We used linear mixed-effects models to determine the extent to which the openness, contour, and ceiling height of interior spaces influenced the beauty and pleasantness ratings of 18 participants. Then, by analyzing structural brain images acquired for the same group of participants, we asked if any regional gray matter volume (rGMV) covaried with these differences in the extent to which the three features influence beauty and pleasantness ratings. Voxel-based morphometry analysis revealed that the influence of openness on pleasantness ratings correlated with rGMV in the anterior prefrontal cortex (Brodmann area (BA)-10), and the influence of openness on beauty ratings correlated with rGMV in the temporal pole (BA38) and cluster, including the posterior cingulate cortex (BA31) and paracentral lobule (BA5/6). There were no significant correlations involving contour or ceiling height. Our results suggest that regional variance in gray matter volume may play a role in the computation of hedonic valuation and account for differences in the way people weigh certain attributes of interior architectural spaces.

Enacting Media. An Embodied Account of Enculturation Between Neuromediality and New Cognitive Media Theory

This paper argues that the still-emerging paradigm of situated cognition requires a more systematic perspective on media to capture the enculturation of the human mind. By virtue of being media, cultural artifacts present central experiential models of the world for our embodied minds to latch onto. The paper identifies references to external media within embodied, extended, enactive, and predictive approaches to cognition, which remain underdeveloped in terms of the profound impact that media have on our mind. To grasp this impact, I propose an enactive account of media that is based on expansive habits as media-structured, embodied ways of bringing forth meaning and new domains of values. We apply such habits, for instance, when seeing a picture or perceiving a movie. They become established through a process of reciprocal adaptation between media artifacts and organisms and define the range of viable actions within such a media ecology. Within an artifactual habit, we then become attuned to a specific media work (e.g., a TV series, a picture, a text, or even a city) that engages us. Both the plurality of habits and the dynamical adjustments within a habit require a more flexible neural architecture than is addressed by classical cognitive neuroscience. To detail how neural and media processes interlock, I will introduce the concept of neuromediality and discuss radical predictive processing accounts that could contribute to the externalization of the mind by treating media themselves as generative models of the world. After a short primer on general media theory, I discuss media examples in three domains: pictures and moving images; digital media; architecture and the built environment. This discussion demonstrates the need for a new cognitive media theory based on enactive artifactual habits-one that will help us gain perspective on the continuous re-mediation of our mind.

Using mobile brain/body imaging to advance research in arts, health, and related therapeutics

The uses of mobile brain/body imaging (MoBI) are expanding and allow for more direct study of the neurophysiological signals associated with behavior in psychotherapeutic encounters. Neuroaesthetics is concerned with the cognitive and neural basis of art appreciation, and scientific correlations are being made in the field that might help to clarify theories claimed in the creative arts therapies. Yet, most neuroaesthetics studies are confined to the laboratory and do not propose a translation for research methods and clinical applications. The creative arts therapies have a long history of clinical success with various patient populations and will benefit from increased scientific explanation to support intervention strategies. Examining the brain dynamics and motor behaviors that are associated with the higher complex processes involved in artistic expression offers MoBI as a promising instrumentation to move forward in linking ideas from neuroaesthetics to the creative arts therapies. Tracking brain dynamics in association with behavioral change allows for more objective and quantitative physiological monitors to evaluate, and together with subjective patient reports provides insight into the psychological mechanisms of change in treatment. We outline a framework that shows how MoBI can be used to study the effectiveness of creative arts therapy interventions motivated by the 4E approach to cognition with a focus on visual art therapy. The article illuminates how a new partnership among the fields of art therapy, neuroscience, and neuroaesthetics might work together within the 4E/MoBI framework in efforts to advance transdisciplinary research for clinical health populations.

Mobile brain/body imaging of landmark-based navigation with high-density EEG

Coupling behavioral measures and brain imaging in naturalistic, ecological conditions is key to comprehend the neural bases of spatial navigation. This highly integrative function encompasses sensorimotor, cognitive, and executive processes that jointly mediate active exploration and spatial learning. However, most neuroimaging approaches in humans are based on static, motion‐constrained paradigms and they do not account for all these processes, in particular multisensory integration. Following the Mobile Brain/Body Imaging approach, we aimed to explore the cortical correlates of landmark‐based navigation in actively behaving young adults, solving a Y‐maze task in immersive virtual reality. EEG analysis identified a set of brain areas matching state‐of‐the‐art brain imaging literature of landmark‐based navigation. Spatial behavior in mobile conditions additionally involved sensorimotor areas related to motor execution and proprioception usually overlooked in static fMRI paradigms. Expectedly, we located a cortical source in or near the posterior cingulate, in line with the engagement of the retrosplenial complex in spatial reorientation. Consistent with its role in visuo‐spatial processing and coding, we observed an alpha‐power desynchronization while participants gathered visual information. We also hypothesized behavior‐dependent modulations of the cortical signal during navigation. Despite finding few differences between the encoding and retrieval phases of the task, we identified transient time–frequency patterns attributed, for instance, to attentional demand, as reflected in the alpha/gamma range, or memory workload in the delta/theta range. We confirmed that combining mobile high‐density EEG and biometric measures can help unravel the brain structures and the neural modulations subtending ecological landmark‐based navigation.

The brain dynamics of architectural affordances during transition

Action is a medium of collecting sensory information about the environment, which in turn is shaped by architectural affordances. Affordances characterize the fit between the physical structure of the body and capacities for movement and interaction with the environment, thus relying on sensorimotor processes associated with exploring the surroundings. Central to sensorimotor brain dynamics, the attentional mechanisms directing the gating function of sensory signals share neuronal resources with motor-related processes necessary to inferring the external causes of sensory signals. Such a predictive coding approach suggests that sensorimotor dynamics are sensitive to architectural affordances that support or suppress specific kinds of actions for an individual. However, how architectural affordances relate to the attentional mechanisms underlying the gating function for sensory signals remains unknown. Here we demonstrate that event-related desynchronization of alpha-band oscillations in parieto-occipital and medio-temporal regions covary with the architectural affordances. Source-level time-frequency analysis of data recorded in a motor-priming Mobile Brain/Body Imaging experiment revealed strong event-related desynchronization of the alpha band to originate from the posterior cingulate complex, the parahippocampal region as well as the occipital cortex. Our results firstly contribute to the understanding of how the brain resolves architectural affordances relevant to behaviour. Second, our results indicate that the alpha-band originating from the occipital cortex and parahippocampal region covaries with the architectural affordances before participants interact with the environment, whereas during the interaction, the posterior cingulate cortex and motor areas dynamically reflect the affordable behaviour. We conclude that the sensorimotor dynamics reflect behaviour-relevant features in the designed environment.

A Novel Method to Understand Neural Oscillations During Full-Body Reaching: A Combined EEG and 3D Virtual Reality Study

Virtual reality (VR) can be used to create environments that are not possible in the real-world. Producing movements in VR holds enormous promise for rehabilitation and offers a platform from which to understand the neural control of movement. However, no study has examined the impact of a 3D fully immersive head-mounted display (HMD) VR system on the integrity of neural data. We assessed the quality of 64-channel EEG data with and without HMD VR during rest and during a full-body reaching task. We compared resting EEG while subjects completed three conditions: No HMD (EEG-only), HMD powered off (VR-off), and HMD powered on (VR-on). Within the same session, EEG were collected while subjects completed full-body reaching movements in two conditions (EEG-only, VR-on). During rest, no significant differences in data quality and power spectrum were observed between EEG-only, VR-off, and VR-on conditions. During reaching movements, the proportion of components attributed to the brain was greater in the EEG-only condition compared to the VR-on condition. Despite this difference, neural oscillations in source space were not significantly different between conditions, with both conditions associated with decreases in alpha and beta power in sensorimotor cortex during movements. Our findings demonstrate that the integrity of EEG data can be maintained while individuals execute full-body reaching movements within an immersive 3D VR environment. Clinical impact: Integrating VR and EEG is a viable approach to understanding the cortical processes of movement. Simultaneously recording movement and brain activity in combination with VR provides the foundation for neurobiologically informed rehabilitation therapies.

An Important Step toward Understanding the Role of Body-based Cues on Human Spatial Memory for Large-Scale Environments

Moving our body through space is fundamental to human navigation; however, technical and physical limitations have hindered our ability to study the role of these body-based cues experimentally. We recently designed an experiment using novel immersive virtual-reality technology, which allowed us to tightly control the availability of body-based cues to determine how these cues influence human spatial memory [Huffman, D. J., & Ekstrom, A. D. A modality-independent network underlies the retrieval of large-scale spatial environments in the human brain. Neuron, 104, 611-622, 2019]. Our analysis of behavior and fMRI data revealed a similar pattern of results across a range of body-based cues conditions, thus suggesting that participants likely relied primarily on vision to form and retrieve abstract, holistic representations of the large-scale environments in our experiment. We ended our paper by discussing a number of caveats and future directions for research on the role of body-based cues in human spatial memory. Here, we reiterate and expand on this discussion, and we use a commentary in this issue by A. Steel, C. E. Robertson, and J. S. Taube (Current promises and limitations of combined virtual reality and functional magnetic resonance imaging research in humans: A commentary on Huffman and Ekstrom (2019). Journal of Cognitive Neuroscience, 2020) as a helpful discussion point regarding some of the questions that we think will be the most interesting in the coming years. We highlight the exciting possibility of taking a more naturalistic approach to study the behavior, cognition, and neuroscience of navigation. Moreover, we share the hope that researchers who study navigation in humans and nonhuman animals will synergize to provide more rapid advancements in our understanding of cognition and the brain.

From Research to Practice: Is Rethinking Architectural Education the Remedy?

OBJECTIVES

Our aim is to investigate how a new master studies course "Architecture, Health, and Well-being" (AHW) supports development of students' skills in understanding and assessing health-related research as well as applying research-based knowledge through unfolding of user perspectives in their design projects.

BACKGROUND

With the growing focus on health-related research in Danish design practice, knowing how to translate research findings into research-informed design strategies becomes a preferable, if not (yet) a critical, skill. This calls for architecture educations to reconsider their graduate profiles and teaching curricula, thereby addressing research-to-practice gap.

METHOD

Based on design project hand-ins, we evaluate whether students participating in the AHW course demonstrate greater sensibility toward user experiences and research-based design (RBD) in their master thesis projects, compared to students attending a more traditional architectural tectonic track. Evaluation relates to the use of scientific literature and theoretical frameworks on topics like "healing architecture" and applied user-oriented methods (interviews, personas, demographics).

RESULTS

Our explorative analysis indicates that students have the skills to make a detailed user analysis when it comes to well-defined user groups in a highly specialized building (e.g., hospice patients and staff). The extent to which health-related research and user perspectives are applied in the design process seems to be primarily driven by thematic focus of the project (welfare buildings in contrast to housing).

CONCLUSION

Despite the challenges in teaching students to assess and apply academic literature, a RBD paradigm in architectural education can help bridge emerging research knowledge with design skills and professional competencies.

Aesthetic preference is related to organized complexity

There is extensive evidence today linking exposure to natural environments to favorable changes in mental and even physical health. There is also a growing body of work indicating that there are specific geometric properties of natural scenes that mediate these effects, and that these properties can also be found in artificial structures like buildings, especially those designed before the emergence of modernism. These geometries are also associated with aesthetic preference–we seem to like what is good for us. Here, using a questionnaire-based survey, we have tried to elucidate some of the parameters that play a role in formulating a preference for one form over the other. The images used were nature scenes from the Alpine landscape with various manipulations to alter their complexity, or with additions of computer graphics or various buildings. In all cases, the presence of a natural scaling hierarchy and of either fractal graphics or of ornate, non-local pre-modern buildings was always preferable to the alternative. We discuss these findings under the light of recent evidence in the field and conclude that they support the idea of the existence of a preference of our perceptive system for certain types of visual organization.