Towards an ecologically valid naturalistic cognitive neuroscience of memory and event cognition

The landscape of human memory and event cognition research has witnessed a transformative journey toward the use of naturalistic contexts and tasks. In this review, we track this progression from abrupt, artificial stimuli used in extensively controlled laboratory experiments to more naturalistic tasks and stimuli that present a more faithful representation of the real world. We argue that in order to improve ecological validity, naturalistic study designs must consider the complexity of the cognitive phenomenon being studied. Then, we review the current state of "naturalistic" event segmentation studies and critically assess frequently employed movie stimuli. We evaluate recently developed tools like lifelogging and other extended reality technologies to help address the challenges we identified with existing naturalistic approaches. We conclude by offering some guidelines that can be used to design ecologically valid cognitive neuroscience studies of memory and event cognition.

AI-enhanced analysis of naturalistic social interactions characterizes interaffective impairments in schizophrenia

Social deficits in schizophrenia have been attributed to an impaired attunement to mutual interaction, or "interaffectivity". While impairments in emotion recognition and facial expressivity in schizophrenia have been consistently reported, findings on mimicry and social synchrony are inconsistent, and previous studies have often lacked ecological validity. To investigate interaffective behavior in dyadic interactions in a real-world-like setting, 20 individuals with schizophrenia and 20 without mental disorder played a cooperative board game with a previously unacquainted healthy control participant. Facial expression analysis was conducted using Affectiva Emotion AI in iMotions 9.3. The contingency and state space distribution of emotional facial expressions was assessed using Mangold INTERACT. Psychotic symptoms, subjective stress, affectivity and game experience were evaluated through questionnaires. Due to a considerable between-group age difference, age-adjusted ANCOVA was performed. Overall, despite an unchanged subjective experience of the social interaction, individuals with schizophrenia exhibited reduced responsiveness to positive affective stimuli. Subjective game experience did not differ between groups. Descriptively, facial expressions in schizophrenia were generally more negative, with increased sadness and decreased joy. Facial mimicry was impaired specifically regarding joyful expressions in schizophrenia, which correlated with blunted affect as measured by the SANS. Dyadic interactions involving persons with schizophrenia were less attracted toward mutual joyful affective states. Only unadjusted for age, in the absence of emotional stimuli from their interaction partner, individuals with schizophrenia showed more angry and sad expressions. These impairments in interaffective processes may contribute to social dysfunction in schizophrenia and provide new avenues for future research.

The magic, memory, and curiosity fMRI dataset of people viewing magic tricks

Videos of magic tricks offer lots of opportunities to study the human mind. They violate the expectations of the viewer, causing prediction errors, misdirect attention, and elicit epistemic emotions. Herein we describe and share the Magic, Memory, and Curiosity (MMC) Dataset where 50 participants watched 36 magic tricks filmed and edited specifically for functional magnetic imaging (fMRI) experiments. The MMC Dataset includes a contextual incentive manipulation, curiosity ratings for the magic tricks, and incidental memory performance tested a week later. We additionally measured individual differences in working memory and constructs relevant to motivated learning. fMRI data were acquired before, during, and after learning. We show that both behavioural and fMRI data are of high quality, as indicated by basic validation analysis, i.e., variance decomposition as well as intersubject correlation and seed-based functional connectivity, respectively. The richness and complexity of the MMC Dataset will allow researchers to explore dynamic cognitive and motivational processes from various angles during task and rest.

A context-dependent model of resilient functioning after childhood maltreatment-the case for flexible biobehavioral synchrony

Many children who experience childhood adversity, whether in the form of threat or deprivation, develop adaptive competencies that lead to resilient functioning. Still, research has not succeeded in accurately predicting the level of resilient functioning by any kind of biomarkers, likely because it has sidelined the flexibility inherent in a construct that is situationally and developmentally variable. Whilst recent research acknowledges the importance of redefining resilience in order to reflect its dynamic nature after adversity, evidence for specific behaviors that are developmentally adaptive and dynamic throughout the lifespan is limited. We here propose a model in which resilient functioning is crucially dependent on the individual's capability to flexibly synchronize with and segregate from another's cognitive-affective, behavioral, and physiological states, known as 'biobehavioral synchrony'. Such an adaptive interpersonal skill is rooted in (a) the early caregiving experience and its regulatory effects on an individual's physiological stress reactivity, as well as (b) the development of self-other distinction which can be affected by childhood maltreatment. Bridging the gap between accounts of flexible resilient functioning and the latest thinking in biobehavioral synchrony, we will review behavioral and neurobiological evidence that threat and deprivation in childhood interfere with the development of dynamic, context-sensitive boundaries between self and other, mediated by the (right) tempo-parietal junction (a central neural hub for interpersonal synchronization), which puts the individual at risk for affective fusion or cut-off from others' arousal states. Our proposed model charts a path for investigating the differential effects of maltreatment experiences and mechanisms for intergenerational transmission of non-sensitive caregiving. We conclude with metrics, data analysis methods, and strategies to facilitate flexible biobehavioral synchrony.

Impairment of affective and cognitive empathy in high functioning autism is mediated by alterations in emotional reactivity

Empathy impairments are considered a key aspect of autism-spectrum disorders (ASD). Previous research consistently shows reduced cognitive empathy, but findings on affective empathy vary, possibly due to experimental design variations (e.g., stimulus modality, social distance) and individual psychological factors (e.g., perceptual abilities, emotional reactivity). This study aims to clarify deficits in affective and cognitive empathy in ASD by addressing these contributing factors. Empathy was examined in 34 autistic individuals and 33 typically developed controls (TDCs) through the Textual Empathy Test (TET). The TET was developed to assess emotional responses when imagining oneself (emotional reactivity) as compared to a target person (friend, stranger) in emotional situations presented via short verbal descriptions. Participants rated emotional states of the target person (cognitive empathy) as well as their own emotional responses when imagining the target person in that situation (affective empathy). Ratings were interpreted relative to normative mean values through standardized regression coefficients. Results showed that high-functioning autism was associated with lower cognitive and affective empathy irrespective of social distance as well as with decreased emotional reactivity compared to controls. Moreover, emotional reactivity mediated the impact of ASD on both empathic components. In summary, altered emotional reactivity may underlie impaired empathy in autistic individuals.

Video analysis of interaction in schizophrenia reveals functionally relevant abnormalities

OBJECTIVE

Deficits of dyadic social interaction seem to diminish social functioning in schizophrenia. However, most previous studies are of a limited ecological validity due to decontextualized experimental conditions far off from real-world interaction. In this pilot study, we thus exposed participants to a more real-world-like situation to generate new hypotheses for research and therapeutic interventions.

METHODS

Dyads of either participants with schizophrenia (n = 21) or control participants without mental disorder (n = 21) were presented with a 5-min emotionally engaging movie. The subsequent uninstructed dyadic interaction was videotaped and analyzed by means of a semi-quantitative, software-supported behavioral analysis.

RESULTS

The patients with schizophrenia showed significant abnormalities regarding their social interaction, such as more negative verbalizations, a more open display of negative affect and gaze abnormalities. Their interaction behavior was mostly characterized by neutral affect, silence and avoidance of direct eye contact. Neutral affect was associated with poorer psychosocial performance. Verbal intelligence and empathy were associated with positive interaction variables, which were also not impaired by psychotic symptom severity.

CONCLUSION

In this real-world-like dyadic interaction, participants with schizophrenia show distinct abnormalities that are relevant to psychosocial performance and consistent with a hypothesized lack of attunement to interaffective situations.

The value of error-correcting responses for cognitive assessment in games

Traditional conflict-based cognitive assessment tools are highly behaviorally restrictive, which prevents them from capturing the dynamic nature of human cognition, such as the tendency to make error-correcting responses. The cognitive game Tunnel Runner measures interference control, response inhibition, and response-rule switching in a less restrictive manner than traditional cognitive assessment tools by giving players movement control after an initial response and encouraging error-correcting responses. Nevertheless, error-correcting responses remain unused due to a limited understanding of what they measure and how to use them. To facilitate the use of error-correcting responses to measure and understand human cognition, we developed theoretically-grounded measures of error-correcting responses in Tunnel Runner and assessed whether they reflected the same cognitive functions measured via initial responses. Furthermore, we evaluated the measurement potential of error-correcting responses. We found that initial and error-correcting responses similarly reflected players' response inhibition and interference control, but not their response-rule switching. Furthermore, combining the two response types increased the reliability of interference control and response inhibition measurements. Lastly, error-correcting responses showed the potential to measure response inhibition on their own. Our results pave the way toward understanding and using post-decision change of mind data for cognitive measurement and other research and application contexts.

Interpreting Neuroscientific Evidence in the Legal Domain: Do the Stereotypes Come In?

The current article explores the meaning of neuroscientific evidence in the legal domain. It takes a social-psychological perspective to discuss how group-based stereotypes affect legal decision-making critically. Examining how any interpretation is anchored and objectified is interesting as evidence is interpreted in the context. Dominantly, with the ubiquity of neuroscience in different domains, the brain is positioned as an authentic source of nurturing authenticity. It is observed that sometimes unquestionable scientific knowledge may surpass the rationality and intuition of judges. In one way, it is a boon; in another, it is shaping the whole framework of our knowledge system, where knowledge from brain studies reifies our understanding of human actions and thinking.

Current opportunities and challenges of immersive virtual reality for psychological research and application

Immersive virtual reality (iVR), that is, digital stereoscopic 360° scenarios usually presented in head-mounted displays, has gained much popularity in medical, educational, and consumer contexts in the last years. Recently, psychological research started to utilize the theoretical and methodological advantages of iVR. Furthermore, understanding cognitive, emotional, and behavioral processes in iVR similar to real-life is a genuinely psychological, currently understudied topic. This article briefly reviews the current application of iVR in psychological research and related disciplines. The review presents empirical evidence for opportunities and strengths (e.g., realism, experimental control, effectiveness of therapeutic and educational interventions) as well as challenges and weaknesses (e.g., differences in experiencing presence, interacting with VR content including avatars, i.e., graphical representation of a person). The main part discusses areas requiring additional basic research, such as cognitive processes, socio-emotional processes during social interactions in iVR, and possible societal implications (e.g., fraud, VR-addiction). For both research and application, iVR offers a contemporary extension of the psychological toolkit, offering new avenues to investigate and enhance core phenomena of psychology such as cognition, affect, motivation, and behavior. Still, it is crucial to exercise caution in its application as excessive and careless use of iVR can pose risks to individuals' mental and physical well-being.

Better together: A systematic review of studies combining magnetic resonance imaging with ecological momentary assessment

Social neuroscientists often use magnetic resonance imaging (MRI) to understand the relationship between social experiences and their neural substrates. Although MRI is a powerful method, it has several limitations in the study of social experiences, first and foremost its low ecological validity. To address this limitation, researchers have conducted multimethod studies combining MRI with Ecological Momentary Assessment (EMA). However, there are no existing recommendations for best practices for conducting and reporting such studies. To address the absence of standards in the field, we conducted a systematic review of papers that combined the methods. A systematic search of peer-reviewed papers resulted in a pool of 11,558 articles. Inclusion criteria were studies in which participants completed (a) Structural or functional MRI and (b) an EMA protocol that included self-report. Seventy-one papers met inclusion criteria. The following review compares these studies based on several key parameters (e.g., sample size) with the aim of determining feasibility and current standards for design and reporting in the field. The review concludes with recommendations for future research. A special focus is given to the ways in which the two methods were combined analytically and suggestions for novel computational methods that could further advance the field of social neuroscience.

Multisensory integration of speech and gestures in a naturalistic paradigm

Speech comprehension is crucial for human social interaction, relying on the integration of auditory and visual cues across various levels of representation. While research has extensively studied multisensory integration (MSI) using idealised, well-controlled stimuli, there is a need to understand this process in response to complex, naturalistic stimuli encountered in everyday life. This study investigated behavioural and neural MSI in neurotypical adults experiencing audio-visual speech within a naturalistic, social context. Our novel paradigm incorporated a broader social situational context, complete words, and speech-supporting iconic gestures, allowing for context-based pragmatics and semantic priors. We investigated MSI in the presence of unimodal (auditory or visual) or complementary, bimodal speech signals. During audio-visual speech trials, compared to unimodal trials, participants more accurately recognised spoken words and showed a more pronounced suppression of alpha power-an indicator of heightened integration load. Importantly, on the neural level, these effects surpassed mere summation of unimodal responses, suggesting non-linear MSI mechanisms. Overall, our findings demonstrate that typically developing adults integrate audio-visual speech and gesture information to facilitate speech comprehension in noisy environments, highlighting the importance of studying MSI in ecologically valid contexts.

A systematic review of mobile brain/body imaging studies using the P300 event-related potentials to investigate cognition beyond the laboratory

The P300 ERP component, related to the onset of task-relevant or infrequent stimuli, has been widely used in the Mobile Brain/Body Imaging (MoBI) literature. This systematic review evaluates the quality and breadth of P300 MoBI studies, revealing a maturing field with well-designed research yet grappling with standardization and global representation challenges. While affirming the reliability of measuring P300 ERP components in mobile settings, the review identifies significant hurdles in standardizing data cleaning and processing techniques, impacting comparability and reproducibility. Geographical disparities emerge, with studies predominantly in the Global North and a dearth of research from the Global South, emphasizing the need for broader inclusivity to counter the WEIRD bias in psychology. Collaborative projects and mobile EEG systems showcase the feasibility of reaching diverse populations, which is essential to advance precision psychiatry and to integrate varied data streams. Methodologically, a trend toward ecological validity is noted, shifting from lab-based to real-world settings with portable EEG system advancements. Future hardware developments are expected to balance signal quality and sensor intrusiveness, enriching data collection in everyday contexts. Innovative methodologies reflect a move toward more natural experimental settings, prompting critical questions about the applicability of traditional ERP markers, such as the P300 outside structured paradigms. The review concludes by highlighting the crucial role of integrating mobile technologies, physiological sensors, and machine learning to advance cognitive neuroscience. It advocates for an operational definition of ecological validity to bridge the gap between controlled experiments and the complexity of embodied cognitive experiences, enhancing both theoretical understanding and practical application in study design.

From physical to digital: A theoretical-methodological primer on designing hyperscanning investigations to explore remote exchanges

As individuals increasingly engage in social interactions through digital mediums, understanding the neuroscientific underpinnings of such exchanges becomes a critical challenge and a valuable opportunity. In line with a second-person neuroscience approach, understanding the forms of interpersonal syntonisation that occur during digital interactions is pivotal for grasping the mechanisms underlying successful collaboration in virtual spaces. The hyperscanning paradigm, involving the simultaneous monitoring of the brains and bodies of multiple interacting individuals, seems to be a powerful tool for unravelling the neural correlates of interpersonal syntonisation in social exchanges. We posit that such approach can now open new windows on interacting brains' responses even to digitally-conveyed social cues, offering insights into how social information is processed in the absence of traditional face-to-face settings. Yet, such paradigm shift raises challenging methodological questions, which should be answered properly to conduct significant and informative hyperscanning investigations. Here, we provide an introduction to core methodological issues dedicated to novices approaching the design of hyperscanning investigations of remote exchanges in natural settings, focusing on the selection of neuroscientific devices, synchronization of data streams, and data analysis approaches. Finally, a methodological checklist for devising robust hyperscanning studies on digital interactions is presented.

A framework for neurophysiological experiments on flow states

Csikszentmihalyi's concept of the "flow state" was initially discovered in experts deeply engaged in self-rewarding activities. However, recent neurophysiology research often measures flow in constrained and unfamiliar activities. In this perspective article, we address the challenging yet necessary considerations for studying flow state's neurophysiology. We aggregate an activity-autonomy framework with several testable hypotheses to induce flow, expanding the traditional "challenge skill balance" paradigm. Further, we review and synthesise the best methodological practices from neurophysiological flow studies into a practical 24-item checklist. This checklist offers detailed guidelines for ensuring consistent reporting, personalising and testing isolated challenge types, factoring in participant skills, motivation, and individual differences, and processing self-report data. We argue for a cohesive approach in neurophysiological studies to capture a consistent representation of flow states.

Combining EEG and eye-tracking in virtual reality: Obtaining fixation-onset event-related potentials and event-related spectral perturbations

Extensive research conducted in controlled laboratory settings has prompted an inquiry into how results can be generalized to real-world situations influenced by the subjects' actions. Virtual reality lends itself ideally to investigating complex situations but requires accurate classification of eye movements, especially when combining it with time-sensitive data such as EEG. We recorded eye-tracking data in virtual reality and classified it into gazes and saccades using a velocity-based classification algorithm, and we cut the continuous data into smaller segments to deal with varying noise levels, as introduced in the REMoDNav algorithm. Furthermore, we corrected for participants' translational movement in virtual reality. Various measures, including visual inspection, event durations, and the velocity and dispersion distributions before and after gaze onset, indicate that we can accurately classify the continuous, free-exploration data. Combining the classified eye-tracking with the EEG data, we generated fixation-onset event-related potentials (ERPs) and event-related spectral perturbations (ERSPs), providing further evidence for the quality of the eye-movement classification and timing of the onset of events. Finally, investigating the correlation between single trials and the average ERP and ERSP identified that fixation-onset ERSPs are less time sensitive, require fewer repetitions of the same behavior, and are potentially better suited to study EEG signatures in naturalistic settings. We modified, designed, and tested an algorithm that allows the combination of EEG and eye-tracking data recorded in virtual reality.

Motor Strategies: The Role of Active Behavior in Spatial Hearing Research

When completing a task, the ability to implement behavioral strategies to solve it in an effective and cognitively less-demanding way is extremely adaptive for humans. This behavior makes it possible to accumulate evidence and test one's own predictions about the external world. In this work, starting from examples in the field of spatial hearing research, I analyze the importance of considering motor strategies in perceptual tasks, and I stress the urgent need to create ecological experimental settings, which are essential in allowing the implementation of such behaviors and in measuring them. In particular, I will consider head movements as an example of strategic behavior implemented to solve acoustic space-perception tasks.

Taking consciousness for real: Increasing the ecological validity of the study of conscious vs. unconscious processes

The study of consciousness has developed well-controlled, rigorous methods for manipulating and measuring consciousness. Yet, in the process, experimental paradigms grew farther away from everyday conscious and unconscious processes, which raises the concern of ecological validity. In this review, we suggest that the field can benefit from adopting a more ecological approach, akin to other fields of cognitive science. There, this approach challenged some existing hypotheses, yielded stronger effects, and enabled new research questions. We argue that such a move is critical for studying consciousness, where experimental paradigms tend to be artificial and small effect sizes are relatively prevalent. We identify three paths for doing so-changing the stimuli and experimental settings, changing the measures, and changing the research questions themselves-and review works that have already started implementing such approaches. While acknowledging the inherent challenges, we call for increasing ecological validity in consciousness studies.

A practical guide to EEG hyperscanning in joint action research: from motivation to implementation

Developments in cognitive neuroscience have led to the emergence of hyperscanning, the simultaneous measurement of brain activity from multiple people. Hyperscanning is useful for investigating social cognition, including joint action, because of its ability to capture neural processes that occur within and between people as they coordinate actions toward a shared goal. Here, we provide a practical guide for researchers considering using hyperscanning to study joint action and seeking to avoid frequently raised concerns from hyperscanning skeptics. We focus specifically on Electroencephalography (EEG) hyperscanning, which is widely available and optimally suited for capturing fine-grained temporal dynamics of action coordination. Our guidelines cover questions that are likely to arise when planning a hyperscanning project, ranging from whether hyperscanning is appropriate for answering one's research questions to considerations for study design, dependent variable selection, data analysis and visualization. By following clear guidelines that facilitate careful consideration of the theoretical implications of research design choices and other methodological decisions, joint action researchers can mitigate interpretability issues and maximize the benefits of hyperscanning paradigms.

An Analytical Approach for Naturalistic Cooperative and Competitive EEG-Hyperscanning Data: A Proof-of-Concept Study

Investigating the neural mechanisms underlying both cooperative and competitive joint actions may have a wide impact in many social contexts of human daily life. An effective pipeline of analysis for hyperscanning data recorded in a naturalistic context with a cooperative and competitive motor task has been missing. We propose an analytical pipeline for this type of joint action data, which was validated on electroencephalographic (EEG) signals recorded in a proof-of-concept study on two dyads playing cooperative and competitive table tennis. Functional connectivity maps were reconstructed using the corrected imaginary part of the phase locking value (ciPLV), an algorithm suitable in case of EEG signals recorded during turn-based competitive joint actions. Hyperbrain, within-, and between-brain functional connectivity maps were calculated in three frequency bands (i.e., theta, alpha, and beta) relevant during complex motor task execution and were characterized with graph theoretical measures and a clustering approach. The results of the proof-of-concept study are in line with recent findings on the main features of the functional networks sustaining cooperation and competition, hence demonstrating that the proposed pipeline is promising tool for the analysis of joint action EEG data recorded during cooperation and competition using a turn-based motor task.

Dyadic contagion in cognitive function: A nationally-representative longitudinal study of older U.S. couples

Later-life cognitive function is strongly influenced by one's environment. At this life stage, a partner's behaviors and attributes-including their own cognitive status-are a key environmental determinant. A recent "social allostasis" theory also yields specific predictions on patterns of mutual influence-or "contagion"-in cognitive function. Yet, no population representative studies have examined these coupled dynamics. Using recently developed fixed-effects cross-lagged panel modeling (FE-CLPM) methods and ten-year data from the Health and Retirement Study-nationally-representative of U.S. adults over 50-the current study filled this gap. Results supported dyadic cognitive contagion over the long- but not short-run. Short-term associations suggested intriguing "cognitive cycling" possibilities among both men and women that need further investigation. Overall, results supported a theoretical model of coupled "cognitive careers," and relational inducement of allostatic load. Especially among men, recurrent impulses also cumulatively induced substantial path-dependent cognitive improvements, supporting the added value of repeated over one-time interventions. Theoretical and substantive implications are discussed.

Electrophysiological correlates of face and object perception: A comparative analysis of 2D laboratory and virtual reality conditions

Human face perception is a specialized visual process with inherent social significance. The neural mechanisms reflecting this intricate cognitive process have evolved in spatially complex and emotionally rich environments. Previous research using VR to transfer an established face perception paradigm to realistic conditions has shown that the functional properties of face-sensitive neural correlates typically observed in the laboratory are attenuated outside the original modality. The present study builds on these results by comparing the perception of persons and objects under conventional laboratory (PC) and realistic conditions in VR. Adhering to established paradigms, the PC- and VR modalities both featured images of persons and cars alongside standard control images. To investigate the individual stages of realistic face processing, response times, the typical face-sensitive N170 component, and relevant subsequent components (L1, L2; pre-, post-response) were analyzed within and between modalities. The between-modality comparison of response times and component latencies revealed generally faster processing under realistic conditions. However, the obtained N170 latency and amplitude differences showed reduced discriminative capacity under realistic conditions during this early stage. These findings suggest that the effects commonly observed in the lab are specific to monitor-based presentations. Analyses of later and response-locked components showed specific neural mechanisms for identification and evaluation are employed when perceiving the stimuli under realistic conditions, reflected in discernible amplitude differences in response to faces and objects beyond the basic perceptual features. Conversely, the results do not provide evidence for comparable stimulus-specific perceptual processing pathways when viewing pictures of the stimuli under conventional laboratory conditions.

Should I Stay or Should I Go? Cognitive Modeling of Left-Turn Gap Acceptance Decisions in Human Drivers

OBJECTIVE

We aim to bridge the gap between naturalistic studies of driver behavior and modern cognitive and neuroscientific accounts of decision making by modeling the cognitive processes underlying left-turn gap acceptance by human drivers.

BACKGROUND

Understanding decisions of human drivers is essential for the development of safe and efficient transportation systems. Current models of decision making in drivers provide little insight into the underlying cognitive processes. On the other hand, laboratory studies of abstract, highly controlled tasks point towards noisy evidence accumulation as a key mechanism governing decision making. However, it is unclear whether the cognitive processes implicated in these tasks are as paramount to decisions that are ingrained in more complex behaviors, such as driving.

RESULTS

The drivers' probability of accepting the available gap increased with the size of the gap; importantly, response time increased with time gap but not distance gap. The generalized drift-diffusion model explained the observed decision outcomes and response time distributions, as well as substantial individual differences in those. Through cross-validation, we demonstrate that the model not only explains the data, but also generalizes to out-of-sample conditions.

CONCLUSION

Our results suggest that dynamic evidence accumulation is an essential mechanism underlying left-turn gap acceptance decisions in human drivers, and exemplify how simple cognitive process models can help to understand human behavior in complex real-world tasks.

APPLICATION

Potential applications of our results include real-time prediction of human behavior by automated vehicles and simulating realistic human-like behaviors in virtual environments for automated vehicles.

Dynamic and/or multimodal assessments for social cognition in neuropsychology: Results from a systematic literature review

Objective: Despite the prevalence of socio-cognitive disturbances, and their important diagnostic/therapeutic implications, the assessment of these disturbances remains scarce. This systematic review aims to identify available social cognition tools for adult assessment that use multimodal and/or dynamic social cues, specifying their strengths and limitations (e.g. from a methodological, psychometric, ecological, and clinical perspective). Method: An electronic search was conducted in Pubmed, PsychINFO, Embase and Scopus databases for articles published up to the 3th of January 2023 and the first 200 Google Scholar results on the same date. The PRISMA methodology was applied, 3884 studies were screened based on title and abstract and 329 full texts were screened. Articles using pseudo-dynamic methodologies (e.g. morphing), reported only subjective or self-reported measures, or investigated only physiological or brain activity responses were excluded. Results: In total, 149 works were included in this review, representing 65 assessment tools (i.e. 48% studying emotion recognition (n = 31), 32% Theory of Mind (n = 21), 5% empathy (n = 3), 1.5% moral cognition/social reasoning (n = 1), and 14% being multimodal (n = 9)). For each study, the tool's main characteristics, psychometric properties, ecological validity indicators and available norms are reported. The tools are presented according to social-cognitive process assessed and communication channels used. Conclusions: This study highlights the lack of validated and standardized tools. A few tools appear to partially meet some clinical needs. The development of methodologies using a first-person paradigm and taking into account the multidimensional nature of social cognition seems a relevant research endeavour for greater ecological validity.

Remote Wearable Neuroimaging Devices for Health Monitoring and Neurophenotyping: A Scoping Review

Digital health tracking is a source of valuable insights for public health research and consumer health technology. The brain is the most complex organ, containing information about psychophysical and physiological biomarkers that correlate with health. Specifically, recent developments in electroencephalogram (EEG), functional near-infra-red spectroscopy (fNIRS), and photoplethysmography (PPG) technologies have allowed the development of devices that can remotely monitor changes in brain activity. The inclusion criteria for the papers in this review encompassed studies on self-applied, remote, non-invasive neuroimaging techniques (EEG, fNIRS, or PPG) within healthcare applications. A total of 23 papers were reviewed, comprising 17 on using EEGs for remote monitoring and 6 on neurofeedback interventions, while no papers were found related to fNIRS and PPG. This review reveals that previous studies have leveraged mobile EEG devices for remote monitoring across the mental health, neurological, and sleep domains, as well as for delivering neurofeedback interventions. With headsets and ear-EEG devices being the most common, studies found mobile devices feasible for implementation in study protocols while providing reliable signal quality. Moderate to substantial agreement overall between remote and clinical-grade EEGs was found using statistical tests. The results highlight the promise of portable brain-imaging devices with regard to continuously evaluating patients in natural settings, though further validation and usability enhancements are needed as this technology develops.

Favoritism or bias? Cooperation and competition under different intergroup relationships: evidence from EEG hyperscanning

Cooperation and competition are the most common forms of social interaction in various social relationships. Intergroup relationships have been posited to influence individuals' interpersonal interactions significantly. Using electroencephalography hyperscanning, this study aimed to establish whether intergroup relationships influence interpersonal cooperation and competition and the underlying neural mechanisms. According to the results, the in-group Coop-index is better than the out-group, whereas the out-group Comp-index is stronger than the in-group. The in-group functional connectivity between the frontal-central region and the right temporoparietal junction in the β band was stronger in competition than cooperation. The out-group functional connectivity between the frontal-central region and the left temporoparietal junction in the α band was stronger in cooperation than competition. In both cooperation and competition, the in-group exhibited higher interbrain synchronization between the prefrontal cortex and parietal region in the θ band, as well as between the frontal-central region and frontal-central region in the α band, compared to the out-group. The intrabrain phase-locking value in both the α and β bands can effectively predict performance in competition tasks. Interbrain phase-locking value in both the α and θ bands can be effectively predicted in a performance cooperation task. This study offers neuroscientific evidence for in-group favoritism and out-group bias at an interpersonal level.

Using virtual reality to induce multi-trial inattentional blindness despite trial-by-trial measures of awareness

Unconscious processing has been widely examined using diverse and well-controlled methodologies. However, the extent to which these findings are relevant to real-life instances of information processing without awareness is limited. Here, we present a novel inattentional blindness (IB) paradigm in virtual reality (VR). In three experiments, we managed to repeatedly induce IB while participants foveally viewed salient stimuli for prolonged durations. The effectiveness of this paradigm demonstrates the close relationship between top-down attention and subjective experience. Thus, this method provides an ecologically valid setup to examine processing without awareness.

How Do Psychology Professors View the Relation Between Scientific Knowledge and Its Applicability and Societal Relevance?

How do researchers in psychology view the relation between scientific knowledge, its applicability, and its societal relevance? Most research on psychological science and its benefits to society is discussed from a bird's eye view (a meta-scientific perspective), by identifying general trends such as psychology's dominant focus on lab-based experiments and general descriptive theories. In recent years, several critics have argued that this focus has come at the cost of reduced practical and societal relevance. In this study, we interviewed Dutch psychology professors to gauge their views about the relation between psychological research and its relevance to society. We found that psychology professors engaged in a variety of activities to engage science with society, from work in clinical and applied settings, to consultancy, education, and science communication. However, we found that the role of theory when applying scientific knowledge to practical problems is far from straightforward. While most participants regarded theories as relevant to understanding general contexts of application, psychological theories were seldom directly related to specific applications. We compare and discuss our findings in the light of recent discussions about the lack of applicability and societal relevance of psychological science.

Methods matter: Exploring how expectations influence common actions

Behavior in controlled laboratory studies is not always representative of what people do in daily life. This has prompted a recent shift toward conducting studies in natural settings. We wondered whether expectations raised by how the task is presented should also be considered. To find out, we studied gaze when walking down and up a staircase. Gaze was often directed at steps before stepping on them, but most participants did not look at every step. Importantly, participants fixated more steps and looked around less when asked to navigate the staircase than when navigating the same staircase but asked to walk outside. Presumably, expecting the staircase to be important made participants direct their gaze at more steps, despite the identical requirements when on the staircase. This illustrates that behavior can be influenced by expectations, such as expectations resulting from task instructions, even when studies are conducted in natural settings.

Fixation-related potentials during mobile map assisted navigation in the real world: The effect of landmark visualization style

An often-proposed enhancement for mobile maps to aid assisted navigation is the presentation of landmark information, yet understanding of the manner in which they should be displayed is limited. In this study, we investigated whether the visualization of landmarks as 3D map symbols with either an abstract or realistic style influenced the subsequent processing of those landmarks during route navigation. We utilized a real-world mobile electroencephalography approach to this question by combining several tools developed to overcome the challenges typically encountered in real-world neuroscience research. We coregistered eye-movement and EEG recordings from 45 participants as they navigated through a real-world environment using a mobile map. Analyses of fixation event-related potentials revealed that the amplitude of the parietal P200 component was enhanced when participants fixated landmarks in the real world that were visualized on the mobile map in a realistic style, and that frontal P200 latencies were prolonged for landmarks depicted in either a realistic or abstract style compared with features of the environment that were not presented on the map, but only for the male participants. In contrast, we did not observe any significant effects of landmark visualization style on visual P1-N1 peaks or the parietal late positive component. Overall, the findings indicate that the cognitive matching process between landmarks seen in the environment and those previously seen on a map is facilitated by more realistic map display, while low-level perceptual processing of landmarks and recall of associated information are unaffected by map visualization style.

The psychophysiology of Mastermind: Characterizing response times and blinking in a high-stakes television game show

Television game shows have proven to be a valuable resource for studying human behavior under conditions of high stress and high stakes. However, previous work has focused mostly on choices-ignoring much of the rich visual information that is available on screen. Here, we take a first step to extracting more of this information by investigating the response times and blinking of contestants in the BBC show Mastermind. In Mastermind, contestants answer rapid-fire quiz questions while a camera slowly zooms in on their faces. By labeling contestants' behavior and blinks from 25 episodes, we asked how accuracy, response times, and blinking varied over the course of the game. For accuracy and response times, we tested whether contestants responded more accurately and more slowly after an error-exhibiting the "post-error increase in accuracy" and "post-error slowing" which has been repeatedly observed in the lab. For blinking, we tested whether blink rates varied according to the cognitive demands of the game-decreasing during periods of cognitive load, such as when pondering a response, and increasing at event boundaries in the task, such as the start of a question. In contrast to the lab, evidence for post-error changes in accuracy and response time was weak, with only marginal effects observed. In line with the lab, blinking varied over the course of the game much as we predicted. Overall, our findings demonstrate the potential of extracting dynamic signals from game shows to study the psychophysiology of behavior in the real world.

Post-interaction neuroplasticity of inter-brain networks underlies the development of social relationship

Inter-brain coupling has been increasingly recognized for its role in supporting connectedness during social communication. Here we investigate whether inter-brain coupling is plastic and persists beyond the offset of social interaction, facilitating the emergence of social closeness. Dyads were concurrently scanned using functional near infrared spectroscopy (fNIRS) while engaging in a task that involved movement synchronization. To assess post-interaction neuroplasticity, participants performed a baseline condition with no interaction before and after the interaction. The results reveal heightened inter-brain coupling in neural networks comprising the inferior frontal gyrus (IFG) and dorsomedial prefrontal cortex in the post-task compared to the pre-task baseline. Critically, the right IFG emerged as a highly connected hub, with post-task inter-brain coupling in this region predicting the levels of motivation to connect socially. We suggest that post-interactions inter-brain coupling may reflect consolidation of socially related cues, underscoring the role of inter-brain plasticity in fundamental aspects of relationship development.

Temporal Unfolding of Racial Ingroup Bias in Neural Responses to Perceived Dynamic Pain in Others

In this study, we investigated how empathic neural responses unfold over time in different empathy networks when viewing same-race and other-race individuals in dynamic painful conditions. We recorded magnetoencephalography signals from Chinese adults when viewing video clips showing a dynamic painful (or non-painful) stimulation to Asian and White models' faces to trigger painful (or neutral) expressions. We found that perceived dynamic pain in Asian models modulated neural activities in the visual cortex at 100 ms-200 ms, in the orbitofrontal and subgenual anterior cingulate cortices at 150 ms-200 ms, in the anterior cingulate cortex around 250 ms-350 ms, and in the temporoparietal junction and middle temporal gyrus around 600 ms after video onset. Perceived dynamic pain in White models modulated activities in the visual, anterior cingulate, and primary sensory cortices after 500 ms. Our findings unraveled earlier dynamic activities in multiple neural circuits in response to same-race (vs other-race) individuals in dynamic painful situations.

Knowledge Transfer Within Organizations: Mechanisms, Motivation, and Consideration

Knowledge transfer-the extent to which one unit learns from or is affected by the experience of another-has the potential to improve the performance of organizations. Through knowledge transfer, developments made in one unit of an organization can benefit others. Studies have found, however, considerable variation in the extent to which knowledge transfers across organizational units. In some cases, knowledge transfers seamlessly, whereas in others, knowledge transfer is far from complete. This article reviews research with the aim of explaining the variation observed in knowledge transfer. Key factors identified as explaining the variation include knowledge transfer opportunities, knowledge characteristics, mechanisms for knowledge transfer, motivation for transfer, and the depth of consideration of knowledge. These factors are integrated into a theoretical framework that predicts when knowledge transfer will be successful. The article concludes with a discussion of directions for future research to increase our understanding of knowledge transfer in organizations.

Childhood conduct problems and parent-child talk during social and nonsocial play contexts: a naturalistic home-based experiment

Parent-child interactions are a critical pathway to emotion socialization, with disruption to these processes associated with risk for childhood behavior problems. Using computational linguistics methods, we tested whether (1) play context influenced parent-child socioemotional language, and (2) child conduct problems or callous-unemotional traits were associated with patterns of socioemotional or nonsocial language across contexts. Seventy-nine parent-child dyads (children, 5-6 years old) played a socioemotional skills ("social context") or math ("nonsocial context") game at home. We transcribed and analyzed game play, which had been audio recorded by participants. The social context elicited more socioemotional and cognitive words, while the nonsocial context elicited more mathematical words. The use of socioemotional language by parents and children was more strongly correlated in the social context, but context did not moderate the degree of correlation in cognitive or mathematical word use between parents and children. Children with more conduct problems used fewer socioemotional words in the social context, while children with higher callous-unemotional traits used fewer cognitive words in both contexts. We highlight the role of context in supporting socioemotionally rich parent-child language interactions and provide preliminary evidence for the existence of linguistic markers of child behavior problems. Our results also inform naturalistic assessments of parent-child interactions and home-based interventions for parents and children facing socioemotional or behavioral challenges.

High-dimensional Metaverse Platforms and the Virtually Extended Self

The study of cognition has traditionally used low-dimensional measures and stimulus presentations that emphasize laboratory control over high-dimensional (i.e., ecologically valid) tools that reflect the activities and interactions in everyday living. Although controlled experimental presentations in laboratories have enhanced our understanding of cognition for both healthy and clinical cohorts, high dimensionality may extend reality and cognition. High-dimensional Metaverse approaches use extended reality (XR) platforms with dynamic stimulus presentations that couple humans and simulation technologies to extend cognition. The plan for this paper is as follows: The "Extending from low to high-dimensional studies of cognition" section discusses current needs for high-dimensional stimulus presentations that reflect everyday cognitive activities. In the "Algorithmic devices and digital extension of cognition" section, technologies of the extended mind are introduced with the Metaverse as a candidate cognitive process for extension. Next, in the "A neurocognitive framework for understanding technologies of the extended mind" section, a framework and model are proposed for understanding the neural correlates of human technology couplings in terms of automatic algorithmic processes (limbic-ventral striatal loop); reflective cognition (prefrontal-dorsal striatal loop); and algorithmic processing (insular cortex). The algorithmic processes of human-technology interactions can, over time, become an automated and algorithmic coupling of brain and technology. The manuscript ends with a brief summary and discussion of the ways in which the Metaverse can be used for studying how persons respond to high-dimensional stimuli in simulations that approximate real-world activities and interactions.

An investigation of the modulatory effects of empathic and autistic traits on emotional and facial motor responses during live social interactions

A close relationship between emotional contagion and spontaneous facial mimicry has been theoretically proposed and is supported by empirical data. Facial expressions are essential in terms of both emotional and motor synchrony. Previous studies have demonstrated that trait emotional empathy enhanced spontaneous facial mimicry, but the relationship between autistic traits and spontaneous mimicry remained controversial. Moreover, previous studies presented faces that were static or videotaped, which may lack the "liveliness" of real-life social interactions. We addressed this limitation by using an image relay system to present live performances and pre-recorded videos of smiling or frowning dynamic facial expressions to 94 healthy female participants. We assessed their subjective experiential valence and arousal ratings to infer the amplitude of emotional contagion. We measured the electromyographic activities of the zygomaticus major and corrugator supercilii muscles to estimate spontaneous facial mimicry. Individual differences measures included trait emotional empathy (empathic concern) and the autism-spectrum quotient. We did not find that live performances enhanced the modulatory effect of trait differences on emotional contagion or spontaneous facial mimicry. However, we found that a high trait empathic concern was associated with stronger emotional contagion and corrugator mimicry. We found no two-way interaction between the autism spectrum quotient and emotional condition, suggesting that autistic traits did not modulate emotional contagion or spontaneous facial mimicry. Our findings imply that previous findings regarding the relationship between emotional empathy and emotional contagion/spontaneous facial mimicry using videos and photos could be generalized to real-life interactions.

Mobile fNIRS for exploring inter-brain synchrony across generations and time

While still relatively rare, longitudinal hyperscanning studies are exceptionally valuable for documenting changes in inter-brain synchrony, which may in turn underpin how behaviors develop and evolve in social settings. The generalizability and ecological validity of this experimental approach hinges on the selected imaging technique being mobile-a requirement met by functional near-infrared spectroscopy (fNIRS). fNIRS has most frequently been used to examine the development of inter-brain synchrony and behavior in child-parent dyads. In this position paper, we contend that dedicating attention to longitudinal and intergenerational hyperscanning stands to benefit the fields of social and cognitive neuroscience more broadly. We argue that this approach is particularly relevant for understanding the neural mechanisms underpinning intergenerational social dynamics, and potentially for benchmarking progress in psychological and social interventions, many of which are situated in intergenerational contexts. In line with our position, we highlight areas of intergenerational research that stand to be enhanced by longitudinal hyperscanning with mobile devices, describe challenges that may arise from measuring across generations in the real world, and offer potential solutions.

Inducing visual attention through audiovisual stimuli: Can synchronous sound be a salient event?

We present an experimental research aiming to explore how spatial attention may be biased through auditory stimuli. In particular, we investigate how synchronous sound and image may affect attention and increase the saliency of the audiovisual event. We have designed and implemented an experimental study where subjects, wearing an eye-tracking system, were examined regarding their gaze toward the audiovisual stimuli being displayed. The audiovisual stimuli were specifically tailored for this experiment, consisting of videos contrasting in terms of Synch Points (i.e., moments where a visual event is associated with a visible trigger movement, synchronous with its correspondent sound). While consistency across audiovisual sensory modalities revealed to be an attention-drawing feature, when combined with synchrony, it clearly emphasized the biasing, triggering orienting, that is, focal attention towards the particular scene that contains the Synch Point. Consequently, results revealed synchrony to be a saliency factor, contributing to the strengthening of the focal attention.

Predictive processing of scenes and objects

Real-world visual input consists of rich scenes that are meaningfully composed of multiple objects which interact in complex, but predictable, ways. Despite this complexity, we recognize scenes, and objects within these scenes, from a brief glance at an image. In this review, we synthesize recent behavioral and neural findings that elucidate the mechanisms underlying this impressive ability. First, we review evidence that visual object and scene processing is partly implemented in parallel, allowing for a rapid initial gist of both objects and scenes concurrently. Next, we discuss recent evidence for bidirectional interactions between object and scene processing, with scene information modulating the visual processing of objects, and object information modulating the visual processing of scenes. Finally, we review evidence that objects also combine with each other to form object constellations, modulating the processing of individual objects within the object pathway. Altogether, these findings can be understood by conceptualizing object and scene perception as the outcome of a joint probabilistic inference, in which "best guesses" about objects act as priors for scene perception and vice versa, in order to concurrently optimize visual inference of objects and scenes.

Social Understanding beyond the Familiar: Disparity in Visual Abilities Does Not Impede Empathy and Theory of Mind

Feeling with our conspecifics and understanding their sentiments and intentions is a crucial part of our lives. What is the basis for these forms of social understanding? If individuals ground their understanding of others' thoughts and feelings in their own perceptual and factual experiences, it could present a challenge to empathize and mentalize with those whose reality of life is significantly different. This preregistered study compared two groups of participants who differed in a central perceptual feature, their visual abilities (visually impaired vs. unimpaired; total N = 56), concerning their social understanding of others who were themselves either visually impaired or unimpaired. Employing an adjusted version of the EmpaToM task, participants heard short, autobiographic narrations by visually impaired or unimpaired individuals, and we assessed their empathic responding and mentalizing performance. Our findings did not reveal heightened empathy and mentalizing proclivities when the narrator's visual abilities aligned with those of the participant. However, in some circumstances, cognitive understanding of others' narrations benefitted from familiarity with the situation. Overall, our findings suggest that social understanding does not mainly rely on perceptual familiarity with concrete situations but is likely grounded in sharing emotions and experiences on a more fundamental level.

Learning of object-in-context sequences in freely-moving macaques

Flexible learning is a hallmark of primate cognition, which arises through interactions with changing environments. Studies of the neural basis for this flexibility are typically limited by laboratory settings that use minimal environmental cues and restrict interactions with the environment, including active sensing and exploration. To address this, we constructed a 3-D enclosure containing touchscreens on its walls, for studying cognition in freely moving macaques. To test flexible learning, two monkeys completed trials consisting of a regular sequence of object selections across four touchscreens. On each screen, the monkeys had to select by touching the sole correct object item ('target') among a set of four items, irrespective of their positions on the screen. Each item was the target on exactly one screen of the sequence, making correct performance conditioned on the spatiotemporal sequence rule across screens. Both monkeys successfully learned multiple 4-item sets (N=14 and 22 sets), totaling over 50 and 80 unique, conditional item-context memoranda, with no indication of capacity limits. The enclosure allowed freedom of movements leading up to and following the touchscreen interactions. To determine whether movement economy changed with learning, we reconstructed 3D position and movement dynamics using markerless tracking software and gyroscopic inertial measurements. Whereas general body positions remained consistent across repeated sequences, fine head movements varied as monkeys learned, within and across sequence sets, demonstrating learning set or "learning to learn". These results demonstrate monkeys' rapid, capacious, and flexible learning within an integrated, multisensory 3-D space. Furthermore, this approach enables the measurement of continuous behavior while ensuring precise experimental control and behavioral repetition of sequences over time. Overall, this approach harmonizes the design features that are needed for electrophysiological studies with tasks that showcase fully situated, flexible cognition.

A deep new look at color

Bowers et al. counter deep neural networks (DNNs) as good models of human visual perception. From our color perspective we feel their view is based on three misconceptions: A misrepresentation of the state-of-the-art of color perception; the type of model required to move the field forward; and the attribution of shortcomings to DNN research that are already being resolved.

Theta EEG neurofeedback promotes early consolidation of real life-like episodic memory

Theta oscillations are believed to coordinate neuronal activity related to human cognition, especially for memory functions. Theta power during learning and retrieval has been found to correlate with memory performance success. Additionally, up-regulating theta oscillations during a post-encoding epoch crucial for memory consolidation was previously shown to benefit long-term memory for acquired motor sequences, pictures, and object-location associations. However, it remains to be determined whether such effects would be found for more ecological aspects of long-term episodic memory. Therefore, the current study assessed neurofeedback-based theta upregulation effects on movie memory. After viewing a 15-minute silent, narrative movie, participants engaged in neurofeedback-based theta/beta up-regulation, neurofeedback beta/theta up-regulation as an active control condition, or an unrelated passive control task. Memory was tested three times: once immediately after watching the movie (as baseline); 24 hours thereafter; and once again 1 week later. Memory performance 1 week after encoding was significantly enhanced in the theta/beta up-regulation group compared with the other groups. Additionally, changes in neurofeedback theta/beta ratio from baseline EEG recordings correlated with long-term memory gains in retrieving the movie's content. These findings highlight the relationship between post-learning theta oscillations and the consolidation of episodic memory for a naturalistic event.

Effects of nature on restorative and cognitive benefits in indoor environment

This study investigates the effects of natural exposure in an indoor environment on restorative quality and cognitive ability. Thirty participants were shown nature at three different indoor sites: baseline, indoor (some vegetation), and semi-indoor (a large amount of vegetation and view to sky) for five minutes. After viewing, they completed an assessment of restoration and a cognitive task, and their electroencephalography (EEG) was recorded. Compared to the baseline, the sites with nature resulted in restorative (higher perceived restoration scores) and cognitive (higher working memory performance and lower delta-to-theta ratio (DTR), delta-to-alpha ratio (DAR), theta-to-beta ratio (TBR), and alpha-to-beta ratio (ABR) responses) benefits. These findings further our understanding of the effects of exposure to nature on restorative and cognitive benefits in an indoor environment, and help to build guidance for future research on the effects of nature indoors and designing restorative- and cognitive-enhancing indoor spaces.

Moving beyond the lab: investigating empathy through the Empirical 5E approach

Empathy is a complex and multifaceted phenomenon that plays a crucial role in human social interactions. Recent developments in social neuroscience have provided valuable insights into the neural underpinnings and bodily mechanisms underlying empathy. This methodology often prioritizes precision, replicability, internal validity, and confound control. However, fully understanding the complexity of empathy seems unattainable by solely relying on artificial and controlled laboratory settings, while overlooking a comprehensive view of empathy through an ecological experimental approach. In this article, we propose articulating an integrative theoretical and methodological framework based on the 5E approach (the "E"s stand for embodied, embedded, enacted, emotional, and extended perspectives of empathy), highlighting the relevance of studying empathy as an active interaction between embodied agents, embedded in a shared real-world environment. In addition, we illustrate how a novel multimodal approach including mobile brain and body imaging (MoBi) combined with phenomenological methods, and the implementation of interactive paradigms in a natural context, are adequate procedures to study empathy from the 5E approach. In doing so, we present the Empirical 5E approach (E5E) as an integrative scientific framework to bridge brain/body and phenomenological attributes in an interbody interactive setting. Progressing toward an E5E approach can be crucial to understanding empathy in accordance with the complexity of how it is experienced in the real world.

Landmark Sequence Learning from Real-World Route Navigation and the Impact of Navigation Aid Visualisation Style

Primacy and recency features of serial memory are a hallmark of typical memory functions that have been observed for a wide array of tasks. Recently, the ubiquity of this serial position effect has been supported for objects learned during navigation, with canonical serial position functions observed for sequence memory of landmarks that were encountered along a route during a highly controlled virtual navigation task. In the present study, we extended those findings to a real-world navigation task in which participants actively walked a route through a city whilst using a navigation aid featuring either realistic or abstract landmark visualisation styles. Analyses of serial position functions (i.e., absolute sequence knowledge) and sequence lags (i.e., relative sequence knowledge) yielded similar profiles to those observed in a lab based virtual navigation task from previous work and non-spatial list learning studies. There were strong primacy effects for serial position memory in both conditions; recency effects only in the realistic visualisation condition; a non-uniform distribution of item-lags peaking at lag +1; and an overall bias towards positive lags for both visualisation conditions. The findings demonstrate that benchmark serial position memory effects can be observed in uncontrolled, real-world behaviour. In a navigation context, the results support the notion that general memory mechanisms are involved in spatial learning, and that landmark sequence knowledge is a feature of spatial knowledge which is affected by navigation aids.

Prospective memories in the wild: Predicting memory for intentions in natural environments

Prospective memory, the ability to remember an intention at the appropriate future moment, is often investigated in the laboratory to maximize experimental control. However, demands of laboratory prospective memory tasks only partly map onto everyday demands. Therefore, it is an open question whether factors which predict prospective memory in the laboratory also predict prospective memory in the real world. We combined diary and ecological momentary assessment methods to investigate which factors, that have been repeatedly shown to predict prospective memory performance in laboratory tasks, are related to the fulfillment of everyday intentions. Results showed that substantial portions of variance in real-world prospective memory performance could be explained with the factors found to be significant in laboratory. The most powerful predictors were perceived intention importance, the use of external memory aids, delay interval, and conscientiousness. However, some meaningful laboratory predictors (e.g., working memory) played only a minor role in natural environments and a large portion of the variance in everyday intention fulfillment remained unexplained. The results substantially extend the understanding of conditions and personality variables most conducive to remembering intentions, but they also suggest that additional factors influencing real-world prospective memory remain to be discovered.

Editorial for Special Issue "Psychophysiology and Experimental Psychology"

The first experimental laboratory in psychology was founded in Leipzig (Germany), where Wilhelm Wundt mainly investigated feelings and sensations by employing experimental methods. Almost a century and half after is debut, experimental laboratories have extremely evolved in terms of apparatus, instruments, and recording techniques. Under a multiand interdisciplinary perspective, we can now better understand human cognitive and affective processes. As current zeitgeist has placed increasing emphasis upon the ecologically valid research, an "out-of-thelab" approach, integrated with both human and nonhuman research, is expected to leverage scientific advances in the field of human behavior.

Age-related decreases in global metacognition are independent of local metacognition and task performance

Metacognition refers to a capacity to reflect on and control other cognitive processes, commonly quantified as the extent to which confidence tracks objective performance. There is conflicting evidence about how "local" metacognition (monitoring of individual judgments) and "global" metacognition (estimates of self-performance) change across the lifespan. Additionally, the degree to which metacognition generalises across cognitive domains may itself change with age due to increased experience with one's own abilities. Using a gamified suite of performance-controlled memory and visual perception tasks, we measured local and global metacognition in an age-stratified sample of 304 healthy volunteers (18-83 years; N = 50 in each of 6 age groups). We calculated both local and global metrics of metacognition and quantified how and whether domain-generality changes with age. First-order task performance was stable across the age range. People's global self-performance estimates and local metacognitive bias decreased with age, indicating overall lower confidence in performance. In contrast, local metacognitive efficiency was spared in older age and remained correlated across the two cognitive domains. A stability of local metacognition indicates distinct mechanisms contributing to local and global metacognition. Our study reveals how local and global metacognition change across the lifespan and provide a benchmark against which disease-related changes in metacognition can be compared.

Mobile cognition: imaging the human brain in the 'real world'

Cognitive neuroscience studies in humans have enabled decades of impactful discoveries but have primarily been limited to recording the brain activity of immobile participants in a laboratory setting. In recent years, advances in neuroimaging technologies have enabled recordings of human brain activity to be obtained during freely moving behaviours in the real world. Here, we propose that these mobile neuroimaging methods can provide unique insights into the neural mechanisms of human cognition and contribute to the development of novel treatments for neurological and psychiatric disorders. We further discuss the challenges associated with studying naturalistic human behaviours in complex real-world settings as well as strategies for overcoming them. We conclude that mobile neuroimaging methods have the potential to bring about a new era of cognitive neuroscience in which neural mechanisms can be studied with increased ecological validity and with the ability to address questions about natural behaviour and cognitive processes in humans engaged in dynamic real-world experiences.