ACTION AFFORDANCE AFFECTS PROXIMAL AND DISTAL GOAL-ORIENTED PLANNING

Approach-Avoidance Bias in Virtual and Real-World Simulations: Insights from a Systematic Review of Experimental Setups

BACKGROUND

Approach and avoidance bias (AAB) describes automatic behavioral tendencies to react toward environmental stimuli regarding their emotional valence. Traditional setups have provided evidence but often lack ecological validity. The study of the AAB in naturalistic contexts has recently increased, revealing significant methodological challenges. This systematic review evaluates the use of virtual reality (VR) and real-world setups to study the AAB, summarizing methodological innovations and challenges.

METHODS

We systematically reviewed peer-reviewed articles employing VR and real-world setups to investigate the AAB. We analyzed experimental designs, stimuli, response metrics, and technical aspects to assess their alignment with research objectives and identify limitations.

RESULTS

This review included 14 studies revealing diverse methodologies, stimulus types, and novel behavioral responses, highlighting significant variability in design strategies and methodological coherence. Several studies used traditional reaction time measures yet varied in their application of VR technology and participant interaction paradigms. Some studies showed discrepancies between simulated and natural bodily actions, while others showcased more integrated approaches that preserved their integrity. Only a minority of studies included control conditions or acquired (neuro)physiological data.

CONCLUSIONS

VR offers a potential ecological setup for studying the AAB, enabling dynamic and immersive interactions. Our results underscore the importance of establishing a coherent framework for investigating the AAB tendencies using VR. Addressing the foundational challenges of developing baseline principles that guide VR-based designs to study the AAB within naturalistic contexts is essential for advancing the AAB research and application. This will ultimately contribute to more reliable and reproducible experimental paradigms and develop effective interventions that help individuals recognize and change their biases, fostering more balanced behaviors.

Combining EEG and eye-tracking in virtual reality: Obtaining fixation-onset event-related potentials and event-related spectral perturbations

Extensive research conducted in controlled laboratory settings has prompted an inquiry into how results can be generalized to real-world situations influenced by the subjects' actions. Virtual reality lends itself ideally to investigating complex situations but requires accurate classification of eye movements, especially when combining it with time-sensitive data such as EEG. We recorded eye-tracking data in virtual reality and classified it into gazes and saccades using a velocity-based classification algorithm, and we cut the continuous data into smaller segments to deal with varying noise levels, as introduced in the REMoDNav algorithm. Furthermore, we corrected for participants' translational movement in virtual reality. Various measures, including visual inspection, event durations, and the velocity and dispersion distributions before and after gaze onset, indicate that we can accurately classify the continuous, free-exploration data. Combining the classified eye-tracking with the EEG data, we generated fixation-onset event-related potentials (ERPs) and event-related spectral perturbations (ERSPs), providing further evidence for the quality of the eye-movement classification and timing of the onset of events. Finally, investigating the correlation between single trials and the average ERP and ERSP identified that fixation-onset ERSPs are less time sensitive, require fewer repetitions of the same behavior, and are potentially better suited to study EEG signatures in naturalistic settings. We modified, designed, and tested an algorithm that allows the combination of EEG and eye-tracking data recorded in virtual reality.

Motor actions across psychiatric disorders: A research domain criteria (RDoC) perspective

The motor system is critical for understanding the pathophysiology and treatment of mental illness. Abnormalities in the processes that allow us to plan and execute movement in a goal-directed, context-appropriate manner (i.e., motor actions) are especially central to clinical motor research. Within this context, the NIMH Research Domain Criteria (RDoC) framework now includes a Motor Actions construct within the recently incorporated Sensorimotor Systems Domain, providing a useful framework for conducting research on motor action processes. However, there is limited available resources for understanding or implementing this framework. We address this gap by providing a comprehensive critical review and conceptual integration of the current clinical literature on the subconstructs comprising the Motor Actions construct. This includes a detailed discussion of each Motor Action subconstruct (e.g., action planning/execution) and its measurement across different units of analysis (e.g., molecules to behavior), the temporal and conceptual relationships among the Motor Action subconstructs (and other relevant RDoC domain constructs), and how abnormalities in these Motor Action subconstructs manifest in mental illness. Together, the review illustrates how motor system dysfunction is implicated in the pathophysiology of many psychiatric conditions and demonstrates shared and distinct mechanisms that may account for similar manifestations of motor abnormalities across disorders.

Just-in-time: Gaze guidance in natural behavior

Natural eye movements have primarily been studied for over-learned activities such as tea-making, sandwich-making, and hand-washing, which have a fixed sequence of associated actions. These studies demonstrate a sequential activation of low-level cognitive schemas facilitating task completion. However, whether these action schemas are activated in the same pattern when a task is novel and a sequence of actions must be planned in the moment is unclear. Here, we recorded gaze and body movements in a naturalistic task to study action-oriented gaze behavior. In a virtual environment, subjects moved objects on a life-size shelf to achieve a given order. To compel cognitive planning, we added complexity to the sorting tasks. Fixations aligned with the action onset showed gaze as tightly coupled with the action sequence, and task complexity moderately affected the proportion of fixations on the task-relevant regions. Our analysis revealed that gaze fixations were allocated to action-relevant targets just in time. Planning behavior predominantly corresponded to a greater visual search for task-relevant objects before the action onset. The results support the idea that natural behavior relies on the frugal use of working memory, and humans refrain from encoding objects in the environment to plan long-term actions. Instead, they prefer just-in-time planning by searching for action-relevant items at the moment, directing their body and hand to it, monitoring the action until it is terminated, and moving on to the following action.