A virtual reality-based FMRI study of reward-based spatial learning

When virtual reality becomes psychoneuroendocrine reality: A stress(or) review

This review article was awarded the Dirk Hellhammer award from ISPNE in 2023. It explores the dynamic relationship between stressors and stress from a historical view as well as a vision towards the future of stress research via virtual reality (VR). We introduce the concept of a "syncytium," a permeable boundary that blurs the distinction between stress and stressor, in order to understand why the field of stress biology continues to inadequately measure stress alone as a proxy for the force of external stressors. Using Virtual Reality (VR) as an illustrative example to explicate the black box of stressors, we examine the distinction between 'immersion' and 'presence' as analogous terms for stressor and stress, respectively. We argue that the conventional psychological approaches to stress measurement and appraisal theory unfortunately fall short in quantifying the force of the stressor, leading to reverse causality fallacies. Further, the concept of affordances is introduced as an ecological or holistic tool to measure and design a stressor's force, bridging the gap between the external environment and an individual's physiological response to stress. Affordances also serve to ameliorate shortcomings in stress appraisal by integrating ecological interdependencies. By combining VR and psychobiological measures, this paper aims to unravel the complexity of the stressor-stress syncytium, highlighting the necessity of assessing both the internal and external facets to gain a holistic understanding of stress physiology and shift away from reverse causality reasoning. We find that the utility of VR extends beyond presence to include affordance-based measures of immersion, which can effectively model stressor force. Future research should prioritize the development of tools that can measure both immersion and presence, thereby providing a more comprehensive understanding of how external stressors interact with individual psychological states.

Network-wise analysis of movie-specific information in dynamic functional connectivity using COBE

Movie watching during functional magnetic resonance imaging has emerged as a promising tool to measure the complex behavior of the brain in response to a stimulus similar to real-life situations. It has been observed that presenting a movie (sequence of events) as a stimulus will lead to a unique time course of dynamic functional connectivity related to movie stimuli that can be compared across the participants. We assume that the observed dynamic functional connectivity across subjects can be divided into following 2 components: (i) specific to a movie stimulus (depicting group-level behavior in functional connectivity) and (ii) individual-specific behavior (not necessarily common across the subjects). In this work, using the dynamic time warping distance measure, we have shown the extent of similarity between the temporal sequences of functional connectivity while the underlying movie stimuli were same and different. Further, the temporal sequence of functional connectivity patterns related to a movie is enhanced by suppressing the subject-specific components of dynamic functional connectivity using common and orthogonal basis extraction. Quantitative analysis using the F-ratio measure reveals significant differences in dynamic functional connectivity within the somatomotor network and default mode network, as well as between the occipital network and somatomotor networks.

VR for Cognition and Memory

This chapter will provide a review of research into human cognition through the lens of VR-based paradigms for studying memory. Emphasis is placed on why VR increases the ecological validity of memory research and the implications of such enhancements.

Combined robot motor assistance with neural circuit-based virtual reality (NeuCir-VR) lower extremity rehabilitation training in patients after stroke: a study protocol for a single-centre randomised controlled trial

INTRODUCTION

Improving lower extremity motor function is the focus and difficulty of post-stroke rehabilitation treatment. More recently, robot-assisted and virtual reality (VR) training are commonly used in post-stroke rehabilitation and are considered feasible treatment methods. Here, we developed a rehabilitation system combining robot motor assistance with neural circuit-based VR (NeuCir-VR) rehabilitation programme involving procedural lower extremity rehabilitation with reward mechanisms, from muscle strength training, posture control and balance training to simple and complex ground walking training. The study aims to explore the effectiveness and neurological mechanisms of combining robot motor assistance and NeuCir-VR lower extremity rehabilitation training in patients after stroke.

METHODS AND ANALYSIS

This is a single-centre, observer-blinded, randomised controlled trial. 40 patients with lower extremity hemiparesis after stroke will be recruited and randomly divided into a control group (combined robot assistance and VR training) and an intervention group (combined robot assistance and NeuCir-VR training) by the ratio of 1:1. Each group will receive five 30 min sessions per week for 4 weeks. The primary outcome will be Fugl-Meyer assessment of the lower extremity. Secondary outcomes will include Berg Balance Scale, Modified Ashworth Scale and functional connectivity measured by resting-state functional MRI. Outcomes will be measured at baseline (T0), post-intervention (T1) and follow-ups (T2-T4).

ETHICS, REGISTRATION AND DISSEMINATION

The trial was approved by the Ethics Committee of Yueyang Hospital of Integrated Traditional Chinese and Western Medicine, Shanghai University of Chinese Traditional Medicine (Grant No. 2019-014). The results will be submitted to a peer-reviewed journal or at a conference.

TRIAL REGISTRATION NUMBER

ChiCTR2100052133.

Virtual reality gaming in rehabilitation after stroke - user experiences and perceptions

PURPOSE

The present study explored participants' experiences with and perceptions of using fully immersive head-mounted virtual reality (VR) gaming as rehabilitation after stroke.

METHODS

Four men and three women (median age 64 years) with chronic stroke and varying motor impairment (mild to severe) were interviewed after 10 weeks of VR training on the commercial HTC Vive system, focusing on the upper extremities. Inductive qualitative thematic analysis was performed.

RESULTS

The analysis revealed three main themes: playing the game, benefits and effects, and personalizing the game. Playing the game encompasses both the feeling of being immersed in the game and descriptions of the gaming being motivating and fun. Benefits and effects describe the participants' expectations of potential benefits, the importance of getting feed-back, and the impact in daily life. Personalizing the game includes finding the right game and level, and the participants' need for support to achieve full use of the training.

CONCLUSIONS

Participants with chronic stroke described the fully immersive VR gaming intervention as a fun and motivating way to improve their functioning in everyday life. Qualitative studies are needed to explore how people with stroke perceive VR gaming when it is implemented in real clinical environments.Clinical implicationsVR gaming was perceived as a positive and motivating rehabilitation after stroke.Getting feedback and perceiving benefits are essential parts of VR rehabilitation.Commercial fully immersive VR-games might be an option for stroke rehabilitation when the game can be personalized and support is available.

Wearable Immersive Virtual Reality Device for Promoting Physical Activity in Parkinson's Disease Patients

Parkinson’s disease (PD) is a neurological disorder that usually appears in the 6th decade of life and affects up to 2% of older people (65 years and older). Its therapeutic management is complex and includes not only pharmacological therapies but also physiotherapy. Exercise therapies have shown good results in disease management in terms of rehabilitation and/or maintenance of physical and functional capacities, which is important in PD. Virtual reality (VR) could promote physical activity in this population. We explore whether a commercial wearable head-mounted display (HMD) and the selected VR exergame could be suitable for people with mild–moderate PD. In all, 32 patients (78.1% men; 71.50 ± 11.80 years) were a part of the study. Outcomes were evaluated using the Simulator Sickness Questionnaire (SSQ), the System Usability Scale (SUS), the Game Experience Questionnaire (GEQ post-game module), an ad hoc satisfaction questionnaire, and perceived effort. A total of 60 sessions were completed safely (without adverse effects (no SSQ symptoms) and with low scores in the negative experiences of the GEQ (0.01–0.09/4)), satisfaction opinions were positive (88% considered the training “good” or “very good”), and the average usability of the wearable HMD was good (75.16/100). Our outcomes support the feasibility of a boxing exergame combined with a wearable commercial HMD as a suitable physical activity for PD and its applicability in different environments due to its safety, usability, low cost, and small size. Future research is needed focusing on postural instability, because it seems to be a symptom that could have an impact on the success of exergaming programs aimed at PD.

Application of Real and Virtual Radial Arm Maze Task in Human

Virtual Reality (VR) emerges as a promising technology capable of creating different scenarios in which the body, environment, and brain are closely related, proving enhancements in the diagnosis and treatment of several spatial memory deficits. In recent years, human spatial navigation has increasingly been studied in interactive virtual environments. However, navigational tasks are still not completely adapted in immersive 3D VR systems. We stipulate that an immersive Radial Arm Maze (RAM) is an excellent instrument, allowing the participants to be physically active within the maze exactly as in the walking RAM version in reality modality. RAM is a behavioral ecological task that allows the analyses of different facets of spatial memory, distinguishing declarative components from procedural ones. In addition to describing the characteristics of RAM, we will also analyze studies in which RAM has been used in virtual modality to provide suggestions into RAM building in immersive modality.

Can Immersive Virtual Reality Videogames Help Parkinson's Disease Patients? A Case Study

Video games have proven useful in physical rehabilitation therapy. Accessibility, however, is limited for some groups such as the elderly or patients with Parkinson’s disease (PD). We explore the potential of fully immersive video games as a rehabilitation tool in PD patients. Four patients with mild-moderate PD (3 males:1 female, 53–71 years) participated in the study. Training consisted in two immersive virtual reality video gaming sessions. Outcomes were evaluated using System Usability Scale (SUS), Simulator Sickness Questionnaire (SSQ), Game Experience Questionnaire-post game (GEQ), an ad hoc satisfaction questionnaire and perceived effort. All participants completed the sessions without adverse effects (100%), without SSQ symptoms reported. Post-gaming SUS was >75% in both sessions (range 75–80%). Post-gaming GEQ scores were 3.3–4.0/4 in both sessions. Immersive virtual reality video gaming is feasible in patients with mild-moderate PD, with positive usability and patient satisfaction, and no adverse effects.

Learning and Animal Movement

Integrating diverse concepts from animal behavior, movement ecology, and machine learning, we develop an overview of the ecology of learning and animal movement. Learning-based movement is clearly relevant to ecological problems, but the subject is rooted firmly in psychology, including a distinct terminology. We contrast this psychological origin of learning with the task-oriented perspective on learning that has emerged from the field of machine learning. We review conceptual frameworks that characterize the role of learning in movement, discuss emerging trends, and summarize recent developments in the analysis of movement data. We also discuss the relative advantages of different modeling approaches for exploring the learning-movement interface. We explore in depth how individual and social modalities of learning can matter to the ecology of animal movement, and highlight how diverse kinds of field studies, ranging from translocation efforts to manipulative experiments, can provide critical insight into the learning process in animal movement.

Meta-analytic clustering dissociates brain activity and behavior profiles across reward processing paradigms

Reward learning is a ubiquitous cognitive mechanism guiding adaptive choices and behaviors, and when impaired, can lead to considerable mental health consequences. Reward-related functional neuroimaging studies have begun to implicate networks of brain regions essential for processing various peripheral influences (e.g., risk, subjective preference, delay, social context) involved in the multifaceted reward processing construct. To provide a more complete neurocognitive perspective on reward processing that synthesizes findings across the literature while also appreciating these peripheral influences, we used emerging meta-analytic techniques to elucidate brain regions, and in turn networks, consistently engaged in distinct aspects of reward processing. Using a data-driven, meta-analytic, k-means clustering approach, we dissociated seven meta-analytic groupings (MAGs) of neuroimaging results (i.e., brain activity maps) from 749 experimental contrasts across 176 reward processing studies involving 13,358 healthy participants. We then performed an exploratory functional decoding approach to gain insight into the putative functions associated with each MAG. We identified a seven-MAG clustering solution that represented dissociable patterns of convergent brain activity across reward processing tasks. Additionally, our functional decoding analyses revealed that each of these MAGs mapped onto discrete behavior profiles that suggested specialized roles in predicting value (MAG-1 & MAG-2) and processing a variety of emotional (MAG-3), external (MAG-4 & MAG-5), and internal (MAG-6 & MAG-7) influences across reward processing paradigms. These findings support and extend aspects of well-accepted reward learning theories and highlight large-scale brain network activity associated with distinct aspects of reward processing.

Human spatial navigation: Neural representations of spatial scales and reference frames obtained from an ALE meta-analysis

Humans use different spatial reference frames (allocentric or egocentric) to navigate successfully toward their destination in different spatial scale spaces (environmental or vista). However, it remains unclear how the brain represents different spatial scales and different spatial reference frames. Thus, we conducted an activation likelihood estimation (ALE) meta-analysis of 47 fMRI articles involving human spatial navigation. We found that both the environmental and vista spaces activated the parahippocampal place area (PPA), retrosplenial complex (RSC), and occipital place area in the right hemisphere. The environmental space showed stronger activation than the vista space in the occipital and frontal regions. No brain region exhibited stronger activation for the vista than the environmental space. The allocentric and egocentric reference frames activated the bilateral PPA and right RSC. The allocentric frame showed more stronger activations than the egocentric frame in the right culmen, left middle frontal gyrus, and precuneus. No brain region displayed stronger activation for the egocentric than the allocentric navigation. Our findings suggest that navigation in different spatial scale spaces can evoke specific and common brain regions, and that the brain regions representing spatial reference frames are not absolutely separated.

Commercial head-mounted display virtual reality for upper extremity rehabilitation in chronic stroke: a single-case design study

Background

Rehabilitation is crucial for maximizing recovery after stroke. Rehabilitation activities that are fun and rewarding by themselves can be more effective than those who are not. Gamification with virtual reality (VR) exploits this principle. This single-case design study probes the potential for using commercial off-the-shelf, room-scale head-mounted virtual reality for upper extremity rehabilitation in individuals with chronic stroke, the insights of which can inform further research.

Methods

A heterogeneous volunteer sample of seven participants living with stroke were recruited through advertisement. A single-case design was employed with a 5-week baseline (A), followed by a 10-week intervention (B) and a 6-month follow-up. Upper extremity motor function was assessed with validated kinematic analysis of drinking task. Activity capacity was assessed with Action Research Arm Test, Box and Block Test and ABILHAND questionnaire. Assessments were done weekly and at follow-up. Playing games on a VR-system with head-mounted display (HTC Vive) was used as rehabilitation intervention. Approximately 300 games were screened and 6 tested. Visual analysis and Tau-U statistics were used to interpret the results.

Results

Visual analysis of trend, level shift and overlap as well as Tau-U statistics indicated improvement of Action Research Arm Test in six participants. Four of these had at least a moderate Tau-U score (0.50–0.92), in at least half of the assessed outcomes. These four participants trained a total of 361 to 935 min. Two out of four participants who were able to perform the drinking task, had the highest training dose (> 900 min) and showed also improvements in kinematics. The predominant game played was Beat Saber. No serious adverse effects related to the study were observed, one participant interrupted the intervention phase due to a fall at home.

Conclusions

This first study of combining commercial games, a commercial head-mounted VR, and commercial haptic hand controls, showed promising results for upper extremity rehabilitation in individuals with chronic stroke. By being affordable yet having high production values, as well as being an easily accessible off-the-shelf product, this variant of VR technology might facilitate widespread adaption. Insights garnered in this study can facilitate the execution of future studies.

Trial registration The study was registered at researchweb.org (project number 262331, registered 2019-01-30, https://www.researchweb.org/is/vgr/project/262331) prior to participant enrolment.

Spatial Network Connectivity and Spatial Reasoning Ability in Children with Nonverbal Learning Disability

Nonverbal Learning Disability (NVLD) is characterized by deficits in visual-spatial, but not verbal, reasoning. Nevertheless, the functioning of the neural circuits supporting spatial processing have yet to be assessed in children with NVLD. We compared the resting state functional connectivity of a spatial brain network among children with NVLD, children with reading disorder (RD), and typically developing (TD) children. Seventy-five participants (7-15 years old) were included in the study (20 TD, 24 NVLD, and 31 RD). Group differences in global efficiency and functional connectivity among 12 regions comprising a previously defined spatial network were evaluated. Associations with behavior were explored. Global efficiency of the spatial network associated positively with spatial ability and inversely with socioemotional problems. Within the spatial network, associations between left posterior cingulate (PCC) and right retrosplenial cortical activity were reduced in children with NVLD relative to those without spatial deficits (RD and TD). Connectivity between left PCC and right posterior cerebellum (Crus I and II) was reduced in both groups of children with learning disabilities (NVLD and RD) relative to TD children. Functional connectivity of the spatial network was atypically associated with cognitive and socioemotional performance in children with NVLD. Identifying a neurobiological substrate for NVLD provides evidence that it is a discrete clinical entity and suggests targets for treatment.

Education and visual neuroscience: A mini-review

Neuroscience, especially visual neuroscience, is a burgeoning field that has greatly shaped the format and efficacy of education. Moreover, findings from visual neuroscience are an ongoing source of great progress in pedagogy. In this mini-review, I review existing evidence and areas of active research to describe the fundamental questions and general applications for visual neuroscience as it applies to education. First, I categorize the research questions and future directions for the role of visual neuroscience in education. Second, I juxtapose opposing views on the roles of neuroscience in education and reveal the "neuromyths" propagated under the guise of educational neuroscience. Third, I summarize the policies and practices applied in different countries and for different age ranges. Fourth, I address and discuss the merits of visual neuroscience in art education and of visual perception theories (e.g., those concerned with perceptual organization with respect to space and time) in reading education. I consider how vision-deprived students could benefit from current knowledge of brain plasticity and visual rehabilitation methods involving compensation from other sensory systems. I also consider the potential educational value of instructional methods based on statistical learning in the visual domain. Finally, I outline the accepted translational framework for applying findings from educational neuroscience to pedagogical theory.

Differential diagnosis of schizophrenia and schizoaffective disorder from normal subjects using virtual reality

Dysfunction of allocentric and egocentric memories is one of the core features of psychiatric disorders. There are a few navigational studies on these memories in schizophrenia and bipolar disorders, but studies in schizoaffective disorder are lacking. Here, we aim to explore allocentric and egocentric navigation deficits in these subjects using our advanced recently developed virtual reality navigation task (VRNT). Twenty patients with schizophrenia and 20 with schizoaffective disorder were compared with 20 normal volunteer subjects on VRNTs consisting of a virtual neighbourhood (allocentric memory) and a virtual maze (egocentric memory). Compared with schizoaffective disorder and control subjects, patients with schizophrenia had the worst performance on both virtual neighbourhood and virtual maze tasks. The allocentric memory in both patients with schizophrenia and those with schizoaffective disorder was more impaired than the egocentric memory (p ˂ 0.001). However, the patients with schizoaffective disorder performed better in egocentric memory than those with schizophrenia, as they had fewer errors in the virtual maze. It was concluded that allocentric memory is more impaired than egocentric in both schizoaffective disorder and schizophrenia patients, whereas patients with schizoaffective disorder performed better in egocentric memory than patients with schizophrenia. It was also concluded that allocentric memory deficits can help differentiate patients with schizophrenia and schizoaffective disorder from healthy participants, whereas egocentric memory deficits can be used to distinguish them from each other.

Shared and Distinct Neural Bases of Large- and Small-Scale Spatial Ability: A Coordinate-Based Activation Likelihood Estimation Meta-Analysis

Background: Spatial ability is vital for human survival and development. However, the relationship between large-scale and small-scale spatial ability remains poorly understood. To address this issue from a novel perspective, we performed an activation likelihood estimation (ALE) meta-analysis of neuroimaging studies to determine the shared and distinct neural bases of these two forms of spatial ability. Methods: We searched Web of Science, PubMed, PsycINFO, and Google Scholar for studies regarding "spatial ability" published within the last 20 years (January 1988 through June 2018). A final total of 103 studies (Table 1) involving 2,085 participants (male = 1,116) and 2,586 foci were incorporated into the meta-analysis. Results: Large-scale spatial ability was associated with activation in the limbic lobe, posterior lobe, occipital lobe, parietal lobe, right anterior lobe, frontal lobe, and right sub-lobar area. Small-scale spatial ability was associated with activation in the parietal lobe, occipital lobe, frontal lobe, right posterior lobe, and left sub-lobar area. Furthermore, conjunction analysis revealed overlapping regions in the sub-gyrus, right superior frontal gyrus, right superior parietal lobule, right middle occipital gyrus, right superior occipital gyrus, left inferior occipital gyrus, and precuneus. The contrast analysis demonstrated that the parahippocampal gyrus, left lingual gyrus, culmen, right middle temporal gyrus, left declive, left superior occipital gyrus, and right lentiform nucleus were more strongly activated during large-scale spatial tasks. In contrast, the precuneus, right inferior frontal gyrus, right precentral gyrus, left inferior parietal lobule, left supramarginal gyrus, left superior parietal lobule, right inferior occipital gyrus, and left middle frontal gyrus were more strongly activated during small-scale spatial tasks. Our results further indicated that there is no absolute difference in the cognitive strategies associated with the two forms of spatial ability (egocentric/allocentric). Conclusion: The results of the present study verify and expand upon the theoretical model of spatial ability proposed by Hegarty et al. Our analysis revealed a shared neural basis between large- and small-scale spatial abilities, as well as specific yet independent neural bases underlying each. Based on these findings, we proposed a more comprehensive version of the behavioral model.

Cooperating yet distinct brain networks engaged during naturalistic paradigms: A meta-analysis of functional MRI results

Cognitive processes do not occur by pure insertion and instead depend on the full complement of co-occurring mental processes, including perceptual and motor functions. As such, there is limited ecological validity to human neuroimaging experiments that use highly controlled tasks to isolate mental processes of interest. However, a growing literature shows how dynamic, interactive tasks have allowed researchers to study cognition as it more naturally occurs. Collective analysis across such neuroimaging experiments may answer broader questions regarding how naturalistic cognition is biologically distributed throughout the brain. We applied an unbiased, data-driven, meta-analytic approach that uses k-means clustering to identify core brain networks engaged across the naturalistic functional neuroimaging literature. Functional decoding allowed us to, then, delineate how information is distributed between these networks throughout the execution of dynamical cognition in realistic settings. This analysis revealed six recurrent patterns of brain activation, representing sensory, domain-specific, and attentional neural networks that support the cognitive demands of naturalistic paradigms. Although gaps in the literature remain, these results suggest that naturalistic fMRI paradigms recruit a common set of networks that allow both separate processing of different streams of information and integration of relevant information to enable flexible cognition and complex behavior.

Enhancing the Ecological Validity of fMRI Memory Research Using Virtual Reality

Functional magnetic resonance imaging (fMRI) is a powerful research tool to understand the neural underpinnings of human memory. However, as memory is known to be context-dependent, differences in contexts between naturalistic settings and the MRI scanner environment may potentially confound neuroimaging findings. Virtual reality (VR) provides a unique opportunity to mitigate this issue by allowing memories to be formed and/or retrieved within immersive, navigable, visuospatial contexts. This can enhance the ecological validity of task paradigms, while still ensuring that researchers maintain experimental control over critical aspects of the learning and testing experience. This mini-review surveys the growing body of fMRI studies that have incorporated VR to address critical questions about human memory. These studies have adopted a variety of approaches, including presenting research participants with VR experiences in the scanner, asking participants to retrieve information that they had previously acquired in a VR environment, or identifying neural correlates of behavioral metrics obtained through VR-based tasks performed outside the scanner. Although most such studies to date have focused on spatial or navigational memory, we also discuss the promise of VR in aiding other areas of memory research and facilitating research into clinical disorders.

Separate neural representations of prediction error valence and surprise: Evidence from an fMRI meta-analysis

Learning occurs when an outcome differs from expectations, generating a reward prediction error signal (RPE). The RPE signal has been hypothesized to simultaneously embody the valence of an outcome (better or worse than expected) and its surprise (how far from expectations). Nonetheless, growing evidence suggests that separate representations of the two RPE components exist in the human brain. Meta-analyses provide an opportunity to test this hypothesis and directly probe the extent to which the valence and surprise of the error signal are encoded in separate or overlapping networks. We carried out several meta-analyses on a large set of fMRI studies investigating the neural basis of RPE, locked at decision outcome. We identified two valence learning systems by pooling studies searching for differential neural activity in response to categorical positive-versus-negative outcomes. The first valence network (negative > positive) involved areas regulating alertness and switching behaviours such as the midcingulate cortex, the thalamus and the dorsolateral prefrontal cortex whereas the second valence network (positive > negative) encompassed regions of the human reward circuitry such as the ventral striatum and the ventromedial prefrontal cortex. We also found evidence of a largely distinct surprise-encoding network including the anterior cingulate cortex, anterior insula and dorsal striatum. Together with recent animal and electrophysiological evidence this meta-analysis points to a sequential and distributed encoding of different components of the RPE signal, with potentially distinct functional roles.

Patterns of activation and de-activation associated with cue-guided spatial navigation: A whole-brain, voxel-based study

Functional imaging studies have implicated the hippocampus and parahippocampal gyrus in cue-guided spatial navigation, but also many other regions. Furthermore, little is known about de-activations that take place during performance of navigation tasks, something that is of interest given that the hippocampus is a component of the default mode network, which de-activates during attention-demanding tasks. In this study 22 healthy subjects underwent whole-brain functional Magnetic Resonance Imaging (fMRI) while they navigated toward a previously learned goal in a virtual reality environment. At a threshold of p<0.05 corrected, the subjects showed a pattern of widespread cortical activations, including the parahippocampal and retrosplenial cortex and also parts of the frontal, temporal and occipital cortex. Hippocampal activation, however, was restricted to the posterior portion of the structure bilaterally. De-activations were seen in the medial frontal cortex and other regions of the default mode network, but not in the posterior cingulate cortex/precuneus. The findings support the involvement of the hippocampus in cue-guided navigation, but suggest that its posterior regions are particularly important. Cue-guided spatial navigation is associated with de-activation in some but not all parts of the default mode network.

Combining Dopaminergic Facilitation with Robot-Assisted Upper Limb Therapy in Stroke Survivors: A Focused Review

Despite aggressive conventional therapy, lasting hemiplegia persists in a large percentage of stroke survivors. The aim of this article is to critically review the rationale behind targeting multiple sites along the motor learning network by combining robotic therapy with pharmacotherapy and virtual reality–based reward learning to alleviate upper extremity impairment in stroke survivors. Methods for personalizing pharmacologic facilitation to each individual’s unique biology are also reviewed. At the molecular level, treatment with levodopa was shown to induce long-term potentiation-like and practice-dependent plasticity. Clinically, trials combining conventional therapy with levodopa in stroke survivors yielded statistically significant but clinically unconvincing outcomes because of limited personalization, standardization, and reproducibility. Robotic therapy can induce neuroplasticity by delivering intensive, reproducible, and functionally meaningful interventions that are objective enough for the rigors of research. Robotic therapy also provides an apt platform for virtual reality, which boosts learning by engaging reward circuits. The future of stroke rehabilitation should target distinct molecular, synaptic, and cortical sites through personalized multimodal treatments to maximize motor recovery.

Reward-Based Spatial Learning in Teens With Bulimia Nervosa

OBJECTIVE

To assess the functioning of mesolimbic and fronto-striatal areas involved in reward-based spatial learning in teenaged girls with bulimia nervosa (BN) that might be involved in the development and maintenance of maladaptive behaviors characteristic of the disorder.

METHOD

We compared functional magnetic resonance imaging blood oxygen level-dependent response in 27 adolescent girls with BN to that of 27 healthy, age-matched control participants during a reward-based learning task that required learning to use extra-maze cues to navigate a virtual 8-arm radial maze to find hidden rewards. We compared groups in their patterns of brain activation associated with reward-based spatial learning versus a control condition in which rewards were unexpected because they were allotted pseudo-randomly to experimentally prevent learning.

RESULTS

Both groups learned to navigate the maze to find hidden rewards, but group differences in brain activity associated with maze navigation and reward processing were detected in the fronto-striatal regions and right anterior hippocampus. Unlike healthy adolescents, those with BN did not engage the right inferior frontal gyrus during maze navigation, activated the right anterior hippocampus during the receipt of unexpected rewards (control condition), and deactivated the left superior frontal gyrus and right anterior hippocampus during expected reward receipt (learning condition). These patterns of hippocampal activation in the control condition were significantly associated with the frequency of binge-eating episodes.

CONCLUSION

Adolescents with BN displayed abnormal functioning of the anterior hippocampus and fronto-striatal regions during reward-based spatial learning. These findings suggest that an imbalance in control and reward circuits may arise early in the course of BN. Clinical trial registration information-An fMRI Study of Self-Regulation in Adolescents With Bulimia Nervosa; https://clinicaltrials.gov/; NCT00345943.

Examining hippocampal function in schizophrenia using a virtual reality spatial navigation task

BACKGROUND

Structural pathology in the hippocampus is well-documented in schizophrenia, but brain functional changes have not been consistently found. We used spatial navigation in a virtual reality environment, a task that is known to produce robust hippocampal activation in healthy subjects, to examine task-related activations and de-activations in the disorder.

METHODS

Twenty-seven DSM IV schizophrenia patients and 32 healthy controls underwent fMRI while they navigated to a goal through a virtual reality town. Activations and de-activations were examined at the whole brain level and also using a region-of-interest (ROI) in the hippocampus.

RESULTS

Spatial navigation was associated with activation in the posterior hippocampus and parahippocampal gyrus plus widespread neocortical areas. The patients showed reduced activation compared to the controls in the left dorsolateral prefrontal cortex (DLPFC) and the left occipital/temporal cortex. No differences in hippocampal activation were seen either at the whole-brain level or in the ROI analysis. The patients showed failure of de-activation affecting some but not all subregions of the default mode network.

CONCLUSIONS

Schizophrenia is associated with task-related hypoactivation in the DLPFC during spatial navigation, but not with functional changes in the hippocampus. The failure of de-activation also found adds to evidence for default mode network dysfunction in the disorder.

Investigating virtual reality navigation in amnestic mild cognitive impairment using fMRI

Spatial navigation requires a well-established network of brain regions, including the hippocampus, caudate nucleus, and retrosplenial cortex. Amnestic Mild Cognitive Impairment (aMCI) is a condition with predominantly memory impairment, conferring a high predictive risk factor for dementia. aMCI is associated with hippocampal atrophy and subtle deficits in spatial navigation. We present the first use of a functional Magnetic Resonance Imaging (fMRI) navigation task in aMCI, using a virtual reality analog of the Radial Arm Maze. Compared with controls, aMCI patients showed reduced activity in the hippocampus bilaterally, retrosplenial cortex, and left dorsolateral prefrontal cortex. Reduced activation in key areas for successful navigation, as well as additional regions, was found alongside relatively normal task performance. Results also revealed increased activity in the right dorsolateral prefrontal cortex in aMCI patients, which may reflect compensation for reduced activations elsewhere. These data support suggestions that fMRI spatial navigation tasks may be useful for staging of progression in MCI.

Accurately decoding visual information from fMRI data obtained in a realistic virtual environment

Three-dimensional interactive virtual environments (VEs) are a powerful tool for brain-imaging based cognitive neuroscience that are presently under-utilized. This paper presents machine-learning based methods for identifying brain states induced by realistic VEs with improved accuracy as well as the capability for mapping their spatial topography on the neocortex. VEs provide the ability to study the brain under conditions closer to the environment in which humans evolved, and thus to probe deeper into the complexities of human cognition. As a test case, we designed a stimulus to reflect a military combat situation in the Middle East, motivated by the potential of using real-time functional magnetic resonance imaging (fMRI) in the treatment of post-traumatic stress disorder. Each subject experienced moving through the virtual town where they encountered 1-6 animated combatants at different locations, while fMRI data was collected. To analyze the data from what is, compared to most studies, more complex and less controlled stimuli, we employed statistical machine learning in the form of Multi-Voxel Pattern Analysis (MVPA) with special attention given to artificial Neural Networks (NN). Extensions to NN that exploit the block structure of the stimulus were developed to improve the accuracy of the classification, achieving performances from 58 to 93% (chance was 16.7%) with six subjects. This demonstrates that MVPA can decode a complex cognitive state, viewing a number of characters, in a dynamic virtual environment. To better understand the source of this information in the brain, a novel form of sensitivity analysis was developed to use NN to quantify the degree to which each voxel contributed to classification. Compared with maps produced by general linear models and the searchlight approach, these sensitivity maps revealed a more diverse pattern of information relevant to the classification of cognitive state.

Hippocampal-dorsolateral prefrontal coupling as a species-conserved cognitive mechanism: a human translational imaging study

Hippocampal-prefrontal cortex (HC-PFC) interactions are implicated in working memory (WM) and altered in psychiatric conditions with cognitive impairment such as schizophrenia. While coupling between both structures is crucial for WM performance in rodents, evidence from human studies is conflicting and translation of findings is complicated by the use of differing paradigms across species. We therefore used functional magnetic resonance imaging together with a spatial WM paradigm adapted from rodent research to examine HC-PFC coupling in humans. A PFC-parietal network was functionally connected to hippocampus (HC) during task stages requiring high levels of executive control but not during a matched control condition. The magnitude of coupling in a network comprising HC, bilateral dorsolateral PFC (DLPFC), and right supramarginal gyrus explained one-fourth of the variability in an independent spatial WM task but was unrelated to visual WM performance. HC-DLPFC coupling may thus represent a systems-level mechanism specific to spatial WM that is conserved across species, suggesting its utility for modeling cognitive dysfunction in translational neuroscience.

Reward-based spatial learning in unmedicated adults with obsessive-compulsive disorder

OBJECTIVE

The authors assessed the functioning of mesolimbic and striatal areas involved in reward-based spatial learning in unmedicated adults with obsessive-compulsive disorder (OCD).

METHOD

Functional MRI blood-oxygen-level-dependent response was compared in 33 unmedicated adults with OCD and 33 healthy, age-matched comparison subjects during a reward-based learning task that required learning to use extramaze cues to navigate a virtual eight-arm radial maze to find hidden rewards. The groups were compared in their patterns of brain activation associated with reward-based spatial learning versus a control condition in which rewards were unexpected because they were allotted pseudorandomly to experimentally prevent learning.

RESULTS

Both groups learned to navigate the maze to find hidden rewards, but group differences in neural activity during navigation and reward processing were detected in mesolimbic and striatal areas. During navigation, the OCD group, unlike the healthy comparison group, exhibited activation in the left posterior hippocampus. Unlike healthy subjects, participants in the OCD group did not show activation in the left ventral putamen and amygdala when anticipating rewards or in the left hippocampus, amygdala, and ventral putamen when receiving unexpected rewards (control condition). Signal in these regions decreased relative to baseline during unexpected reward receipt among those in the OCD group, and the degree of activation was inversely associated with doubt/checking symptoms.

CONCLUSIONS

Participants in the OCD group displayed abnormal recruitment of mesolimbic and ventral striatal circuitry during reward-based spatial learning. Whereas healthy comparison subjects exhibited activation in this circuitry in response to the violation of reward expectations, unmedicated OCD participants did not and instead over-relied on the posterior hippocampus during learning. Thus, dopaminergic innervation of reward circuitry may be altered, and future study of anterior/posterior hippocampal dysfunction in OCD is warranted.

Pre-stimulus functional networks modulate task performance in time-pressured evidence gathering and decision-making

Rapid perceptual decision-making is believed to depend upon efficient allocation of neural resources to the processing of transient stimuli within task-relevant contexts. Given decision-making under severe time pressure, it is reasonable to posit that the brain configures itself, prior to processing stimulus information, in a way that depends upon prior beliefs and/or anticipation. However, relatively little is known about such configuration processes, how they might be manifested in the human brain, or ultimately how they mediate task performance. Here we show that network configuration, defined via pre-stimulus functional connectivity measures estimated from functional magnetic resonance imaging (fMRI) data, is predictive of performance in a time-pressured Go/No-Go task. Specifically, using connectivity measures to summarize network properties, we show that pre-stimulus brain state can be used to discriminate behaviorally correct and incorrect trials, as well as behaviorally correct commission and omission trial categories. More broadly, our results show that pre-stimulus functional configurations of cortical and sub-cortical networks can be a major determiner of task performance.

Frontostriatal circuits and the development of bulimia nervosa

Bulimia nervosa (BN) is characterized by both recurrent episodes of binge eating that are, in part, defined by a sense of loss of control and compensatory behaviors to avoid weight gain. Impulsive behaviors are also common in individuals with BN, indicating more pervasive difficulties in behavioral self-regulation. Findings from functional and anatomical neuroimaging studies of individuals with BN suggest dysfunction in the dorsal frontostriatal circuits that support self-regulatory capacities and habit learning and in overlapping ventral circuits that support reward processing and reward-based learning. In this review, we describe the normal development of frontostriatal circuits and then present behavioral and neuroimaging data from adolescents and adults with BN. These data suggest that the abnormal maturation of frontostriatal circuits may contribute to the habitual binge-eating and purging behaviors of BN. Future longitudinal imaging studies will improve understanding of how these circuits contribute to the developmental trajectory of BN and will inform novel interventions that could target or prevent the impulsive and habit-like features of this disorder.

Changes in corticostriatal connectivity during reinforcement learning in humans

Many computational models assume that reinforcement learning relies on changes in synaptic efficacy between cortical regions representing stimuli and striatal regions involved in response selection, but this assumption has thus far lacked empirical support in humans. We recorded hemodynamic signals with fMRI while participants navigated a virtual maze to find hidden rewards. We fitted a reinforcement-learning algorithm to participants' choice behavior and evaluated the neural activity and the changes in functional connectivity related to trial-by-trial learning variables. Activity in the posterior putamen during choice periods increased progressively during learning. Furthermore, the functional connections between the sensorimotor cortex and the posterior putamen strengthened progressively as participants learned the task. These changes in corticostriatal connectivity differentiated participants who learned the task from those who did not. These findings provide a direct link between changes in corticostriatal connectivity and learning, thereby supporting a central assumption common to several computational models of reinforcement learning.

Neural correlates of reward-based spatial learning in persons with cocaine dependence

Dysfunctional learning systems are thought to be central to the pathogenesis of and impair recovery from addictions. The functioning of the brain circuits for episodic memory or learning that support goal-directed behavior has not been studied previously in persons with cocaine dependence (CD). Thirteen abstinent CD and 13 healthy participants underwent MRI scanning while performing a task that requires the use of spatial cues to navigate a virtual-reality environment and find monetary rewards, allowing the functional assessment of the brain systems for spatial learning, a form of episodic memory. Whereas both groups performed similarly on the reward-based spatial learning task, we identified disturbances in brain regions involved in learning and reward in CD participants. In particular, CD was associated with impaired functioning of medial temporal lobe (MTL), a brain region that is crucial for spatial learning (and episodic memory) with concomitant recruitment of striatum (which normally participates in stimulus-response, or habit, learning), and prefrontal cortex. CD was also associated with enhanced sensitivity of the ventral striatum to unexpected rewards but not to expected rewards earned during spatial learning. We provide evidence that spatial learning in CD is characterized by disturbances in functioning of an MTL-based system for episodic memory and a striatum-based system for stimulus-response learning and reward. We have found additional abnormalities in distributed cortical regions. Consistent with findings from animal studies, we provide the first evidence in humans describing the disruptive effects of cocaine on the coordinated functioning of multiple neural systems for learning and memory.

Spatial recognition memory in a virtual reality task is altered in refractory temporal lobe epilepsy

Temporal lobe epilepsy is often resistant to medical management. Patients experience seizures for years until they receive surgical interventions. During that time, they can exhibit an altered cognition that can be assessed using virtual reality-based neuropsychological tasks. In this study, we coupled a recognition task with a spatial learning task to assess spatial learning and spatial recognition in patients with pharmacoresistant epilepsy. We tested spatial learning and spatial recognition in 8 subjects with epilepsy and 8 control subjects. Tests were based on virtual reality technologies. Data collected showed that groups did not differ in spatial learning, but recognition was better in the control group. They showed a shorter reaction time and fewer errors. This supports the hippocampal role in managing an allothetic environment representation and suggests that the spatial recognition task can be very sensitive to hippocampal disturbances.

Error detection and error memory in spatial navigation as reflected by electrodermal activity

The study investigated spatial navigation by means of electrodermal activity (EDA). Two groups of healthy subjects (group 1, age <38; group 2, age ≥ 38) were recorded during navigation through two 3-D virtual mazes differing in difficulty, that is, Maze Simple (MazeS) and Maze Complex (MazeC). Our results show (1) an effect of difficulty, that is, larger skin conductance responses (SCRs) and slower velocity profiles while navigating through MazeC as compared to MazeS. (2) An effect of age, that is, larger SCRs and faster velocity profiles in younger subjects (group 1) compared to older subjects (group 2). (3) An effect of maze region, that is, SCRs increased when subjects entered dead ends with group 1 (young group) decreasing in velocity, whereas group 2 (old group) increased in velocity. (4) And an error memory effect, that is, subjects who remembered an error at a given decision point (crossroads preceding dead ends in MazeC) from previous trials, and then if they did not repeat that error, elicited decreased SCRs as compared to subjects who did not remember and subsequently repeated an error. The latter aspect is the most impactful as it shows that EDA is able to reflect error detection and memory during spatial navigation. Our data designate EDA as suitable monitoring tool for identification and differentiation of the affective correlates underlying spatial navigation, which has recently attracted researchers' attention due to its increased use in 3-D virtual environments.

Segregating cognitive functions within hippocampal formation: a quantitative meta-analysis on spatial navigation and episodic memory

The most important cognitive domains where hippocampal formation is crucially involved are navigation and memory. Some evidence suggests that different hippocampal subregions mediate these domains. However, a quantitative meta-analysis on neuroimaging studies of spatial navigation versus memory is lacking. By means of activation likelihood estimation (ALE), we investigate concurrence of brain regions activated during spatial navigation encoding and retrieval as well as during episodic memory encoding and retrieval tasks in humans. During encoding in spatial navigation, activity was located in more posterior regions of the hippocampal formation, whereas episodic memory encoding was located in more anterior regions. Retrieval in spatial navigation was more strongly lateralized to the right compared to episodic memory retrieval. Within studies on spatial navigation retrieval, immediate recall was located more posterior and delayed recall more anterior. Overlap between concurrence of activation in spatial navigation and episodic memory was rather limited in comparison to uniquely involved regions. This argues in favor of two distinct networks, one for spatial navigation the other for episodic memory within the hippocampal formation.

A Virtual Radial Arm Maze for the Study of Multiple Memory Systems in a Functional Magnetic Resonance Imaging Environment

An increasing number of functional brain imaging studies are employing computer-based virtual reality (VR) to study changes in brain activity during the performance of high-level psychological and cognitive tasks. We report the development of a VR radial arm maze that adapts for human use in a scanning environment with the same general experimental design of behavioral tasks as that has been used with remarkable effectiveness for the study of multiple memory systems in rodents. The software platform is independent of specific computer hardware and operating systems, as we aim to provide shared access to this technology by the research community. We hope that doing so will provide greater standardization of software platform and study paradigm that will reduce variability and improve the comparability of findings across studies. We report the details of the design and implementation of this platform and provide information for downloading of the system for demonstration and research applications.

Spatial memory deficits in a virtual reality eight-arm radial maze in schizophrenia

Learning and memory impairments are present in schizophrenia (SZ) throughout the illness course and predict psychosocial function. Abnormalities in prefrontal and hippocampal function are thought to contribute to SZ deficits. The radial arm maze (RAM) is a test of spatial learning and memory in rodents that relies on intact prefrontal and hippocampal function. The goal of the present study was to investigate spatial learning in SZ using a virtual RAM. Thirty-three subjects with SZ and thirty-nine healthy controls (HC) performed ten trials of a virtual RAM task. Subjects attempted to learn to retrieve four rewards each located in separate arms. As expected, subjects with SZ used more time and traveled more distance to retrieve rewards, made more reference (RM) and working memory (WM) errors, and retrieved fewer rewards than HC. It is important to note that the SZ group did learn but did not reach the level of HC. Whereas RM errors decreased across trials in the SZ group, WM errors did not. There were no significant relationships between psychiatric symptom severity and maze performance. To our knowledge, use of a virtual 8-arm radial maze task in SZ to assess spatial learning is novel. Impaired virtual RAM performance in SZ is consistent with studies that examined RAM performance in animal models of SZ. Results provide further support for compromised prefrontal and hippocampal function underlying WM and RM deficits in SZ. The virtual RAM task could help bridge preclinical and clinical research for testing novel drug treatments of SZ.

A brain-based endophenotype for major depressive disorder

We have identified a brain-based endophenotype for major depressive disorder (MDD) that includes thinning of the cortex of the lateral aspect of the right hemisphere and the medial aspect of the left, as well as bilateral hypoplasia of frontal and parietal white matter. The endophenotype status of these abnormalities is supported by their presence in a multigenerational cohort of persons who themselves do not have MDD but who are at increased familial risk for developing the illness. Those who have the endophenotype but who are not ill nevertheless still suffer from inattention and poor visual memory for social stimuli in direct proportion to the magnitude of cortical thinning and white matter hypoplasia within the endophenotype. Identification of this endophenotype and its cognitive correlates provides targets for devising new preventive and therapeutic interventions for MDD.