A biased competition based neurodynamical model of visual neglect

Virtual reality gameplay classification illustrates the multidimensionality of visuospatial neglect

Brain injuries can significantly impact mental processes and lead to hidden disabilities not easily detectable. Traditional methods for assessing these impacts are imprecise, leading to unreliable prevalence estimates and treatments with uncertain effectiveness. Immersive virtual reality has shown promise for assessment, but its use as a standalone tool is rare. Our research focused on developing and validating a standalone immersive virtual reality classification system for unilateral spatial neglect, a condition common following brain injury characterized by inattention to one side of space. Our study involved 51 brain injury inpatients and 30 controls, all engaging with 'The Attention Atlas', an immersive virtual reality game for testing visual search skills. Our classification system aimed to identify patients with neglect, 'minor atypicality' (indicative of inattention not consistent enough to be labelled as neglect) or non-neglect. This categorization was based on a simple mathematical definition, utilizing gameplay to describe spatial orientation (to the left or right side) and attentional challenge (indicative of search inefficiency). These metrics were benchmarked against a normative model to detect atypical visual search, which refers to gameplay beyond the usual bounds. The combination of neglected side, orientation and challenge factors was used to categorize neglect. We discovered a strong correlation between atypical visual search patterns and neglect risk factors, such as middle cerebral artery stroke, parietal injuries and existing neglect diagnoses (Poisson regression incidence rate ratio = 7.18, 95% confidence interval = 4.41-11.90). In our study, immersive virtual reality-identified neglect in one-fourth of the patients (n = 13, 25.5%), minor atypicality in 17.6% (n = 9) and non-neglect in the majority, 56.9% (n = 29). This contrasts with standard assessments, which detected neglect in 17.6% (n = 9) of cases and had no intermediate category. Our analysis determined six categories of neglect, the most common being left hemispace neglect with above-median orientation and challenge scores. Traditional assessments were not significantly more accurate (accuracy = 84.3%, P = 0.06) than a blanket assumption of non-neglect. Traditional assessments were also relatively insensitive in detecting immersive virtual reality-identified neglect (53.8%), particularly in less severe cases and those involving right-side inattention. Our findings underline the effectiveness of immersive virtual reality in revealing various dimensions of neglect, surpassing traditional methods in sensitivity and detail and operating independently from them. To integrate immersive virtual reality into real-world clinical settings, collaboration with healthcare professionals, patients and other stakeholders is crucial to ensure practical applicability and accessibility.

Pseudoneglect in Visual Search: Behavioral Evidence and Connectional Constraints in Simulated Neural Circuitry

Most people tend to bisect horizontal lines slightly to the left of their true center (pseudoneglect) and start visual search from left-sided items. This physiological leftward spatial bias may depend on hemispheric asymmetries in the organization of attentional networks, but the precise mechanisms are unknown. Here, we modeled relevant aspects of the ventral and dorsal attentional networks (VAN and DAN) of the human brain. First, we demonstrated pseudoneglect in visual search in 101 right-handed psychology students. Participants consistently tended to start the task from a left-sided item, thus showing pseudoneglect. Second, we trained populations of simulated neurorobots to perform a similar task, by using a genetic algorithm. The neurorobots' behavior was controlled by artificial neural networks, which simulated the human VAN and DAN in the two brain hemispheres. Neurorobots differed in the connectional constraints that were applied to the anatomy and function of the attention networks. Results indicated that (1) neurorobots provided with a biologically plausible hemispheric asymmetry of the VAN-DAN connections, as well as with interhemispheric inhibition, displayed the best match with human data; however; (2) anatomical asymmetry per se was not sufficient to generate pseudoneglect; in addition, the VAN must have an excitatory influence on the ipsilateral DAN; and (3) neurorobots provided with bilateral competence in the VAN but without interhemispheric inhibition failed to display pseudoneglect. These findings provide a proof of concept of the causal link between connectional asymmetries and pseudoneglect and specify important biological constraints that result in physiological asymmetries of human behavior.

Lateral specialization in unilateral spatial neglect: a cognitive robotics model

In this paper, we present the experimental results of an embodied cognitive robotic approach for modelling the human cognitive deficit known as unilateral spatial neglect (USN). To this end, we introduce an artificial neural network architecture designed and trained to control the spatial attentional focus of the iCub robotic platform. Like the human brain, the architecture is divided into two hemispheres and it incorporates bio-inspired plasticity mechanisms, which allow the development of the phenomenon of the specialization of the right hemisphere for spatial attention. In this study, we validate the model by replicating a previous experiment with human patients affected by the USN and numerical results show that the robot mimics the behaviours previously exhibited by humans. We also simulated recovery after the damage to compare the performance of each of the two hemispheres as additional validation of the model. Finally, we highlight some possible advantages of modelling cognitive dysfunctions of the human brain by means of robotic platforms, which can supplement traditional approaches for studying spatial impairments in humans.

Neuromodelling based on evolutionary robotics: on the importance of motor control for spatial attention

Mainstream approaches to modelling cognitive processes have typically focused on (1) reproducing their neural underpinning, without regard to sensory-motor systems and (2) producing a single, ideal computational model. Evolutionary robotics is an alternative possibility to bridge the gap between neural substrate and behavior by means of a sensory-motor apparatus, and a powerful tool to build a population of individuals rather than a single model. We trained 4 populations of neurorobots, equipped with a pan/tilt/zoom camera, and provided with different types of motor control in order to perform a cancellation task, often used to tap spatial cognition. Neurorobots' eye movements were controlled by (a) position, (b) velocity, (c) simulated muscles and (d) simulated muscles with fixed level of zoom. Neurorobots provided with muscle and velocity control showed better performances than those controlled in position. This is an interesting result since muscle control can be considered a particular type of position control. Finally, neurorobots provided with muscle control and zoom outperformed those without zooming ability.

Computational modeling of neurostimulation in brain diseases

Neurostimulation as a therapeutic tool has been developed and used for a range of different diseases such as Parkinson's disease, epilepsy, and migraine. However, it is not known why the efficacy of the stimulation varies dramatically across patients or why some patients suffer from severe side effects. This is largely due to the lack of mechanistic understanding of neurostimulation. Hence, theoretical computational approaches to address this issue are in demand. This chapter provides a review of mechanistic computational modeling of brain stimulation. In particular, we will focus on brain diseases, where mechanistic models (e.g., neural population models or detailed neuronal models) have been used to bridge the gap between cellular-level processes of affected neural circuits and the symptomatic expression of disease dynamics. We show how such models have been, and can be, used to investigate the effects of neurostimulation in the diseased brain. We argue that these models are crucial for the mechanistic understanding of the effect of stimulation, allowing for a rational design of stimulation protocols. Based on mechanistic models, we argue that the development of closed-loop stimulation is essential in order to avoid inference with healthy ongoing brain activity. Furthermore, patient-specific data, such as neuroanatomic information and connectivity profiles obtainable from neuroimaging, can be readily incorporated to address the clinical issue of variability in efficacy between subjects. We conclude that mechanistic computational models can and should play a key role in the rational design of effective, fully integrated, patient-specific therapeutic brain stimulation.

Development and evaluation of a new instrument to measure visual exploration behavior

Effective visual exploration is required for many activities of daily living and instruments to assess visual exploration are important for the evaluation of the visual and the oculomotor system. In this article, the development of a new instrument to measure central and peripheral target recognition is described. The measurement setup consists of a hemispherical projection which allows presenting images over a large area of ± 90° horizontal and vertical angle. In a feasibility study with 14 younger (21-49 years) and 12 older (50-78 years) test persons, 132 targets and 24 distractors were presented within naturalistic color photographs of everyday scenes at 10°, 30°, and 50° eccentricity. After the experiment, both younger and older participants reported in a questionnaire that the task is easy to understand, fun and that it measures a competence that is relevant for activities of daily living. A main result of the pilot study was that younger participants recognized more targets with smaller reaction times than older participants. The group differences were most pronounced for peripheral target detection. This test is feasible and appropriate to assess the functional field of view in younger and older adults.

Space-, object-, and feature-based attention interact to organize visual scenes

Biased-competition accounts of attentional processing propose that attention arises from distributed interactions within and among different types of perceptual representations (e.g., spatial, featural, and object-based). Although considerable research has examined the facilitation in processing afforded by attending selectively to spatial locations, or to features, or to objects, surprisingly little research has addressed a key prediction of the biased-competition account: that attending to any stimulus should give rise to simultaneous interactions across all the types of perceptual representations encompassed by that stimulus. Here we show that, when an object in a visual display is cued, space-, feature-, and object-based forms of attention interact to enhance processing of that object and to create a scene-wide pattern of attentional facilitation. These results provide evidence to support the biased-competition framework and suggest that attention might be thought of as a mechanism by which multiple, disparate bottom-up, and even top-down, visual perceptual representations are coordinated and preferentially enhanced.

Hemispheric differences in frontal and parietal influences on human occipital cortex: direct confirmation with concurrent TMS-fMRI

We used concurrent TMS-fMRI to test directly for hemispheric differences in causal influences of the right or left fronto-parietal cortex on activity (BOLD signal) in the human occipital cortex. Clinical data and some behavioral TMS studies have been taken to suggest right-hemisphere specialization for top-down modulation of vision in humans, based on deficits such as spatial neglect or extinction in lesioned patients, or findings that TMS to right (vs. left) fronto-parietal structures can elicit stronger effects on visual performance. But prior to the recent advent of concurrent TMS and neuroimaging, it was not possible to directly examine the causal impact of one (stimulated) brain region upon others in humans. Here we stimulated the frontal or intraparietal cortex in the left or right hemisphere with TMS, inside an MR scanner, while measuring with fMRI any resulting BOLD signal changes in visual areas V1-V4 and V5/MT+. For both frontal and parietal stimulation, we found clear differences between effects of right- versus left-hemisphere TMS on activity in the visual cortex, with all differences significant in direct statistical comparisons. Frontal TMS over either hemisphere elicited similar BOLD decreases for central visual field representations in V1-V4, but only right frontal TMS led to BOLD increases for peripheral field representations in these regions. Hemispheric differences for effects of parietal TMS were even more marked: Right parietal TMS led to strong BOLD changes in V1-V4 and V5/MT+, but left parietal TMS did not. These data directly confirm that the human frontal and parietal cortex show right-hemisphere specialization for causal influences on the visual cortex.

Dissociations between motor-related EEG measures in a cued movement sequence task

Different aspects of preparation, especially processes related to knowing what to prepare versus applying that foreknowledge effectively, may be reflected in different types of brain activity, e.g., the lateralized readiness potential (LRP), beta-band event-related desynchronization and phase locking. In a previous study in which subjects had to switch between response hands, dissociations were found between types of preparatory hand-related lateralization in evoked potentials, amplitude and phase locking (Gladwin et al., 2006) knowing what task set to switch to and effectively preparing that task set affected the different measures of lateralization. Similarly to how, in task switching, stimuli and responses must be correctly related to each other, in the preparation of movement sequences relations must be specified concerning motor processes. Similar dissociations as found in the task switching data might then be found in a cued movement sequence task. This possibility was explored by precueing elements of a two-movement sequence involving the left and right index fingers, and comparing various measures of electroencephalogram activity. Cues could specify the full sequence, either the first or the second element, or neither element. Knowing the first element was sufficient to lateralize the pattern of phase locking, but effects were found in the LRP and lateralized amplitude only when the full sequence was known. It seems likely that subjects only fully prepared the first response when they had full knowledge of the sequence so that the dissociation may be closely related to that found for task switching. Thus, the present data would appear to agree with previous results that couple response-foreknowledge with phase locking and the transformation of that foreknowledge into effective changes in component processes with evoked potential shifts. The results further underscore the general importance of considering different types of brain activity: depolarization, desynchronization and phase locking all appear to be involved in different aspects of cognitive control.

A role for the 'magnocellular advantage' in visual impairments in neurodevelopmental and psychiatric disorders

Evidence exists implicating abnormal visual information processing and visually driven attention in a number of neurodevelopmental and psychiatric disorders, suggesting that research into such disorders may benefit from a better understanding of more recent advances in visual system processing. A new integrated model of visual processing based on primate single cell and human electrophysiology may provide a framework, to understand how the visual system is involved, by implicating the magnocellular pathway's role in driving attentional mechanisms in higher-order cortical regions, what we term the 'magnocellular advantage'. Evidence is also presented demonstrating visual processing occurs considerably faster than previously assumed, and emphasising the importance of top-down feedback signals into primary visual cortex, as well as considering the possibility of lateral connections from dorsal to ventral visual areas. Such organisation is argued to be important for future research highlighting visual aspects of impairment in disorders as diverse as schizophrenia and autism.

Competition between simultaneous stimuli modulated by location probability in hemispatial neglect

Many aspects of spatial neglect can be explained as arising from competition for attentional selection, with salient ipsilesional stimuli emerging as the winner more often than contralesional stimuli. The outcome of the competition, however, can be affected both by bottom-up perceptual factors such as the gestalt properties of the display and by top-down factors such as expectancy or stimulus blocking. This study examines whether the competition for attentional selection can be modulated by manipulating the probability of the target's location in hemispatial neglect. Five patients with left-sided hemispatial neglect and a group of control participants performed a visual target discrimination task. In equal probability blocks, the target appeared randomly in any of six possible horizontal locations (three left, three right) whereas in biased blocks, the target appeared in the mid-location on the left on 50% of the trials and in each of the other locations on 10% of the trials. The target appeared either alone or was accompanied by a distractor on the opposite side. The results showed that the spatial bias facilitated detection of all left-sided targets in the neglect group, but was more spatially specific in the control group. Furthermore, while distractors on either side interfered with target processing in both groups, the patterns differed across the visual field. Finally, the magnitude of facilitation due to the bias was greatest in the condition with the most inhibition, i.e. a left-sided target accompanied by a right-sided distractor in the neglect group. These data underscore the competitive push-pull relationship between different bottom-up and top-down attentional factors, particularly within neglect patients, in whom a strong ipsilesional attentional bias already exists.