The Effect of Locomotion on Early Visual Contrast Processing in Humans

Variation and convergence in the morpho-functional properties of the mammalian neocortex

Man's natural inclination to classify and hierarchize the living world has prompted neurophysiologists to explore possible differences in brain organisation between mammals, with the aim of understanding the diversity of their behavioural repertoires. But what really distinguishes the human brain from that of a platypus, an opossum or a rodent? In this review, we compare the structural and electrical properties of neocortical neurons in the main mammalian radiations and examine their impact on the functioning of the networks they form. We discuss variations in overall brain size, number of neurons, length of their dendritic trees and density of spines, acknowledging their increase in humans as in most large-brained species. Our comparative analysis also highlights a remarkable consistency, particularly pronounced in marsupial and placental mammals, in the cell typology, intrinsic and synaptic electrical properties of pyramidal neuron subtypes, and in their organisation into functional circuits. These shared cellular and network characteristics contribute to the emergence of strikingly similar large-scale physiological and pathological brain dynamics across a wide range of species. These findings support the existence of a core set of neural principles and processes conserved throughout mammalian evolution, from which a number of species-specific adaptations appear, likely allowing distinct functional needs to be met in a variety of environmental contexts.

Activity in primate visual cortex is minimally driven by spontaneous movements

Organisms process sensory information in the context of their own moving bodies, an idea referred to as embodiment. This idea is important for developmental neuroscience, robotics and systems neuroscience. The mechanisms supporting embodiment are unknown, but a manifestation could be the observation in mice of brain-wide neuromodulation, including in the primary visual cortex, driven by task-irrelevant spontaneous body movements. We tested this hypothesis in macaque monkeys (Macaca mulatta), a primate model for human vision, by simultaneously recording visual cortex activity and facial and body movements. We also sought a direct comparison using an analogous approach to those used in mouse studies. Here we found that activity in the primate visual cortex (V1, V2 and V3/V3A) was associated with the animals' own movements, but this modulation was largely explained by the impact of the movements on the retinal image, that is, by changes in visual input. These results indicate that visual cortex in primates is minimally driven by spontaneous movements and may reflect species-specific sensorimotor strategies.

Continuous peripersonal tracking accuracy is limited by the speed and phase of locomotion

Recent evidence suggests that perceptual and cognitive functions are codetermined by rhythmic bodily states. Prior investigations have focused on the cardiac and respiratory rhythms, both of which are also known to synchronise with locomotion-arguably our most common and natural of voluntary behaviours. Compared to the cardiorespiratory rhythms, walking is easier to voluntarily control, enabling a test of how natural and voluntary rhythmic action may affect sensory function. Here we show that the speed and phase of human locomotion constrains sensorimotor performance. We used a continuous visuo-motor tracking task in a wireless, body-tracking virtual environment, and found that the accuracy and reaction time of continuous reaching movements were decreased at slower walking speeds, and rhythmically modulated according to the phases of the step-cycle. Decreased accuracy when walking at slow speeds suggests an advantage for interlimb coordination at normal walking speeds, in contrast to previous research on dual-task walking and reach-to-grasp movements. Phasic modulations of reach precision within the step-cycle also suggest that the upper limbs are affected by the ballistic demands of motor-preparation during natural locomotion. Together these results show that the natural phases of human locomotion impose constraints on sensorimotor function and demonstrate the value of examining dynamic and natural behaviour in contrast to the traditional and static methods of psychological science.

Threat gates visual aversion via theta activity in Tachykinergic neurons

Animals must adapt sensory responses to an ever-changing environment for survival. Such sensory modulation is especially critical in a threatening situation, in which animals often promote aversive responses to, among others, visual stimuli. Recently, threatened Drosophila has been shown to exhibit a defensive internal state. Whether and how threatened Drosophila promotes visual aversion, however, remains elusive. Here we report that mechanical threats to Drosophila transiently gate aversion from an otherwise neutral visual object. We further identified the neuropeptide tachykinin, and a single cluster of neurons expressing it ("Tk-GAL42 ∩ Vglut neurons"), that are responsible for gating visual aversion. Calcium imaging analysis revealed that mechanical threats are encoded in Tk-GAL42 ∩ Vglut neurons as elevated activity. Remarkably, we also discovered that a visual object is encoded in Tk-GAL42 ∩ Vglut neurons as θ oscillation, which is causally linked to visual aversion. Our data reveal how a single cluster of neurons adapt organismal sensory response to a threatening situation through a neuropeptide and a combination of rate/temporal coding schemes.

The brain in motion-cognitive effects of simultaneous motor activity

During the last 30 years, a large number of behavioral studies have investigated the effect of simultaneous exercise on cognitive functions. The heterogeneity of the results has been attributed to different parameters, such as intensity or modality of physical activity, and the investigated cognitive processes. More recent methodological improvements have enabled to record electroencephalography (EEG) during physical exercise. EEG studies combining cognitive tasks with exercise have described predominantly detrimental effects on cognitive processes and EEG parameters. However, differences in the underlying rationale and the design of EEG versus behavioral studies make direct comparisons between both types of studies difficult. In this narrative review of dual-task experiments we evaluated behavioral and EEG studies and discuss possible explanations for the heterogeneity of results and for the discrepancy between behavioral and EEG studies. Furthermore, we provide a proposal for future EEG studies on simultaneous motion to be a useful complement to behavioral studies. A crucial factor might be to find for each cognitive function the motor activity that matches this function in terms of attentional focus. This hypothesis should be investigated systematically in future studies.

Aerobic Exercise and Human Visual Cortex Neuroplasticity: A Narrative Review

There is compelling evidence from animal models that physical exercise can enhance visual cortex neuroplasticity. In this narrative review, we explored whether exercise has the same effect in humans. We found that while some studies report evidence consistent with exercise-induced enhancement of human visual cortex neuroplasticity, others report no effect or even reduced neuroplasticity following exercise. Differences in study methodology may partially explain these varying results. Because the prospect of exercise increasing human visual cortex neuroplasticity has important implications for vision rehabilitation, additional research is required to resolve this discrepancy in the literature.

Did you even see that? visual sensory processing of single stimuli under different locomotor loads

Modern living and working environments are more and more interspersed with the concurrent execution of locomotion and sensory processing, most often in the visual domain. Many job profiles involve the presentation of visual information while walking, for example in warehouse logistics work, where a worker has to manage walking to the correct aisle to pick up a package while being presented with visual information over data-glasses concerning the next order. Similar use-cases can be found in manufacturing jobs, for example in car montage assembly lines where next steps are presented via augmented reality headsets while walking at a slow pace. Considering the overall scarcity of cognitive resources available to be deployed to either the cognitive or motor processes, task performance decrements were found when increasing load in either domain. Interestingly, the walking motion also had beneficial effects on peripheral contrast detection and the inhibition of visual stream information. Taking these findings into account, we conducted a study that comprised the detection of single visual targets (Landolt Cs) within a broad range of the visual field (-40° to +40° visual angle) while either standing, walking, or walking with concurrent perturbations. We used questionnaire (NASA-TLX), behavioral (response times and accuracy), and neurophysiological data (ERPs and ERSPs) to quantify the effects of cognitive-motor interference. The study was conducted in a Gait Real-time Analysis Interactive Laboratory (GRAIL), using a 180° projection screen and a swayable and tiltable dual-belt treadmill. Questionnaire and behavioral measures showed common patterns. We found increasing subjective physical workload and behavioral decrements with increasing stimulus eccentricity and motor complexity. Electrophysiological results also indicated decrements in stimulus processing with higher stimulus eccentricity and movement complexity (P3, Theta), but highlighted a beneficial role when walking without perturbations and processing more peripheral stimuli regarding earlier sensory components (N1pc/N2pc, N2). These findings suggest that walking without impediments can enhance the visual processing of peripheral information and therefore help with perceiving non-foveal sensory content. Also, our results could help with re-evaluating previous findings in the context of cognitive-motor interference, as increased motor complexity might not always impede cognitive processing and performance.

Steady-state measures of visual suppression

In the early visual system, suppression occurs between neurons representing different stimulus properties. This includes features such as orientation (cross-orientation suppression), eye-of-origin (interocular suppression) and spatial location (surround suppression), which are thought to involve distinct anatomical pathways. We asked if these separate routes to suppression can be differentiated by their pattern of gain control on the contrast response function measured in human participants using steady-state electroencephalography. Changes in contrast gain shift the contrast response function laterally, whereas changes in response gain scale the function vertically. We used a Bayesian hierarchical model to summarise the evidence for each type of gain control. A computational meta-analysis of 16 previous studies found the most evidence for contrast gain effects with overlaid masks, but no clear evidence favouring either response gain or contrast gain for other mask types. We then conducted two new experiments, comparing suppression from four mask types (monocular and dichoptic overlay masks, and aligned and orthogonal surround masks) on responses to sine wave grating patches flickering at 5Hz. At the occipital pole, there was strong evidence for contrast gain effects in all four mask types at the first harmonic frequency (5Hz). Suppression generally became stronger at more lateral electrode sites, but there was little evidence of response gain effects. At the second harmonic frequency (10Hz) suppression was stronger overall, and involved both contrast and response gain effects. Although suppression from different mask types involves distinct anatomical pathways, gain control processes appear to serve a common purpose, which we suggest might be to suppress less reliable inputs.

Overground Walking Decreases Alpha Activity and Entrains Eye Movements in Humans

Experiments in animal models have shown that running increases neuronal activity in early visual areas in light as well as in darkness. This suggests that visual processing is influenced by locomotion independent of visual input. Combining mobile electroencephalography, motion- and eye-tracking, we investigated the influence of overground free walking on cortical alpha activity (~10 Hz) and eye movements in healthy humans. Alpha activity has been considered a valuable marker of inhibition of sensory processing and shown to negatively correlate with neuronal firing rates. We found that walking led to a decrease in alpha activity over occipital cortex compared to standing. This decrease was present during walking in darkness as well as during light. Importantly, eye movements could not explain the change in alpha activity. Nevertheless, we found that walking and eye related movements were linked. While the blink rate increased with increasing walking speed independent of light or darkness, saccade rate was only significantly linked to walking speed in the light. Pupil size, on the other hand, was larger during darkness than during light, but only showed a modulation by walking in darkness. Analyzing the effect of walking with respect to the stride cycle, we further found that blinks and saccades preferentially occurred during the double support phase of walking. Alpha power, as shown previously, was lower during the swing phase than during the double support phase. We however could exclude the possibility that the alpha modulation was introduced by a walking movement induced change in electrode impedance. Overall, our work indicates that the human visual system is influenced by the current locomotion state of the body. This influence affects eye movement pattern as well as neuronal activity in sensory areas and might form part of an implicit strategy to optimally extract sensory information during locomotion.

Task-related activity in human visual cortex

The brain exhibits widespread endogenous responses in the absence of visual stimuli, even at the earliest stages of visual cortical processing. Such responses have been studied in monkeys using optical imaging with a limited field of view over visual cortex. Here, we used functional MRI (fMRI) in human participants to study the link between arousal and endogenous responses in visual cortex. The response that we observed was tightly entrained to task timing, was spatially extensive, and was independent of visual stimulation. We found that this response follows dynamics similar to that of pupil size and heart rate, suggesting that task-related activity is related to arousal. Finally, we found that higher reward increased response amplitude while decreasing its trial-to-trial variability (i.e., the noise). Computational simulations suggest that increased temporal precision underlies both of these observations. Our findings are consistent with optical imaging studies in monkeys and support the notion that arousal increases precision of neural activity.

The brain exhibits widespread endogenous responses in the absence of visual stimuli, even at the earliest stages of visual cortical processing. This fMRI study characterizes a widespread hemodynamic response in early visual cortex that is not related to visual input but instead reflects a participant’s engagement in a task, is modulated by expected monetary reward, and may reflect neural quenching.

Movement-Related Signals in Sensory Areas: Roles in Natural Behavior

Recent studies have demonstrated prominent and widespread movement-related signals in the brain of head-fixed mice, even in primary sensory areas. However, it is still unknown what role these signals play in sensory processing. Why are these sensory areas 'contaminated' by movement signals? During natural behavior, animals actively acquire sensory information as they move through the environment and use this information to guide ongoing actions. In this context, movement-related signals could allow sensory systems to predict self-induced sensory changes and extract additional information about the environment. In this review we summarize recent findings on the presence of movement-related signals in sensory areas and discuss how their study, in the context of natural freely moving behaviors, could advance models of sensory processing.

Does physical exercise and congruent visual stimulation enhance perceptual learning?

PURPOSE

There is currently great interest in methods that can modulate brain plasticity, both in terms of understanding the basic mechanisms, and in the remedial application to situations of sensory loss. Recent work has focussed on how different manipulations might be combined to produce new settings that reveal synergistic actions. Here we ask whether a prominent example of adult visual plasticity, called perceptual learning, is modified by other environmental factors, such as visual stimulation and physical exercise.

METHODS

We quantified the magnitude, rate and transfer of perceptual learning using a peripheral Vernier alignment task, in two groups of subjects matched for a range of baseline factors (e.g. age, starting Vernier threshold, baseline fitness). We trained subjects for 5 days on a Vernier alignment task. In one group, we introduced an exercise protocol with congruent visual stimulation. The control group received the same visual stimulation, but did not exercise prior to measurement of Vernier thresholds.

RESULTS

Although the task generated large amounts of learning (~40%) and some transfer to untrained conditions in both groups, there were no specific benefits associated with either the addition of an exercise schedule or congruent visual stimulation.

CONCLUSION

In adults, short periods of physical exercise and visual stimulation do not enhance perceptual learning.

Intrinsic activity temporal structure reactivity to behavioural state change is correlated with depressive symptoms

The brain's intrinsic activity plays a fundamental role in its function. In normal conditions this activity is responsive to behavioural context, changing as an individual switches between directed tasks and task-free conditions. A key feature of such changes is the movement of the brain between corresponding critical and sub-critical states, with these dynamics supporting efficient cognitive processing. Breakdowns in processing efficiency can occur, however, in brain disorders such as depression. It was therefore hypothesised that depressive symptoms would be related to reduced intrinsic activity responsiveness to changes in behavioural state. This was tested in a mixed group of major depressive disorder patients (n = 26) and healthy participants (n = 37) by measuring intrinsic EEG activity temporal structure, quantified with detrended fluctuation analysis (DFA), in eyes-closed (EC) and eyes-open task-free states and contrasting between the conditions. The degree to which DFA values changed between the states was found to correlate negatively with depressive symptoms. DFA values did not differ between states in those with higher symptom levels, meaning that the brain remained in a less flexible sub-critical condition. This sub-critical condition in the EC state was further found to correlate with levels of maladaptive rumination. This may reflect a general cognitive inflexibility resulting from a lack in neural activity reactivity that may predispose people to overly engage in self-directed attention. These results provide an initial link between intrinsic activity reactivity and psychological features found in psychiatric disorders.

Two stream hypothesis of visual processing for navigation in mouse

Vision research has traditionally been studied in stationary subjects observing stimuli, and rarely during navigation. Recent research using virtual reality environments for mice has revealed that responses even in the primary visual cortex are modulated by spatial context - identical scenes presented in different positions of a room can elicit different responses. Here, we review these results and discuss how information from visual areas can reach navigational areas of the brain. Based on the observation that mouse higher visual areas cover different parts of the visual field, we propose that spatial signals are processed along two-streams based on visual field coverage. Specifically, this hypothesis suggests that landmark related signals are processed by areas biased to the central field, and self-motion related signals are processed by areas biased to the peripheral field.

Mechanisms underlying gain modulation in the cortex

Cortical gain regulation allows neurons to respond adaptively to changing inputs. Neural gain is modulated by internal and external influences, including attentional and arousal states, motor activity and neuromodulatory input. These influences converge to a common set of mechanisms for gain modulation, including GABAergic inhibition, synaptically driven fluctuations in membrane potential, changes in cellular conductance and changes in other biophysical neural properties. Recent work has identified GABAergic interneurons as targets of neuromodulatory input and mediators of state-dependent gain modulation. Here, we review the engagement and effects of gain modulation in the cortex. We highlight key recent findings that link phenomenological observations of gain modulation to underlying cellular and circuit-level mechanisms. Finally, we place these cellular and circuit interactions in the larger context of their impact on perception and cognition.

Walking enhances peripheral visual processing in humans

Cognitive processes are almost exclusively investigated under highly controlled settings during which voluntary body movements are suppressed. However, recent animal work suggests differences in sensory processing between movement states by showing drastically changed neural responses in early visual areas between locomotion and stillness. Does locomotion also modulate visual cortical activity in humans, and what are the perceptual consequences? Our study shows that walking increased the contrast-dependent influence of peripheral visual input on central visual input. This increase is prevalent in stimulus-locked electroencephalogram (EEG) responses (steady-state visual evoked potential [SSVEP]) alongside perceptual performance. Ongoing alpha oscillations (approximately 10 Hz) further positively correlated with the walking-induced changes of SSVEP amplitude, indicating the involvement of an altered inhibitory process during walking. The results predicted that walking leads to an increased processing of peripheral visual input. A second study indeed showed an increased contrast sensitivity for peripheral compared to central stimuli when subjects were walking. Our work shows complementary neurophysiological and behavioural evidence corroborating animal findings that walking leads to a change in early visual neuronal activity in humans. That neuronal modulation due to walking is indeed linked to specific perceptual changes extends the existing animal work.

Harnessing behavioral diversity to understand neural computations for cognition

With the increasing acquisition of large-scale neural recordings comes the challenge of inferring the computations they perform and understanding how these give rise to behavior. Here, we review emerging conceptual and technological advances that begin to address this challenge, garnering insights from both biological and artificial neural networks. We argue that neural data should be recorded during rich behavioral tasks, to model cognitive processes and estimate latent behavioral variables. Careful quantification of animal movements can also provide a more complete picture of how movements shape neural dynamics and reflect changes in brain state, such as arousal or stress. Artificial neural networks (ANNs) could serve as artificial model organisms to connect neural dynamics and rich behavioral data. ANNs have already begun to reveal how a wide range of different behaviors can be implemented, generating hypotheses about how observed neural activity might drive behavior and explaining diversity in behavioral strategies.

Bottom-up and top-down modulation of multisensory integration

Sensory perception in the real world requires proper integration of different modality inputs. Process of multisensory integration is not uniform. It varies from individual to individual and changes at different behavioral states of the animal. What factors affect multisensory integration? How does the mammalian brain reconstruct a multisensory world at different states? Here, we summarize recent findings on bottom-up and top-down factors that can modulate sensory processing and multisensory integration. We discuss cortical circuits that are responsible for modulation of multisensory processing based on recent rodent studies. We suggest that multisensory information is not a simple, fixed signal in the brain. Multisensory processing is dynamically modulated in the mammalian brain and leads to a unique and subjective experience of perception.