The role of visual processing in motor learning and control: Insights from electroencephalography

Alterations in cortical thickness and volumes of subcortical structures in pediatric patients with complete spinal cord injury

AIMS

To study the changes in cortical thickness and subcortical gray matter structures in children with complete spinal cord injury (CSCI), reveal the possible causes of dysfunction beyond sensory motor dysfunction after CSCI, and provide a possible neural basis for corresponding functional intervention training.

METHODS

Thirty-seven pediatric CSCI patients and 34 age-, gender-matched healthy children as healthy controls (HCs) were recruited. The 3D high-resolution T1-weighted structural images of all subjects were obtained using a 3.0 Tesla MRI system. Statistical differences between pediatric CSCI patients and HCs in cortical thickness and volumes of subcortical gray matter structures were evaluated. Then, correlation analyses were performed to analyze the correlation between the imaging indicators and clinical characteristics.

RESULTS

Compared with HCs, pediatric CSCI patients showed decreased cortical thickness in the right precentral gyrus, superior temporal gyrus, and posterior segment of the lateral sulcus, while increased cortical thickness in the right lingual gyrus and inferior occipital gyrus. The volume of the right thalamus in pediatric CSCI patients was significantly smaller than that in HCs. No significant correlation was found between the imaging indicators and the injury duration, sensory scores, and motor scores of pediatric CSCI patients.

CONCLUSIONS

These findings demonstrated that the brain structural reorganizations of pediatric CSCI occurred not only in sensory motor areas but also in cognitive and visual related brain regions, which may suggest that the visual processing, cognitive abnormalities, and related early intervention therapy also deserve greater attention beyond sensory motor rehabilitation training in pediatric CSCI patients.

Brain Activity is Influenced by How High Dimensional Data are Represented: An EEG Study of Scatterplot Diagnostic (Scagnostics) Measures

Visualization and visual analytic tools amplify one's perception of data, facilitating deeper and faster insights that can improve decision making. For multidimensional data sets, one of the most common approaches of visualization methods is to map the data into lower dimensions. Scatterplot matrices (SPLOM) are often used to visualize bivariate relationships between combinations of variables in a multidimensional dataset. However, the number of scatterplots increases quadratically with respect to the number of variables. For high dimensional data, the corresponding enormous number of scatterplots makes data exploration overwhelmingly complex, thereby hindering the usefulness of SPLOM in human decision making processes. One approach to address this difficulty utilizes Graph-theoretic Scatterplot Diagnostic (Scagnostics) to automatically extract a subset of scatterplots with salient features and of manageable size with the hope that the data will be sufficient for improving human decisions. In this paper, we use Electroencephalogram (EEG) to observe brain activity while participants make decisions informed by scatterplots created using different visual measures. We focused on 4 categories of Scagnostics measures: Clumpy, Monotonic, Striated, and Stringy. Our findings demonstrate that by adjusting the level of difficulty in discriminating between data sets based on the Scagnostics measures, different parts of the brain are activated: easier visual discrimination choices involve brain activity mostly in visual sensory cortices located in the occipital lobe, while more difficult discrimination choices tend to recruit more parietal and frontal regions as they are known to be involved in resolving ambiguities. Our results imply that patterns of neural activity are predictive markers of which specific Scagnostics measures most assist human decision making based on visual stimuli such as ours.

Age Differences in Learning-Related Neurophysiological Changes

Abstract. Research in young adults has demonstrated that neurophysiological measures are able to provide insight into learning processes. However, to date, it remains unclear whether neurophysiological changes during learning in older adults are comparable to those in younger adults. The current study addressed this issue by exploring age differences in changes over time in a range of neurophysiological outcome measures collected during visuomotor sequence learning. Specifically, measures of electroencephalography (EEG), skin conductance, heart rate, heart rate variability, respiration rate, and eye-related measures, in addition to behavioral performance measures, were collected in younger ( Mage = 27.24 years) and older adults ( Mage = 58.06 years) during learning. Behavioral responses became more accurate over time in both age groups during visuomotor sequence learning. Yet, older adults needed more time in each trial to enhance the precision of their movement. Changes in EEG during learning demonstrated a stronger increase in theta power in older compared to younger adults and a decrease in gamma power in older adults while increasing slightly in younger adults. No such differences between the two age groups were found on other neurophysiological outcome measures, suggesting changes in brain activity during learning to be more sensitive to age differences than changes in peripheral physiology. Additionally, differences in which neurophysiological outcomes were associated with behavioral performance on the learning task were found between younger and older adults. This indicates that the neurophysiological underpinnings of learning may differ between younger and older adults. Therefore, the current findings highlight the importance of taking age into account when aiming to gain insight into behavioral performance through neurophysiology during learning.

Reduced motor planning underlying inhibition of prepotent responses in children with ADHD

To flexibly regulate their behavior, children's ability to inhibit prepotent responses arises from cognitive and motor mechanisms that have an intertwined developmental trajectory. Subtle differences in planning and control can contribute to impulsive behaviors, which are common in Attention Deficit and Hyperactivity Disorder (ADHD) and difficult to be assessed and trained. We adapted a Go/No-Go task and employed a portable, low-cost kinematic sensor to explore the different strategies used by children with ADHD or typical development to provide a prepotent response (dominant condition) or inhibit the prepotent and select an alternative one (non-dominant condition). Although no group difference emerged on accuracy levels, the kinematic analysis of correct responses revealed that, unlike neurotypical children, those with ADHD did not show increased motor planning in non-dominant compared to dominant trials. Future studies should investigate whether motor control could help children with ADHD compensate for planning difficulties. This strategy might make inhibition harder in naturalistic situations that involve complex actions. Combining cognitive and kinematic measures is a potential innovative method for assessment and intervention of subtle differences in executive processes such as inhibition, going deeper than is possible based on accuracy outcomes alone.

Neurophysiological correlates of interference control and response inhibition processes in children and adolescents engaging in open- and closed-skill sports

BACKGROUND

Accumulating evidence suggests that sports participation promotes the development of inhibitory control, but the influences of the sports category and inhibition type still remain unclear. The categorization of sports based on the open-skill (externally paced) and closed-skill (self-paced) continuum allows for the integration of the environment as a factor contributing to sports-related benefits for inhibitory control.

METHODS

Cross-sectional data from different studies were combined (n = 184) to examine the association between open- and closed-skill sports and cognitive control processes related to interference control and response inhibition. Participants (aged 9-14 years) filled in 7-day physical activity recall protocols and completed a Stroop Color-Word or a Go/NoGo task. The N200, N450, and P300 components of event-related potentials elicited by these tasks were recorded using electroencephalography.

RESULTS

Partial correlations supported the belief that time spent in open-skill sports was related to higher performance on inhibition trials. Additionally, path analyses revealed an association between this sports type and a greater negativity in the N200 and N450 amplitudes in both the full sample and group-level analyses. In contrast, no relation was found between sports type and P300 amplitude.

CONCLUSION

The findings suggest that only the engagement in open-skill sports is associated with more effective conflict monitoring and higher performance on tasks demanding inhibitory control.

Influence of visual feedback persistence on visuo-motor skill improvement

Towards the larger goal of understanding factors relevant for improving visuo-motor control, we investigated the role of visual feedback for modulating the effectiveness of a simple hand-eye training protocol. The regimen comprised a series of curve tracing tasks undertaken over a period of one week by neurologically healthy individuals with their non-dominant hands. Our three subject groups differed in the training they experienced: those who received ‘Persistent’ visual-feedback by seeing their hand and trace evolve in real-time superimposed upon the reference patterns, those who received ‘Non-Persistent’ visual-feedback seeing their hand movement but not the emerging trace, and a ‘Control’ group that underwent no training. Improvements in performance were evaluated along two dimensions—accuracy and steadiness, to assess visuo-motor and motor skills, respectively. We found that persistent feedback leads to a significantly greater improvement in accuracy than non-persistent feedback. Steadiness, on the other hand, benefits from training irrespective of the persistence of feedback. Our results not only demonstrate the feasibility of rapid visuo-motor learning in adulthood, but more specifically, the influence of visual veridicality and a critical role for dynamically emergent visual information.

Impact of Sensory Deficits on Upper Limb Motor Performance in Individuals with Cerebral Palsy: A Systematic Review

People living with cerebral palsy (CP) exhibit motor and sensory impairments that affect unimanual and bimanual functions. The importance of sensory functions for motor control is well known, but the association between motor and sensory functions remains unclear in people living with CP. The objective of this systematic review was to characterize the relationship between sensory deficits and upper limb motor function in individuals living with CP.

METHODS

Five databases were screened. The inclusion criteria were: (1) including people living with CP, (2) reporting measurements of upper limb motor and sensory functions. A qualitative analysis of the studies' level of evidence was done.

RESULTS

Thirty-three articles were included. Twenty-five articles evaluated tactile functions, 10 proprioceptive functions and 7 visual functions; 31 of the articles reported on unimanual functions and 17 of them reported on bimanual functions. Tactile functions showed a moderate to high association; it was not possible to reach definitive conclusions for proprioceptive and visual functions.

CONCLUSIONS

The heterogeneity of the results limits the ability to draw definitive conclusions. Further studies should aim to perform more comprehensive assessments of motor and sensory functions, to determine the relative contribution of various sensory modalities to simple and more complex motor functions.

Very preterm birth and cognitive control: The mediating roles of motor skills and physical fitness

•

Very preterm birth was associated with impaired response inhibition.

•

Impaired behavioral performance was linked with decreased P300, but not N200.

•

Motor skills fully mediated the association of preterm birth and P300.

•

Cardiorespiratory fitness did not contribute to this mediation.

•

Improving motor skills might promise the reduction of cognitive control deficits.

The neurophysiological mechanisms underlying executive function deficits in very preterm born children still remain unclear. Moreover, evidence on factors that can be modified by behavior and exert an influence on these deficits is lacking. The present case-control study examined the association between very preterm birth and neurophysiological indices of response inhibition (i.e. the N200-P300 complex) as well as the potential mediation of this association by aspects of physical fitness. 54 children born very preterm completed a submaximal cycling ergometer test and a motor skill test battery. Event-related potentials elicited by a Go/NoGo task were recorded using electroencephalography. Cases were then matched to full-term children (age: 11 ± 0.7 y). A higher error rate on NoGo trials was found in children born very preterm compared to those born full-term. Path-analyses further revealed that very preterm birth was associated with decreased NoGo P300 amplitude. Motor skills, but not aerobic fitness, fully mediated this association. In early adolescence, very preterm birth is associated with less effective recruitment of attentional resources for stimulus evaluation processes. The improvement of motor skills rather than cardiorespiratory fitness appears promising for reducing this specific impairment in cognitive control.

Neural Oscillatory Abnormalities During Gaze Processing in Schizophrenia: Evidence of Reduced Theta Phase Consistency and Inter-areal Theta-Gamma Coupling

BACKGROUND

Abnormal gaze discrimination in schizophrenia (SZ) is associated with impairment in social functioning, but the neural mechanisms remain unclear. Evidence suggests that local neural oscillations and inter-areal communication through neural synchronization are critical physiological mechanisms supporting basic and complex cognitive processes. The roles of these mechanisms in abnormal gaze processing in SZ have not been investigated. The present study examined local neural oscillations and connectivity between anterior and bilateral posterior brain areas during gaze processing.

METHODS

During electroencephalography recording, 28 participants with SZ and 34 healthy control participants completed a gaze discrimination task. Time-frequency decomposition of electroencephalography data was used to examine neural oscillatory power and intertrial phase consistency at bilateral posterior and midline anterior scalp sites. In addition, connectivity between these anterior and posterior sites, in terms of cross-frequency coupling between theta phase and gamma amplitude, was examined using the Kullback-Leibler Modulation Index.

RESULTS

Participants with SZ showed reduced total power of theta-band activity relative to healthy control participants at all sites examined. This group difference could be accounted for by reduced intertrial phase consistency of theta activity in SZ participants, which was related to reduced gaze discrimination accuracy in SZ. In addition, SZ participants exhibited reduced Kullback-Leibler indexing, both feedforward and feedback connectivity, between the posterior and anterior sites.

CONCLUSIONS

These findings suggest that abnormal theta phase consistency and dysconnection between posterior face processing and anterior areas may underlie gaze processing deficits in SZ.

Children with Cerebral Palsy Have Altered Occipital Cortical Oscillations during a Visuospatial Attention Task

Dynamically allocating neural resources to salient features or objects within our visual space is fundamental to making rapid and accurate decisions. Impairments in such visuospatial abilities have been consistently documented in the clinical literature on individuals with cerebral palsy (CP), although the underlying neural mechanisms are poorly understood. In this study, we used magnetoencephalography (MEG) and oscillatory analysis methods to examine visuospatial processing in children with CP and demographically matched typically developing (TD) children. Our results indicated robust oscillations in the theta (4-8 Hz), alpha (8-14 Hz), and gamma (64-80 Hz) frequency bands in the occipital cortex of both groups during visuospatial processing. Importantly, the group with CP exhibited weaker cortical oscillations in the theta and gamma frequency bands, as well as slower response times and worse accuracy during task performance compared to the TD children. Furthermore, we found that weaker theta and gamma oscillations were related to greater visuospatial performance deficits across both groups. We propose that the weaker occipital oscillations seen in children with CP may reflect poor bottom-up processing of incoming visual information, which subsequently affects the higher-order visual computations essential for accurate visual perception and integration for decision-making.

Neurocognitive processes mediate the relation between children's motor skills, cardiorespiratory fitness and response inhibition: Evidence from source imaging

Accumulating evidence suggests an association between outcomes of sports participation, such as motor skills and cardiorespiratory fitness, and aspects of inhibitory control in children. However, it remains unclear if motor skills and cardiorespiratory fitness are related to different source activity patterns and if neurophysiological indices of response inhibition mediate the relation of these constructs with behavioral performance. We examined the relative contributions of motor skills and cardiorespiratory fitness to response inhibition and a potential mediation by the neurocognitive processes indexed by the N200 and P300 components of event-related potentials. About 92 children aged 9-13 years completed the Movement ABC-2, the PWC170 and a Go/NoGo task. We employed electroencephalography (EEG) to record the N200 and P300 components elicited by the task, which are considered to reflect conflict monitoring and the allocation of attentional resources toward task-relevant stimuli, respectively. Path-anlayses revealed a moderate association between motor skills and behavioral performance on the Go/NoGo task. This association was fully mediated by the P300 amplitude in the NoGo condition. In contrast, cardiorespiratory fitness was not related to behavioral performance, but accounted for variance in N200. Source analyses supported an association between cardiorespiratory fitness and N200 source activity in prefrontal and primary motor cortex, whereas motor skills were related to P300 source activity in the posterior cingulate cortex. Our findings provide novel insights into the neural mechanisms underlying the relation between motor skills and response inhibition. Moreover, we found that the neural generators of the P300 and N200 varied as a function of children's cardiorespiratory fitness and motor skills.

Biologically Inspired Visual System Architecture for Object Recognition in Autonomous Systems

Computer vision is currently one of the most exciting and rapidly evolving fields of science, which affects numerous industries. Research and development breakthroughs, mainly in the field of convolutional neural networks (CNNs), opened the way to unprecedented sensitivity and precision in object detection and recognition tasks. Nevertheless, the findings in recent years on the sensitivity of neural networks to additive noise, light conditions, and to the wholeness of the training dataset, indicate that this technology still lacks the robustness needed for the autonomous robotic industry. In an attempt to bring computer vision algorithms closer to the capabilities of a human operator, the mechanisms of the human visual system was analyzed in this work. Recent studies show that the mechanisms behind the recognition process in the human brain include continuous generation of predictions based on prior knowledge of the world. These predictions enable rapid generation of contextual hypotheses that bias the outcome of the recognition process. This mechanism is especially advantageous in situations of uncertainty, when visual input is ambiguous. In addition, the human visual system continuously updates its knowledge about the world based on the gaps between its prediction and the visual feedback. CNNs are feed forward in nature and lack such top-down contextual attenuation mechanisms. As a result, although they process massive amounts of visual information during their operation, the information is not transformed into knowledge that can be used to generate contextual predictions and improve their performance. In this work, an architecture was designed that aims to integrate the concepts behind the top-down prediction and learning processes of the human visual system with the state-of-the-art bottom-up object recognition models, e.g., deep CNNs. The work focuses on two mechanisms of the human visual system: anticipation-driven perception and reinforcement-driven learning. Imitating these top-down mechanisms, together with the state-of-the-art bottom-up feed-forward algorithms, resulted in an accurate, robust, and continuously improving target recognition model.

Beyond the eye: Cortical differences in primary visual processing in children with cerebral palsy

•

Visual processing deficits are common in children with CP.

•

MEG was used to image multispectral cortical oscillations during visual processing.

•

Compared with controls, children with CP had weaker occipital oscillations.

•

Aberrant cortical oscillations likely impact early visual processing abilities.

Despite the growing clinical recognition of visual impairments among people with cerebral palsy (CP), very few studies have evaluated the neurophysiology of the visual circuitry. To this end, the primary aim of this investigation was to use magnetoencephalography and beamforming methods to image the relative change in the alpha–beta and gamma occipital cortical oscillations induced by a spatial grating stimulus (e.g., visual contrast) that was viewed by a cohort of children with CP and typically-developing (TD) children. Our results showed that the high-contrast, visual gratings stimuli induced a decrease in alpha–beta (10 – 20 Hz) activity, and an increase in both low (40 – 56 Hz) and high (60 – 72 Hz) gamma oscillations in the occipital cortices. Compared with the TD children, the strength of the frequency specific cortical oscillations were significantly weaker in the children with CP, suggesting that they had deficient processing of the contrast stimulus. Although CP is largely perceived as a musculoskeletal centric disorder, our results fuel the growing impression that there may also be prominent visual processing deficiencies. These visual processing deficits likely impact the ability to perceive visual changes in the environment.

Non-invasive Neurophysiology in Learning and Training: Mechanisms and a SWOT Analysis

Although many scholars deem non-invasive measures of neurophysiology to have promise in assessing learning, these measures are currently not widely applied, neither in educational settings nor in training. How can non-invasive neurophysiology provide insight into learning and how should research on this topic move forward to ensure valid applications? The current article addresses these questions by discussing the mechanisms underlying neurophysiological changes during learning followed by a SWOT (strengths, weaknesses, opportunities, and threats) analysis of non-invasive neurophysiology in learning and training. This type of analysis can provide a structured examination of factors relevant to the current state and future of a field. The findings of the SWOT analysis indicate that the field of neurophysiology in learning and training is developing rapidly. By leveraging the opportunities of neurophysiology in learning and training (while bearing in mind weaknesses, threats, and strengths) the field can move forward in promising directions. Suggestions for opportunities for future work are provided to ensure valid and effective application of non-invasive neurophysiology in a wide range of learning and training settings.

Biologically-Inspired Computational Neural Mechanism for Human Action/activity Recognition: A Review

Theoretical neuroscience investigation shows valuable information on the mechanism for recognizing the biological movements in the mammalian visual system. This involves many different fields of researches such as psychological, neurophysiology, neuro-psychological, computer vision, and artificial intelligence (AI). The research on these areas provided massive information and plausible computational models. Here, a review on this subject is presented. This paper describes different perspective to look at this task including action perception, computational and knowledge based modeling, psychological, and neuroscience approaches.

Non-invasive neurophysiological measures of learning: A meta-analysis

In a meta-analysis of 113 experiments we examined neurophysiological outcomes of learning, and the relationship between neurophysiological and behavioral outcomes of learning. Findings showed neurophysiology yielding large effect sizes, with the majority of studies examining electroencephalography and eye-related outcome measures. Effect sizes on neurophysiological outcomes were smaller than effect sizes on behavioral outcomes, however. Neurophysiological outcomes were, but behavioral outcomes were not, influenced by several modulating factors. These factors included the sensory system in which learning took place, number of learning days, whether feedback on performance was provided, and age of participants. Controlling for these factors resulted in the effect size differences between behavior and neurophysiology to disappear. The findings of the current meta-analysis demonstrate that neurophysiology is an appropriate measure in assessing learning, particularly when taking into account factors that could have an influence on neurophysiology. We propose a first model to aid further studies that are needed to examine the exact interplay between learning, neurophysiology, behavior, individual differences, and task-related aspects.

Visuomotor Prediction Errors Modulate EEG Activity Over Parietal Cortex

The parietal cortex is thought to be involved in visuomotor adaptation, yet it remains unclear whether it is specifically modulated by visuomotor prediction errors (i.e. PEs; mismatch between the predicted and actual visual consequences of the movement). One reason for this is that PEs tend to be associated with task errors, as well as changes in motor output and visual input, making them difficult to isolate. Here this issue is addressed using electroencephalography. A strategy (STR) condition, in which participants were instructed on how to counter a 45° visuomotor rotation, was compared to a condition in which participants had adapted to the rotation (POST). Both conditions were matched for task errors and movement kinematics, with the only difference being the presence of PEs in STR. Results revealed strong parietal modulations in current source density and low theta (2–4 Hz) power shortly after movement onset in STR vs. POST, followed by increased alpha/low beta (8–18 Hz) power during much of the post-movement period. Given recent evidence showing that feedforward and feedback information is respectively carried by theta and alpha/beta oscillations, the observed power modulations may reflect the bottom-up propagation of PEs and the top-down revision of predictions.

Neurophysiological changes in the visuomotor network after practicing a motor task

Although it is well appreciated that practicing a motor task updates the associated internal model, it is still unknown how the cortical oscillations linked with the motor action change with practice. The present study investigates the short-term changes (e.g., fast motor learning) in the α- and β-event-related desynchronizations (ERD) associated with the production of a motor action. To this end, we used magnetoencephalography to identify changes in the α- and β-ERD in healthy adults after participants practiced a novel isometric ankle plantarflexion target-matching task. After practicing, the participants matched the targets faster and had improved accuracy, faster force production, and a reduced amount of variability in the force output when trying to match the target. Parallel with the behavioral results, the strength of the β-ERD across the motor-planning and execution stages was reduced after practice in the sensorimotor and occipital cortexes. No pre/postpractice changes were found in the α-ERD during motor planning or execution. Together, these outcomes suggest that fast motor learning is associated with a decrease in β-ERD power. The decreased strength likely reflects a more refined motor plan, a reduction in neural resources needed to perform the task, and/or an enhancement of the processes that are involved in the visuomotor transformations that occur before the onset of the motor action. These results may augment the development of neurologically based practice strategies and/or lead to new practice strategies that increase motor learning. NEW & NOTEWORTHY We aimed to determine the effects of practice on the movement-related cortical oscillatory activity. Following practice, we found that the performance of the ankle plantarflexion target-matching task improved and the power of the β-oscillations decreased in the sensorimotor and occipital cortexes. These novel findings capture the β-oscillatory activity changes in the sensorimotor and occipital cortexes that are coupled with behavioral changes to demonstrate the effects of motor learning.

Novel behavioral indicator of explicit awareness reveals temporal course of frontoparietal neural network facilitation during motor learning

Deficits in sequential motor learning have been observed in many patient populations. Having an understanding of the individual neural progression associated with sequential learning in healthy individuals may provide valuable insights for effective interventions with these patients. Due to individual variability in motor skill acquisition, the temporal course of such learning will be vary, suggesting a need for a more individualized approach. Knowing when a subject becomes aware of movement patterns may provide a marker with which to identify each individual’s learning time course. To avoid interfering with the incidental nature of discovery during learning, such an indicator requires an indirect, behaviorally-based approach. In Part I, our study aimed to identify a reliable behavioral indicator predictive of the presence of incidental explicit awareness in a sequential motor learning task. Part II, utilized the predictive indicator and EEG to provide neural validation of perceptual processing changes temporally correlated with the indicator. Results of Part I provide a reliable predictive indicator for the timing of explicit awareness development. Results from Part II demonstrates strong classification reliability, as well as a significant neural correlation with behavior for subjects developing awareness (EXP), not observed with subjects without awareness (NOEXP). Additionally, a temporal correlation of peak activation between neural regions was noted over frontoparietal regions, suggesting that the incidental discovery of motor patterns may involve a facilitative network during awareness development. The proposed indicator provides a tool in which to further examine potential impacts of awareness associated with incidental, or exploratory, motor learning, while the individual nature of the indicator provides a tool for monitoring progress in rehabilitative, exploratory motor learning paradigms.