Arousal facilitates involuntary eye movements

Gazing into spatiotemporal 'known unknowns': the influence of uncertainty on pupil size and saccadic eye movements

Expectation of a future stimulus increases the preparedness to act once it actually appears and results in reduced latency of the appropriate motor response. Real world events are uncertain both spatially and/or temporally but this uncertainty could itself be expected. In the presence of both expected spatial and temporal uncertainty, which one should be prioritized by the motor system could depend on the context. Therefore, we investigated the relative weight of expected spatial and temporal uncertainty during the preparation of a saccadic eye movement. A reaction time task was used with a variable foreperiod between a warning and an imperative visual stimuli. Expected temporal and/or spatial uncertainty associated with the stimulus was cued. We found that before imperative stimulus onset, pupil dilation increased with expected temporal uncertainty but was unaltered by spatial uncertainty. After imperative stimulus onset, both types of expected uncertainty affected saccade latency. Maximum eye velocity was modulated by expected spatial uncertainty only. In conclusion, expected temporal and spatial uncertainty do not have the same impact on preparation and execution of a motor response. There could be a prioritization of the relevant information as a function of the evolving expected uncertainty context during the task.

Enhancing learning outcomes through multisensory integration: A fMRI study of audio-visual training in virtual reality

The integration of information from different sensory modalities is a fundamental process that enhances perception and performance in real and virtual environments (VR). Understanding these mechanisms, especially during learning tasks that exploit novel multisensory cue combinations provides opportunities for the development of new rehabilitative interventions. This study aimed to investigate how functional brain changes support behavioural performance improvements during an audio-visual (AV) learning task. Twenty healthy participants underwent a 30 min daily VR training for four weeks. The task was an AV adaptation of a 'scanning training' paradigm that is commonly used in hemianopia rehabilitation. Functional magnetic resonance imaging (fMRI) and performance data were collected at baseline, after two and four weeks of training, and four weeks post-training. We show that behavioural performance, operationalised as mean reaction time reduction in VR, significantly improves. In separate tests in a controlled laboratory environment, we showed that the behavioural performance gains in the VR training environment transferred to a significant mean RT reduction for the trained AV voluntary task on a computer screen. Enhancements were observed in both the visual-only and AV conditions, with the latter demonstrating a faster response time supported by the presence of audio cues. The behavioural learning effect also transfers to two additional tasks that were tested: a visual search task and an involuntary visual task. Our fMRI results reveal an increase in functional activation (BOLD signal) in multisensory brain regions involved in early-stage AV processing: the thalamus, the caudal inferior parietal lobe and cerebellum. These functional changes were only observed for the trained, multisensory, task and not for unimodal visual stimulation. Functional activation changes in the thalamus were significantly correlated to behavioural performance improvements. This study demonstrates that incorporating spatial auditory cues to voluntary visual training in VR leads to augmented brain activation changes in multisensory integration, resulting in measurable performance gains across tasks. The findings highlight the potential of VR-based multisensory training as an effective method for enhancing cognitive function and as a potentially valuable tool in rehabilitative programmes.

Fatigue and Arousal Modulations Revealed by Saccade and Pupil Dynamics

Saccadic eye movements are directed to the objects of interests and enable high-resolution visual images in the exploration of the visual world. There is a trial-to-trial variation in saccade dynamics even in a simple task, possibly attributed to arousal fluctuations. Previous studies have showed that an increase of fatigue level over time, also known as time-on-task, can be revealed by saccade peak velocity. In addition, pupil size, controlled by the autonomic nervous system, has long been used as an arousal index. However, limited research has been done with regards to the relation between pupil size and saccade behavior in the context of trial-to-trial variation. To investigate fatigue and arousal effects on saccadic and pupillary responses, we used bright and emotional stimuli to evoke pupillary responses in tasks requiring reactive and voluntary saccade generation. Decreased voluntary saccade peak velocities, reduced tonic pupil size and phasic pupillary responses were observed as time-on-task increased. Moreover, tonic pupil size affected saccade latency and dynamics, with steeper saccade main sequence slope as tonic pupil size increased. In summary, saccade dynamics and tonic pupil size were sensitive to fatigue and arousal level, together providing valuable information for the understanding of human behavior.

The eyes reflect an internal cognitive state hidden in the population activity of cortical neurons

Decades of research have shown that global brain states such as arousal can be indexed by measuring the properties of the eyes. The spiking responses of neurons throughout the brain have been associated with the pupil, small fixational saccades, and vigor in eye movements, but it has been difficult to isolate how internal states affect the eyes, and vice versa. While recording from populations of neurons in the visual and prefrontal cortex (PFC), we recently identified a latent dimension of neural activity called "slow drift," which appears to reflect a shift in a global brain state. Here, we asked if slow drift is correlated with the action of the eyes in distinct behavioral tasks. We recorded from visual cortex (V4) while monkeys performed a change detection task, and PFC, while they performed a memory-guided saccade task. In both tasks, slow drift was associated with the size of the pupil and the microsaccade rate, two external indicators of the internal state of the animal. These results show that metrics related to the action of the eyes are associated with a dominant and task-independent mode of neural activity that can be accessed in the population activity of neurons across the cortex.

Pupil-linked Arousal Signals in the Midbrain Superior Colliculus

The orienting response evoked by the appearance of a salient stimulus is modulated by arousal; however, neural underpinnings for the interplay between orienting and arousal are not well understood. The superior colliculus (SC), causally involved in multiple components of the orienting response including gaze and attention shifts, receives not only multisensory and cognitive inputs but also arousal-regulated inputs from various cortical and subcortical structures. To investigate the impact of moment-by-moment fluctuations in arousal on orienting saccade responses, we used microstimulation of the monkey SC to trigger saccade responses, and we used pupil size and velocity to index the level of arousal at stimulation onset because these measures correlate with changes in brain states and locus coeruleus activity. Saccades induced by SC microstimulation correlated with prestimulation pupil velocity, with higher pupil velocities on trials without evoked saccades than with evoked saccades. In contrast, prestimulation absolute pupil size did not correlate with saccade behavior. However, pupil velocity correlated with evoked saccade latency and metrics. Together, our results demonstrated that small fluctuations in arousal, indexed by pupil velocity, can modulate the saccade response evoked by SC microstimulation in awake behaving monkeys.

EEG Signals Index a Global Signature of Arousal Embedded in Neuronal Population Recordings

Electroencephalography (EEG) has long been used to index brain states, from early studies describing activity in the presence and absence of visual stimulation to modern work employing complex perceptual tasks. These studies have shed light on brain-wide signals but often lack explanatory power at the single neuron level. Similarly, single neuron recordings can suffer from an inability to measure brain-wide signals accessible using EEG. Here, we combined these techniques while monkeys performed a change detection task and discovered a novel link between spontaneous EEG activity and a neural signal embedded in the spiking responses of neuronal populations. This "slow drift" was associated with fluctuations in the subjects' arousal levels over time: decreases in prestimulus α power were accompanied by increases in pupil size and decreases in microsaccade rate. These results show that brain-wide EEG signals can be used to index modes of activity present in single neuron recordings, that in turn reflect global changes in brain state that influence perception and behavior.

The oculomotor signature of expected surprise

Expected surprise, defined as the anticipation of uncertainty associated with the occurrence of a future event, plays a major role in gaze shifting and spatial attention. In the present study, we analyzed its impact on oculomotor behavior. We hypothesized that the occurrence of anticipatory saccades could decrease with increasing expected surprise and that its influence on visually-guided responses could be different given the presence of sensory information and perhaps competitive attentional effects. This hypothesis was tested in humans using a saccadic reaction time task in which a cue indicated the future stimulus position. In the ‘no expected surprise’ condition, the visual target could appear only at one previously cued location. In other conditions, more likely future positions were cued with increasing expected surprise. Anticipation was more frequent and pupil size was larger in the ‘no expected surprise’ condition compared with all other conditions, probably due to increased arousal. The latency of visually-guided saccades increased linearly with the logarithm of surprise (following Hick’s law) but their maximum velocity repeated the arousal-related pattern. Therefore, expected surprise affects anticipatory and visually-guided responses differently. Moreover, these observations suggest a causal chain linking surprise, attention and saccades that could be disrupted in attentional or impulse control disorders.

Quantifying the Effect of Noise on Cognitive Processes: A Review of Psychophysiological Correlates of Workload

Noise is present in most work environments, including emissions from machines and devices, irrelevant speech from colleagues, and traffic noise. Although it is generally accepted that noise below the permissible exposure limits does not pose a considerable risk for auditory effects like hearing impairments. Yet, noise can have a direct adverse effect on cognitive performance (non-auditory effects like workload or stress). Under certain circumstances, the observable performance for a task carried out in silence compared to noisy surroundings may not differ. One possible explanation for this phenomenon needs further investigation: individuals may invest additional cognitive resources to overcome the distraction from irrelevant auditory stimulation. Recent developments in measurements of psychophysiological correlates and analysis methods of load-related parameters can shed light on this complex interaction. These objective measurements complement subjective self-report of perceived effort by quantifying unnoticed noise-related cognitive workload. In this review, literature databases were searched for peer-reviewed journal articles that deal with an at least partially irrelevant "auditory stimulation" during an ongoing "cognitive task" that is accompanied by "psychophysiological correlates" to quantify the "momentary workload." The spectrum of assessed types of "auditory stimulations" extended from speech stimuli (varying intelligibility), oddball sounds (repeating short tone sequences), and auditory stressors (white noise, task-irrelevant real-life sounds). The type of "auditory stimulation" was related (speech stimuli) or unrelated (oddball, auditory stressor) to the type of primary "cognitive task." The types of "cognitive tasks" include speech-related tasks, fundamental psychological assessment tasks, and real-world/simulated tasks. The "psychophysiological correlates" include pupillometry and eye-tracking, recordings of brain activity (hemodynamic, potentials), cardiovascular markers, skin conductance, endocrinological markers, and behavioral markers. The prevention of negative effects on health by unexpected stressful soundscapes during mental work starts with the continuous estimation of cognitive workload triggered by auditory noise. This review gives a comprehensive overview of methods that were tested for their sensitivity as markers of workload in various auditory settings during cognitive processing.

Linking Pupil Size Modulated by Global Luminance and Motor Preparation to Saccade Behavior

Saccades are rapid eye movements that are used to move the high acuity fovea in a serial manner in the exploration of the visual scene. Stimulus contrast is known to modulate saccade latency and metrics possibly via changing visual activity in the superior colliculus (SC), a midbrain structure causally involved in saccade generation. However, the quality of visual signals should also be modulated by the amount of lights projected onto the retina, which is gated by the size of the pupil. Although absolute pupil size should modulate visual signals and in turn affect saccade responses, research examining this relationship is very limited. Besides, pupil size is associated with motor preparation. However, the role of pupil dilation in saccade metrics remains unexplored. Through varying peripheral background luminance level and target visual contrast in the saccade task, we investigated the role of absolute pupil size and baseline-corrected pupil dilation in saccade latency and metrics. Higher target detection accuracy was obtained with lower background luminance level, and larger absolute pupil diameter correlated with smaller saccade amplitude and higher saccade peak velocities. More interestingly, the comparable modulation between pupil dilation and stimulus contrast was obtained, showing larger pupil dilation (or higher contrast stimuli) correlating with faster saccade latencies, larger amplitude, higher peak velocities, and smaller endpoint deviation. Together, our results demonstrated the influence of absolute pupil size induced by global luminance level and baseline-corrected pupil dilation associated with motor preparation on saccade latency and metrics, implicating the role of the SC in this behavior.

Differentiating global luminance, arousal and cognitive signals on pupil size and microsaccades

Pupil size reflects a proxy for neural activity associated with global luminance, arousal and cognitive processing. Microsaccades are also modulated by arousal and cognitive processing. Are these effects of arousal and cognitive signals on pupil size and microsaccades coordinated? If so, via what neural mechanisms? We hypothesized that if pupil size and microsaccades are coordinately modulated by these processes, pupil size immediately before microsaccade onset, as an index for ongoing cognitive and arousal processing, should correlate with microsaccade responses during tasks alternating these signals. Here, we examined the relationship between pupil size and microsaccade responses in tasks that included variations in global luminance, arousal and inhibitory control. Higher microsaccade peak velocities correlated with larger pre-microsaccade pupil response related to arousal and inhibitory control signals. In contrast, pupil responses evoked by global luminance signals did not correlate with microsaccade responses. Given the central role of the superior colliculus in microsaccade generation, these results suggest the critical involvement of the superior colliculus to coordinate pupil and microsaccade responses for arousal and inhibitory control modulations, but not for the pupil luminance modulation.

Shouting strengthens maximal voluntary force and is associated with augmented pupillary dilation

Previous research has demonstrated that human maximal voluntary force is generally limited by neural inhibition. Producing a shout during maximal exertion effort enhances the force levels of maximal voluntary contraction. However, the mechanisms underlying this enhancement effect on force production remain unclear. We investigated the influence of producing a shout on the pupil-linked neuromodulatory system state by examining pupil size. We also examined its effects on the motor system state by examining motor evoked potentials in response to transcranial magnetic stimulation applied over the contralateral primary motor cortex, and by evaluating handgrip maximal voluntary force. Analysis revealed that producing a shout significantly increased handgrip maximal voluntary force, followed by an increase in pupil size and a reduction of the cortical silent period. Our results indicate that producing a shout increased handgrip maximal voluntary force through the enhancement of motor cortical excitability, possibly via the enhancement of noradrenergic system activity. This study provides evidence that the muscular force-enhancing effect of shouting during maximal force exertion is related to both the motor system state and the pupil-linked neuromodulatory system state.

Characterizing the electrophysiological abnormalities in visually reviewed normal EEGs of drug-resistant focal epilepsy patients

Routine scalp EEG is essential in the clinical diagnosis and management of epilepsy. However, a normal scalp EEG (based on expert visual review) recorded from a patient with epilepsy can cause delays in diagnosis and clinical care delivery. Here, we investigated whether normal EEGs might contain subtle electrophysiological clues of epilepsy. Specifically, we investigated (i) whether there are indicators of abnormal brain electrophysiology in normal EEGs of epilepsy patients, and (ii) whether such abnormalities are modulated by the side of the brain generating seizures in focal epilepsy. We analysed awake scalp EEG recordings of age-matched groups of 144 healthy individuals and 48 individuals with drug-resistant focal epilepsy who had normal scalp EEGs. After preprocessing, using a bipolar montage of eight channels, we extracted the fraction of spectral power in the alpha band (8-13 Hz) relative to a wide band of 0.5-40 Hz within 10-s windows. We analysed the extracted features for (i) the extent to which people with drug-resistant focal epilepsy differed from healthy subjects, and (ii) whether differences within the drug-resistant focal epilepsy patients were related to the hemisphere generating seizures. We then used those differences to classify whether an EEG is likely to have been recorded from a person with drug-resistant focal epilepsy, and if so, the epileptogenic hemisphere. Furthermore, we tested the significance of these differences while controlling for confounders, such as acquisition system, age and medications. We found that the fraction of alpha power is generally reduced (i) in drug-resistant focal epilepsy compared to healthy controls, and (ii) in right-handed drug-resistant focal epilepsy subjects with left hemispheric seizures compared to those with right hemispheric seizures, and that the differences are most prominent in the frontal and temporal regions. The fraction of alpha power yielded area under curve values of 0.83 in distinguishing drug-resistant focal epilepsy from healthy and 0.77 in identifying the epileptic hemisphere in drug-resistant focal epilepsy patients. Furthermore, our results suggest that the differences in alpha power are greater when compared with differences attributable to acquisition system differences, age and medications. Our findings support that EEG-based measures of normal brain function, such as the normalized spectral power of alpha activity, may help identify patients with epilepsy even when an EEG does not contain any epileptiform activity, recorded seizures or other abnormalities. Although alpha abnormalities are unlikely to be disease-specific, we propose that such abnormalities may provide a higher pre-test probability for epilepsy when an individual being screened for epilepsy has a normal EEG on visual assessment.

Acetylcholine acts on songbird premotor circuitry to invigorate vocal output

Acetylcholine is well-understood to enhance cortical sensory responses and perceptual sensitivity in aroused or attentive states. Yet little is known about cholinergic influences on motor cortical regions. Here we use the quantifiable nature of birdsong to investigate how acetylcholine modulates the cortical (pallial) premotor nucleus HVC and shapes vocal output. We found that dialyzing the cholinergic agonist carbachol into HVC increased the pitch, amplitude, tempo and stereotypy of song, similar to the natural invigoration of song that occurs when males direct their songs to females. These carbachol-induced effects were associated with increased neural activity in HVC and occurred independently of basal ganglia circuitry. Moreover, we discovered that the normal invigoration of female-directed song was also accompanied by increased HVC activity and was attenuated by blocking muscarinic acetylcholine receptors. These results indicate that, analogous to its influence on sensory systems, acetylcholine can act directly on cortical premotor circuitry to adaptively shape behavior.

Differential Impact of Sleep Deprivation and Circadian Timing on Reflexive Versus Inhibitory Control of Attention

In a visually stimulating environment with competing stimuli, we continually choose where to allocate attention, and what to ignore. Wake and circadian-dependent modulation of attentional control and resolution of conflict is poorly understood. Twenty-two participants (17males; 25.6 ± 5.6 years) completed ocular motor tasks throughout 40 hours of sleep deprivation under constant routine conditions. A prosaccade task required a reflexive saccade toward a stimulus (no conflict), while an antisaccade task required inhibiting a reflexive saccade to the peripheral stimulus, and looking in the mirror opposite instead (conflict resolution). Antisaccade inhibitory errors showed circadian modulation, being highest in the morning, progressively decreasing until melatonin onset, before returning to the prior morning's peak throughout the biological night. This diurnal rhythm was blunted by sleep loss (>24 hours), with inhibitory control remaining impaired across the second biological day. For prosaccade, responses slowed down during the biological night. Taken together, we provide evidence for a circadian modulation of attentional bias: the morning being biased toward reflexive responding, and the evening toward higher inhibitory control. Our data show that sleep loss and circadian timing differentially impact attention, depending on whether a response conflict is present (antisaccade) or absent (prosaccade).