Coupling of pupil- and neuronal population dynamics reveals diverse influences of arousal on cortical processing

Aperiodic Pupil Fluctuations at Rest Predict Orienting of Visual Attention

The aperiodic exponent of the power spectrum of signals in several neuroimaging modalities has been found to be related to the excitation/inhibition balance of the neural system. Leveraging the rich temporal dynamics of resting-state pupil fluctuations, the present study investigated the association between the aperiodic exponent of pupil fluctuations and the neural excitation/inhibition balance in attentional processing. In separate phases, we recorded participants' pupil size during resting state and assessed their attentional orienting using the Posner cueing tasks with different cue validities (i.e., 100% and 50%). We found significant correlations between the aperiodic exponent of resting pupil fluctuations and both the microsaccadic and behavioral cueing effects. Critically, this relationship was particularly evident in the 50% cue-validity condition rather than in the 100% cue-validity condition. The microsaccadic responses mediated the association between the aperiodic exponent and the behavioral response. Further analysis showed that the aperiodic exponent of pupil fluctuations predicted the self-rated hyperactivity/impulsivity trait across individuals, suggesting its potential as a marker of attentional deficits. These findings highlight the rich information contained in pupil fluctuations and provide a new approach to assessing the neural excitation/inhibition balance in attentional processing.

Foraging and inertia: understanding the developmental dynamics of overt visual attention

During early life, we develop the ability to choose what we focus on and what we ignore, allowing us to regulate perception and action in complex environments. But how does this change influence how we spontaneously allocate attention to real-world objects during free behaviour? Here, in this narrative review, we examine this question by considering the time dynamics of spontaneous overt visual attention, and how these develop through early life. Even in early childhood, visual attention shifts occur both periodically and aperiodically. These reorientations become more internally controlled as development progresses. Increasingly with age, attention states also develop self-sustaining attractor dynamics, known as attention inertia, in which the longer an attention episode lasts, the more the likelihood increases of its continuing. These self-sustaining dynamics are driven by amplificatory interactions between engagement, comprehension, and distractibility. We consider why experimental measures show decline in sustained attention over time, while real-world visual attention often demonstrates the opposite pattern. Finally, we discuss multi-stable attention states, where both hypo-arousal (mind-wandering) and hyper-arousal (fragmentary attention) may also show self-sustaining attractor dynamics driven by moment-by-moment amplificatory child-environment interactions; and we consider possible applications of this work, and future directions.

Cross-species real-time detection of trends in pupil size fluctuation

Pupillometry is a popular method because pupil size is easily measured and sensitive to central neural activity linked to behavior, cognition, emotion, and perception. Currently, there is no method for online monitoring phases of pupil size fluctuation. We introduce rtPupilPhase-an open-source software that automatically detects trends in pupil size in real time. This tool enables novel applications of real-time pupillometry for achieving numerous research and translational goals. We validated the performance of rtPupilPhase on human, rodent, and monkey pupil data, and we propose future implementations of real-time pupillometry.

Extended wakefulness alters the relationship between EEG oscillations and performance in a sustained attention task

During drowsiness, maintaining consistent attention becomes difficult, leading to behavioural lapses. Bursts of oscillations in the electroencephalogram (EEG) might predict such lapses, given that alpha bursts increase during inattention and theta bursts increase with time spent awake. Paradoxically, however, alpha bursts decrease with time awake and theta bursts increase during focussed attention and cognitive tasks. Therefore, we investigated to what extent theta and alpha bursts predicted performance in a sustained attention task, either when well rested (baseline, BL) or following 20 h of extended wakefulness (EW). High-density EEG was measured in 18 young adults, and the timing of bursts was related to trial outcomes (fast, slow, and lapse trials). To increase the likelihood of lapses, the task was performed under soporific conditions. Against expectations, alpha bursts were more likely before fast trials and less likely before lapses at baseline, although the effect was substantially reduced during extended wakefulness. Theta bursts showed no significant relationship to behavioural outcome either at baseline or extended wakefulness. However, following exploratory analyses, we found that large-amplitude theta and alpha bursts were more likely to be followed by lapse trials during extended wakefulness but not baseline. In summary, alpha bursts during baseline anticipated better trial outcomes, whereas large-amplitude theta and alpha bursts during extended wakefulness anticipated worse outcomes. Therefore, neither theta nor alpha bursts maintain a consistent relationship with behaviour under different levels of overall vigilance.

A Dynamic Link between Respiration and Arousal

Viewing brain function through the lens of other physiological processes has critically added to our understanding of human cognition. Further advances though may need a closer look at the interactions between these physiological processes themselves. Here we characterize the interplay of the highly periodic, and metabolically vital respiratory process and fluctuations in arousal neuromodulation, a process classically seen as nonperiodic. In the data from three experiments (N = 56 / 27 / 25 women and men), we tested for covariations in respiratory and pupil size (arousal) dynamics. After substantiating a robust coupling in the largest dataset, we further show that coupling strength decreases during task performance compared with rest and that it mirrors a decreased respiratory rate when participants take deeper breaths. Taken together, these findings suggest a stronger link between respiratory and arousal processes than previously thought. Moreover, these links imply a stronger coupling during periods of rest, and the effect of respiratory rate on the coupling suggests a driving role. As a consequence, studying the role of neuromodulatory arousal on cortical function may also need to consider respiratory influences.

Blink-induced changes in pupil dynamics are consistent and heritable

Pupil size and blink rates are heritable but the extent to which they interact with one another has not been properly investigated. Though changes in pupil size due to eye blinks have been reported, they are considered a pupillary artifact. In this study we used the HCP 7T fMRI dataset with resting state eye-tracking data obtained in monozygotic and dizygotic twins to assess their heritability and their interactions. For this purpose, we characterized the pupil dilation (positive peak) and constriction (negative peak) that followed blink events, which we describe as blink-induced pupillary response (BIPR). We show that the BIPR is highly consistent with a positive dilatory peak (D-peak) around 500ms and a negative constricting peak (C-peak) around 1s. These patterns were reproducible within- and between-subjects across two time points and differed by vigilance state (vigilant versus drowsy). By comparing BIPR between monozygotic and dizygotic twins we show that BIPR have a heritable component with significant additive genetic (A) and environmental (E) factors dominating the structural equation models, particularly in the time-domain for both D- and C-peaks (a2 between 42 and 49%) and shared effects (C) as observed in the amplitude domain for the C-peak. Blink duration, pupil size and blink rate were also found to be highly heritable (a2 up to 62% for pupil size). Our study provides evidence of that shared environmental and additive genetic factors influence BIPR and indicates that BIPR should not be treated as a coincidental artefact. Instead BIPR appears to be a component of a larger oculomotor system that we label here as Oculomotor Adaptive System, that is genetically determined.

Differential effects of haloperidol on neural oscillations during wakefulness and sleep

The electrical activity of the brain, characterized by its frequency components, reflects a complex interplay between periodic (oscillatory) and aperiodic components. These components are associated with various neurophysiological processes, such as the excitation-inhibition balance (aperiodic activity) or interregional communication (oscillatory activity). However, we do not fully understand whether these components are truly independent or if different neuromodulators affect them in different ways. The dopaminergic system has a critical role for cognition and motivation, being a potential modulator of these power spectrum components. To improve our understanding of these questions, we investigated the differential effects of this system on these components using electrocorticogram recordings in cats, which show clear oscillations and aperiodic 1/f activity. Specifically, we focused on the effects of haloperidol (a D2 receptor antagonist) on oscillatory and aperiodic dynamics during wakefulness and sleep. By parameterizing the power spectrum into these two components, our findings reveal a robust modulation of oscillatory activity by the D2 receptor across the brain. Surprisingly, aperiodic activity was not significantly affected and exhibited inconsistent changes across the brain. This suggests a nuanced interplay between neuromodulation and the distinct components of brain oscillations, providing insights into the selective regulation of oscillatory dynamics in awake states.

Multiple Intrinsic Timescales Govern Distinct Brain States in Human Sleep

Human sleep exhibits multiple, recurrent temporal regularities, ranging from circadian rhythms to sleep stage cycles and neuronal oscillations during nonrapid eye movement sleep. Moreover, recent evidence revealed a functional role of aperiodic activity, which reliably discriminates different sleep stages. Aperiodic activity is commonly defined as the spectral slope χ of the 1/frequency (1/fχ) decay function of the electrophysiological power spectrum. However, several lines of inquiry now indicate that the aperiodic component of the power spectrum might be better characterized by a superposition of several decay processes with associated timescales. Here, we determined multiple timescales, which jointly shape aperiodic activity using human intracranial electroencephalography. Across three independent studies (47 participants, 23 female), our results reveal that aperiodic activity reliably dissociated sleep stage-dependent dynamics in a regionally specific manner. A principled approach to parametrize aperiodic activity delineated several, spatially and state-specific timescales. Lastly, we employed pharmacological modulation by means of propofol anesthesia to disentangle state-invariant timescales that may reflect physical properties of the underlying neural population from state-specific timescales that likely constitute functional interactions. Collectively, these results establish the presence of multiple intrinsic timescales that define the electrophysiological power spectrum during distinct brain states.

Pupil-Linked Arousal Modulates Precision of Stimulus Representation in Cortex

Neural responses are naturally variable from one moment to the next, even when the stimulus is held constant. What factors might underlie this variability in neural population activity? We hypothesized that spontaneous fluctuations in cortical stimulus representations are created by changes in arousal state. We tested the hypothesis using a combination of fMRI, probabilistic decoding methods, and pupillometry. Human participants (20 female, 12 male) were presented with gratings of random orientation. Shortly after viewing the grating, participants reported its orientation and gave their level of confidence in this judgment. Using a probabilistic fMRI decoding technique, we quantified the precision of the stimulus representation in the visual cortex on a trial-by-trial basis. Pupil size was recorded and analyzed to index the observer's arousal state. We found that the precision of the cortical stimulus representation, reported confidence, and variability in the behavioral orientation judgments varied from trial to trial. Interestingly, these trial-by-trial changes in cortical and behavioral precision and confidence were linked to pupil size and its temporal rate of change. Specifically, when the cortical stimulus representation was more precise, the pupil dilated more strongly prior to stimulus onset and remained larger during stimulus presentation. Similarly, stronger pupil dilation during stimulus presentation was associated with higher levels of subjective confidence, a secondary measure of sensory precision, as well as improved behavioral performance. Taken together, our findings support the hypothesis that spontaneous fluctuations in arousal state modulate the fidelity of the stimulus representation in the human visual cortex, with clear consequences for behavior.

High-resolution awake mouse fMRI at 14 Tesla

High-resolution awake mouse fMRI remains challenging despite extensive efforts to address motion-induced artifacts and stress. This study introduces an implantable radiofrequency (RF) surface coil design that minimizes image distortion caused by the air/tissue interface of mouse brains while simultaneously serving as a headpost for fixation during scanning. Furthermore, this study provides a thorough acclimation method used to accustom animals to the MRI environment minimizing motion induced artifacts. Using a 14T scanner, high-resolution fMRI enabled brain-wide functional mapping of visual and vibrissa stimulation at 100×100×200μm resolution with a 2s per frame sampling rate. Besides activated ascending visual and vibrissa pathways, robust BOLD responses were detected in the anterior cingulate cortex upon visual stimulation and spread through the ventral retrosplenial area (VRA) with vibrissa air-puff stimulation, demonstrating higher-order sensory processing in association cortices of awake mice. In particular, the rapid hemodynamic responses in VRA upon vibrissa stimulation showed a strong correlation with the hippocampus, thalamus, and prefrontal cortical areas. Cross-correlation analysis with designated VRA responses revealed early positive BOLD signals at the contralateral barrel cortex (BC) occurring 2 seconds prior to the air-puff in awake mice with repetitive stimulation, which was not detected using a randomized stimulation paradigm. This early BC activation indicated a learned anticipation through the vibrissa system and association cortices in awake mice under continuous training of repetitive air-puff stimulation. This work establishes a high-resolution awake mouse fMRI platform, enabling brain-wide functional mapping of sensory signal processing in higher association cortical areas.

Neurophysiological patterns reflecting vulnerability to delirium subtypes: a resting-state EEG and event-related potential study

Delirium is a common and acute neurocognitive disorder in older adults associated with increased risk of dementia and death. Understanding the interaction between brain vulnerability and acute stressors is key to delirium pathophysiology, but the neurophysiology of delirium vulnerability is not well defined. This study aimed to identify pre-operative resting-state EEG and event-related potential markers of incident delirium and its subtypes in older adults undergoing elective cardiac procedures. This prospective observational study included 58 older participants (mean age = 75.6 years, SD = 7.1; 46 male/12 female); COVID-19 restrictions limited recruitment. Baseline assessments were conducted in the weeks before elective cardiac procedures and included a 4-min resting-state EEG recording (2-min eyes open and 2-min eyes closed), a 5-min frequency auditory oddball paradigm recording, and cognitive and depression examinations. Periodic peak power, peak frequency and bandwidth measures, and aperiodic offsets and exponents were derived from resting-state EEG data. Event-related potentials were measured as mean component amplitudes (first positive component, first negative component, early third positive component, and mismatch negativity) following standard and deviant auditory stimuli. Incident delirium occurred in 21 participants: 10 hypoactive, 6 mixed, and 5 hyperactive. Incident hyperactive delirium was associated with higher pre-operative eyes open (P = 0.045, d = 1.0) and closed (P = 0.036, d = 1.0) aperiodic offsets. Incident mixed delirium was associated with significantly larger pre-operative first positive component amplitudes to deviants (P = 0.037, d = 1.0) and larger third positive component amplitudes to standards (P = 0.025, d = 1.0) and deviants (P = 0.041, d = 0.9). Other statistically non-significant but moderate-to-large effects were observed in relation to all subtypes. We report evidence of neurophysiological markers of delirium risk weeks prior to elective cardiac procedures in older adults. Despite being underpowered due to COVID-19-related recruitment impacts, these findings indicate pre-operative dysfunction in neural excitation/inhibition balance associated with different delirium subtypes and warrant further investigation on a larger scale.

Cross-species real time detection of trends in pupil size fluctuation

Pupillometry is a popular method because pupil size is easily measured, sensitive to central neural activity, and associated with behavior, cognition, emotion, and perception. Currently, there is no method for online monitoring phases of pupil size fluctuation. We introduce rtPupilPhase - an open source software that automatically detects trends in pupil size in real time, enabling novel implementations of real time pupillometry towards achieving numerous research and translational goals. We validated the performance of rtPupilPhase on human, rodent, and monkey pupil data and propose future applications of real time pupillometry.

State-Dependent tACS Effects Reveal the Potential Causal Role of Prestimulus Alpha Traveling Waves in Visual Contrast Detection

The intricate relationship between prestimulus alpha oscillations and visual contrast detection variability has been the focus of numerous studies. However, the causal impact of prestimulus alpha traveling waves on visual contrast detection remains largely unexplored. In our research, we sought to discern the causal link between prestimulus alpha traveling waves and visual contrast detection across different levels of mental fatigue. Using electroencephalography alongside a visual detection task with 30 healthy adults (13 females; 17 males), we identified a robust negative correlation between prestimulus alpha forward traveling waves (FTWs) and visual contrast threshold (VCT). Inspired by this correlation, we utilized 45/-45° phase-shifted transcranial alternating current stimulation (tACS) in a sham-controlled, double-blind, within-subject experiment with 33 healthy adults (23 females; 10 males) to directly modulate these alpha traveling waves. After the application of 45° phase-shifted tACS, we observed a substantial decrease in FTW and an increase in backward traveling waves, along with a concurrent increase in VCT, compared with the sham condition. These changes were particularly pronounced under a low fatigue state. The findings of state-dependent tACS effects reveal the potential causal role of prestimulus alpha traveling waves in visual contrast detection. Moreover, our study highlights the potential of 45/-45° phase-shifted tACS in cognitive modulation and therapeutic applications.

Modulation of pain perception through transcranial alternating current stimulation and its nonlinear relationship with the simulated electric field magnitude

BACKGROUND

Oscillatory activities observed in multiple regions are closely associated with the experience of pain. Specifically, oscillatory activities within the theta- and beta-frequency bands, observed in the left dorsolateral prefrontal cortex (DLPFC), have been implicated in pain perception among healthy individuals and those with chronic pain. However, their physiological significance remains unclear.

METHODS

We explored the modulation of pain perception in healthy individuals by theta- and beta-band transcranial alternating current stimulation (tACS) over the left DLPFC and examined the relationship between the modulation effect and magnitude of the electric field elicited by tACS in the left DLPFC using computational simulation.

RESULTS

Our findings revealed that both theta- and beta-tACS increased the heat pain threshold during and after stimulation. Notably, the simulated electric field magnitude in the left DLPFC exhibited an inverted U-shaped relationship with the pain modulation effect for theta-tACS.

CONCLUSIONS

Our study findings suggested that there would be an optimal electric field strength to produce a high analgesic effect for theta-tACS.

SIGNIFICANCE

The application of theta- and beta-tACS interventions targeting the left DLPFC might facilitate the treatment of chronic pain. Furthermore, the attainment of effective pain modulation via theta-tACS over the DLPFC warrants the use of optimal stimulus intensity.

Double Dissociation of Spontaneous Alpha-Band Activity and Pupil-Linked Arousal on Additive and Multiplicative Perceptual Gain

Perception is a probabilistic process dependent on external stimulus properties and one's internal state. However, which internal states influence perception and via what mechanisms remain debated. We studied how spontaneous alpha-band activity (8-13 Hz) and pupil fluctuations impact visual detection and confidence across stimulus contrast levels (i.e., the contrast response function, CRF). In human subjects of both sexes, we found that low prestimulus alpha power induced an "additive" shift in the CRF, whereby stimuli were reported present more frequently at all contrast levels, including contrast of zero (i.e., false alarms). Conversely, prestimulus pupil size had a "multiplicative" effect on detection such that stimuli occurring during large pupil states (putatively corresponding to higher arousal) were perceived more frequently as contrast increased. Signal detection modeling reveals that alpha power changes detection criteria equally across the CRF but not detection sensitivity (d'), whereas pupil-linked arousal modulated sensitivity, particularly for higher contrasts. Interestingly, pupil size and alpha power were positively correlated, meaning that some of the effect of alpha on detection may be mediated by pupil fluctuations. However, pupil-independent alpha still induced an additive shift in the CRF corresponding to a criterion effect. Our data imply that low alpha boosts detection and confidence by an additive factor, rather than by a multiplicative scaling of contrast responses, a profile which captures the effect of pupil-linked arousal. We suggest that alpha power and arousal fluctuations have dissociable effects on behavior. Alpha reflects the baseline level of visual excitability, which can vary independent of arousal.

Simultaneous interneuron labeling reveals population-level interactions among parvalbumin, somatostatin, and pyramidal neurons in cortex

Cortical interneurons shape network activity in cell type-specific ways, and are also influenced by interactions with other cell types. These specific cell-type interactions are understudied, as transgenic labeling methods typically restrict labeling to one neuron type at a time. Although recent methods have enabled post-hoc identification of cell types, these are not available to many labs. Here, we present a method to distinguish between two red fluorophores in vivo, which allowed imaging of activity in somatostatin (SOM), parvalbumin (PV), and putative pyramidal neurons (PYR) in mouse association cortex. We compared population events of elevated activity and observed that the PYR network state corresponded to the ratio between mean SOM and PV neuron activity, demonstrating the importance of simultaneous labeling to explain dynamics. These results extend previous findings in sensory cortex, as activity became sparser and less correlated when the ratio between SOM and PV activity was high.

A mammal and bird's-eye-view of the pupil during sleep and wakefulness

Besides regulating the amount of light that reaches the retina, fluctuations in pupil size also occur in isoluminant conditions during accommodation, during movement and in relation to cognitive workload, attention and emotion. Recent studies in mammals and birds revealed that the pupils are also highly dynamic in the dark during sleep. However, despite exhibiting similar sleep states (rapid eye movement [REM] and non-REM [NREM] sleep), wake and sleep state-dependent changes in pupil size are opposite between mammals and birds, due in part to differences in the type (striated vs. smooth) and control of the iris muscles. Given the link between pupil dynamics and cognitive processes occurring during wakefulness, sleep-related changes in pupil size might indicate when related processes are occurring during sleep. Moreover, the divergent pupillary behaviour observed between mammals and birds raises the possibility that changes in pupil size in birds are a readout of processes not reflected in the mammalian pupil.

Do we all synch alike? Brain-body-environment interactions in ASD

Autism Spectrum Disorder (ASD) is characterized by rigidity of routines and restricted interests, and atypical social communication and interaction. Recent evidence for altered synchronization of neuro-oscillatory brain activity with regularities in the environment and of altered peripheral nervous system function in ASD present promising novel directions for studying pathophysiology and its relationship to ASD clinical phenotype. Human cognition and action are significantly influenced by physiological rhythmic processes that are generated by both the central nervous system (CNS) and the autonomic nervous system (ANS). Normally, perception occurs in a dynamic context, where brain oscillations and autonomic signals synchronize with external events to optimally receive temporally predictable rhythmic information, leading to improved performance. The recent findings on the time-sensitive coupling between the brain and the periphery in effective perception and successful social interactions in typically developed highlight studying the interactions within the brain-body-environment triad as a critical direction in the study of ASD. Here we offer a novel perspective of autism as a case where the temporal dynamics of brain-body-environment coupling is impaired. We present evidence from the literature to support the idea that in autism the nervous system fails to operate in an adaptive manner to synchronize with temporally predictable events in the environment to optimize perception and behavior. This framework could potentially lead to novel biomarkers of hallmark deficits in ASD such as cognitive rigidity and altered social interaction.

Vagal sensory neurons mediate the Bezold-Jarisch reflex and induce syncope

Visceral sensory pathways mediate homeostatic reflexes, the dysfunction of which leads to many neurological disorders1. The Bezold-Jarisch reflex (BJR), first described2,3 in 1867, is a cardioinhibitory reflex that is speculated to be mediated by vagal sensory neurons (VSNs) that also triggers syncope. However, the molecular identity, anatomical organization, physiological characteristics and behavioural influence of cardiac VSNs remain mostly unknown. Here we leveraged single-cell RNA-sequencing data and HYBRiD tissue clearing4 to show that VSNs that express neuropeptide Y receptor Y2 (NPY2R) predominately connect the heart ventricular wall to the area postrema. Optogenetic activation of NPY2R VSNs elicits the classic triad of BJR responses-hypotension, bradycardia and suppressed respiration-and causes an animal to faint. Photostimulation during high-resolution echocardiography and laser Doppler flowmetry with behavioural observation revealed a range of phenotypes reflected in clinical syncope, including reduced cardiac output, cerebral hypoperfusion, pupil dilation and eye-roll. Large-scale Neuropixels brain recordings and machine-learning-based modelling showed that this manipulation causes the suppression of activity across a large distributed neuronal population that is not explained by changes in spontaneous behavioural movements. Additionally, bidirectional manipulation of the periventricular zone had a push-pull effect, with inhibition leading to longer syncope periods and activation inducing arousal. Finally, ablating NPY2R VSNs specifically abolished the BJR. Combined, these results demonstrate a genetically defined cardiac reflex that recapitulates characteristics of human syncope at physiological, behavioural and neural network levels.

Measuring the reliability of binocular rivalry

Binocular rivalry is a widely used tool in sensory and cognitive neuroscience to investigate different aspects of vision and cognition. The dynamics of binocular rivalry (e.g., duration of perceptual dominance phases and mixed percept proportions) differ across individuals; based on rivalry dynamics, it is also possible to calculate an index of ocular dominance (by comparing the perceptual dominance of the images in the two eyes). In this study, we investigated the reliability of binocular rivalry dynamics using different methods for dichoptic stimulation and different rivalry stimuli. For the three main indices we defined (ocular dominance, phase durations and mixed percept proportions), we found a high test-retest reliability across sessions. Moreover, the test-retest reliability of the ocular dominance index was predictable from its internal consistency, supporting its stability over time. Phase durations and mixed percept proportions, in contrast, had worse test-retest reliability than expected based on internal consistency, indicating that these parameters are susceptible to state-dependent changes. Our results support the use of the ocular dominance index and binocular rivalry in the measurement of sensory eye dominance and its plasticity, but advise caution when investigating the association between phase durations or mixed percepts and stable characteristics like psychological traits or disorders.

Pupil-linked arousal modulates network-level EEG signatures of attention reorienting during immersive multitasking

Objective. When multitasking, we must dynamically reorient our attention between different tasks. Attention reorienting is thought to arise through interactions of physiological arousal and brain-wide network dynamics. In this study, we investigated the relationship between pupil-linked arousal and electroencephalography (EEG) brain dynamics in a multitask driving paradigm conducted in virtual reality. We hypothesized that there would be an interaction between arousal and EEG dynamics and that this interaction would correlate with multitasking performance.Approach. We collected EEG and eye tracking data while subjects drove a motorcycle through a simulated city environment, with the instructions to count the number of target images they observed while avoiding crashing into a lead vehicle. The paradigm required the subjects to continuously reorient their attention between the two tasks. Subjects performed the paradigm under two conditions, one more difficult than the other.Main results. We found that task difficulty did not strongly correlate with pupil-linked arousal, and overall task performance increased as arousal level increased. A single-trial analysis revealed several interesting relationships between pupil-linked arousal and task-relevant EEG dynamics. Employing exact low-resolution electromagnetic tomography, we found that higher pupil-linked arousal led to greater EEG oscillatory activity, especially in regions associated with the dorsal attention network and ventral attention network (VAN). Consistent with our hypothesis, we found a relationship between EEG functional connectivity and pupil-linked arousal as a function of multitasking performance. Specifically, we found decreased functional connectivity between regions in the salience network (SN) and the VAN as pupil-linked arousal increased, suggesting that improved multitasking performance at high arousal levels may be due to a down-regulation in coupling between the VAN and the SN. Our results suggest that when multitasking, our brain rebalances arousal-based reorienting so that individual task demands can be met without prematurely reorienting to competing tasks.

Pupil size reflects activation of subcortical ascending arousal system nuclei during rest

Neuromodulatory nuclei that are part of the ascending arousal system (AAS) play a crucial role in regulating cortical state and optimizing task performance. Pupil diameter, under constant luminance conditions, is increasingly used as an index of activity of these AAS nuclei. Indeed, task-based functional imaging studies in humans have begun to provide evidence of stimulus-driven pupil-AAS coupling. However, whether there is such a tight pupil-AAS coupling during rest is not clear. To address this question, we examined simultaneously acquired resting-state fMRI and pupil-size data from 74 participants, focusing on six AAS nuclei: the locus coeruleus, ventral tegmental area, substantia nigra, dorsal and median raphe nuclei, and cholinergic basal forebrain. Activation in all six AAS nuclei was optimally correlated with pupil size at 0-2 s lags, suggesting that spontaneous pupil changes were almost immediately followed by corresponding BOLD-signal changes in the AAS. These results suggest that spontaneous changes in pupil size that occur during states of rest can be used as a noninvasive general index of activity in AAS nuclei. Importantly, the nature of pupil-AAS coupling during rest appears to be vastly different from the relatively slow canonical hemodynamic response function that has been used to characterize task-related pupil-AAS coupling.

Pupil size predicts the onset of exploration in brain and behavior

In uncertain environments, intelligent decision-makers exploit actions that have been rewarding in the past, but also explore actions that could be even better. Several neuromodulatory systems are implicated in exploration, based, in part, on work linking exploration to pupil size-a peripheral correlate of neuromodulatory tone and index of arousal. However, pupil size could instead track variables that make exploration more likely, like volatility or reward, without directly predicting either exploration or its neural bases. Here, we simultaneously measured pupil size, exploration, and neural population activity in the prefrontal cortex while two rhesus macaques explored and exploited in a dynamic environment. We found that pupil size under constant luminance specifically predicted the onset of exploration, beyond what could be explained by reward history. Pupil size also predicted disorganized patterns of prefrontal neural activity at both the single neuron and population levels, even within periods of exploitation. Ultimately, our results support a model in which pupil-linked mechanisms promote the onset of exploration via driving the prefrontal cortex through a critical tipping point where prefrontal control dynamics become disorganized and exploratory decisions are possible.

Microsaccades are directed toward the midpoint between targets in a variably cued attention task

Reliable, noninvasive biomarkers that reveal the internal state of a subject are an invaluable tool for neurological diagnoses. Small fixational eye movements, called microsaccades, are a candidate biomarker thought to reflect a subject's focus of attention [Z. M. Hafed, J. J. Clark, VisionRes. 42, 2533-2545 (2002); R. Engbert, R. Kliegl, VisionRes. 43, 1035-1045 (2003)]. The linkage between the direction of microsaccades and attention has mainly been demonstrated using explicit and unambiguous attentional cues. However, the natural world is seldom predictable and rarely provides unambiguous information. Thus, a useful biomarker must be robust to such changes in environmental statistics. To determine how well microsaccades reveal visual-spatial attention across behavioral contexts, we analyzed these fixational eye movements in monkeys performing a conventional change detection task. The task included two stimulus locations and variable cue validities across blocks of trials. Subjects were adept at the task, showing precise and graded modulations of visual attention for subtle target changes and performing better and faster when the cue was more reliable [J. P. Mayo, J. H. R. Maunsell, J. Neurosci. 36, 5353 (2016)]. However, over tens of thousands of microsaccades, we found no difference in microsaccade direction between cued locations when cue variability was high nor between hit and miss trials. Instead, microsaccades were made toward the midpoint of the two target locations, not toward individual targets. Our results suggest that the direction of microsaccades should be interpreted with caution and may not be a reliable measure of covert spatial attention in more complex viewing conditions.

Beyond linear neural envelope tracking: a mutual information approach

Objective.The human brain tracks the temporal envelope of speech, which contains essential cues for speech understanding. Linear models are the most common tool to study neural envelope tracking. However, information on how speech is processed can be lost since nonlinear relations are precluded. Analysis based on mutual information (MI), on the other hand, can detect both linear and nonlinear relations and is gradually becoming more popular in the field of neural envelope tracking. Yet, several different approaches to calculating MI are applied with no consensus on which approach to use. Furthermore, the added value of nonlinear techniques remains a subject of debate in the field. The present paper aims to resolve these open questions.Approach.We analyzed electroencephalography (EEG) data of participants listening to continuous speech and applied MI analyses and linear models.Main results.Comparing the different MI approaches, we conclude that results are most reliable and robust using the Gaussian copula approach, which first transforms the data to standard Gaussians. With this approach, the MI analysis is a valid technique for studying neural envelope tracking. Like linear models, it allows spatial and temporal interpretations of speech processing, peak latency analyses, and applications to multiple EEG channels combined. In a final analysis, we tested whether nonlinear components were present in the neural response to the envelope by first removing all linear components in the data. We robustly detected nonlinear components on the single-subject level using the MI analysis.Significance.We demonstrate that the human brain processes speech in a nonlinear way. Unlike linear models, the MI analysis detects such nonlinear relations, proving its added value to neural envelope tracking. In addition, the MI analysis retains spatial and temporal characteristics of speech processing, an advantage lost when using more complex (nonlinear) deep neural networks.

Microsaccades are directed towards the midpoint between targets in a variably cued attention task

Reliable, non-invasive biomarkers that reveal the internal state of a subject are an invaluable tool for neurological diagnoses. Small fixational eye movements, called microsaccades, are a candidate biomarker thought to reflect a subject's focus of attention (1, 2). The linkage between the direction of microsaccades and attention has mainly been demonstrated using explicit and unambiguous attentional cues. However, the natural world is seldom predictable and rarely provides unambiguous information. Thus, a useful biomarker must be robust to such changes in environmental statistics. To determine how well microsaccades reveal visual-spatial attention across behavioral contexts, we analyzed these fixational eye movements in monkeys performing a conventional change detection task. The task included two stimulus locations and variable cue validities across blocks of trials. Subjects were adept at the task, showing precise and graded modulations of visual attention for subtle target changes and performing better and faster when the cue was more reliable (3). However, over tens of thousands of microsaccades, we found no difference in microsaccade direction between cued locations when cue variability was high nor between hit and miss trials. Instead, microsaccades were made towards the midpoint of the two target locations, not towards individual targets. Our results suggest that the direction of microsaccades should be interpreted with caution and may not be a reliable measure of covert spatial attention in more complex viewing conditions.

Significance Statement

Small fixational eye movements called microsaccades are thought to "point" towards a location that is being attended in the visual periphery. This phenomenon has largely been studied using visual cues that unambiguously indicate the location of the upcoming stimulus change. Because the natural world is rarely unambiguous, we studied the relationship between microsaccade direction and spatial attention using less reliable cues. We found that monkeys' microsaccade directions in a standard visuospatial attention task did not indicate the animals' focus of attention, despite behavioral and neuronal evidence of spatial attention. Instead, microsaccades were made towards the midpoint between the target locations in both animals, suggesting a more complex relationship between microsaccades and attention in naturalistic settings.

Measures of tonic and phasic activity of the locus coeruleus-norepinephrine system in children with autism spectrum disorder: An event-related potential and pupillometry study

A growing body of research suggests that locus coeruleus-norepinephrine (LC-NE) system may function differently in individuals with autism spectrum disorder (ASD). Understanding the dynamics of both tonic (resting pupil diameter) and phasic (pupil dilation response [PDR] and event-related potential [ERP]) indices may provide meaningful insights about the nature of LC-NE function in ASD. Twenty-four children with ASD and 27 age- and nonverbal-IQ matched typically developing (TD) children completed two experiments: (1) a resting eye-tracking task to measure tonic pupil diameter, and (2) a three-stimulus oddball paradigm to measure phasic responsivity using PDR and ERP. Consistent with prior reports, our results indicate that children with ASD exhibit increased tonic (resting pupil diameter) and reduced phasic (PDR and ERP) activity of the LC-NE system compared to their TD peers. For both groups, decreased phasic responsivity was associated with increased resting pupil diameter. Lastly, tonic and phasic LC-NE indices were primarily related to measures of attention-deficit/hyperactivity disorder (ADHD), and not ASD, symptomatology. These findings expand our understanding of neurophysiological differences present in ASD and demonstrate that aberrant LC-NE activation may be associated with atypical arousal and decreased responsivity to behaviorally-relevant information in ASD.

Behavioral impulsivity is associated with pupillary alterations and hyperactivity in CDKL5 mutant mice

Cyclin-dependent kinase-like 5 (Cdkl5) deficiency disorder (CDD) is a severe neurodevelopmental condition caused by mutations in the X-linked Cdkl5 gene. CDD is characterized by early-onset seizures in the first month of life, intellectual disability, motor and social impairment. No effective treatment is currently available and medical management is only symptomatic and supportive. Recently, mouse models of Cdkl5 disorder have demonstrated that mice lacking Cdkl5 exhibit autism-like phenotypes, hyperactivity and dysregulations of the arousal system, suggesting the possibility to use these features as translational biomarkers. In this study, we tested Cdkl5 male and female mutant mice in an appetitive operant conditioning chamber to assess cognitive and motor abilities, and performed pupillometry to assess the integrity of the arousal system. Then, we evaluated the performance of artificial intelligence models to classify the genotype of the animals from the behavioral and physiological phenotype. The behavioral results show that CDD mice display impulsivity, together with low levels of cognitive flexibility and perseverative behaviors. We assessed arousal levels by simultaneously recording pupil size and locomotor activity. Pupillometry reveals in CDD mice a smaller pupil size and an impaired response to unexpected stimuli associated with hyperlocomotion, demonstrating a global defect in arousal modulation. Finally, machine learning reveals that both behavioral and pupillometry parameters can be considered good predictors of CDD. Since early diagnosis is essential to evaluate treatment outcomes and pupillary measures can be performed easily, we proposed the monitoring of pupil size as a promising biomarker for CDD.

Spectral Fingerprints of Cortical Neuromodulation

Pupil size has been established as a versatile marker of noradrenergic and cholinergic neuromodulation, which has profound effects on neuronal processing, cognition, and behavior. However, little is known about the cortical control and effects of pupil-linked neuromodulation. Here, we show that pupil dynamics are tightly coupled to temporally, spectrally, and spatially specific modulations of local and large-scale cortical population activity in the human brain. We quantified the dynamics of band-limited cortical population activity in resting human subjects using magnetoencephalography and investigated how neural dynamics were linked to simultaneously recorded pupil dynamics. Our results show that pupil-linked neuromodulation does not merely affect cortical population activity in a stereotypical fashion. Instead, we identified three frontal, precentral, and occipitoparietal networks, in which local population activity with distinct spectral profiles in the theta, beta, and alpha bands temporally preceded and followed changes in pupil size. Furthermore, we found that amplitude coupling at ∼16 Hz in a large-scale frontoparietal network predicted pupil dynamics. Our results unravel network-specific spectral fingerprints of cortical neuromodulation in the human brain that likely reflect both the causes and effects of neuromodulation.SIGNIFICANCE STATEMENT Brain function is constantly affected by modulatory neurotransmitters. Pupil size has been established as a versatile marker of noradrenergic and cholinergic neuromodulation. However, because the cortical correlates of pupil dynamics are largely unknown, fundamental questions remain unresolved. Which cortical networks control pupil-linked neuromodulation? Does neuromodulation affect cortical activity in a stereotypical or region-specific fashion? To address this, we quantified the dynamics of cortical population activity in human subjects using magnetoencephalography. We found that pupil dynamics are coupled to highly specific modulations of local and large-scale cortical activity in the human brain. We identified four cortical networks with distinct spectral profiles that temporally predicted and followed pupil size dynamics. These effects likely reflect both the cortical control and effect of neuromodulation.

Expectations boost the reconstruction of auditory features from electrophysiological responses to noisy speech

Online speech processing imposes significant computational demands on the listening brain, the underlying mechanisms of which remain poorly understood. Here, we exploit the perceptual "pop-out" phenomenon (i.e. the dramatic improvement of speech intelligibility after receiving information about speech content) to investigate the neurophysiological effects of prior expectations on degraded speech comprehension. We recorded electroencephalography (EEG) and pupillometry from 21 adults while they rated the clarity of noise-vocoded and sine-wave synthesized sentences. Pop-out was reliably elicited following visual presentation of the corresponding written sentence, but not following incongruent or neutral text. Pop-out was associated with improved reconstruction of the acoustic stimulus envelope from low-frequency EEG activity, implying that improvements in perceptual clarity were mediated via top-down signals that enhanced the quality of cortical speech representations. Spectral analysis further revealed that pop-out was accompanied by a reduction in theta-band power, consistent with predictive coding accounts of acoustic filling-in and incremental sentence processing. Moreover, delta-band power, alpha-band power, and pupil diameter were all increased following the provision of any written sentence information, irrespective of content. Together, these findings reveal distinctive profiles of neurophysiological activity that differentiate the content-specific processes associated with degraded speech comprehension from the context-specific processes invoked under adverse listening conditions.