Pupil-linked arousal determines variability in perceptual decision making

Transcranial Alternating Current Stimulation over Frontal Eye Fields Mimics Attentional Modulation of Visual Processing

Attentional control over sensory processing has been linked to neural alpha oscillations and related inhibition of cerebral cortex. Despite the wide consensus on the functional relevance of alpha oscillations for attention, precise neural mechanisms of how alpha oscillations shape perception and how this top-down modulation is implemented in cortical networks remain unclear. Here, we tested the hypothesis that alpha oscillations in frontal eye fields (FEFs) are causally involved in the top-down regulation of visual processing in humans (male and female). We applied sham-controlled, intermittent transcranial alternating current stimulation (tACS) over bilateral FEF at either 10 Hz (alpha) or 40 Hz (gamma) to manipulate attentional preparation in a visual discrimination task. Under each stimulation condition, we measured psychometric functions for contrast perception and introduced a novel linear mixed modeling approach for statistical control of neurosensory side effects of the electric stimulation. tACS at alpha frequency reduced the slope of the psychometric function, resulting in improved subthreshold and impaired superthreshold contrast perception. Side effects on the psychometric functions were complex and showed large interindividual variability. Controlling for the impact of side effects on the psychometric parameters by using covariates in the linear mixed model analysis reduced this variability and strengthened the perceptual effect. We propose that alpha tACS over FEF mimicked a state of endogenous attention by strengthening a fronto-occipitoparietal network in the alpha band. We speculate that this network modulation enhanced phasic gating in occipitoparietal cortex leading to increased variability of single-trial psychometric thresholds, measurable as a reduction of psychometric slope.

On the (un)reliability of common behavioral and electrophysiological measures from the stop signal task: Measures of inhibition lack stability over time

Response inhibition, the intentional stopping of planned or initiated actions, is often considered a key facet of control, impulsivity, and self-regulation. The stop signal task is argued to be the purest inhibition task we have, and it is thus central to much work investigating the role of inhibition in areas like development and psychopathology. Most of this work quantifies stopping behavior by calculating the stop signal reaction time as a measure of individual stopping latency. Individual difference studies aiming to investigate why and how stopping latencies differ between people often do this under the assumption that the stop signal reaction time indexes a stable, dispositional trait. However, empirical support for this assumption is lacking, as common measures of inhibition and control tend to show low test-retest reliability and thus appear unstable over time. The reasons for this could be methodological, where low stability is driven by measurement noise, or substantive, where low stability is driven by a larger influence of state-like and situational factors. To investigate this, we characterized the split-half and test-retest reliability of a range of common behavioral and electrophysiological measures derived from the stop signal task. Across three independent studies, different measurement modalities, and a systematic review of the literature, we found a pattern of low temporal stability for inhibition measures and higher stability for measures of manifest behavior and non-inhibitory processing. This pattern could not be explained by measurement noise and low internal consistency. Consequently, response inhibition appears to have mostly state-like and situational determinants, and there is little support for the validity of conceptualizing common inhibition measures as reflecting stable traits.

Teleological reasoning bias is predicted by pupil dynamics: Evidence for the extensive integration account of bias in reasoning

Teleological reasoning is the tendency for humans to see purpose and intentionality in natural phenomena when there is none. In this study, we assess three competing theories on how bias in reasoning arises by examining performance on a teleological reasoning task while measuring pupil size and response times. We replicate that humans (N = 45) are prone to accept false teleological explanations. Further, we show that errors on the teleological reasoning task are associated with slower response times, smaller baseline pupil size, and larger pupil dilations. The results are in line with the single-process extensive integration account and directly oppose predictions from dual-processing accounts. Lastly, by modeling responses with a drift-diffusion model, we find that larger baseline pupil size is associated with lower decision threshold and higher drift rate, whereas larger pupil dilations are associated with higher decision threshold and lower drift rate. The results highlight the role of neural gain and the Locus Coeruleus-Norepinephrine system in modulating evidence integration and bias in reasoning. Thus, teleological reasoning and susceptibility to bias likely arise due to extensive processing rather than through fast and effortless processing.

Pistol shooting performance under pressure: Longitudinal changes in gaze behavior of male and female Army cadets

We found evidence that Army cadets improved their gaze behavior and performance across time under high and low pressure in a shooting task. The purpose of the study was to determine if male and female cadets developed an optimal quiet eye (QE) onset, a longer QE duration, and decreased pupil diameter variability (PDV) over time under low (LP) and high pressure (HP) conditions. The study was carried out over four sessions, with intervals of 4.5 months. During each session, 16 men and 12 women, first-year cadets of The Brazilian Army Academy, performed ten pistol shots under counterbalanced LP and HP conditions. The cadets shot in the upright position and wore an eye-tracker. Shooting accuracy improved and did not differ for men and women in the LP condition, however during HP the women performed more poorly than the men in session 1 but improved to a level similar to the men in session 4. QE duration Pre (aiming) did not differ during LP, while during HP QE Post (execution) increased across the session for men and women. QE onset 2 (execution) occurred earlier for the men than women during LP, while during HP the women improved to a level similar to the men in sessions 3 and 4. PDV declined across sessions for men and women with the lowest values in sessions 3 and 4. The findings are discussed within social facilitation theory, which states the context of training affects the rate at which improvements in motor skills occur. The results show that women cadets can improve their shooting performance, quiet eye duration, quiet eye onset and pupil diameter variability to a level similar to men if three to four LP and HP training sessions are scheduled across approximately 12-18 months.

Modulation of metastable ensemble dynamics explains optimal coding at moderate arousal in auditory cortex

Performance during perceptual decision-making exhibits an inverted-U relationship with arousal, but the underlying network mechanisms remain unclear. Here, we recorded from auditory cortex (A1) of behaving mice during passive tone presentation, while tracking arousal via pupillometry. We found that tone discriminability in A1 ensembles was optimal at intermediate arousal, revealing a population-level neural correlate of the inverted-U relationship. We explained this arousal-dependent coding using a spiking network model with a clustered architecture. Specifically, we show that optimal stimulus discriminability is achieved near a transition between a multi-attractor phase with metastable cluster dynamics (low arousal) and a single-attractor phase (high arousal). Additional signatures of this transition include arousal-induced reductions of overall neural variability and the extent of stimulus-induced variability quenching, which we observed in the empirical data. Altogether, this study elucidates computational principles underlying interactions between pupil-linked arousal, sensory processing, and neural variability, and suggests a role for phase transitions in explaining nonlinear modulations of cortical computations.

Role of Posterior Medial Thalamus in the Modulation of Striatal Circuitry and Choice Behavior

The posterior medial (POm) thalamus is heavily interconnected with sensory and motor circuitry and is likely involved in behavioral modulation and sensorimotor integration. POm provides axonal projections to the dorsal striatum, a hotspot of sensorimotor processing, yet the role of POm-striatal projections has remained undetermined. Using optogenetics with slice electrophysiology, we found that POm provides robust synaptic input to direct and indirect pathway striatal spiny projection neurons (D1- and D2-SPNs, respectively) and parvalbumin-expressing fast spiking interneurons (PVs). During the performance of a whisker-based tactile discrimination task, POm-striatal projections displayed learning-related activation correlating with anticipatory, but not reward-related, pupil dilation. Inhibition of POm-striatal axons across learning caused slower reaction times and an increase in the number of training sessions for expert performance. Our data indicate that POm-striatal inputs provide a behaviorally relevant arousal-related signal, which may prime striatal circuitry for efficient integration of subsequent choice-related inputs.

A disinhibitory circuit mechanism explains a general principle of peak performance during mid-level arousal

Perceptual decision-making is highly dependent on the momentary arousal state of the brain, which fluctuates over time on a scale of hours, minutes, and even seconds. The textbook relationship between momentary arousal and task performance is captured by an inverted U-shape, as put forward in the Yerkes-Dodson law. This law suggests optimal performance at moderate levels of arousal and impaired performance at low or high arousal levels. However, despite its popularity, the evidence for this relationship in humans is mixed at best. Here, we use pupil-indexed arousal and performance data from various perceptual decision-making tasks to provide converging evidence for the inverted U-shaped relationship between spontaneous arousal fluctuations and performance across different decision types (discrimination, detection) and sensory modalities (visual, auditory). To further understand this relationship, we built a neurobiologically plausible mechanistic model and show that it is possible to reproduce our findings by incorporating two types of interneurons that are both modulated by an arousal signal. The model architecture produces two dynamical regimes under the influence of arousal: one regime in which performance increases with arousal and another regime in which performance decreases with arousal, together forming an inverted U-shaped arousal-performance relationship. We conclude that the inverted U-shaped arousal-performance relationship is a general and robust property of sensory processing. It might be brought about by the influence of arousal on two types of interneurons that together act as a disinhibitory pathway for the neural populations that encode the available sensory evidence used for the decision.

Assessing Cognitive Effort in Ménière's Disease: Pupillometry as a Novel Tool for Postural Control

BACKGROUND

This study aimed to investigate the utility of pupillometry as a measure of cognitive effort in individuals with Ménière's disease experiencing chronic postural destabilization. By integrating pupillometry with static posturography, we sought to gain deeper insights into the cognitive demands and arousal levels associated with postural control in this specific patient population.

METHODS

The study included 36 patients who met the diagnostic criteria for Ménière's disease and a control group comprising 36 healthy volunteers. We performed static posturography using a computerized static posturography platform to objectively assess postural imbalance. Additionally, pupillometry was recorded using infrared video-oculoscopy. Pupil dilation was measured before and after participants walked for 7 steps on-site with their vision obscured.

RESULTS

Baseline tonic pupil size showed no significant difference between healthy controls and Ménière's patients. However, after walking stimulation, Ménière's patients exhibited highly significant abnormal walking-induced pupil dilation. This suggests increased arousal in response to the challenging task of walking with closed eyes, linked to static upright stance imbalance as correlated with posturography parameters.

CONCLUSION

Pupillometry holds promise as an objective tool to assess cognitive effort and arousal during postural control in Ménière's disease. Implementing pupillometry in clinical practice could enhance the management of postural instability in these patients. Our findings contribute to the understanding of cognitive aspects in balance control and open new avenues for further investigations in vestibular dysfunction.

Interpersonal alignment of neural evidence accumulation to social exchange of confidence

Private, subjective beliefs about uncertainty have been found to have idiosyncratic computational and neural substrates yet, humans share such beliefs seamlessly and cooperate successfully. Bringing together decision making under uncertainty and interpersonal alignment in communication, in a discovery plus pre-registered replication design, we examined the neuro-computational basis of the relationship between privately held and socially shared uncertainty. Examining confidence-speed-accuracy trade-off in uncertainty-ridden perceptual decisions under social vs isolated context, we found that shared (i.e. reported confidence) and subjective (inferred from pupillometry) uncertainty dynamically followed social information. An attractor neural network model incorporating social information as top-down additive input captured the observed behavior and demonstrated the emergence of social alignment in virtual dyadic simulations. Electroencephalography showed that social exchange of confidence modulated the neural signature of perceptual evidence accumulation in the central parietal cortex. Our findings offer a neural population model for interpersonal alignment of shared beliefs.

Effects of pupil size as manipulated through ipRGC activation on visual processing

The size of the eyes' pupils determines how much light enters the eye and also how well this light is focused. Through this route, pupil size shapes the earliest stages of visual processing. Yet causal effects of pupil size on vision are poorly understood and rarely studied. Here we introduce a new way to manipulate pupil size, which relies on activation of intrinsically photosensitive retinal ganglion cells (ipRGCs) to induce sustained pupil constriction. We report the effects of both experimentally induced and spontaneous changes in pupil size on visual processing as measured through EEG. We compare these to the effects of stimulus intensity and covert visual attention, because previous studies have shown that these factors all have comparable effects on some common measures of early visual processing, such as detection performance and steady-state visual evoked potentials; yet it is still unclear whether these are superficial similarities, or rather whether they reflect similar underlying processes. Using a mix of neural-network decoding, ERP analyses, and time-frequency analyses, we find that induced pupil size, spontaneous pupil size, stimulus intensity, and covert visual attention all affect EEG responses, mainly over occipital and parietal electrodes, but-crucially-that they do so in qualitatively different ways. Induced and spontaneous pupil-size changes mainly modulate activity patterns (but not overall power or intertrial coherence) in the high-frequency beta range; this may reflect an effect of pupil size on oculomotor activity and/ or visual processing. In addition, spontaneous (but not induced) pupil size tends to correlate positively with intertrial coherence in the alpha band; this may reflect a non-causal relationship, mediated by arousal. Taken together, our findings suggest that pupil size has qualitatively different effects on visual processing from stimulus intensity and covert visual attention. This shows that pupil size as manipulated through ipRGC activation strongly affects visual processing, and provides concrete starting points for further study of this important yet understudied earliest stage of visual processing.

Adaptive decision-making depends on pupil-linked arousal in rats performing tactile discrimination tasks

Perceptual decision-making is a dynamic cognitive process and is shaped by many factors, including behavioral state, reward contingency, and sensory environment. To understand the extent to which adaptive behavior in decision-making is dependent on pupil-linked arousal, we trained head-fixed rats to perform perceptual decision-making tasks and systematically manipulated the probability of Go and No-go stimuli while simultaneously measuring their pupil size in the tasks. Our data demonstrated that the animals adaptively modified their behavior in response to the changes in the sensory environment. The response probability to both Go and No-go stimuli decreased as the probability of the Go stimulus being presented decreased. Analyses within the signal detection theory framework showed that while the animals' perceptual sensitivity was invariant, their decision criterion increased as the probability of the Go stimulus decreased. Simulation results indicated that the adaptive increase in the decision criterion will increase possible water rewards during the task. Moreover, the adaptive decision-making is dependent on pupil-linked arousal as the increase in the decision criterion was the largest during low pupil-linked arousal periods. Taken together, our results demonstrated that the rats were able to adjust their decision-making to maximize rewards in the tasks, and that adaptive behavior in perceptual decision-making is dependent on pupil-linked arousal.NEW & NOTEWORTHY Perceptual decision-making is a dynamic cognitive process and is shaped by many factors. However, the extent to which changes in sensory environment result in adaptive decision-making remains poorly understood. Our data provided new experimental evidence demonstrating that the rats were able to adaptively modify their decision criterion to maximize water reward in response to changes in the statistics of the sensory environment. Furthermore, the adaptive decision-making is dependent on pupil-linked arousal.

Catecholaminergic neuromodulation and selective attention jointly shape perceptual decision-making

Perceptual decisions about sensory input are influenced by fluctuations in ongoing neural activity, most prominently driven by attention and neuromodulator systems. It is currently unknown if neuromodulator activity and attention differentially modulate perceptual decision-making and/or whether neuromodulatory systems in fact control attentional processes. To investigate the effects of two distinct neuromodulatory systems and spatial attention on perceptual decisions, we pharmacologically elevated cholinergic (through donepezil) and catecholaminergic (through atomoxetine) levels in humans performing a visuo-spatial attention task, while we measured electroencephalography (EEG). Both attention and catecholaminergic enhancement improved decision-making at the behavioral and algorithmic level, as reflected in increased perceptual sensitivity and the modulation of the drift rate parameter derived from drift diffusion modeling. Univariate analyses of EEG data time-locked to the attentional cue, the target stimulus, and the motor response further revealed that attention and catecholaminergic enhancement both modulated pre-stimulus cortical excitability, cue- and stimulus-evoked sensory activity, as well as parietal evidence accumulation signals. Interestingly, we observed both similar, unique, and interactive effects of attention and catecholaminergic neuromodulation on these behavioral, algorithmic, and neural markers of the decision-making process. Thereby, this study reveals an intricate relationship between attentional and catecholaminergic systems and advances our understanding about how these systems jointly shape various stages of perceptual decision-making.

Pupil size predicts the onset of exploration in brain and behavior

In uncertain environments, intelligent decision-makers exploit actions that have been rewarding in the past, but also explore actions that could be even better. Several neuromodulatory systems are implicated in exploration, based, in part, on work linking exploration to pupil size-a peripheral correlate of neuromodulatory tone and index of arousal. However, pupil size could instead track variables that make exploration more likely, like volatility or reward, without directly predicting either exploration or its neural bases. Here, we simultaneously measured pupil size, exploration, and neural population activity in the prefrontal cortex while two rhesus macaques explored and exploited in a dynamic environment. We found that pupil size under constant luminance specifically predicted the onset of exploration, beyond what could be explained by reward history. Pupil size also predicted disorganized patterns of prefrontal neural activity at both the single neuron and population levels, even within periods of exploitation. Ultimately, our results support a model in which pupil-linked mechanisms promote the onset of exploration via driving the prefrontal cortex through a critical tipping point where prefrontal control dynamics become disorganized and exploratory decisions are possible.

Pupillometric evidence for a temporal expectations-based account of persistence under temporal uncertainty

People often quit waiting for delayed rewards when the exact timing of those rewards is uncertain. This behavior often has been attributed to self-control failure. Another possibility is that quitting is the result of a rational decision-making process in the face of uncertainty, based on the decision-maker's expectations about the possible arrival times of the awaited reward. There are forms of temporal expectations (e.g., heavy-tailed) under which the expected time remaining until a reward arrives actually increases as time elapses. In those cases, the rational strategy is to quit waiting when the expected reward is no longer worth the expected time remaining. To arbitrate between the "limited self-control" and "temporal expectations" accounts of persistence, we measured pupil diameter during a persistence task, as a physiological marker of surprise (phasic responses) and effort (pre-decision diameter). Phasic pupil responses were elevated in response to reward receipt. Critically, the extent to which pupils dilated following rewards depended on the delay: people showed larger pupillary surprise responses the more delayed the reward was. This result suggests that people expect the reward less the longer they wait for it-a form of temporal expectations under which limiting persistence is rational. Moreover, predecision pupil diameter before quit events was not associated with how long the participant had been waiting, but rather, depended on how atypical the quit decision was compared with the participant's usual behavior. These data provide physiological evidence for a temporal expectations account of persistence under temporal uncertainty.

Pupillary dynamics reflect the impact of temporal expectation on detection strategy

Everyday life's perceptual decision-making is informed by experience. In particular, temporal expectation can ease the detection of relevant events in noisy sensory streams. Here, we investigated if humans can extract hidden temporal cues from the occurrences of probabilistic targets and utilize them to inform target detection in a complex acoustic stream. To understand what neural mechanisms implement temporal expectation influence on decision-making, we used pupillometry as a proxy for underlying neuromodulatory activity. We found that participants' detection strategy was influenced by the hidden temporal context and correlated with sound-evoked pupil dilation. A model of urgency fitted on false alarms predicted detection reaction time. Altogether, these findings suggest that temporal expectation informs decision-making and could be implemented through neuromodulatory-mediated urgency signals.

Baseline pupil size encodes task-related information and modulates the task-evoked response in a speech-in-noise task

Pupillometry data are commonly reported relative to a baseline value recorded in a controlled pre-task condition. In this study, the influence of the experimental design and the preparatory processing related to task difficulty on the baseline pupil size was investigated during a speech intelligibility in noise paradigm. Furthermore, the relationship between the baseline pupil size and the temporal dynamics of the pupil response was assessed. The analysis revealed strong effects of block presentation order, within-block sentence order and task difficulty on the baseline values. An interaction between signal-to-noise ratio and block order was found, indicating that baseline values reflect listener expectations arising from the order in which the different blocks were presented. Furthermore, the baseline pupil size was found to affect the slope, delay and curvature of the pupillary response as well as the peak pupil dilation. This suggests that baseline correction might be sufficient when reporting pupillometry results in terms of mean pupil dilation only, but not when a more complex characterization of the temporal dynamics of the response is considered. By clarifying which factors affect baseline pupil size and how baseline values interact with the task-evoked response, the results from the present study can contribute to a better interpretation of the pupillary response as a marker of cognitive processing.

Pupillometry tracks errors in interval timing

Recent primate studies suggest a potential link between pupil size and subjectively elapsed duration. Here, we sought to investigate the relationship between pupil size and perceived duration in human participants performing two temporal bisection tasks in the subsecond and suprasecond interval ranges. In the subsecond task, pupil diameter was greater during stimulus processing when shorter intervals were overestimated but also during and after stimulus offset when longer intervals were underestimated. By contrast, in the suprasecond task, larger pupil diameter was observed only in the late stimulus offset phase prior to response prompts when longer intervals were underestimated. This pattern of results suggests that pupil diameter relates to an error monitoring mechanism in interval timing. These results are at odds with a direct relationship between pupil size and the perception of duration but suggest that pupillometric variation might play a key role in signifying errors related to temporal judgments.

Pupillometry as an integrated readout of distinct attentional networks

The course of pupillary constriction and dilation provides an easy-to-access, inexpensive, and noninvasive readout of brain activity. We propose a new taxonomy of factors affecting the pupil and link these to associated neural underpinnings in an ascending hierarchy. In addition to two well-established low-level factors (light level and focal distance), we suggest two further intermediate-level factors, alerting and orienting, and a higher-level factor, executive functioning. Alerting, orienting, and executive functioning - including their respective underlying neural circuitries - overlap with the three principal attentional networks, making pupil size an integrated readout of distinct states of attention. As a now widespread technique, pupillometry is ready to provide meaningful applications and constitutes a viable part of the psychophysiological toolbox.

Pupil-linked Arousal Signals in the Midbrain Superior Colliculus

The orienting response evoked by the appearance of a salient stimulus is modulated by arousal; however, neural underpinnings for the interplay between orienting and arousal are not well understood. The superior colliculus (SC), causally involved in multiple components of the orienting response including gaze and attention shifts, receives not only multisensory and cognitive inputs but also arousal-regulated inputs from various cortical and subcortical structures. To investigate the impact of moment-by-moment fluctuations in arousal on orienting saccade responses, we used microstimulation of the monkey SC to trigger saccade responses, and we used pupil size and velocity to index the level of arousal at stimulation onset because these measures correlate with changes in brain states and locus coeruleus activity. Saccades induced by SC microstimulation correlated with prestimulation pupil velocity, with higher pupil velocities on trials without evoked saccades than with evoked saccades. In contrast, prestimulation absolute pupil size did not correlate with saccade behavior. However, pupil velocity correlated with evoked saccade latency and metrics. Together, our results demonstrated that small fluctuations in arousal, indexed by pupil velocity, can modulate the saccade response evoked by SC microstimulation in awake behaving monkeys.

Dynamic decision policy reconfiguration under outcome uncertainty

In uncertain or unstable environments, sometimes the best decision is to change your mind. To shed light on this flexibility, we evaluated how the underlying decision policy adapts when the most rewarding action changes. Human participants performed a dynamic two-armed bandit task that manipulated the certainty in relative reward (conflict) and the reliability of action-outcomes (volatility). Continuous estimates of conflict and volatility contributed to shifts in exploratory states by changing both the rate of evidence accumulation (drift rate) and the amount of evidence needed to make a decision (boundary height), respectively. At the trialwise level, following a switch in the optimal choice, the drift rate plummets and the boundary height weakly spikes, leading to a slow exploratory state. We find that the drift rate drives most of this response, with an unreliable contribution of boundary height across experiments. Surprisingly, we find no evidence that pupillary responses associated with decision policy changes. We conclude that humans show a stereotypical shift in their decision policies in response to environmental changes.

Longitudinal network model of the co-development of temperament, executive functioning, and psychopathology symptoms in youth with and without ADHD

Attention-deficit hyperactivity disorder (ADHD) is a common, chronic, and impairing disorder, yet presentations of ADHD and clinical course are highly heterogeneous. Despite substantial research efforts, both (a) the secondary co-occurrence of ADHD and complicating additional clinical problems and (b) the developmental pathways leading toward or away from recovery through adolescence remain poorly understood. Resolving these requires accounting for transactional influences of a large number of features across development. Here, we applied a longitudinal cross-lagged panel network model to a multimodal, multilevel dataset in a well-characterized sample of 488 children (nADHD = 296) to test Research Domain Criteria initiative-inspired hypotheses about transdiagnostic risk. Network features included Diagnostic and Statistical Manual of Mental Disorders symptoms, trait-based ratings of emotional functioning (temperament), and performance-based measures of cognition. Results confirmed that ADHD symptom domains, temperamental irritability, and working memory are independent transdiagnostic risk factors for psychopathology based on their direct associations with other features across time. ADHD symptoms and working memory each had direct, independent associations with depression. Results also demonstrated tightly linked co-development of ADHD symptoms and temperamental irritability, consistent with the possibility that this type of anger dysregulation is a core feature that is co-expressed as part of the ADHD phenotype for some children.

State-related neural influences on fMRI connectivity estimation

The spatiotemporal structure of functional magnetic resonance imaging (fMRI) signals has provided a valuable window into the network underpinnings of human brain function and dysfunction. Although some cross-regional temporal correlation patterns (functional connectivity; FC) exhibit a high degree of stability across individuals and species, there is growing acknowledgment that measures of FC can exhibit marked changes over a range of temporal scales. Further, FC can covary with experimental task demands and ongoing neural processes linked to arousal, consciousness and perception, cognitive and affective state, and brain-body interactions. The increased recognition that such interrelated neural processes modulate FC measurements has raised both challenges and new opportunities in using FC to investigate brain function. Here, we review recent advances in the quantification of neural effects that shape fMRI FC and discuss the broad implications of these findings in the design and analysis of fMRI studies. We also discuss how a more complete understanding of the neural factors that shape FC measurements can resolve apparent inconsistencies in the literature and lead to more interpretable conclusions from fMRI studies.

The ascending arousal system promotes optimal performance through mesoscale network integration in a visuospatial attentional task

Previous research has shown that the autonomic nervous system provides essential constraints over ongoing cognitive function. However, there is currently a relative lack of direct empirical evidence for how this interaction manifests in the brain at the macroscale level. Here, we examine the role of ascending arousal and attentional load on large-scale network dynamics by combining pupillometry, functional MRI, and graph theoretical analysis to analyze data from a visual motion-tracking task with a parametric load manipulation. We found that attentional load effects were observable in measures of pupil diameter and in a set of brain regions that parametrically modulated their BOLD activity and mesoscale network-level integration. In addition, the regional patterns of network reconfiguration were correlated with the spatial distribution of the α2a adrenergic receptor. Our results further solidify the relationship between ascending noradrenergic activity, large-scale network integration, and cognitive task performance.

Anticipatory Energization Revealed by Pupil and Brain Activity Guides Human Effort-Based Decision Making

An organism's fitness is determined by how it chooses to adapt to effort in response to challenges. Exertion of effort correlates with activity in dorsomedial prefrontal cortex (dmPFC) and noradrenergic pupil dilation, but little is known about the role of these neurophysiological processes for decisions about future efforts, they may provide anticipatory energization to help us accept the challenge or a cost representation that is weighted against the expected rewards. Here, we provide evidence for the former, by measuring pupil and functional magnetic resonance imaging (fMRI) brain responses while 52 human participants (29 females) chose whether to exert efforts to obtain rewards. Both pupil-dilation rate and dmPFC fMRI activity increased with anticipated effort level, and these increases differ depending on the choice outcome: they were stronger when participants chose to accept the challenge compared with when the challenge was declined. Crucially, the choice-dependent modulation of pupil and brain-activity effort representations were stronger in participants whose behavioral choices were more sensitive to effort. Our results identify a process involving the peripheral and central human nervous system that simulates the required energization before overt response, suggesting a role in guiding effort-based decisions.SIGNIFICANCE STATEMENT The brain's arousal system tracks the effort we engage in during strenuous activity. But much less is known about what role this effort signaling may play when we decide whether to exert effort in the future. Here, we characterize pupil-linked arousal and brain signals that guide decisions whether to engage in effort to gain money. During such choices, increases in brain activity and pupil dilation correlated with the effort involved in the chosen option, and these increases were stronger when people decided to accept the effort compared with when they rejected it. These results suggest that the brain arousal system guides decisions by energizing the organism for the prospective challenge.

Pupil dilation predicts individual self-regulation success across domains

Multiple theories have proposed that increasing central arousal through the brain's locus coeruleus-norepinephrine system may facilitate cognitive control and memory. However, the role of the arousal system in emotion regulation is less well understood. Pupil diameter is a proxy to infer upon the central arousal state. We employed an emotion regulation paradigm with a combination of design features that allowed us to dissociate regulation from emotional arousal in the pupil diameter time course of 34 healthy adults. Pupil diameter increase during regulation predicted individual differences in emotion regulation success beyond task difficulty. Moreover, the extent of this individual regulatory arousal boost predicted performance in another self-control task, dietary health challenges. Participants who harnessed more regulation-associated arousal during emotion regulation were also more successful in choosing healthier foods. These results suggest that a common arousal-based facilitation mechanism may support an individual's self-control across domains.

PupilEXT: Flexible Open-Source Platform for High-Resolution Pupillometry in Vision Research

The human pupil behavior has gained increased attention due to the discovery of the intrinsically photosensitive retinal ganglion cells and the afferent pupil control path's role as a biomarker for cognitive processes. Diameter changes in the range of 10-2 mm are of interest, requiring reliable and characterized measurement equipment to accurately detect neurocognitive effects on the pupil. Mostly commercial solutions are used as measurement devices in pupillometry which is associated with high investments. Moreover, commercial systems rely on closed software, restricting conclusions about the used pupil-tracking algorithms. Here, we developed an open-source pupillometry platform consisting of hardware and software competitive with high-end commercial stereo eye-tracking systems. Our goal was to make a professional remote pupil measurement pipeline for laboratory conditions accessible for everyone. This work's core outcome is an integrated cross-platform (macOS, Windows and Linux) pupillometry software called PupilEXT, featuring a user-friendly graphical interface covering the relevant requirements of professional pupil response research. We offer a selection of six state-of-the-art open-source pupil detection algorithms (Starburst, Swirski, ExCuSe, ElSe, PuRe and PuReST) to perform the pupil measurement. A developed 120-fps pupillometry demo system was able to achieve a calibration accuracy of 0.003 mm and an averaged temporal pupil measurement detection accuracy of 0.0059 mm in stereo mode. The PupilEXT software has extended features in pupil detection, measurement validation, image acquisition, data acquisition, offline pupil measurement, camera calibration, stereo vision, data visualization and system independence, all combined in a single open-source interface, available at https://github.com/openPupil/Open-PupilEXT.

Pupillary dilation elicited by attending to two disks with different luminance

Pupils become smaller when people attend to a bright disk as compared to a dark disk. However, people can divide their attention into several distinct positions, which is referred to as divided attention, and pupillary responses under such conditions have not been investigated. In this study, we examined how pupils would respond when people attended to two disks presented at two distinct positions by conducting three experiments. We found that the pupillary response when attending to two disks with different luminance was larger than when attending to a single brighter disk and was comparable to that when attending to a single darker disk, whereas the pupillary response when attending to two disks with identical luminance was not larger than when attending to a single disk (irrespective of the disk luminance). Furthermore, we found that the magnitude of pupillary dilation was determined by the magnitude of the luminance difference between two disks. These results make a useful contribution to the literature on human pupillary responses.

Pupil Dilation and the Slow Wave ERP Reflect Surprise about Choice Outcome Resulting from Intrinsic Variability in Decision Confidence

Central to human and animal cognition is the ability to learn from feedback in order to optimize future rewards. Such a learning signal might be encoded and broadcasted by the brain's arousal systems, including the noradrenergic locus coeruleus. Pupil responses and the positive slow wave component of event-related potentials reflect rapid changes in the arousal level of the brain. Here, we ask whether and how these variables may reflect surprise: the mismatch between one's expectation about being correct and the outcome of a decision, when expectations fluctuate due to internal factors (e.g., engagement). We show that during an elementary decision task in the face of uncertainty both physiological markers of phasic arousal reflect surprise. We further show that pupil responses and slow wave event-related potential are unrelated to each other and that prediction error computations depend on feedback awareness. These results further advance our understanding of the role of central arousal systems in decision-making under uncertainty.

Real-world stress resilience is associated with the responsivity of the locus coeruleus

Individuals may show different responses to stressful events. Here, we investigate the neurobiological basis of stress resilience, by showing that neural responsitivity of the noradrenergic locus coeruleus (LC-NE) and associated pupil responses are related to the subsequent change in measures of anxiety and depression in response to prolonged real-life stress. We acquired fMRI and pupillometry data during an emotional-conflict task in medical residents before they underwent stressful emergency-room internships known to be a risk factor for anxiety and depression. The LC-NE conflict response and its functional coupling with the amygdala was associated with stress-related symptom changes in response to the internship. A similar relationship was found for pupil-dilation, a potential marker of LC-NE firing. Our results provide insights into the noradrenergic basis of conflict generation, adaptation and stress resilience.

Phasic activity of the locus-coeruleus is not a mediator of the relationship between fitness and inhibition in college-aged adults

Aerobic fitness is consistently and robustly associated with superior performance on assessments of cognitive control. One potential mechanism underlying this phenomenon is activation of the locus-coeruleus. Specifically, individuals with greater aerobic fitness may be better able to sustain engagement in a cognitively demanding task via a superior ability to meet the metabolic demands of this neural system. Accordingly, the present investigation examined 1) the relationship between aerobic fitness and phasic activation of the locus-coeruleus (indexed using pupillometry) and 2) the potential mediating influence of locus-coeruleus activity on the relationship between aerobic fitness and cognitive task performance. Participants performed an inhibition task while their pupillary responses were measured using an infrared eye tracker. A VO_2max test was then performed to determine individuals' aerobic fitness levels. Consistent with previous research, higher levels of aerobic fitness were related to shorter reaction time. However, phasic activity of the locus-coeruleus did not mediate this relationship - nor did it relate to aerobic fitness level. These results suggest that aerobic fitness does not relate to differences in locus-coeruleus activity in the context of cognitive control in college-aged adults.

Deep learning-based pupil model predicts time and spectral dependent light responses

Although research has made significant findings in the neurophysiological process behind the pupillary light reflex, the temporal prediction of the pupil diameter triggered by polychromatic or chromatic stimulus spectra is still not possible. State of the art pupil models rested in estimating a static diameter at the equilibrium-state for spectra along the Planckian locus. Neither the temporal receptor-weighting nor the spectral-dependent adaptation behaviour of the afferent pupil control path is mapped in such functions. Here we propose a deep learning-driven concept of a pupil model, which reconstructs the pupil's time course either from photometric and colourimetric or receptor-based stimulus quantities. By merging feed-forward neural networks with a biomechanical differential equation, we predict the temporal pupil light response with a mean absolute error below 0.1 mm from polychromatic (2007 [Formula: see text] 1 K, 4983 [Formula: see text] 3 K, 10,138 [Formula: see text] 22 K) and chromatic spectra (450 nm, 530 nm, 610 nm, 660 nm) at 100.01 ± 0.25 cd/m2. This non-parametric and self-learning concept could open the door to a generalized description of the pupil behaviour.

Perceptual Behavior Depends Differently on Pupil-Linked Arousal and Heartbeat Dynamics-Linked Arousal in Rats Performing Tactile Discrimination Tasks

Several physiology signals, including heart rate and pupil size, have been widely used as peripheral indices of arousal to evaluate the effects of arousal on brain functions. However, whether behavior depends differently on arousal indexed by these physiological signals remains unclear. We simultaneously recorded electrocardiogram (ECG) and pupil size in head-fixed rats performing tactile discrimination tasks. We found both heartbeat dynamics and pupil size co-varied with behavioral outcomes, indicating behavior was dependent upon arousal indexed by the two physiological signals. To estimate the potential difference between the effects of pupil-linked arousal and heart rate-linked arousal on behavior, we constructed a Bayesian decoder to predict animals' behavior from pupil size and heart rate prior to stimulus presentation. The performance of the decoder was significantly better when using both heart rate and pupil size as inputs than when using either of them alone, suggesting the effects of the two arousal systems on behavior are not completely redundant. Supporting this notion, we found that, on a substantial portion of trials correctly predicted by the heart rate-based decoder, the pupil size-based decoder failed to correctly predict animals' behavior. Taken together, these results suggest that pupil-linked and heart rate-linked arousal systems exert different influences on animals' behavior.

Modeling pupil responses to rapid sequential events

Pupil size is an easily accessible, noninvasive online indicator of various perceptual and cognitive processes. Pupil measurements have the potential to reveal continuous processing dynamics throughout an experimental trial, including anticipatory responses. However, the relatively sluggish (~2 s) response dynamics of pupil dilation make it challenging to connect changes in pupil size to events occurring close together in time. Researchers have used models to link changes in pupil size to specific trial events, but such methods have not been systematically evaluated. Here we developed and evaluated a general linear model (GLM) pipeline that estimates pupillary responses to multiple rapid events within an experimental trial. We evaluated the modeling approach using a sample dataset in which multiple sequential stimuli were presented within 2-s trials. We found: (1) Model fits improved when the pupil impulse response function (PuRF) was fit for each observer. PuRFs varied substantially across individuals but were consistent for each individual. (2) Model fits also improved when pupil responses were not assumed to occur simultaneously with their associated trial events, but could have non-zero latencies. For example, pupil responses could anticipate predictable trial events. (3) Parameter recovery confirmed the validity of the fitting procedures, and we quantified the reliability of the parameter estimates for our sample dataset. (4) A cognitive task manipulation modulated pupil response amplitude. We provide our pupil analysis pipeline as open-source software (Pupil Response Estimation Toolbox: PRET) to facilitate the estimation of pupil responses and the evaluation of the estimates in other datasets.

Effect of an Educational Intervention on Therapeutic Inertia in Neurologists With Expertise in Multiple Sclerosis: A Randomized Clinical Trial

IMPORTANCE

Therapeutic inertia (TI) is the failure to escalate therapy when treatment goals are unmet and is associated with low tolerance to uncertainty and aversion to ambiguity in physician decision-making. Limited information is available on how physicians handle therapeutic decision-making in the context of uncertainty.

OBJECTIVE

To evaluate whether an educational intervention decreases TI by reducing autonomic arousal response (pupil dilation), a proxy measure of how physicians respond to uncertainty during treatment decisions.

DESIGN, SETTING, AND PARTICIPANTS

In this randomized clinical trial, 34 neurologists with expertise in multiple sclerosis (MS) practicing at 15 outpatient MS clinics in academic and community institutions from across Canada were enrolled. Participants were randomly assigned to receive an educational intervention that facilitates treatment decisions (active group) or to receive no exposure to the intervention (usual care [control group]) from December 2017 to March 2018. Participants listened to 20 audio-recorded simulated case scenarios as pupil responses were assessed by eye trackers. Autonomic arousal was assessed as pupil dilation in periods in which critical information was provided (first period [T1]: clinical data, second period [T2]: neurologic status, and third period [T3]: magnetic resonance imaging data). Data were analyzed from September 2018 to March 2020.

INTERVENTIONS

The traffic light system (TLS)-based educational intervention vs usual care (unexposed). The TLS (use of established associations between traffic light colors and actions to stop or proceed) assists participants in identifying factors associated with worse prognosis in MS care, thereby facilitating the treatment decision-making process by use of established associations between red, green, and yellow colors and risk levels, and actions (treatment decisions).

MAIN OUTCOMES AND MEASURES

Pupil assessment was the primary autonomic outcome. To test the treatment effect of the educational intervention (TLS), difference-in-differences models (also called untreated control group design with pretest and posttest) were used.

RESULTS

Of 38 eligible participants, 34 (89.4%) neurologists completed the study. The mean (SD) age was 44.6 (11.6) years; 38.3% were female and 20 (58.8%) were MS specialists. Therapeutic inertia was present in 50.0% (17 of 34) of all participants and was associated with greater pupil dilation. For every additional SD of pupil dilation, the odds of TI increased by 51% for T1 (odds ratio, 1.51; 95% CI, 1.12-2.03), by 31% for T2 (odds ratio, 1.31; 95% CI, 1.08-1.59), and by 49% for T3 (odds ratio, 1.49; 95% CI, 1.13-1.97). The intervention significantly reduced TI (risk reduction, 31.5%; 95% CI, 16.1%-47.0%). Autonomic arousal responses mediated 29.0% of the effect of the educational intervention on TI.

CONCLUSIONS AND RELEVANCE

In this randomized clinical trial, the TLS intervention decreased TI as measured by pupil dilation, which suggests that individual autonomic arousal is an indicator of how physicians handle uncertainty when making live therapeutic decisions. Pupil response, a biomarker of TI, may eventually be useful in medical education.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT03134794.

Task-related activity in human visual cortex

The brain exhibits widespread endogenous responses in the absence of visual stimuli, even at the earliest stages of visual cortical processing. Such responses have been studied in monkeys using optical imaging with a limited field of view over visual cortex. Here, we used functional MRI (fMRI) in human participants to study the link between arousal and endogenous responses in visual cortex. The response that we observed was tightly entrained to task timing, was spatially extensive, and was independent of visual stimulation. We found that this response follows dynamics similar to that of pupil size and heart rate, suggesting that task-related activity is related to arousal. Finally, we found that higher reward increased response amplitude while decreasing its trial-to-trial variability (i.e., the noise). Computational simulations suggest that increased temporal precision underlies both of these observations. Our findings are consistent with optical imaging studies in monkeys and support the notion that arousal increases precision of neural activity.

The brain exhibits widespread endogenous responses in the absence of visual stimuli, even at the earliest stages of visual cortical processing. This fMRI study characterizes a widespread hemodynamic response in early visual cortex that is not related to visual input but instead reflects a participant’s engagement in a task, is modulated by expected monetary reward, and may reflect neural quenching.

Pupillary Dilations of Mice Performing a Vibrotactile Discrimination Task Reflect Task Engagement and Response Confidence

Pupillometry, the measure of pupil size and reactivity, has been widely used to assess cognitive processes. Changes in pupil size have been shown to correlate with various behavioral states, both externally and internally induced such as locomotion, arousal, cortical state, and decision-making processes. Besides, these pupillary responses have also been linked to the activity of neuromodulatory systems that modulate attention and perception such as the noradrenergic and cholinergic systems. Due to the extent of processes the pupil reflects, we aimed at further resolving pupillary responses in the context of behavioral state and task performance while recording pupillary transients of mice performing a vibrotactile two-alternative forced-choice task (2-AFC). We show that before the presentation of task-relevant information, pre-stimulus, pupil size differentiates between states of disengagement from task performance vs. engagement. Also, when subjects have to attend to task stimuli to attain a reward, post-stimulus, pupillary dilations exhibit a difference between correct and error responses with this difference reflecting an internal decision variable. We hypothesize that this internal decision variable relates to response confidence, the internal perception of the confidence the subject has in its choice. As opposed to this, we show that in a condition of passive performance, when the stimulus has no more task relevance due to reward being provided automatically, pupillary dilations reflect the occurrence of stimulation and reward provision but not decisional variables as under active performance. Our results provide evidence that in addition to reflecting attentiveness under task performance rather than arousal per se, pupil dilations also reflect the confidence of the subject in his ensuing response. This confidence coding is overlaid within a more pronounced pupil dilation that reflects post-decision components that are related to the response itself but not to the decision. We also provide evidence as to how different behavioral states, imposed by task demands, modulate what the pupil is reflecting, presumably showing what the underlying cognitive network is coding for.

Effects of stimulus size, eccentricity, luminance, and attention on pupillary light response examined by concentric stimulus

Previous studies show that the amplitude of pupillary light response (PLR) depends on the corneal flux density (CFD), which is the product of stimulus area by luminance. However, the contribution of CFD has been investigated only when the stimulus was centered on the fovea, whereas perceived luminance to pupillary response would reduce with stimulus eccentricity. Additionally, it has been shown recently that attentional state modulates pupillary response. In this study, we aimed to clarify the complete mechanisms of PLR by manipulating the stimulus size, eccentricity, luminance, and the participants' attentional states. We focused on four indices to examine PLR, that is, pupillary latency (PL), maximum constriction velocity (MCV), maximum constriction (MC), and mean pupil change (MPC). Results showed that PL was a function of CFD, whereas MCV, MC, and MPC were functions of both CFD and stimulus eccentricity. Furthermore, the magnitude of effect due to stimulus eccentricity for MCV and MC was different from that for MPC. These results provided new evidence that the different processing systems in PLR existed.

Decision Making and Oddball Effects on Pupil Size: Evidence for a Sequential Process

In our physical environment as well as in many experimental paradigms, we need to decide whether an occurring stimulus is relevant to us or not; further, stimuli have uneven probabilities to emerge. Both, decision making and the difference between rare and frequent stimuli (oddball effect) are described to affect pupil dilation. Surprisingly though, conjoint systematic pupillometric investigations into both factors are still rare. In two experiments, both factors as well as their interplay were investigated. Participants completed a sequential letter matching task. In this task, stimulus probability and letter matching (decision making) were manipulated independently. As dependent variables, pupil dilation and reaction time were assessed. Results suggest a clearly larger pupil dilation for target than for distractor letters, even when targets were frequent and distractors rare. When considering the data structure best, no main effect of stimulus probability was found, instead, oddball effects only emerged when stimuli were goal-relevant to participants. The results are discussed in the light of common theoretical concepts of decision making and stimulus probability. Finally, relating theories of each factor, we propose an integrated framework for effects of decision making and stimulus features on pupil dilation. We assume a sequential mechanism during which incoming stimuli are decided upon regarding their goal relevance and, about 200 ms later, relevant stimuli are appraised regarding their value.

Indexing brain state-dependent pupil dynamics with simultaneous fMRI and optical fiber calcium recording

Pupillometry, a noninvasive measure of arousal, complements human functional MRI (fMRI) to detect periods of variable cognitive processing and identify networks that relate to particular attentional states. Even under anesthesia, pupil dynamics correlate with brain-state fluctuations, and extended dilations mark the transition to more arousable states. However, cross-scale neuronal activation patterns are seldom linked to brain state-dependent pupil dynamics. Here, we complemented resting-state fMRI in rats with cortical calcium recording (GCaMP-mediated) and pupillometry to tackle the linkage between brain-state changes and neural dynamics across different scales. This multimodal platform allowed us to identify a global brain network that covaried with pupil size, which served to generate an index indicative of the brain-state fluctuation during anesthesia. Besides, a specific correlation pattern was detected in the brainstem, at a location consistent with noradrenergic cell group 5 (A5), which appeared to be dependent on the coupling between different frequencies of cortical activity, possibly further indicating particular brain-state dynamics. The multimodal fMRI combining concurrent calcium recordings and pupillometry enables tracking brain state-dependent pupil dynamics and identifying unique cross-scale neuronal dynamic patterns under anesthesia.

Dissociable mappings of tonic and phasic pupillary features onto cognitive processes involved in mental arithmetic

Pupil size modulations have been used for decades as a window into the mind, and several pupillary features have been implicated in a variety of cognitive processes. Thus, a general challenge facing the field of pupillometry has been understanding which pupil features should be most relevant for explaining behavior in a given task domain. In the present study, a longitudinal design was employed where participants completed 8 biweekly sessions of a classic mental arithmetic task for the purposes of teasing apart the relationships between tonic/phasic pupil features (baseline, peak amplitude, peak latency) and two task-related cognitive processes including mental processing load (indexed by math question difficulty) and decision making (indexed by response times). We used multi-level modeling to account for individual variation while identifying pupil-to-behavior relationships at the single-trial and between-session levels. We show a dissociation between phasic and tonic features with peak amplitude and latency (but not baseline) driven by ongoing task-related processing, whereas baseline was driven by state-level effects that changed over a longer time period (i.e. weeks). Finally, we report a dissociation between peak amplitude and latency whereby amplitude reflected surprise and processing load, and latency reflected decision making times.

Peer Presence Effects on Eye Movements and Attentional Performance

"Social facilitation" refers to the enhancement or impairment of performance engendered by the mere presence of others. It has been demonstrated for a diversity of behaviors. This study assessed whether it also concerns attention and eye movements and if yes, which decision-making mechanisms it affects. Human volunteers were tested in three different tasks (saccades, visual search, and continuous performance) either alone or in the presence of a familiar peer. The results failed to reveal any significant peer influence on the visual search and continuous performance tasks. For saccades, by contrast, they showed a negative or positive peer influence depending on the complexity of the testing protocol. Pro-and anti-saccades were both inhibited when pseudorandomly mixed, and both facilitated when performed separately. Peer presence impaired or improved reaction times, i.e., the speed to initiate the saccade, as well as peak velocity, i.e., the driving force moving the eye toward the target. Effect sizes were large, with Cohen's d-values ranging for reaction times (RTs) from 0.50 to 0.95. Analyzing RT distributions using the LATER (Linear Approach to Threshold with Ergodic Rate) model revealed that social inhibition of pro- and anti-saccades in the complex protocol was associated with a significant increase in the rate of rise. The present demonstration that the simple presence of a familiar peer can inhibit or facilitate saccades depending on task difficulty strengthens a growing body of evidence showing social modulations of eye movements and attention processes. The present lack of effect on visual search and continuous performance tasks contrasts with peer presence effects reported earlier using similar tasks, and future studies are needed to determine whether it is due to an intermediate level of difficulty maximizing individual variability. Together with an earlier study of the social inhibition of anti-saccades also using the LATER model, which showed an increase of the threshold, the present increase of the rate of rise suggests that peer presence can influence both the top-down and bottom-up attention-related processes guiding the decision to move the eyes.

Mechanisms underlying gain modulation in the cortex

Cortical gain regulation allows neurons to respond adaptively to changing inputs. Neural gain is modulated by internal and external influences, including attentional and arousal states, motor activity and neuromodulatory input. These influences converge to a common set of mechanisms for gain modulation, including GABAergic inhibition, synaptically driven fluctuations in membrane potential, changes in cellular conductance and changes in other biophysical neural properties. Recent work has identified GABAergic interneurons as targets of neuromodulatory input and mediators of state-dependent gain modulation. Here, we review the engagement and effects of gain modulation in the cortex. We highlight key recent findings that link phenomenological observations of gain modulation to underlying cellular and circuit-level mechanisms. Finally, we place these cellular and circuit interactions in the larger context of their impact on perception and cognition.

Local cortical desynchronization and pupil-linked arousal differentially shape brain states for optimal sensory performance

Instantaneous brain states have consequences for our sensation, perception, and behaviour. Fluctuations in arousal and neural desynchronization likely pose perceptually relevant states. However, their relationship and their relative impact on perception is unclear. We here show that, at the single-trial level in humans, local desynchronization in sensory cortex (expressed as time-series entropy) versus pupil-linked arousal differentially impact perceptual processing. While we recorded electroencephalography (EEG) and pupillometry data, stimuli of a demanding auditory discrimination task were presented into states of high or low desynchronization of auditory cortex via a real-time closed-loop setup. Desynchronization and arousal distinctly influenced stimulus-evoked activity and shaped behaviour displaying an inverted u-shaped relationship: States of intermediate desynchronization elicited minimal response bias and fastest responses, while states of intermediate arousal gave rise to highest response sensitivity. Our results speak to a model in which independent states of local desynchronization and global arousal jointly optimise sensory processing and performance.

Pupillometric investigation into the speed-accuracy trade-off in a visuo-motor aiming task

Convergent lines of evidence suggest that fluctuations in the size of the pupil may be associated with the trade‐off between the speed (adrenergic, sympathetic) and accuracy (cholinergic, parasympathetic) of behavior across a variety of task contexts. Here, we explored whether pupil size was related to this trade‐off during a visuospatial motor aiming task. Participants were shown visual targets at random locations on a screen and were instructed and incentivized to move a computer mouse‐controlled cursor to the center of the targets, either as fast as possible, as accurately as possible, or to strike a balance between the two. Behavioral results showed that these instructions led to typical speed‐accuracy trade‐off effects on movement reaction times and hit distances to target centers. Pupillometric analyses revealed that movements were faster and less accurate when participants had relatively large baseline pupil sizes, as measured before target onset. Furthermore, trial‐evoked pupil dilation was related specifically to a bias toward speed in the trade‐off and the speed of the ballistic and error‐correction phases of the motor responses such that larger pupils predicted shorter latencies and higher movement speeds. Pupil responses were also associated with performance in a manner that may reflect the combined influence of a number of factors, including the generation of dynamic urgency and an arousal response to negative feedback. Our results generally support a role for pupil‐linked arousal in regulating the trade‐off between speed and accuracy, while also highlighting how the trial‐related pupil response can exhibit multifaceted, temporally discrete associations with behavior.

The eye’s pupil has been considered a “window into the soul” as its dynamics are related to a wide variety of cognitive processes. Here, we present convergent evidence that both slow, prestimulus fluctuations and fast, event‐related changes in pupil diameter are sensitive to a fundamental trade‐off between the speed and accuracy of visuo‐motor actions—an association that holds for both instructed and endogenous variation in this trade‐off. This finding complements a growing literature linking pupil size to adaptive, contextually appropriate changes in behavior.

CHAP: Open-source software for processing and analyzing pupillometry data

Pupil dilation is an effective indicator of cognitive and affective processes. Although several eyetracker systems on the market can provide effective solutions for pupil dilation measurement, there is a lack of tools for processing and analyzing the data provided by these systems. For this reason, we developed CHAP: open-source software written in MATLAB. This software provides a user-friendly graphical user interface for processing and analyzing pupillometry data. Our software creates uniform conventions for the preprocessing and analysis of pupillometry data and provides a quick and easy-to-use tool for researchers interested in pupillometry. To download CHAP or join our mailing list, please visit CHAP's website: http://in.bgu.ac.il/en/Labs/CNL/chap .

Eye pupil signals information gain

In conditions of constant illumination, the eye pupil diameter indexes the modulation of arousal state and responds to a large breadth of cognitive processes, including mental effort, attention, surprise, decision processes, decision biases, value beliefs, uncertainty, volatility, exploitation/exploration trade-off, or learning rate. Here, I propose an information theoretic framework that has the potential to explain the ensemble of these findings as reflecting pupillary response to information processing. In short, updates of the brain’s internal model, quantified formally as the Kullback–Leibler (KL) divergence between prior and posterior beliefs, would be the common denominator to all these instances of pupillary dilation to cognition. I show that stimulus presentation leads to pupillary response that is proportional to the amount of information the stimulus carries about itself and to the quantity of information it provides about other task variables. In the context of decision making, pupil dilation in relation to uncertainty is explained by the wandering of the evidence accumulation process, leading to large summed KL divergences. Finally, pupillary response to mental effort and variations in tonic pupil size are also formalized in terms of information theory. On the basis of this framework, I compare pupillary data from past studies to simple information-theoretic simulations of task designs and show good correspondance with data across studies. The present framework has the potential to unify the large set of results reported on pupillary dilation to cognition and to provide a theory to guide future research.

Choice history biases subsequent evidence accumulation

Perceptual choices depend not only on the current sensory input but also on the behavioral context, such as the history of one's own choices. Yet, it remains unknown how such history signals shape the dynamics of later decision formation. In models of decision formation, it is commonly assumed that choice history shifts the starting point of accumulation toward the bound reflecting the previous choice. We here present results that challenge this idea. We fit bounded-accumulation decision models to human perceptual choice data, and estimated bias parameters that depended on observers' previous choices. Across multiple task protocols and sensory modalities, individual history biases in overt behavior were consistently explained by a history-dependent change in the evidence accumulation, rather than in its starting point. Choice history signals thus seem to bias the interpretation of current sensory input, akin to shifting endogenous attention toward (or away from) the previously selected interpretation.

Evaluating Age-Related Variations of Gaze Behavior for a Novel Digitized-Digit Symbol Substitution Test

Analysis of cognitive functioning from gaze behavior might serve as an early indicator of age related decline of cognitive functions. Standard psychological tests like the digit-symbol substitution test or the symbol-digit modalities test is used exclusively in this regard. In this paper, we have designed and developed a digitized version of the digit symbol substitution test. Three different versions have been designed in order to derive deeper insights of the user behavior. The test-retest validation of the versions reveals good correlation across sessions. Further, the difference in gaze behavior which might be used as an indicator of cognitive functions is tested for two different age groups (13 participants <30 years and 11 participants >40 years). It is seen that the designed digitized version along with the usage of physiological markers like eye tracking bestows additional information and is sensitive to age related factors which might be used for the assessment as well as for the training purpose in rehabilitation systems. Results show that the performance can be analyzed using gaze and pupillometric features in addition to the conventional test performance metrics. We derived an index to measure the performance related to visuo-spatial functioning on one of the designed versions of the test. Results of this index on the number of fixations for two age groups are found to be separated in a statistically significant (p<0.05) manner. The age related difference (p<0.05) is also evident in the pupillometric responses obtained.

Regulation of evidence accumulation by pupil-linked arousal processes

Effective decision-making requires integrating evidence over time. For simple perceptual decisions, previous work suggests that humans and animals can integrate evidence over time, but not optimally. This suboptimality could arise from sources including neuronal noise, weighting evidence unequally over time (that is, the 'integration kernel'), previous trial effects and an overall bias. Here, using an auditory evidence accumulation task in humans, we report that people exhibit all four suboptimalities, some of which covary across the population. Pupillometry shows that only noise and the integration kernel are related to the change in pupil response. Moreover, these two different suboptimalities were related to different aspects of the pupil signal, with the individual differences in pupil response associated with individual differences in the integration kernel, while trial-by-trial fluctuations in pupil response were associated with trial-by-trial fluctuations in noise. These results suggest that different suboptimalities relate to distinct pupil-linked processes, possibly related to tonic and phasic norepinephrine activity.