Listening Effort for Speech in Noise Perception Using Pupil Dilation: A Comparison Among Percussionists, Non-Percussionists, and Non-Musicians

Background and Objectives

Most studies in literature attribute the benefits of musical training on speech in noise (SIN) perception to "experience-based" plasticity, which assists in the activation of speech-processing networks. However, whether musicianship provides an advantage for the listening effort (LE) required to comprehend speech in degraded environments has received less attention. The current study aimed to understand the influence of Indian classical music training on SIN perception and its related LE across percussionists, non-percussionists, and non-musicians.

Subjects and Methods

A quasi-experiment was conducted on 16 percussionists, 17 non-percussionists, and 26 non-musicians aged 18-35 years with normal hearing. In phase 1, musical abilities were assessed using Mini-Profile of Music Perception Skills (Mini-PROMS). Phase 2 examined SIN using Tamil Phonemically-Balanced Words and Tamil Matrix Sentence Test at +5 dB, 0 dB, and -5 dB SNR and LE using pupillometry, measuring pupil dilations with an eye-tracker.

Results

Fractional Logit and Linear Regression models demonstrated that percussionists outperformed non-percussionists in Tuning and Speed subsets of Mini-PROMS. Percussionists outperformed non-percussionists and non-musicians in SIN and LE at -5 dB SNR for words and at 0 dB and -5 dB SNR for sentences.

Conclusions

Percussionists have the greatest advantage in decoding SIN with reduced LE followed by non-percussionists and non-musicians, demonstrating musician-advantage in most challenging listening conditions.

Eye pupil signals life motion perception

The ability to readily detect and recognize biological motion (BM) is fundamental to survival and interpersonal communication. However, perception of BM is strongly disrupted when it is shown upside down. This well-known inversion effect is proposed to be caused by a life motion detection mechanism highly tuned to gravity-compatible motion cues. In the current study, we assessed the inversion effect in BM perception using a no-report pupillometry. We found that the pupil size was significantly enlarged when observers viewed upright BMs (gravity-compatible) compared with the inverted counterparts (gravity-incompatible). Importantly, such an effect critically depended on the dynamic biological characteristics, and could be extended to local feet motion signals. These findings demonstrate that the eye pupil can signal gravity-dependent life motion perception. More importantly, with the convenience, objectivity, and noninvasiveness of pupillometry, the current study paves the way for the potential application of pupillary responses in detecting the deficiency of life motion perception in individuals with socio-cognitive disorders.

Nociception assessment with videopupillometry in deeply sedated intensive care patients: Discriminative and criterion validations

BACKGROUND

Nociceptive assessment in deeply sedated patients is challenging. Validated instruments are lacking for this unresponsive population. Videopupillometry is a promising tool but has not been established in intensive care settings.

AIM/OBJECTIVE

To test the discriminate validity of pupillary dilation reflex (PDR) between non-noxious and noxious procedures for assessing nociception in non-neurological intensive care unit (ICU) patients and to test the criterion validity of pupil dilation using recommended PDR cut-off points to determine nociception.

METHODS

A single-centre prospective observational study was conducted in medical-surgical ICU patients. Two independent investigators performed videopupillometer measurements during a non-noxious and a noxious procedure, once a day (up to 7 days), when the patient remained deeply sedated (Richmond Agitation-Sedation Scale score: -5 or -4). The non-noxious procedures consisted of a gentle touch on each shoulder and the noxious procedures were endotracheal suctioning or turning onto the side. Bivariable and multivariable general linear mixed models were used to account for multiple measurements in same patients. Sensitivity and specificity, and areas under the curve of the receiver operating characteristic curve were calculated.

RESULTS

Sixty patients were included, and 305 sets of 3 measurements (before, during, and after), were performed. PDR was higher during noxious procedures than before (mean difference between noxious and non-noxious procedures = 31.66%). After testing all variables of patient and stimulation characteristics in bivariable models, age and noxious procedures were kept in the multivariable model. Adjusting for age, noxious procedures (coefficient = -15.14 (95% confidence interval = -20.17 to -15.52, p < 0.001) remained the only predictive factor for higher pupil change. Testing recommended cut-offs, a PDR of >12% showed a sensitivity of 65%, and a specificity of 94% for nociception prediction, with an area under the receiver operating curve of 0.828 (95% confidence interval = 0.779-0.877).

CONCLUSIONS

In conclusion, PDR is a potentially appropriate measure to assess nociception in deeply sedated ICU patients, and we suggest considering its utility in daily practices.

REGISTRATION

This study was not preregistered in a clinical registry.

TWEETABLE ABSTRACT

Pupillometry may help clinicians to assess nociception in deeply sedated ICU patients.

The pupil collaboration: A multi-lab, multi-method analysis of goal attribution in infants

The rise of pupillometry in infant research over the last decade is associated with a variety of methods for data preprocessing and analysis. Although pupil diameter is increasingly recognized as an alternative measure of the popular cumulative looking time approach used in many studies (Jackson & Sirois, 2022), an open question is whether the many approaches used to analyse this variable converge. To this end, we proposed a crowdsourced approach to pupillometry analysis. A dataset from 30 9-month-old infants (15 girls; Mage = 282.9 days, SD = 8.10) was provided to 7 distinct teams for analysis. The data were obtained from infants watching video sequences showing a hand, initially resting between two toys, grabbing one of them (after Woodward, 1998). After habituation, infants were shown (in random order) a sequence of four test events that varied target position and target toy. Results show that looking times reflect primarily the familiar path of the hand, regardless of target toy. Gaze data similarly show this familiarity effect of path. The pupil dilation analyses show that features of pupil baseline measures (duration and temporal location) as well as data retention variation (trial and/or participant) due to different inclusion criteria from the various analysis methods are linked to divergences in findings. Two of the seven teams found no significant findings, whereas the remaining five teams differ in the pattern of findings for main and interaction effects. The discussion proposes guidelines for best practice in the analysis of pupillometry data.

Prefrontal transcranial direct current stimulation over the right prefrontal cortex reduces proactive and reactive control performance towards emotional material in healthy individuals

The prefrontal cortex plays a crucial role in cognitive processes, both during anticipatory and reactive modes of cognitive control. Transcranial Direct Current Stimulation (tDCS) can modulate these cognitive resources. However, there is a lack of research exploring the impact of tDCS on emotional material processing in the prefrontal cortex, particularly in regard to proactive and reactive modes of cognitive control. In this study, 35 healthy volunteers underwent both real and sham tDCS applied to the right prefrontal cortex in a counterbalanced order, and then completed the Cued Emotion Control Task (CECT). Pupil dilation, a measure of cognitive resource allocation, and behavioral outcomes, such as reaction time and accuracy, were collected. The results indicate that, as compared to sham stimulation, active right-sided tDCS reduced performance and resource allocation in both proactive and reactive modes of cognitive control. These findings highlight the importance of further research on the effects of tDCS applied to the right prefrontal cortex on cognitive engagement, particularly for clinical trials utilizing the present electrode montage in combination with cognitive interventions.

Evidence that pupil dilation and cardiac afferent signalling differentially impact the processing of emotional intensity and racial bias

Interoceptive cardiac arousal signals (e.g., from baroreceptor firing at ventricular systole compared to diastole) have been found to enhance perception of fearful versus neutral faces. They have also been found to amplify racially biased misidentification of tools as weapons when preceded by facial images of Black versus White individuals. Since pupil size is strongly coupled to arousal, we tested if experimental manipulation of pupil size influences fear processing in emotional judgement and racial bias tasks involving measurement of cardiac signals. In a sample of 22 non-clinical participants in an emotional intensity judgement task, pupil size did not affect emotional intensity ratings. Nor did it interact with differential effects of cardiac systole versus diastole on intensity judgements of fearful and neutral faces, replicated here. In a sample of 25 non-clinical participants in a weapons identification task, larger pupil size resulted in faster response times and lower accuracy when identifying tools and weapons. However, pupil size did not interact with weapon versus tool identification, race of prime, or cardiac timing. We nevertheless replicated the observed increase in racially biased misidentification of tools as weapons following Black face primes presented at cardiac systole. Together our findings indicate that pupil dilation does not directly influence the processing of fear cues or perceived threat (as in racial bias) yet affects task performance by decreasing response times and accuracy. These findings contrast with the established effect of cardiac arousal signals on threat processing and may help focus interventions to mitigate related decision errors in high-pressure occupations.

Eye Movements, Pupil Dilation, and Conflict Detection in Reasoning: Exploring the Evidence for Intuitive Logic

A controversial claim in recent dual process accounts of reasoning is that intuitive processes not only lead to bias but are also sensitive to the logical status of an argument. The intuitive logic hypothesis draws upon evidence that reasoners take longer and are less confident on belief-logic conflict problems, irrespective of whether they give the correct logical response. In this paper, we examine conflict detection under conditions in which participants are asked to either judge the logical validity or believability of a presented conclusion, accompanied by measures of eye movement and pupil dilation. The findings show an effect of conflict, under both types of instruction, on accuracy, latency, gaze shifts, and pupil dilation. Importantly, these effects extend to conflict trials in which participants give a belief-based response (incorrectly under logic instructions or correctly under belief instructions) demonstrating both behavioral and physiological evidence in support of the logical intuition hypothesis.

Behavioral and physiological sensitivity to natural sick faces

The capacity to rapidly detect and avoid sick people may be adaptive. Given that faces are reliably available, as well as rapidly detected and processed, they may provide health information that influences social interaction. Prior studies used faces that were manipulated to appear sick (e.g., editing photos, inducing inflammatory response); however, responses to naturally sick faces remain largely unexplored. We tested whether adults detected subtle cues of genuine, acute, potentially contagious illness in face photos compared to the same individuals when healthy. We tracked illness symptoms and severity with the Sickness Questionnaire and Common Cold Questionnaire. We also checked that sick and healthy photos were matched on low-level features. We found that participants (N = 109) rated sick faces, compared to healthy faces, as sicker, more dangerous, and eliciting more unpleasant feelings. Participants (N = 90) rated sick faces as more likely to be avoided, more tired, and more negative in expression than healthy faces. In a passive-viewing eye-tracking task, participants (N = 50) looked longer at healthy than sick faces, especially the eye region, suggesting people may be more drawn to healthy conspecifics. When making approach-avoidance decisions, participants (N = 112) had greater pupil dilation to sick than healthy faces, and more pupil dilation was associated with greater avoidance, suggesting elevated arousal to threat. Across all experiments, participants' behaviors correlated with the degree of sickness, as reported by the face donors, suggesting a nuanced, fine-tuned sensitivity. Together, these findings suggest that humans may detect subtle threats of contagion from sick faces, which may facilitate illness avoidance. By better understanding how humans naturally avoid illness in conspecifics, we may identify what information is used and ultimately improve public health.

Rapid effects of acute stress on cognitive emotion regulation

Acute stress has been shown to either enhance or impair emotion regulation (ER) performances. Besides sex, strategy use and stimulus intensity, another moderating factor appears to be timing of the ER task relative to stress exposure. Whereas somewhat delayed increases in the stress hormone cortisol have been shown to improve ER performances, rapid sympathetic nervous system (SNS) actions might oppose such effects via cognitive regulatory impairments. Here, we thus investigated rapid effects of acute stress on two ER strategies: reappraisal and distraction. N = 80 healthy participants (40 men & 40 women) were exposed to the Socially Evaluated Cold-Pressor Test or a control condition immediately prior to an ER paradigm which required them to deliberately downregulate emotional responses towards high intensity negative pictures. Subjective ratings and pupil dilation served as ER outcomes measures. Increases in salivary cortisol and cardiovascular activity (index of SNS activation) verified successful induction of acute stress. Unexpectedly, stress reduced subjective emotional arousal when distracting from negative pictures in men indicating regulatory improvements. However, this beneficial effect was particularly pronounced in the second half of the ER paradigm and fully mediated by already rising cortisol levels. In contrast, cardiovascular responses to stress were linked to decreased subjective regulatory performances of reappraisal and distraction in women. However, no detrimental effects of stress on ER occurred at the group level. Yet, our findings provide initial evidence for rapid, opposing effects of the two stress systems on the cognitive control of negative emotions that are critically moderated by sex.

Short bursts of transcutaneous auricular vagus nerve stimulation enhance evoked pupil dilation as a function of stimulation parameters

Transcutaneous auricular vagus nerve stimulation (taVNS) is a neurostimulatory technique hypothesised to enhance central noradrenaline. Currently, there is scarce evidence in support of a noradrenergic mechanism of taVNS and limited knowledge on its stimulation parameters (i.e., intensity and pulse width). Therefore, the present study aimed to test whether taVNS enhances pupil dilation, a noradrenergic biomarker, as a function of stimulation parameters. Forty-nine participants received sham (i.e., left ear earlobe) and taVNS (i.e., left ear cymba concha) stimulation in two separate sessions, in a counterbalanced order. We administered short bursts (5s) of seven stimulation settings varying as a function of pulse width and intensity and measured pupil size in parallel. Each stimulation setting was administered sixteen times in separate blocks. We expected short bursts of stimulation to elicit phasic noradrenergic activity as indexed by event-related pupil dilation and event-related temporal derivative. We hypothesised higher stimulation settings, quantified as the total charge per pulse (pulse width x intensity), to drive greater event-related pupil dilation and temporal derivative in the taVNS compared to sham condition. Specifically, we expected stimulation settings in the taVNS condition to be associated with a linear increase in event-related pupil dilation and temporal derivative. We found stimulation settings to linearly increase both pupil measures. In line with our hypothesis, the observed dose-dependent effect was stronger in the taVNS condition. We also found taVNS to elicit more intense and unpleasant sensations than sham stimulation. These results support the hypothesis of a noradrenergic mechanism of taVNS. However, future studies should disentangle whether stimulation elicited sensations mediate the effect of taVNS on evoked pupil dilation.

Is Categorization in Visual Working Memory a Way to Reduce Mental Effort? A Pupillometry Study

Recent studies on visual working memory (VWM) have shown that visual information can be stored in VWM as continuous (e.g., a specific shade of red) as well as categorical representations (e.g., the general category red). It has been widely assumed, yet never directly tested, that continuous representations require more VWM mental effort than categorical representations; given limited VWM capacity, this would mean that fewer continuous, as compared to categorical, representations can be maintained simultaneously. We tested this assumption by measuring pupil size, as a proxy for mental effort, in a delayed estimation task. Participants memorized one to four ambiguous (boundaries between adjacent color categories) or prototypical colors to encourage continuous or categorical representations, respectively; after a delay, a probe indicated the location of the to‐be‐reported color. We found that, for memory load 1, pupil size was larger while maintaining ambiguous as compared to prototypical colors, but without any difference in memory precision; this suggests that participants relied on an effortful continuous representation to maintain a single ambiguous color, thus resulting in pupil dilation while preserving precision. Strikingly, this effect gradually inverted, such that for memory load 4, pupil size was smaller while maintaining ambiguous and prototypical colors, but memory precision was now substantially reduced for ambiguous colors; this suggests that with increased memory load participants increasingly relied on categorical representations for ambiguous colors (which are by definition a poor fit to any category). Taken together, our results suggest that continuous representations are more effortful than categorical representations and that very few continuous representations (perhaps only one) can be maintained simultaneously.

Need for cognition is associated with the interaction of reward and task-load on effort: A verification and extension study

Here, we work to provide nuance around the assumption that people will work for rewards. We examine whether individuals' inherent tendency to mobilize cognitive effort (need for cognition, NFC) moderates this effect. We re-analyzed our existing data to verify an effect reported by Sandra and Otto (2018) regarding the association between NFC and reward-induced cognitive effort expenditure, using a more ecological cognitive task design and adding a psychophysiological measure of effort. Specifically, distinct from their short time course visual task-switching paradigm, we used a relatively long course auditory comprehension task paradigm. We found that, consistent with the original study, increased cognitive effort in response to incentive reward depends on individual differences in cognitive motivation (need for cognition). We also found that, to observe consistent phenomena, different indices of effort (behavioral and psychophysiological) need to be considered when evaluating the relationship between the effort expenditure and cognitive motivation. Pupil dilation showed an advantage over reaction time in revealing mental effort mobilized over a prolonged cognitive task. Our results suggest that assessing cognitive motivation when planning a behavior-change program involving reward feedback for positive performance could help to optimize individuals' effort investment.

Individual differences in pupil dilation to others' emotional and neutral eyes with varying pupil sizes

Sensitivity to others' emotional signals is an important factor for social interaction. While many studies of emotional reactivity focus on facial emotional expressions, signals such as pupil dilation which can indicate arousal, may also affect observers. For example, observers' pupils dilate when viewing someone with dilated pupils, so-called pupillary contagion. Yet it is unclear how pupil size and emotional expression interact as signals. Further, examining individual differences in emotional reactivity to others can shed light on its mechanisms and potential outcomes. In the current study, adults' (N = 453) pupil size was assessed while they viewed images of the eye region of individuals varying in emotional expression (neutral, happy, sad, fearful, angry) and pupil size (large, medium, small). Participants showed pupillary contagion regardless of the emotional expression. Individual differences in demographics (gender, age, socioeconomic status) and psychosocial factors (anxiety, depression, sleep problems) were also examined, yet the only factor related to pupillary contagion was socioeconomic status, with higher socioeconomic status predicting less pupillary contagion for emotionally-neutral stimuli. The results suggest that while pupillary contagion is a robust phenomenon, it can vary meaningfully across individuals.

Pupil dilation predicts modulation of direct gaze on action value calculations

Perceiving direct gaze facilitates social cognition and behaviour. We hypothesized that direct gaze modulates decision-making, particularly calculations of action values. To test our hypothesis, we used the reinforcement learning paradigm in situations with or without direct gaze. Forty adults were recruited and participated in pupil size measurements and a two-armed bandit task. The task was conducted with 70% and 30% reward probabilities for each option. During the task, a female showing the Direct Gaze (DG) or Closed Eyes (CE) condition was presented from the start of each trial. The results showed that behavioural bias to choices with 70% reward probability increased more in the DG condition than in the CE condition and the expected reward value. This bias to choices with 70% reward in the DG condition was predicted by pupil dilation to DG. These results suggest that participants over-evaluated the expected reward value in the DG condition, and this DG effect may be related to subjective expectations of rewarding events indexed by pupil dilations. It is considered that perceiving direct gaze is a driver of reward expectations that modulate action value calculations and then cognitive processing and behaviours are facilitated.

[Technical and optical aspects of smartphone-based fundus photography : Possibilities and limitations in practice]

BACKGROUND

Smartphone-based adapters for fundus photography offer a cost-effective alternative to traditional fundus cameras. The various offers vary widely in design, size, purchasing costs, user-friendliness, and image quality when compared to each other and to traditional fundus cameras.

OBJECTIVE

The aim is to enable the reader to understand the technical and optical aspects of fundus photography and therefore to evaluate the various offers of traditional fundus cameras and adaptors for smartphone-based fundus photography with respect to their personal requirements.

MATERIAL AND METHODS

The technical and optical principles and aspects of fundus photography are explained and the various approaches to illumination, imaging, image capture and alignment are discussed. The association between field of view, pupil size, mydriasis and image quality are discussed as well as the challenges and difficulties of aligning the fundus camera relative to the patient's eye.

RESULTS

The most important technical aspects of a fundus camera are the avoidance of disturbing reflections when taking photographs, an acceptable field of view angle, the user-friendliness during alignment, success rate of imaging and the question whether mydriasis is necessary.

CONCLUSION

The development of adapters for smartphone-based fundus photography has resulted in interesting offers, which make fundus photography available to a wider user spectrum at low purchase costs. The offers on the market vary widely. It is therefore difficult to reach a definitive evaluation; however, smartphone-based adapters mostly have limitations with respect to user-friendliness, the size of the field of view and image quality.

Measurement of Sexual Interests with Pupillary Responses: A Meta-Analysis

Objective measures of sexual interest are important for research on human sexuality. There has been a resurgence in research examining pupil dilation as a potential index of sexual orientation. We carried out a meta-analytic review of studies published between 1965 and 2020 (Mdn year = 2016) measuring pupil responses to visual stimuli of adult men and women to assess sexual interest. Separate meta-analyses were performed for six sexual orientation categories. In the final analysis, 15 studies were included for heterosexual men (N = 550), 5 studies for gay men (N = 65), 4 studies for bisexual men (N = 124), 13 studies for heterosexual women (N = 403), and 3 studies for lesbian women (N = 132). Only heterosexual and gay men demonstrated discrimination in pupillary responses that was clearly in line with their sexual orientation, with greater pupil dilation to female and male stimuli, respectively. Bisexual men showed greater pupil dilation to male stimuli. Although heterosexual women exhibited larger pupils to male stimuli compared to female stimuli, the magnitude of the effect was small and non-significant. Finally, lesbian women displayed greater pupil dilation to male stimuli. Three methodological moderators were identified-the sexual explicitness of stimulus materials, the measurement technique of pupillary response, and inclusion of self-report measures of sexual interest. These meta-analyses are based on a limited number of studies and are therefore preliminary. However, the results suggest that pupillary measurement of sexual interest is promising for men and that standardization is essential to gain a better understanding of the validity of this measurement technique for sexual interest.

Conscious awareness of motor fluidity improves performance and decreases cognitive effort in sequence learning

Motor skill learning is improved when participants are instructed to judge after each trial whether their performed movements have reached maximal fluidity. Consequently, the conscious awareness of this maximal fluidity can be classified as a genuine learning factor for motor sequences. However, it is unknown whether this effect of conscious awareness on motor learning could be mediated by the increased cognitive effort that may accompany such judgment making. The main aim of this study was to test this hypothesis in comparing two groups with, and without, the conscious awareness of the maximal fluidity. To assess the possible involvement of cognitive effort, we have recorded the pupillary dilation to the task, which is well-known to increase in proportion to cognitive effort. Results confirmed that conscious awareness indeed improved motor sequence learning of the trained sequence specifically. Pupil dilation was smaller during trained than during novel sequence performance, indicating that sequence learning decreased the cognitive cost of sequence execution. However, we found that in the group that had to judge on their maximal fluidity, pupil dilation during sequence production was smaller than in the control group, indicating that the motor improvement induced by the fluidity judgment does not involve additional cognitive effort. We discuss these results in the context of motor learning and cognitive effort theories.

A systematic review and meta-analysis

The use of pupillometry to track emotional learning processes in humans is generating an increasing interest. Here, we provide a first systematic review and meta-analysis on the value of pupil dilation as a marker of Pavlovian conditioning, focusing on the roles of UCS valence (aversive vs. appetitive), the time course across trials and response intervals within trials. Based on data from 39 independent samples (total n = 1303), our results revealed strong evidence for the overall validity of conditioned pupil responses, with a trend for larger effects in aversive (average g = 0.73) vs. appetitive conditioning (g = 0.39). Response differentiation increased over the course of acquisition. Substantial differentiation effects were found in both early and late response windows. Moderator analyses revealed a consistent influence of UCS modality on differential conditioning, while evidence for moderation by contingency instructions and length of acquisition phase was mixed. The results highlight pupil dilation as a sensitive and reliable index of Pavlovian conditioning across valence categories and stimulus modalities. Important implications regarding methodological considerations and research goals are discussed.

Direct voluntary control of pupil constriction and dilation: Exploratory evidence from pupillometry, optometry, skin conductance, perception, and functional MRI

We present a single case who can change pupil size on command with dilation of pupil diameter of around 0.8 mm, and constriction of around 2.4 mm. Using modern pupillometric and optometric techniques in combination with measuring electrodermal activity, various indirect mechanisms possibly mediating this phenomenon were tested: accommodation, brightness, increases in arousal by increased mental effort. None of these behavioral tests could support an indirect strategy as the mode of action, although it seems plausible that the case could have learned to gain control over the pupillary response by decoupling pupil size changes from accommodation and vergence in the near triad: Even at maximal accommodation, the case voluntarily constricted his pupil without changing vergence and could improve visual acuity by >6 diopters. Using task-based functional magnetic resonance imaging we found involvement of brain regions generating and mediating volitional impulses. Changes of the left pupil size were associated with increased activation of parts of the left dorsolateral prefrontal cortex, adjacent premotor areas, and supplementary motor area. It still remains open where these neural signals enter the final pathway, either innervating the pupil's dilator directly, or more indirectly by inhibiting the parasympathetically innervated antagonistic sphincter, and vice versa for constriction. To conclude, so far none of potential - conscious or unconscious - indirect strategies, may it be accommodative or vergence efforts or mental efforts and imaginations, could be observed or inferred to be fully responsible, suggesting direct voluntary control of pupil size in the present case.

Differences in cognitive processing? The role of verbal processes and mental effort in bilingual and monolingual children's planning performance

Past research documents a bilingual advantage in the domain of executive functions (EFs). However, controversial debates have questioned the robustness of those behavioral differences. The current study aimed to better understand the underlying cognitive prerequisites in bilingual students as compared with monolingual students and focused on two processes: the role of verbal processes, on the one hand, and mental effort during task execution, on the other. The use of self-regulatory speech has been found to be related to performance in tasks requiring EFs. For bilinguals who have grown up with two language systems from an early age, those relations are not fully understood. Furthermore, results from neuroimaging studies have shown that bilinguals might exhibit less mental effort in EF tasks. We investigated both processes in German-speaking monolingual elementary school students (n = 33; M_age = 8.78 years) and German-Russian bilingual elementary school students (n = 34; M_age = 8.88 years) solving a planning task. Results showed that monolinguals were impaired by a verbal secondary task in comparison with a motor control condition, whereas bilinguals performed in both tasks at an equal level, indicating a differential role of self-regulatory speech in both language groups. Analyses of changes in pupil diameter revealed less mental effort during task execution for bilingual children as compared with monolingual children. The current study adds to the existing literature by supplying further evidence for cognitive differences between monolingual and bilingual children.

The eyes of the past: larger pupil size for autobiographical memories retrieved from field perspective

BACKGROUND

Visual perspective during memory retrieval has mainly been evaluated with methodologies based on introspection and subjective reports. The current study investigates whether visual perspective can be evaluated with a physiological measurement: pupil dilation.

METHODS

While their pupil diameter was measured with an eye-tracker, forty-five participants retrieved one memory from a field perspective (i.e., as viewed through our own eyes) and one memory from an observer perspective (i.e., as viewed from a spectator's standpoint). After retrieval, participants rated the emotional intensity of the memories.

RESULTS

Analysis demonstrated larger pupils during the retrieval of memories from a field perspective and higher emotional intensity for memories retrieved from a field perspective.

DISCUSSION

The larger pupils for memories recalled from a field perspective could, however, not be attributed to their higher emotional intensity. These findings suggest that pupil dilation could be used as a physiological assessment of visual perspective during memory retrieval.

Replicating five pupillometry studies of Eckhard Hess

Several papers by Eckhard Hess from the 1960s and 1970s report that the pupils dilate or constrict according to the interest value, arousing content, or mental demands of visual stimuli. However, Hess mostly used small sample sizes and undocumented luminance control. In a first experiment (N = 182) and a second preregistered experiment (N = 147), we replicated five studies of Hess using modern equipment. Our experiments (1) did not support the hypothesis of gender differences in pupil diameter change with respect to baseline (PC) when viewing stimuli of different interest value, (2) showed that solving more difficult multiplications yields a larger PC in the seconds before providing an answer and a larger maximum PC, but a smaller PC at a fixed time after the onset of the multiplication, (3) did not support the hypothesis that participants' PC mimics the pupil diameter in a pair of schematic eyes but not in single-eyed or three-eyed stimuli, (4) did not support the hypothesis of gender differences in PC when watching a video of a male trying to escape a mob, and (5) supported the hypothesis that arousing words yield a higher PC than non-arousing words. Although we did not observe consistent gender differences in PC, additional analyses showed gender differences in eye movements towards erogenous zones. Furthermore, PC strongly correlated with the luminance of the locations where participants looked. Overall, our replications confirm Hess's findings that pupils dilate in response to mental demands and stimuli of an arousing nature. Hess's hypotheses regarding pupil mimicry and gender differences in pupil dilation did not replicate.

Delayed effects of acute stress on cognitive emotion regulation

Acute stress has been shown to modulate cognitive emotion regulation. Besides interactions with strategy use or sex, another critical modulating factor appears to be stress timing. Exposure to acute stress initiates immediate and delayed glucocorticoid effects on cognitive control functions. Previous studies indicated a delayed increase in prefrontal activity after stress and cortisol elevations, which might also improve the ability to cognitively regulate emotions when the acute stress state has subsided. In this study, we investigated the delayed impact of acute stress on the two emotion regulation strategies reappraisal and distraction. Eighty-one healthy males and free-cycling females were exposed to the Trier Social Stress Test or a control condition 90 min before they were tested in an emotion regulation paradigm, which required them to up- and downregulate their emotional responses towards negative pictures. Affective ratings served to measure emotion regulation success, whereas pupil dilation was included to additionally assess the cognitive effort required to deliberately regulate emotions. Stress affected neither arousal, valence or success ratings nor pupil dilation. However, cortisol increases were significantly associated with reduced arousal and enhanced valence ratings when regulating negative emotions via distraction. Exploratory mediation analyses revealed an indirect effect of stress on arousal and valence ratings for distraction that was mediated by cortisol increase. Our findings thereby provide further evidence that cortisol is positively related to emotion regulation success, which might be driven by a glucocorticoid-mediated mechanism facilitating attentional shifting.

Children understand communication intuitively, but indirect communication makes them think twice-Evidence from pupillometry and looking patterns

Interpreting a speaker's communicative acts is a challenge children face permanently in everyday life. In doing so, they seem to understand direct communicative acts more easily than indirect communicative acts. The current study investigated which step in the processing of communicative acts might cause difficulties in understanding indirect communication. To assess the developmental trajectory of this phenomenon, we tested 3- and 5-year-old children (N = 105) using eye tracking and an object-choice task. The children watched videos that showed puppets during their everyday activities (e.g., pet care). For every activity, the puppets were asked which of two objects (e.g., rabbit or dog) they would rather have. The puppets responded either directly (e.g., "I want the rabbit") or indirectly (e.g., "I have a carrot"). Results showed that children chose the object intended by the puppets more often in the direct communication condition than in the indirect communication condition and that 5-year-olds chose correctly more than 3-year-olds. However, even though we found that children's pupil size increased while hearing the utterances, we found no effect for communication type before children had already decided on the correct object during object selection by looking at it. Only after this point-that is, only in children's further fixation patterns and reaction times-did differences for communication type occur. Thus, although children's object-choice performance suggests that indirect communication is harder to understand than direct communication, the cognitive demands during processing of both communication types seem similar. We discuss theoretical implications of these findings for developmental pragmatics in terms of a dual-process account of communication comprehension.

Encoding-linked pupil response is modulated by expected and unexpected novelty: Implications for memory formation and neurotransmission

Whether a novel stimulus is expected or unexpected may have implications for the kind of ensuing encoding and the type of subsequent memory. Pupil response was used in the present study to explore the way expected and unexpected stimuli are encoded and whether encoding-linked pupil response is modulated by expectation. Participants first established a contingency relationship between a series of symbols and the type of stimulus (man-made or natural) that followed each one. At encoding, some of the target stimuli violated the previously established relationship (i.e., unexpected), while the majority conformed to this relationship (i.e., expected). Expectation at encoding had opposite effects on familiarity and recollection, the two types of memory that support recognition, and modulated differently the way pupil response predicted subsequent memory. Encoding of unexpected novel stimuli was associated with increased pupil dilation as a predictor of subsequent memory type and strength. In contrast, encoding of expected novel stimuli was associated with decreased pupil response (constriction), which was predictive of subsequent memory type and strength. The findings support the close link between pupil response and memory formation, but critically indicate that this is modulated by the type of novelty as defined by expectation. These novel findings have important implications for the encoding mechanisms involved when different types of novelty are detected and is proposed to indicate the operation of different neurotransmitters during memory formation.

Is accommodation a confounder in pupillometry research?

Much psychological research uses pupil diameter measurements to investigate the cognitive and emotional effects of visual stimuli. A potential problem is that accommodating at a nearby point causes the pupil to constrict. This study examined to what extent accommodation is a confounder in pupillometry research. Participants solved multiplication problems at different distances (Experiment 1) and looked at line drawings with different monocular depth cues (Experiment 2) while their pupil diameter, refraction, and vergence angle were recorded using a photorefractor. Experiment 1 showed that the pupils dilated while performing the multiplications, for all presentation distances. Pupillary constriction due to accommodation was not strong enough to override pupil dilation due to cognitive load. Experiment 2 showed that monocular depth cues caused a small shift in refraction in the expected direction. We conclude that, for the young student sample we used, pupil diameter measurements are not substantially affected by accommodation.

Pupil dilation during orienting of attention and conscious detection of visual targets in patients with left spatial neglect

Right Brain-Damaged patients (RBD) with left spatial neglect (N+), are characterised by deficits in orienting and re-orienting attention to stimuli in the contralesional left side of space. In a recent ERPs study with visual stimuli (Lasaponara et al., 2018) we have pointed out that the pathological attentional bias of N+ is matched with exaggerated novelty reaction and contextual updating of targets in the right ipsilesional space and reduced novelty reaction and contextual updating of targets in the left contralesional space. To characterise further the attentional performance of N+, here we measured Pupil Dilation (PDil), which is a reliable marker of noradrenergic-locus coeruleus activity and response to unexpected events/rewards. Compared to Neutral and Valid targets, N+ patients displayed a pathological reduction of PDil in response to infrequent Invalid targets in the left side of space, while in Healthy Controls (HC) and RBD without neglect (N-) the same targets enhanced PDil with respect to Neutral and frequent Valid targets. Invalid targets in the right side of space enhanced PDil in all experimental groups. Interestingly, both N- and N+ showed a consistent number of target omissions both in the left and right side of space. With respect to seen targets, N- showed reduced PDil in response to unseen targets both in the left and right side of space. In contrast, N+ had reduced PDil in response to unseen targets in the left side of space though not in the right side, where seen and unseen targets evoked comparable levels of PDil. These results disclose, for the first time, the PDil correlates of spatial attention in left spatial neglect and suggest that the pathological attentional bias suffered by N+ might enhance the autonomic responses reflected in PDil to unseen ipsilesional stimuli. This enhancement can contribute to biasing contextual updating and predictive coding of stimuli in the ipsilesional space, thus worsening the pathological attentional bias of N+.

Response time and eye tracking datasets for activities demanding varying cognitive load

The dataset contains the following three measures that are widely used to determine cognitive load in humans: Detection Response Task - response time, pupil diameter, and eye gaze. These measures were recorded from 28 participants while they underwent tasks that are designed to permeate three different cognitive difficulty levels. The dataset will be useful to those researchers who seek to employ low cost, non-invasive sensors to detect cognitive load in humans and to develop algorithms for human-system automation. One such application is found in Advanced Driver Assistance Systems where eye-trackers are employed to monitor the alertness of the drivers. The dataset would also be helpful to researchers who are interested in employing machine learning algorithms to develop predictive models of humans for applications in human-machine system automation. The data is collected by the authors at the Department of Electrical & Computer Engineering in collaboration with the Faculty of Human Kinetics at the University of Windsor under the guidance of their Research Ethics Board.

Using eye-tracking and EEG to study the mental processing demands during learning of text-picture combinations

Using and combining eye-tracking and EEG frequency band power as process measures, in the current study we were interested in the mental processing demands during learning of text-picture combinations that either enabled or prohibited text-picture integration (TPI). In the mismatch condition, the textual and pictorial information being dissimilar, TPI was not possible, whereas in the match and the partial-match condition, the textual and pictorial information being identical respective complementary, TPI was possible. We expected mental processing demands to be higher in the mismatch condition, when pictorial and textual information had to be processed and memorized as separate representations, compared to the match and partial-match conditions when TPI was possible. As expected, on virtually all process measures we observed increased mental processing demands when two mental representations had to be processed and memorized compared to the two conditions where TPI was possible. The EEG alpha and theta frequency band power data corroborated and extended the eye-tracking measures of mental processing demands. In addition, we performed a fixation-related EEG frequency band power analysis that also corroborated the results of the classic stimulus-locked EEG frequency band power analysis, exemplifying the use of this former methodology in the context of complex multimedia task materials.

Influence of pupil dilation on the Barrett universal II (new generation), Haigis (4th generation), and SRK/T (3rd generation) intraocular lens calculation formulas: a retrospective study

BACKGROUND

Despite the surge in the number of cataract surgeries, there is limited information available regarding the influence of pupil dilation on predicted postoperative refraction and its comparison with recommended various intraocular lens power calculated using the different parameters. We used three different IOL power calculation formulas: Barrett Universal II (Barrett) (5-variable formula), Haigis (3-variable formula), and SRK/T (2-variable formula), in order to investigate the potential effect of pupil dilation on the predicted postoperative refraction (PPR) and recommended intraocular lens (IOL) power calculation.

METHODS

This retrospective study included 150 eyes. All variables were measured and calculated using a ZEISS IOL Master 700. The following variables were measured before and after dilation: anterior chamber depth (ACD), lens thickness (LT), white-to-white (WTW). PPR and recommended IOL power were calculated by Barrett, Haigis, and SRK/T IOL calculation formulas. The change in each variable before and after dilation, and the correlations between all changes were analyzed using the Wilcoxon signed-rank test and the Spearman's rank-order correlation test, respectively.

RESULTS

The mean absolute change (MAC) in PPR before and after dilation was found to be highest in the Barrett formula. Significant differences were found between each MAC (P <  0.0001). Significant changes were observed before and after dilation in ACD and LT (P <  0.0001), but not in WTW. Using the Barrett and Haigis formulas, there was a significant positive correlation between the change in PPR and change in ACD (P <  0.0001), and a negative correlation between change in PPR and change in LT (P <  0.0001). The correlations were strongest with the Barret formula followed by the Haigis, particularly in terms of LT. Changes in PPR determined by the Barrett formula also demonstrated a significant positive correlation with changes in WTW (P = 0.022). The recommended IOL power determined using Barrett and Haigis changed before and after dilation in 23.3 and 19.3% cases respectively, while SRK/T showed no change.

CONCLUSIONS

In terms of PPR and recommended IOL power, pupil dilation influenced mostly the Barrett formula. Given the stronger correlation between the changes in PPR when using Barrett and the changes in ACD, LT, and WTW, changes in ACD, LT, and WTW significantly affect how dilation influences the Barrett formula. Determining how dilation influences each formula and other variables is key to improving the accuracy of IOL calculations.

Pupil dilation as an indicator of future thinking

BACKGROUND

The pupil typically dilates in reaction to cognitive load. In this study, we, for the first time, investigated whether future thinking (i.e., the ability to generate hypothetical scenarios in the future) would result in pupil dilation.

METHODS

We recorded pupil dilation of participants during two conditions: past and future thinking. In past thinking, we invited participants to retrieve past personal events, while in future thinking, we invited them to imagine an event that may occur in the future.

RESULTS

Analysis demonstrated a larger pupil size during future than past thinking. Results also demonstrated longer retrieval time of future events compared with past ones, suggesting that future thinking perhaps requires more cognitive load than for past thinking. Interestingly, retrieval times during past and future thinking were positively correlated with pupil size.

DISCUSSION

The finding that future thinking activates pupil dilation could be due to the fact that while both past and future thinking require retrieving information from memory, future, but not past, thinking additionally requires the ability to recombine this information into novel scenarios.

Decision Making and Oddball Effects on Pupil Size: Evidence for a Sequential Process

In our physical environment as well as in many experimental paradigms, we need to decide whether an occurring stimulus is relevant to us or not; further, stimuli have uneven probabilities to emerge. Both, decision making and the difference between rare and frequent stimuli (oddball effect) are described to affect pupil dilation. Surprisingly though, conjoint systematic pupillometric investigations into both factors are still rare. In two experiments, both factors as well as their interplay were investigated. Participants completed a sequential letter matching task. In this task, stimulus probability and letter matching (decision making) were manipulated independently. As dependent variables, pupil dilation and reaction time were assessed. Results suggest a clearly larger pupil dilation for target than for distractor letters, even when targets were frequent and distractors rare. When considering the data structure best, no main effect of stimulus probability was found, instead, oddball effects only emerged when stimuli were goal-relevant to participants. The results are discussed in the light of common theoretical concepts of decision making and stimulus probability. Finally, relating theories of each factor, we propose an integrated framework for effects of decision making and stimulus features on pupil dilation. We assume a sequential mechanism during which incoming stimuli are decided upon regarding their goal relevance and, about 200 ms later, relevant stimuli are appraised regarding their value.

Age-related changes in the functional integrity of the phasic alerting system: a pupillometric investigation

Enhanced processing following a warning cue is thought to be mediated by a phasic alerting response involving the locus coeruleus-noradrenergic (LC-NA) system. We examined the effect of aging on phasic alerting using pupil dilation as a marker of LC-NA activity in conjunction with a novel assessment of task-evoked pupil dilation. While both young and older adults displayed behavioral and pupillary alerting effects, reflected in decreased RT and increased pupillary response under high (tone) versus low (no tone) alerting conditions, older adults displayed a weaker pupillary response that benefited more from the alerting tone. The strong association between dilation and speed displayed by older adults in both alerting conditions was reduced in young adults in the high alerting condition, suggesting that in young (but not older) adults the tone conferred relatively little behavioral benefit beyond that provided by the alerting effect elicited by the target. These findings suggest a functioning but deficient LC-NA alerting system in older adults, and help reconcile previous results concerning the effects of aging on phasic alerting.

Focusing attention on biological markers of acute stressor intensity: Empirical evidence and limitations

ARMARIO, A, J. Labad and R. Nadal. Focusing attention on biological markers of acute stressor intensity: empirical evidence and limitations. NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS. The availability of biological markers that objectively quantify stress is a highly relevant issue. However, experimental evidence suggests that most physiological changes elicited by emotional stressors do not reflect their intensity and are not useful for this purpose. Thus, we review experimental evidence in animals and humans about the putative validity of neuroendocrine and sympathetic/parasympathetic variables to measure stress. Plasma levels of some hormones (e.g. ACTH, glucocorticoids, prolactin and catecholamines) have been found to reflect, at least under certain conditions, the intensity of emotional stressors in animals and probably in humans. However, the temporal resolution of hormone changes is insufficient to reflect the very dynamic psychological processes taking place while experiencing stressors. Cardiovascular parameters (e.g. heart rate and blood pressure) have much better temporal resolution but their validity as markers of stressor intensity either in animals or humans is problematic. Skin conductance and pupil dilation appear to be promising. Additional and more systematic studies are needed to demonstrate the actual validity of stress-induced physiological changes to quantify stress.

Can auditory warning signals normalize eye movements in children with ADHD?

Attenuated baseline arousal has been hypothesized to underlie symptoms of attention deficit/hyperactivity disorder (ADHD). A behavioral signature of reduced baseline arousal is an increased beneficiary effect of warning signals in reaction tasks. This paradoxical effect is believed to be caused by a temporary increase in arousal induced by warning signals. In a preregistered study, we tested the hypothesis that children with high levels of ADHD symptoms would be hyperresponsive to warning signals in a well-established visual attention task (the gap/overlap paradigm). Previous studies using this task have found slower and more variable saccadic reaction times in children with ADHD compared to typically developing children, suggesting that these eye movement metrics are candidate biomarkers. We examined 71 children, of which 1/3 had a diagnosis of ADHD, using both dimensional analyses and group comparisons. Previously reported findings of reduced saccadic latency and increased latency variability were replicated. Importantly, saccadic latency was normalized by auditory warning signals. Analyses of pupil dilation, a physiological index of arousal and locus coeruleus-noradrenergic activity, confirmed that warning signals led to enhanced arousal. Our findings are novel and contribute to our understanding of arousal and attention in ADHD and have implications for treatment and interventions.

Pupillometric decoding of high-level musical imagery

Humans report imagining sound where no physical sound is present: we replay conversations, practice speeches, and "hear" music all within the confines of our minds. Research has identified neural substrates underlying auditory imagery; yet deciphering its explicit contents has been elusive. Here we present a novel pupillometric method for decoding what individuals hear "inside their heads". Independent of light, pupils dilate and constrict in response to noradrenergic activity. Hence, stimuli evoking unique and reliable patterns of attention and arousal even when imagined should concurrently produce identifiable patterns of pupil-size dynamics (PSDs). Participants listened to and then silently imagined music while eye-tracked. Using machine learning algorithms, we decoded the imagined songs within- and across-participants following classifier-training on PSDs collected during both imagination and perception. Echoing findings in vision, cross-domain decoding accuracy increased with imagery strength. These data suggest that light-independent PSDs are a neural signature sensitive enough to decode imagination.

How alliteration enhances conceptual-attentional interactions in reading

In linguistics, the relationship between phonological word form and meaning is mostly considered arbitrary. Why, then, do literary authors traditionally craft sound relationships between words? We set out to characterise how dynamic interactions between word form and meaning may account for this literary practice. Here, we show that alliteration influences both meaning integration and attentional engagement during reading. We presented participants with adjective-noun phrases, having manipulated semantic relatedness (congruent, incongruent) and form repetition (alliterating, non-alliterating) orthogonally, as in "dazzling-diamond"; "sparkling-diamond"; "dangerous-diamond"; and "creepy-diamond". Using simultaneous recording of event-related brain potentials and pupil dilation (PD), we establish that, whilst semantic incongruency increased N400 amplitude as expected, it reduced PD, an index of attentional engagement. Second, alliteration affected semantic evaluation of word pairs, since it reduced N400 amplitude even in the case of unrelated items (e.g., "dangerous-diamond"). Third, alliteration specifically boosted attentional engagement for related words (e.g., "dazzling-diamond"), as shown by a sustained negative correlation between N400 amplitudes and PD change after the window of lexical integration. Thus, alliteration strategically arouses attention during reading and when comprehension is challenged, phonological information helps readers link concepts beyond the level of literal semantics. Overall, our findings provide a tentative mechanism for the empowering effect of sound repetition in literary constructs.

Does goal congruence dilate the pupil over and above goal relevance?

To better understand the mechanisms underlying preferential processing of affective stimuli (i.e., affective attention), it is useful to ask which appraisal dimensions characterize stimuli that capture affective attention. Viewed from such appraisal perspective, most accounts of affective attention predict that the appraisal of goal relevance (i.e. the overall relevance of a stimulus/event to one's current goals) should attract attention whereas some accounts also implicate the appraisal of goal congruence (i.e. the value of the stimulus with respect to these goals). We compared these accounts by investigating independent effects of goal relevance and goal congruence on attention capture operationalized through pupil dilation. Forty-seven participants completed a modified Monetary Incentive Delay task (MID) where they sought to maximize the amount of chocolate received at the end of the experiment, pupil data from forty-two participants were used in the final analysis. Implicating attention capture by goal relevance, we found that pupil size was increased by all win- and loss-related compared to neutral stimuli and by materialized wins and losses compared to non-materialized ones. By contrast, we did not find pupil dilation effects of goal congruence across three different operationalizations of this appraisal dimension. These findings suggest that goal congruence appraisal may not contribute to the aspects of affective attention reflected in pupil dilation over and above goal relevance appraisal.

Observation of environments with different restorative potential results in differences in eye patron movements and pupillary size

•

Mean number of fixations, fixation durations and pupil dilation were calculated for high and low restorative potential scenes.

•

There were significantly more fixations for low restorative than for high restorative scenes.

•

Fixation times had the predicted inverse relationship, with low restorative settings having a significantly shorter time per fixation than high restorative scenes.

•

Higher measures of pupil dilatation were related to the view of high restorative potential vs. low restorative potential environments.

•

Eye movements related to photographs, low on fascination, were characterized by a greater exploration and a greater number of fixations compared to those which rated high on fascination.

The Environmental Psychological Restoration (EPR) is the result of the recovery of an antecedent deficit (e.g. stress or attentional fatigue) culminating in a restorative environment exposure. Recent findings suggest that visual contact with nature is important in triggering restorative responses. We measure the behavioral evidence of visual exposure to restorative environments in an eye-tracking study. Eye movement patterns (fixations and pupil dilatation) were evaluated while a sample of participants (n = 27; 15 females and 12 males) viewed photographs with High Restorative Potential (HRP) or Low Restorative Potential (LRP). The eye patterns during the observation of LRP were distinct to those of the HRP environments. Eye movements related to LRP photographs were characterized by a greater number of fixations compared to those related to HRP. Fixation times predicted an inverse relation, with LRP settings having a significantly shorter time per fixation than HRP pictures. Differences on pupil diameter were found. A higher pupil size was found during the view of HRP vs. LRP environments. Our eye tracking study suggest that restorative environment observation is associated with reduced eye movement activity relative to low restorative potential environment perception, which may reflect a lower cognitive effort in processing natural scenes. Likewise, pupillary dilatation variations suggest a possible link between the affective valences of the settings and its restorative quality. Data results are confronted according to attention restoration theory on restorative environments.

A new comprehensive eye-tracking test battery concurrently evaluating the Pupil Labs glasses and the EyeLink 1000

Eye-tracking experiments rely heavily on good data quality of eye-trackers. Unfortunately, it is often the case that only the spatial accuracy and precision values are available from the manufacturers. These two values alone are not sufficient to serve as a benchmark for an eye-tracker: Eye-tracking quality deteriorates during an experimental session due to head movements, changing illumination or calibration decay. Additionally, different experimental paradigms require the analysis of different types of eye movements; for instance, smooth pursuit movements, blinks or microsaccades, which themselves cannot readily be evaluated by using spatial accuracy or precision alone. To obtain a more comprehensive description of properties, we developed an extensive eye-tracking test battery. In 10 different tasks, we evaluated eye-tracking related measures such as: the decay of accuracy, fixation durations, pupil dilation, smooth pursuit movement, microsaccade classification, blink classification, or the influence of head motion. For some measures, true theoretical values exist. For others, a relative comparison to a reference eye-tracker is needed. Therefore, we collected our gaze data simultaneously from a remote EyeLink 1000 eye-tracker as the reference and compared it with the mobile Pupil Labs glasses. As expected, the average spatial accuracy of 0.57° for the EyeLink 1000 eye-tracker was better than the 0.82° for the Pupil Labs glasses (N = 15). Furthermore, we classified less fixations and shorter saccade durations for the Pupil Labs glasses. Similarly, we found fewer microsaccades using the Pupil Labs glasses. The accuracy over time decayed only slightly for the EyeLink 1000, but strongly for the Pupil Labs glasses. Finally, we observed that the measured pupil diameters differed between eye-trackers on the individual subject level but not on the group level. To conclude, our eye-tracking test battery offers 10 tasks that allow us to benchmark the many parameters of interest in stereotypical eye-tracking situations and addresses a common source of confounds in measurement errors (e.g., yaw and roll head movements). All recorded eye-tracking data (including Pupil Labs' eye videos), the stimulus code for the test battery, and the modular analysis pipeline are freely available (https://github.com/behinger/etcomp).

Pupil dilation to emotional expressions in adolescent social anxiety disorder is related to treatment outcome

Atypical attention to potential social threats, such as emotional faces, may be one of the core mechanisms underlying social anxiety disorder (SAD). Pupil dilation is an index of locus coreuleus-noradrenergic activity, and closely linked to attention. In the present study, pupil dilation was studied in adolescents with SAD (N = 26; 22 Female) before the onset of a 12-week cognitive behavioral treatment, and in healthy controls (N = 23). Stimuli were faces with angry or happy emotional expressions. Contrary to our hypothesis, the SAD group did not show hyper-responsiveness to angry compared to happy faces. Instead, an atypical time course of the pupil dilation response was found, resulting in an attenuated response during late time stages. Larger pupil dilation amplitude to happy faces before treatment was related to worse treatment response. These results contribute significantly to our understanding of the mechanisms underlying adolescent SAD.

Pupillary measurement during an assembly task

We conducted an empirical study of 57 children using a printed Booklet and a digital Tablet instruction for LEGO^® construction while they wore a head-mounted gaze tracker. Booklets caused a particularly strong pupil dilation when encountered as the first media. Subjective responses confirmed the booklet to be more difficult to use. The children who were least productive and asked for assistance more often had a significantly different pupil pattern than the rest. Our findings suggest that it is possible to collect pupil size data in unconstrained work scenarios, providing insight to task effort and difficulties.

How the inference of hierarchical rules unfolds over time

Inductive reasoning, which entails reaching conclusions that are based on but go beyond available evidence, has long been of interest in cognitive science. Nevertheless, knowledge is still lacking as to the specific cognitive processes that underlie inductive reasoning. Here, we shed light on these processes in two ways. First, we characterized the timecourse of inductive reasoning in a rule induction task, using pupil dilation as a moment-by-moment measure of cognitive load. Participants' patterns of behavior and pupillary responses indicated that they engaged in rule inference on-line, and were surprised when additional evidence violated their inferred rules. Second, we sought to gain insight into how participants represented rules on this task - specifically, whether they would structure the rules hierarchically when possible. We predicted the cognitive load imposed by hierarchical representations, as well as by non-hierarchical, flat ones. We used task-evoked pupil dilation as a metric of cognitive load to infer, based on these predictions, which participants represented rules with flat or hierarchical structures. Participants categorized as representing the rules hierarchically or flat differed in task performance and self-reports of strategy. Hierarchical rule representation was associated with more efficient performance and more pronounced pupillary responses to rule violations on trials that afford a higher-order regularity, but with less efficient performance on trials that do not. Thus, differences in rule representation can be inferred from a physiological measure of cognitive load, and are associated with differences in performance. These results illustrate how pupillometry can provide a window into reasoning as it unfolds over time.

Acute stress enhances pupillary responses to erotic nudes: Evidence for differential effects of sympathetic activation and cortisol

Chronic stress attenuates reproductive behavior in many species, but evidence regarding the impact of acute stress on human sexual arousability is insufficient. Stressor-specific effects might result from divergent roles of both stress response systems. Social self-threat, linked to affiliation-oriented coping, might also influence sexual responsivity. To investigate stress-induced modulation of the processing of sexual cues and its relationship with cortisol, 58 participants underwent either a predominantly sympathetic stressor (3 min sustained handgrip) or similar control procedure. In both conditions, half of the sample was monitored by an opposite-sex person (social evaluation). Pupillary responses to erotic nudes were recorded and dissociated into fast and slow PCA components. Physically stressed participants showed enhanced (slow) dilation to explicit pictures. Cortisol levels after stress negatively predicted rapid responses to opposite-sex and (marginally) explicit stimuli. Our results suggest that acute sympathetic stress exposure facilitates cognitive sexual processing, whereas subsequent HPA-axis activation may induce counteracting effects.

A gaze interactive assembly instruction with pupillometric recording

This paper presents a study of a gaze interactive digital assembly instruction that provides concurrent logging of pupil data in a realistic task setting. The instruction allows hands-free gaze dwells as a substitute for finger clicks, and supports image rotation as well as image zooming by head movements. A user study in two LEGO toy stores with 72 children showed it to be immediately usable by 64 of them. Data logging of view-times and pupil dilations was possible for 59 participants. On average, the children spent half of the time attending to the instruction (S.D. 10.9%). The recorded pupil size showed a decrease throughout the building process, except when the child had to back-step: a regression was found to be followed by a pupil dilation. The main contribution of this study is to demonstrate gaze-tracking technology capable of supporting both robust interaction and concurrent, non-intrusive recording of gaze- and pupil data in-the-wild. Previous research has found pupil dilation to be associated with changes in task effort. However, other factors like fatigue, head motion, or ambient light may also have an impact. The final section summarizes our approach to this complexity of real-task pupil data collection and makes suggestions for how future applications may utilize pupil information.

The feeling of effort during mental activity

The feeling of effort is familiar to most, if not all, humans. Prior research shows that the feeling of effort shapes judgments (e.g., of agency) and decisions (e.g., to quit the current task) in various ways, but the proximal causes of the feeling of effort are not well understood. In this research, I address these proximal causes. In particular, I conducted two preregistered experiments in which participants performed a difficult vs. easy cognitive task, while I measured effort-related phenomenology (feeling of effort) and physiology (pupil dilation) on a moment-to-moment basis. In both experiments, difficult tasks increased the feeling of effort; however, this effect could not be explained by concurrent increases in physiological effort. To explain these findings, I suggest that the feeling of effort during mental activity stems from the decision to exert physiological effort, rather than from physiological effort itself.

Impact of SNR, masker type and noise reduction processing on sentence recognition performance and listening effort as indicated by the pupil dilation response

Recent studies have shown that activating the noise reduction scheme in hearing aids results in a smaller peak pupil dilation (PPD), indicating reduced listening effort, at 50% and 95% correct sentence recognition with a 4-talker masker. The objective of this study was to measure the effect of the noise reduction scheme (on or off) on PPD and sentence recognition across a wide range of signal-to-noise ratios (SNRs) from +16 dB to -12 dB and two masker types (4-talker and stationary noise). Relatively low PPDs were observed at very low (-12 dB) and very high (+16 dB to +8 dB) SNRs presumably due to 'giving up' and 'easy listening', respectively. The maximum PPD was observed with SNRs at approximately 50% correct sentence recognition. Sentence recognition with both masker types was significantly improved by the noise reduction scheme, which corresponds to the shift in performance from SNR function at approximately 5 dB toward a lower SNR. This intelligibility effect was accompanied by a corresponding effect on the PPD, shifting the peak by approximately 4 dB toward a lower SNR. In addition, with the 4-talker masker, when the noise reduction scheme was active, the PPD was smaller overall than that when the scheme was inactive. We conclude that with the 4-talker masker, noise reduction scheme processing provides a listening effort benefit in addition to any effect associated with improved intelligibility. Thus, the effect of the noise reduction scheme on listening effort incorporates more than can be explained by intelligibility alone, emphasizing the potential importance of measuring listening effort in addition to traditional speech reception measures.

Latency-Based and Psychophysiological Measures of Sexual Interest Show Convergent and Concurrent Validity

Latency-based measures of sexual interest require additional evidence of validity, as do newer pupil dilation approaches. A total of 102 community men completed six latency-based measures of sexual interest. Pupillary responses were recorded during three of these tasks and in an additional task where no participant response was required. For adult stimuli, there was a high degree of intercorrelation between measures, suggesting that tasks may be measuring the same underlying construct (convergent validity). In addition to being correlated with one another, measures also predicted participants' self-reported sexual interest, demonstrating concurrent validity (i.e., the ability of a task to predict a more validated, simultaneously recorded, measure). Latency-based and pupillometric approaches also showed preliminary evidence of concurrent validity in predicting both self-reported interest in child molestation and viewing pornographic material containing children. Taken together, the study findings build on the evidence base for the validity of latency-based and pupillometric measures of sexual interest.

Don't judge me: Psychophysiological evidence of gender differences to social evaluative feedback

Human beings have a basic need for esteemed social connections, and receiving negative self-evaluative feedback induces emotional distress. The aim of the current study is to measure eye movements (a physiological marker of attention allocation) and pupillary responses (a physiological marker of cognitive and emotional processing) as online and objective indices of participants' reaction to positive/negative social evaluations from the same or opposite sex. Following the paradigm, subjective mood ratings and heart rate variability (HRV) - as an objective index of regulatory effort- were measured. Results demonstrate clear gender-specific results in all measures. Eye-movements demonstrate that male participants respond more with other-focused attention (and specifically to male participants), whereas women respond more with self-focused attention following negative social evaluative feedback. Pupillary responses show that social evaluative feedback is specifically eliciting cognitive/affective processes in male participants to regulate emotional responses when provided by the opposite gender. Finally, following the paradigm, female (as compared to male) participants were more subjectively reactive to the paradigm (i.e., self-reports), and were less able to engage contextual- and goal related regulatory control of emotional responses (reduced HRV). Although the current study focused on psychiatrically healthy young adults, results may contribute to our understanding of sex differences in internalizing mental problems, such as rumination.