Pupillary responses on the visual backward masking task reflect general cognitive ability

A Multimodal Approach to Measuring Listening Effort: A Systematic Review on the Effects of Auditory Task Demand on Physiological Measures and Their Relationship

OBJECTIVES

Listening effort involves the mental effort required to perceive an auditory stimulus, for example in noisy environments. Prolonged increased listening effort, for example due to impaired hearing ability, may increase risk of health complications. It is therefore important to identify valid and sensitive measures of listening effort. Physiological measures have been shown to be sensitive to auditory task demand manipulations and are considered to reflect changes in listening effort. Such measures include pupil dilation, alpha power, skin conductance level, and heart rate variability. The aim of the current systematic review was to provide an overview of studies to listening effort that used multiple physiological measures. The two main questions were: (1) what is the effect of changes in auditory task demand on simultaneously acquired physiological measures from various modalities? and (2) what is the relationship between the responses in these physiological measures?

DESIGN

Following Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, relevant articles were sought in PubMed, PsycInfo, and Web of Science and by examining the references of included articles. Search iterations with different combinations of psychophysiological measures were performed in conjunction with listening effort-related search terms. Quality was assessed using the Appraisal Tool for Cross-Sectional Studies.

RESULTS

A total of 297 articles were identified from three databases, of which 27 were included. One additional article was identified from reference lists. Of the total 28 included articles, 16 included an analysis regarding the relationship between the physiological measures. The overall quality of the included studies was reasonable.

CONCLUSIONS

The included studies showed that most of the physiological measures either show no effect to auditory task demand manipulations or a consistent effect in the expected direction. For example, pupil dilation increased, pre-ejection period decreased, and skin conductance level increased with increasing auditory task demand. Most of the relationships between the responses of these physiological measures were nonsignificant or weak. The physiological measures varied in their sensitivity to auditory task demand manipulations. One of the identified knowledge gaps was that the included studies mostly used tasks with high-performance levels, resulting in an underrepresentation of the physiological changes at lower performance levels. This makes it difficult to capture how the physiological responses behave across the full psychometric curve. Our results support the Framework for Understanding Effortful Listening and the need for a multimodal approach to listening effort. We furthermore discuss focus points for future studies.

Pupil Dilation Reflects Perceptual Priorities During a Receptive Speech Task

OBJECTIVES

The listening demand incurred by speech perception fluctuates in normal conversation. At the acoustic-phonetic level, natural variation in pronunciation acts as speedbumps to accurate lexical selection. Any given utterance may be more or less phonetically ambiguous-a problem that must be resolved by the listener to choose the correct word. This becomes especially apparent when considering two common speech registers-clear and casual-that have characteristically different levels of phonetic ambiguity. Clear speech prioritizes intelligibility through hyperarticulation which results in less ambiguity at the phonetic level, while casual speech tends to have a more collapsed acoustic space. We hypothesized that listeners would invest greater cognitive resources while listening to casual speech to resolve the increased amount of phonetic ambiguity, as compared with clear speech. To this end, we used pupillometry as an online measure of listening effort during perception of clear and casual continuous speech in two background conditions: quiet and noise.

DESIGN

Forty-eight participants performed a probe detection task while listening to spoken, nonsensical sentences (masked and unmasked) while recording pupil size. Pupil size was modeled using growth curve analysis to capture the dynamics of the pupil response as the sentence unfolded.

RESULTS

Pupil size during listening was sensitive to the presence of noise and speech register (clear/casual). Unsurprisingly, listeners had overall larger pupil dilations during speech perception in noise, replicating earlier work. The pupil dilation pattern for clear and casual sentences was considerably more complex. Pupil dilation during clear speech trials was slightly larger than for casual speech, across quiet and noisy backgrounds.

CONCLUSIONS

We suggest that listener motivation could explain the larger pupil dilations to clearly spoken speech. We propose that, bounded by the context of this task, listeners devoted more resources to perceiving the speech signal with the greatest acoustic/phonetic fidelity. Further, we unexpectedly found systematic differences in pupil dilation preceding the onset of the spoken sentences. Together, these data demonstrate that the pupillary system is not merely reactive but also adaptive-sensitive to both task structure and listener motivation to maximize accurate perception in a limited resource system.

Contributions of listening effort and intelligibility to cortical tracking of speech in adverse listening conditions

Cortical tracking of speech is vital for speech segmentation and is linked to speech intelligibility. However, there is no clear consensus as to whether reduced intelligibility leads to a decrease or an increase in cortical speech tracking, warranting further investigation of the factors influencing this relationship. One such factor is listening effort, defined as the cognitive resources necessary for speech comprehension, and reported to have a strong negative correlation with speech intelligibility. Yet, no studies have examined the relationship between speech intelligibility, listening effort, and cortical tracking of speech. The aim of the present study was thus to examine these factors in quiet and distinct adverse listening conditions. Forty-nine normal hearing adults listened to sentences produced casually, presented in quiet and two adverse listening conditions: cafeteria noise and reverberant speech. Electrophysiological responses were registered with electroencephalogram, and listening effort was estimated subjectively using self-reported scores and objectively using pupillometry. Results indicated varying impacts of adverse conditions on intelligibility, listening effort, and cortical tracking of speech, depending on the preservation of the speech temporal envelope. The more distorted envelope in the reverberant condition led to higher listening effort, as reflected in higher subjective scores, increased pupil diameter, and stronger cortical tracking of speech in the delta band. These findings suggest that using measures of listening effort in addition to those of intelligibility is useful for interpreting cortical tracking of speech results. Moreover, reading and phonological skills of participants were positively correlated with listening effort in the cafeteria condition, suggesting a special role of expert language skills in processing speech in this noisy condition. Implications for future research and theories linking atypical cortical tracking of speech and reading disorders are further discussed.

Pupillary dilations in a Target/Distractor visual task paradigm and attention deficit hyperactivity disorder (ADHD)

ADHD is a neurocognitive disorder characterized by attention difficulties, hyperactivity, and impulsivity, often persisting into adulthood with substantial personal and societal consequences. Despite the importance of neurophysiological assessment and treatment monitoring tests, their availability outside of research settings remains limited. Cognitive neuroscience investigations have identified distinct components associated with ADHD, including deficits in sustained attention, inefficient enhancement of attended Targets, and altered suppression of ignored Distractors. In this study, we examined pupil activity in control and ADHD subjects during a sustained visual attention task specifically designed to evaluate the mechanisms underlying Target enhancement and Distractor suppression. Our findings revealed some distinguishing factors between the two groups which we discuss in light of their neurobiological implications.

Time-specific Components of Pupil Responses Reveal Alternations in Effort Allocation Caused by Memory Task Demands During Speech Identification in Noise

Daily communication may be effortful due to poor acoustic quality. In addition, memory demands can induce effort, especially for long or complex sentences. In the current study, we tested the impact of memory task demands and speech-to-noise ratio on the time-specific components of effort allocation during speech identification in noise. Thirty normally hearing adults (15 females, mean age 42.2 years) participated. In an established auditory memory test, listeners had to listen to a list of seven sentences in noise, and repeat the sentence-final word after presentation, and, if instructed, recall the repeated words. We tested the effects of speech-to-noise ratio (SNR; -4 dB, +1 dB) and recall (Recall; Yes, No), on the time-specific components of pupil responses, trial baseline pupil size, and their dynamics (change) along the list. We found three components in the pupil responses (early, middle, and late). While the additional memory task (recall versus no recall) lowered all components' values, SNR (-4 dB versus +1 dB SNR) increased the middle and late component values. Increasing memory demands (Recall) progressively increased trial baseline and steepened decrease of the late component's values. Trial baseline increased most steeply in the condition of +1 dB SNR with recall. The findings suggest that adding a recall to the auditory task alters effort allocation for listening. Listeners are dynamically re-allocating effort from listening to memorizing under changing memory and acoustic demands. The pupil baseline and the time-specific components of pupil responses provide a comprehensive picture of the interplay of SNR and recall on effort.

Task-Evoked Pupillary Response as a Potential Biomarker of Dementia and Mild Cognitive Impairment: A Scoping Review

Pupil dilation functions as a proxy for cognitive effort and can be measured through automated pupillometry. The aim of this scoping review is to examine how individuals with cognitive impairment differ in task-evoked pupillary responses relative to cognitively healthy individuals. A systematic literature search across six databases was conducted to identify studies examining changes in pupillary responses evoked by cognitive tasks comparing patients with dementia to healthy controls. Eight articles met inclusion criteria and were included for review. Differences in task-evoked pupillary response between cognitively impaired and cognitively healthy participants were observed across studies. Pupil dilation is decreased in patients with Alzheimer's Disease compared to controls, with no difference observed in patients with mild cognitive impairment. A mild, non-significant trend towards reduced pupil dilation in patients with either Parkinson's Disease or Dementia with Lewy Bodies suggests a similar but less pronounced effect than in AD patients. Further research is required to examine the utility of task-evoked pupillary responses as a potential biomarker indexing cognitive decline in individuals transitioning to mild cognitive impairment and/or dementia.

Schizophrenia in Translation: Why the Eye?

Schizophrenia is increasingly recognized as a systemic disease, characterized by dysregulation in multiple physiological systems (eg, neural, cardiovascular, endocrine). Many of these changes are observed as early as the first psychotic episode, and in people at high risk for the disorder. Expanding the search for biomarkers of schizophrenia beyond genes, blood, and brain may allow for inexpensive, noninvasive, and objective markers of diagnosis, phenotype, treatment response, and prognosis. Several anatomic and physiologic aspects of the eye have shown promise as biomarkers of brain health in a range of neurological disorders, and of heart, kidney, endocrine, and other impairments in other medical conditions. In schizophrenia, thinning and volume loss in retinal neural layers have been observed, and are associated with illness progression, brain volume loss, and cognitive impairment. Retinal microvascular changes have also been observed. Abnormal pupil responses and corneal nerve disintegration are related to aspects of brain function and structure in schizophrenia. In addition, studying the eye can inform about emerging cardiovascular, neuroinflammatory, and metabolic diseases in people with early psychosis, and about the causes of several of the visual changes observed in the disorder. Application of the methods of oculomics, or eye-based biomarkers of non-ophthalmological pathology, to the treatment and study of schizophrenia has the potential to provide tools for patient monitoring and data-driven prediction, as well as for clarifying pathophysiology and course of illness. Given their demonstrated utility in neuropsychiatry, we recommend greater adoption of these tools for schizophrenia research and patient care.

Nonuniformity of Whole-Cerebral Neural Resource Allocation, a Neuromarker of the Broad-Task Attention

The neural basis of attention is thought to involve the allocation of limited neural resources. However, the quantitative validation of this hypothesis remains challenging. Here, we provide quantitative evidence that the nonuniform allocation of neural resources across the whole cerebral gray matter reflects the broad-task process of sustained attention. We propose a neural measure for the nonuniformity of whole-cerebral allocation using functional magnetic resonance imaging. We found that this measure was significantly correlated with conventional indicators of attention level, such as task difficulty and pupil dilation. We further found that the broad-task neural correlates of the measure belong to frontoparietal and dorsal attention networks. Finally, we found that patients with attention-deficit/hyperactivity disorder showed abnormal decreases in the level of the proposed measure, reflecting the executive dysfunction. This study proposes a neuromarker suggesting that the nonuniform allocation of neural resources may be the broad-task neural basis of sustained attention.

Listening Effort in Cochlear Implant Users: The Effect of Speech Intelligibility, Noise Reduction Processing, and Working Memory Capacity on the Pupil Dilation Response

PURPOSE

This study aimed to evaluate the effect of speech recognition performance, working memory capacity (WMC), and a noise reduction algorithm (NRA) on listening effort as measured with pupillometry in cochlear implant (CI) users while listening to speech in noise.

METHOD

Speech recognition and pupil responses (peak dilation, peak latency, and release of dilation) were measured during a speech recognition task at three speech-to-noise ratios (SNRs) with an NRA in both on and off conditions. WMC was measured with a reading span task. Twenty experienced CI users participated in this study.

RESULTS

With increasing SNR and speech recognition performance, (a) the peak pupil dilation decreased by only a small amount, (b) the peak latency decreased, and (c) the release of dilation after the sentences increased. The NRA had no effect on speech recognition in noise or on the peak or latency values of the pupil response but caused less release of dilation after the end of the sentences. A lower reading span score was associated with higher peak pupil dilation but was not associated with peak latency, release of dilation, or speech recognition in noise.

CONCLUSIONS

In CI users, speech perception is effortful, even at higher speech recognition scores and high SNRs, indicating that CI users are in a chronic state of increased effort in communication situations. The application of a clinically used NRA did not improve speech perception, nor did it reduce listening effort. Participants with a relatively low WMC exerted relatively more listening effort but did not have better speech reception thresholds in noise.

Talker discontinuity disrupts attention to speech: Evidence from EEG and pupillometry

Speech is processed less efficiently from discontinuous, mixed talkers than one consistent talker, but little is known about the neural mechanisms for processing talker variability. Here, we measured psychophysiological responses to talker variability using electroencephalography (EEG) and pupillometry while listeners performed a delayed recall of digit span task. Listeners heard and recalled seven-digit sequences with both talker (single- vs. mixed-talker digits) and temporal (0- vs. 500-ms inter-digit intervals) discontinuities. Talker discontinuity reduced serial recall accuracy. Both talker and temporal discontinuities elicited P3a-like neural evoked response, while rapid processing of mixed-talkers' speech led to increased phasic pupil dilation. Furthermore, mixed-talkers' speech produced less alpha oscillatory power during working memory maintenance, but not during speech encoding. Overall, these results are consistent with an auditory attention and streaming framework in which talker discontinuity leads to involuntary, stimulus-driven attentional reorientation to novel speech sources, resulting in the processing interference classically associated with talker variability.

The Principle of Least Effort and Comprehension of Spoken Sentences by Younger and Older Adults

There is considerable evidence that listeners' understanding of a spoken sentence need not always follow from a full analysis of the words and syntax of the utterance. Rather, listeners may instead conduct a superficial analysis, sampling some words and using presumed plausibility to arrive at an understanding of the sentence meaning. Because this latter strategy occurs more often for sentences with complex syntax that place a heavier processing burden on the listener than sentences with simpler syntax, shallow processing may represent a resource conserving strategy reflected in reduced processing effort. This factor may be even more important for older adults who as a group are known to have more limited working memory resources. In the present experiment, 40 older adults (M age = 75.5 years) and 20 younger adults (M age = 20.7) were tested for comprehension of plausible and implausible sentences with a simpler subject-relative embedded clause structure or a more complex object-relative embedded clause structure. Dilation of the pupil of the eye was recorded as an index of processing effort. Results confirmed greater comprehension accuracy for plausible than implausible sentences, and for sentences with simpler than more complex syntax, with both effects amplified for the older adults. Analysis of peak pupil dilations for implausible sentences revealed a complex three-way interaction between age, syntactic complexity, and plausibility. Results are discussed in terms of models of sentence comprehension, and pupillometry as an index of intentional task engagement.

Disentangling listening effort and memory load beyond behavioural evidence: Pupillary response to listening effort during a concurrent memory task

Recent research has demonstrated that pupillometry is a robust measure for quantifying listening effort. However, pupillary responses in listening situations where multiple cognitive functions are engaged and sustained over a period of time remain hard to interpret. This limits our conceptualisation and understanding of listening effort in realistic situations, because rarely in everyday life are people challenged by one task at a time. Therefore, the purpose of this experiment was to reveal the dynamics of listening effort in a sustained listening condition using a word repeat and recall task. Words were presented in quiet and speech-shaped noise at different signal-to-noise ratios (SNR): 0dB, 7dB, 14dB and quiet. Participants were presented with lists of 10 words, and required to repeat each word after its presentation. At the end of the list, participants either recalled as many words as possible or moved on to the next list. Simultaneously, their pupil dilation was recorded throughout the whole experiment. When only word repeating was required, peak pupil dilation (PPD) was bigger in 0dB versus other conditions; whereas when recall was required, PPD showed no difference among SNR levels and PPD in 0dB was smaller than repeat-only condition. Baseline pupil diameter and PPD followed different variation patterns across the 10 serial positions within a block for conditions requiring recall: baseline pupil diameter built up progressively and plateaued in the later positions (but shot up when listeners were recalling the previously heard words from memory); PPD decreased at a pace quicker than in repeat-only condition. The current findings demonstrate that additional cognitive load during a speech intelligibility task could disturb the well-established relation between pupillary response and listening effort. Both the magnitude and temporal pattern of task-evoked pupillary response differ greatly in complex listening conditions, urging for more listening effort studies in complex and realistic listening situations.

Effect of Speech-to-Noise Ratio and Luminance on a Range of Current and Potential Pupil Response Measures to Assess Listening Effort

In hearing research, pupillometry is an established method of studying listening effort. The focus of this study was to evaluate several pupil measures extracted from the Task-Evoked Pupil Responses (TEPRs) in speech-in-noise test. A range of analysis approaches was applied to extract these pupil measures, namely (a) pupil peak dilation (PPD); (b) mean pupil dilation (MPD); (c) index of pupillary activity; (d) growth curve analysis (GCA); and (e) principal component analysis (PCA). The effect of signal-to-noise ratio (SNR; Data Set A: -20 dB, -10 dB, +5 dB SNR) and luminance (Data Set B: 0.1 cd/m2, 360 cd/m2) on the TEPRs were investigated. Data Sets A and B were recorded during a speech-in-noise test and included TEPRs from 33 and 27 normal-hearing native Dutch speakers, respectively. The main results were as follows: (a) A significant effect of SNR was revealed for all pupil measures extracted in the time domain (PPD, MPD, GCA, PCA); (b) Two time series analysis approaches (GCA, PCA) provided modeled temporal profiles of TEPRs (GCA); and time windows spanning subtasks performed in a speech-in-noise test (PCA); and (c) All pupil measures revealed a significant effect of luminance. In conclusion, multiple pupil measures showed similar effects of SNR, suggesting that effort may be reflected in multiple aspects of TEPR. Moreover, a direct analysis of the pupil time course seems to provide a more holistic view of TEPRs, yet further research is needed to understand and interpret its measures. Further research is also required to find pupil measures less sensitive to changes in luminance.

Pupil-linked arousal signals track the temporal organization of events in memory

Everyday life unfolds continuously, yet we tend to remember past experiences as discrete event sequences or episodes. Although this phenomenon has been well documented, the neuromechanisms that support the transformation of continuous experience into distinct and memorable episodes remain unknown. Here, we show that changes in context, or event boundaries, elicit a burst of autonomic arousal, as indexed by pupil dilation. Event boundaries also lead to the segmentation of adjacent episodes in later memory, evidenced by changes in memory for the temporal duration, order, and perceptual details of recent event sequences. These subjective and objective changes in temporal memory are also related to distinct temporal features of pupil dilations to boundaries as well as to the temporal stability of more prolonged pupil-linked arousal states. Collectively, our findings suggest that pupil measures reflect both stability and change in ongoing mental context representations, which in turn shape the temporal structure of memory.

Pupil diameter differentiates expertise in dental radiography visual search

Expert behavior is characterized by rapid information processing abilities, dependent on more structured schemata in long-term memory designated for their domain-specific tasks. From this understanding, expertise can effectively reduce cognitive load on a domain-specific task. However, certain tasks could still evoke different gradations of load even for an expert, e.g., when having to detect subtle anomalies in dental radiographs. Our aim was to measure pupil diameter response to anomalies of varying levels of difficulty in expert and student dentists’ visual examination of panoramic radiographs. We found that students’ pupil diameter dilated significantly from baseline compared to experts, but anomaly difficulty had no effect on pupillary response. In contrast, experts’ pupil diameter responded to varying levels of anomaly difficulty, where more difficult anomalies evoked greater pupil dilation from baseline. Experts thus showed proportional pupillary response indicative of increasing cognitive load with increasingly difficult anomalies, whereas students showed pupillary response indicative of higher cognitive load for all anomalies when compared to experts.

Schizophrenia and the retina: Towards a 2020 perspective

BACKGROUND

Differences between people with schizophrenia and psychiatrically healthy controls have been consistently demonstrated on measures of retinal function such as electroretinography (ERG), and measures of retinal structure such as optical coherence tomography (OCT). Since our 2015 review of this literature, multiple new studies have been published using these techniques. At the same time, the accumulation of data has highlighted the "fault lines" in these fields, suggesting methodological considerations that need greater attention in future studies.

METHODS

We reviewed studies of ERG and OCT in schizophrenia, as well as data from studies whose findings are relevant to interpreting these papers, such as those on effects of the following on ERG and OCT data: comorbid medical conditions that are over-represented in schizophrenia, smoking, antipsychotic medication, substance abuse, sex and gender, obesity, attention, motivation, and influences of brain activity on retinal function.

RESULTS

Recent ERG and OCT studies continue to support the hypothesis of retinal structural and functional abnormalities in schizophrenia, and suggest that these are relevant to understanding broader aspects of pathophysiology, neurodevelopment, and neurodegeneration in this disorder. However, there are differences in findings which suggest that the effects of multiple variables on ERG and OCT data need further clarification.

CONCLUSIONS

The retina, as the only component of the CNS that can be imaged directly in live humans, has potential to clarify important aspects of schizophrenia. With greater attention to specific methodological issues, the true potential of ERG and OCT as biomarkers for important clinical phenomena in schizophrenia should become apparent.

Investigating sex differences, cognitive effort, strategy, and performance on a computerised version of the mental rotations test via eye tracking

Mental rotation tests (MRTs) have previously shown one of the most prominent sex differences in cognitive psychology, marked by a large male performance advantage. However, debate continues over the reasons for these sex differences. Previously, we used pupillometry to demonstrate sex differences in the cognitive effort invoked during the original MRT. Here, we evaluated the magnitude of sex differences during performance on a computerized version of the Vandenberg and Kuse MRT. Secondly, we examined whether fixation metrics could illuminate strategy use by participants. Finally, we used pupillometry to investigate whether cognitive effort differed between sexes and trials of different difficulty. While our results demonstrate no performance differences between sexes on the computerized MRT, fixation patterns provided evidence that gaze strategy was associated with performance on different parts of the test. Moreover, we show the cognitive demand of the V&K MRT, evidenced by large task dependent increases in participants’ pupil diameters.

The pupil response as an indicator of user experience in a digital exercise game

To study whether psychophysiological indicators are suitable measures of user experience in a digital exercise game (exergame), a laboratory study employing both psychophysiological and self-report measures was conducted. Sixty-six participants cycled for 10 min on an ergometer while pupil diameter, skin conductance, and heart rate were measured; afterward, they completed a user experience questionnaire. The participants performed under three experimental conditions varying between subjects: active gaming (participants controlled the altitude of a digital bird by varying their pedal rate in order to catch letters flying across the screen), observing a game (they observed a replay of another participant's game), and no-game (blank screen). Only the gaming condition showed evidence for statistically significant pupil dilations-indicating emotional arousal-in response to game events (catching a letter) or corresponding points in time. The observational condition did not differ statistically from the no-game control condition. Self-reports also indicated that the gaming condition was rated most fun and least demanding. Other psychophysiological indicators (heart rate, skin conductance) showed no systematic effects in response to game events, rather they steadily increased during training. Thus, pupil responses were shown to be suitable indicators of positive emotional reactions to game events and user experience in a (training) game.

Cortical modulation of pupillary function: systematic review

BACKGROUND

The pupillary light reflex is the main mechanism that regulates the pupillary diameter; it is controlled by the autonomic system and mediated by subcortical pathways. In addition, cognitive and emotional processes influence pupillary function due to input from cortical innervation, but the exact circuits remain poorly understood. We performed a systematic review to evaluate the mechanisms behind pupillary changes associated with cognitive efforts and processing of emotions and to investigate the cerebral areas involved in cortical modulation of the pupillary light reflex.

METHODOLOGY

We searched multiple databases until November 2018 for studies on cortical modulation of pupillary function in humans and non-human primates. Of 8,809 papers screened, 258 studies were included.

RESULTS

Most investigators focused on pupillary dilatation and/or constriction as an index of cognitive and emotional processing, evaluating how changes in pupillary diameter reflect levels of attention and arousal. Only few tried to correlate specific cerebral areas to pupillary changes, using either cortical activation models (employing micro-stimulation of cortical structures in non-human primates) or cortical lesion models (e.g., investigating patients with stroke and damage to salient cortical and/or subcortical areas). Results suggest the involvement of several cortical regions, including the insular cortex (Brodmann areas 13 and 16), the frontal eye field (Brodmann area 8) and the prefrontal cortex (Brodmann areas 11 and 25), and of subcortical structures such as the locus coeruleus and the superior colliculus.

CONCLUSIONS

Pupillary dilatation occurs with many kinds of mental or emotional processes, following sympathetic activation or parasympathetic inhibition. Conversely, pupillary constriction may occur with anticipation of a bright stimulus (even in its absence) and relies on a parasympathetic activation. All these reactions are controlled by subcortical and cortical structures that are directly or indirectly connected to the brainstem pupillary innervation system.

Analyzing the Time Course of Pupillometric Data

This article provides a tutorial for analyzing pupillometric data. Pupil dilation has become increasingly popular in psychological and psycholinguistic research as a measure to trace language processing. However, there is no general consensus about procedures to analyze the data, with most studies analyzing extracted features from the pupil dilation data instead of analyzing the pupil dilation trajectories directly. Recent studies have started to apply nonlinear regression and other methods to analyze the pupil dilation trajectories directly, utilizing all available information in the continuously measured signal. This article applies a nonlinear regression analysis, generalized additive mixed modeling, and illustrates how to analyze the full-time course of the pupil dilation signal. The regression analysis is particularly suited for analyzing pupil dilation in the fields of psychological and psycholinguistic research because generalized additive mixed models can include complex nonlinear interactions for investigating the effects of properties of stimuli (e.g., formant frequency) or participants (e.g., working memory score) on the pupil dilation signal. To account for the variation due to participants and items, nonlinear random effects can be included. However, one of the challenges for analyzing time series data is dealing with the autocorrelation in the residuals, which is rather extreme for the pupillary signal. On the basis of simulations, we explain potential causes of this extreme autocorrelation, and on the basis of the experimental data, we show how to reduce their adverse effects, allowing a much more coherent interpretation of pupillary data than possible with feature-based techniques.

Pupillary responses to a cognitive effort task in schizophrenia

Effort-based decision making paradigms are increasingly utilized to gain insight into the nature of motivation deficits. Although these tasks are being used to assess effort and motivation in schizophrenia, little work has been done to confirm that effort-based decision making tasks validly manipulate effort. In the current study, we adapted the effort component a cognitive effort-based decision making task (the Deck Choice Effort Task) for use with pupillometric assessment. We sought to confirm with psychophysiology that cognitive effort is manipulated. We also examined correlations between physiological indicators of effort exertion and cognition and negative symptoms. The results confirmed manipulation of cognitive effort: there was a significant difference in pupillary responses between easy and difficult task conditions. Pupillary responses were also correlated with cognitive ability, and with negative symptoms when controlling for cognition. Thus, our findings offer physiological validation of an effort manipulation included in a cognitive effort-based decision making task for schizophrenia.

Best Practices and Advice for Using Pupillometry to Measure Listening Effort: An Introduction for Those Who Want to Get Started

Within the field of hearing science, pupillometry is a widely used method for quantifying listening effort. Its use in research is growing exponentially, and many labs are (considering) applying pupillometry for the first time. Hence, there is a growing need for a methods paper on pupillometry covering topics spanning from experiment logistics and timing to data cleaning and what parameters to analyze. This article contains the basic information and considerations needed to plan, set up, and interpret a pupillometry experiment, as well as commentary about how to interpret the response. Included are practicalities like minimal system requirements for recording a pupil response and specifications for peripheral, equipment, experiment logistics and constraints, and different kinds of data processing. Additional details include participant inclusion and exclusion criteria and some methodological considerations that might not be necessary in other auditory experiments. We discuss what data should be recorded and how to monitor the data quality during recording in order to minimize artifacts. Data processing and analysis are considered as well. Finally, we share insights from the collective experience of the authors and discuss some of the challenges that still lie ahead.

Foggy windows: Pupillary responses during task preparation

We investigated pupil dilation in 96 subjects during task preparation and during a post-trial interval in a visual search task and an auditory working memory task. Completely informative difficulty cues (easy, medium, or hard) were presented right before task preparation to examine whether pupil dilation indicated advance mobilisation of attentional resources; functional magnetic resonance imaging (fMRI) studies have argued for the existence of such task preparation, and the literature shows that pupil dilation tracks attentional effort during task performance. We found, however, little evidence for such task preparation. In the working memory task, pupil size was identical across cues, and although pupil dilation in the visual search task tracked the cue, pupil dilation predicted subsequent performance in neither task. Pupil dilation patterns in the post-trial interval were more consistent with an effect of emotional reactivity. Our findings suggest that the mobilisation of attentional resources in the service of the task does not occur during the preparatory interval, but is delayed until the task itself is initiated.

Quantification of baseline pupillary response and task-evoked pupillary response during constant and incremental task load

The methods employed to quantify the baseline pupil size and task-evoked pupillary response (TEPR) may affect the overall study results. To test this hypothesis, the objective of this study was to assess variability in baseline pupil size and TEPR during two basic working memory tasks: constant load of 3-letters memorisation-recall (10 trials), and incremental load memorisation-recall (two trials of each load level), using two commonly used methods (1) change from trail/load specific baseline, (2) change from constant baseline. Results indicated that there was a significant shift in baseline between the trails for constant load, and between the load levels for incremental load. The TEPR was independent of shifts in baseline using method 1 only for constant load, and method 2 only for higher levels of incremental load condition. These important findings suggest that the assessment of both the baseline and methods to quantify TEPR are critical in ergonomics application, especially in studies with small number of trials per subject per condition. Practitioner Summary: Quantification of TEPR can be affected by shifts in baseline pupil size that are most likely affected by non-cognitive factors when other external factors are kept constant. Therefore, quantification methods employed to compute both baseline and TEPR are critical in understanding the information processing of humans in practical ergonomics settings.

Beyond eye gaze: What else can eyetracking reveal about cognition and cognitive development?

This review provides an introduction to two eyetracking measures that can be used to study cognitive development and plasticity: pupil dilation and spontaneous blink rate. We begin by outlining the rich history of gaze analysis, which can reveal the current focus of attention as well as cognitive strategies. We then turn to the two lesser-utilized ocular measures. Pupil dilation is modulated by the brain's locus coeruleus-norepinephrine system, which controls physiological arousal and attention, and has been used as a measure of subjective task difficulty, mental effort, and neural gain. Spontaneous eyeblink rate correlates with levels of dopamine in the central nervous system, and can reveal processes underlying learning and goal-directed behavior. Taken together, gaze, pupil dilation, and blink rate are three non-invasive and complementary measures of cognition with high temporal resolution and well-understood neural foundations. Here we review the neural foundations of pupil dilation and blink rate, provide examples of their usage, describe analytic methods and methodological considerations, and discuss their potential for research on learning, cognitive development, and plasticity.

Fuzzy System-Based Target Selection for a NIR Camera-Based Gaze Tracker

Gaze-based interaction (GBI) techniques have been a popular subject of research in the last few decades. Among other applications, GBI can be used by persons with disabilities to perform everyday tasks, as a game interface, and can play a pivotal role in the human computer interface (HCI) field. While gaze tracking systems have shown high accuracy in GBI, detecting a user’s gaze for target selection is a challenging problem that needs to be considered while using a gaze detection system. Past research has used the blinking of the eyes for this purpose as well as dwell time-based methods, but these techniques are either inconvenient for the user or requires a long time for target selection. Therefore, in this paper, we propose a method for fuzzy system-based target selection for near-infrared (NIR) camera-based gaze trackers. The results of experiments performed in addition to tests of the usability and on-screen keyboard use of the proposed method show that it is better than previous methods.

Pupillary response indexes the metrical hierarchy of unattended rhythmic violations

The perception of music is a complex interaction between what we hear and our interpretation. This is reflected in beat perception, in which a listener infers a regular pulse from a musical rhythm. Although beat perception is a fundamental human ability, it is still unknown whether attention to the music is necessary to establish the perception of stronger and weaker beats, or meter. In addition, to what extent beat perception is dependent on musical expertise is still a matter of debate. Here, we address these questions by measuring the pupillary response to omissions at different metrical positions in drum rhythms, while participants attended to another task. We found that the omission of the salient first beat elicited a larger pupil dilation than the omission of the less-salient second beat. This result shows that participants not only detected the beat without explicit attention to the music, but also perceived a metrical hierarchy of stronger and weaker beats. This suggests that hierarchical beat perception is an automatic process that requires no or minimal attentional resources. In addition, we found no evidence for the hypothesis that hierarchical beat perception is affected by musical expertise, suggesting that elementary beat perception might be independent from musical expertise. Finally, our results show that pupil dilation reflects surprise without explicit attention, demonstrating that the pupil is an accessible index to signatures of unattentive processing.

Rapid Release From Listening Effort Resulting From Semantic Context, and Effects of Spectral Degradation and Cochlear Implants

People with hearing impairment are thought to rely heavily on context to compensate for reduced audibility. Here, we explore the resulting cost of this compensatory behavior, in terms of effort and the efficiency of ongoing predictive language processing. The listening task featured predictable or unpredictable sentences, and participants included people with cochlear implants as well as people with normal hearing who heard full-spectrum/unprocessed or vocoded speech. The crucial metric was the growth of the pupillary response and the reduction of this response for predictable versus unpredictable sentences, which would suggest reduced cognitive load resulting from predictive processing. Semantic context led to rapid reduction of listening effort for people with normal hearing; the reductions were observed well before the offset of the stimuli. Effort reduction was slightly delayed for people with cochlear implants and considerably more delayed for normal-hearing listeners exposed to spectrally degraded noise-vocoded signals; this pattern of results was maintained even when intelligibility was perfect. Results suggest that speed of sentence processing can still be disrupted, and exertion of effort can be elevated, even when intelligibility remains high. We discuss implications for experimental and clinical assessment of speech recognition, in which good performance can arise because of cognitive processes that occur after a stimulus, during a period of silence. Because silent gaps are not common in continuous flowing speech, the cognitive/linguistic restorative processes observed after sentences in such studies might not be available to listeners in everyday conversations, meaning that speech recognition in conventional tests might overestimate sentence-processing capability.

Attentional Mechanisms during the Performance of a Subsecond Timing Task

There is evidence that timing processes in the suprasecond scale are modulated by attentional mechanisms; in addition, some studies have shown that attentional mechanisms also affect timing in the subsecond scale. Our aim was to study eye movements and pupil diameter during a temporal bisection task in the subsecond range. Subjects were trained to discriminate anchor intervals of 200 or 800 msec, and were then confronted with intermediate durations. Eye movements revealed that subjects used different cognitive strategies during the bisection timing task. When the stimulus to be timed appeared randomly at a central or 4 peripheral positions on a screen, some subjects choose to maintain their gaze toward the central area while other followed the peripheral placement of the stimulus; some others subjects used both strategies. The time of subjective equality did not differ between subjects who employed different attentional mechanisms. However, differences emerged in the timing variance and attentional indexes (time taken to initial fixation, latency to respond, pupil dilatation and duration and number of fixations to stimulus areas). Timing in the subsecond range seems invariant despite the use of different attentional strategies. Future research should determine whether the selection of attentional mechanisms is related to particular timing tasks or instructions or whether it represents idiosyncratic cognitive “styles”.

Culture-Fair Cognitive Ability Assessment

Valid assessment with diverse populations requires tools that are not influenced by cultural elements. This study investigated the relationships between culture, information processing efficiency, and general cognitive capacities in samples of Caucasian and Mexican American college students. Consistent with the neural efficiency hypothesis, pupillary responses (indexing mental effort) and detection accuracy scores on a visual backward-masking task were both significantly related to the Wechsler Adult Intelligence Scale-Revised (WAIS-R) Full Scale scores. These measures of information processing efficiency were similar in the two groups. However, they were related only to Caucasian American, but not to a comparable sample of Mexican American, students’ WAIS-R scores. Therefore, the differential validity in prediction suggests that the WAIS-R test may contain cultural influences that reduce the validity of the WAIS-R as a measure of cognitive ability for Mexican American students. Information processing and psychophysiological approaches may be helpful in developing culture-fair cognitive ability measures.

Impact of Background Noise and Sentence Complexity on Processing Demands during Sentence Comprehension

Speech comprehension in adverse listening conditions can be effortful even when speech is fully intelligible. Acoustical distortions typically make speech comprehension more effortful, but effort also depends on linguistic aspects of the speech signal, such as its syntactic complexity. In the present study, pupil dilations, and subjective effort ratings were recorded in 20 normal-hearing participants while performing a sentence comprehension task. The sentences were either syntactically simple (subject-first sentence structure) or complex (object-first sentence structure) and were presented in two levels of background noise both corresponding to high intelligibility. A digit span and a reading span test were used to assess individual differences in the participants' working memory capacity (WMC). The results showed that the subjectively rated effort was mostly affected by the noise level and less by syntactic complexity. Conversely, pupil dilations increased with syntactic complexity but only showed a small effect of the noise level. Participants with higher WMC showed increased pupil responses in the higher-level noise condition but rated sentence comprehension as being less effortful compared to participants with lower WMC. Overall, the results demonstrate that pupil dilations and subjectively rated effort represent different aspects of effort. Furthermore, the results indicate that effort can vary in situations with high speech intelligibility.

Ginseng and Ginkgo Biloba Effects on Cognition as Modulated by Cardiovascular Reactivity: A Randomised Trial

Background

There is some evidence to suggest that ginseng and Ginkgo biloba can improve cognitive performance, however, very little is known about the mechanisms associated with such improvement. Here, we tested whether cardiovascular reactivity to a task is associated with cognitive improvement.

Methodology/Principal findings

Using a double-blind, placebo controlled, crossover design, participants (N = 24) received two doses of Panax Ginseng (500, 1000 mg) or Ginkgo Biloba (120, 240 mg) (N = 24), and underwent a series of cognitive tests while systolic, diastolic, and heart rate readings were taken. Ginkgo Biloba improved aspects of executive functioning (Stroop and Berg tasks) in females but not in males. Ginseng had no effect on cognition. Ginkgo biloba in females reversed the initial (i.e. placebo) increase in cardiovascular reactivity (systolic and diastolic readings increased compared to baseline) to cognitive tasks. This effect (reversal) was most notable after those tasks (Stroop and Iowa) that elicited the greatest cardiovascular reactivity during placebo. In males, although ginkgo also decreased cardiovascular readings, it did so from an initial (placebo) blunted response (i.e. decrease or no change from baseline) to cognitive tasks. Ginseng, on the contrary, increased cardiovascular readings compared to placebo.

Conclusions/Significance

These results suggest that cardiovascular reactivity may be a mechanism by which ginkgo but not ginseng, in females is associated with certain forms of cognitive improvement.

Trial Registration

ClinicalTrials.gov NCT02386852

Cross-Modal and Intra-Modal Characteristics of Visual Function and Speech Perception Performance in Postlingually Deafened, Cochlear Implant Users

Evidence of visual-auditory cross-modal plasticity in deaf individuals has been widely reported. Superior visual abilities of deaf individuals have been shown to result in enhanced reactivity to visual events and/or enhanced peripheral spatial attention. The goal of this study was to investigate the association between visual-auditory cross-modal plasticity and speech perception in post-lingually deafened, adult cochlear implant (CI) users. Post-lingually deafened adults with CIs (N = 14) and a group of normal hearing, adult controls (N = 12) participated in this study. The CI participants were divided into a good performer group (good CI, N = 7) and a poor performer group (poor CI, N = 7) based on word recognition scores. Visual evoked potentials (VEP) were recorded from the temporal and occipital cortex to assess reactivity. Visual field (VF) testing was used to assess spatial attention and Goldmann perimetry measures were analyzed to identify differences across groups in the VF. The association of the amplitude of the P1 VEP response over the right temporal or occipital cortex among three groups (control, good CI, poor CI) was analyzed. In addition, the association between VF by different stimuli and word perception score was evaluated. The P1 VEP amplitude recorded from the right temporal cortex was larger in the group of poorly performing CI users than the group of good performers. The P1 amplitude recorded from electrodes near the occipital cortex was smaller for the poor performing group. P1 VEP amplitude in right temporal lobe was negatively correlated with speech perception outcomes for the CI participants (r = -0.736, P = 0.003). However, P1 VEP amplitude measures recorded from near the occipital cortex had a positive correlation with speech perception outcome in the CI participants (r = 0.775, P = 0.001). In VF analysis, CI users showed narrowed central VF (VF to low intensity stimuli). However, their far peripheral VF (VF to high intensity stimuli) was not different from the controls. In addition, the extent of their central VF was positively correlated with speech perception outcome (r = 0.669, P = 0.009). Persistent visual activation in right temporal cortex even after CI causes negative effect on outcome in post-lingual deaf adults. We interpret these results to suggest that insufficient intra-modal (visual) compensation by the occipital cortex may cause negative effects on outcome. Based on our results, it appears that a narrowed central VF could help identify CI users with poor outcomes with their device.

Costs of storing colour and complex shape in visual working memory: Insights from pupil size and slow waves

We investigated the impact of perceptual processing demands on visual working memory of coloured complex random polygons during change detection. Processing load was assessed by pupil size (Exp. 1) and additionally slow wave potentials (Exp. 2). Task difficulty was manipulated by presenting different set sizes (1, 2, 4 items) and by making different features (colour, shape, or both) task-relevant. Memory performance in the colour condition was better than in the shape and both condition which did not differ. Pupil dilation and the posterior N1 increased with set size independent of type of feature. In contrast, slow waves and a posterior P2 component showed set size effects but only if shape was task-relevant. In the colour condition slow waves did not vary with set size. We suggest that pupil size and N1 indicates different states of attentional effort corresponding to the number of presented items. In contrast, slow waves reflect processes related to encoding and maintenance strategies. The observation that their potentials vary with the type of feature (simple colour versus complex shape) indicates that perceptual complexity already influences encoding and storage and not only comparison of targets with memory entries at the moment of testing.

Modulation of resource allocation by intelligent individuals in linguistic, mathematical and visuo-spatial tasks

This study investigates two questions: first, how individuals with high-intelligence allocate cognitive resources while solving linguistic, mathematical and visuo-spatial tasks with varying degree of difficulty as compared to individuals with low intelligence? Second, how to distinguish between high and low intelligent individuals by analyzing pupil dilation and eye blink together? We measured the response time, error rates along with pupil dilation and eye blink rate that indicate resource allocation. We divided the whole processing into three stages namely: pre-stimuli (5s prior to stimuli onset), during stimuli and post stimuli (until 5s after the response) for better assessment of preparation and resource allocation strategies. Individuals with high intelligence showed greater task evoked pupil dilation, decreased eye blink with less response time and error rates during-stimuli stage (processing) of tough linguistic and visuo-spatial tasks but not during mathematical tasks. The finding suggests that individuals with high intelligence allocate more resources if the task demands are high else they allocate less resources. Greater pre-stimuli pupil dilation and increased eye blink of high intelligent individuals in all tasks indicated their attentiveness and preparedness. The result of our study shows that individuals with high intelligence are more attentive and flexible in terms of altering the resource allocation strategy according to task demand. Eye-blinks along with pupil dilation and other behavioral parameters can be reliably used to assess the intelligence of an individual and the analysis of pupil dilation and blink rate at pre-stimuli stage can be crucial in distinguishing individuals with varying intelligence.

Pupillary responses during a joint attention task are associated with nonverbal cognitive abilities and sub-clinical symptoms of autism

Measures of pupillary dilation provide a temporally sensitive, quantitative indicator of cognitive resource allocation. The current study included 39 typically developing children between 3 and 9 years of age. Children completed a free-viewing task designed to elicit gaze following, a core deficit of Autism Spectrum Disorders (ASD). Results revealed a negative association between children's pupil dilation and a standardized measure of nonverbal intelligence, suggesting that children with lower intelligence allocated more cognitive resources than children with higher intelligence. In addition, the results revealed a negative association between pupil dilation and a parent-report measure of sub-clinical symptoms of ASD, suggesting that children with fewer ASD-related symptoms allocated more cognitive resources than children who showed more sub-clinical symptoms of ASD. Both associations were independent of each other and could not be explained by variation in chronological age. These findings extend previous research demonstrating associations between basic aspects of visual processing and intelligence. In addition, these findings comport with recent theories of ASD that emphasize reduced sensitivity to the reward value of social situations. When confronted with social ambiguity, children with more ASD-related symptoms allocated fewer cognitive resources to resolving this ambiguity than children who showed fewer sub-clinical symptoms of ASD.

Impact of chronotype and time perspective on the processing of scripts

Little is known about the impact of temporal orientation (chronotype; time perspective) on cognitive performance. This study adopted a psychophysiological approach to explore how chronotype (morningness-eveningness) and time perspective (present; future) influence time succession as another aspect of psychological time that is entailed within script knowledge. In a temporal judgment task, participants decided which of the two presented sub-events (e.g., get new batteries-set right time on alarm clock) comes earlier (or later) within a given script (e.g., changing batteries in an alarm clock). Behavioral and pupillary data suggest a differential impact of chronotype and time perspective on script knowledge and cognitive performance. The impact of time perspective on the processing of temporal information entailed in script knowledge appears linked to match or mismatch conditions between a strong focus on future outcomes associated with future time perspective and the task of identifying either the later (future-oriented) or the earlier (past-oriented) sub-event. Concerning the chronotype, evening types process items in which chronological time succession is violated (i.e., reversely presented items) more accurately than morning types. Indexed by pupillary data, the impact of chronotype may relate to more general cognitive abilities. The psychophysiological data derived in this study suggests that evening types typically outperform morning types in various measures such working memory capacity and verbal intelligence simply because they invest more cognitive resources than morning types.

Processing speed training increases the efficiency of attentional resource allocation in young adults

Cognitive training has been shown to improve performance on a range of tasks. However, the mechanisms underlying these improvements are still unclear. Given the wide range of transfer effects, it is likely that these effects are due to a factor common to a wide range of tasks. One such factor is a participant's efficiency in allocating limited cognitive resources. The impact of a cognitive training program, Processing Speed Training (PST), on the allocation of resources to a set of visual tasks was measured using pupillometry in 10 young adults as compared to a control group of a 10 young adults (n = 20). PST is a well-studied computerized training program that involves identifying simultaneously presented central and peripheral stimuli. As training progresses, the task becomes increasingly more difficult, by including peripheral distracting stimuli and decreasing the duration of stimulus presentation. Analysis of baseline data confirmed that pupil diameter reflected cognitive effort. After training, participants randomized to PST used fewer attentional resources to perform complex visual tasks as compared to the control group. These pupil diameter data indicated that PST appears to increase the efficiency of attentional resource allocation. Increases in cognitive efficiency have been hypothesized to underlie improvements following experience with action video games, and improved cognitive efficiency has been hypothesized to underlie the benefits of PST in older adults. These data reveal that these training schemes may share a common underlying mechanism of increasing cognitive efficiency in younger adults.

Task difficulty differentially affects two measures of processing load: the pupil response during sentence processing and delayed cued recall of the sentences

PURPOSE

In this study, the authors assessed the influence of masking level (29% or 71% sentence perception) and test modality on the processing load during language perception as reflected by the pupil response. In addition, the authors administered a delayed cued stimulus recall test to examine whether processing load affected the encoding of the stimuli in memory.

METHOD

Participants performed speech and text reception threshold tests, during which the pupil response was measured. In the cued recall test, the first half of correctly perceived sentences was presented, and participants were asked to complete the sentences. Reading and listening span tests of working memory capacity were presented as well.

RESULTS

Regardless of test modality, the pupil response indicated higher processing load in the 29% condition than in the 71% correct condition. Cued recall was better for the 29% condition.

CONCLUSIONS

The consistent effect of masking level on the pupil response during listening and reading support the validity of the pupil response as a measure of processing load during language perception. The absent relation between pupil response and cued recall may suggest that cued recall is not directly related to processing load, as reflected by the pupil response.

Off-line and on-line stress detection through processing of the pupil diameter signal

The pupil diameter (PD), controlled by the autonomic nervous system, seems to provide a strong indication of affective arousal, as found by previous research, but it has not been investigated fully yet. In this study, new approaches based on monitoring and processing the PD signal for off-line and on-line "relaxation" vs. "stress" differentiation are proposed. For the off-line approach, wavelet denoising, Kalman filtering, data normalization, and feature extraction are sequentially utilized. For the on-line approach, a hard threshold, a moving average window and three stress detection steps are implemented. In order to use only the most reliable data, two types of data selection methods (paired t test based on galvanic skin response (GSR) data and subject self-evaluation) are applied, achieving average classification accuracies up to 86.43 and 87.20% for off-line and 72.30 and 73.55% for on-line algorithms, with each set of selected data, respectively. The GSR was also monitored and processed in our experiments for comparison purposes, with the highest classification rate achieved being only 63.57% (based on the off-line processing algorithm). The overall results show that the PD signal is more effective and robust for differentiating "relaxation" vs. "stress," in comparison with the traditionally used GSR signal.

Motivation modulates visual attention: evidence from pupillometry

Increasing evidence suggests that action planning does not only affect the preparation and execution of overt actions but also "works back" to tune the perceptual system toward action-relevant information. We investigated whether the amount of this impact of action planning on perceptual selection varies as a function of motivation for action, which was assessed online by means of pupillometry (Experiment 1) and visual analog scales (VAS, Experiment 2). Findings replicate the earlier observation that searching for size-defined targets is more efficient in the context of grasping than in the context of pointing movements (Wykowska et al., 2009). As expected, changes in tonic pupil size (reflecting changes in effort and motivation) across the sessions, as well as changes in motivation-related scores on the VAS were found to correlate with changes in the size of the action-perception congruency effect. We conclude that motivation and effort might play a crucial role in how much participants prepare for an action and activate action codes. The degree of activation of action codes in turn influences the observed action-related biases on perception.

Pupil size varies with word listening and response selection difficulty in older adults with hearing loss

Listening to speech in noise can be exhausting, especially for older adults with impaired hearing. Pupil dilation is thought to track the difficulty associated with listening to speech at various intelligibility levels for young and middle-aged adults. This study examined changes in the pupil response with acoustic and lexical manipulations of difficulty in older adults with hearing loss. Participants identified words at two signal-to-noise ratios (SNRs) among options that could include a similar-sounding lexical competitor. Growth Curve Analyses revealed that the pupil response was affected by an SNR × Lexical competition interaction, such that it was larger and more delayed and sustained in the harder SNR condition, particularly in the presence of lexical competition. Pupillometry detected these effects for correct trials and across reaction times, suggesting it provides additional evidence of task difficulty than behavioral measures alone.

Pupil and salivary indicators of autonomic dysfunction in autism spectrum disorder

Dysregulated tonic pupil size has been reported in autism spectrum disorder (ASD). Among the possible sources of this dysregulation are disruptions in the feedback loop between norepinephrine (NE) and hypothalamic systems. In the current study, we examined afternoon levels of salivary alpha-amylase (sAA, a putative correlate of NE) and cortisol (used to assess stress-based responses) in two independent samples of children with ASD. We found a larger pupil size and lower sAA levels in ASD, compared to typical and clinical age-matched controls. This was substantiated at the individual level, as sAA levels were strongly correlated with tonic pupil size. Relatively little diurnal variation in sAA taken in the home environment in the ASD group was also observed, while typical controls showed a significant linear increase throughout the day. Results are discussed in terms of potential early biomarkers and the elucidation of underlying neural dysfunction in ASD.