Effort during visual search and counting: Insights from pupillometry

Effective engagement in computerized cognitive training for older adults

Computerized cognitive training (CCT) is a frontline therapy to prevent or slow age-related cognitive decline. A prerequisite for CCT research to provide clinically relevant improvements in cognition is to understand effective engagement, i.e., the pattern of energy investment that ensures CCT effectiveness. Even though previous studies have assessed whether particular variables (e.g., gamification) predict engagement and/or CCT effectiveness, the field lacks a systematic approach to understanding effective engagement. Here, by comprehensively reviewing and evaluating engagement and adjacent literature, we propose a standardized measurement and operational framework to promote effective engagement with CCT targeting cognitive decline in older adults. We suggest that promoting effective engagement with CCT has two key steps: 1) comprehensively measuring engagement with CCT and 2) identifying which aspects of engagement are essential to achieve the pre-specified outcome of clinically relevant improvements in cognition. The proposed measurement and operational framework of effective engagement will allow future research to maximize older adults' engagement with CCT to slow/prevent age-related cognitive decline.

Entrainment of visuomotor responses to target speed during interception

Motor actions adapt dynamically to external changes through the brain's ability to predict sensory outcomes and adjust for discrepancies between anticipated and actual sensory inputs. In this study, we investigated how changes in target speed (vT) and direction influenced visuomotor responses, focusing on gaze and manual joystick control during an interception task. Participants tracked a moving target with sinusoidal variations in vT and directional changes, generating sensory prediction errors and requiring real-time adjustments. Our results demonstrate slow variations in vT entrained gaze and joystick metrics, with participants synchronizing their responses to the cycles of target motion. While target directional changes alone had limited impact, combining them with sinusoidal variations in vT led to robust behavioral entrainment. Participants also exhibited rapid within-trial adjustments, with peak gaze and joystick gains increasing linearly with vT frequency, highlighting the critical role of manual control in matching or exceeding vT for successful interception. Additionally, responses to sudden phase changes in the vT sinusoid revealed the continuous monitoring of prediction errors driven by the magnitude of phase shifts. These findings illustrate the brain's predictive system's ability to integrate continuous visual feedback and sensory prediction errors to fine-tune motor responses and anticipate future target speeds.

Self-face processing in relation to self-referential tasks in 24-month-old infants: A study through eye movements and pupillometry measures

The aim of the current study was to investigate visual scan patterns for the self-face in infants with the ability to recognize themselves with a photograph. 24-month-old infants (N = 32) were presented with faces including the self-face in the upright or inverted orientation. We also measured infants' ability to recognize oneself in a mirror and with a photograph. Results showed that only in trials with the self-face was pupil dilation greater in the upright orientation than in the inverted orientation, and that eye movements and pupil dilation were not associated with PSR tasks. Our findings suggest that the processing of the self-face was processed in a manner similar to that of others, with longer and more fixations on eyes and nose, but infants allocated more attentional resources to processing upright self-face. Self-face processing in infancy may be independent of the understanding of the self beyond the here and now.

Pupillary responses to directional uncertainty while intercepting a moving target

Pupillary responses serve as sensitive indicators of cognitive processes, attentional shifts and decision-making dynamics. Our study investigates how directional uncertainty and target speed (V T) influence pupillary responses in a foveal tracking task involving the interception of a moving dot. Directional uncertainty, reflecting the unpredictability of the target's direction changes, was manipulated by altering the angular range (AR) from which random directions for the moving dot were extracted. Higher AR values were associated with reduced pupillary diameters, indicating that heightened uncertainty led to smaller pupil sizes. Additionally, an inverse U-shaped relationship between V T and pupillary responses suggested maximal diameters at intermediate speeds. Analysis of saccade-triggered responses showed a negative correlation between pupil diameter and directional uncertainty. Dynamic linear modelling revealed the influence of past successful collisions and other behavioural parameters on pupillary responses, emphasizing the intricate interaction between task variables and cognitive processing. Our results highlight the dynamic interplay between the directional uncertainty of a single moving target, V T and pupillary responses, with implications for understanding attentional mechanisms, decision-making processes and potential applications in emerging technologies.

Task-evoked pupillary responses as potential biomarkers of mild cognitive impairment

INTRODUCTION

Eye movement alterations are effective biomarkers for Alzheimer's disease (AD). This study examines task-evoked pupillary responses (TEPRs) as potential biomarkers of the mild cognitive impairment (MCI), the symptomatic stage preceding AD.

METHODS

The prospective cohort study included 213 MCI patients and 514 cognitively normal controls (CNs). Participants performed a prosaccade (PS) or antisaccade (AS) task while their eye movements were tracked using a Tobii Pro Spectrum system.

RESULTS

The CNs showed unique TEPRs linked to better performance, characterized by larger baselines, greater PS target-onset variability, and smaller AS target-onset variability. Conversely, for MCI patients, better performance was linked to larger AS target-onset sizes. Furthermore, MCI patients displayed reduced dilation during the cue and target-onset periods compared to CNs.

DISCUSSION

MCI patients showed altered pupillary response patterns associated with cognitive task performance, highlighting the potential of oculomotor changes as a biomarker for early cognitive decline.

Highlights

MCI patients displayed markedly smaller pupil dilation than CNs in response to cue and target stimuli.For MCI patients, larger pupil size upon target appearance during antisaccades correlated with better performance.Faster and more consistent prosaccades were linked to better performance in both groups.For MCI patients, the association between longer AS latencies and better performance was more pronounced than in CNs.Combined analysis of TEPRs and saccade performances in a sizeable cohort strengthens the generalizability of our findings to the broader MCI population.

Investigating an effort avoidance account of attentional strategy choice

People often choose suboptimal attentional control strategies during visual search. This has been at least partially attributed to the avoidance of the cognitive effort associated with the optimal strategy, but aspects of the task triggering such avoidance remain unclear. Here, we attempted to measure effort avoidance of an isolated task component to assess whether this component might drive suboptimal behavior. We adopted a modified version of the Adaptive Choice Visual Search (ACVS), a task designed to measure people's visual search strategies. To perform optimally, participants must make a numerosity judgment-estimating and comparing two color sets-before they can advantageously search through the less numerous of the two. If participants skip the numerosity judgment step, they can still perform accurately, albeit substantially more slowly. To study whether effort associated with performing the optional numerosity judgment could be an obstacle to optimal performance, we created a variant of the demand selection task to quantify the avoidance of numerosity judgment effort. Results revealed a robust avoidance of the numerosity judgment, offering a potential explanation for why individuals choose suboptimal strategies in the ACVS task. Nevertheless, we did not find a significant relationship between individual numerosity judgment avoidance and ACVS optimality, and we discussed potential reasons for this lack of an observed relationship. Altogether, our results showed that the effort avoidance for specific subcomponents of a visual search task can be probed and linked to overall strategy choices.

Utilising raw psycho-physiological data and functional data analysis for estimating mental workload in human drivers

Recent studies have focused on accurately estimating mental workload using machine learning algorithms and extracting features from physiological measures. However, feature extraction leads to the loss of valuable information and often results in binary classifications that lack specificity in the identification of optimum mental workload. This study investigates the feasibility of using raw physiological data (EEG, facial EMG, ECG, EDA, pupillometry) combined with Functional Data Analysis (FDA) to estimate the mental workload of human drivers. A driving scenario with five tasks was employed, and subjective ratings were collected. Results demonstrate that the FDA applied nine different combinations of raw physiological signals achieving a maximum 90% accuracy, outperforming extracted features by 73%. This study shows that the mental workload of human drivers can be accurately estimated without utilising burdensome feature extraction. The approach proposed in this study offers promise for mental workload assessment in real-world applications.

Predicting Driver's mental workload using physiological signals: A functional data analysis approach

This study investigates the impact of advanced driver-assistance systems on drivers' mental workload. Using a combination of physiological signals including ECG, EMG, EDA, EEG (af4 and fc6 channels from the theta band), and eye diameter data, this study aims to predict and categorize drivers' mental workload into low, adequate, and high levels. Data were collected from five different driving situations with varying cognitive demands. A functional linear regression model was employed for prediction, and the accuracy rate was calculated. Among the 31 tested combinations of physiological variables, 9 combinations achieved the highest accuracy result of 90%. These results highlight the potential benefits of utilizing raw physiological signal data and employing functional data analysis methods to understand and assess driver mental workload. The findings of this study have implications for the design and improvement of driver-assistance systems to optimize safety and performance.

Prediction of Robotic Anastomosis Competency Evaluation (RACE) metrics during vesico-urethral anastomosis using electroencephalography, eye-tracking, and machine learning

Residents learn the vesico-urethral anastomosis (VUA), a key step in robot-assisted radical prostatectomy (RARP), early in their training. VUA assessment and training significantly impact patient outcomes and have high educational value. This study aimed to develop objective prediction models for the Robotic Anastomosis Competency Evaluation (RACE) metrics using electroencephalogram (EEG) and eye-tracking data. Data were recorded from 23 participants performing robot-assisted VUA (henceforth 'anastomosis') on plastic models and animal tissue using the da Vinci surgical robot. EEG and eye-tracking features were extracted, and participants' anastomosis subtask performance was assessed by three raters using the RACE tool and operative videos. Random forest regression (RFR) and gradient boosting regression (GBR) models were developed to predict RACE scores using extracted features, while linear mixed models (LMM) identified associations between features and RACE scores. Overall performance scores significantly differed among inexperienced, competent, and experienced skill levels (P value < 0.0001). For plastic anastomoses, R2 values for predicting unseen test scores were: needle positioning (0.79), needle entry (0.74), needle driving and tissue trauma (0.80), suture placement (0.75), and tissue approximation (0.70). For tissue anastomoses, the values were 0.62, 0.76, 0.65, 0.68, and 0.62, respectively. The models could enhance RARP anastomosis training by offering objective performance feedback to trainees.

First steps into the pupillometry multiverse of developmental science

Pupillometry has been widely implemented to investigate cognitive functioning since infancy. Like most psychophysiological and behavioral measures, it implies hierarchical levels of arbitrariness in preprocessing before statistical data analysis. By means of an illustrative example, we checked the robustness of the results of a familiarization procedure that compared the impact of audiovisual and visual stimuli in 12-month-olds. We adopted a multiverse approach to pupillometry data analysis to explore the role of (1) the preprocessing phase, that is, handling of extreme values, selection of the areas of interest, management of blinks, baseline correction, participant inclusion/exclusion and (2) the modeling structure, that is, the incorporation of smoothers, fixed and random effects structure, in guiding the parameter estimation. The multiverse of analyses shows how the preprocessing steps influenced the regression results, and when visual stimuli plausibly predicted an increase of resource allocation compared with audiovisual stimuli. Importantly, smoothing time in statistical models increased the plausibility of the results compared to those nested models that do not weigh the impact of time. Finally, we share theoretical and methodological tools to move the first steps into (rather than being afraid of) the inherent uncertainty of infant pupillometry.

Detecting feigned cognitive impairment using pupillometry on the Warrington Recognition Memory Test for Words

OBJECTIVE

Pupillometry provides information about physiological and psychological processes related to cognitive load, familiarity, and deception, and it is outside of conscious control. This study examined pupillary dilation patterns during a performance validity test (PVT) among adults with true and feigned impairment of traumatic brain injury (TBI).

PARTICIPANTS AND METHODS

Participants were 214 adults in three groups: adults with bona fide moderate to severe TBI (TBI; n = 51), healthy comparisons instructed to perform their best (HC; n = 72), and healthy adults instructed and incentivized to simulate cognitive impairment due to TBI (SIM; n = 91). The Recognition Memory Test (RMT) was administered in the context of a comprehensive neuropsychological battery. Three pupillary indices were evaluated. Two pure pupil dilation (PD) indices assessed a simple measure of baseline arousal (PD-Baseline) and a nuanced measure of dynamic engagement (PD-Range). A pupillary-behavioral index was also evaluated. Dilation-response inconsistency (DRI) captured the frequency with which examinees displayed a pupillary familiarity response to the correct answer but selected the unfamiliar stimulus (incorrect answer).

RESULTS

All three indices differed significantly among the groups, with medium-to-large effect sizes. PD-Baseline appeared sensitive to oculomotor dysfunction due to TBI; adults with TBI displayed significantly lower chronic arousal as compared to the two groups of healthy adults (SIM, HC). Dynamic engagement (PD-Range) yielded a hierarchical structure such that SIM were more dynamically engaged than TBI followed by HC. As predicted, simulators engaged in DRI significantly more frequently than other groups. Moreover, subgroup analyses indicated that DRI differed significantly for simulators who scored in the invalid range on the RMT (n = 45) versus adults with genuine TBI who scored invalidly (n = 15).

CONCLUSIONS

The findings support continued research on the application of pupillometry to performance validity assessment: Overall, the findings highlight the promise of biometric indices in multimethod assessments of performance validity.

Pupillary dilations in a Target/Distractor visual task paradigm and attention deficit hyperactivity disorder (ADHD)

ADHD is a neurocognitive disorder characterized by attention difficulties, hyperactivity, and impulsivity, often persisting into adulthood with substantial personal and societal consequences. Despite the importance of neurophysiological assessment and treatment monitoring tests, their availability outside of research settings remains limited. Cognitive neuroscience investigations have identified distinct components associated with ADHD, including deficits in sustained attention, inefficient enhancement of attended Targets, and altered suppression of ignored Distractors. In this study, we examined pupil activity in control and ADHD subjects during a sustained visual attention task specifically designed to evaluate the mechanisms underlying Target enhancement and Distractor suppression. Our findings revealed some distinguishing factors between the two groups which we discuss in light of their neurobiological implications.

Elevated and accelerated: Locus coeruleus activity and visual search abilities in autistic children

BACKGROUND

Autistic individuals excel at visual search, however, the neural mechanism(s) underlying this advantage remain unclear. The locus coeruleus-norepinephrine (LC-NE) system, which plays a critical role in sensory perception and selective attention, has been shown to function in a persistently elevated state in individuals on the spectrum. However, the relationship between elevated tonic LC-NE activity and accelerated search in autism has not been explored.

OBJECTIVE

To examine the relationship between visual search abilities and resting pupil diameter (an indirect measure of tonic LC-NE activation) in autistic and neurotypical children.

METHODS

Participants were 24 school-aged autistic children and 24 age- and IQ-matched neurotypical children aged 8-15 years. Children completed two tasks: a resting eye-tracking task and a visual search paradigm. For the resting eye-tracking task, pupil diameter was monitored while participants fixated a central crosshair. For the visual search paradigm, participants were instructed to find the target (vertical line) embedded within an array of tilted (10°) distractor lines. The target was present on 50% of trials, and displayed within set sizes of 18, 24, and 36 items.

RESULTS

Consistent with previous studies, autistic children had significantly larger resting pupil size and searched faster and more efficiently compared to their neurotypical peers. Eye-tracking findings revealed that accelerated search was associated with fewer, not shorter, fixations in the autism group. Autistic children also showed reduced leftward search bias. Larger resting pupil size, indicative of increased tonic activation of the LC-NE system, was associated with greater search efficiency, longer fixation durations, and reduced leftward bias. Finally, within both groups reduced leftward bias was associated with increased autism symptomatology.

DISCUSSION

Together, these findings add to the existing body of research highlighting superior search in autism, suggest that elevated tonic LC-NE activity may contribute to more efficient search, and link non-social visual-spatial processing strengths to autism symptoms.

Attentional, emotional, and behavioral response toward spiders, scorpions, crabs, and snakes provides no evidence for generalized fear between spiders and scorpions

Spiders are among the animals evoking the highest fear and disgust and such a complex response might have been formed throughout human evolution. Ironically, most spiders do not present a serious threat, so the evolutionary explanation remains questionable. We suggest that other chelicerates, such as scorpions, have been potentially important in the formation and fixation of the spider-like category. In this eye-tracking study, we focused on the attentional, behavioral, and emotional response to images of spiders, scorpions, snakes, and crabs used as task-irrelevant distractors. Results show that spider-fearful subjects were selectively distracted by images of spiders and crabs. Interestingly, these stimuli were not rated as eliciting high fear contrary to the other animals. We hypothesize that spider-fearful participants might have mistaken crabs for spiders based on their shared physical characteristics. In contrast, subjects with no fear of spiders were the most distracted by snakes and scorpions which supports the view that scorpions as well as snakes are prioritized evolutionary relevant stimuli. We also found that the reaction time increased systematically with increasing subjective fear of spiders only when using spiders (and crabs to some extent) but not snakes and scorpions as distractors. The maximal pupil response covered not only the attentional and cognitive response but was also tightly correlated with the fear ratings of the picture stimuli. However, participants' fear of spiders did not affect individual reactions to scorpions measured by the maximal pupil response. We conclude that scorpions are evolutionary fear-relevant stimuli, however, the generalization between scorpions and spiders was not supported in spider-fearful participants. This result might be important for a better understanding of the evolution of spider phobia.

Dysregulated noradrenergic response is associated with symptom severity in individuals with schizophrenia

Introduction

The locus coeruleus-noradrenaline (LC-NA) system is involved in a wide range of cognitive functions and may be altered in schizophrenia. A non-invasive method to indirectly measure LC activity is task-evoked pupillary response. Individuals with schizophrenia present reduced pupil dilation compared to healthy subjects, particularly when task demand increases. However, the extent to which alteration in LC activity contributes to schizophrenia symptomatology remains largely unexplored. We aimed to investigate the association between symptomatology, cognition, and noradrenergic response in individuals with schizophrenia.

Methods

We assessed task-evoked pupil dilation during a pro- and antisaccade task in 23 individuals with schizophrenia and 28 healthy subjects.

Results

Both groups showed similar preparatory pupil dilation during prosaccade trials, but individuals with schizophrenia showed significantly lower pupil dilation compared to healthy subjects in antisaccade trials. Importantly, reduced preparatory pupil dilation for antisaccade trials was associated with worse general symptomatology in individuals with schizophrenia.

Discussion

Our findings suggest that changes in LC-NA activity - measured by task-evoked pupil dilation - when task demand increases is associated with schizophrenia symptoms. Interventions targeting the modulation of noradrenergic responses may be suitable candidates to reduce schizophrenia symptomatology.

Deficits in the pupillary response associated with abnormal visuospatial attention allocation in mild traumatic brain injury

INTRODUCTION

The ability to allocate visual attention is known to be impaired in patients with mild traumatic brain injury (mTBI). In the present study, we investigated a possible neural correlate of this cognitive deficit by examining the pupil response of patients with mTBI whilst performing a modified Posner visual search task.

METHOD

Two experiments were conducted in which the target location was either not cued (Experiment 1) or cued (Experiment 2). Additionally, in Experiment 2, the type of cue (endogenous vs exogenous cue) and cue validity were treated as independent variables. In both experiments, search efficiency was varied by changing shape similarity between target and distractor patterns. The reaction time required to judge whether the target was present or absent and pupil dilation metrics, particularly the pupil dilation latency (PDL) and amplitude (PDA), were measured. Thirteen patients with chronic mTBI and 21 age-, sex-, and IQ -matched controls participated in the study.

RESULTS

In Experiment 1, patients with mTBI displayed a similar PDA for both efficient and inefficient search conditions, while control participants had a significantly larger PDA in inefficient search conditions compared to efficient search conditions. As cognitive load is positively correlated with PDA, our findings suggest that mTBI patients were unable to apply more mental effort whilst performing visual search, particularly if the task is difficult when visual search is inefficient. In Experiment 2, when the target location was cued, patients with mTBI displayed no significant pupil dilation response to the target regardless of the efficiency of the search, nor whether the cue was valid or invalid. These results contrasted with control participants, who were additionally sensitive to the validity of the cue in which PDA was smaller for cue-valid conditions than invalid conditions, particularly for efficient search conditions.

CONCLUSION

Pupillometry provided further evidence of attention allocation deficits following mTBI.

Pupil response patterns distinguish true from false memories

Memory is reconstructive and error-prone, which make memory illusions very common in everyday life. However, studying memory illusions can provide valuable insights into how memory works. Pupil response has emerged, in recent years, as an indicator of memory encoding and retrieval, however its validity as a measure of memory success is debated. In this study, we explored whether pupil response patterns can differentiate true from false memories and whether variations in the temporal dynamics of pupil response can elucidate the mechanisms underlying false memory creation. The Deese-Roediger-McDermott (DRM) paradigm was employed to generate false memories in two separate experiments involving visual and auditory stimuli. Pupil responses effectively differentiated true from false memories based on variations in pupil amplitude at different temporal components. This discrimination remained consistent across both experiments, with slightly stronger effects in the auditory condition, aligning with the more pronounced false memory effects in this condition. Notably, differential pupil responses between true and false memories varied based on the type of memory involved at recognition. These findings provide valuable insights into the cognitive processes underlying memory distortions, with implications for theoretical frameworks and real-world contexts.

Multi-dimensional task recognition for human-robot teaming: literature review

Human-robot teams collaborating to achieve tasks under various conditions, especially in unstructured, dynamic environments will require robots to adapt autonomously to a human teammate's state. An important element of such adaptation is the robot's ability to infer the human teammate's tasks. Environmentally embedded sensors (e.g., motion capture and cameras) are infeasible in such environments for task recognition, but wearable sensors are a viable task recognition alternative. Human-robot teams will perform a wide variety of composite and atomic tasks, involving multiple activity components (i.e., gross motor, fine-grained motor, tactile, visual, cognitive, speech and auditory) that may occur concurrently. A robot's ability to recognize the human's composite, concurrent tasks is a key requirement for realizing successful teaming. Over a hundred task recognition algorithms across multiple activity components are evaluated based on six criteria: sensitivity, suitability, generalizability, composite factor, concurrency and anomaly awareness. The majority of the reviewed task recognition algorithms are not viable for human-robot teams in unstructured, dynamic environments, as they only detect tasks from a subset of activity components, incorporate non-wearable sensors, and rarely detect composite, concurrent tasks across multiple activity components.

The Pupil Knows: Pupil Dilation Indexes and Their Inhibitory Ability in Normal Aging

Pupil dilation is considered an index of cognitive effort, as the pupil typically dilates as the cognitive load increases. In this paper, we evaluated whether older adults demonstrate increased pupil size when performing tasks requiring cognitive inhibition. We invited 44 older and 44 younger adults to perform the Stroop task while their pupil dilation was recorded with eye-tracking glasses. The dependent variables were the number of accurate responses on the Stroop task as well as pupil size in the three conditions of the task (i.e., color naming, word reading, and the interference condition). The results demonstrated less accurate responses in the interference condition than in the color-naming or word-reading conditions, in both older and younger adults. Critically, larger pupil dilation was observed in the interference condition than in the color-naming and word-reading conditions, in both older and younger adults. This study demonstrates that pupil dilation responds to cognitive effort in normal aging, at least in the interference condition of the Stroop task.

A time slice analysis of dentistry students' visual search strategies and pupil dilation during diagnosing radiographs

Diagnosing orthopantomograms (OPTs: panoramic radiographs) is an essential skill dentistry students acquire during university training. While prior research described experts' visual search behavior in radiology as global-to-focal for chest radiographs and mammography, generalizability to a hybrid search task in OPTs (i.e., searching for multiple, diverse anomalies) remains unclear. Addressing this gap, this study investigated visual search of N = 107 dentistry students while they were diagnosing anomalies in OPTs. Following a global-to-focal expert model, we hypothesized that students would use many, short fixations representing global search in earlier stages, and few, long fixations representing focal search in later stages. Furthermore, pupil dilation and mean fixation duration served as cognitive load measures. We hypothesized that later stages would be characterized by elaboration and a reflective search strategy, leading to higher cognitive load being associated with higher diagnostic performance in late compared to earlier stages. In line with the first hypothesis, students' visual search comprised of a three-stage process that grew increasingly focal in terms of the number of fixations and anomalies fixated. Contrary to the second hypothesis, mean fixation duration during anomaly fixations was positively associated with diagnostic performance across all stages. As OPTs greatly varied in how difficult it was to identify the anomalies contained therein, OPTs with above-average difficulty were sampled for exploratory analysis. Pupil dilation predicted diagnostic performance for difficult OPTs, possibly capturing elaborative cognitive processes and cognitive load compared to mean fixation duration. A visual analysis of fine-grained time slices indicated large cognitive load differences towards the end of trials, showcasing a richness-resolution-trade-off in data sampling crucial for future studies using time-slicing of eye tracking data.

Neural α Oscillations and Pupil Size Differentially Index Cognitive Demand under Competing Audiovisual Task Conditions

Cognitive demand is thought to modulate two often used, but rarely combined, measures: pupil size and neural α (8-12 Hz) oscillatory power. However, it is unclear whether these two measures capture cognitive demand in a similar way under complex audiovisual-task conditions. Here we recorded pupil size and neural α power (using electroencephalography), while human participants of both sexes concurrently performed a visual multiple object-tracking task and an auditory gap detection task. Difficulties of the two tasks were manipulated independent of each other. Participants' performance decreased in accuracy and speed with increasing cognitive demand. Pupil size increased with increasing difficulty for both the auditory and the visual task. In contrast, α power showed diverging neural dynamics: parietal α power decreased with increasing difficulty in the visual task, but not with increasing difficulty in the auditory task. Furthermore, independent of task difficulty, within-participant trial-by-trial fluctuations in pupil size were negatively correlated with α power. Difficulty-induced changes in pupil size and α power, however, did not correlate, which is consistent with their different cognitive-demand sensitivities. Overall, the current study demonstrates that the dynamics of the neurophysiological indices of cognitive demand and associated effort are multifaceted and potentially modality-dependent under complex audiovisual-task conditions.SIGNIFICANCE STATEMENT Pupil size and oscillatory α power are associated with cognitive demand and effort, but their relative sensitivity under complex audiovisual-task conditions is unclear, as is the extent to which they share underlying mechanisms. Using an audiovisual dual-task paradigm, we show that pupil size increases with increasing cognitive demands for both audition and vision. In contrast, changes in oscillatory α power depend on the respective task demands: parietal α power decreases with visual demand but not with auditory task demand. Hence, pupil size and α power show different sensitivity to cognitive demands, perhaps suggesting partly different underlying neural mechanisms.

Pathologist pupil dilation reflects experience level and difficulty in diagnosing medical images

Purpose: Digital whole slide imaging allows pathologists to view slides on a computer screen instead of under a microscope. Digital viewing allows for real-time monitoring of pathologists' search behavior and neurophysiological responses during the diagnostic process. One particular neurophysiological measure, pupil diameter, could provide a basis for evaluating clinical competence during training or developing tools that support the diagnostic process. Prior research shows that pupil diameter is sensitive to cognitive load and arousal, and it switches between exploration and exploitation of a visual image. Different categories of lesions in pathology pose different levels of challenge, as indicated by diagnostic disagreement among pathologists. If pupil diameter is sensitive to the perceived difficulty in diagnosing biopsies, eye-tracking could potentially be used to identify biopsies that may benefit from a second opinion. Approach: We measured case onset baseline-corrected (phasic) and uncorrected (tonic) pupil diameter in 90 pathologists who each viewed and diagnosed 14 digital breast biopsy cases that cover the diagnostic spectrum from benign to invasive breast cancer. Pupil data were extracted from the beginning of viewing and interpreting of each individual case. After removing 122 trials ( < 10 % ) with poor eye-tracking quality, 1138 trials remained. We used multiple linear regression with robust standard error estimates to account for dependent observations within pathologists. Results: We found a positive association between the magnitude of phasic dilation and subject-centered difficulty ratings and between the magnitude of tonic dilation and untransformed difficulty ratings. When controlling for case diagnostic category, only the tonic-difficulty relationship persisted. Conclusions: Results suggest that tonic pupil dilation may indicate overall arousal differences between pathologists as they interpret biopsy cases and could signal a need for additional training, experience, or automated decision aids. Phasic dilation is sensitive to characteristics of biopsies that tend to elicit higher difficulty ratings and could indicate a need for a second opinion.

Differentiating between Bayesian parameter learning and structure learning based on behavioural and pupil measures

Within predictive processing two kinds of learning can be distinguished: parameter learning and structure learning. In Bayesian parameter learning, parameters under a specific generative model are continuously being updated in light of new evidence. However, this learning mechanism cannot explain how new parameters are added to a model. Structure learning, unlike parameter learning, makes structural changes to a generative model by altering its causal connections or adding or removing parameters. Whilst these two types of learning have recently been formally differentiated, they have not been empirically distinguished. The aim of this research was to empirically differentiate between parameter learning and structure learning on the basis of how they affect pupil dilation. Participants took part in a within-subject computer-based learning experiment with two phases. In the first phase, participants had to learn the relationship between cues and target stimuli. In the second phase, they had to learn a conditional change in this relationship. Our results show that the learning dynamics were indeed qualitatively different between the two experimental phases, but in the opposite direction as we originally expected. Participants were learning more gradually in the second phase compared to the first phase. This might imply that participants built multiple models from scratch in the first phase (structure learning) before settling on one of these models. In the second phase, participants possibly just needed to update the probability distribution over the model parameters (parameter learning).

Task-Evoked Pupillary Response as a Potential Biomarker of Dementia and Mild Cognitive Impairment: A Scoping Review

Pupil dilation functions as a proxy for cognitive effort and can be measured through automated pupillometry. The aim of this scoping review is to examine how individuals with cognitive impairment differ in task-evoked pupillary responses relative to cognitively healthy individuals. A systematic literature search across six databases was conducted to identify studies examining changes in pupillary responses evoked by cognitive tasks comparing patients with dementia to healthy controls. Eight articles met inclusion criteria and were included for review. Differences in task-evoked pupillary response between cognitively impaired and cognitively healthy participants were observed across studies. Pupil dilation is decreased in patients with Alzheimer's Disease compared to controls, with no difference observed in patients with mild cognitive impairment. A mild, non-significant trend towards reduced pupil dilation in patients with either Parkinson's Disease or Dementia with Lewy Bodies suggests a similar but less pronounced effect than in AD patients. Further research is required to examine the utility of task-evoked pupillary responses as a potential biomarker indexing cognitive decline in individuals transitioning to mild cognitive impairment and/or dementia.

The influence of experience on cognitive load during simultaneous interpretation

Simultaneous interpretation is a complex task that is assumed to be associated with a high workload. To corroborate this association, we measured workload during three tasks of increasing complexity: listening, shadowing, and interpreting, using electroencephalography and self-assessments in four groups of participants with varying experience in simultaneous interpretation. The self-assessment data showed that professional interpreters perceived the most workload-inducing condition, namely the interpreting task, as less demanding compared to the less experienced participants. This higher subjectively perceived workload in non-interpreters was paralleled by increasing frontal theta power values from listening to interpreting, whereas such a modulation was less pronounced in professional interpreters. Furthermore, regarding both workload measures, trainee interpreters were situated between professional interpreters and non-interpreters. Since the non-interpreters demonstrated high proficiencies and exposure in their second language, too, our findings provide evidence for an influence of interpretation training on experienced workload during simultaneous interpretation.

Arousal-modulated memory encoding and retrieval in adults with autism spectrum disorder

Recently, we have shown that pupil dilation during a recognition memory task can serve as an index of memory retrieval difficulties in autism. At the time of publication, we were unaware of specific data-analysis methods that can be used to shed further light on the origins of such memory related pupil dilation. Specifically, by distinguishing "tonic" from "phasic" changes in pupil dilation and considering their temporal progression, it is possible to draw inferences about the functional integrity of a locus coeruleus-norepinephrine system (LC-NE) that is known to play a key role in regulating memory encoding and retrieval processes. We therefore apply these analyses to our previously published eye-tracking data of adults with ASD (N = 24) and neurotypical development (TD, N = 30) during the recognition memory task. In this re-analysis, we related pupil dilation during encoding and retrieval to recognition accuracy in a per-trial analysis of linear mixed models. In ASD, we replicated attenuated recognition accuracy, which was accompanied by attenuated pupil dilation during encoding and retrieval. Group differences in pupil dilation during retrieval occurred late during the trial (after 1.75 s) and indicated an altered top-down processing like attenuated attribution of semantic salience in response to previously encoded stimuli. In addition, only in the ASD group were higher pupil dilation during encoding and lower pupil dilation during retrieval associated with decreased recognition accuracy. This supports altered modulation of memory encoding and retrieval in ASD, with LC-NE phasic activity as promising underlying mechanism. LAY SUMMARY: We investigated the changes of pupil size during memory testing in autism spectrum disorder. Adults with ASD remembered fewer items correctly than neurotypical individuals (TD). This reduced memory was related to increased pupillary responses at study and decreased pupil dilation at test only for adults with ASD indicating a different modulation of memory by the locus coeruleus.

Neurophysiological indicators of internal attention: An fMRI-eye-tracking coregistration study

Many goal-directed, as well as spontaneous everyday activities (e.g., planning, mind-wandering), rely on an internal focus of attention. This fMRI-eye-tracking coregistration study investigated brain mechanisms and eye behavior related to internally versus externally directed cognition. Building on an established paradigm, we manipulated internal attention demands within tasks utilizing conditional stimulus masking. Internally directed cognition involved bilateral activation of the lingual gyrus and inferior parietal lobe areas as well as wide-spread deactivation of visual networks. Moreover, internally directed cognition was related to greater pupil diameter, pupil diameter variance, blink duration, fixation disparity variance, and smaller amounts of microsaccades. FMRI-eye-tracking covariation analyses further revealed that larger pupil diameter was related to increased activation of basal ganglia and lingual gyrus. It can be concluded that internally and externally directed cognition are characterized by distinct neurophysiological signatures. The observed neurophysiological differences indicate that internally directed cognition is associated with reduced processing of task-irrelevant information and increased mental load. These findings shed further light on the interplay between neural and perceptual mechanisms contributing to an internal focus of attention.

The Bilingual Native Speaker Competence: Evidence From Explicit and Implicit Language Knowledge Using Elicited Production, Sentence-Picture Matching, and Pupillometry

The present pilot study investigated potential effects of early and late child bilingualism in highly proficient adult bilinguals. It has been shown that some early second language (eL2) speakers stagnate when it comes to complex linguistic phenomena and that they display subtle difficulties in adulthood. Therefore, we have chosen the complex structure of double object constructions. We investigate the long-term achievement in a combined-method approach using elicited production, explicit comprehension by sentence-picture matching and a measure of implicit linguistic knowledge, namely pupillometry. This eye tracking method is suitable for measuring implicit reactions of the pupils to unexpected or ungrammatical stimuli. For production, ditransitive structures were elicited by means of a game. For comprehension, a sentence-picture matching task was conducted. Two pictures were shown on a monitor that were equal with respect to the involved objects, but the thematic roles of direct and indirect objects were interchanged. Items were controlled for length, gender, animacy, semantic likelihood and word order. Reaction times and accuracy scores were analyzed. To this end, N = 18 bilingual adult speakers of German (+ another language, mean age: 26.5) with different ages of onset participated in this study and were compared to N = 26 monolingual German adult speakers (mean age 23.9). All participants had a proficiency of German above 89% correct in placement and cloze tests. Results show fully comparable productive and comprehensive competencies in monolinguals and bilinguals including the reaction times in the sentence-picture matching task and a word order effect on the reaction times in both groups. In the pupillometry task, we found monolinguals and bilinguals to be sensitive to differing conditions with respect to grammatical and ungrammatical utterances. However, we find between group differences in pupil dilations in that bilinguals react differently to strong grammatical violations than monolinguals. These results are discussed with respect to the term of native speaker competence and the variation within both groups.

Convolutional neural networks can decode eye movement data: A black box approach to predicting task from eye movements

Previous attempts to classify task from eye movement data have relied on model architectures designed to emulate theoretically defined cognitive processes and/or data that have been processed into aggregate (e.g., fixations, saccades) or statistical (e.g., fixation density) features. Black box convolutional neural networks (CNNs) are capable of identifying relevant features in raw and minimally processed data and images, but difficulty interpreting these model architectures has contributed to challenges in generalizing lab-trained CNNs to applied contexts. In the current study, a CNN classifier was used to classify task from two eye movement datasets (Exploratory and Confirmatory) in which participants searched, memorized, or rated indoor and outdoor scene images. The Exploratory dataset was used to tune the hyperparameters of the model, and the resulting model architecture was retrained, validated, and tested on the Confirmatory dataset. The data were formatted into timelines (i.e., x-coordinate, y-coordinate, pupil size) and minimally processed images. To further understand the informational value of each component of the eye movement data, the timeline and image datasets were broken down into subsets with one or more components systematically removed. Classification of the timeline data consistently outperformed the image data. The Memorize condition was most often confused with Search and Rate. Pupil size was the least uniquely informative component when compared with the x- and y-coordinates. The general pattern of results for the Exploratory dataset was replicated in the Confirmatory dataset. Overall, the present study provides a practical and reliable black box solution to classifying task from eye movement data.

Pupil dilation predicts individual self-regulation success across domains

Multiple theories have proposed that increasing central arousal through the brain's locus coeruleus-norepinephrine system may facilitate cognitive control and memory. However, the role of the arousal system in emotion regulation is less well understood. Pupil diameter is a proxy to infer upon the central arousal state. We employed an emotion regulation paradigm with a combination of design features that allowed us to dissociate regulation from emotional arousal in the pupil diameter time course of 34 healthy adults. Pupil diameter increase during regulation predicted individual differences in emotion regulation success beyond task difficulty. Moreover, the extent of this individual regulatory arousal boost predicted performance in another self-control task, dietary health challenges. Participants who harnessed more regulation-associated arousal during emotion regulation were also more successful in choosing healthier foods. These results suggest that a common arousal-based facilitation mechanism may support an individual's self-control across domains.

On the Effect of Standing and Seated Viewing of 360° Videos on Subjective Quality Assessment: A Pilot Study

Due to the advances in head-mounted displays (HMDs), hardware and software technologies, and mobile connectivity, virtual reality (VR) applications such as viewing 360° videos on HMDs have seen an increased interest in a wide range of consumer and vertical markets. Quality assessment of digital media systems and services related to immersive visual stimuli has been one of the challenging problems of multimedia signal processing. Specifically, subjective quality assessment of 360° videos presented on HMDs is needed to obtain a ground truth on the visual quality as perceived by humans. Standardized test methodologies to assess the subjective quality of 360° videos on HMDs are currently not as developed as for conventional videos and are subject to further study. In addition, subjective tests related to quality assessment of 360° videos are commonly conducted with participants seated on a chair but neglect other options of consumption such as standing viewing. In this paper, we compare the effect that standing and seated viewing of 360° videos on an HMD has on subjective quality assessment. A pilot study was conducted to obtain psychophysical and psychophysiological data that covers explicit and implicit responses of the participants to the shown 360° video stimuli with different quality levels. The statistical analysis of the data gathered in the pilot study is reported in terms of average rating times, mean opinion scores, standard deviation of opinion scores, head movements, pupil diameter, galvanic skin response (GSR), and simulator sickness scores. The results indicate that the average rating times consumed for 360° video quality assessment are similar for standing and seated viewing. Further, the participants showed higher resolving power among different 360° video quality levels and were more confident about the given opinion scores for seated viewing. On the other hand, a larger scene exploration of 360° videos was observed for standing viewing which appears to distract from the quality assessment task. A slightly higher pupil dilation was recorded for standing viewing which suggests a slightly more immersed experience compared to seated viewing. GSR data indicate a lower degree of emotional arousal in seated viewing which seems to allow the participants to better conduct the quality assessment task. Similarly, simulator sickness symptoms are kept significantly lower when seated. The pilot study also contributes to a holistic view of subjective quality assessment and provides indicative ground truth that can guide the design of large-scale subjective tests.

Sensitivity of the Spatial Distribution of Fixations to Variations in the Type of Task Demand and Its Relation to Visual Entropy

Ocular activity is known to be sensitive to variations in mental workload, and recent studies have successfully related the distribution of eye fixations to the mental load. This study aimed to verify the effectiveness of the spatial distribution of fixations as a measure of mental workload and its sensitivity to different types of demands imposed by the task: mental, temporal, and physical. To test the research hypothesis, two experimental studies were run: Experiment 1 evaluated the sensitivity of an index of spatial distribution (Nearest Neighbor Index; NNI) to changes in workload. A sample of 30 participants participated in a within-subject design with different types of task demands (mental, temporal, physical) applied to Tetris game; Experiment 2 investigated the accuracy of the index through the analysis of 1-min epochs during the execution of a visual-spatial task (the “spot the differences” puzzle game). Additionally, NNI was compared to a better-known ocular mental workload index, the entropy rate. The data analysis showed a relation between the NNI and the different workload levels imposed by the tasks. In particular: Experiment 1 demonstrated that increased difficulty, due to higher temporal demand, led to a more dispersed pattern with respect to the baseline, whereas the mental demand led to a more grouped pattern of fixations with respect to the baseline; Experiment 2 indicated that the entropy rate and the NNI show a similar pattern over time, indicating high mental workload after the first minute of activity. That suggests that NNI highlights the greater presence of fixation groups and, accordingly, the entropy indicates a more regular and orderly scanpath. Both indices are sensitive to changes in workload and they seem to anticipate the drop in performance. However, the entropy rate is limited by the use of the areas of interest, making it impossible to apply it in dynamic contexts. Conversely, NNI works with the entire scanpath and it shows sensitivity to different types of task demands. These results confirm the NNI as a measure applicable to different contexts and its potential use as a trigger in adaptive systems implemented in high-risk settings, such as control rooms and transportation systems.

(Eye-) Tracking the Other-Race Effect: Comparison of Eye Movements During Encoding and Recognition of Ingroup Faces With Proximal and Distant Outgroup Faces

People experience difficulties recognizing faces of ethnic outgroups, known as the other-race effect. The present eye-tracking study investigates if this effect is related to differences in visual attention to ingroup and outgroup faces. We measured gaze fixations to specific facial features and overall eye-movement activity level during an old/new recognition task comparing ingroup faces with proximal and distal ethnic outgroup faces. Recognition was best for ingroup faces and decreased gradually for proximal and distal outgroup faces. Participants attended more to the eyes of ingroup faces than outgroup faces, but this effect was unrelated to recognition performance. Ingroup-outgroup differences in eye-movement activity level did not emerge during the study phase, but during the recognition phase, with ingroup-outgroup differences varying as a function of recognition accuracy and old/new effects. Overall, ingroup-outgroup effects on recognition performance and eye movements were more pronounced for recognition of new items, emphasizing the role of retrieval processes.

Detecting simulated versus bona fide traumatic brain injury using pupillometry

Objective: Pupil dilation patterns are outside of conscious control and provide information regarding neuropsychological processes related to deception, cognitive effort, and familiarity. This study examined the incremental utility of pupillometry on the Test of Memory Malingering (TOMM) in classifying individuals with verified traumatic brain injury (TBI), individuals simulating TBI, and healthy comparisons. Method: Participants were 177 adults across three groups: verified TBI (n = 53), feigned cognitive impairment due to TBI (SIM, n = 52), and heathy comparisons (HC, n = 72). Results: Logistic regression and ROC curve analyses identified several pupil indices that discriminated the groups. Pupillometry discriminated best for the comparison of greatest clinical interest, verified TBI versus simulators, adding information beyond traditional accuracy scores. Simulators showed evidence of greater cognitive load than both groups instructed to perform at their best ability (HC and TBI). Additionally, the typically robust phenomenon of dilating to familiar stimuli was relatively diminished among TBI simulators compared to TBI and HC. This finding may reflect competing, interfering effects of cognitive effort that are frequently observed in pupillary reactivity during deception. However, the familiarity effect appeared on nearly half the trials for SIM participants. Among those trials evidencing the familiarity response, selection of the unfamiliar stimulus (i.e., dilation-response inconsistency) was associated with a sizeable increase in likelihood of being a simulator. Conclusions: Taken together, these findings provide strong support for multimethod assessment: adding unique performance assessments such as biometrics to standard accuracy scores. Continued study of pupillometry will enhance the identification of simulators who are not detected by traditional performance validity test scoring metrics. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Can pupillometry distinguish accurate from inaccurate familiarity?

Pupillometry, the measurement of pupil diameter, has become increasingly popular as a tool to investigate human memory. It has long been accepted that the pupil is able to distinguish familiar from completely novel items, a phenomenon known as "pupil old/new effect". Surprisingly, most pupillometric studies on the pupil old/new effect tend to disregard the possibility that the pupillary response to familiarity memory may not be entirely exclusive. Here, we investigated whether the pupillary response to old items correctly judged familiar (hits; accurate familiarity) can be differentiated from the pupillary response to new items wrongly judged familiar (false alarms; inaccurate familiarity). We found no evidence that the two processes could be isolated, as both accurate and inaccurate familiarity showed nearly identical mean and across-time pupillary responses. However, both familiarity hits and false alarms showed pupillary responses unequivocally distinct from those observed during either recollection or novelty detection, which suggests that the pupil measure of familiarity hits and/or false alarms was sufficiently sensitive. The pupillary response to false alarms may have been partially driven by perceptual fluency, since novel objects incorrectly judged to be old (i.e., false alarms) showed a higher degree of similarity to studied images than items correctly judged as novel (i.e., correct rejections). Thus, our results suggest that pupil dilation may not be able to distinguish accurate from inaccurate familiarity using standard recognition memory paradigms, and they also suggest that the pupillary response during familiarity feelings may also partly reflect perceptual fluency.

The Sternberg Paradigm: Correcting Encoding Latencies in Visual and Auditory Test Designs

The Sternberg task is a widely used tool for assessing the working memory performance in vision and cognitive science. It is possible to apply a visual or auditory variant of the Sternberg task to query the memory load. However, previous studies have shown that the subjects' corresponding reaction times differ dependent on the used variant. In this work, we present an experimental approach that is intended to correct the reaction time differences observed between auditory and visual item presentation. We found that the subjects' reaction time offset is related to the encoding speed of a single probe item. After correcting for these individual encoding latencies, differences in the results of both the auditory and visual Sternberg task become non-significant, p=0.252. Thus, an equal task difficulty can be concluded for both variants of item presentation.

Context Affects Quiet Eye Duration and Motor Performance Independent of Cognitive Effort

Extensive literature has shown the effect of "quiet eye" (QE) on motor performance. However, little attention has been paid to the context in which tasks are executed (independent of anxiety) and the mechanisms that underpin the phenomenon. Here, the authors aimed to investigate the effects of context (independent of anxiety) on QE and performance while examining if the mechanisms underpinning QE are rooted in cognitive effort. In this study, 21 novice participants completed golf putts while pupil dilation, QE duration, and putting accuracy were measured. Results showed that putting to win was more accurate compared with the control (no context) condition, and QE duration was longer when putting to win or tie a hole compared with control. There was no effect of context on pupil dilation. Results suggest that, while the task was challenging, performance scenarios can enhance representativeness of practice without adding additional load to cognitive resources, even for novice performers.

Aerobic fitness relates to superior exact and approximate arithmetic processing in college-aged adults

BACKGROUND

Aerobic fitness relates to superior math achievement, but the underlying reasons remain unclear. This study tested how more efficient processing (efficiency hypothesis) or enhanced allocation of cognitive resources (resources hypothesis) underly fitness-related differences in arithmetic cognition in a sample of 138 college-aged adults.

METHOD

Participants completed an arithmetic task while pupillary measures were recorded prior to an aerobic fitness test.

RESULTS

Higher aerobic fitness was associated with shorter reaction time for all problems and greater pupillary reactivity for problems requiring approximate and exact arithmetic.

CONCLUSIONS

Superior aerobic fitness relates to greater cognitive resources available to execute exact and approximate arithmetic faster. Fitness-related differences in math achievement may be driven by the cognitive resources underlying arithmetic strategy. These differences may extend beyond educational achievement and affect the motivation to engage in health behaviors based on quantitative information. Thus, improving cardiovascular fitness has the potential to also ameliorate health numeracy.

Multimodal Fusion for Objective Assessment of Cognitive Workload: A Review

Considerable progress has been made in improving the estimation accuracy of cognitive workload using various sensor technologies. However, the overall performance of different algorithms and methods remain suboptimal in real-world applications. Some studies in the literature demonstrate that a single modality is sufficient to estimate cognitive workload. These studies are limited to controlled settings, a scenario that is significantly different from the real world where data gets corrupted, interrupted, and delayed. In such situations, the use of multiple modalities is needed. Multimodal fusion approaches have been successful in other domains, such as wireless-sensor networks, in addressing single-sensor weaknesses and improving information quality/accuracy. These approaches are inherently more reliable when a data source is lost. In the cognitive workload literature, sensors, such as electroencephalography (EEG), electrocardiography (ECG), and eye tracking, have shown success in estimating the aspects of cognitive workload. Multimodal approaches that combine data from several sensors together can be more robust for real-time measurement of cognitive workload. In this article, we review the published studies related to multimodal data fusion to estimate the cognitive workload and synthesize their main findings. We identify the opportunities for designing better multimodal fusion systems for cognitive workload modeling.

Beyond Looking for the Rewarded Target: The Effects of Reward on Attention in Search Tasks

One puzzling result in training-test paradigms is that effects of reward-associated stimuli on attention are often seen in test but not in training. We focus on one study, where reward-related performance benefits occur in the training and which was discussed contentiously. By using a similar design, we conceptually replicated the results. Moreover, we investigated the underlying mechanisms and processes resulting in these reward-related performance benefits. In two experiments, using search tasks and having participants perform the tasks either with or without individually adjusted time pressure, we disentangled the mechanisms and processes contributing to the reward-related benefits. We found evidence that not only search efficiency is increased with increasing reward, but also that non-search factors contribute to the results. By also investigating response time distributions, we were able to show that reward-related performance effects increased as search time increased in demanding tasks but not in less demanding tasks. Theoretical implications of the results regarding how reward influences attentional processing are discussed.

Attentional engagement during syllable discrimination: The role of salient prosodic cues in 6- to 8-month-old infants

Prosodic cues drive speech segmentation and guide syllable discrimination. However, less is known about the attentional mechanisms underlying an infant's ability to benefit from prosodic cues. This study investigated how 6- to 8-month-old Italian infants allocate their attention to strong vs. weak syllables after familiarization with four repeats of a single CV sequence with alternating strong and weak syllables (different syllables on each trial). In the discrimination test-phase, either the strong or the weak syllable was replaced by a pure tone matching the suprasegmental characteristics of the segmental syllable, i.e., duration, loudness and pitch, whereas the familiarized stimulus was presented as a control. By using an eye-tracker, attention deployment (fixation times) and cognitive resource allocation (pupil dilation) were measured under conditions of high and low saliency that corresponded to the strong and weak syllabic changes, respectively. Italian learning infants were found to look longer and also to show, through pupil dilation, more attention to changes in strong syllable replacement rather than weak syllable replacement, compared to the control condition. These data offer insights into the strategies used by infants to deploy their attention towards segmental units guided by salient prosodic cues, like the stress pattern of syllables, during speech segmentation.

Face Inversion Effect on Perceived Cuteness and Pupillary Response

The face inversion effect reflects the special nature of facial processing and appears not only in recognizing facial identity or expression but also in subjective evaluation, such as facial attractiveness. Previous studies have revealed that the way in which we perceive attractiveness (beauty versus cuteness) differs our perceptual behavior. Therefore, the face inversion effect on attractiveness might differ based on the viewpoint of attractiveness. In this study, we measured pupillary response when judging the cuteness of facial stimuli and focused on the mechanism of perceiving attractiveness in terms of the effect of involuntary physical reaction. We investigated whether perceived cuteness – a kind of attractiveness – was affected by face inversion and whether the face inversion effect appeared in pupillary responses. We then conducted experiments in which participants observed inverted faces and rated the subjective cuteness of the faces, and we measured the participants’ pupil size while they observed the facial stimuli. The results revealed a negative correlation between pupil changes and the perceived cuteness of inverted faces, which is consistent with the previous result of upright faces. Thus, we found that the perception of facial cuteness is little affected by face inversion, suggesting that the judgment of cuteness is processed differently from other types of attractiveness such as beauty. We also found that pupillary response is related to perceiving cuteness, which could lead to consistency in the perception of cuteness.

Pupil diameter as a biomarker of effort in goal-directed gait

Subjects' eye movement behavior related to cognitive effort during gait was measured as subjects walked to perform low and high cognitive load tasks. We found that all pupil diameter measures, fixation durations, and the proportion of blink duration changed significantly during gait as a function of task load. In contrast, the number of fixations, saccade durations and travel time did not change significantly as a function of task load. Findings showed that pupil diameter was the best predictor of task load during one's gait preceding the performance of the task. While other studies have demonstrated the importance of eye fixation characteristics during gait, our findings showed that eye measures related to pupil diameter were better at detecting cognitive load while walking to perform a task compared to eye fixation data. We also found that cognitive effort was not limited to just the performance of the task, but that it was also exerted during one's gait preceding the performance of the task. Therefore, the additional attention demand caused by an increase in task complexity may result in less attentional resources being available to adequately handle distractions (such as obstacle avoidance) while walking to perform the task. Consequently, this may increase the likelihood of falls in those individuals with lower attentional capacity.

Understanding the underlying mechanisms of Quiet Eye: The role of microsaccades, small saccades and pupil-size before final movement initiation in a soccer penalty kick

Experts keep a steady final fixation at a specific location just before final movement initiation, the so-called "quiet eye" (QE). However, the eyes are rarely "quiet", and small eye movements occur during visual fixation. The current research investigated the subtle eye movements and underlying mechanisms immediately prior to and during QE. The gaze behaviour of 8 intermediate-level goalkeepers was recorded as they moved (either left or right) in an attempt to predict the future direction of the ball during a soccer penalty kick. Goalkeepers were more likely to predict the direction of the penalty, which was coupled with delaying movement initiation. The temporal sequence of microsaccade rates dropped ∼1000 ms before goalkeepers' final movement initiation. Saccade rates increased, reaching a peak ∼500 ms before final movement initiation, concomitant with microsaccades reduction. Microsaccades predicted the goalkeepers' direction, oriented to the right when goalkeepers moved to the right, and conversely to the left when they moved to the left. Microsaccades may be modulated by attention and appear functionally related to saccadic intrusions. Pupil-size increased proportionally with the lead up to the instance of the penalty being kicked, reaching a plateau at final movement initiation. In conclusion, microsaccades and small saccades could improve the perception of the soccer penalty kick, helping athletes during the period that precedes the critical movement initiation, shifting from covert to overt attention for identifying the useful cues necessary to guide the action.

Pupil dilation as an indicator of future thinking

BACKGROUND

The pupil typically dilates in reaction to cognitive load. In this study, we, for the first time, investigated whether future thinking (i.e., the ability to generate hypothetical scenarios in the future) would result in pupil dilation.

METHODS

We recorded pupil dilation of participants during two conditions: past and future thinking. In past thinking, we invited participants to retrieve past personal events, while in future thinking, we invited them to imagine an event that may occur in the future.

RESULTS

Analysis demonstrated a larger pupil size during future than past thinking. Results also demonstrated longer retrieval time of future events compared with past ones, suggesting that future thinking perhaps requires more cognitive load than for past thinking. Interestingly, retrieval times during past and future thinking were positively correlated with pupil size.

DISCUSSION

The finding that future thinking activates pupil dilation could be due to the fact that while both past and future thinking require retrieving information from memory, future, but not past, thinking additionally requires the ability to recombine this information into novel scenarios.

Component processes in free-viewing visual search: Insights from fixation-aligned pupillary response averaging

Pupil size changes during a visual search may reflect cognitive processes, such as effort and memory accumulation, but methodological confounds and the general lack of literature in this area leave the reliability of findings open to question. We used a novel synthesis of experimental methods and averaging techniques to explore how cognitive processing unfolds during free-viewing visual search for multiple targets. Twenty-seven participants completed 152 searches across two separate 1-hour sessions. The number of targets present (Targets: 0, 1, 2, and 3) in each trial was the main manipulation and the task was to "find all of the targets" and report the total via mouse-click at the end of the trial. Search time lasted for 10 seconds or until the participant purported to have found all of the targets, in which case they could terminate the search via keypress. Whole-trial pupil analysis revealed a significant effect of button pressing as well as a significant main effect of targets for trials that were not self-terminated via button press. Fixation-aligned pupil responses revealed transient modulations in pupil size following initial fixations on targets but not distractors and refixations on both targets and distractors. Owing to rigorous control over experimental confounds and a detailed analysis and correction of eye-movement-related measurement error, we confidently discuss these findings in terms of task-related processing and underlying brain activity.

Tracking visual search demands and memory load through pupil dilation

Continuously tracking cognitive demands via pupil dilation is a desirable goal for the monitoring and investigation of cognitive performance in applied settings where the exact time point of mental engagement in a task is often unknown. Yet, hitherto no experimentally validated algorithm exists for continuously estimating cognitive demands based on pupil size. Here, we evaluated the performance of a continuously operating algorithm that is agnostic of the onset of the stimuli and derives them by way of retrospectively modeling attentional pulses (i.e., onsets of processing). We compared the performance of this algorithm to a standard analysis of stimulus-locked pupil data. The pupil data were obtained while participants performed visual search (VS) and visual working memory (VWM) tasks with varying cognitive demands. In Experiment 1, VS was performed during the retention interval of the VWM task to assess interactive effects between search and memory load on pupil dilation. In Experiment 2, the tasks were performed separately. The results of the stimulus-locked pupil data demonstrated reliable increases in pupil dilation due to high VWM load. VS difficulty only affected pupil dilation when simultaneous memory demands were low. In the single task condition, increased VS difficulty resulted in increased pupil dilation. Importantly, online modeling of pupil responses was successful on three points. First, there was good correspondence between the modeled and stimulus locked pupil dilations. Second, stimulus onsets could be approximated from the derived attentional pulses to a reasonable extent. Third, cognitive demands could be classified above chance level from the modeled pupil traces in both tasks.