Beyond eye gaze: What else can eyetracking reveal about cognition and cognitive development?

The Effects of Light Level and Signal-to-Noise Ratio on the Task-Evoked Pupil Response in a Speech-in-Noise Task

PURPOSE

There is increasing interest in the measurement of cognitive effort during listening tasks, for both research and clinical purposes. Quantification of task-evoked pupil responses (TEPRs) is a psychophysiological method that can be used to study cognitive effort. However, light level during cognitively demanding listening tasks may affect TEPRs, complicating interpretation of listening-related changes. The objective of this study was to examine the effects of light level on TEPRs during effortful listening across a range of signal-to-noise ratios (SNRs).

METHOD

Thirty-six adults without hearing loss were asked to repeat target sentences presented in background babble noise while their pupil diameter was recorded. Light level and SNRs were manipulated in a 4 × 4 repeated-measures design. Repeated-measures analyses of variance were used to measure the effects.

RESULTS

Peak and mean dilation were typically larger in more adverse SNR conditions (except for SNR -6 dB) and smaller in higher light levels. Differences in mean and peak dilation between SNR conditions were larger in dim light than in brighter light.

CONCLUSIONS

Brighter light conditions make TEPRs less sensitive to variations in listening effort across levels of SNR. Therefore, light level must be considered and reported in detail to ensure sensitivity of TEPRs and for comparisons of findings across different studies. It is recommended that TEPR testing be conducted in relatively low light conditions, considering both background illumination and screen luminance.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.25676538.

Visual social attention in SYNGAP1-related intellectual disability

SYNGAP1-ID is a neurodevelopmental disorder caused by a mutation of the SYNGAP1 gene. Characterized by moderate to severe developmental delay, it is associated with several physical and behavioral issues as well as additional diagnoses, including autism. However, it is not known whether social cognitive differences seen in SYNGAP1-ID are similar to those previously identified in idiopathic or other forms of autism. This study therefore investigated visual social attention in SYNGAP1-ID. Eye movements were recorded across three passive viewing tasks (face scanning, pop-out, and social preference) of differing social complexity in 24 individuals with SYNGAP1-ID and 12 typically developing controls. We found that SYNGAP1-ID participants looked at faces less than the controls, and when they did look at faces, they had less time looking at and fewer fixations to the eyes. For the pop-out task, where social and nonsocial objects (Phone, car, face, bird, and face-noise) were presented in an array, those with SYNGAP1-ID spent significantly less time looking at the phone stimulus as well as fewer fixations to the face compared with the typically developing controls. When looking at two naturalistic scenes side by side, one social in nature (e.g., with children present) and the other not, there were no differences between the SYNGAP1-ID group and typically developing controls on any of the examined eye tracking measures. This study provides novel findings on the social attention of those with SYNGAP1-ID and helps to provide further evidence for using eye tracking as an objective measure of the social phenotype in this population in future clinical trials.

Grandiose narcissism associates with higher cognitive performance under stress through more efficient attention distribution: An eye-tracking study

Narcissism is a part of the Dark Triad that consists also of the traits of Machiavellianism and psychopathy. Two main types of narcissism exist: grandiose and vulnerable narcissism. Being a Dark Triad trait, narcissism is typically associated with negative outcomes. However, recent research suggests that at least the grandiose type may be linked (directly or indirectly) to positive outcomes including lower levels of psychopathology, higher school grades in adolescents, deeper and more strategic learning in university students and higher cognitive performance in experimental settings. The current pre-registered, quasi-experimental study implemented eye-tracking to assess whether grandiose narcissism indirectly predicts cognitive performance through wider distribution of attention on the Raven's Progressive Matrices task. Fifty-four adults completed measures of the Dark Triad, self-esteem and psychopathology. Eight months to one year later, participants completed the Raven's, while their eye-movements were monitored during high stress conditions. When controlling for previous levels of psychopathology, grandiose narcissism predicted higher Raven's scores indirectly, through increased variability in the number of fixations across trials. These findings suggest that grandiose narcissism predicts higher cognitive performance, at least in experimental settings, and call for further research to understand the implications of this seemingly dark trait for performance across various settings.

Influence of the time-task constraint on ocular metrics of semi-elite soccer players

This study novelty aimed to investigate the influence of manipulating the available time to perform the training tasks on soccer players´ ocular metrics, following training. Specifically, pupillary response (pupil diameter) and saccadic features (latency, accuracy, velocity, and number) were measured with a portable eye tracker following training to reflect the mental load accumulated by players during the training sessions. Nine semi-elite soccer players performed two training sessions, based on large-sided games, on an artificial grass field. These two sessions were composed of the same tasks but varying the required time to complete the task goals (Session 1: No time limitations to perform the tasks; Session 2: Limited time to perform the tasks). The participants performed, before (pre-test) and after (post-test) each training session, a prosaccade task in a room near the playing field. Findings revealed a differentiated effect of the available time to complete the training tasks on ocular metrics because significant differences were found in all variables after training (p < .001 for pupil diameter; p < .01 for saccade accuracy and number of saccades; p < .05 for saccade velocity and latency). Ocular metrics could be a promising tool to evaluate mental load following practice because they were sensitive to the time-task constraint, providing researchers a valuable information for a better planning of the mental workload when designed training tasks.

Swift-Eye: Towards Anti-blink Pupil Tracking for Precise and Robust High-Frequency Near-Eye Movement Analysis with Event Cameras

Eye tracking has shown great promise in many scientific fields and daily applications, ranging from the early detection of mental health disorders to foveated rendering in virtual reality (VR). These applications all call for a robust system for high-frequency near-eye movement sensing and analysis in high precision, which cannot be guaranteed by the existing eye tracking solutions with CCD/CMOS cameras. To bridge the gap, in this paper, we propose Swift-Eye, an offline precise and robust pupil estimation and tracking framework to support high-frequency near-eye movement analysis, especially when the pupil region is partially occluded. Swift-Eye is built upon the emerging event cameras to capture the high-speed movement of eyes in high temporal resolution. Then, a series of bespoke components are designed to generate high-quality near-eye movement video at a high frame rate over kilohertz and deal with the occlusion over the pupil caused by involuntary eye blinks. According to our extensive evaluations on EV-Eye, a large-scale public dataset for eye tracking using event cameras, Swift-Eye shows high robustness against significant occlusion. It can improve the IoU and F1-score of the pupil estimation by 20% and 12.5% respectively, compared with the second-best competing approach, when over 80% of the pupil region is occluded by the eyelid. Lastly, it provides continuous and smooth traces of pupils in extremely high temporal resolution and can support high-frequency eye movement analysis and a number of potential applications, such as mental health diagnosis, behaviour-brain association, etc. The implementation details and source codes can be found at https://github.com/ztysdu/Swift-Eye.

Frequency-encoded eye tracking smart contact lens for human-machine interaction

Eye tracking techniques enable high-efficient, natural, and effortless human-machine interaction by detecting users' eye movements and decoding their attention and intentions. Here, a miniature, imperceptible, and biocompatible smart contact lens is proposed for in situ eye tracking and wireless eye-machine interaction. Employing the frequency encoding strategy, the chip-free and battery-free lens successes in detecting eye movement and closure. Using a time-sequential eye tracking algorithm, the lens has a great angular accuracy of <0.5°, which is even less than the vision range of central fovea. Multiple eye-machine interaction applications, such as eye-drawing, Gluttonous Snake game, web interaction, pan-tilt-zoom camera control, and robot vehicle control, are demonstrated on the eye movement model and in vivo rabbit. Furthermore, comprehensive biocompatibility tests are implemented, demonstrating low cytotoxicity and low eye irritation. Thus, the contact lens is expected to enrich approaches of eye tracking techniques and promote the development of human-machine interaction technology.

What is a blink? Classifying and characterizing blinks in eye openness signals

Blinks, the closing and opening of the eyelids, are used in a wide array of fields where human function and behavior are studied. In data from video-based eye trackers, blink rate and duration are often estimated from the pupil-size signal. However, blinks and their parameters can be estimated only indirectly from this signal, since it does not explicitly contain information about the eyelid position. We ask whether blinks detected from an eye openness signal that estimates the distance between the eyelids (EO blinks) are comparable to blinks detected with a traditional algorithm using the pupil-size signal (PS blinks) and how robust blink detection is when data quality is low. In terms of rate, there was an almost-perfect overlap between EO and PS blink (F1 score: 0.98) when the head was in the center of the eye tracker's tracking range where data quality was high and a high overlap (F1 score 0.94) when the head was at the edge of the tracking range where data quality was worse. When there was a difference in blink rate between EO and PS blinks, it was mainly due to data loss in the pupil-size signal. Blink durations were about 60 ms longer in EO blinks compared to PS blinks. Moreover, the dynamics of EO blinks was similar to results from previous literature. We conclude that the eye openness signal together with our proposed blink detection algorithm provides an advantageous method to detect and describe blinks in greater detail.

Linking tonic and phasic pupil responses to P300 amplitude in an emotional face-word Stroop task

The locus coeruleus-norepinephrine (LC-NE) system, which regulates arousal levels, is important for cognitive control, including emotional conflict resolution. Additionally, the LC-NE system is implicated in P300 generation. If the P300 is mediated by the LC-NE system, and considering the established correlations between LC activity and pupil dilation, P300 amplitude should correlate with task-evoked (phasic) pupil dilation on a trial-by-trial basis. However, prior studies, predominantly utilizing oddball-type paradigms, have not demonstrated correlations between concurrently recorded task-evoked pupil dilation and P300 responses. Using a recently developed emotional face-word Stroop task that links pupil dilation to the LC-NE system, here, we examined both intra- and inter-individual correlations between task-evoked pupil dilation and P300 amplitude. We found that lower accuracy, slower reaction times, and larger task-evoked pupil dilation were obtained in the incongruent compared to the congruent condition. Furthermore, we observed intra-individual correlations between task-evoked pupil dilation and P300 amplitude, with larger pupil dilation correlating with a greater P300 amplitude. In contrast, pupil dilation did not exhibit consistent correlations with N450 and N170 amplitudes. Baseline (tonic) pupil size also showed correlations with P300 and N170 amplitudes, with smaller pupil size corresponding to larger amplitude. Moreover, inter-individual differences in task-evoked pupil dilation between the congruent and incongruent conditions correlated with differences in reaction time and P300 amplitude, though these effects only approached significance. To summarize, our study provides evidence for a connection between task-evoked pupil dilation and P300 amplitude at the single-trial level, suggesting the involvement of the LC-NE system in P300 generation.

Applicability and usefulness of pupillometry in the study of lexical access. A scoping review of primary research

Pupil dilation has been associated with the effort required to perform various cognitive tasks. At the lexical level, some studies suggest that this neurophysiological measure would provide objective, real-time information during word processing and lexical access. However, due to the scarcity and incipient advancement of this line of research, its applicability, use, and sensitivity are not entirely clear. This scoping review aims to determine the applicability and usefulness of pupillometry in the study of lexical access by providing an up-to-date overview of research in this area. Following the PRISMA protocol, 16 articles were included in this review. The results show that pupillometry is a highly applicable, useful, and sensitive method for assessing lexical skills of word recognition, word retrieval, and semantic activation. Moreover, it easily fits into traditional research paradigms and methods in the field. Because it is a non-invasive, objective, and automated procedure, it can be applied to any population or age group. However, the emerging development of this specific area of research and the methodological diversity observed in the included studies do not yet allow for definitive conclusions in this area, which in turn does not allow for meta-analyses or fully conclusive statements about what the pupil response actually reflects when processing words. Standardized pupillary recording and analysis methods need to be defined to generate more accurate, replicable research designs with more reliable results to strengthen this line of research.

Now it's your turn!: Eye blink rate in a Jenga task modulated by interaction of task wait times, effortful control, and internalizing behaviors

Dopamine is a versatile neurotransmitter with implications in many domains, including anxiety and effortful control. Where high levels of effortful control are often regarded as adaptive, other work suggests that high levels of effortful control may be a risk factor for anxiety. Dopamine signaling may be key in understanding these relations. Eye blink rate is a non-invasive proxy metric of midbrain dopamine activity. However, much work with eye blink rate has been constrained to screen-based tasks which lack in ecological validity. We tested whether changes in eye blink rate during a naturalistic effortful control task differ as a function of parent-reported effortful control and internalizing behaviors. Children played a Jenga-like game with an experimenter, but for each trial the experimenter took an increasingly long time to take their turn. Blinks-per-second were computed during each wait period. Multilevel modeling examined the relation between duration of wait period, effortful control, and internalizing behaviors on eye blink rate. We found a significant 3-way interaction between effortful control, internalizing behaviors, and duration of the wait period. Probing this interaction revealed that for children with low reported internalizing behaviors (-1 SD) and high reported effortful control (+1 SD), eye blink rate significantly decreased as they waited longer to take their turn. These findings index task-related changes in midbrain dopamine activity in relation to naturalistic task demands, and that these changes may vary as a function of individual differences in effortful control and internalizing behaviors. We discuss possible top-down mechanisms that may underlie these differences.

Resistance exercising on unstable surface leads to Pupil Dilation

BACKGROUND

Chronic resistance training and acute resistance exercises improve physical performance and can enhance cognitive performance. However, there is still uncertainty about the mechanism(s) responsible for cognitive improvement following resistance training and exercise. Recent findings suggest that resistance exercise has metabolic as well as cognitive demands, which potentially activate similar neural circuitry associated with higher-order cognitive function tasks. Exercising on unstable devices increases the coordinative and metabolic demands and thus may further increase cognitive activation during resistance exercise. The measurement of pupil diameter could provide indications of cognitive activation and arousal during resistance exercise. Pupil dilation is linked to the activity in multiple neuromodulatory systems (e.g., activation of the locus coeruleus and the release of the neurotransmitter norepinephrine (LC-NE system)), which are involved in supporting processes for executive control. Therefore, the purpose of this study was to compare the cognitive activation measured by pupil diameter during an acute bout of resistance exercise on stable and unstable surfaces.

METHODS

18 participants (23.5 ± 1.5 years; 10 females) performed ten kettlebell squats in a preferred repetition velocity in stable and unstable (BOSU® Balance Trainer) ground conditions. Pupil diameter was recorded with eye tracking glasses (SMI ETG) during standing (baseline) and during squatting. Raw pupil data were cleaned of artifacts (missing values were linearly interpolated) and subjected to a subtractive baseline correction. A student t-test was used to compare mean pupil diameter between ground conditions.

RESULTS

The mean pupil diameter was significantly greater during squats in the unstable condition than in the stable condition, t (17) = -2.63, p =.018, Cohen's dZ = -0.62; stable: 0.49 ± 0.32 mm; unstable: 0.61 ± 0.25 mm).

CONCLUSION

As indicated by pupil dilation, the use of unstable devices can increase the cognitive activation and effort during acute bouts of resistance exercise. Since pupil dilation is only an indirect method, further investigations are necessary to describe causes and effects of neuromodulatory system activity during resistance exercise. Resistance training with and without surface instability can be recommended to people of all ages as a physically and cognitively challenging training program contributing to the preservation of both physical and cognitive functioning.

Reclassifying guesses to increase signal-to-noise ratio in psychological experiments

This paper introduces a novel procedure that can increase the signal-to-noise ratio in psychological experiments that use accuracy as a selection variable for another dependent variable. This procedure relies on the fact that some correct responses result from guesses and reclassifies them as incorrect responses using a trial-by-trial reclassification evidence such as response time. It selects the optimal reclassification evidence criterion beyond which correct responses should be reclassified as incorrect responses. We show that the more difficult the task and the fewer the response alternatives, the more to be gained from this reclassification procedure. We illustrate the procedure on behavioral and ERP data from two different datasets (Caplette et al. NeuroImage 218, 116994, 2020; Faghel-Soubeyrand et al. Journal of Experimental Psychology: General 148, 1834-1841, 2019) using response time as reclassification evidence. In both cases, the reclassification procedure increased signal-to-noise ratio by more than 13%. Matlab and Python implementations of the reclassification procedure are openly available ( https://github.com/GroupeLaboGosselin/Reclassification ).

Effects of Exercise Habits and Gender on Sports e-Learning Behavior: Evidence from an Eye-Tracking Study

Background/Objective

In the post-epidemic era, an increasing number of individuals were accustomed to learning sports and physical activity knowledge online for fitness and health demands. However, most previous studies have examined the influence of e-learning materials and resources on learners and have neglected intrinsic factors such as experience and physiological characteristics. Therefore, we conducted a study to investigate the effect of exercise habits and gender on sports e-learning behavior via eye-tracking technology.

Methods

We recruited a sample of 60 undergraduate students (mean age = 19.6) from a university in Nanjing, China. They were randomly assigned into 4 groups based on 2 genders × 2 exercise habits. Their gaze behavior was collected by an eye-tracking device during the experiment. The cognitive Load Test and Learning Effect Test were conducted at the end of the individual experiment.

Results

(1) Compared to the non-exercise habit group, the exercise habit group had a higher fixation count (P<0.05), a shorter average fixation duration (P<0.05), a smaller average pupil diameter (P<0.05), and a lower subjective cognitive load (P<0.05) and better learning outcome (P<0.05). (2) Male participants showed a greater tendency to process information from the video area of interest (AOIs), and had lower subjective cognitive load (P < 0.05) and better learning outcomes (P < 0.05). (3) There was no interaction effect between exercise habits and gender for any of the indicators (P > 0.05).

Conclusion

Our results indicate that exercise habits effectively enhance sports e-learning outcomes and reduce cognitive load. The exercise habits group showed significant improvements in fixation counts, average fixation duration, and average pupil diameter. Furthermore, male subjects exhibited superior learning outcomes, experienced lower cognitive load, and demonstrated greater attentiveness to dynamic visual information. These conclusions are expected to improve sports e-learning success and address educational inequality.

Use of eye tracking in medical education

Eye tracking has become increasingly applied in medical education research for studying the cognitive processes that occur during the performance of a task, such as image interpretation and surgical skills development. However, analysis and interpretation of the large amount of data obtained by eye tracking can be confusing. In this article, our intention is to clarify the analysis and interpretation of the data obtained from eye tracking. Understanding the relationship between eye tracking metrics (such as gaze, pupil and blink rate) and cognitive processes (such as visual attention, perception, memory and cognitive workload) is essential. The importance of calibration and how the limitations of eye tracking can be overcome is also highlighted.

Exploring the usability of the virtual reality module LEAF CAFÉ: a qualitative think-aloud study

BACKGROUND

The global healthcare system faces increasing strain from our ageing population, primarily due to the growing prevalence of age-related health conditions such as dementia. While modern healthcare technology offers potential solutions, it frequently lacks user-friendliness for older adults. Virtual Reality (VR) has emerged as a promising tool for diagnosing cognitive impairment, offering innovative solutions where traditional methods may fall short. This study explores older adults' perspectives on the usability of a newly designed VR module for cognitive assessment.

METHODS

During a 100-min session, participants were asked to engage and complete recall and recognition tasks within the VR module (think-aloud approach) and provide feedback upon completion (semi-structured interviews). Audio materials were transcribed for analysis and recordings of the users' interactions with the module were annotated to provide additional context. These combined textual data were analysed using content coding and thematic analysis to identify themes that reflect how participants used the module's features and what features are desirable to support that process better.

RESULTS

Participants (N = 10; Mean age = 73.3, SD = 7.53, range = 65-83 years) perceived the VR module as user-friendly and endorsed its potential as a cognitive screener due to its engaging and immersive nature. Older adults highlighted three key aspects of the module: the usefulness of the platform's ability to offer a comprehensive and reliable evaluation of an individual's cognitive abilities; the need to present concise and relevant content to optimise engagement and use; and the importance of overcoming barriers to support implementation. Suggested game improvements centred on food recognition and adjusting difficulty levels. Barriers to implementation included technology challenges for older adults and concerns about the game's suitability for everyday scenarios. Participants stressed the need for reliable implementation strategies, proposing locations such as libraries and advocating for home-based screening.

CONCLUSION

Continued improvements in accessibility suggest that VR tools could help with diagnosing cognitive impairment in older adults. Using a simulated environment to assess cognitive status might fill the gap between current diagnostic methods, aiding treatment planning and early intervention. However, these findings should be approached cautiously, as more research is needed to fully grasp the potential impact of VR tools in this context.

Short-time AOIs-based representative scanpath identification and scanpath aggregation

A new algorithm to identify a representative scanpath in a sample is presented and evaluated with eye-tracking data. According to Gestalt theory, each fixation of the scanpath should be on an area of interest (AOI) of the stimuli. As with existing methods, we first identify the AOIs and then extract the fixations of the representative scanpath from the AOIs. In contrast to existing methods, we propose a new concept of short-time AOI and extract the fixations of representative scanpath from the short-time AOIs. Our method outperforms the existing methods on two publicly available datasets. Our method can be applied to arbitrary visual stimuli, including static stimuli without natural segmentation, as well as dynamic stimuli. Our method also provides a solution for issues caused by the selection of scanpath similarity.

Neurophysiological measures and correlates of cognitive load in attention-deficit/hyperactivity disorder (ADHD), autism spectrum disorder (ASD) and dyslexia: A scoping review and research recommendations

Working memory is integral to a range of critical cognitive functions such as reasoning and decision-making. Although alterations in working memory have been observed in neurodivergent populations, there has been no review mapping how cognitive load is measured in common neurodevelopmental conditions such as attention-deficit/hyperactivity disorder (ADHD), autism spectrum disorder (ASD) and dyslexia. This scoping review explores the neurophysiological measures used to study cognitive load in these specific populations. Our findings highlight that electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) are the most frequently used methods, with a limited number of studies employing functional near-infrared spectroscopy (fNIRs), magnetoencephalography (MEG) or eye-tracking. Notably, eye-related measures are less commonly used, despite their prominence in cognitive load research among neurotypical individuals. The review also highlights potential correlates of cognitive load, such as neural oscillations in the theta and alpha ranges for EEG studies, blood oxygenation level-dependent (BOLD) responses in lateral and medial frontal brain regions for fMRI and fNIRS studies and eye-related measures such as pupil dilation and blink rate. Finally, critical issues for future studies are discussed, including the technical challenges associated with multimodal approaches, the possible impact of atypical features on cognitive load measures and balancing data richness with participant well-being. These insights contribute to a more nuanced understanding of cognitive load measurement in neurodivergent populations and point to important methodological considerations for future neuroscientific research in this area.

Webcam-based eye tracking to detect mind wandering and comprehension errors

Recent advances in computer vision have opened the door for scalable eye tracking using only a webcam. Such solutions are particularly useful for online educational technologies, in which a goal is to respond adaptively to students' ongoing experiences. We used WebGazer, a webcam-based eye-tracker, to automatically detect covert cognitive states during an online reading-comprehension task related to task-unrelated thought and comprehension. We present data from two studies using different populations: (1) a relatively homogenous sample of university students (N = 105), and (2) a more diverse sample from Prolific (N = 173, with < 20% White participants). Across both studies, the webcam-based eye-tracker provided sufficiently accurate and precise gaze measurements to predict both task-unrelated thought and reading comprehension from a single calibration. We also present initial evidence of predictive validity, including a positive correlation between predicted rates of task-unrelated thought and comprehension scores. Finally, we present slicing analyses to determine how performance changed under certain conditions (lighting, glasses, etc.) and generalizability of the results across the two datasets (e.g., training on the data Study 1 and testing on data from Study 2, and vice versa). We conclude by discussing results in the context of remote research and learning technologies.

Mapping the bioimaging marker of Alzheimer's disease based on pupillary light response-driven brain-wide fMRI in awake mice

Pupil dynamics has emerged as a critical non-invasive indicator of brain state changes. In particular, pupillary-light-responses (PLR) in Alzheimer's disease (AD) patients may be used as biomarkers of brain degeneration. To characterize AD-specific PLR and its underlying neuromodulatory sources, we combined high-resolution awake mouse fMRI with real-time pupillometry to map brain-wide event-related correlation patterns based on illumination-driven pupil constriction ( P c ) and post-illumination pupil dilation recovery (amplitude, P d , and time, T ). The P c -driven differential analysis revealed altered visual signal processing coupled with reduced thalamocortical activation in AD mice compared with the wild-type normal mice. In contrast, the post-illumination pupil dilation recovery-based fMRI highlighted multiple brain areas related to AD brain degeneration, including the cingulate cortex, hippocampus, septal area of the basal forebrain, medial raphe nucleus, and pontine reticular nuclei (PRN). Also, brain-wide functional connectivity analysis highlighted the most significant changes in PRN of AD mice, which serves as the major subcortical relay nuclei underlying oculomotor function. This work combined non-invasive pupil-fMRI measurements in preclinical models to identify pupillary biomarkers based on neuromodulatory dysfunction coupled with AD brain degeneration.

Designing Combinations of Pictogram and Text Size for Icons: Effects of Text Size, Pictogram Size, and Familiarity on Older Adults' Visual Search Performance

OBJECTIVE

This study aimed to determine suitable combinations of text and pictogram sizes for older adults and investigated the visual prioritization of pictogram versus text.

BACKGROUND

Icons have become an indispensable part of application (app) design. Pictogram size and text size of icons influence the usability of apps, especially by aged users. However, few studies have investigated the influences of different pictogram and text size combinations on readability, legibility, and visual search performance for older adults.

METHOD

This study used eye-tracking technology to investigate the effects of different pictogram and text size combinations as well as familiarity on readability, legibility, and visual search performance for older adults. A 3 (pictogram size) × 3 (text size) × 2 (familiarity) repeated-measures experimental design was used.

RESULTS

The results of this study suggest that pictogram size and text size significantly affect visual search performance and that familiarity moderates the effect of text size on distribution of fixation duration proportion for text and pictograms.

CONCLUSION

Large pictogram and text sizes improved the readability and legibility of icons for older adults. Furthermore, the older adults fixated the area of text prior to pictograms when the pictogram size was larger than 72 × 72 px (1.38° × 1.38°) in the visual search task.

APPLICATION

The results of this study suggest using different combinations of pictogram and text sizes for older adults under different scenarios. The findings of this study act as practical support for designers and developers of mobile apps for older adults.

Prediction error and memory across the lifespan

The influence of Prediction Errors (PEs) on episodic memory has generated growing empirical and theoretical interest. This review explores how the relationship between PE and memory may evolve throughout lifespan. Drawing upon the predictive processing framework and the Predictive, Interactive Multiple Memory System (PIMMS) model in particular, the paper highlights the hierarchical organization of memory systems and the interaction between top-down predictions and bottom-up sensory input, proposing that PEs promote synaptic change and improve encoding and consolidation processes. We discuss the neuroscientific mechanisms underlying PE-driven memory enhancement, focusing on the involvement of the hippocampus, the entorhinal cortex-hippocampus pathway, and the noradrenergic sympathetic system. Recognizing the divergent trajectories of episodic and semantic memory across the lifespan is crucial when examining the effects of PEs on memory. This review underscores the heterogeneity of memory processes and neurocognitive mechanisms underlying PE-driven memory enhancement across age. Future research is suggested to directly compare neural networks involved in learning from PEs across different age groups and to contribute to a deeper understanding of PE-driven learning across age.

Pupil dilation response elicited by violations of auditory regularities is a promising but challenging approach to probe consciousness at the bedside

Pupil dilation response (PDR) has been proposed as a physiological marker of conscious access to a stimulus or its attributes, such as novelty. In a previous study on healthy volunteers, we adapted the auditory "local global" paradigm and showed that violations of global regularity elicited a PDR. Notably without instructions, this global effect was present only in participants who could consciously report violations of global regularities. In the present study, we used a similar approach in 24 non-communicating patients affected with a Disorder of Consciousness (DoC) and compared PDR to ERPs regarding diagnostic and prognostic performance. At the group level, global effect could not be detected in DoC patients. At the individual level, the only patient with a PDR global effect was in a MCS and recovered consciousness at 6 months. Contrasting the most regular trials to the most irregular ones improved PDR's diagnostic and prognostic power in DoC patients. Pupillometry is a promising tool but requires several methodological improvements to enhance the signal-to-noise ratio and make it more robust for probing consciousness and cognition in DoC patients.

Phonological discrimination and contrast detection in pupillometry

Introduction

The perception of phonemes is guided by both low-level acoustic cues and high-level linguistic context. However, differentiating between these two types of processing can be challenging. In this study, we explore the utility of pupillometry as a tool to investigate both low- and high-level processing of phonological stimuli, with a particular focus on its ability to capture novelty detection and cognitive processing during speech perception.

Methods

Pupillometric traces were recorded from a sample of 22 Danish-speaking adults, with self-reported normal hearing, while performing two phonological-contrast perception tasks: a nonword discrimination task, which included minimal-pair combinations specific to the Danish language, and a nonword detection task involving the detection of phonologically modified words within sentences. The study explored the perception of contrasts in both unprocessed speech and degraded speech input, processed with a vocoder.

Results

No difference in peak pupil dilation was observed when the contrast occurred between two isolated nonwords in the nonword discrimination task. For unprocessed speech, higher peak pupil dilations were measured when phonologically modified words were detected within a sentence compared to sentences without the nonwords. For vocoded speech, higher peak pupil dilation was observed for sentence stimuli, but not for the isolated nonwords, although performance decreased similarly for both tasks.

Conclusion

Our findings demonstrate the complexity of pupil dynamics in the presence of acoustic and phonological manipulation. Pupil responses seemed to reflect higher-level cognitive and lexical processing related to phonological perception rather than low-level perception of acoustic cues. However, the incorporation of multiple talkers in the stimuli, coupled with the relatively low task complexity, may have affected the pupil dilation.

Exploring the potential of eye tracking on personalized learning and real-time feedback in modern education

Eye tracking is one of the techniques used to investigate cognitive mechanisms involved in the school context, such as joint attention and visual perception. Eye tracker has portability, straightforward application, cost-effectiveness, and infant-friendly neuroimaging measures of cognitive processes such as attention, engagement, and learning. Furthermore, the ongoing software enhancements coupled with the implementation of artificial intelligence algorithms have improved the precision of collecting eye movement data and simplified the calibration process. These characteristics make it plausible to consider eye-tracking technology a promising tool to assist the teaching-learning process in school routines. However, eye tracking needs to be explored more as an educational instrument for real-time classroom activities and teachers' feedback. This perspective article briefly presents the fundamentals of the eye-tracking technique and four illustrative examples of employing this method in everyday school life. The first application shows how eye tracker information may contribute to teacher assessment of students' computational thinking in coding classes. In the second and third illustrations, we discuss the additional information provided by the eye-tracker to the teacher assessing the student's strategies to solve fraction problems and chart interpretation. The last illustration demonstrates the potential of eye tracking to provide Real-time feedback on learning difficulties/disabilities. Thus, we highlight the potential of the eye tracker as a complementary tool to promote personalized education and discuss future perspectives. In conclusion, we suggest that an eye-tracking system could be helpful by providing real-time student gaze leading to immediate teacher interventions and metacognition strategies.

Phasic, Event-Related Transcutaneous Auricular Vagus Nerve Stimulation Modifies Behavioral, Pupillary, and Low-Frequency Oscillatory Power Responses

Transcutaneous auricular vagus nerve stimulation (taVNS) has been proposed to activate the locus ceruleus-noradrenaline (LC-NA) system. However, previous studies failed to find consistent modulatory effects of taVNS on LC-NA biomarkers. Previous studies suggest that phasic taVNS may be capable of modulating LC-NA biomarkers such as pupil dilation and alpha oscillations. However, it is unclear whether these effects extend beyond pure sensory vagal nerve responses. Critically, the potential of the pupillary light reflex as an additional taVNS biomarker has not been explored so far. Here, we applied phasic active and sham taVNS in 29 subjects (16 female, 13 male) while they performed an emotional Stroop task (EST) and a passive pupil light reflex task (PLRT). We recorded pupil size and brain activity dynamics using a combined Magnetoencephalography (MEG) and pupillometry design. Our results show that phasic taVNS significantly increased pupil dilation and performance during the EST. During the PLRT, active taVNS reduced and delayed pupil constriction. In the MEG, taVNS increased frontal-midline theta and alpha power during the EST, whereas occipital alpha power was reduced during both the EST and PLRT. Our findings provide evidence that phasic taVNS systematically modulates behavioral, pupillary, and electrophysiological parameters of LC-NA activity during cognitive processing. Moreover, we demonstrate for the first time that the pupillary light reflex can be used as a simple and effective proxy of taVNS efficacy. These findings have important implications for the development of noninvasive neuromodulation interventions for various cognitive and clinical applications.SIGNIFICANCE STATEMENT taVNS has gained increasing attention as a noninvasive neuromodulation technique and is widely used in clinical and nonclinical research. Nevertheless, the exact mechanism of action of taVNS is not yet fully understood. By assessing physiology and behavior in a response conflict task in healthy humans, we demonstrate the first successful application of a phasic, noninvasive vagus nerve stimulation to improve cognitive control and to systematically modulate pupillary and electrophysiological markers of the noradrenergic system. Understanding the mechanisms of action of taVNS could optimize future clinical applications and lead to better treatments for mental disorders associated with noradrenergic dysfunction. In addition, we present a new taVNS-sensitive pupillary measure representing an easy-to-use biomarker for future taVNS studies.

Look into my eyes: What can eye-based measures tell us about the relationship between physical activity and cognitive performance?

BACKGROUND

There is a growing interest to understand the neurobiological mechanisms that drive the positive associations of physical activity and fitness with measures of cognitive performance. To better understand those mechanisms, several studies have employed eye-based measures (e.g., eye movement measures such as saccades, pupillary measures such as pupil dilation, and vascular measures such as retinal vessel diameter) deemed to be proxies for specific neurobiological mechanisms. However, there is currently no systematic review providing a comprehensive overview of these studies in the field of exercise-cognition science. Thus, this review aimed to address that gap in the literature.

METHODS

To identify eligible studies, we searched 5 electronic databases on October 23, 2022. Two researchers independently extracted data and assessed the risk of bias using a modified version of the Tool for the assEssment of Study qualiTy and reporting in EXercise (TESTEX scale, for interventional studies) and the critical appraisal tool from the Joanna Briggs Institute (for cross-sectional studies).

RESULTS

Our systematic review (n = 35 studies) offers the following main findings: (a) there is insufficient evidence available to draw solid conclusions concerning gaze-fixation-based measures; (b) the evidence that pupillometric measures, which are a proxy for the noradrenergic system, can explain the positive effect of acute exercise and cardiorespiratory fitness on cognitive performance is mixed; (c) physical training- or fitness-related changes of the cerebrovascular system (operationalized via changes in retinal vasculature) are, in general, positively associated with cognitive performance improvements; (d) acute and chronic physical exercises show a positive effect based on an oculomotor-based measure of executive function (operationalized via antisaccade tasks); and (e) the positive association between cardiorespiratory fitness and cognitive performance is partly mediated by the dopaminergic system (operationalized via spontaneous eye-blink rate).

CONCLUSION

This systematic review offers confirmation that eye-based measures can provide valuable insight into the neurobiological mechanisms that may drive positive associations between physical activity and fitness and measures of cognitive performance. However, due to the limited number of studies utilizing specific methods for obtaining eye-based measures (e.g., pupillometry, retinal vessel analysis, spontaneous eye blink rate) or investigating a possible dose-response relationship, further research is necessary before more nuanced conclusions can be drawn. Given that eye-based measures are economical and non-invasive, we hope this review will foster the future application of eye-based measures in the field of exercise-cognition science.

AI for Psychometrics: Validating Machine Learning Models in Measuring Emotional Intelligence with Eye-Tracking Techniques

AI, or artificial intelligence, is a technology of creating algorithms and computer systems that mimic human cognitive abilities to perform tasks. Many industries are undergoing revolutions due to the advances and applications of AI technology. The current study explored a burgeoning field-Psychometric AI, which integrates AI methodologies and psychological measurement to not only improve measurement accuracy, efficiency, and effectiveness but also help reduce human bias and increase objectivity in measurement. Specifically, by leveraging unobtrusive eye-tracking sensing techniques and performing 1470 runs with seven different machine-learning classifiers, the current study systematically examined the efficacy of various (ML) models in measuring different facets and measures of the emotional intelligence (EI) construct. Our results revealed an average accuracy ranging from 50-90%, largely depending on the percentile to dichotomize the EI scores. More importantly, our study found that AI algorithms were powerful enough to achieve high accuracy with as little as 5 or 2 s of eye-tracking data. The research also explored the effects of EI facets/measures on ML measurement accuracy and identified many eye-tracking features most predictive of EI scores. Both theoretical and practical implications are discussed.

Dogs Rely On Visual Cues Rather Than On Effector-Specific Movement Representations to Predict Human Action Targets

The ability to predict others' actions is one of the main pillars of social cognition. We investigated the processes underlying this ability by pitting motor representations of the observed movements against visual familiarity. In two pre-registered eye-tracking experiments, we measured the gaze arrival times of 16 dogs (Canis familiaris) who observed videos of a human or a conspecific executing the same goal-directed actions. On the first trial, when the human agent performed human-typical movements outside dogs' specific motor repertoire, dogs' gaze arrived at the target object anticipatorily (i.e., before the human touched the target object). When the agent was a conspecific, dogs' gaze arrived to the target object reactively (i.e., upon or after touch). When the human agent performed unusual movements more closely related to the dogs' motor possibilities (e.g., crawling instead of walking), dogs' gaze arrival times were intermediate between the other two conditions. In a replication experiment, with slightly different stimuli, dogs' looks to the target object were neither significantly predictive nor reactive, irrespective of the agent. However, when including looks at the target object that were not preceded by looks to the agents, on average dogs looked anticipatorily and sooner at the human agent's action target than at the conspecific's. Looking times and pupil size analyses suggest that the dogs' attention was captured more by the dog agent. These results suggest that visual familiarity with the observed action and saliency of the agent had a stronger influence on the dogs' looking behaviour than effector-specific movement representations in anticipating action targets.

The impact of Alzheimer's disease risk factors on the pupillary light response

Alzheimer's disease (AD) is the leading cause of dementia, and its prevalence is increasing and is expected to continue to increase over the next few decades. Because of this, there is an urgent requirement to determine a way to diagnose the disease, and to target interventions to delay and ideally stop the onset of symptoms, specifically those impacting cognition and daily livelihood. The pupillary light response (PLR) is controlled by the sympathetic and parasympathetic branches of the autonomic nervous system, and impairments to the pupillary light response (PLR) have been related to AD. However, most of these studies that assess the PLR occur in patients who have already been diagnosed with AD, rather than those who are at a higher risk for the disease but without a diagnosis. Determining whether the PLR is similarly impaired in subjects before an AD diagnosis is made and before cognitive symptoms of the disease begin, is an important step before using the PLR as a diagnostic tool. Specifically, identifying whether the PLR is impaired in specific at-risk groups, considering both genetic and non-genetic risk factors, is imperative. It is possible that the PLR may be impaired in association with some risk factors but not others, potentially indicating different pathways to neurodegeneration that could be distinguished using PLR. In this work, we review the most common genetic and lifestyle-based risk factors for AD and identify established relationships between these risk factors and the PLR. The evidence here shows that many AD risk factors, including traumatic brain injury, ocular and intracranial hypertension, alcohol consumption, depression, and diabetes, are directly related to changes in the PLR. Other risk factors currently lack sufficient literature to make any conclusions relating directly to the PLR but have shown links to impairments in the parasympathetic nervous system; further research should be conducted in these risk factors and their relation to the PLR.

Neuronal correlates of eyeblinks are an expression of primary consciousness phenomena

The blinking rate far exceeds that required for moistening the cornea and changes depending on whether a person is resting or engaged in cognitive tasks. During ecological cognitive tasks (such as speaking, reading, and watching videos), blinks occur at breakpoints of attention suggesting a role in information segmentation, but the close relationship between cognition dynamics and blink timing still escapes a full understanding. The aim of the present study is to seek (1) if there is a temporal relationship between blink events and the consecutive steps of cognitive processing, and (2) if blink timing and the intensity of blink-related EEG responses are affected by task-relevance of stimuli. Our results show that, in a classical visual oddball task, (i) the occurrence of blinks is influenced by stimuli, irrespective of their relevance, (ii) blinks following relevant stimuli are only apparently delayed due to the need of finalizing a behavioural response, and (iii) stimulus relevance does not affect the intensity of the blink-related EEG response. This evidence reinforce the idea that blinks are not emitted until the last step of the processing sequence has been completed and suggests that blink-related EEG responses are generated by primary consciousness phenomena which are considered by their nature non-modulable (all-or-nothing) phenomena.

Physiological Measurements of Situation Awareness: A Systematic Review

OBJECTIVE

The goal of this systematic literature review is to investigate the relationship between indirect physiological measurements and direct measures of situation awareness (SA).

BACKGROUND

Across different environments and tasks, assessments of SA are often performed using techniques designed specifically to directly measure SA, such as SAGAT, SPAM, and/or SART. However, research suggests that indirect physiological sensing methods may also be capable of predicting SA. Currently, it is unclear which particular physiological approaches are sensitive to changes in SA.

METHOD

Seven databases were searched using the PRISMA reporting guidelines. Eligibility criteria included human-subject experiments that used at least one direct SA assessment technique, as well as at least one physiological measurement. Information extracted from each article was the physiological metric(s), the direct SA measurement(s), the correlation between these two metrics, and the experimental task(s). All studies underwent a quality assessment.

RESULTS

Twenty-five articles were included in this review. Eye tracking techniques were the most commonly used physiological measures, and correlations between conscious aspects of eye movement measures and direct SA scores were observed. Evidence for cardiovascular predictors of SA were mixed. EEG studies were too few to form strong conclusions, but were consistently positive.

CONCLUSION

Further investigation is needed to methodically collect more relevant data and comprehensively model the relationships between a wider range of physiological measurements and direct assessments of SA.

APPLICATION

This review will guide researchers and practitioners in methods to indirectly assess SA with sensors and highlight opportunities for future research on wearables and SA.

Eye-tracking paradigms for the assessment of mild cognitive impairment: a systematic review

Mild cognitive impairment (MCI), representing the 'transitional zone' between normal cognition and dementia, has become a novel topic in clinical research. Although early detection is crucial, it remains logistically challenging at the same time. While traditional pen-and-paper tests require in-depth training to ensure standardized administration and accurate interpretation of findings, significant technological advancements are leading to the development of procedures for the early detection of Alzheimer's disease (AD) and facilitating the diagnostic process. Some of the diagnostic protocols, however, show significant limitations that hamper their widespread adoption. Concerns about the social and economic implications of the increasing incidence of AD underline the need for reliable, non-invasive, cost-effective, and timely cognitive scoring methodologies. For instance, modern clinical studies report significant oculomotor impairments among patients with MCI, who perform poorly in visual paired-comparison tasks by ascribing less attentional resources to novel stimuli. To accelerate the Global Action Plan on the Public Health Response to Dementia 2017-2025, this work provides an overview of research on saccadic and exploratory eye-movement deficits among older adults with MCI. The review protocol was drafted based on the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. Electronic databases were systematically searched to identify peer-reviewed articles published between 2017 and 2022 that examined visual processing in older adults with MCI and reported gaze parameters as potential biomarkers. Moreover, following the contemporary trend for remote healthcare technologies, we reviewed studies that implemented non-commercial eye-tracking instrumentation in order to detect information processing impairments among the MCI population. Based on the gathered literature, eye-tracking-based paradigms may ameliorate the screening limitations of traditional cognitive assessments and contribute to early AD detection. However, in order to translate the findings pertaining to abnormal gaze behavior into clinical applications, it is imperative to conduct longitudinal investigations in both laboratory-based and ecologically valid settings.

Speech recognition in noise task among children and young-adults: a pupillometry study

Introduction

Children experience unique challenges when listening to speech in noisy environments. The present study used pupillometry, an established method for quantifying listening and cognitive effort, to detect temporal changes in pupil dilation during a speech-recognition-in-noise task among school-aged children and young adults.

Methods

Thirty school-aged children and 31 young adults listened to sentences amidst four-talker babble noise in two signal-to-noise ratios (SNR) conditions: high accuracy condition (+10 dB and  + 6 dB, for children and adults, respectively) and low accuracy condition (+5 dB and + 2 dB, for children and adults, respectively). They were asked to repeat the sentences while pupil size was measured continuously during the task.

Results

During the auditory processing phase, both groups displayed pupil dilation; however, adults exhibited greater dilation than children, particularly in the low accuracy condition. In the second phase (retention), only children demonstrated increased pupil dilation, whereas adults consistently exhibited a decrease in pupil size. Additionally, the children's group showed increased pupil dilation during the response phase.

Discussion

Although adults and school-aged children produce similar behavioural scores, group differences in dilation patterns point that their underlying auditory processing differs. A second peak of pupil dilation among the children suggests that their cognitive effort during speech recognition in noise lasts longer than in adults, continuing past the first auditory processing peak dilation. These findings support effortful listening among children and highlight the need to identify and alleviate listening difficulties in school-aged children, to provide proper intervention strategies.

Motor synchronization and impulsivity in pediatric borderline personality disorder with and without attention-deficit hyperactivity disorder: an eye-tracking study of saccade, blink and pupil behavior

Shifting motor actions from reflexively reacting to an environmental stimulus to predicting it allows for smooth synchronization of behavior with the outside world. This shift relies on the identification of patterns within the stimulus - knowing when a stimulus is predictable and when it is not - and launching motor actions accordingly. Failure to identify predictable stimuli results in movement delays whereas failure to recognize unpredictable stimuli results in early movements with incomplete information that can result in errors. Here we used a metronome task, combined with video-based eye-tracking, to quantify temporal predictive learning and performance to regularly paced visual targets at 5 different interstimulus intervals (ISIs). We compared these results to the random task where the timing of the target was randomized at each target step. We completed these tasks in female pediatric psychiatry patients (age range: 11-18 years) with borderline personality disorder (BPD) symptoms, with (n = 22) and without (n = 23) a comorbid attention-deficit hyperactivity disorder (ADHD) diagnosis, against controls (n = 35). Compared to controls, BPD and ADHD/BPD cohorts showed no differences in their predictive saccade performance to metronome targets, however, when targets were random ADHD/BPD participants made significantly more anticipatory saccades (i.e., guesses of target arrival). The ADHD/BPD group also significantly increased their blink rate and pupil size when initiating movements to predictable versus unpredictable targets, likely a reflection of increased neural effort for motor synchronization. BPD and ADHD/BPD groups showed increased sympathetic tone evidenced by larger pupil sizes than controls. Together, these results support normal temporal motor prediction in BPD with and without ADHD, reduced response inhibition in BPD with comorbid ADHD, and increased pupil sizes in BPD patients. Further these results emphasize the importance of controlling for comorbid ADHD when querying BPD pathology.

Data-Driven Pupil Response Profiles as Transdiagnostic Readouts for the Detection of Neurocognitive Functioning in Affective and Anxiety Disorders

BACKGROUND

Neurocognitive functioning is a relevant transdiagnostic dimension in psychiatry. As pupil size dynamics track cognitive load during a working memory task, we aimed to explore if this parameter allows identification of psychophysiological subtypes in healthy participants and patients with affective and anxiety disorders.

METHODS

Our sample consisted of 226 participants who completed the n-back task during simultaneous functional magnetic resonance imaging and pupillometry measurements. We used latent class growth modeling to identify clusters based on pupil size in response to cognitive load. In a second step, these clusters were compared on affective and anxiety symptom levels, performance in neurocognitive tests, and functional magnetic resonance imaging activity.

RESULTS

The clustering analysis resulted in two distinct pupil response profiles: one with a stepwise increasing pupil size with increasing cognitive load (reactive group) and one with a constant pupil size across conditions (nonreactive group). A larger increase in pupil size was significantly associated with better performance in neurocognitive tests in executive functioning and sustained attention. Statistical maps of parametric modulation of pupil size during the n-back task showed the frontoparietal network in the positive contrast and the default mode network in the negative contrast. The pupil response profile of the reactive group was associated with more thalamic activity, likely reflecting better arousal upregulation and less deactivation of the limbic system.

CONCLUSIONS

Pupil measurements have the potential to serve as a highly sensitive psychophysiological readout for detection of neurocognitive deficits in the core domain of executive functioning, adding to the development of valid transdiagnostic constructs in psychiatry.

The Development of Flexible Problem Solving: An Integrative Approach

Flexible problem solving, the ability to deal with currently goal-irrelevant information that may have been goal-relevant in previous, similar situations, plays a prominent role in cognitive development and has been repeatedly investigated in developmental research. However, this research, spanning from infancy to the school years, lacks a unifying framework, obscuring the developmental timing of flexible problem solving. Therefore, in this review paper, previous findings are gathered, organized, and integrated under a common framework to unveil how and when flexible problem solving develops. It is showed that the development of flexible problem solving coincides with increases in executive functions, that is, inhibition, working memory and task switching. The analysis of previous findings shows that dealing with goal-irrelevant, non-salient information received far more attention than generalizing in the presence of goal-irrelevant, salient information. The developmental timing of the latter can only be inferred from few transfer studies, as well as executive functions, planning and theory of mind research, to highlight gaps in knowledge and sketch out future research directions. Understanding how transfer in the presence of seemingly relevant but truly irrelevant information develops has implications for well-balanced participation in information societies, early and lifespan education, and investigating the evolutionary trajectory of flexible problem solving.

The Development of Relational Reasoning: An Eyetracking Analysis of Strategy Use and Adaptation in Children and Adults Performing Matrix Completion

Relational reasoning is a key component of fluid intelligence and an important predictor of academic achievement. Relational reasoning is commonly assessed using matrix completion tasks, in which participants see an incomplete matrix of items that vary on different dimensions and select a response that best completes the matrix based on the relations among items. Performance on such assessments increases dramatically across childhood into adulthood. However, despite widespread use, little is known about the strategies associated with good or poor matrix completion performance in childhood. This study examined the strategies children and adults use to solve matrix completion problems, how those strategies change with age, and whether children and adults adapt strategies to difficulty. We used eyetracking to infer matrix completion strategy use in 6- and 9-year-old children and adults. Across ages, scanning across matrix rows and columns predicted good overall performance, and quicker and higher rates of consulting potential answers predicted poor performance, indicating that optimal matrix completion strategies are similar across development. Indices of good strategy use increased across childhood. As problems increased in difficulty, children and adults increased their scanning of matrix rows and columns, and adults and 9-year-olds also shifted strategies to rely more on consulting potential answers. Adapting strategies to matrix difficulty, particularly increased scanning of rows and columns, was associated with good overall performance in both children and adults. These findings underscore the importance of both spontaneous and adaptive strategy use in individual differences in relational reasoning and its development.

On the relationship of arousal and attentional distraction by emotional novel sounds

Unexpected and task-irrelevant sounds can impair performance in a task. It has been shown that highly arousing emotional distractor sounds impaired performance less compared to moderately arousing neutral distractor sounds. The present study tests whether these differential emotion-related distraction effects are directly related to an enhancement of arousal evoked by processing of emotional distractor sounds. We disentangled costs of orienting of attention and benefits of increased arousal levels during the presentation of highly arousing emotional and moderately arousing neutral novel sounds that were embedded in a sequence of repeated standard sounds. We used sound-related pupil dilation responses as a marker of arousal and RTs as a marker of distraction in a visual categorization task in 57 healthy young adults. Multilevel analyses revealed increased RT and increased pupil dilation in response to novel vs. standard sounds. Emotional novel sounds reduced distraction effects on the behavioral level and increased pupil dilation responses compared to neutral novel sounds. Bayes Factors revealed strong evidence against an inverse proportional relationship between behavioral distraction effects and sound-related pupil dilation responses for emotional sounds. Given that the activity of the locus coeruleus has been linked to both changes in pupil diameter and arousal, it may embody an indirect relationship as a common antecedent by the release of norepinephrine into brain networks involved in attention control and control of the pupil. The present study provides new insights into the relation of changes in arousal and attentional distraction during the processing of emotional task-irrelevant novel sounds.

Effects of an intelligent virtual assistant on office task performance and workload in a noisy environment

This study examines the effects of noise and the use of an Intelligent Virtual Assistant (IVA) on the task performance and workload of office workers. Data were collected from forty-eight adults across varied office task scenarios (i.e., sending an email, setting up a timer/reminder, and searching for a phone number/address) and noise types (i.e., silence, non-verbal noise, and verbal noise). The baseline for this study is measured without the use of an IVA. Significant differences in performance and workload were found on both objective and subjective measures. In particular, verbal noise emerged as the primary factor affecting performance using an IVA. Task performance was dependent on the task scenario and noise type. Subjective ratings found that participants preferred to use IVA for less complex tasks. Future work can focus more on the effects of tasks, demographics, and learning curves. Furthermore, this work can help guide IVA system designers by highlighting factors affecting performance.

Keeping an eye on cost: What can eye tracking tell us about attention to cost information in discrete choice experiments?

Concern has been expressed about including a cost attribute within discrete choice experiments (DCEs) when individuals do not have to pay at the point of consumption. We use eye tracking to investigate attention to cost when valuing publicly financed health care. One-hundred and four individuals completed a DCE concerned with preferences for UK general practitioner appointments: 51 responded to a DCE with cost included and 53 to the same DCE without cost. Eye-movements were tracked whilst respondents completed the DCE. We assessed if respondents pay attention to cost. We then compare fixation time (FT) on attributes, eye movement patterns and mental effort across the experimental groups. Results are encouraging for the inclusion of cost in DCEs valuing publicly provided healthcare. Most respondents gave visual attention to the cost attribute most of the time. Average FT on multi-attribute tasks increased by 44% in the cost DCE, with attention to non-monetary attributes increasing by 22%. Including cost led to more structured decision-making and did not increase mental effort. Acceptability of the cost attribute and difficulty of choice tasks were predictors of cost information processing, highlighting the importance of both motivating the cost attribute and considering difficulty of the tasks when developing DCEs.

Developmental eye movement strategies for decoding facial expressions of emotion

In our daily lives, we routinely look at the faces of others to try to understand how they are feeling. Few studies have examined the perceptual strategies that are used to recognize facial expressions of emotion, and none have attempted to isolate visual information use with eye movements throughout development. Therefore, we recorded the eye movements of children from 5 years of age up to adulthood during recognition of the six "basic emotions" to investigate when perceptual strategies for emotion recognition become mature (i.e., most adult-like). Using iMap4, we identified the eye movement fixation patterns for recognition of the six emotions across age groups in natural viewing and gaze-contingent (i.e., expanding spotlight) conditions. While univariate analyses failed to reveal significant differences in fixation patterns, more sensitive multivariate distance analyses revealed a U-shaped developmental trajectory with the eye movement strategies of the 17- to 18-year-old group most similar to adults for all expressions. A developmental dip in strategy similarity was found for each emotional expression revealing which age group had the most distinct eye movement strategy from the adult group: the 13- to 14-year-olds for sadness recognition; the 11- to 12-year-olds for fear, anger, surprise, and disgust; and the 7- to 8-year-olds for happiness. Recognition performance for happy, angry, and sad expressions did not differ significantly across age groups, but the eye movement strategies for these expressions diverged for each group. Therefore, a unique strategy was not a prerequisite for optimal recognition performance for these expressions. Our data provide novel insights into the developmental trajectories underlying facial expression recognition, a critical ability for adaptive social relations.

Time Scales and Moments of Listening Effort Revealed in Pupillometry

This article offers a collection of observations that highlight the value of time course data in pupillometry and points out ways in which these observations create deeper understanding of listening effort. The main message is that listening effort should be considered on a moment-to-moment basis rather than as a singular amount. A review of various studies and the reanalysis of data reveal distinct signatures of effort before a stimulus, during a stimulus, in the moments after a stimulus, and changes over whole experimental testing sessions. Collectively these observations motivate questions that extend beyond the "amount" of effort, toward understanding how long the effort lasts, and how precisely someone can allocate effort at specific points in time or reduce effort at other times. Apparent disagreements between studies are reconsidered as informative lessons about stimulus selection and the nature of pupil dilation as a reflection of decision making rather than the difficulty of sensory encoding.

Testing locus coeruleus-norepinephrine accounts of working memory, attention control, and fluid intelligence

The current set of studies examined the relationship among working memory capacity, attention control, fluid intelligence, and pupillary correlates of tonic arousal regulation and phasic responsiveness in a combined sample of more than 1,000 participants in two different age ranges (young adults and adolescents). Each study was designed to test predictions made by two recent theories regarding the role of the locus coeruleus-norepinephrine (LC-NE) system in determining individual differences in cognitive ability. The first theory, proposed by Unsworth and Robison (2017a), posits two important individual differences: the moment-to-moment regulation of tonic arousal, and the phasic responsiveness of the system to goal-relevant stimuli. The second theory, proposed by Tsukahara and Engle (2021a), argues that people with higher cognitive abilities have greater functional connectivity between the LC-NE system and cortical networks at rest. These two theories are not mutually exclusive, but they make different predictions. Overall, we found no evidence consistent with a resting-state theory. However, phasic responsiveness was consistently correlated with working memory capacity, attention control, and fluid intelligence, supporting a prediction made by Unsworth and Robison (2017a). Tonic arousal regulation was not correlated with working memory or fluid intelligence and was inconsistently correlated with attention control, which offers only partial support for Unsworth and Robison's (2017a) second prediction.

[Formula: see text] A cross-cultural study of visual attention in autism spectrum disorder

Differences in visual attention have been documented in ASD, and appear linked to clinical symptoms. However, most research has been conducted in Western cultures. Because striking differences in visual attention patterns have been documented in other cultures, it is important to understand how culture may influence attentional patterns in ASD. This study compared differences in visual attention in ASD across Western and East Asian cultures, where differences in attention to contextual and global information have been repeatedly demonstrated, to investigate potential culturally-specific ASD phenotypes. One hundred thirty-two total participants included individuals with ASD (n = 24) and controls (n = 47) from Hong Kong (HK), along with a previously studied group of age- and IQ-comparable participants from the United States (n = 26 ASD; n = 35 control). Gaze was tracked while participants completed two narrative tasks that differed in social-emotional complexity. Proportions of fixations to face, bodies, and setting were examined across groups using linear mixed-effect models and a series of growth curve models. Cultural differences were found across tasks and groups. Both the ASD and control HK groups attended more to global contextual setting information, more to the body regions, and less toward faces of characters compared to US groups. Growth curve models indicated that these differences attenuated over time in certain stimuli. ASD-related effects were only observed in the more complex stimuli depicting characters with ambiguous facial expressions. Findings indicate a notable cultural influence on visual attention patterns in ASD, and underscore the importance of stimuli complexity in differentiating cultural versus diagnostic effects on attentional styles.

A pupillometric investigation of state regulation in adults scoring high versus low on ADHD symptomatology

According to the state regulation deficit (SRD) account, ADHD is associated with difficulties regulating tonic arousal levels, which may be due to inefficient effort allocation. We aimed to test the SRD account by using a target detection task with three different event rates (ER; 700 ms, 1800 ms, 6000 ms), in order to manipulate the tonic arousal state and its effects on performance and pupil indices in adults with high (n = 40) versus low (n = 36) ADHD symptom levels. In an additional condition, a fast ER (700 ms) was accompanied by auditory white noise (WN), to further increase tonic arousal level. The ER manipulation had a clear effect on RT and variability of RT. These effects were more pronounced for the high-ADHD group, especially for variability of RT with decreasing ER, suggestive of deficient upregulation of a tonic arousal state in that group, in line with their self-reported SRDs in daily life. Adding WN to the fast condition led to more errors, however similarly for both groups. Contrary to our predictions, the ER manipulation had no effect on tonic pupil size (as a measure of tonic arousal). Phasic pupil amplitude (as a measure of cognitive effort) linearly increased with decreasing ER, suggesting more effort allocation during slower ERs. WN decreased phasic pupil amplitude, but had no impact on tonic pupil size. Importantly, however, no ADHD-related differences were present for the pupil indices. In conclusion, adults with elevated levels of ADHD symptoms reported more SRDs in daily life and showed a performance pattern that suggests difficulties in upregulating but not downregulating the tonic arousal state. Surprisingly, these findings were not accompanied by group differences in pupillometric indices. This casts some doubts on the relationship between these measures of autonomic nervous system activity and state regulation, in particular in the context of ADHD symptomatology.

Zoom behavior during visual search modulates pupil diameter and reflects adaptive control states

Adaptive gain theory proposes that the dynamic shifts between exploration and exploitation control states are modulated by the locus coeruleus-norepinephrine system and reflected in tonic and phasic pupil diameter. This study tested predictions of this theory in the context of a societally important visual search task: the review and interpretation of digital whole slide images of breast biopsies by physicians (pathologists). As these medical images are searched, pathologists encounter difficult visual features and intermittently zoom in to examine features of interest. We propose that tonic and phasic pupil diameter changes during image review may correspond to perceived difficulty and dynamic shifts between exploration and exploitation control states. To examine this possibility, we monitored visual search behavior and tonic and phasic pupil diameter while pathologists (N = 89) interpreted 14 digital images of breast biopsy tissue (1,246 total images reviewed). After viewing the images, pathologists provided a diagnosis and rated the level of difficulty of the image. Analyses of tonic pupil diameter examined whether pupil dilation was associated with pathologists' difficulty ratings, diagnostic accuracy, and experience level. To examine phasic pupil diameter, we parsed continuous visual search data into discrete zoom-in and zoom-out events, including shifts from low to high magnification (e.g., 1× to 10×) and the reverse. Analyses examined whether zoom-in and zoom-out events were associated with phasic pupil diameter change. Results demonstrated that tonic pupil diameter was associated with image difficulty ratings and zoom level, and phasic pupil diameter showed constriction upon zoom-in events, and dilation immediately preceding a zoom-out event. Results are interpreted in the context of adaptive gain theory, information gain theory, and the monitoring and assessment of physicians' diagnostic interpretive processes.

Examining the role of attentional allocation in working memory precision with pupillometry in children and adults

Working memory (WM) precision, or the fidelity with which items can be remembered, is an important aspect of WM capacity that increases over childhood. Why individuals are more or less precise from moment to moment and why WM becomes more stable with age are not yet fully understood. Here, we examined the role of attentional allocation in visual WM precision in children aged 8 to 13 years and young adults aged 18 to 27 years, as measured by fluctuations in pupil dilation during stimulus encoding and maintenance. Using mixed models, we examined intraindividual links between change in pupil diameter and WM precision across trials and the role of developmental differences in these associations. Through probabilistic modeling of error distributions and the inclusion of a visuomotor control task, we isolated mnemonic precision from other cognitive processes. We found an age-related increase in mnemonic precision that was independent of guessing behavior, serial position effects, fatigue or loss of motivation across the experiment, and visuomotor processes. Trial-by-trial analyses showed that trials with smaller changes in pupil diameter during encoding and maintenance predicted more precise responses than trials with larger changes in pupil diameter within individuals. At encoding, this relationship was stronger for older participants. Furthermore, the pupil-performance coupling grew across the delay period-particularly or exclusively for adults. These results suggest a functional link between pupil fluctuations and WM precision that grows over development; visual details may be stored more faithfully when attention is allocated efficiently to a sequence of objects at encoding and throughout a delay period.

Deep Learning Algorithms for Screening and Diagnosis of Systemic Diseases Based on Ophthalmic Manifestations: A Systematic Review

Deep learning (DL) is the new high-profile technology in medical artificial intelligence (AI) for building screening and diagnosing algorithms for various diseases. The eye provides a window for observing neurovascular pathophysiological changes. Previous studies have proposed that ocular manifestations indicate systemic conditions, revealing a new route in disease screening and management. There have been multiple DL models developed for identifying systemic diseases based on ocular data. However, the methods and results varied immensely across studies. This systematic review aims to summarize the existing studies and provide an overview of the present and future aspects of DL-based algorithms for screening systemic diseases based on ophthalmic examinations. We performed a thorough search in PubMed^®, Embase, and Web of Science for English-language articles published until August 2022. Among the 2873 articles collected, 62 were included for analysis and quality assessment. The selected studies mainly utilized eye appearance, retinal data, and eye movements as model input and covered a wide range of systemic diseases such as cardiovascular diseases, neurodegenerative diseases, and systemic health features. Despite the decent performance reported, most models lack disease specificity and public generalizability for real-world application. This review concludes the pros and cons and discusses the prospect of implementing AI based on ocular data in real-world clinical scenarios.

Investigating the Reliability of Pupillometry as a Measure of Individualized Listening Effort

Recordings of the pupillary response have been used in numerous studies to assess listening effort during a speech-in-noise task. Most studies focused on averaged responses across listeners, whereas less is known about pupil dilation as an indicator of the individuals’ listening effort. The present study investigated the reliability of several pupil features as potential indicators of individual listening effort and the impact of different normalization procedures on the reliability. The pupil diameters of 31 normal-hearing listeners were recorded during multiple visits while performing a speech-in-noise task. The signal-to-noise ratios (SNRs) of the stimuli ranged from −12 dB to +4 dB. All listeners were measured twice at separate visits, and 11 were re-tested at a third visit. To examine the reliability of the pupil responses across visits, the intraclass correlation coefficient was applied to the peak and mean pupil dilation and to the temporal features of the pupil response, extracted using growth curve analysis. The reliability of the pupillary response was assessed in relation to SNR and different normalization procedures over multiple visits. The most reliable pupil features were the traditional mean and peak pupil dilation. The highest reliability results were obtained when the data were baseline-corrected and normalized to the individual pupil response range across all visits. Moreover, the present study results showed only a minor impact of the SNR and the number of visits on the reliability of the pupil response. Overall, the results may provide an important basis for developing a standardized test for pupillometry in the clinic.

The use of gaze to study cognition: limitations, solutions, and applications to animal welfare

The study of gaze responses, typically using looking time paradigms, has become a popular approach to improving our understanding of cognitive processes in non-verbal individuals. Our interpretation of data derived from these paradigms, however, is constrained by how we conceptually and methodologically approach these problems. In this perspective paper, we outline the application of gaze studies in comparative cognitive and behavioral research and highlight current limitations in the interpretation of commonly used paradigms. Further, we propose potential solutions, including improvements to current experimental approaches, as well as broad-scale benefits of technology and collaboration. Finally, we outline the potential benefits of studying gaze responses from an animal welfare perspective. We advocate the implementation of these proposals across the field of animal behavior and cognition to aid experimental validity, and further advance our knowledge on a variety of cognitive processes and welfare outcomes.