Interpersonal eye-tracking reveals the dynamics of interacting minds

The human eye is a rich source of information about where, when, and how we attend. Our gaze paths indicate where and what captures our attention, while changes in pupil size can signal surprise, revealing our expectations. Similarly, the pattern of our blinks suggests levels of alertness and when our attention shifts between external engagement and internal thought. During interactions with others, these cues reveal how we coordinate and share our mental states. To leverage these insights effectively, we need accurate, timely methods to observe these cues as they naturally unfold. Advances in eye-tracking technology now enable real-time observation of these cues, shedding light on mutual cognitive processes that foster shared understanding, collaborative thought, and social connection. This brief review highlights these advances and the new opportunities they present for future research.

Applicability and usefulness of pupillometry in the study of lexical access. A scoping review of primary research

Pupil dilation has been associated with the effort required to perform various cognitive tasks. At the lexical level, some studies suggest that this neurophysiological measure would provide objective, real-time information during word processing and lexical access. However, due to the scarcity and incipient advancement of this line of research, its applicability, use, and sensitivity are not entirely clear. This scoping review aims to determine the applicability and usefulness of pupillometry in the study of lexical access by providing an up-to-date overview of research in this area. Following the PRISMA protocol, 16 articles were included in this review. The results show that pupillometry is a highly applicable, useful, and sensitive method for assessing lexical skills of word recognition, word retrieval, and semantic activation. Moreover, it easily fits into traditional research paradigms and methods in the field. Because it is a non-invasive, objective, and automated procedure, it can be applied to any population or age group. However, the emerging development of this specific area of research and the methodological diversity observed in the included studies do not yet allow for definitive conclusions in this area, which in turn does not allow for meta-analyses or fully conclusive statements about what the pupil response actually reflects when processing words. Standardized pupillary recording and analysis methods need to be defined to generate more accurate, replicable research designs with more reliable results to strengthen this line of research.

Development of a Smartphone-Based System for Intrinsically Photosensitive Retinal Ganglion Cells Targeted Chromatic Pupillometry

Chromatic Pupillometry, used to assess Pupil Light Reflex (PLR) to a coloured light stimulus, has regained interest since the discovery of melanopsin in the intrinsically photosensitive Retinal Ganglion Cells (ipRGCs). This technique has shown the potential to be used as a screening tool for neuro-ophthalmological diseases; however, most of the pupillometers available are expensive and not portable, making it harder for them to be used as a widespread screening tool. In this study, we developed a smartphone-based system for chromatic pupillometry that allows targeted stimulation of the ipRGCs. Using a smartphone, this system is portable and accessible and takes advantage of the location of the ipRGCs in the perifovea. The system incorporates a 3D-printed support for the smartphone and an illumination system. Preliminary tests were carried out on a single individual and then validated on eleven healthy individuals with two different LED intensities. The average Post-Illumination Pupil Light Response 6 s after the stimuli offsets (PIPR-6s) showed a difference between the blue and the red stimuli of 9.5% for both intensities, which aligns with the studies using full-field stimulators. The results validated this system for a targeted stimulation of the ipRGCs for chromatic pupillometry, with the potential to be a portable and accessible screening tool for neuro-ophthalmological diseases.

Pupil Dilation Reflects Perceptual Priorities During a Receptive Speech Task

OBJECTIVES

The listening demand incurred by speech perception fluctuates in normal conversation. At the acoustic-phonetic level, natural variation in pronunciation acts as speedbumps to accurate lexical selection. Any given utterance may be more or less phonetically ambiguous-a problem that must be resolved by the listener to choose the correct word. This becomes especially apparent when considering two common speech registers-clear and casual-that have characteristically different levels of phonetic ambiguity. Clear speech prioritizes intelligibility through hyperarticulation which results in less ambiguity at the phonetic level, while casual speech tends to have a more collapsed acoustic space. We hypothesized that listeners would invest greater cognitive resources while listening to casual speech to resolve the increased amount of phonetic ambiguity, as compared with clear speech. To this end, we used pupillometry as an online measure of listening effort during perception of clear and casual continuous speech in two background conditions: quiet and noise.

DESIGN

Forty-eight participants performed a probe detection task while listening to spoken, nonsensical sentences (masked and unmasked) while recording pupil size. Pupil size was modeled using growth curve analysis to capture the dynamics of the pupil response as the sentence unfolded.

RESULTS

Pupil size during listening was sensitive to the presence of noise and speech register (clear/casual). Unsurprisingly, listeners had overall larger pupil dilations during speech perception in noise, replicating earlier work. The pupil dilation pattern for clear and casual sentences was considerably more complex. Pupil dilation during clear speech trials was slightly larger than for casual speech, across quiet and noisy backgrounds.

CONCLUSIONS

We suggest that listener motivation could explain the larger pupil dilations to clearly spoken speech. We propose that, bounded by the context of this task, listeners devoted more resources to perceiving the speech signal with the greatest acoustic/phonetic fidelity. Further, we unexpectedly found systematic differences in pupil dilation preceding the onset of the spoken sentences. Together, these data demonstrate that the pupillary system is not merely reactive but also adaptive-sensitive to both task structure and listener motivation to maximize accurate perception in a limited resource system.

Revealing visual working memory operations with pupillometry: Encoding, maintenance, and prioritization

Pupillary dynamics reflect effects of distinct and important operations of visual working memory: encoding, maintenance, and prioritization. Here, we review how pupil size predicts memory performance and how it provides novel insights into the mechanisms of each operation. Visual information must first be encoded into working memory with sufficient precision. The depth of this encoding process couples to arousal-linked baseline pupil size as well as a pupil constriction response before and after stimulus onset, respectively. Subsequently, the encoded information is maintained over time to ensure it is not lost. Pupil dilation reflects the effortful maintenance of information, wherein storing more items is accompanied by larger dilations. Lastly, the most task-relevant information is prioritized to guide upcoming behavior, which is reflected in yet another dilatory component. Moreover, activated content in memory can be pupillometrically probed directly by tagging visual information with distinct luminance levels. Through this luminance-tagging mechanism, pupil light responses reveal whether dark or bright items receive more attention during encoding and prioritization. Together, conceptualizing pupil responses as a sum of distinct components over time reveals insights into operations of visual working memory. From this viewpoint, pupillometry is a promising avenue to study the most vital operations through which visual working memory works. This article is categorized under: Psychology > Attention Psychology > Memory Psychology > Theory and Methods.

The HPA and SAM axis mediate the impairment of creativity under stress

With the ever-changing social environment, individual creativity is facing a severe challenge induced by stress. However, little is known regarding the underlying mechanisms by which acute stress affects creative cognitive processing. The current research explored the impacts of the neuroendocrine response on creativity under stress and its underlying cognitive flexibility mechanisms. The enzyme-linked immuno sorbent assay was employed to assess salivary cortisol, which acted as a marker of stress-induced activation of the hypothalamic-pituitary-adrenal (HPA) axis. Eye blink rate (EBR) and pupil diameter were measured as respective indicators of dopamine and noradrenaline released by the activation of the sympathetic-adrenal-medullary (SAM) axis. The Wisconsin card task (WCST) measured cognitive flexibility, while the alternative uses task (AUT) and the remote association task (RAT) measured separately divergent and convergent thinking in creativity. Results showed higher cortisol increments following acute stress induction in the stress group than control group. Ocular results showed that the stress manipulation significantly increased EBR and pupil diameter compared to controls, reflecting increased SAM activity. Further analysis revealed that stress-released cortisol impaired the originality component of the AUT, reducing cognitive flexibility as measured by perseverative errors on the WCST task. Serial mediation analyses showed that both EBR and pupil diameter were also associated with increased perseverative errors leading to poor originality on the AUT. These findings confirm that physiological arousal under stress can impair divergent thinking through the regulation of different neuroendocrine pathways, in which the deterioration of flexible switching plays an important mediating role.

Input-related demands: vocoded sentences evoke different pupillometrics and subjective listening effort than sentences in speech-shaped noise

OBJECTIVES

The Framework for Effortful Listening (FUEL) suggests five input-related demands can alter listening effort: source, transmission, listener, message and context factors. We hypothesised that vocoded sentences represented a source factor degradation and sentences in speech-shaped noise represented a transmission factor degradation. We used pupillometry and a subjective scale to examine our hypothesis.

DESIGN

Participants listened to vocoded sentences and sentences in speech-shaped noise at several difficulty levels designed to produce similar word recognition abilities; they also listened to unprocessed sentences. Within-participant pupillometrics and subjective listening effort were analysed. Post-hoc analyses were performed to examine if word recognition accuracy differentially influenced pupil responses.

STUDY SAMPLES

Twenty young adults with normal hearing.

RESULTS

Baseline pupil diameter was significantly smaller, peak pupil dilation was significantly larger, peak pupil dilation latency was significantly shorter, and subjective listening effort was significantly greater for the vocoded sentences than the sentences-in-noise. Word recognition ability also affected pupillometrics, but only for the vocoded sentences.

CONCLUSIONS

Our findings suggest that source factor degradations result in greater listening effort than transmission factor degradations. Future research should address how clinical interventions tailored towards different input-related demands may lead to reduced listening effort and improve patient outcomes.

Are depressive symptoms linked to a reduced pupillary response to novel positive information?-An eye tracking proof-of-concept study

Introduction

Depressive symptoms have been linked to difficulties in revising established negative beliefs in response to novel positive information. Recent predictive processing accounts have suggested that this bias in belief updating may be related to a blunted processing of positive prediction errors at the neural level. In this proof-of-concept study, pupil dilation in response to unexpected positive emotional information was examined as a psychophysiological marker of an attenuated processing of positive prediction errors associated with depressive symptoms.

Methods

Participants (N = 34) completed a modified version of the emotional Bias Against Disconfirmatory Evidence (BADE) task in which scenarios initially suggest negative interpretations that are later either confirmed or disconfirmed by additional information. Pupil dilation in response to the confirmatory and disconfirmatory information was recorded.

Results

Behavioral results showed that depressive symptoms were related to difficulties in revising negative interpretations despite disconfirmatory positive information. The eye tracking results pointed to a reduced pupil response to unexpected positive information among people with elevated depressive symptoms.

Discussion

Altogether, the present study demonstrates that the adapted emotional BADE task can be appropriate for examining psychophysiological aspects such as changes in pupil size along with behavioral responses. Furthermore, the results suggest that depression may be characterized by deviations in both behavioral (i.e., reduced updating of negative beliefs) and psychophysiological (i.e., decreased pupil dilation) responses to unexpected positive information. Future work should focus on a larger sample including clinically depressed patients to further explore these findings.

Do Different Types of Microphones Affect Listening Effort in Cochlear Implant Recipients? A Pupillometry Study

BACKGROUND

It is known that subjects with a cochlear implant (CI) need to exert more listening effort to achieve adequate speech recognition compared to normal hearing subjects. One tool for assessing listening effort is pupillometry. The aim of this study is to evaluate the effectiveness of adaptive directional microphones in reducing listening effort for CI recipients.

METHODS

We evaluated listening in noise and listening effort degree (by pupillometry) in eight bimodal subjects with three types of CI microphones and in three sound configurations.

RESULTS

We found a correlation only between sound configurations and listening in noise score (p-value 0.0095). The evaluation of the microphone types shows worse scores in listening in noise with Opti Omni (+3.15 dB SNR) microphone than with Split Dir (+1.89 dB SNR) and Speech Omni (+1.43 dB SNR). No correlation was found between microphones and sound configurations and within the pupillometric data.

CONCLUSIONS

Different types of microphones have different effects on the listening of CI patients. The difference in the orientation of the sound source is a factor that has an impact on the listening effort results. However, the pupillometry measurements do not significantly correlate with the different microphone types.

Neural encoding of musical expectations in a non-human primate

The appreciation of music is a universal trait of humankind.1,2,3 Evidence supporting this notion includes the ubiquity of music across cultures4,5,6,7 and the natural predisposition toward music that humans display early in development.8,9,10 Are we musical animals because of species-specific predispositions? This question cannot be answered by relying on cross-cultural or developmental studies alone, as these cannot rule out enculturation.11 Instead, it calls for cross-species experiments testing whether homologous neural mechanisms underlying music perception are present in non-human primates. We present music to two rhesus monkeys, reared without musical exposure, while recording electroencephalography (EEG) and pupillometry. Monkeys exhibit higher engagement and neural encoding of expectations based on the previously seeded musical context when passively listening to real music as opposed to shuffled controls. We then compare human and monkey neural responses to the same stimuli and find a species-dependent contribution of two fundamental musical features-pitch and timing12-in generating expectations: while timing- and pitch-based expectations13 are similarly weighted in humans, monkeys rely on timing rather than pitch. Together, these results shed light on the phylogeny of music perception. They highlight monkeys' capacity for processing temporal structures beyond plain acoustic processing, and they identify a species-dependent contribution of time- and pitch-related features to the neural encoding of musical expectations.

Pupillary Responses to Dot Patterns on a Human Face Background

Dots on natural backgrounds can elicit significant pupillary constrictions within the entire image phase associated with parasympathetic activation, suggesting disgust rather than fear. Although studies have reported that dots on faces elicit stronger disgust than dots on non-face backgrounds, it remains unclear whether dots on a face elicit stronger pupil constrictions than non-face backgrounds. Pupillometry was used while viewing dots on faces and compared with luminance- and spatial frequency-controlled images (dots on phase-scrambled faces) and luminance-controlled images (face only, phase-scrambled faces). Relative pupillary constrictions were elicited when dots were placed on faces and phase-scrambled faces; however, the response to dots on faces did not differ significantly from that to the control stimuli. Approximately 3-5 s after stimulus onset, pupillary responses to dots on faces recovered to baseline faster than those to dots on phase-scrambled faces with a larger pupil size. The initial pupillary constrictions observed are consistent with those in response to dots on natural backgrounds, suggesting that regardless of the background, dots may stimulate parasympathetic activation and elicit disgust rather than fear. The faster recovery from the pupil constriction and larger pupil size in the later phase may be caused by a dynamic balance between the sympathetic and parasympathetic neuronal activities.

Investigating pupillometry to detect preoperative anxiety: a pilot study

Guidelines from the European Society of Anesthesia (ESA) insist on the importance of preoperative anxiety management. However, its assessment currently relies on questionnaires that are long to submit and sometimes difficult to interpret. Exploring the balance between sympathetic and parasympathetic neural systems through the use of pupillometry is a promising path to identify anxiety and thus provides an objective and reproducible assessment tool. A single-center prospective observational study was conducted in a population of ambulatory ophthalmological surgery patients. Preoperative anxiety was assessed using the Surgical Fear Questionnaire (SFQ). Measurements were taken using an Algiscan® (IDMed) type pupillometer before, during, and after insertion of the peripheral IV catheter. A statistical correlation test was carried out between the different evaluations of anxiety and the coefficient of variation of the pupillary diameter (VCPD). A total of 71 patients were included in the study between July 2020 and February 2021, with a median SFQ score of 23 [IQR 11-34]. No significant statistical correlation was found between the baseline pupillary diameter, or VCPD, and preoperative anxiety levels. Similarly, the pupillometric variables did not differ significantly when adjusting for the level of anxiety during and after painful stimulation due to canulation. More studies are necessary to explore the potential correlation between preoperative anxiety and pupillometry.

Assessing Cognitive Effort in Ménière's Disease: Pupillometry as a Novel Tool for Postural Control

BACKGROUND

This study aimed to investigate the utility of pupillometry as a measure of cognitive effort in individuals with Ménière's disease experiencing chronic postural destabilization. By integrating pupillometry with static posturography, we sought to gain deeper insights into the cognitive demands and arousal levels associated with postural control in this specific patient population.

METHODS

The study included 36 patients who met the diagnostic criteria for Ménière's disease and a control group comprising 36 healthy volunteers. We performed static posturography using a computerized static posturography platform to objectively assess postural imbalance. Additionally, pupillometry was recorded using infrared video-oculoscopy. Pupil dilation was measured before and after participants walked for 7 steps on-site with their vision obscured.

RESULTS

Baseline tonic pupil size showed no significant difference between healthy controls and Ménière's patients. However, after walking stimulation, Ménière's patients exhibited highly significant abnormal walking-induced pupil dilation. This suggests increased arousal in response to the challenging task of walking with closed eyes, linked to static upright stance imbalance as correlated with posturography parameters.

CONCLUSION

Pupillometry holds promise as an objective tool to assess cognitive effort and arousal during postural control in Ménière's disease. Implementing pupillometry in clinical practice could enhance the management of postural instability in these patients. Our findings contribute to the understanding of cognitive aspects in balance control and open new avenues for further investigations in vestibular dysfunction.

A glimpse into multimodal neuromonitoring in acute liver failure: a case report

Introduction

Acute liver failure (ALF) is a rapidly progressing, life-threatening syndrome characterized by liver-related coagulopathy and hepatic encephalopathy (HE). Given that higher HE grades correlate with poorer outcomes, clinical management of ALF necessitates close neurological monitoring. The primary objective of this case report is to highlight the diagnostic value of utilizing multimodal neuromonitoring (MNM) in a patient suffering from ALF.

Case report

A 56-year-old male patient with a history of chronic alcoholism, without prior chronic liver disease, and recent acetaminophen use was admitted to the hospital due to fatigue and presenting with a mild flapping tremor. The primary hypothesis was an acute hepatic injury caused by acetaminophen intoxication. In the following hours, the patient's condition deteriorated, accompanied by neurological decline and rising ammonia levels. The patient's neurological status was closely monitored using MNM. Bilaterally altered pupillary light reflex assessed by decreasing in the Neurological Pupil Index values, using automated pupillometry, initially suggested severe brain oedema. However, ultrasound measurements of the optic nerve sheath diameter showed normal values in both eyes, P2/P1 noninvasive intracranial pressure waveform assessment was within normal ranges and the cerebral computed tomography-scan revealed no signs of cerebral swelling. Increased middle cerebral artery velocities measured by Transcranial Doppler and the initiation of electroencephalography monitoring yielded the presence of status epilepticus.

Discussion

The utilization of MNM facilitated a more comprehensive understanding of the mechanisms underlying the patient's clinical deterioration in the setting of HE. Nonetheless, future studies are needed to show feasibility and to yield valuable insights that can enhance the outcomes for patients with HE using such an approach. Given the absence of specific guidelines in this particular context, it is advisable for physicians to give further consideration to the incorporation of MNM in the management of unconscious patients with ALF.

Impact of SNR, peripheral auditory sensitivity, and central cognitive profile on the psychometric relation between pupillary response and speech performance in CI users

Despite substantial technical advances and wider clinical use, cochlear implant (CI) users continue to report high and elevated listening effort especially under challenging noisy conditions. Among all the objective measures to quantify listening effort, pupillometry is one of the most widely used and robust physiological measures. Previous studies with normally hearing (NH) and hearing-impaired (HI) listeners have shown that the relation between speech performance in noise and listening effort (as measured by peak pupil dilation) is not linear and exhibits an inverted-U shape. However, it is unclear whether the same psychometric relation exists in CI users, and whether individual differences in auditory sensitivity and central cognitive capacity affect this relation. Therefore, we recruited 17 post-lingually deaf CI adults to perform speech-in-noise tasks from 0 to 20 dB SNR with a 4 dB step size. Simultaneously, their pupillary responses and self-reported subjective effort were recorded. To characterize top-down and bottom-up individual variabilities, a spectro-temporal modulation task and a set of cognitive abilities were measured. Clinical word recognition in quiet and Quality of Life (QoL) were also collected. Results showed that at a group level, an inverted-U shape psychometric curve between task difficulty (SNR) and peak pupil dilation (PPD) was not observed. Individual shape of the psychometric curve was significantly associated with some individual factors: CI users with higher clinical word and speech-in-noise recognition showed a quadratic decrease of PPD over increasing SNRs; CI users with better non-verbal intelligence and lower QoL showed smaller average PPD. To summarize, individual differences in CI users had a significant impact on the psychometric relation between pupillary response and task difficulty, hence affecting the interpretation of pupillary response as listening effort (or engagement) at different task difficulty levels. Future research and clinical applications should further characterize the possible effects of individual factors (such as motivation or engagement) in modulating CI users' occurrence of 'tipping point' on their psychometric functions, and develop an individualized method for reliably quantifying listening effort using pupillometry.

Dynamic Pupillary Response in Multiple Sclerosis Patients with and without Optic Neuritis

Multiple sclerosis (MS) is a neurodegenerative disease that affects the central nervous system which produces abnormalities in visual function, as disturbed pupillary responses, even after an episode of optic neuritis (ON). The aim was to assess different parameters of the pupillary response in MS subjects with and without ON. Therefore, 24 eyes of healthy age-matched subjects were included, 22 eyes of subjects with MS (MS group), and 13 subjects with MS with previous ON (MSON group). Pupillary parameters (ratio pupil max/min; latency; velocity and duration; contraction and dilation; and amplitude of contraction) were recorded with the MYAH topographer. Statistical analysis was performed by IBM SPSS Statistics, and parametrical or non-parametrical tests were used according to the normality of the data. MS patients did not significantly differ from healthy patients in any of the parameters analyzed (p > 0.05). Only patients with previous ON were different from healthy patients in the amplitude (40.71 ± 6.73% vs. 45.22 ± 3.29%, respectively) and latency of contraction (0.35 ± 0.13 s vs. 0.26 ± 0.05 s, respectively). The time to recover 75% of the initial diameter was abnormal in 9% of the MS subjects and 12% of MSON subjects. Based on the results of this study, the contraction process, especially latency and amplitude, was found to be affected in subjects with MS and previous ON. The degree of disability and the relation of the decrease in pupil response with other indicators of MS disease should be further investigated considering other comorbidities such as ON in the affection.

Gestalt's Perspective on Insight: A Recap Based on Recent Behavioral and Neuroscientific Evidence

The Gestalt psychologists' theory of insight problem-solving was based on a direct parallelism between perceptual experience and higher-order forms of cognition (e.g., problem-solving). Similarly, albeit not exclusively, to the sudden recognition of bistable figures, these psychologists contended that problem-solving involves a restructuring of one's initial representation of the problem's elements, leading to a sudden leap of understanding phenomenologically indexed by the "Aha!" feeling. Over the last century, different scholars have discussed the validity of the Gestalt psychologists' perspective, foremost using the behavioral measures available at the time. However, in the last two decades, scientists have gained a deeper understanding of insight problem-solving due to the advancements in cognitive neuroscience. This review aims to provide a retrospective reading of Gestalt theory based on the knowledge accrued by adopting novel paradigms of research and investigating their neurophysiological correlates. Among several key points that the Gestalt psychologists underscored, we focus specifically on the role of the visual system in marking a discrete switch of knowledge into awareness, as well as the perceptual experience and holistic standpoints. While the main goal of this paper is to read the previous theory in light of new evidence, we also hope to initiate an academic discussion and encourage further research about the points we raise.

Electrophysiological concomitants of pupillary synchrony

Pupillary synchrony or contagion is the automatic unconscious mimicry of pupil dilation in dyadic interactions. This experiment explored electrophysiological event-related potential (ERP) concomitants of pupillary synchrony. Artificial pupils (black dots) were superimposed on either partial faces (eyes, nose, brow) or random textures. Observers were asked to judge dot size (large, medium, or small). There was clear evidence of pupillary synchrony with observer pupil dilation greater to large dots than to small or medium dots. The pupillary synchrony increased in magnitude throughout the trial and was found both with faces and with textures. When the stimuli were partial faces with artificial pupils (dots), there was ERP activity related to target dot size in the period at P250 and P3. A face specific N170 was also found. When the stimuli were random textures with dots, there was ERP activity at P1 and in the interval from 140 to 200 ms post-stimulus onset. The use of ERP with pupillometry revealed results for faces that were consistent with a social explanation of pupillary synchrony whereas results for textures were consistent with a local luminance explanation.

To err is human- to understand error-processing is divine: Contributions of working memory and anxiety to error-related brain and pupil responses

Both anxiety and working memory capacity appear to predict increased (more negative) error-related negativity (ERN) amplitudes, despite being inversely related to one another. Until the interactive effects of these variables on the ERN are clarified, there may be challenges posed to our ability to use the ERN as an endophenotype for anxiety, as some have suggested. The compensatory error monitoring hypothesis suggests that high trait-anxiety individuals have larger ERN amplitudes because they must employ extra, compensatory efforts to override the working memory demands of their anxiety. Yet, to our knowledge, no ERN study has employed direct manipulation of working memory demands in conjunction with direct manipulations of induced (state) anxiety. Furthermore, little is known about how these manipulations affect other measures of error processing, such as the error-related pupil dilation response and post-error behavioral adjustments. Therefore, we manipulate working memory load and anxiety in a 2 × 2 within-subjects design to examine the interactive effects of working memory load and anxiety on ERN amplitude, error-related pupil dilation response amplitude, and post-error behavior. There were no effects of our manipulations on ERN amplitude, suggesting a strong interpretation of compensatory error-processing theory. However, our worry manipulation affected post-error behavior, such that worry caused a reduction in post-error accuracy. Additionally, our working memory manipulation affected error-related PDR magnitude and the amplitude of the error-related positivity (Pe), such that increased working memory load decreased the amplitude of these responses. Implications of these results within the context of the compensatory error processing framework are discussed.

Noradrenaline tracks emotional modulation of attention in human amygdala

The noradrenaline (NA) system is one of the brain's major neuromodulatory systems; it originates in a small midbrain nucleus, the locus coeruleus (LC), and projects widely throughout the brain.1,2 The LC-NA system is believed to regulate arousal and attention3,4 and is a pharmacological target in multiple clinical conditions.5,6,7 Yet our understanding of its role in health and disease has been impeded by a lack of direct recordings in humans. Here, we address this problem by showing that electrochemical estimates of sub-second NA dynamics can be obtained using clinical depth electrodes implanted for epilepsy monitoring. We made these recordings in the amygdala, an evolutionarily ancient structure that supports emotional processing8,9 and receives dense LC-NA projections,10 while patients (n = 3) performed a visual affective oddball task. The task was designed to induce different cognitive states, with the oddball stimuli involving emotionally evocative images,11 which varied in terms of arousal (low versus high) and valence (negative versus positive). Consistent with theory, the NA estimates tracked the emotional modulation of attention, with a stronger oddball response in a high-arousal state. Parallel estimates of pupil dilation, a common behavioral proxy for LC-NA activity,12 supported a hypothesis that pupil-NA coupling changes with cognitive state,13,14 with the pupil and NA estimates being positively correlated for oddball stimuli in a high-arousal but not a low-arousal state. Our study provides proof of concept that neuromodulator monitoring is now possible using depth electrodes in standard clinical use.

An Exploratory Study of the Effect of Tinnitus on Listening Effort Using EEG and Pupillometry

OBJECTIVE

Previous behavioral studies on listening effort in tinnitus patients did not consider extended high-frequency hearing thresholds and had conflicting results. This inconsistency may be related that listening effort is not evaluated by the central nervous system (CNS) and autonomic nervous system (ANS), which are directly related to tinnitus pathophysiology. This study matches hearing thresholds at all frequencies, including the extended high-frequency and reduces hearing loss to objectively evaluate listening effort over the CNS and ANS simultaneously in tinnitus patients.

STUDY DESIGN

Case-control study.

SETTING

University hospital.

METHODS

Sixteen chronic tinnitus patients and 23 matched healthy controls having normal pure-tone averages with symmetrical hearing thresholds were included. Subjects were evaluated with 0.125 to 20 kHz pure-tone audiometry, Montreal Cognitive Assessment Test (MoCA), Tinnitus Handicap Inventory (THI), Visual Analog Scale (VAS), electroencephalography (EEG), and pupillometry.

RESULTS

Pupil dilation and EEG alpha band in the "coding" phase of the sentence presented in tinnitus patients was less than in the control group (p < .05). VAS score was higher in the tinnitus group (p < .01). Also, there was no statistically significant relationship between EEG and pupillometry components and THI or MoCA (p > .05).

CONCLUSION

This study suggests that tinnitus patients may need to make an extra effort to listen. Also, pupillometry may not be sufficiently reliable to assess listening effort in ANS-related pathologies. Considering the possible listening difficulties in tinnitus patients, reducing the listening difficulties, especially in noisy environments, can be added to the goals of tinnitus therapy protocols.

The impact of physical exercise on the consolidation of fear extinction memories

Based on the mechanisms of fear extinction, exposure therapy is the most common treatment for anxiety disorders. However, extinguished fear responses can reemerge even after successful treatment. Novel interventions enhancing exposure therapy efficacy are therefore critically needed. Physical exercise improves learning and memory and was also shown to enhance extinction processes. This study tested whether physical exercise following fear extinction training improves the consolidation of extinction memories. Sixty healthy men underwent a differential fearconditioning paradigm with fear acquisition training on day 1 and fear extinction training followed by an exercise or resting control intervention on day 2. On day 3, retrieval and reinstatement were tested including two additional but perceptually similar stimuli to explore the generalization of exercise effects. Exercise significantly increased heart rate, salivary alpha amylase, and cortisol, indicating successful exercise manipulation. Contrary to our expectations, exercise did not enhance but rather impaired extinction memory retrieval on the next day, evidenced by significantly stronger differential skin conductance responses (SCRs) and pupil dilation (PD). Importantly, although conditioned fear responses were successfully acquired, they did not fully extinguish, explaining why exercise might have boosted the consolidation of the original fear memory trace instead. Additionally, stronger differential SCRs and PD toward the novel stimuli suggest that the memory enhancing effects of exercise also generalized to perceptually similar stimuli. Together, these findings indicate that physical exercise can facilitate both the long-term retrievability and generalization of extinction memories, but presumably only when extinction was successful in the first place.

Phonological discrimination and contrast detection in pupillometry

Introduction

The perception of phonemes is guided by both low-level acoustic cues and high-level linguistic context. However, differentiating between these two types of processing can be challenging. In this study, we explore the utility of pupillometry as a tool to investigate both low- and high-level processing of phonological stimuli, with a particular focus on its ability to capture novelty detection and cognitive processing during speech perception.

Methods

Pupillometric traces were recorded from a sample of 22 Danish-speaking adults, with self-reported normal hearing, while performing two phonological-contrast perception tasks: a nonword discrimination task, which included minimal-pair combinations specific to the Danish language, and a nonword detection task involving the detection of phonologically modified words within sentences. The study explored the perception of contrasts in both unprocessed speech and degraded speech input, processed with a vocoder.

Results

No difference in peak pupil dilation was observed when the contrast occurred between two isolated nonwords in the nonword discrimination task. For unprocessed speech, higher peak pupil dilations were measured when phonologically modified words were detected within a sentence compared to sentences without the nonwords. For vocoded speech, higher peak pupil dilation was observed for sentence stimuli, but not for the isolated nonwords, although performance decreased similarly for both tasks.

Conclusion

Our findings demonstrate the complexity of pupil dynamics in the presence of acoustic and phonological manipulation. Pupil responses seemed to reflect higher-level cognitive and lexical processing related to phonological perception rather than low-level perception of acoustic cues. However, the incorporation of multiple talkers in the stimuli, coupled with the relatively low task complexity, may have affected the pupil dilation.

Colour perception changes with basic colour word comprehension

Recent work has investigated the origin of infant colour categories, showing pre-linguistic infants categorise colour even in the absence of colour words. These infant categories are similar but not identical to adult categories, giving rise to an important question about how infant colour perception changes with the learning of colour words. Here we present two novel paradigms in which 12- and 19-month-old participants learning English as their first language were assessed on their perception of colour, while data on their colour word comprehension were also collected. Results indicate that participants' perception of colours close to the colour category boundaries dramatically change after colour word learning. The results highlight the shift made from infant colour categories to adult-like linguistically mediated colour categories that accompanies colour word learning. RESEARCH HIGHLIGHTS: We aimed to test whether colour perception is linguistically mediated in infants. We used novel eye-tracking and pupillometry paradigms to test infant colour perception either side of learning colour words. Infants' discrimination of colour changes after learning colour words, suggesting a shift due to colour word learning. A shift from pre-linguistic colour representation to linguistically mediated colour representation is discussed.

Characterizing brain stage-dependent pupil dynamics based on lateral hypothalamic activity

Pupil dynamics presents varied correlation features with brain activity under different vigilant levels. The modulation of brain dynamic stages can arise from the lateral hypothalamus (LH), where diverse neuronal cell types contribute to arousal regulation in opposite directions via the anterior cingulate cortex (ACC). However, the relationship of the LH and pupil dynamics has seldom been investigated. Here, we performed local field potential (LFP) recordings at the LH and ACC, and whole-brain fMRI with simultaneous fiber photometry Ca2+ recording in the ACC, to evaluate their correlation with brain state-dependent pupil dynamics. Both LFP and functional magnetic resonance imaging (fMRI) data showed various correlations to pupil dynamics across trials that span negative, null, and positive correlation values, demonstrating brain state-dependent coupling features. Our results indicate that the correlation of pupil dynamics with ACC LFP and whole-brain fMRI signals depends on LH activity, suggesting a role of the latter in brain dynamic stage regulation.