1
|
Fink L, Simola J, Tavano A, Lange E, Wallot S, Laeng B. From pre-processing to advanced dynamic modeling of pupil data. Behav Res Methods 2024; 56:1376-1412. [PMID: 37351785 PMCID: PMC10991010 DOI: 10.3758/s13428-023-02098-1] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/20/2023] [Indexed: 06/24/2023]
Abstract
The pupil of the eye provides a rich source of information for cognitive scientists, as it can index a variety of bodily states (e.g., arousal, fatigue) and cognitive processes (e.g., attention, decision-making). As pupillometry becomes a more accessible and popular methodology, researchers have proposed a variety of techniques for analyzing pupil data. Here, we focus on time series-based, signal-to-signal approaches that enable one to relate dynamic changes in pupil size over time with dynamic changes in a stimulus time series, continuous behavioral outcome measures, or other participants' pupil traces. We first introduce pupillometry, its neural underpinnings, and the relation between pupil measurements and other oculomotor behaviors (e.g., blinks, saccades), to stress the importance of understanding what is being measured and what can be inferred from changes in pupillary activity. Next, we discuss possible pre-processing steps, and the contexts in which they may be necessary. Finally, we turn to signal-to-signal analytic techniques, including regression-based approaches, dynamic time-warping, phase clustering, detrended fluctuation analysis, and recurrence quantification analysis. Assumptions of these techniques, and examples of the scientific questions each can address, are outlined, with references to key papers and software packages. Additionally, we provide a detailed code tutorial that steps through the key examples and figures in this paper. Ultimately, we contend that the insights gained from pupillometry are constrained by the analysis techniques used, and that signal-to-signal approaches offer a means to generate novel scientific insights by taking into account understudied spectro-temporal relationships between the pupil signal and other signals of interest.
Collapse
Affiliation(s)
- Lauren Fink
- Department of Music, Max Planck Institute for Empirical Aesthetics, Grüneburgweg 14, 60322, Frankfurt am Main, Germany.
- Department of Psychology, Neuroscience & Behavior, McMaster University, 1280 Main St. West, Hamilton, Ontario, L8S 4L8, Canada.
| | - Jaana Simola
- Helsinki Collegium for Advanced Studies, University of Helsinki, Helsinki, Finland
- Department of Education, University of Helsinki, Helsinki, Finland
| | - Alessandro Tavano
- Department of Cognitive Neuropsychology, Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Germany
| | - Elke Lange
- Department of Music, Max Planck Institute for Empirical Aesthetics, Grüneburgweg 14, 60322, Frankfurt am Main, Germany
| | - Sebastian Wallot
- Department of Literature, Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Germany
- Institute for Sustainability Education and Psychologyy, Leuphana University, Lüneburg, Germany
| | - Bruno Laeng
- Department of Psychology, University of Oslo, Oslo, Norway
- RITMO Centre for Interdisciplinary studies in Rhythm, Time, and Motion, University of Oslo, Oslo, Norway
| |
Collapse
|
2
|
Identification of attention-deficit hyperactivity disorder based on the complexity and symmetricity of pupil diameter. Sci Rep 2021; 11:8439. [PMID: 33875772 PMCID: PMC8055872 DOI: 10.1038/s41598-021-88191-x] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2020] [Accepted: 04/06/2021] [Indexed: 02/02/2023] Open
Abstract
Adult attention-deficit/hyperactivity disorder (ADHD) frequently leads to psychological/social dysfunction if unaddressed. Identifying a reliable biomarker would assist the diagnosis of adult ADHD and ensure that adults with ADHD receive treatment. Pupil diameter can reflect inherent neural activity and deficits of attention or arousal characteristic of ADHD. Furthermore, distinct profiles of the complexity and symmetricity of neural activity are associated with some psychiatric disorders. We hypothesized that analysing the relationship between the size, complexity of temporal patterns, and asymmetricity of pupil diameters will help characterize the nervous systems of adults with ADHD and that an identification method combining these features would ease the diagnosis of adult ADHD. To validate this hypothesis, we evaluated the resting state hippus in adult participants with or without ADHD by examining the pupil diameter and its temporal complexity using sample entropy and the asymmetricity of the left and right pupils using transfer entropy. We found that large pupil diameters and low temporal complexity and symmetry were associated with ADHD. Moreover, the combination of these factors by the classifier enhanced the accuracy of ADHD identification. These findings may contribute to the development of tools to diagnose adult ADHD.
Collapse
|
3
|
Lanatà A, Greco A, Ciardelli M, Uvelli A, Fratini E, Manzoni D, Scilingo EP, Santarcangelo EL, Sebastiani L. Linear and non linear measures of pupil size as a function of hypnotizability. Sci Rep 2021; 11:5196. [PMID: 33664358 PMCID: PMC7970859 DOI: 10.1038/s41598-021-84756-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2020] [Accepted: 02/19/2021] [Indexed: 02/01/2023] Open
Abstract
Higher arousal and cortical excitability have been observed in high hypnotizable individuals (highs) with respect to low hypnotizables (lows), which may be due to differences in the activation of ascending activating systems. The present study investigated the possible hypnotizability-related difference in the cortical noradrenergic tone sustained by the activity of the Locus Coeruleus which is strongly related to pupil size. This was measured during relaxation in three groups of participants—highs (N = 15), lows (N = 15) and medium hypnotizable individuals (mediums, N = 11)—in the time and frequency domains and through the Recurrence Quantification Analysis. ECG and Skin Conductace (SC) were monitored to extract autonomic indices of relaxation (heart interbeats intervals, parasympathetic component of heart rate variability (RMSSD) and tonic SC (MeanTonicSC). Most variables indicated that participants relaxed throughout the session. Pupil features did not show significant differences between highs, mediums and lows, except for the spectral Band Median Frequency which was higher in mediums than in lows and highs at the beginning, but not at the end of the session.Thus, the present findings of pupil size cannot account for the differences in arousal and motor cortex excitability observed between highs and lows in resting conditions.
Collapse
Affiliation(s)
- Antonio Lanatà
- Department of Information Engineering, University of Florence, Florence, Italy
| | - Alberto Greco
- Research Center "E. Piaggio", University of Pisa, Pisa, Italy
| | - Mirco Ciardelli
- Research Center "E. Piaggio", University of Pisa, Pisa, Italy
| | - Allison Uvelli
- Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, Via San Zeno, 31, 56127, Pisa, Italy
| | | | - Diego Manzoni
- Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, Via San Zeno, 31, 56127, Pisa, Italy
| | - Enzo P Scilingo
- Research Center "E. Piaggio", University of Pisa, Pisa, Italy.,Department of Information Engineering, University of Pisa, Pisa, Italy
| | - Enrica L Santarcangelo
- Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, Via San Zeno, 31, 56127, Pisa, Italy.
| | - Laura Sebastiani
- Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, Via San Zeno, 31, 56127, Pisa, Italy
| |
Collapse
|
4
|
Nobukawa S, Shirama A, Takahashi T, Takeda T, Ohta H, Kikuchi M, Iwanami A, Kato N, Toda S. Pupillometric Complexity and Symmetricity Follow Inverted-U Curves Against Baseline Diameter Due to Crossed Locus Coeruleus Projections to the Edinger-Westphal Nucleus. Front Physiol 2021; 12:614479. [PMID: 33643064 PMCID: PMC7905168 DOI: 10.3389/fphys.2021.614479] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2020] [Accepted: 01/19/2021] [Indexed: 11/13/2022] Open
Abstract
In addition to photic reflex function, the temporal behavior of the pupil diameter reflects levels of arousal and attention and thus internal cognitive neural activity. Recent studies have reported that these behaviors are characterized by baseline activity, temporal complexity, and symmetricity (i.e., degree of symmetry) between the right and left pupil diameters. We hypothesized that experimental analysis to reveal relationships among these characteristics and model-based analysis focusing on the newly discovered contralateral projection from the locus coeruleus (LC) to the Edinger-Westphal nucleus (EWN) within the neural system for controlling pupil diameter could contribute to another dimension of understanding of complex pupil dynamics. In this study, we aimed to validate our hypothesis by analyzing the pupillary hippus in the healthy resting state in terms of sample entropy (SampEn), to capture complexity, and transfer entropy (TranEn), to capture symmetricity. We also constructed a neural model embedded with the new findings on neural pathways. The following results were observed: first, according to surrogate data analysis, the complexity and symmetricity of pupil diameter changes reflect a non-linear deterministic process. Second, both the complexity and the symmetricity are unimodal, peaking at intermediate pupil diameters. Third, according to simulation results, the neural network that controls pupil diameter has an inverted U-shaped profile of complexity and symmetricity vs. baseline LC activity; this tendency is enhanced by the contralateral synaptic projections from the LCs to the EWNs. Thus, we characterized the typical relationships between the baseline activity and the complexity and symmetricity of the pupillometric data in terms of SampEn and TranEn. Our evaluation method and findings may facilitate the development of estimation and diagnostic tools for exploring states of the healthy brain and psychiatric disorders based on measurements of pupil diameter.
Collapse
Affiliation(s)
- Sou Nobukawa
- Department of Computer Science, Chiba Institute of Technology, Chiba, Japan
| | - Aya Shirama
- National Center of Neurology and Psychiatry, Department of Preventive Intervention for Psychiatric Disorders, National Institute of Mental Health, Tokyo, Japan
| | - Tetsuya Takahashi
- Research Center for Child Mental Development, Kanazawa University, Ishikawa, Japan.,Department of Neuropsychiatry, University of Fukui, Fukui, Japan.,Uozu Shinkei Sanatorium, Uozu, Japan
| | | | - Haruhisa Ohta
- Medical Institute of Developmental Disabilities Research, Showa University, Tokyo, Japan
| | - Mitsuru Kikuchi
- Department of Psychiatry & Behavioral Science, Kanazawa University, Ishikawa, Japan
| | - Akira Iwanami
- Department of Psychiatry, School of Medicine, Showa University, Tokyo, Japan
| | - Nobumasa Kato
- Medical Institute of Developmental Disabilities Research, Showa University, Tokyo, Japan
| | - Shigenobu Toda
- Department of Psychiatry & Behavioral Science, Kanazawa University, Ishikawa, Japan.,Department of Psychiatry, Showa University East Hospital, Showa University, Tokyo, Japan
| |
Collapse
|