1
|
Render A, Eisenbarth H, Oxner M, Jansen P. Arousal, interindividual differences and temporal binding a psychophysiological study. PSYCHOLOGICAL RESEARCH 2024:10.1007/s00426-024-01976-3. [PMID: 38806732 DOI: 10.1007/s00426-024-01976-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2023] [Accepted: 05/13/2024] [Indexed: 05/30/2024]
Abstract
The sense of agency varies as a function of arousal in negative emotional contexts. As yet, it is unknown whether the same is true for positive affect, and how inter-individual characteristics might predict these effects. Temporal binding, an implicit measure of the sense of agency, was measured in 59 participants before and after watching either an emotionally neutral film clip or a positive film clip with high or low arousal. Analyses included participants' individual differences in subjective affective ratings, physiological arousal (pupillometry, skin conductance, heart rate), striatal dopamine levels via eye blink rates, and psychopathy. Linear mixed models showed that sexual arousal decreased temporal binding whereas calm pleasure had no facilitation effect on binding. Striatal dopamine levels were positively linked whereas subjective and physiological arousal may be negatively associated with binding towards actions. Psychopathic traits reduced the effect of high arousal on binding towards actions. These results provide evidence that individual differences influence the extent to which the temporal binding is affected by high arousing states with positive valence.
Collapse
Affiliation(s)
- Anna Render
- Faculty of Human Sciences, University of Regensburg, Regensburg, Germany.
- Victoria University of Wellington, Wellington, New Zealand.
- University of Passau, Passau, Germany.
| | | | - Matt Oxner
- Victoria University of Wellington, Wellington, New Zealand
- Wilhelm Wundt Institute for Psychology, University of Leipzig, Leipzig, Germany
| | - Petra Jansen
- Faculty of Human Sciences, University of Regensburg, Regensburg, Germany
| |
Collapse
|
2
|
Sanchez R, Tomei AC, Mamassian P, Vidal M, Desantis A. What the eyes, confidence, and partner's identity can tell about change of mind. Neurosci Conscious 2024; 2024:niae018. [PMID: 38720814 PMCID: PMC11077902 DOI: 10.1093/nc/niae018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2023] [Revised: 03/07/2024] [Accepted: 04/10/2024] [Indexed: 05/12/2024] Open
Abstract
Perceptual confidence reflects the ability to evaluate the evidence that supports perceptual decisions. It is thought to play a critical role in guiding decision-making. However, only a few empirical studies have actually investigated the function of perceptual confidence. To address this issue, we designed a perceptual task in which participants provided a confidence judgment on the accuracy of their perceptual decision. Then, they viewed the response of a machine or human partner, and they were instructed to decide whether to keep or change their initial response. We observed that confidence predicted participants' changes of mind more than task difficulty and perceptual accuracy. Additionally, interacting with a machine, compared to a human, decreased confidence and increased participants tendency to change their initial decision, suggesting that both confidence and changes of mind are influenced by contextual factors, such as the identity of a partner. Finally, variations in confidence judgments but not change of mind were correlated with pre-response pupil dynamics, indicating that arousal changes are linked to confidence computations. This study contributes to our understanding of the factors influencing confidence and changes of mind and also evaluates the possibility of using pupil dynamics as a proxy of confidence.
Collapse
Affiliation(s)
- Rémi Sanchez
- Département Traitement de l’Information et Systèmes, ONERA, Salon-de-Provence F-13661, France
- Institut de Neurosciences de la Timone (UMR 7289), CNRS and Aix-Marseille Université, Marseille F-13005, France
| | - Anne-Catherine Tomei
- Département Traitement de l’Information et Systèmes, ONERA, Salon-de-Provence F-13661, France
- Institut de Neurosciences de la Timone (UMR 7289), CNRS and Aix-Marseille Université, Marseille F-13005, France
| | - Pascal Mamassian
- Laboratoire des systèmes perceptifs, Département d’études cognitives, École normale supérieure, PSL University, CNRS, Paris F-75005, France
| | - Manuel Vidal
- Institut de Neurosciences de la Timone (UMR 7289), CNRS and Aix-Marseille Université, Marseille F-13005, France
| | - Andrea Desantis
- Département Traitement de l’Information et Systèmes, ONERA, Salon-de-Provence F-13661, France
- Institut de Neurosciences de la Timone (UMR 7289), CNRS and Aix-Marseille Université, Marseille F-13005, France
- Integrative Neuroscience and Cognition Center (UMR 8002), CNRS and Université Paris Cité, Paris F-75006, France
| |
Collapse
|
3
|
Wohltjen S, Wheatley T. Interpersonal eye-tracking reveals the dynamics of interacting minds. Front Hum Neurosci 2024; 18:1356680. [PMID: 38532792 PMCID: PMC10963423 DOI: 10.3389/fnhum.2024.1356680] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2023] [Accepted: 02/20/2024] [Indexed: 03/28/2024] Open
Abstract
The human eye is a rich source of information about where, when, and how we attend. Our gaze paths indicate where and what captures our attention, while changes in pupil size can signal surprise, revealing our expectations. Similarly, the pattern of our blinks suggests levels of alertness and when our attention shifts between external engagement and internal thought. During interactions with others, these cues reveal how we coordinate and share our mental states. To leverage these insights effectively, we need accurate, timely methods to observe these cues as they naturally unfold. Advances in eye-tracking technology now enable real-time observation of these cues, shedding light on mutual cognitive processes that foster shared understanding, collaborative thought, and social connection. This brief review highlights these advances and the new opportunities they present for future research.
Collapse
Affiliation(s)
- Sophie Wohltjen
- Department of Psychology, University of Wisconsin–Madison, Madison, WI, United States
| | - Thalia Wheatley
- Department of Psychological and Brain Sciences, Consortium for Interacting Minds, Dartmouth College, Hanover, NH, United States
- Santa Fe Institute, Santa Fe, NM, United States
| |
Collapse
|
4
|
Gunther KE, Fu X, MacNeill LA, Jones M, Ermanni B, Pérez-Edgar K. Now it's your turn!: Eye blink rate in a Jenga task modulated by interaction of task wait times, effortful control, and internalizing behaviors. PLoS One 2024; 19:e0294888. [PMID: 38457390 PMCID: PMC10923458 DOI: 10.1371/journal.pone.0294888] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2022] [Accepted: 11/10/2023] [Indexed: 03/10/2024] Open
Abstract
Dopamine is a versatile neurotransmitter with implications in many domains, including anxiety and effortful control. Where high levels of effortful control are often regarded as adaptive, other work suggests that high levels of effortful control may be a risk factor for anxiety. Dopamine signaling may be key in understanding these relations. Eye blink rate is a non-invasive proxy metric of midbrain dopamine activity. However, much work with eye blink rate has been constrained to screen-based tasks which lack in ecological validity. We tested whether changes in eye blink rate during a naturalistic effortful control task differ as a function of parent-reported effortful control and internalizing behaviors. Children played a Jenga-like game with an experimenter, but for each trial the experimenter took an increasingly long time to take their turn. Blinks-per-second were computed during each wait period. Multilevel modeling examined the relation between duration of wait period, effortful control, and internalizing behaviors on eye blink rate. We found a significant 3-way interaction between effortful control, internalizing behaviors, and duration of the wait period. Probing this interaction revealed that for children with low reported internalizing behaviors (-1 SD) and high reported effortful control (+1 SD), eye blink rate significantly decreased as they waited longer to take their turn. These findings index task-related changes in midbrain dopamine activity in relation to naturalistic task demands, and that these changes may vary as a function of individual differences in effortful control and internalizing behaviors. We discuss possible top-down mechanisms that may underlie these differences.
Collapse
Affiliation(s)
- Kelley E. Gunther
- Department of Psychology, Yale University, New Haven, CT, United States of America
| | - Xiaoxue Fu
- Department of Psychology, The University of South Carolina, Columbia, SC, United States of America
| | - Leigha A. MacNeill
- Northwestern University Feinberg School of Medicine, Chicago, IL, United States of America
| | - Morgan Jones
- Department of Human Development and Quantitative Methodology, University of Maryland, College Park, MD, United States of America
| | - Briana Ermanni
- Department of Psychology, Virginia Tech, Blacksburg, VA, United States of America
| | - Koraly Pérez-Edgar
- Department of Psychology, The Pennsylvania State University, State College, PA, United States of America
| |
Collapse
|
5
|
Wyly S, Jinon N, Francis T, Evans H, Kao TL, Lambert S, Montgomery S, Newlove M, Mariscal H, Nguyen H, Cole H, Aispuro I, Robledo D, Tenaglia O, Weinberger N, Nguyen B, Waits H, Jorian D, Koch-Kreher L, Myrdal H, Antoniou V, Warrier M, Wunsch L, Arce I, Kirchner K, Campos E, Nguyen A, Rodriguez K, Cao L, Halmekangas A, Wilson RC. The psychophysiology of Mastermind: Characterizing response times and blinking in a high-stakes television game show. Psychophysiology 2024; 61:e14485. [PMID: 37966011 DOI: 10.1111/psyp.14485] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2023] [Revised: 10/20/2023] [Accepted: 10/21/2023] [Indexed: 11/16/2023]
Abstract
Television game shows have proven to be a valuable resource for studying human behavior under conditions of high stress and high stakes. However, previous work has focused mostly on choices-ignoring much of the rich visual information that is available on screen. Here, we take a first step to extracting more of this information by investigating the response times and blinking of contestants in the BBC show Mastermind. In Mastermind, contestants answer rapid-fire quiz questions while a camera slowly zooms in on their faces. By labeling contestants' behavior and blinks from 25 episodes, we asked how accuracy, response times, and blinking varied over the course of the game. For accuracy and response times, we tested whether contestants responded more accurately and more slowly after an error-exhibiting the "post-error increase in accuracy" and "post-error slowing" which has been repeatedly observed in the lab. For blinking, we tested whether blink rates varied according to the cognitive demands of the game-decreasing during periods of cognitive load, such as when pondering a response, and increasing at event boundaries in the task, such as the start of a question. In contrast to the lab, evidence for post-error changes in accuracy and response time was weak, with only marginal effects observed. In line with the lab, blinking varied over the course of the game much as we predicted. Overall, our findings demonstrate the potential of extracting dynamic signals from game shows to study the psychophysiology of behavior in the real world.
Collapse
Affiliation(s)
- Skyler Wyly
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Neryanne Jinon
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Timothy Francis
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Hailey Evans
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Tsai Lieh Kao
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Shelby Lambert
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Shayne Montgomery
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Marvelene Newlove
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Haley Mariscal
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Henry Nguyen
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Harrison Cole
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Israel Aispuro
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Daniela Robledo
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Olivia Tenaglia
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Nina Weinberger
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Bill Nguyen
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Hailey Waits
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Daisy Jorian
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Lucas Koch-Kreher
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Hunter Myrdal
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Victoria Antoniou
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Meghana Warrier
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Leah Wunsch
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Iram Arce
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Kayla Kirchner
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Elena Campos
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - An Nguyen
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | | | - Lanqin Cao
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Avery Halmekangas
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Robert C Wilson
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
- McKnight Brain Research Foundation, University of Arizona, Tucson, Arizona, USA
- Cognitive Science Program, University of Arizona, Tucson, Arizona, USA
| |
Collapse
|
6
|
Pitigoi IC, Coe BC, Calancie OG, Brien DC, Yep R, Riek HC, Kirkpatrick RH, Noyes BK, White BJ, Blohm G, Munoz DP. Attentional modulation of eye blinking is altered by sex, age, and task structure. eNeuro 2024; 11:ENEURO.0296-23.2024. [PMID: 38331578 PMCID: PMC10915461 DOI: 10.1523/eneuro.0296-23.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2023] [Revised: 01/15/2024] [Accepted: 02/05/2024] [Indexed: 02/10/2024] Open
Abstract
Spontaneous eye blinking is gaining popularity as a proxy for higher cognitive functions, as it is readily modulated by both environmental demands and internal processes. Prior studies were impoverished in sample size, sex representation and age distribution, making it difficult to establish a complete picture of the behavior. Here we present eye-tracking data from a large cohort of normative participants (n=604, 393 F, aged 5-93 years) performing two tasks: one with structured, discrete trials (interleaved pro/anti-saccade task; IPAST) and one with a less structured, continuous organization in which participants watch movies (free-viewing; FV). Sex- and age-based analyses revealed that females had higher blink rates between the ages of 22 and 58 years in the IPAST, and 22 and 34 years in FV. We derived a continuous measure of blink probability to reveal behavioral changes driven by stimulus appearance in both paradigms. In the IPAST, blinks were suppressed near stimulus appearance, particularly on correct anti-saccade trials, which we attribute to the stronger inhibitory control required for anti-saccades compared to pro-saccades. In FV, blink suppression occurred immediately after scene changes, and the effect was sustained on scenes where gaze clustered among participants (indicating engagement of attention). Females were more likely than males to blink during appearance of novel stimuli in both tasks, but only within the age bin of 18-44 years. The consistency of blink patterns in each paradigm endorses blinking as a sensitive index for changes in visual processing and attention, while sex and age differences drive interindividual variability.Significance Statement Eye-tracking is becoming useful as a non-invasive tool for detecting preclinical markers of neurological and psychiatric disease. Blinks are understudied despite being an important supplement to saccade and pupil eye-tracking metrics. The present study is a crucial step in developing a healthy baseline for blink behavior to compare to clinical groups. While many prior blink studies suffered from small sample sizes with relatively low age- and sex-diversity (review by Jongkees & Colzato, 2016), our large cohort of healthy participants has permitted a more detailed analysis of sex and age effects in blink behavior. Furthermore, our analysis techniques are robust to temporal changes in blink probability, greatly clarifying the relationship between blinking, visual processing, and inhibitory control mechanisms on visual tasks.
Collapse
Affiliation(s)
- Isabell C Pitigoi
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada K7L 3N6
| | - Brian C Coe
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada K7L 3N6
| | - Olivia G Calancie
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada K7L 3N6
| | - Donald C Brien
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada K7L 3N6
| | - Rachel Yep
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada K7L 3N6
| | - Heidi C Riek
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada K7L 3N6
| | - Ryan H Kirkpatrick
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada K7L 3N6
| | - Blake K Noyes
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada K7L 3N6
| | - Brian J White
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada K7L 3N6
| | - Gunnar Blohm
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada K7L 3N6
| | - Douglas P Munoz
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada K7L 3N6
| |
Collapse
|
7
|
Partridge GJW, Taib AG, Phillips P, James JJ, Satchithananda K, Sharma N, Morel J, McAvinchey R, Valencia A, Teh W, Khan H, Muscat E, Michell MJ, Chen Y. Take a break: should breaks be enforced during digital breast tomosynthesis reading sessions? Eur Radiol 2024; 34:1388-1398. [PMID: 37589906 PMCID: PMC10853356 DOI: 10.1007/s00330-023-10086-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2023] [Revised: 04/24/2023] [Accepted: 06/26/2023] [Indexed: 08/18/2023]
Abstract
OBJECTIVES Digital breast tomosynthesis (DBT) can improve diagnostic accuracy compared to 2D mammography, but DBT reporting is time-consuming and potentially more fatiguing. Changes in diagnostic accuracy and subjective and objective fatigue were evaluated over a DBT reporting session, and the impact of taking a reporting break was assessed. MATERIALS AND METHODS Forty-five National Health Service (NHS) mammography readers from 6 hospitals read a cancer-enriched set of 40 DBT cases whilst eye tracked in this prospective cohort study, from December 2020 to April 2022. Eye-blink metrics were assessed as objective fatigue measures. Twenty-one readers had a reporting break, 24 did not. Subjective fatigue questionnaires were completed before and after the session. Diagnostic accuracy and subjective and objective fatigue measures were compared between the cohorts using parametric and non-parametric significance testing. RESULTS Readers had on average 10 years post-training breast screening experience and took just under 2 h (105.8 min) to report all cases. Readers without a break reported greater levels of subjective fatigue (44% vs. 33%, p = 0.04), which related to greater objective fatigue: an increased average blink duration (296 ms vs. 286 ms, p < 0.001) and a reduced eye-opening velocity (76 mm/s vs. 82 mm/s, p < 0.001). Objective fatigue increased as the trial progressed for the no break cohort only (ps < 0.001). No difference was identified in diagnostic accuracy between the groups (accuracy: 87% vs. 87%, p = 0.92). CONCLUSIONS Implementing a break during a 2-h DBT reporting session resulted in lower levels of subjective and objective fatigue. Breaks did not impact diagnostic accuracy, which may be related to the extensive experience of the readers. CLINICAL RELEVANCE STATEMENT DBT is being incorporated into many mammography screening programmes. Recognising that reporting breaks are required when reading large volumes of DBT studies ensures this can be factored in when setting up reading sessions. TRIAL REGISTRATION Clinical trials registration number: NCT03733106 KEY POINTS: • Use of digital breast tomosynthesis (DBT) in breast screening programmes can cause significant reader fatigue. • The effectiveness of incorporating reading breaks into DBT reporting sessions, to reduce mammography reader fatigue, was investigated using eye tracking. • Integrating breaks into DBT reporting sessions reduced reader fatigue; however, diagnostic accuracy was unaffected.
Collapse
Affiliation(s)
- George John William Partridge
- Translational Medical Sciences, School of Medicine, University of Nottingham, Clinical Sciences Building, City Hospital Campus, Hucknall Road, Nottingham, NG5 1PB, UK
| | - Adnan Gani Taib
- Translational Medical Sciences, School of Medicine, University of Nottingham, Clinical Sciences Building, City Hospital Campus, Hucknall Road, Nottingham, NG5 1PB, UK
| | - Peter Phillips
- Health and Medical Sciences Group, University of Cumbria, Lancaster, UK
| | - Jonathan Jeffrey James
- Nottingham University Hospitals NHS Trust, Nottingham Breast Institute, City Hospital Campus, Hucknall Road, Nottingham, NG5 1PB, UK
| | - Keshthra Satchithananda
- Department of Breast Radiology and National Breast Screening Training Centre, King's College Hospital, Denmark Hill, London, SE5 9RS, UK
| | - Nisha Sharma
- Leeds Breast Screening Unit, Leeds Teaching Hospital, York Road, Leeds, LS14 6UH, UK
| | - Juliet Morel
- Department of Breast Radiology and National Breast Screening Training Centre, King's College Hospital, Denmark Hill, London, SE5 9RS, UK
| | - Rita McAvinchey
- Jarvis Breast Screening Centre, Guildford, Surrey, GU1 1LJ, UK
| | - Alexandra Valencia
- Avon Breast Screening, Bristol Breast Care Centre, Bristol, BS10 5NB, UK
| | - William Teh
- North London Breast Screening Service, Edgware Community Hospital, London, HA8 9BA, UK
| | - Humaira Khan
- City, Sandwell and Walsall Breast Screening Service, Birmingham City Hospital, B18 7QH, Birmingham, UK
| | - Elizabeth Muscat
- South West London Breast Screening Service, St George's Hospital, London, SW17 0QT, UK
| | - Michael James Michell
- Department of Breast Radiology and National Breast Screening Training Centre, King's College Hospital, Denmark Hill, London, SE5 9RS, UK
| | - Yan Chen
- Translational Medical Sciences, School of Medicine, University of Nottingham, Clinical Sciences Building, City Hospital Campus, Hucknall Road, Nottingham, NG5 1PB, UK.
| |
Collapse
|
8
|
Hershman R, Share DL, Weiss EM, Henik A, Shechter A. Insights from Eye Blinks into the Cognitive Processes Involved in Visual Word Recognition. J Cogn 2024; 7:14. [PMID: 38250559 PMCID: PMC10798168 DOI: 10.5334/joc.343] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2023] [Accepted: 12/26/2023] [Indexed: 01/23/2024] Open
Abstract
Behavioral differences in speed and accuracy between reading familiar and unfamiliar words are well-established in the empirical literature. However, these standard measures of skill proficiency are limited in their ability to capture the moment-to-moment processing involved in visual word recognition. In the present study, the effect of word familiarity was initially investigated using an eye blink rate among adults and children. The probability of eye blinking was higher for familiar (real) words than for unfamiliar (pseudo)words. This counterintuitive pattern of results suggests that the processing of unfamiliar (pseudo)words is more demanding and perhaps less rewarding than the processing of familiar (real) words, as previously observed in both behavioral and pupillometry data. Our findings suggest that the measurement of eye blinks might shed new light on the cognitive processes involved in visual word recognition and other domains of human cognition.
Collapse
Affiliation(s)
- Ronen Hershman
- Department of Psychology, University of Innsbruck, Innsbruck, Austria
| | - David L. Share
- Department of Learning Disabilities, Faculty of Education, University of Haifa, Haifa, Israel
- Edmond J. Safra Brain Research Center for the Study of Learning Disabilities, University of Haifa, Haifa, Israel
| | | | - Avishai Henik
- Department of Psychology and The Zelman Center for Brain Science, Ben-Gurion University of the Negev, Beer-Sheva, Israel
| | - Adi Shechter
- Department of Learning Disabilities, Faculty of Education, University of Haifa, Haifa, Israel
- Edmond J. Safra Brain Research Center for the Study of Learning Disabilities, University of Haifa, Haifa, Israel
| |
Collapse
|
9
|
Magliacano A, Catalano L, Sagliano L, Estraneo A, Trojano L. Spontaneous eye blinking during an auditory, an interoceptive and a visual task: The role of the sensory modality and the attentional focus. Cortex 2023; 168:49-61. [PMID: 37659289 DOI: 10.1016/j.cortex.2023.07.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2023] [Revised: 07/15/2023] [Accepted: 07/31/2023] [Indexed: 09/04/2023]
Abstract
Previous evidence suggested that spontaneous eye blinking changes as a function of the attentional focus. In particular, eye blink rate (EBR) tends to increase when attention is directed to internal versus environmental processing. Most studies on this issue compared eye blinking during visual and mental imagery tasks, and interpreted the increase in EBR as a mechanism to focus cognitive resources on internal processing by disengaging attention from interfering information. However, since eye blinking also depends on the sensory modality of the task, the findings might be influenced by a modality-specific effect. In the present Registered Report we aim at investigating whether the environmental versus internal attentional focus can affect spontaneous blinking behaviour in non-visual tasks as well, in conditions where visual stimuli are not relevant. In a within-subject design, healthy participants performed an interoceptive task (i.e., heartbeat counting) and an auditory task in which pre-recorded heartbeats were presented aurally; during both tasks irrelevant visual stimuli were also presented. In a further control condition with the same auditory and visual stimuli, the participants were required to focus their attention on visual stimuli. Participants' EBR was recorded during each task by means of an eye-tracking system. We found that, although the interoceptive task was more difficult than the auditory and visual tasks, participants' EBR decreased by a comparable level in all tasks with respect to a rest condition, with no differences between internal versus environmental conditions. The present findings do not support the idea that EBR is modulated by an internal versus external focus of attention, at least in presence of controlled visual stimulation.
Collapse
Affiliation(s)
| | - Laura Catalano
- Department of Psychology, University of Campania "Luigi Vanvitelli", Caserta, Italy
| | - Laura Sagliano
- Department of Psychology, University of Campania "Luigi Vanvitelli", Caserta, Italy
| | | | - Luigi Trojano
- Department of Psychology, University of Campania "Luigi Vanvitelli", Caserta, Italy.
| |
Collapse
|
10
|
Caputo GB. Strange-face-in-the-mirror illusions: specific effects on derealization, depersonalization, and dissociative identity. J Trauma Dissociation 2023; 24:575-608. [PMID: 37006162 DOI: 10.1080/15299732.2023.2195394] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/07/2022] [Accepted: 01/03/2023] [Indexed: 04/04/2023]
Abstract
Anomalous strange-face illusions (SFIs) are produced when mirror gazing under a low level of face illumination. In contrast to past studies in which an observer's task was to pay attention to the reflected face and to perceive potential facial changes, the present research used a mirror gazing task (MGT) that instructed participants to fixate their gaze on a 4-mm hole in a glass mirror. The participants' eye-blink rates were thus measured without priming any facial changes. Twenty-one healthy young individuals participated in the MGT and a control panel-fixation task (staring at a hole in a gray non-reflective panel). The Revised Strange-Face Questionnaire (SFQ-R) indexed derealization (deformations of facial features; FD), depersonalization (bodily face detachment; BD), and dissociative identity (new or unknown identities; DI) scales. Mirror-fixation increased FD, BD, and DI scores compared to panel-fixation. In mirror-fixation, FD scores revealed fading specific to facial features, distinct from "classical" Troxler- and Brewster-fading. In mirror-fixation, eye-blink rates correlated negatively with FD scores. Panel-fixation produced low BD scores, and, in a few participants, face pareidolias as detected on FD scores. Females were more prone to early derealization and males to compartmentalization of a dissociative identity. SFQ-R may be a valuable instrument for measuring face-specific dissociation (FD, BD, DI) produced by MGT. Use of MGT and panel-fixation task for differential diagnoses between schizophrenia and dissociative identity disorder is discussed.
Collapse
Affiliation(s)
- Giovanni B Caputo
- Department of Humanistic Studies (DISTUM), University of Urbino, Urbino, Italy
| |
Collapse
|
11
|
Yule S, Robertson JM, Mormann B, Smink DS, Lipsitz S, Abahuje E, Kennedy-Metz L, Park S, Miccile C, Pozner CN, Doyle T, Musson D, Dias RD. Crew Autonomy During Simulated Medical Event Management on Long Duration Space Exploration Missions. HUMAN FACTORS 2023; 65:1221-1234. [PMID: 35430922 PMCID: PMC10466940 DOI: 10.1177/00187208211067575] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/28/2021] [Accepted: 11/16/2021] [Indexed: 06/14/2023]
Abstract
OBJECTIVE Our primary aim was to investigate crew performance during medical emergencies with and without ground-support from a flight surgeon located at mission control. BACKGROUND There are gaps in knowledge regarding the potential for unanticipated in-flight medical events to affect crew health and capacity, and potentially compromise mission success. Additionally, ground support may be impaired or periodically absent during long duration missions. METHOD We reviewed video recordings of 16 three-person flight crews each managing four unique medical events in a fully immersive spacecraft simulator. Crews were randomized to two conditions: with and without telemedical flight surgeon (FS) support. We assessed differences in technical performance, behavioral skills, and cognitive load between groups. RESULTS Crews with FS support performed better clinically, were rated higher on technical skills, and completed more clinical tasks from the medical checklists than crews without FS support. Crews with FS support also had better behavioral/non-technical skills (information exchange) and reported significantly lower cognitive demand during the medical event scenarios on the NASA-TLX scale, particularly in mental demand and temporal demand. There was no significant difference between groups in time to treat or in objective measures of cognitive demand derived from heart rate variability and electroencephalography. CONCLUSION Medical checklists are necessary but not sufficient to support high levels of autonomous crew performance in the absence of real-time flight surgeon support. APPLICATION Potential applications of this research include developing ground-based and in-flight training countermeasures; informing policy regarding autonomous spaceflight, and design of autonomous clinical decision support systems.
Collapse
Affiliation(s)
- Steven Yule
- STRATUS Center for Medical Simulation, Brigham and Women's Hospital, Boston, MA, USA; Center for Surgery & Public Health, Brigham & Women's Hospital, Boston, MA, USA; Department of Surgery, Brigham & Women's Hospital/ Harvard Medical School, Boston, MA, USA; Department of Clinical Surgery, The University of Edinburgh, Edinburgh, UK
| | - Jamie M Robertson
- Department of Surgery, Brigham & Women's Hospital/ Harvard Medical School, Boston, MA, USA
| | - Benjamin Mormann
- Department of Emergency Medicine, Harvard Medical School, Boston, MA, USA
| | - Douglas S Smink
- Center for Surgery & Public Health, Brigham & Women's Hospital, Boston, MA, USA; Department of Surgery, Brigham & Women's Hospital/ Harvard Medical School, Boston, MA, USA
| | - Stuart Lipsitz
- Center for Surgery & Public Health, Brigham & Women's Hospital, Boston, MA, USA
| | - Egide Abahuje
- STRATUS Center for Medical Simulation, Brigham and Women's Hospital, Boston, MA, USA; Department of Surgery, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
| | - Lauren Kennedy-Metz
- Department of Surgery, Brigham & Women's Hospital/ Harvard Medical School, Boston, MA, USA; Medical Robotics and Computer Assisted Surgery Laboratory, Division of Cardiac Surgery, U.S. Veterans Affairs Boston Healthcare System, Boston, MA, USA
| | - Sandra Park
- STRATUS Center for Medical Simulation, Brigham and Women's Hospital, Boston, MA, USA
| | - Christian Miccile
- STRATUS Center for Medical Simulation, Brigham and Women's Hospital, Boston, MA, USA
| | - Charles N Pozner
- STRATUS Center for Medical Simulation, Brigham and Women's Hospital, Boston, MA, USA; Department of Emergency Medicine, Harvard Medical School, Boston, MA, USA
| | - Thomas Doyle
- Department of Electrical and Computer Engineering, McMaster University, Hamilton, ON, Canada
| | - David Musson
- Faculty of Health Science, Northern Ontario School of Medicine, Thunder Bay, ON, Canada
| | - Roger D Dias
- STRATUS Center for Medical Simulation, Brigham and Women's Hospital, Boston, MA, USA; Department of Emergency Medicine, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
12
|
Nishizono R, Saijo N, Kashino M. Highly reproducible eyeblink timing during formula car driving. iScience 2023; 26:106803. [PMID: 37378324 PMCID: PMC10291330 DOI: 10.1016/j.isci.2023.106803] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2022] [Revised: 02/01/2023] [Accepted: 04/28/2023] [Indexed: 06/29/2023] Open
Abstract
How do humans blink while driving a vehicle? Although gaze control patterns have been previously reported in relation to successful steering, eyeblinks that disrupt vision are believed to be randomly distributed during driving or are ignored. Herein, we demonstrate that eyeblink timing shows reproducible patterns during real formula car racing driving and is related to car control. We studied three top-level racing drivers. Their eyeblinks and driving behavior were acquired during practice sessions. The results revealed that the drivers blinked at surprisingly similar positions on the courses. We identified three factors underlying the eyeblink patterns: the driver's individual blink count, lap pace associated with how strictly they followed their pattern on each lap, and car acceleration associated with when/where to blink at a moment. These findings suggest that the eyeblink pattern reflected cognitive states during in-the-wild driving and experts appear to change such cognitive states continuously and dynamically.
Collapse
Affiliation(s)
- Ryota Nishizono
- NTT Communication Science Laboratories, Morinosato Wakamiya 3-1, Atsugi, Kanagawa 243-0198, Japan
| | - Naoki Saijo
- NTT Communication Science Laboratories, Morinosato Wakamiya 3-1, Atsugi, Kanagawa 243-0198, Japan
| | - Makio Kashino
- NTT Communication Science Laboratories, Morinosato Wakamiya 3-1, Atsugi, Kanagawa 243-0198, Japan
| |
Collapse
|
13
|
López-Ahumada R, Jiménez-Naharro R, Gómez-Bravo F. A Hardware-Based Configurable Algorithm for Eye Blink Signal Detection Using a Single-Channel BCI Headset. SENSORS (BASEL, SWITZERLAND) 2023; 23:s23115339. [PMID: 37300066 DOI: 10.3390/s23115339] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/15/2023] [Revised: 04/20/2023] [Accepted: 05/29/2023] [Indexed: 06/12/2023]
Abstract
Eye blink artifacts in electroencephalographic (EEG) signals have been used in multiple applications as an effective method for human-computer interaction. Hence, an effective and low-cost blinking detection method would be an invaluable aid for the development of this technology. A configurable hardware algorithm, described using hardware description language, for eye blink detection based on EEG signals from a one-channel brain-computer interface (BCI) headset was developed and implemented, showing better performance in terms of effectiveness and detection time than manufacturer-provided software.
Collapse
Affiliation(s)
- Rafael López-Ahumada
- Departamento de Ingeniería Electrónica Sistemas Informáticos y Automática, Universidad de Huelva, 21007 Huelva, Spain
| | - Raúl Jiménez-Naharro
- Departamento de Ingeniería Electrónica Sistemas Informáticos y Automática, Universidad de Huelva, 21007 Huelva, Spain
| | - Fernando Gómez-Bravo
- Centro Científico Tecnológico de Huelva (CCTH), University of Huelva, 21007 Huelva, Spain
| |
Collapse
|
14
|
Yu C, Ishibashi K, Iwanaga K. Effects of fearful face presentation time and observer's eye movement on the gaze cue effect. J Physiol Anthropol 2023; 42:8. [PMID: 37248516 DOI: 10.1186/s40101-023-00325-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2022] [Accepted: 05/12/2023] [Indexed: 05/31/2023] Open
Abstract
BACKGROUND There are many conflicting findings on the gaze cueing effect (GCE) of emotional facial expressions. This study aimed to investigate whether an averted gaze, accompanied by a fearful expression of different durations, could enhance attentional orientation, as measured by a participant's eye movements. METHODS Twelve participants (3 females) completed the gaze cue task, reacting to a target location after observing changes in the gaze and expression of a face illustrated on a computer screen. Meanwhile, participants' eye movements were monitored by electrooculography. The GCE was calculated by reaction time as an indicator of attention shift. RESULTS The analysis of the overall data did not find a significant effect of fearful facial expressions on the GCE. However, analysis of trial data that excluded a participant's eye movement data showed that brief (0, 100 ms) presentation of the fearful facial expression enhanced the GCE compared to that during a neutral facial expression, although when the presentation time of the fearful expression was increased to 200 or 400 ms, the GCE of the fearful expression was at the same level as when model showed a neutral expression. CONCLUSIONS The results suggest that the attention-enhancing effect of gaze cues induced by rapidly presented fearful expressions occurs only when the effect of eye movement trials is excluded. This effect may be mediated by reflexively neural circuits in the amygdala that process threatening stimuli. However, as the expression duration increased, the fearful expression's attention-enhancing effect decreased. We suggest that future studies on the emotion modulation of GCE should consider the negative effects of participants' saccades and blinks on the experimental results.
Collapse
Affiliation(s)
- Chuntai Yu
- Graduate School of Science and Engineering, Chiba University, 1-33 Yayoi-Cho, Inage-Ku, Chiba, 263-8522, Japan
| | - Keita Ishibashi
- Design Research Institute, Chiba University, 1-33 Yayoi-Cho, Inage-Ku, Chiba, 263-8522, Japan
| | - Koichi Iwanaga
- Design Research Institute, Chiba University, 1-33 Yayoi-Cho, Inage-Ku, Chiba, 263-8522, Japan.
| |
Collapse
|
15
|
Huber SE, Martini M, Sachse P. Task-synchronized eye blink modulation neither requires visual stimulation nor active motor response and is modulated by task predictability. Int J Psychophysiol 2023; 187:1-10. [PMID: 36773888 DOI: 10.1016/j.ijpsycho.2023.01.011] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2022] [Revised: 01/31/2023] [Accepted: 01/31/2023] [Indexed: 02/12/2023]
Abstract
It has been repeatedly shown that temporal task features are reflected in eye blink dynamics during attention tasks. Eye blinks occur with increased likeliness particularly when demands on external attention allocation are low. Both predictive, top-down and reactive, bottom-up processes were shown to be involved in blink regulation. However, whether temporal stimulus prediction is a generally active component of the attention system or rather specific to the visual domain has not been fully elaborated yet. By monitoring eye blinking of 99 students during an auditory attention task and analyzing particularly the dynamics of eye blink onsets relative to stimuli timings, we show here that prediction does, in principle, not require visual stimulation, and is also not merely a consequence of the involvement of manual responses during the task. We further show that both the inclusion of manual response to stimuli and elevated task predictability enhance the prediction component reflected in eye blink dynamics, whereas for the latter we experimentally manipulate objective task predictability by adjusting the frequency dependence of the power spectral densities of the series of inter-stimulus time intervals. This allows us finally to explain why, for specific choices of experimental conditions, the generally active and present prediction component involved in attention can become difficult to detect in non-visual, auditory tasks. Conversely, this comes with the important implication that, if tasks aim for elaborating particularly temporal prediction, distributing stimuli over time such that inter-stimulus-intervals conform to a sample of Gaussian noise represents a specifically unfavorable choice.
Collapse
Affiliation(s)
- Stefan E Huber
- Department of Psychology, University of Innsbruck, Universitätsstraße 5-7, A-6020 Innsbruck, Austria; Institute of Psychology, University of Graz, Universitätsplatz 2, A-8010 Graz, Austria.
| | - Markus Martini
- Department of Psychology, University of Innsbruck, Universitätsstraße 5-7, A-6020 Innsbruck, Austria
| | - Pierre Sachse
- Department of Psychology, University of Innsbruck, Universitätsstraße 5-7, A-6020 Innsbruck, Austria
| |
Collapse
|
16
|
Castner SA, Zhang L, Yang CR, Hao J, Cramer JW, Wang X, Bruns RF, Marston H, Svensson KA, Williams GV. Effects of DPTQ, a novel positive allosteric modulator of the dopamine D1 receptor, on spontaneous eye blink rate and spatial working memory in the nonhuman primate. Psychopharmacology (Berl) 2023; 240:1033-1048. [PMID: 36961560 PMCID: PMC10102062 DOI: 10.1007/s00213-022-06282-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/05/2021] [Accepted: 11/23/2022] [Indexed: 03/25/2023]
Abstract
RATIONALE Dopamine (DA) signaling through the D1 receptor has been shown to be integral to multiple aspects of cognition, including the core process of working memory. The discovery of positive allosteric modulators (PAMs) of the D1 receptor has enabled treatment modalities that may have alternative benefits to orthosteric D1 agonists arising from a synergism of action with functional D1 receptor signaling. OBJECTIVES To investigate this potential, we have studied the effects of the novel D1 PAM DPTQ on a spatial delayed response working memory task in the rhesus monkey. Initial studies indicated that DPTQ binds to primate D1R with high affinity and selectivity and elevates spontaneous eye blink rate in rhesus monkeys in a dose-dependent manner consistent with plasma ligand exposures and central D1activation. RESULTS Based on those results, DPTQ was tested at 2.5 mg/kg IM in the working memory task. No acute effect was observed 1 h after dosing, but performance was impaired 48 h later. Remarkably, this deficit was immediately followed by a significant enhancement in cognition over the next 3 days. In a second experiment in which DPTQ was administered on days 1 and 5, the early impairment was smaller and did not reach statistical significance, but statistically significant enhancement of performance was observed over the following week. Lower doses of 0.1 and 1.0 mg/kg were also capable of producing this protracted enhancement without inducing any transient impairment. CONCLUSIONS DPTQ exemplifies a class of D1PAMs that may be capable of providing long-term improvements in working memory.
Collapse
Affiliation(s)
- Stacy A Castner
- Department of Comparative Medicine, Yale University, 310 Cedar St, New Haven, CT, 06520, USA
| | - Linli Zhang
- ChemPartner, 99 Lian He North Road, Zhe Lin Town, Fengxian Area, Shanghai, China
| | - Charles R Yang
- ChemPartner, 99 Lian He North Road, Zhe Lin Town, Fengxian Area, Shanghai, China
| | - Junliang Hao
- Eli Lilly & Co, Lilly Corporate Center, Indianapolis, IN, 46285, USA
| | - Jeffrey W Cramer
- Eli Lilly & Co, Lilly Corporate Center, Indianapolis, IN, 46285, USA
| | - Xushan Wang
- Eli Lilly & Co, Lilly Corporate Center, Indianapolis, IN, 46285, USA
| | - Robert F Bruns
- Eli Lilly & Co, Lilly Corporate Center, Indianapolis, IN, 46285, USA
| | | | - Kjell A Svensson
- Eli Lilly & Co, Lilly Corporate Center, Indianapolis, IN, 46285, USA
| | - Graham V Williams
- Department of Comparative Medicine, Yale University, 310 Cedar St, New Haven, CT, 06520, USA.
| |
Collapse
|
17
|
Chen Y, Sudin ES, Partridge GJW, Taib AG, Darker IT, Phillips P, James JJ, Satchithananda K, Sharma N, Michell MJ. Measuring reader fatigue in the interpretation of screening digital breast tomosynthesis (DBT). Br J Radiol 2023; 96:20220629. [PMID: 36633316 PMCID: PMC9975365 DOI: 10.1259/bjr.20220629] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2022] [Revised: 11/01/2022] [Accepted: 11/06/2022] [Indexed: 01/13/2023] Open
Abstract
OBJECTIVES The interpretation of digital breast tomosynthesis (DBT) screening examinations is a complex task for an already overstretched workforce which has the potential to increase pressure on readers leading to fatigue and patient safety issues. Studies in non-medical and medical settings have suggested that changes in blink characteristics can reflect fatigue. The purpose of this study is to investigate the use of blink characteristics as an objective marker of fatigue in readers interpreting DBT breast screening examinations. METHODS Twenty-six DBT readers involved in the UK PROSPECTS trial interpreted a test set of 40 DBT cases while being observed by an eye tracking device from November 2019 to February 2021. Raw data from the eye tracker were collected and automated processing software was used to produce eye blinking characteristics data which were analysed using multiple linear regression statistical models. RESULTS Of the 26 DBT readers recruited, eye tracking data from 23 participants were analysed due to missing data rendering 3 participants' data uninterpretable. The mean reading time per DBT case was 2.81 min. There was a statistically significant increase in blinking duration of 0.38 ms/case as the reading session progressed (p < 0.0001). This was the result of a significant decrease in the number of ultra-short blinks lasting ≤50 ms (p = 0.0005) and a significant increase in longer blinks lasting 51-100 ms (p = 0.008). CONCLUSION Changes in blinking characteristics could serve as objective measures of reader fatigue and may prove useful in the development of DBT reading protocols. ADVANCES IN KNOWLEDGE Blink characteristics can be used as an objective measure of fatigue; however there is limited evidence of their use in radiological settings. Our study suggests that changes in blink duration and frequency could be used to monitor fatigue in DBT reading sessions.
Collapse
Affiliation(s)
- Yan Chen
- University of Nottingham, School of Medicine, Translational Medical Sciences, Clinical Sciences Building, City Hospital Campus, Hucknall Road, Nottingham, United Kingdom
| | - Ellhia S Sudin
- University of Nottingham, School of Medicine, Translational Medical Sciences, Clinical Sciences Building, City Hospital Campus, Hucknall Road, Nottingham, United Kingdom
| | - George JW Partridge
- University of Nottingham, School of Medicine, Translational Medical Sciences, Clinical Sciences Building, City Hospital Campus, Hucknall Road, Nottingham, United Kingdom
| | - Adnan G Taib
- University of Nottingham, School of Medicine, Translational Medical Sciences, Clinical Sciences Building, City Hospital Campus, Hucknall Road, Nottingham, United Kingdom
| | - Iain T Darker
- University of Nottingham, School of Medicine, Translational Medical Sciences, Clinical Sciences Building, City Hospital Campus, Hucknall Road, Nottingham, United Kingdom
| | - Peter Phillips
- Health and Medical Sciences Group, University of Cumbria, Lancaster, United Kingdom
| | - Jonathan J James
- Nottingham University Hospitals NHS Trust, Nottingham Breast Institute, City Hospital Campus, Hucknall Road, Nottingham, United Kingdom
| | - Keshthra Satchithananda
- Department of Breast Radiology, National Breast Screening Training Centre, King’s College Hospital, Denmark Hill, London, United Kingdom
| | - Nisha Sharma
- Leeds Breast Screening Unit, Leeds Teaching Hospital, York Road, Leeds, United Kingdom
| | - Michael J Michell
- Department of Breast Radiology, National Breast Screening Training Centre, King’s College Hospital, Denmark Hill, London, United Kingdom
| |
Collapse
|
18
|
Aminosharieh Najafi T, Affanni A, Rinaldo R, Zontone P. Driver Attention Assessment Using Physiological Measures from EEG, ECG, and EDA Signals. SENSORS (BASEL, SWITZERLAND) 2023; 23:2039. [PMID: 36850637 PMCID: PMC9961536 DOI: 10.3390/s23042039] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/10/2022] [Revised: 02/03/2023] [Accepted: 02/07/2023] [Indexed: 06/18/2023]
Abstract
In this paper, we consider the evaluation of the mental attention state of individuals driving in a simulated environment. We tested a pool of subjects while driving on a highway and trying to overcome various obstacles placed along the course in both manual and autonomous driving scenarios. Most systems described in the literature use cameras to evaluate features such as blink rate and gaze direction. In this study, we instead analyse the subjects' Electrodermal activity (EDA) Skin Potential Response (SPR), their Electrocardiogram (ECG), and their Electroencephalogram (EEG). From these signals we extract a number of physiological measures, including eye blink rate and beta frequency band power from EEG, heart rate from ECG, and SPR features, then investigate their capability to assess the mental state and engagement level of the test subjects. In particular, and as confirmed by statistical tests, the signals reveal that in the manual scenario the subjects experienced a more challenged mental state and paid higher attention to driving tasks compared to the autonomous scenario. A different experiment in which subjects drove in three different setups, i.e., a manual driving scenario and two autonomous driving scenarios characterized by different vehicle settings, confirmed that manual driving is more mentally demanding than autonomous driving. Therefore, we can conclude that the proposed approach is an appropriate way to monitor driver attention.
Collapse
|
19
|
Evaluation of eye movement patterns during reading of mixed dentition panoramic radiographs in dental students. PEDIATRIC DENTAL JOURNAL 2023. [DOI: 10.1016/j.pdj.2023.01.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/21/2023]
|
20
|
Pinggal E, Dockree PM, O'Connell RG, Bellgrove MA, Andrillon T. Pharmacological Manipulations of Physiological Arousal and Sleep-Like Slow Waves Modulate Sustained Attention. J Neurosci 2022; 42:8113-8124. [PMID: 36109167 PMCID: PMC9637000 DOI: 10.1523/jneurosci.0836-22.2022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2022] [Revised: 08/25/2022] [Accepted: 08/29/2022] [Indexed: 11/21/2022] Open
Abstract
Sustained attention describes our ability to keep a constant focus on a given task. This ability is modulated by our physiological state of arousal. Although lapses of sustained attention have been linked with dysregulations of arousal, the underlying physiological mechanisms remain unclear. An emerging body of work proposes that the intrusion during wakefulness of sleep-like slow waves, a marker of the transition toward sleep, could mechanistically account for attentional lapses. This study aimed to expose, via pharmacological manipulations of the monoamine system, the relationship between the occurrence of sleep-like slow waves and the behavioral consequences of sustained attention failures. In a double-blind, randomized-control trial, 32 healthy human male participants received methylphenidate, atomoxetine, citalopram or placebo during four separate experimental sessions. During each session, electroencephalography (EEG) was used to measure neural activity while participants completed a visual task requiring sustained attention. Methylphenidate, which increases wake-promoting dopamine and noradrenaline across cortical and subcortical areas, improved behavioral performance whereas atomoxetine, which increases dopamine and noradrenaline predominantly over frontal cortices, led to more impulsive responses. Additionally, citalopram, which increases sleep-promoting serotonin, led to more missed trials. Based on EEG recording, citalopram was also associated with an increase in sleep-like slow waves. Importantly, compared with a classical marker of arousal such as α power, only slow waves differentially predicted both misses and faster responses in a region-specific fashion. These results suggest that a decrease in arousal can lead to local sleep intrusions during wakefulness which could be mechanistically linked to impulsivity and sluggishness.SIGNIFICANCE STATEMENT We investigated whether the modulation of attention and arousal could not only share the same neuromodulatory pathways but also rely on similar neuronal mechanisms; for example, the intrusion of sleep-like activity within wakefulness. To do so, we pharmacologically manipulated noradrenaline, dopamine, and serotonin in a four-arm, randomized, placebo-controlled trial and examined the consequences on behavioral and electroencephalography (EEG) indices of attention and arousal. We showed that sleep-like slow waves can predict opposite behavioral signatures: impulsivity and sluggishness. Slow waves may be a candidate mechanism for the occurrence of attentional lapses since the relationship between slow-wave occurrence and performance is region-specific and the consequences of these local sleep intrusions are in line with the cognitive functions carried by the underlying brain regions.
Collapse
Affiliation(s)
- Elaine Pinggal
- School of Psychological Sciences, Turner Institute for Brain and Mental Health, Monash University, Melbourne, Victoria 3168, Australia
| | - Paul M Dockree
- Trinity College Institute of Neuroscience and School of Psychology, Trinity College Dublin, Dublin D02 PN40, Ireland
| | - Redmond G O'Connell
- Trinity College Institute of Neuroscience and School of Psychology, Trinity College Dublin, Dublin D02 PN40, Ireland
| | - Mark A Bellgrove
- School of Psychological Sciences, Turner Institute for Brain and Mental Health, Monash University, Melbourne, Victoria 3168, Australia
| | - Thomas Andrillon
- School of Philosophical, Historical, and International Studies, Centre for Consciousness and Contemplative Studies, Monash University, Melbourne, Victoria 3168, Australia
- Paris Brain Institute, Sorbonne Université, Institut National de la Santé et de la Recherche Médicale-Centre National de la Recherche Scientifique, Paris 75013, France
| |
Collapse
|
21
|
Avirame K, Gshur N, Komemi R, Lipskaya-Velikovsky L. A multimodal approach for the ecological investigation of sustained attention: A pilot study. Front Hum Neurosci 2022; 16:971314. [PMID: 36248697 PMCID: PMC9556703 DOI: 10.3389/fnhum.2022.971314] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2022] [Accepted: 09/05/2022] [Indexed: 11/13/2022] Open
Abstract
Natural fluctuations in sustained attention can lead to attentional failures in everyday tasks and even dangerous incidences. These fluctuations depend on personal factors, as well as task characteristics. So far, our understanding of sustained attention is partly due to the common usage of laboratory setups and tasks, and the complex interplay between behavior and brain activity. The focus of the current study was thus to test the feasibility of applying a single-channel wireless EEG to monitor patterns of sustained attention during a set of ecological tasks. An EEG marker of attention (BEI—Brain Engagement Index) was continuously recorded from 42 healthy volunteers during auditory and visual tasks from the Test of Everyday Attention (TEA) and Trail Making Test (TMT). We found a descending pattern of both performance and BEI in the auditory tasks as task complexity increases, while the increase in performance and decrease in BEI on the visual task. In addition, patterns of BEI in the complex tasks were used to detect outliers and the optimal range of attention through exploratory models. The current study supports the feasibility of combined electrophysiological and neurocognitive investigation of sustained attention in ecological tasks yielding unique insights on patterns of sustained attention as a function of task modality and task complexity.
Collapse
Affiliation(s)
- Keren Avirame
- Psychiatric Division, Sourasky Medical Center, Tel Aviv-Yafo, Israel
| | - Noga Gshur
- Independent Researcher, Tel Aviv-Yafo, Israel
| | - Reut Komemi
- School of Occupational Therapy, Faculty of Medicine, Hebrew University, Jerusalem, Israel
| | - Lena Lipskaya-Velikovsky
- School of Occupational Therapy, Faculty of Medicine, Hebrew University, Jerusalem, Israel
- *Correspondence: Lena Lipskaya-Velikovsky,
| |
Collapse
|
22
|
Lee P, Kim H, Kim Y, Choi W, Zitouni MS, Khandoker A, Jelinek HF, Hadjileontiadis L, Lee U, Jeong Y. Beyond Pathogen Filtration: Possibility of Smart Masks as Wearable Devices for Personal and Group Health and Safety Management. JMIR Mhealth Uhealth 2022; 10:e38614. [PMID: 35679029 PMCID: PMC9217147 DOI: 10.2196/38614] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2022] [Revised: 05/20/2022] [Accepted: 06/08/2022] [Indexed: 12/15/2022] Open
Abstract
Face masks are an important way to combat the COVID-19 pandemic. However, the prolonged pandemic has revealed confounding problems with the current face masks, including not only the spread of the disease but also concurrent psychological, social, and economic complications. As face masks have been worn for a long time, people have been interested in expanding the purpose of masks from protection to comfort and health, leading to the release of various “smart” mask products around the world. To envision how the smart masks will be extended, this paper reviewed 25 smart masks (12 from commercial products and 13 from academic prototypes) that emerged after the pandemic. While most smart masks presented in the market focus on resolving problems with user breathing discomfort, which arise from prolonged use, academic prototypes were designed for not only sensing COVID-19 but also general health monitoring aspects. Further, we investigated several specific sensors that can be incorporated into the mask for expanding biophysical features. On a larger scale, we discussed the architecture and possible applications with the help of connected smart masks. Namely, beyond a personal sensing application, a group or community sensing application may share an aggregate version of information with the broader population. In addition, this kind of collaborative sensing will also address the challenges of individual sensing, such as reliability and coverage. Lastly, we identified possible service application fields and further considerations for actual use. Along with daily-life health monitoring, smart masks may function as a general respiratory health tool for sports training, in an emergency room or ambulatory setting, as protection for industry workers and firefighters, and for soldier safety and survivability. For further considerations, we investigated design aspects in terms of sensor reliability and reproducibility, ergonomic design for user acceptance, and privacy-aware data-handling. Overall, we aim to explore new possibilities by examining the latest research, sensor technologies, and application platform perspectives for smart masks as one of the promising wearable devices. By integrating biomarkers of respiration symptoms, a smart mask can be a truly cutting-edge device that expands further knowledge on health monitoring to reach the next level of wearables.
Collapse
Affiliation(s)
- Peter Lee
- KAIST Institute for Health Science and Technology, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea
| | - Heepyung Kim
- KAIST Institute for Health Science and Technology, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea
| | - Yongshin Kim
- Graduate School of Data Science, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea
| | - Woohyeok Choi
- Information & Electronics Research Institute, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea
| | - M Sami Zitouni
- Department of Biomedical Engineering, Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates.,Healthcare Engineering Innovation Center, Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates
| | - Ahsan Khandoker
- Department of Biomedical Engineering, Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates.,Healthcare Engineering Innovation Center, Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates
| | - Herbert F Jelinek
- Department of Biomedical Engineering, Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates.,Healthcare Engineering Innovation Center, Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates
| | - Leontios Hadjileontiadis
- Department of Biomedical Engineering, Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates.,Healthcare Engineering Innovation Center, Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates.,Department of Electrical and Computer Engineering, Aristotle University of Thessaloniki, Thessaloniki, Greece
| | - Uichin Lee
- KAIST Institute for Health Science and Technology, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea.,School of Computing, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea
| | - Yong Jeong
- KAIST Institute for Health Science and Technology, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea.,Department of Bio and Brain Engineering, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea
| |
Collapse
|
23
|
Hikida K. Eyeblink rate as an indicator of concentration on grooming in Japanese macaques (Macaca fuscata). Am J Primatol 2022; 84:e23392. [PMID: 35612538 DOI: 10.1002/ajp.23392] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2021] [Revised: 04/29/2022] [Accepted: 05/03/2022] [Indexed: 11/10/2022]
Abstract
In primates, social relationships with a high frequency of social grooming are referred to as "affiliate relationships," "friendship," "bonding," and are described as involving positive emotion. However, the psychological state during social grooming has not been fully understood. In this study, I focused on blinking as a behavior that reflects psychological state during grooming in Macaca fuscata, a nonhuman wild primate, and examined for the first time whether the blink rate reflects concentration on social grooming. To test this hypothesis, I focused on ectoparasite removals during social grooming with the following three predictions: (1) blinks are synchronized with breakpoints (when monkeys can release visual attention) of mouthing ectoparasites during grooming, (2) the blink rate is lower during grooming (when requiring visual concentration) than during resting (when no visual concentration is required), and (3) the lower the blink rate during grooming (supposedly in high concentration), the higher the frequency of ectoparasites removals (outputs of the task). I recorded the faces of 10 wild female Japanese macaques on Kinkazan Island, Miyagi Prefecture, with video, while they were resting and grooming, and recorded the timing and frequency of eyeblink and ectoparasite removals. All three predictions were supported, suggesting that the blink rate during grooming can be an indicator of concentration on grooming in nonhuman primates. Whether grooming concentration is associated with an affiliative relationship with the grooming partner is an issue that should be carefully examined in future studies, but eyeblink studies may provide new perspectives for understanding the psychological state of individuals during grooming in a noninvasive manner.
Collapse
Affiliation(s)
- Kenichiro Hikida
- Lab. of Human Evolution Studies, Graduate School of Science, Kyoto University, Kyoto, Japan
| |
Collapse
|
24
|
Baron Shahaf D, Weissman A, Priven L, Shahaf G. Identifying Recall Under Sedation by a Novel EEG Based Index of Attention—A Pilot Study. Front Med (Lausanne) 2022; 9:880384. [PMID: 35492350 PMCID: PMC9047181 DOI: 10.3389/fmed.2022.880384] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2022] [Accepted: 03/24/2022] [Indexed: 11/15/2022] Open
Abstract
Overview Recall is an accepted consequence of sedation. But due to the very low prevalence of the more devastating awareness under anesthesia (AUA), it might be of value to assess first the efficacy of new markers for AUA by their efficacy in discovering the more prevalent recall under sedation (RUS). In this pilot study we assessed whether a novel index for attentional effort, the cognitive effort index (CEI), derived in real-time from one forehead EEG channel, could differentiate between patients with or without RUS. Methods EEG was sampled from 2 groups: (1) Patients who underwent deep sedation (n = 25) (using drugs according to the anesthesiologist preference, but generally combining either Midazolam or Propofol together with either Fentanyl or Remifentanil). (2) Patients who underwent general anesthesia (GA, n = 13, a negative control for recall). In recovery, recall was assessed using the BRICE questionnaire. Results Of the 25 sedated patients, 11 experienced recall. The CEI marker was high during significantly longer periods in patients with recall, compared to sedated patients, or patients under GA, without recall. Moreover, the increase in CEI was evident mainly toward the end of the procedure. Conclusion RUS seems to associate with higher level of attention, which is identified in real-time by the easy-to-extract CEI marker.
Collapse
Affiliation(s)
- Dana Baron Shahaf
- Department of Anesthesia, Rambam Health Care Campus, Haifa, Israel
- *Correspondence: Dana Baron Shahaf
| | - Avi Weissman
- Department of Anesthesia, Rambam Health Care Campus, Haifa, Israel
| | - Leonid Priven
- Department of Anesthesia, Rambam Health Care Campus, Haifa, Israel
| | - Goded Shahaf
- The Applied Neurophysiology Lab, Rambam Health Care Campus, Haifa, Israel
| |
Collapse
|
25
|
Paśko W, Zadarko E, Krzeszowski T, Przednowek K. Relationship between Eye Blink Frequency and Incremental Exercise among Young Healthy Men. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:ijerph19074362. [PMID: 35410042 PMCID: PMC8998332 DOI: 10.3390/ijerph19074362] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/18/2022] [Revised: 03/31/2022] [Accepted: 04/01/2022] [Indexed: 11/16/2022]
Abstract
The aim of the study was to verify the correlation between the frequency of blinking and aerobic physical exercise. The research subjects were 13 healthy man aged 23.3 ± 1 year. Measurements of the blink rate and eye closure times were performed during a progressive aerobic test on a cycle ergometer. During the test, power was gradually increased every minute by 25 W, starting from 50 W. Data acquisition involved using a GoPro camera mounted to the helmet of the research subject. The test continued until the research subject refused to continue. The subjects did not know the goal of the test, in order to ensure objectivity and obtain natural results. The largest number of statistically significant differences was observed between the initial stages and 250 W, as well as between 250 W and 325 W. The analysis showed no significant differences in blink rate, eye closure time, and single blink time in terms of heart rate ranges. Regression models were also determined for eye closure time, blink frequency, and single blink time. The analysis showed that blink frequency and eye closure time were determined by a group of factors (the value of cycle ergometer load power, heart rate, body weight, adipose tissue mass, fat-free mass, and total body water and body surface ratio).
Collapse
Affiliation(s)
- Wojciech Paśko
- Institute of Physical Culture Sciences, Medical College of Rzeszow University, Rzeszow University, 35-959 Rzeszow, Poland; (W.P.); (E.Z.)
| | - Emilian Zadarko
- Institute of Physical Culture Sciences, Medical College of Rzeszow University, Rzeszow University, 35-959 Rzeszow, Poland; (W.P.); (E.Z.)
| | - Tomasz Krzeszowski
- Faculty of Electrical and Computer Engineering, Rzeszow University of Technology, Al. Powstancow Warszawy 12, 35-959 Rzeszow, Poland;
| | - Krzysztof Przednowek
- Institute of Physical Culture Sciences, Medical College of Rzeszow University, Rzeszow University, 35-959 Rzeszow, Poland; (W.P.); (E.Z.)
- Correspondence:
| |
Collapse
|
26
|
Ortega J, Plaska CR, Gomes BA, Ellmore TM. Spontaneous Eye Blink Rate During the Working Memory Delay Period Predicts Task Accuracy. Front Psychol 2022; 13:788231. [PMID: 35242077 PMCID: PMC8886217 DOI: 10.3389/fpsyg.2022.788231] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2021] [Accepted: 01/11/2022] [Indexed: 11/17/2022] Open
Abstract
Spontaneous eye blink rate (sEBR) has been linked to attention and memory, specifically working memory (WM). sEBR is also related to striatal dopamine (DA) activity with schizophrenia and Parkinson’s disease showing increases and decreases, respectively, in sEBR. A weakness of past studies of sEBR and WM is that correlations have been reported using blink rates taken at baseline either before or after performance of the tasks used to assess WM. The goal of the present study was to understand how fluctuations in sEBR during different phases of a visual WM task predict task accuracy. In two experiments, with recordings of sEBR collected inside and outside of a magnetic resonance imaging bore, we observed sEBR to be positively correlated with WM task accuracy during the WM delay period. We also found task-related modulation of sEBR, including higher sEBR during the delay period compared to rest, and lower sEBR during task phases (e.g., stimulus encoding) that place demands on visual attention. These results provide further evidence that sEBR could be an important predictor of WM task performance with the changes during the delay period suggesting a role in WM maintenance. The relationship of sEBR to DA activity and WM maintenance is discussed.
Collapse
Affiliation(s)
- Jefferson Ortega
- Department of Psychology, The City College of the City University of New York, New York, NY, United States
| | - Chelsea Reichert Plaska
- Department of Psychology, The City College of the City University of New York, New York, NY, United States.,Behavioral and Cognitive Neuroscience Program, The Graduate Center of the City University of New York, New York, NY, United States
| | - Bernard A Gomes
- Department of Neurosurgery, Cedars-Sinai Medical Center, Los Angeles, CA, United States
| | - Timothy M Ellmore
- Department of Psychology, The City College of the City University of New York, New York, NY, United States.,Behavioral and Cognitive Neuroscience Program, The Graduate Center of the City University of New York, New York, NY, United States
| |
Collapse
|
27
|
Tavano A, Kotz SA. Overt Oculomotor Behavior Reveals Covert Temporal Predictions. Front Hum Neurosci 2022; 16:758138. [PMID: 35221954 PMCID: PMC8874352 DOI: 10.3389/fnhum.2022.758138] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2021] [Accepted: 01/14/2022] [Indexed: 11/21/2022] Open
Abstract
Our eyes move in response to stimulus statistics, reacting to surprising events, and adapting to predictable ones. Cortical and subcortical pathways contribute to generating context-specific eye-movement dynamics, and oculomotor dysfunction is recognized as one the early clinical markers of Parkinson's disease (PD). We asked if covert computations of environmental statistics generating temporal expectations for a potential target are registered by eye movements, and if so, assuming that temporal expectations rely on motor system efficiency, whether they are impaired in PD. We used a repeating tone sequence, which generates a hazard rate distribution of target probability, and analyzed the distribution of blinks when participants were waiting for the target, but the target did not appear. Results show that, although PD participants tend to produce fewer and less temporally organized blink events relative to healthy controls, in both groups blinks became more suppressed with increasing target probability, leading to a hazard rate of oculomotor inhibition effects. The covert generation of temporal predictions may reflect a key feature of cognitive resilience in Parkinson's Disease.
Collapse
Affiliation(s)
- Alessandro Tavano
- Department of Neuroscience, Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Germany
- *Correspondence: Alessandro Tavano ;
| | - Sonja A. Kotz
- Department of Neuropsychology and Psychopharmacology, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, Netherlands
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| |
Collapse
|
28
|
Blinking While Speaking and Talking, Hearing, and Listening: Communication or Individual Underlying Process? JOURNAL OF NONVERBAL BEHAVIOR 2022. [DOI: 10.1007/s10919-021-00387-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
29
|
Bachurina V, Arsalidou M. Multiple levels of mental attentional demand modulate peak saccade velocity and blink rate. Heliyon 2022; 8:e08826. [PMID: 35128110 PMCID: PMC8800024 DOI: 10.1016/j.heliyon.2022.e08826] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2021] [Revised: 03/10/2021] [Accepted: 01/19/2022] [Indexed: 11/24/2022] Open
Abstract
Every day we mentally process new information that needs to be attended, encoded and retrieved. Processing demands depend on the amount of information and the mental attentional capacity of the individual. Research shows that eye movement indices such as peak saccade velocity and blink rate are related to processes of attentional control, however it is still unclear how eye movements are affected by graded changes in task demand. We examine for the first time relations of eye movements to mental attentional tasks with six levels of task demand and two interference conditions. We report data on 57 adults who completed two versions of the color matching task and provided subjective self rating for each mental attentional demand level. Results show that peak saccade velocity and blink rate decrease as a function of mental attentional demand and correlate negatively with self rating of mental effort. Theoretically, new findings related to mental attentional demand and eye movements inform models of visual processing and cognition. Practically, results point to directions for further research to better understand complex relations among eye movements and mental attentional demand in pediatric populations and individuals with cognitive deficits.
Collapse
Affiliation(s)
| | - Marie Arsalidou
- HSE University, Moscow, Russian Federation
- York University, Toronto, Canada
| |
Collapse
|
30
|
Huber SE, Martini M, Sachse P. Patterns of eye blinks are modulated by auditory input in humans. Cognition 2021; 221:104982. [PMID: 34923195 DOI: 10.1016/j.cognition.2021.104982] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2021] [Revised: 11/29/2021] [Accepted: 12/02/2021] [Indexed: 11/16/2022]
Abstract
Previous studies could elaborate a link between attentional processes and eye blinking in both visual and auditory attention tasks. Here we show that this link is active at a fundamental level of perception: presentation of a series of bare sine tones is sufficient to induce a modulation of temporal blink patterns, allowing to determine which series was presented to participants even when they are not required to interactively engage in processing the auditory input. In particular, we monitored eye blinking during an auditory attention task using two series of sine tones, differing in the predictability of the timing of tone onsets. Whereas inter-onset intervals in one tone series corresponded to uncorrelated samples from a normal distribution, they were distributed according to a Gaussian random walk in the other tone series. We find that blink patterns are dynamically modulated by both purely auditory inputs. The magnitude, form, and coherence of the temporal associations between tone onsets and blink events depend strongly on the requirement to respond to the presented stimuli. The predictability of the tone series appears to modulate pre-stimulus blink inhibition given that a response is required. Altogether, these findings suggest eye blink as a readily available, non-invasive behavioral marker for context-sensitive, moment-to-moment allocation of attention.
Collapse
Affiliation(s)
- Stefan E Huber
- Department of Psychology, University of Innsbruck, Innrain 52, 6020 Innsbruck, Austria; Institute for Basic Sciences in Engineering Science, University of Innsbruck, Technikerstraße 13/4, 6020 Innsbruck, Austria.
| | - Markus Martini
- Department of Psychology, University of Innsbruck, Innrain 52, 6020 Innsbruck, Austria
| | - Pierre Sachse
- Department of Psychology, University of Innsbruck, Innrain 52, 6020 Innsbruck, Austria
| |
Collapse
|
31
|
Fang X, Sun Y, Zheng X, Wang X, Deng X, Wang M. Assessing Deception in Questionnaire Surveys With Eye-Tracking. Front Psychol 2021; 12:774961. [PMID: 34880817 PMCID: PMC8646095 DOI: 10.3389/fpsyg.2021.774961] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2021] [Accepted: 10/26/2021] [Indexed: 11/24/2022] Open
Abstract
Deceit often occurs in questionnaire surveys, which leads to the misreporting of data and poor reliability. The purpose of this study is to explore whether eye-tracking could contribute to the detection of deception in questionnaire surveys, and whether the eye behaviors that appeared in instructed lying still exist in spontaneous lying. Two studies were conducted to explore eye movement behaviors in instructed and spontaneous lying conditions. The results showed that pupil size and fixation behaviors are both reliable indicators to detect lies in questionnaire surveys. Blink and saccade behaviors do not seem to predict deception. Deception resulted in increased pupil size, fixation count and duration. Meanwhile, respondents focused on different areas of the questionnaire when lying versus telling the truth. Furthermore, in the actual deception situation, the linear support vector machine (SVM) deception classifier achieved an accuracy of 74.09%. In sum, this study indicates the eye-tracking signatures of lying are not restricted to instructed deception, demonstrates the potential of using eye-tracking to detect deception in questionnaire surveys, and contributes to the questionnaire surveys of sensitive issues.
Collapse
Affiliation(s)
- Xinyue Fang
- School of Mechanical Engineering, Sichuan University, Chengdu, China
| | - Yiteng Sun
- School of Design, South China University of Technology, Guangzhou, China
| | - Xinyi Zheng
- School of Mechanical Engineering, Sichuan University, Chengdu, China
| | - Xinrong Wang
- School of Mechanical Engineering, Sichuan University, Chengdu, China
| | - Xuemei Deng
- School of Mechanical Engineering, Sichuan University, Chengdu, China
| | - Mei Wang
- School of Mechanical Engineering, Sichuan University, Chengdu, China
| |
Collapse
|
32
|
Yuen NH, Tam F, Churchill NW, Schweizer TA, Graham SJ. Driving With Distraction: Measuring Brain Activity and Oculomotor Behavior Using fMRI and Eye-Tracking. Front Hum Neurosci 2021; 15:659040. [PMID: 34483861 PMCID: PMC8415783 DOI: 10.3389/fnhum.2021.659040] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2021] [Accepted: 06/29/2021] [Indexed: 11/13/2022] Open
Abstract
Introduction Driving motor vehicles is a complex task that depends heavily on how visual stimuli are received and subsequently processed by the brain. The potential impact of distraction on driving performance is well known and poses a safety concern - especially for individuals with cognitive impairments who may be clinically unfit to drive. The present study is the first to combine functional magnetic resonance imaging (fMRI) and eye-tracking during simulated driving with distraction, providing oculomotor metrics to enhance scientific understanding of the brain activity that supports driving performance. Materials and Methods As initial work, twelve healthy young, right-handed participants performed turns ranging in complexity, including simple right and left turns without oncoming traffic, and left turns with oncoming traffic. Distraction was introduced as an auditory task during straight driving, and during left turns with oncoming traffic. Eye-tracking data were recorded during fMRI to characterize fixations, saccades, pupil diameter and blink rate. Results Brain activation maps for right turns, left turns without oncoming traffic, left turns with oncoming traffic, and the distraction conditions were largely consistent with previous literature reporting the neural correlates of simulated driving. When the effects of distraction were evaluated for left turns with oncoming traffic, increased activation was observed in areas involved in executive function (e.g., middle and inferior frontal gyri) as well as decreased activation in the posterior brain (e.g., middle and superior occipital gyri). Whereas driving performance remained mostly unchanged (e.g., turn speed, time to turn, collisions), the oculomotor measures showed that distraction resulted in more consistent gaze at oncoming traffic in a small area of the visual scene; less time spent gazing at off-road targets (e.g., speedometer, rear-view mirror); more time spent performing saccadic eye movements; and decreased blink rate. Conclusion Oculomotor behavior modulated with driving task complexity and distraction in a manner consistent with the brain activation features revealed by fMRI. The results suggest that eye-tracking technology should be included in future fMRI studies of simulated driving behavior in targeted populations, such as the elderly and individuals with cognitive complaints - ultimately toward developing better technology to assess and enhance fitness to drive.
Collapse
Affiliation(s)
- Nicole H Yuen
- Department of Medical Biophysics, Faculty of Medicine, University of Toronto, Toronto, ON, Canada.,Physical Sciences Platform, Sunnybrook Research Institute, Toronto, ON, Canada
| | - Fred Tam
- Physical Sciences Platform, Sunnybrook Research Institute, Toronto, ON, Canada
| | - Nathan W Churchill
- Keenan Research Centre for Biomedical Science, St. Michael's Hospital, Toronto, ON, Canada
| | - Tom A Schweizer
- Keenan Research Centre for Biomedical Science, St. Michael's Hospital, Toronto, ON, Canada.,Division of Neurosurgery, St. Michael's Hospital, Toronto, ON, Canada
| | - Simon J Graham
- Department of Medical Biophysics, Faculty of Medicine, University of Toronto, Toronto, ON, Canada.,Physical Sciences Platform, Sunnybrook Research Institute, Toronto, ON, Canada
| |
Collapse
|
33
|
Enders LR, Smith RJ, Gordon SM, Ries AJ, Touryan J. Gaze Behavior During Navigation and Visual Search of an Open-World Virtual Environment. Front Psychol 2021; 12:681042. [PMID: 34434140 PMCID: PMC8380848 DOI: 10.3389/fpsyg.2021.681042] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2021] [Accepted: 06/28/2021] [Indexed: 11/13/2022] Open
Abstract
Eye tracking has been an essential tool within the vision science community for many years. However, the majority of studies involving eye-tracking technology employ a relatively passive approach through the use of static imagery, prescribed motion, or video stimuli. This is in contrast to our everyday interaction with the natural world where we navigate our environment while actively seeking and using task-relevant visual information. For this reason, an increasing number of vision researchers are employing virtual environment platforms, which offer interactive, realistic visual environments while maintaining a substantial level of experimental control. Here, we recorded eye movement behavior while subjects freely navigated through a rich, open-world virtual environment. Within this environment, subjects completed a visual search task where they were asked to find and count occurrence of specific targets among numerous distractor items. We assigned each participant into one of four target conditions: Humvees, motorcycles, aircraft, or furniture. Our results show a statistically significant relationship between gaze behavior and target objects across Target Conditions with increased visual attention toward assigned targets. Specifically, we see an increase in the number of fixations and an increase in dwell time on target relative to distractor objects. In addition, we included a divided attention task to investigate how search changed with the addition of a secondary task. With increased cognitive load, subjects slowed their speed, decreased gaze on objects, and increased the number of objects scanned in the environment. Overall, our results confirm previous findings and support that complex virtual environments can be used for active visual search experimentation, maintaining a high level of precision in the quantification of gaze information and visual attention. This study contributes to our understanding of how individuals search for information in a naturalistic (open-world) virtual environment. Likewise, our paradigm provides an intriguing look into the heterogeneity of individual behaviors when completing an un-timed visual search task while actively navigating.
Collapse
Affiliation(s)
| | | | | | - Anthony J Ries
- DEVCOM Army Research Laboratory, Aberdeen Proving Ground, MD, United States.,Warfighter Effectiveness Research Center, U.S. Air Force Academy, Colorado Springs, CO, United States
| | - Jonathan Touryan
- DEVCOM Army Research Laboratory, Aberdeen Proving Ground, MD, United States
| |
Collapse
|
34
|
D'Agostini M, Burger AM, Franssen M, Claes N, Weymar M, von Leupoldt A, Van Diest I. Effects of transcutaneous auricular vagus nerve stimulation on reversal learning, tonic pupil size, salivary alpha-amylase, and cortisol. Psychophysiology 2021; 58:e13885. [PMID: 34245461 DOI: 10.1111/psyp.13885] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2020] [Revised: 04/26/2021] [Accepted: 05/25/2021] [Indexed: 12/11/2022]
Abstract
This study investigated whether transcutaneous auricular vagus nerve stimulation (taVNS) enhances reversal learning and augments noradrenergic biomarkers (i.e., pupil size, cortisol, and salivary alpha-amylase [sAA]). We also explored the effect of taVNS on respiratory rate and cardiac vagal activity (CVA). Seventy-one participants received stimulation of either the cymba concha (taVNS) or the earlobe (sham) of the left ear. After learning a series of cue-outcome associations, the stimulation was applied before and throughout a reversal phase in which cue-outcome associations were changed for some (reversal), but not for other (distractor) cues. Tonic pupil size, salivary cortisol, sAA, respiratory rate, and CVA were assessed at different time points. Contrary to our hypothesis, taVNS was not associated with an overall improvement in performance on the reversal task. Compared to sham, the taVNS group performed worse for distractor than reversal cues. taVNS did not increase tonic pupil size and sAA. Only post hoc analyses indicated that the cortisol decline was steeper in the sham compared to the taVNS group. Exploratory analyses showed that taVNS decreased respiratory rate but did not affect CVA. The weak and unexpected effects found in this study might relate to the lack of parameters optimization for taVNS and invite to further investigate the effect of taVNS on cortisol and respiratory rate.
Collapse
Affiliation(s)
| | - Andreas M Burger
- Research Group Health Psychology, KU Leuven, Leuven, Belgium.,Laboratory for Biological Psychology, KU Leuven, Leuven, Belgium
| | | | - Nathalie Claes
- Research Group Health Psychology, KU Leuven, Leuven, Belgium
| | - Mathias Weymar
- Department of Biological Psychology and Affective Science, Faculty of Human Sciences, University of Potsdam, Potsdam, Germany.,Faculty of Health Sciences Brandenburg, University of Potsdam, Potsdam, Germany
| | | | - Ilse Van Diest
- Research Group Health Psychology, KU Leuven, Leuven, Belgium
| |
Collapse
|
35
|
Motoki K, Saito T, Onuma T. Eye-tracking research on sensory and consumer science: A review, pitfalls and future directions. Food Res Int 2021; 145:110389. [PMID: 34112392 DOI: 10.1016/j.foodres.2021.110389] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2020] [Revised: 04/11/2021] [Accepted: 05/03/2021] [Indexed: 10/21/2022]
Abstract
Visual processing is a core cognitive element of sensory and consumer science. Consumers visually attend to food types, packaging, label design, advertisements, supermarket shelves, food menus, and other visible information. During the past decade, sensory and consumer science have used eye tracking to elucidate visual processing by consumers. This review paper summarizes earlier findings in terms of bottom-up (i.e., stimulus-driven) processing such as visual salience, size, and top-down (i.e., goal-driven) processing such as goals, task instructions, task complexity, and emotions. Downstream effects of gaze on choice are also reviewed. Pitfalls and future directions of eye-tracking research on sensory and consumer science are also discussed.
Collapse
Affiliation(s)
- Kosuke Motoki
- Department of Food Science and Business, Miyagi University, 2-2-1 Hatatate, Taihaku, Sendai 982-0215, Japan.
| | - Toshiki Saito
- Institute of Development, Aging and Cancer, Tohoku University, 4-1, Seiryo-machi Aoba, Sendai, Japan.
| | - Takuya Onuma
- Department of Management and Business, Faculty of Humanity-oriented Science and Engineering, Kindai University, Fukuoka, Japan.
| |
Collapse
|
36
|
Ocular measures during associative learning predict recall accuracy. Int J Psychophysiol 2021; 166:103-115. [PMID: 34052234 DOI: 10.1016/j.ijpsycho.2021.05.010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2019] [Revised: 05/19/2021] [Accepted: 05/25/2021] [Indexed: 11/20/2022]
Abstract
The ability to form associations between stimuli and commit those associations to memory is a cornerstone of human cognition. Dopamine and noradrenaline are critical neuromodulators implicated in a range of cognitive functions, including learning and memory. Eye blink rate (EBR) and pupil diameter have been shown to index dopaminergic and noradrenergic activity. Here, we examined how these ocular measures relate to accuracy in a paired-associate learning task where participants (N = 73) learned consistent object-location associations over eight trials consisting of pre-trial fixation, encoding, delay, and retrieval epochs. In order to examine how within-subject changes and between-subject changes in ocular metrics related to accuracy, we mean centered individual metric values on each trial based on within-person and across-subject means for each epoch. Within-participant variation in EBR was positively related to accuracy in both encoding and delay epochs: faster EBR within the individual predicted better retrieval. Differences in EBR across participants was negatively related to accuracy in the encoding epoch and in early trials of the pre-trial fixation: faster EBR, relative to other subjects, predicted poorer retrieval. Visual scanning behavior in pre-trial fixation and delay epochs was also positively related to accuracy in early trials: more scanning predicted better retrieval. We found no relationship between pupil diameter and accuracy. These results provide novel evidence supporting the utility of ocular metrics in illuminating cognitive and neurobiological mechanisms of paired-associate learning.
Collapse
|
37
|
Marshev V, Bolloc'h J, Pallamin N, de Bougrenet de la Tocnaye JL, Cochener B, Nourrit V. Impact of virtual reality headset use on eye blinking and lipid layer thickness. J Fr Ophtalmol 2021; 44:1029-1037. [PMID: 34045106 DOI: 10.1016/j.jfo.2020.09.032] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2020] [Accepted: 09/03/2020] [Indexed: 11/17/2022]
Abstract
PURPOSE Blinking plays an important role in protecting the eyes, and the use of computers has been associated with a reduction in the blink rate. The goal of this study was to evaluate the effect of a virtual reality headset on blinking and lipid layer thickness and to compare these data to those associated with a conventional desktop monitor. METHODS Two experiments were performed to compare the effect of 20minutes of use of a virtual reality headset (FOVE) and 20minutes of use of a desktop monitor on the frequency and length of blinks (experiment 1, 15 participants) and on the thickness of the lipid layer as measured by Lipiview (experiment 2, 12 participants). RESULTS In the first experiment, the blink rate [F(1.83)=4.3, P=0.04, β=0.36] and duration [F(1.83)=13, P=0.001, β=0.35] increased with time under both conditions, but no statistical difference was found between the two conditions (headset vs. desktop monitor) either for blink rate [rmANOVA F(1.11)=0.01, P=0.92; headset: 15.1 blinks, 95% CI: 12.6 to 17.6 blinks; desktop: 14.6 blinks, 95% CI: 13.6 to 15.7 blinks] or for blink duration [rmANOVA F(1.11)=4.534, P=0.06; headset: 205.75ms, 95% CI: 200.9 to 210.6ms; desktop: 202.82ms, 95% CI: 198.2 to 207.5ms]. However, strong individual variations were observed. Evaluation of simulator sickness and visual fatigue by questionnaire showed no significant differences between the two conditions (SSQ simulator sickness questionnaire: V=46, P=0.62; VFQ visual fatigue questionnaire: V=15.5, P=0.13). In the second experiment, the lipid layer thickness increased significantly after use of the VR headset [F(1.18)=11.03, P=0.004, headset: 76.2nm, desktop: 58.8nm]. CONCLUSION In terms of recommendations, the effect of virtual reality headsets on blink duration and frequency during a moderate exposure (20minutes) is comparable to that of a conventional desktop monitor. However, the strong individual variations observed, the lack of reliable tests to evaluate this individual sensitivity, and the significant increase in lipid layer thickness in experiment 2 suggest the value of a more detailed investigation, in particular with consideration of a longer exposure time and other tear film parameters.
Collapse
Affiliation(s)
- V Marshev
- Optics department, IMT Atlantique Bretagne-Pays de la Loire, Campus de Brest, Technopôle Brest-Iroise, CS 83818, 29238 Brest cedex 03, France; Laboratoire de Traitement de l'Information Médicale INSERM-UBO UMR 1101, Bâtiment 1, CHRU Morvan, 2, avenue Foch, 29609 Brest cedex, France; UBO, 3, rue des Archives, 29238 Brest, France.
| | - J Bolloc'h
- Optics department, IMT Atlantique Bretagne-Pays de la Loire, Campus de Brest, Technopôle Brest-Iroise, CS 83818, 29238 Brest cedex 03, France; Laboratoire de Traitement de l'Information Médicale INSERM-UBO UMR 1101, Bâtiment 1, CHRU Morvan, 2, avenue Foch, 29609 Brest cedex, France
| | - N Pallamin
- Uses and Acceptability Lab, b-com, 25, rue Claude-Chappe, 29280 Plouzané, France
| | - J-L de Bougrenet de la Tocnaye
- Optics department, IMT Atlantique Bretagne-Pays de la Loire, Campus de Brest, Technopôle Brest-Iroise, CS 83818, 29238 Brest cedex 03, France; Laboratoire de Traitement de l'Information Médicale INSERM-UBO UMR 1101, Bâtiment 1, CHRU Morvan, 2, avenue Foch, 29609 Brest cedex, France
| | - B Cochener
- Service d'ophtalmologie, CHRU Morvan, 2, avenue Foch, 29609 Brest cedex, France
| | - V Nourrit
- Optics department, IMT Atlantique Bretagne-Pays de la Loire, Campus de Brest, Technopôle Brest-Iroise, CS 83818, 29238 Brest cedex 03, France; Laboratoire de Traitement de l'Information Médicale INSERM-UBO UMR 1101, Bâtiment 1, CHRU Morvan, 2, avenue Foch, 29609 Brest cedex, France
| |
Collapse
|
38
|
Zhang S, Yan Z, Sapkota S, Zhao S, Ooi WT. Moment-to-Moment Continuous Attention Fluctuation Monitoring through Consumer-Grade EEG Device. SENSORS (BASEL, SWITZERLAND) 2021; 21:3419. [PMID: 34069027 PMCID: PMC8156270 DOI: 10.3390/s21103419] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/31/2021] [Revised: 04/28/2021] [Accepted: 05/08/2021] [Indexed: 11/16/2022]
Abstract
While numerous studies have explored using various sensing techniques to measure attention states, moment-to-moment attention fluctuation measurement is unavailable. To bridge this gap, we applied a novel paradigm in psychology, the gradual-onset continuous performance task (gradCPT), to collect the ground truth of attention states. GradCPT allows for the precise labeling of attention fluctuation on an 800 ms time scale. We then developed a new technique for measuring continuous attention fluctuation, based on a machine learning approach that uses the spectral properties of EEG signals as the main features. We demonstrated that, even using a consumer grade EEG device, the detection accuracy of moment-to-moment attention fluctuations was 73.49%. Next, we empirically validated our technique in a video learning scenario and found that our technique match with the classification obtained through thought probes, with an average F1 score of 0.77. Our results suggest the effectiveness of using gradCPT as a ground truth labeling method and the feasibility of using consumer-grade EEG devices for continuous attention fluctuation detection.
Collapse
Affiliation(s)
- Shan Zhang
- NUS-HCI Lab, Department of Computer Science, School of Computing, National University of Singapore, Singapore 117417, Singapore; (Z.Y.); (S.S.); (S.Z.)
| | - Zihan Yan
- NUS-HCI Lab, Department of Computer Science, School of Computing, National University of Singapore, Singapore 117417, Singapore; (Z.Y.); (S.S.); (S.Z.)
- College of Computer Science and Technology, Zhejiang University, Hangzhou 310058, China
| | - Shardul Sapkota
- NUS-HCI Lab, Department of Computer Science, School of Computing, National University of Singapore, Singapore 117417, Singapore; (Z.Y.); (S.S.); (S.Z.)
- Division of Science, Yale-NUS College, Singapore 138527, Singapore
| | - Shengdong Zhao
- NUS-HCI Lab, Department of Computer Science, School of Computing, National University of Singapore, Singapore 117417, Singapore; (Z.Y.); (S.S.); (S.Z.)
| | - Wei Tsang Ooi
- National University of Singapore, Singapore 117417, Singapore;
| |
Collapse
|
39
|
Bafna T, Hansen JP. Mental fatigue measurement using eye metrics: A systematic literature review. Psychophysiology 2021; 58:e13828. [PMID: 33825234 DOI: 10.1111/psyp.13828] [Citation(s) in RCA: 24] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2020] [Revised: 02/07/2021] [Accepted: 03/17/2021] [Indexed: 11/30/2022]
Abstract
Mental fatigue measurement techniques utilize one or a combination of the cognitive, affective, and behavioral responses of the body. Eye-tracking and electrooculography, which are used to compute eye-based features, have gained momentum with increases in accuracy and robustness of the lightweight equipment emerging in the markets and can be used for objective and continuous assessment of mental fatigue. The main goal of this systematic review was to summarize the various eye-based features that have been used to measure mental fatigue and explore the relation of eye-based features to mental fatigue. The review process, following the preferred reporting items for systematic reviews and meta-analyses, used the electronic databases Web of Science, Scopus, ACM digital library, IEEE Xplore, and PubMed. Of the 1,385 retrieved documents, 34 studies met the inclusion criteria, resulting in 21 useful eye-based features. Categorizing these into eight groups revealed saccades as the most promising category, with saccade mean and peak velocity providing quick access to the cognitive states within 30 min of fatiguing activity. Complex brain networks involving sympathetic and parasympathetic nervous systems control the relation of mental fatigue to tonic pupil size and have the potential to indicate mental fatigue in controlled experimental conditions. Other categories, like blinks, are derived from the field of sleep research and should be used with caution. Several limitations emerged in the analysis, including varied experimental methods, use of dim lighting during the experiment (that could possibly also induce sleepiness), and use of unclear data analysis techniques, thereby complicating comparisons between studies.
Collapse
Affiliation(s)
- Tanya Bafna
- Department of Technology, Management and Economics, Technical University of Denmark, Kongens Lyngby, Denmark
| | - John Paulin Hansen
- Department of Technology, Management and Economics, Technical University of Denmark, Kongens Lyngby, Denmark
| |
Collapse
|
40
|
Bafna T, Bækgaard P, Hansen JP. Mental fatigue prediction during eye-typing. PLoS One 2021; 16:e0246739. [PMID: 33617541 PMCID: PMC7899326 DOI: 10.1371/journal.pone.0246739] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2020] [Accepted: 01/26/2021] [Indexed: 11/24/2022] Open
Abstract
Mental fatigue is a common problem associated with neurological disorders. Until now, there has not been a method to assess mental fatigue on a continuous scale. Camera-based eye-typing is commonly used for communication by people with severe neurological disorders. We designed a working memory-based eye-typing experiment with 18 healthy participants, and obtained eye-tracking and typing performance data in addition to their subjective scores on perceived effort for every sentence typed and mental fatigue, to create a model of mental fatigue for eye-typing. The features of the model were the eye-based blink frequency, eye height and baseline-related pupil diameter. We predicted subjective ratings of mental fatigue on a six-point Likert scale, using random forest regression, with 22% lower mean absolute error than using simulations. When additionally including task difficulty (i.e. the difficulty of the sentences typed) as a feature, the variance explained by the model increased by 9%. This indicates that task difficulty plays an important role in modelling mental fatigue. The results demonstrate the feasibility of objective and non-intrusive measurement of fatigue on a continuous scale.
Collapse
Affiliation(s)
- Tanya Bafna
- Department of Management, Technology and Economics, Technical University of Denmark, Kongens Lyngby, Capital Region of Denmark, Denmark
- * E-mail:
| | - Per Bækgaard
- Department of Applied Mathematics and Computer Science, Technical University of Denmark, Kongens Lyngby, Capital Region of Denmark, Denmark
| | - John Paulin Hansen
- Department of Management, Technology and Economics, Technical University of Denmark, Kongens Lyngby, Capital Region of Denmark, Denmark
| |
Collapse
|
41
|
McGovern JE, Masucci MD, Le TP, Cohen AS. The (b)link between amotivation and psychosis: Insights through phasic eye blink rate. Psychiatry Res 2020; 294:113490. [PMID: 33038790 DOI: 10.1016/j.psychres.2020.113490] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/14/2020] [Accepted: 09/26/2020] [Indexed: 10/23/2022]
Abstract
Motivation deficits within Schizophrenia Spectrum Disorders (SSDs) are associated with abnormal striatal dopamine responses during reward processing. Eye blink rate (EBR) has been used as a proxy for striatal dopamine; however, it is unclear whether EBR is sensitive to individual differences in amotivation. Amotivation (clinician-rated and self-reported) and EBR during an effort-based reward task were assessed in 28 outpatients with SSDs. EBR was lower during more "active" task phases relative to rest periods. Higher EBR during reward anticipation was associated with lower self-reported, but not clinician-rated, motivation. These preliminary results support a task-engagement, rather than striatal dopamine, account of EBR.
Collapse
Affiliation(s)
- Jessica E McGovern
- Department of Psychology, Louisiana State University, United States; Department of Psychiatry and Biobehavioral Sciences, David Geffen School of Medicine, University of California, Los Angeles, United States; Desert Pacific Mental Illness Research, Education, and Clinical Center, VA Greater Los Angeles Healthcare System, United States.
| | - Michael D Masucci
- Department of Psychology, Louisiana State University, United States; Center for Computation and Technology, Louisiana State University, United States
| | - Thanh P Le
- Department of Psychology, Louisiana State University, United States
| | - Alex S Cohen
- Department of Psychology, Louisiana State University, United States; Center for Computation and Technology, Louisiana State University, United States
| |
Collapse
|
42
|
Tanwear A, Liang X, Liu Y, Vuckovic A, Ghannam R, Bohnert T, Paz E, Freitas PP, Ferreira R, Heidari H. Spintronic Sensors Based on Magnetic Tunnel Junctions for Wireless Eye Movement Gesture Control. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2020; 14:1299-1310. [PMID: 32991289 DOI: 10.1109/tbcas.2020.3027242] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
The tracking of eye gesture movements using wearable technologies can undoubtedly improve quality of life for people with mobility and physical impairments by using spintronic sensors based on the tunnel magnetoresistance (TMR) effect in a human-machine interface. Our design involves integrating three TMR sensors on an eyeglass frame for detecting relative movement between the sensor and tiny magnets embedded in an in-house fabricated contact lens. Using TMR sensors with the sensitivity of 11 mV/V/Oe and ten <1 mm3 embedded magnets within a lens, an eye gesture system was implemented with a sampling frequency of up to 28 Hz. Three discrete eye movements were successfully classified when a participant looked up, right or left using a threshold-based classifier. Moreover, our proof-of-concept real-time interaction system was tested on 13 participants, who played a simplified Tetris game using their eye movements. Our results show that all participants were successful in completing the game with an average accuracy of 90.8%.
Collapse
|
43
|
Briefer Freymond S, Beuret S, Ruet A, Zuberbühler K, Bachmann I, Briefer E. Stereotypic behaviour in horses lowers stress but not spatial learning performance. Appl Anim Behav Sci 2020. [DOI: 10.1016/j.applanim.2020.105099] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/08/2023]
|
44
|
Stawarczyk D, François C, Wertz J, D'Argembeau A. Drowsiness or mind-wandering? Fluctuations in ocular parameters during attentional lapses. Biol Psychol 2020; 156:107950. [PMID: 32871227 DOI: 10.1016/j.biopsycho.2020.107950] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2019] [Revised: 11/05/2019] [Accepted: 08/24/2020] [Indexed: 11/29/2022]
Abstract
Two independent lines of evidence suggest that drowsiness and mind-wandering share common neurocognitive processes indexed by ocular parameters (e.g., eyeblink frequency and pupil dynamics). Mind-wandering and drowsiness frequently co-occur, however, such that it remains unclear whether observed oculometric variations are related to mind-wandering, drowsiness, or a mix of both. To address this issue, we assessed fluctuations in mind-wandering and sleepiness during a sustained attention task while ocular parameters were recorded. Results showed that oculometric variations during mind-wandering were fully explained by increased sleepiness. However, mind-wandering and sleepiness had additive deleterious effects on performance that were not fully explained by ocular parameters. These findings suggest that oculometric variations during task performance reflect increased drowsiness rather than processes specifically involved in mind-wandering, and that the neurocognitive processes indexed by oculometric parameters (e.g., regulatory processes of the locus coeruleus norepinephrine system) do not fully explain how mind-wandering and sleepiness cause attentional lapses.
Collapse
Affiliation(s)
- David Stawarczyk
- Department of Psychology, Psychology and Neuroscience of Cognition Research Unit, University of Liège, 4000, Liège, Belgium.
| | | | | | - Arnaud D'Argembeau
- Department of Psychology, Psychology and Neuroscience of Cognition Research Unit, University of Liège, 4000, Liège, Belgium; GIGA-CRC In Vivo Imaging, University of Liège, 4000, Liège, Belgium
| |
Collapse
|
45
|
Magliacano A, Fiorenza S, Estraneo A, Trojano L. Eye blink rate increases as a function of cognitive load during an auditory oddball paradigm. Neurosci Lett 2020; 736:135293. [PMID: 32771601 DOI: 10.1016/j.neulet.2020.135293] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2020] [Revised: 05/08/2020] [Accepted: 08/03/2020] [Indexed: 01/21/2023]
Abstract
Previous evidence suggests that changes in spontaneous eye blink rate (EBR) in human adults might reflect the amount of attentional demand (i.e. cognitive load) during cognitive tasks. However, the actual direction of this relation is uncertain, since most studies investigated the role of cognitive load on EBR by employing visual tasks only. Here we aimed at elucidating the relationship between EBR and cognitive load in non-visual tasks. Sixteen healthy participants performed two auditory oddball tasks, i.e. passive listening to auditory tones versus active counting of target tones; each oddball task was immediately followed by a rest phase. Throughout the oddball tasks we assessed EBR and recorded the P300 on ERPs as an electrophysiological measure of attention. The results showed that participants' EBR increased during the active task compared to the respective rest phase. Amplitude and latency of the P300 too differed between passive and active tasks, but changes in EBR and P300 features were not correlated with each other. Our findings demonstrated that an increase in cognitive load is associated with an increase in EBR in cognitive tasks not involving visual attention. These findings are consistent with previous evidence suggesting shared neurobiological bases between attention and EBR.
Collapse
Affiliation(s)
- Alfonso Magliacano
- Department of Psychology, University of Campania "Luigi Vanvitelli", Caserta, Italy.
| | - Salvatore Fiorenza
- Istituti Clinici Scientifici Maugeri IRCCS, SB S.p.A., Laboratorio di Valutazione Multimodale dei Disordini della Coscienza, Telese Terme BN, Italy
| | | | - Luigi Trojano
- Department of Psychology, University of Campania "Luigi Vanvitelli", Caserta, Italy
| |
Collapse
|
46
|
Maffei A. Spectrally resolved EEG intersubject correlation reveals distinct cortical oscillatory patterns during free‐viewing of affective scenes. Psychophysiology 2020; 57:e13652. [DOI: 10.1111/psyp.13652] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2020] [Revised: 06/08/2020] [Accepted: 07/06/2020] [Indexed: 01/10/2023]
Affiliation(s)
- Antonio Maffei
- Department of General Psychology University of Padua Padua Italy
| |
Collapse
|
47
|
Maffei A, Polver S, Spironelli C, Angrilli A. EEG gamma activity to emotional movies in individuals with high traits of primary "successful" psychopathy. Brain Cogn 2020; 143:105599. [PMID: 32652444 DOI: 10.1016/j.bandc.2020.105599] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2020] [Revised: 06/26/2020] [Accepted: 06/28/2020] [Indexed: 12/22/2022]
Abstract
This study aimed to investigate emotional alterations in a community sample with primary psychopathic traits. Sixty males selected from a larger sample and divided in two groups, High (HP) and Low (LP) primary Psychopathy, watched 15 validated emotional movies divided in five categories (Erotic, Neutral, Fear, and the new Scenery and Compassion). Subjective responses and cortical activity in the EEG Gamma band (30-49 Hz) were recorded. Concerning self-reports, HP participants felt less anxious and anguished in response to Fear clips and less sad, touched and anguished by Compassion excerpts. Negative clips induced larger EEG Gamma activity in both groups compared to neutral and erotic movies, but Gamma activity to Fear movies was reduced in HP. This group showed also a small cortical response to positive Scenery movies, at the level of the Neutral ones. Source analysis showed in HP participants a reduced cortical activation to Fear in a large brain network, comprising the right prefrontal and temporal cortices and bilateral inferior parietal cortex. Results showed that primary psychopathy, in addition to the impaired response to Fear, was associated with a reduced response also to other specific categories of emotional stimuli, suggesting an altered affect on a broader scale.
Collapse
Affiliation(s)
- Antonio Maffei
- Department of General Psychology, University of Padova, Via Venezia 8, 35131 Padova, Italy
| | - Silvia Polver
- Department of General Psychology, University of Padova, Via Venezia 8, 35131 Padova, Italy
| | - Chiara Spironelli
- Department of General Psychology, University of Padova, Via Venezia 8, 35131 Padova, Italy; PNC - Padova Neuroscience Center, University of Padova, Via Orus 2, 35131 Padova, Italy
| | - Alessandro Angrilli
- Department of General Psychology, University of Padova, Via Venezia 8, 35131 Padova, Italy; IN CNR Institute of Neuroscience, Padova Section, Viale Colombo 3, 35131 Padova, Italy; PNC - Padova Neuroscience Center, University of Padova, Via Orus 2, 35131 Padova, Italy.
| |
Collapse
|
48
|
Attention Optimization Method for EEG via the TGAM. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2020; 2020:6427305. [PMID: 32655682 PMCID: PMC7320284 DOI: 10.1155/2020/6427305] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/27/2020] [Accepted: 05/07/2020] [Indexed: 12/01/2022]
Abstract
Since the 21st century, noninvasive brain-computer interface (BCI) has developed rapidly, and brain-computer devices have gradually moved from the laboratory to the mass market. Among them, the TGAM (ThinkGear Asic Module) and its encapsulate algorithm have been adopted by many research teams and faculty members around the world. However, due to the limited development cost, the effectiveness of the algorithm to calculate data is not satisfactory. This paper proposes an attention optimization algorithm based on the TGAM for EEG data feedback. Considering that the data output of the TGAM encapsulate algorithm fluctuates greatly, the delay is high and the accuracy is low. The experimental results demonstrated that our algorithm can optimize EEG data, so that with the same or even lower delay and without changing the encapsulate algorithm of the module itself, it can significantly improve the performance of attention data, greatly improve the stability and accuracy of data, and achieve better results in practical applications.
Collapse
|
49
|
Rejer I, Cieszyński Ł. RVEB—An algorithm for recognizing voluntary eye blinks based on the signal recorded from prefrontal EEG channels. Biomed Signal Process Control 2020. [DOI: 10.1016/j.bspc.2020.101876] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
50
|
Liu J, Li J, Liang H, Cui F, Wang W, Huang J, Peng G, Huang W, Wang Y, He K, Pan Q, He J. Is the Glasses-Free 3-Dimensional Display System More Effective for Complex Video-Assisted Thoracic Surgery? A Self-Controlled Study Ex Vivo. Surg Innov 2019; 26:712-719. [PMID: 31296133 DOI: 10.1177/1553350619853136] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Objective. Considering the demerits of a high-definition 2-dimensional (HD-2D) system, with its lack of stereopsis, and a conventional 3-dimensional (C-3D) system, which results in a dimmed image, we have recently developed a glasses-free 3-dimensional (GF-3D) display system for reconstruction surgeries such as video-assisted thoracic surgery (VATS) for tracheal reconstruction. Methods. Thoracic surgeons were invited to complete thoracoscopic continuous suture of a transected porcine trachea using the HD-2D, C-3D, and GF-3D systems on separate mornings in randomized order. The duration, numbers of stitches, and distance between every 2 stitches were recorded for every procedure. The surgeons' spontaneous eye blink rate was recorded for 5 minutes before the procedure and the last 5 minutes of the procedure. Results. Fifteen volunteers successfully completed the tracheal reconstruction procedures in this study. Both C-3D (0.403 ± 0.064 stitch/min, P < .001) and GF-3D (0.427 ± 0.079 stitch/min, P < .001) showed significant advantages in speed compared with HD-2D (0.289 ± 0.065 stitch/min). Both C-3D (2.536 ± 2.223 mm, P < .001) and GF-3D (2.603 ± 2.159 mm, P < .001) showed significant advantages in accuracy compared with HD-2D (3.473 ± 3.403 mm). Both HD-2D (1.240 ± 0.642, P < .001) and GF-3D (1.307 ± 0.894, P < .001) showed significant advantages in eye fatigue compared with C-3D (3.333 ± 1.44). Conclusions. All 3 available display systems are efficient for complex VATS. With the help of stereopsis, surgeons can achieve faster operation using C-3D and GF-3D systems in a thoracoscopic simulated setting. GF-3D may be a more effective display system for VATS reconstruction in terms of speed, accuracy, and eye fatigue during operations.
Collapse
Affiliation(s)
- Jun Liu
- The First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China.,Guangzhou Institute of Respiratory Health (GIRH), Guangzhou, China.,State Key Laboratory of Respiratory Disease, National Clinical Research Center for Respiratory Diseases, Guangzhou, China
| | - Jingpei Li
- The First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China.,Guangzhou Institute of Respiratory Health (GIRH), Guangzhou, China.,State Key Laboratory of Respiratory Disease, National Clinical Research Center for Respiratory Diseases, Guangzhou, China
| | - Hengrui Liang
- The First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China.,Guangzhou Institute of Respiratory Health (GIRH), Guangzhou, China.,State Key Laboratory of Respiratory Disease, National Clinical Research Center for Respiratory Diseases, Guangzhou, China
| | - Fei Cui
- The First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China.,Guangzhou Institute of Respiratory Health (GIRH), Guangzhou, China.,State Key Laboratory of Respiratory Disease, National Clinical Research Center for Respiratory Diseases, Guangzhou, China
| | - Wei Wang
- The First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China.,Guangzhou Institute of Respiratory Health (GIRH), Guangzhou, China.,State Key Laboratory of Respiratory Disease, National Clinical Research Center for Respiratory Diseases, Guangzhou, China
| | - Jun Huang
- The First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China.,Guangzhou Institute of Respiratory Health (GIRH), Guangzhou, China.,State Key Laboratory of Respiratory Disease, National Clinical Research Center for Respiratory Diseases, Guangzhou, China
| | - Guilin Peng
- The First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China.,Guangzhou Institute of Respiratory Health (GIRH), Guangzhou, China.,State Key Laboratory of Respiratory Disease, National Clinical Research Center for Respiratory Diseases, Guangzhou, China
| | - Weizhe Huang
- The First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China.,Guangzhou Institute of Respiratory Health (GIRH), Guangzhou, China.,State Key Laboratory of Respiratory Disease, National Clinical Research Center for Respiratory Diseases, Guangzhou, China
| | - Yidong Wang
- The First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Kaiming He
- The Affiliated Hospital of Southwest Medical University, Luzhou, China
| | - Qi Pan
- The Affiliated Tumor Hospital of Guangxi Medical University, Nanning, China
| | - Jianxing He
- The First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China.,Guangzhou Institute of Respiratory Health (GIRH), Guangzhou, China.,State Key Laboratory of Respiratory Disease, National Clinical Research Center for Respiratory Diseases, Guangzhou, China
| |
Collapse
|