1
|
Gunther KE, Fu X, MacNeill LA, Jones M, Ermanni B, Pérez-Edgar K. Now it's your turn!: Eye blink rate in a Jenga task modulated by interaction of task wait times, effortful control, and internalizing behaviors. PLoS One 2024; 19:e0294888. [PMID: 38457390 PMCID: PMC10923458 DOI: 10.1371/journal.pone.0294888] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2022] [Accepted: 11/10/2023] [Indexed: 03/10/2024] Open
Abstract
Dopamine is a versatile neurotransmitter with implications in many domains, including anxiety and effortful control. Where high levels of effortful control are often regarded as adaptive, other work suggests that high levels of effortful control may be a risk factor for anxiety. Dopamine signaling may be key in understanding these relations. Eye blink rate is a non-invasive proxy metric of midbrain dopamine activity. However, much work with eye blink rate has been constrained to screen-based tasks which lack in ecological validity. We tested whether changes in eye blink rate during a naturalistic effortful control task differ as a function of parent-reported effortful control and internalizing behaviors. Children played a Jenga-like game with an experimenter, but for each trial the experimenter took an increasingly long time to take their turn. Blinks-per-second were computed during each wait period. Multilevel modeling examined the relation between duration of wait period, effortful control, and internalizing behaviors on eye blink rate. We found a significant 3-way interaction between effortful control, internalizing behaviors, and duration of the wait period. Probing this interaction revealed that for children with low reported internalizing behaviors (-1 SD) and high reported effortful control (+1 SD), eye blink rate significantly decreased as they waited longer to take their turn. These findings index task-related changes in midbrain dopamine activity in relation to naturalistic task demands, and that these changes may vary as a function of individual differences in effortful control and internalizing behaviors. We discuss possible top-down mechanisms that may underlie these differences.
Collapse
Affiliation(s)
- Kelley E. Gunther
- Department of Psychology, Yale University, New Haven, CT, United States of America
| | - Xiaoxue Fu
- Department of Psychology, The University of South Carolina, Columbia, SC, United States of America
| | - Leigha A. MacNeill
- Northwestern University Feinberg School of Medicine, Chicago, IL, United States of America
| | - Morgan Jones
- Department of Human Development and Quantitative Methodology, University of Maryland, College Park, MD, United States of America
| | - Briana Ermanni
- Department of Psychology, Virginia Tech, Blacksburg, VA, United States of America
| | - Koraly Pérez-Edgar
- Department of Psychology, The Pennsylvania State University, State College, PA, United States of America
| |
Collapse
|
2
|
Wyly S, Jinon N, Francis T, Evans H, Kao TL, Lambert S, Montgomery S, Newlove M, Mariscal H, Nguyen H, Cole H, Aispuro I, Robledo D, Tenaglia O, Weinberger N, Nguyen B, Waits H, Jorian D, Koch-Kreher L, Myrdal H, Antoniou V, Warrier M, Wunsch L, Arce I, Kirchner K, Campos E, Nguyen A, Rodriguez K, Cao L, Halmekangas A, Wilson RC. The psychophysiology of Mastermind: Characterizing response times and blinking in a high-stakes television game show. Psychophysiology 2024; 61:e14485. [PMID: 37966011 DOI: 10.1111/psyp.14485] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2023] [Revised: 10/20/2023] [Accepted: 10/21/2023] [Indexed: 11/16/2023]
Abstract
Television game shows have proven to be a valuable resource for studying human behavior under conditions of high stress and high stakes. However, previous work has focused mostly on choices-ignoring much of the rich visual information that is available on screen. Here, we take a first step to extracting more of this information by investigating the response times and blinking of contestants in the BBC show Mastermind. In Mastermind, contestants answer rapid-fire quiz questions while a camera slowly zooms in on their faces. By labeling contestants' behavior and blinks from 25 episodes, we asked how accuracy, response times, and blinking varied over the course of the game. For accuracy and response times, we tested whether contestants responded more accurately and more slowly after an error-exhibiting the "post-error increase in accuracy" and "post-error slowing" which has been repeatedly observed in the lab. For blinking, we tested whether blink rates varied according to the cognitive demands of the game-decreasing during periods of cognitive load, such as when pondering a response, and increasing at event boundaries in the task, such as the start of a question. In contrast to the lab, evidence for post-error changes in accuracy and response time was weak, with only marginal effects observed. In line with the lab, blinking varied over the course of the game much as we predicted. Overall, our findings demonstrate the potential of extracting dynamic signals from game shows to study the psychophysiology of behavior in the real world.
Collapse
Affiliation(s)
- Skyler Wyly
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Neryanne Jinon
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Timothy Francis
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Hailey Evans
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Tsai Lieh Kao
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Shelby Lambert
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Shayne Montgomery
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Marvelene Newlove
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Haley Mariscal
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Henry Nguyen
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Harrison Cole
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Israel Aispuro
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Daniela Robledo
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Olivia Tenaglia
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Nina Weinberger
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Bill Nguyen
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Hailey Waits
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Daisy Jorian
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Lucas Koch-Kreher
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Hunter Myrdal
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Victoria Antoniou
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Meghana Warrier
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Leah Wunsch
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Iram Arce
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Kayla Kirchner
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Elena Campos
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - An Nguyen
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | | | - Lanqin Cao
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Avery Halmekangas
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Robert C Wilson
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
- McKnight Brain Research Foundation, University of Arizona, Tucson, Arizona, USA
- Cognitive Science Program, University of Arizona, Tucson, Arizona, USA
| |
Collapse
|
3
|
Page C, Liu CC, Meltzer J, Ghosh Hajra S. Blink-Related Oscillations Provide Naturalistic Assessments of Brain Function and Cognitive Workload within Complex Real-World Multitasking Environments. SENSORS (BASEL, SWITZERLAND) 2024; 24:1082. [PMID: 38400241 PMCID: PMC10892680 DOI: 10.3390/s24041082] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/14/2023] [Revised: 01/14/2024] [Accepted: 01/30/2024] [Indexed: 02/25/2024]
Abstract
BACKGROUND There is a significant need to monitor human cognitive performance in complex environments, with one example being pilot performance. However, existing assessments largely focus on subjective experiences (e.g., questionnaires) and the evaluation of behavior (e.g., aircraft handling) as surrogates for cognition or utilize brainwave measures which require artificial setups (e.g., simultaneous auditory stimuli) that intrude on the primary tasks. Blink-related oscillations (BROs) are a recently discovered neural phenomenon associated with spontaneous blinking that can be captured without artificial setups and are also modulated by cognitive loading and the external sensory environment-making them ideal for brain function assessment within complex operational settings. METHODS Electroencephalography (EEG) data were recorded from eight adult participants (five F, M = 21.1 years) while they completed the Multi-Attribute Task Battery under three different cognitive loading conditions. BRO responses in time and frequency domains were derived from the EEG data, and comparisons of BRO responses across cognitive loading conditions were undertaken. Simultaneously, assessments of blink behavior were also undertaken. RESULTS Blink behavior assessments revealed decreasing blink rate with increasing cognitive load (p < 0.001). Prototypical BRO responses were successfully captured in all participants (p < 0.001). BRO responses reflected differences in task-induced cognitive loading in both time and frequency domains (p < 0.05). Additionally, reduced pre-blink theta band desynchronization with increasing cognitive load was also observed (p < 0.05). CONCLUSION This study confirms the ability of BRO responses to capture cognitive loading effects as well as preparatory pre-blink cognitive processes in anticipation of the upcoming blink during a complex multitasking situation. These successful results suggest that blink-related neural processing could be a potential avenue for cognitive state evaluation in operational settings-both specialized environments such as cockpits, space exploration, military units, etc. and everyday situations such as driving, athletics, human-machine interactions, etc.-where human cognition needs to be seamlessly monitored and optimized.
Collapse
Affiliation(s)
- Cleo Page
- Division of Engineering Science, University of Toronto, Toronto, ON M5S 2E4, Canada
| | - Careesa Chang Liu
- Department of Biomedical Engineering and Science, Florida Institute of Technology, 150 W University Boulevard, Melbourne, FL 32901, USA;
| | - Jed Meltzer
- Baycrest Health Sciences, Toronto, ON M6A 2E1, Canada
| | - Sujoy Ghosh Hajra
- Department of Biomedical Engineering and Science, Florida Institute of Technology, 150 W University Boulevard, Melbourne, FL 32901, USA;
| |
Collapse
|
4
|
Murali S, Händel B. Spontaneous Eye Blinks Map the Probability of Perceptual Reinterpretation During Visual and Auditory Ambiguity. Cogn Sci 2024; 48:e13414. [PMID: 38320109 DOI: 10.1111/cogs.13414] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2023] [Revised: 01/10/2024] [Accepted: 01/27/2024] [Indexed: 02/08/2024]
Abstract
Spontaneous eye blinks are modulated around perceptual events. Our previous study, using a visual ambiguous stimulus, indicated that blink probability decreases before a reported perceptual switch. In the current study, we tested our hypothesis that an absence of blinks marks a time in which perceptual switches are facilitated in- and outside the visual domain. In three experiments, presenting either a visual motion quartet in light or darkness or a bistable auditory streaming stimulus, we found a co-occurrence of blink rate reduction with increased perceptual switch probability. In the visual domain, perceptual switches induced by a short interruption of visual input (blank) allowed an estimate of the timing of the perceptual event with respect to the motor response. This provided the first evidence that the blink reduction was not a consequence of the perceptual switch. Importantly, by showing that the time between switches and the previous blink was significantly longer than the inter-blink interval, our studies allowed to conclude that perceptual switches did not happen at random but followed a prolonged period of nonblinking. Correspondingly, blink rate and switch rate showed an inverse relationship. Our study supports the idea that the absence or presence of blinks maps perceptual processes independent of the sensory modality.
Collapse
Affiliation(s)
| | - Barbara Händel
- Institute of Psychology III, University of Würzburg
- Department of Neurology, University Hospital Würzburg
| |
Collapse
|
5
|
Kim BH, Yang H, Yoo MC. Usefulness of the Blink Reflex in Diagnosing Isolated Infraorbital Neuropathy Following Midface Augmentation with AlloPlastic Facial Implants: A Case Report. LIFE (BASEL, SWITZERLAND) 2022; 12:life12081122. [PMID: 35892924 PMCID: PMC9394420 DOI: 10.3390/life12081122] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/12/2022] [Revised: 07/25/2022] [Accepted: 07/25/2022] [Indexed: 11/16/2022]
Abstract
For the preoperative evaluation of infraorbital nerve injury, most clinicians depend on the patient’s subjective symptoms or judgements, lacking a generalized and objective evaluation method. Due to the limitations in subjective evaluations for accurate diagnosis of infraorbital nerve injury, we used the blink reflex to objectively evaluate injury to the infraorbital nerve. A 49-year-old female, who had previously undergone midface augmentation with alloplastic implants, presented with sensory loss in the left upper lip, nose tip, and lower palatal area. Physical examination revealed sensation loss in the area innervated by the infraorbital nerve. Facial three-dimensional computed tomography did not identify compression of the infraorbital nerve. The blink reflex study of the infraorbital nerve was evaluated preoperatively. After the patient was diagnosed with injury along the infraorbital nerve pathway from alloplastic facial implants, she underwent facial implant removal with decompression surgery. The patient experienced a significant decrease in hypoesthesia, and her sensory function improved. The blink reflex study was an effective method to objectively diagnose infraorbital neuropathy. Therefore, clinical use of the blink reflex study as an electrophysiological diagnostic tool is recommended to investigate infraorbital nerve injuries.
Collapse
Affiliation(s)
- Byoung Hoon Kim
- Department of Physical Medicine & Rehabilitation, College of Medicine, Kyung Hee University, Seoul 02447, Korea; (B.H.K.); (H.Y.)
| | - Haseon Yang
- Department of Physical Medicine & Rehabilitation, College of Medicine, Kyung Hee University, Seoul 02447, Korea; (B.H.K.); (H.Y.)
| | - Myung Chul Yoo
- Department of Physical Medicine & Rehabilitation, College of Medicine, Kyung Hee University, Seoul 02447, Korea; (B.H.K.); (H.Y.)
- Department of Medicine, Graduate School, Kyung Hee University, Seoul 02447, Korea
- Correspondence: ; Tel.: +82-2-958-8980; Fax: +82-2-958-8470
| |
Collapse
|
6
|
Mat B, Sanz L, Arzi A, Boly M, Laureys S, Gosseries O. New behavioral signs of consciousness in patients with severe brain injuries. Semin Neurol 2022; 42:259-272. [PMID: 35738292 DOI: 10.1055/a-1883-0861] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2022]
Affiliation(s)
- Beril Mat
- Neurology, University of Wisconsin-Madison, Madison, United States.,Coma Science Group, University of Liege, Liege, Belgium
| | - Leandro Sanz
- Coma Science Group, University of Liege, Liege, Belgium
| | - Anat Arzi
- The Hebrew University of Jerusalem Department of Cognitive and Brain Sciences, Jerusalem, Israel
| | - Melanie Boly
- Neurology, University of Wisconsin-Madison, Madison, United States.,Psychiatry, University of Wisconsin-Madison, Madison, United States
| | | | | |
Collapse
|
7
|
Paśko W, Zadarko E, Krzeszowski T, Przednowek K. Relationship between Eye Blink Frequency and Incremental Exercise among Young Healthy Men. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:ijerph19074362. [PMID: 35410042 PMCID: PMC8998332 DOI: 10.3390/ijerph19074362] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/18/2022] [Revised: 03/31/2022] [Accepted: 04/01/2022] [Indexed: 11/16/2022]
Abstract
The aim of the study was to verify the correlation between the frequency of blinking and aerobic physical exercise. The research subjects were 13 healthy man aged 23.3 ± 1 year. Measurements of the blink rate and eye closure times were performed during a progressive aerobic test on a cycle ergometer. During the test, power was gradually increased every minute by 25 W, starting from 50 W. Data acquisition involved using a GoPro camera mounted to the helmet of the research subject. The test continued until the research subject refused to continue. The subjects did not know the goal of the test, in order to ensure objectivity and obtain natural results. The largest number of statistically significant differences was observed between the initial stages and 250 W, as well as between 250 W and 325 W. The analysis showed no significant differences in blink rate, eye closure time, and single blink time in terms of heart rate ranges. Regression models were also determined for eye closure time, blink frequency, and single blink time. The analysis showed that blink frequency and eye closure time were determined by a group of factors (the value of cycle ergometer load power, heart rate, body weight, adipose tissue mass, fat-free mass, and total body water and body surface ratio).
Collapse
Affiliation(s)
- Wojciech Paśko
- Institute of Physical Culture Sciences, Medical College of Rzeszow University, Rzeszow University, 35-959 Rzeszow, Poland; (W.P.); (E.Z.)
| | - Emilian Zadarko
- Institute of Physical Culture Sciences, Medical College of Rzeszow University, Rzeszow University, 35-959 Rzeszow, Poland; (W.P.); (E.Z.)
| | - Tomasz Krzeszowski
- Faculty of Electrical and Computer Engineering, Rzeszow University of Technology, Al. Powstancow Warszawy 12, 35-959 Rzeszow, Poland;
| | - Krzysztof Przednowek
- Institute of Physical Culture Sciences, Medical College of Rzeszow University, Rzeszow University, 35-959 Rzeszow, Poland; (W.P.); (E.Z.)
- Correspondence:
| |
Collapse
|
8
|
Nilsson EJ, Bärgman J, Ljung Aust M, Matthews G, Svanberg B. Let Complexity Bring Clarity: A Multidimensional Assessment of Cognitive Load Using Physiological Measures. FRONTIERS IN NEUROERGONOMICS 2022; 3:787295. [PMID: 38235474 PMCID: PMC10790847 DOI: 10.3389/fnrgo.2022.787295] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/30/2021] [Accepted: 01/07/2022] [Indexed: 01/19/2024]
Abstract
The effects of cognitive load on driver behavior and traffic safety are unclear and in need of further investigation. Reliable measures of cognitive load for use in research and, subsequently, in the development and implementation of driver monitoring systems are therefore sought. Physiological measures are of interest since they can provide continuous recordings of driver state. Currently, however, a few issues related to their use in this context are not usually taken into consideration, despite being well-known. First, cognitive load is a multidimensional construct consisting of many mental responses (cognitive load components) to added task demand. Yet, researchers treat it as unidimensional. Second, cognitive load does not occur in isolation; rather, it is part of a complex response to task demands in a specific operational setting. Third, physiological measures typically correlate with more than one mental state, limiting the inferences that can be made from them individually. We suggest that acknowledging these issues and studying multiple mental responses using multiple physiological measures and independent variables will lead to greatly improved measurability of cognitive load. To demonstrate the potential of this approach, we used data from a driving simulator study in which a number of physiological measures (heart rate, heart rate variability, breathing rate, skin conductance, pupil diameter, eye blink rate, eye blink duration, EEG alpha power, and EEG theta power) were analyzed. Participants performed a cognitively loading n-back task at two levels of difficulty while driving through three different traffic scenarios, each repeated four times. Cognitive load components and other coinciding mental responses were assessed by considering response patterns of multiple physiological measures in relation to multiple independent variables. With this approach, the construct validity of cognitive load is improved, which is important for interpreting results accurately. Also, the use of multiple measures and independent variables makes the measurements (when analyzed jointly) more diagnostic-that is, better able to distinguish between different cognitive load components. This in turn improves the overall external validity. With more detailed, diagnostic, and valid measures of cognitive load, the effects of cognitive load on traffic safety can be better understood, and hence possibly mitigated.
Collapse
Affiliation(s)
- Emma J. Nilsson
- Volvo Cars Safety Centre, Volvo Car Corporation, Gothenburg, Sweden
- Department of Mechanics and Maritime Sciences, Chalmers University of Technology, Gothenburg, Sweden
| | - Jonas Bärgman
- Department of Mechanics and Maritime Sciences, Chalmers University of Technology, Gothenburg, Sweden
| | | | - Gerald Matthews
- Department of Psychology, George Mason University, Fairfax, VA, United States
| | - Bo Svanberg
- Volvo Cars Safety Centre, Volvo Car Corporation, Gothenburg, Sweden
| |
Collapse
|
9
|
Spontaneous eye blinking as a diagnostic marker in prolonged disorders of consciousness. Sci Rep 2021; 11:22393. [PMID: 34789832 PMCID: PMC8599689 DOI: 10.1038/s41598-021-01858-3] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2021] [Accepted: 11/01/2021] [Indexed: 11/26/2022] Open
Abstract
Clinical diagnosis of patients with prolonged disorders of consciousness is very challenging. As spontaneous eye blink rate (EBR) is reliably correlated with cognitive activity in healthy individuals, we investigated whether EBR could serve as a marker of patients' level of consciousness. We assessed ten patients in prolonged Vegetative State/Unresponsive Wakefulness Syndrome (VS/UWS; three females; mean age = 50.3 ± 17.8 years) and fourteen patients in Minimally Conscious State (MCS; three females; mean age = 52.9 ± 17.5 years) at their admission to a rehabilitation unit after the acute phase. During two separate 3-min rest conditions, we recorded patients' EBR by integrating on-line visual and off-line electro-oculographic count. We also assessed EBR during two auditory oddball tasks, i.e. passive listening and active counting of target tones in a sub-group of patients. EBR was significantly higher in MCS than in VS/UWS; moreover, EBR positively correlated with a validated index of responsiveness derived from the Coma Recovery Scale-Revised. Patients' mean EBR showed no significant differences within sessions and across experimental conditions of the oddball task, in both VS/UWS and MCS. Our findings suggest that, at least in the post-acute phase, observing patients' EBR for 3 min at rest could help to discriminate between VS/UWS and MCS, improving accuracy of clinical diagnosis.
Collapse
|
10
|
Enders LR, Smith RJ, Gordon SM, Ries AJ, Touryan J. Gaze Behavior During Navigation and Visual Search of an Open-World Virtual Environment. Front Psychol 2021; 12:681042. [PMID: 34434140 PMCID: PMC8380848 DOI: 10.3389/fpsyg.2021.681042] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2021] [Accepted: 06/28/2021] [Indexed: 11/13/2022] Open
Abstract
Eye tracking has been an essential tool within the vision science community for many years. However, the majority of studies involving eye-tracking technology employ a relatively passive approach through the use of static imagery, prescribed motion, or video stimuli. This is in contrast to our everyday interaction with the natural world where we navigate our environment while actively seeking and using task-relevant visual information. For this reason, an increasing number of vision researchers are employing virtual environment platforms, which offer interactive, realistic visual environments while maintaining a substantial level of experimental control. Here, we recorded eye movement behavior while subjects freely navigated through a rich, open-world virtual environment. Within this environment, subjects completed a visual search task where they were asked to find and count occurrence of specific targets among numerous distractor items. We assigned each participant into one of four target conditions: Humvees, motorcycles, aircraft, or furniture. Our results show a statistically significant relationship between gaze behavior and target objects across Target Conditions with increased visual attention toward assigned targets. Specifically, we see an increase in the number of fixations and an increase in dwell time on target relative to distractor objects. In addition, we included a divided attention task to investigate how search changed with the addition of a secondary task. With increased cognitive load, subjects slowed their speed, decreased gaze on objects, and increased the number of objects scanned in the environment. Overall, our results confirm previous findings and support that complex virtual environments can be used for active visual search experimentation, maintaining a high level of precision in the quantification of gaze information and visual attention. This study contributes to our understanding of how individuals search for information in a naturalistic (open-world) virtual environment. Likewise, our paradigm provides an intriguing look into the heterogeneity of individual behaviors when completing an un-timed visual search task while actively navigating.
Collapse
Affiliation(s)
| | | | | | - Anthony J Ries
- DEVCOM Army Research Laboratory, Aberdeen Proving Ground, MD, United States.,Warfighter Effectiveness Research Center, U.S. Air Force Academy, Colorado Springs, CO, United States
| | - Jonathan Touryan
- DEVCOM Army Research Laboratory, Aberdeen Proving Ground, MD, United States
| |
Collapse
|
11
|
Shahbakhti M, Beiramvand M, Rejer I, Augustyniak P, Broniec-Wojcik A, Wierzchon M, Marozas V. Simultaneous Eye Blink Characterization and Elimination from Low-Channel Prefrontal EEG Signals Enhances Driver Drowsiness Detection. IEEE J Biomed Health Inform 2021; 26:1001-1012. [PMID: 34260361 DOI: 10.1109/jbhi.2021.3096984] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
OBJECTIVE Blink-related features derived from electroencephalography (EEG) have recently arisen as a meaningful measure of drivers cognitive state. Combined with band power features of low-channel prefrontal EEG data, blink-derived features enhance the detection of driver drowsiness. Yet, it remains unanswered whether synergy of combined blink and EEG band power features for the detection of driver drowsiness may be further boosted if a proper eye blink removal is also applied before EEG analysis. This paper proposes an algorithm for simultaneous eye blink feature extraction and elimination from low-channel prefrontal EEG data. METHODS Firstly, eye blink intervals (EBIs) are identified from the Fp1 EEG channel using variational mode extraction, and then blink-related features are derived. Secondly, the identified EBIs are projected to the rest of EEG channels and then filtered by a combination of principal component analysis and discrete wavelet transform. Thirdly, a support vector machine with 10-fold cross-validation is employed to classify alert and drowsy states from the derived blink and filtered EEG band power features. MAIN RESULTS When compared the synergy of eye blink and EEG features before and after filtering by the proposed algorithm, a significant improvement in the mean accuracy of driver drowsiness detection was achieved (71.2% vs. 78.1%, p<0.05). SIGNIFICANCE This paper validates a novel view of eye blinks as both a source of information and artifacts in EEG-based driver drowsiness detection.
Collapse
|
12
|
Sciaraffa N, Borghini G, Di Flumeri G, Cincotti F, Babiloni F, Aricò P. Joint Analysis of Eye Blinks and Brain Activity to Investigate Attentional Demand during a Visual Search Task. Brain Sci 2021; 11:brainsci11050562. [PMID: 33925209 PMCID: PMC8146019 DOI: 10.3390/brainsci11050562] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2021] [Revised: 04/23/2021] [Accepted: 04/27/2021] [Indexed: 12/26/2022] Open
Abstract
In several fields, the need for a joint analysis of brain activity and eye activity to investigate the association between brain mechanisms and manifest behavior has been felt. In this work, two levels of attentional demand, elicited through a conjunction search task, have been modelled in terms of eye blinks, brain activity, and brain network features. Moreover, the association between endogenous neural mechanisms underlying attentional demand and eye blinks, without imposing a time-locked structure to the analysis, has been investigated. The analysis revealed statistically significant spatial and spectral modulations of the recorded brain activity according to the different levels of attentional demand, and a significant reduction in the number of eye blinks when a higher amount of attentional investment was required. Besides, the integration of information coming from high-density electroencephalography (EEG), brain source localization, and connectivity estimation allowed us to merge spectral and causal information between brain areas, characterizing a comprehensive model of neurophysiological processes behind attentional demand. The analysis of the association between eye and brain-related parameters revealed a statistically significant high correlation (R > 0.7) of eye blink rate with anterofrontal brain activity at 8 Hz, centroparietal brain activity at 12 Hz, and a significant moderate correlation with the participation of right Intra Parietal Sulcus in alpha band (R = -0.62). Due to these findings, this work suggests the possibility of using eye blinks measured from one sensor placed on the forehead as an unobtrusive measure correlating with neural mechanisms underpinning attentional demand.
Collapse
Affiliation(s)
- Nicolina Sciaraffa
- Department of Molecular Medicine, Sapienza University of Rome, Piazzale Aldo Moro 5, 00185 Rome, Italy; (G.B.); (G.D.F.); (F.B.); (P.A.)
- Correspondence:
| | - Gianluca Borghini
- Department of Molecular Medicine, Sapienza University of Rome, Piazzale Aldo Moro 5, 00185 Rome, Italy; (G.B.); (G.D.F.); (F.B.); (P.A.)
- BrainSigns srl, Lungotevere Michelangelo 9, 00192 Rome, Italy
- IRCCS Fondazione Santa Lucia, Neuroelectrical Imaging and BCI Lab, Via Ardeatina 306, 00179 Rome, Italy;
| | - Gianluca Di Flumeri
- Department of Molecular Medicine, Sapienza University of Rome, Piazzale Aldo Moro 5, 00185 Rome, Italy; (G.B.); (G.D.F.); (F.B.); (P.A.)
- BrainSigns srl, Lungotevere Michelangelo 9, 00192 Rome, Italy
| | - Febo Cincotti
- IRCCS Fondazione Santa Lucia, Neuroelectrical Imaging and BCI Lab, Via Ardeatina 306, 00179 Rome, Italy;
- Department of Computer, Control, and Management Engineering “Antonio Ruberti”, Sapienza University of Rome, Via Ariosto 25, 00185 Rome, Italy
| | - Fabio Babiloni
- Department of Molecular Medicine, Sapienza University of Rome, Piazzale Aldo Moro 5, 00185 Rome, Italy; (G.B.); (G.D.F.); (F.B.); (P.A.)
- BrainSigns srl, Lungotevere Michelangelo 9, 00192 Rome, Italy
- College of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou 310005, China
| | - Pietro Aricò
- Department of Molecular Medicine, Sapienza University of Rome, Piazzale Aldo Moro 5, 00185 Rome, Italy; (G.B.); (G.D.F.); (F.B.); (P.A.)
- BrainSigns srl, Lungotevere Michelangelo 9, 00192 Rome, Italy
| |
Collapse
|