1
|
Scharinger C. Task-irrelevant decorative pictures increase cognitive load during text processing but have no effects on learning or working memory performance: an EEG and eye-tracking study. PSYCHOLOGICAL RESEARCH 2024; 88:1362-1388. [PMID: 38502229 PMCID: PMC11142986 DOI: 10.1007/s00426-024-01939-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2021] [Accepted: 02/08/2024] [Indexed: 03/21/2024]
Abstract
Decorative pictures (DP) are often used in multimedia task materials and are commonly considered so-called seductive details as they are commonly not task-relevant. Typically, DP result in mixed effects on behavioral performance measures. The current study focused on the effects of DP on the cognitive load during text reading and working memory task performance. The theta and alpha frequency band power of the electroencephalogram (EEG) and pupil dilation served as proxies of cognitive load. The number of fixations, mean fixation durations, and the number of transitions served as proxies of the attentional focus. For both, text reading and n-back working memory tasks, the presence and congruency of DP were manipulated in four task conditions. DP did neither affect behavioral performance nor subjective ratings of emotional-motivational factors. However, in both tasks, DP increased the cognitive load as revealed by the EEG alpha frequency band power and (at least to some extent) by subjective effort ratings. Notably, the EEG alpha frequency band power was a quite reliable and sensitive proxy of cognitive load. Analyzing the EEG data stimulus-locked and fixation-related, the EEG alpha frequency band power revealed a difference in global and local cognitive load. In sum, the current study underlines the feasibility and use of EEG for multimedia research, especially when combined with eye-tracking.
Collapse
Affiliation(s)
- Christian Scharinger
- Leibniz-Institut für Wissensmedien Tübingen, Schleichstr. 6, 72076, Tübingen, Germany.
| |
Collapse
|
2
|
Ibragimov B, Mello-Thoms C. The Use of Machine Learning in Eye Tracking Studies in Medical Imaging: A Review. IEEE J Biomed Health Inform 2024; 28:3597-3612. [PMID: 38421842 DOI: 10.1109/jbhi.2024.3371893] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/02/2024]
Abstract
Machine learning (ML) has revolutionized medical image-based diagnostics. In this review, we cover a rapidly emerging field that can be potentially significantly impacted by ML - eye tracking in medical imaging. The review investigates the clinical, algorithmic, and hardware properties of the existing studies. In particular, it evaluates 1) the type of eye-tracking equipment used and how the equipment aligns with study aims; 2) the software required to record and process eye-tracking data, which often requires user interface development, and controller command and voice recording; 3) the ML methodology utilized depending on the anatomy of interest, gaze data representation, and target clinical application. The review concludes with a summary of recommendations for future studies, and confirms that the inclusion of gaze data broadens the ML applicability in Radiology from computer-aided diagnosis (CAD) to gaze-based image annotation, physicians' error detection, fatigue recognition, and other areas of potentially high research and clinical impact.
Collapse
|
3
|
Wei Y, Lee C, Han S, Kim A. Enhancing visual communication through representation learning. Front Neurosci 2024; 18:1368733. [PMID: 38859924 PMCID: PMC11163107 DOI: 10.3389/fnins.2024.1368733] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2024] [Accepted: 04/17/2024] [Indexed: 06/12/2024] Open
Abstract
Introduction This research aims to address the challenges in model construction for the Extended Mind for the Design of the Human Environment. Specifically, we employ the ResNet-50, LSTM, and Object Tracking Algorithms approaches to achieve collaborative construction of high-quality virtual assets, image optimization, and intelligent agents, providing users with a virtual universe experience in the context of visual communication. Methods Firstly, we utilize ResNet-50 as a convolutional neural network model for generating virtual assets, including objects, characters, and environments. By training and fine-tuning ResNet-50, we can generate virtual elements with high realism and rich diversity. Next, we use LSTM (Long Short-Term Memory) for image processing and analysis of the generated virtual assets. LSTM can capture contextual information in image sequences and extract/improve the details and appearance of the images. By applying LSTM, we further enhance the quality and realism of the generated virtual assets. Finally, we adopt Object Tracking Algorithms to track and analyze the movement and behavior of virtual entities within the virtual environment. Object Tracking Algorithms enable us to accurately track the positions and trajectories of objects, characters, and other elements, allowing for realistic interactions and dynamic responses. Results and discussion By integrating the technologies of ResNet-50, LSTM, and Object Tracking Algorithms, we can generate realistic virtual assets, optimize image details, track and analyze virtual entities, and train intelligent agents, providing users with a more immersive and interactive visual communication-driven metaverse experience. These innovative solutions have important applications in the Extended Mind for the Design of the Human Environment, enabling the creation of more realistic and interactive virtual worlds.
Collapse
Affiliation(s)
- YuHan Wei
- Dankook University, Yongin-si, Gyeonggi-do, Republic of Korea
| | | | | | | |
Collapse
|
4
|
Jonas M, Kerwer M, Stoll M, Benz G, Chasiotis A. Equivalent user experience and improved community augmented meta-analyses knowledge for a new version of a Plain Language Summary guideline. PLoS One 2024; 19:e0300675. [PMID: 38722870 PMCID: PMC11081257 DOI: 10.1371/journal.pone.0300675] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2023] [Accepted: 03/01/2024] [Indexed: 05/13/2024] Open
Abstract
Plain Language Summaries (PLS) offer a promising solution to make meta-analytic psychological research more accessible for non-experts and laypeople. However, existing writing guidelines for this type of publication are seldom grounded in empirical studies. To address this and to test two versions of a new PLS guideline, we investigated the impact of PLSs of psychological meta-analyses on laypeoples' PLS-related knowledge and their user experience (accessibility, understanding, empowerment). In a preregistered online-study, N = 2,041 German-speaking participants read two PLSs. We varied the inclusion of a disclaimer on PLS authorship, a statement on the causality of effects, additional information on community augmented meta-analyses (CAMA) and the PLS guideline version. Results partially confirmed our preregistered hypotheses: Participants answered knowledge items on CAMA more correctly when a PLS contained additional information on CAMA, and there were no user experience differences between the old and the new guideline versions. Unexpectedly, a priori hypotheses regarding improved knowledge via the use of a disclaimer and a causality statement were not confirmed. Reasons for this, as well as general aspects related to science communication via PLSs aimed at educating laypeople, are discussed.
Collapse
Affiliation(s)
- Mark Jonas
- Leibniz Institute for Psychology (ZPID), Trier, Germany
| | - Martin Kerwer
- Leibniz Institute for Psychology (ZPID), Trier, Germany
| | - Marlene Stoll
- Leibniz Institute for Psychology (ZPID), Trier, Germany
| | - Gesa Benz
- Leibniz Institute for Psychology (ZPID), Trier, Germany
| | | |
Collapse
|
5
|
Ambarchi Z, Boulton KA, Thapa R, Arciuli J, DeMayo MM, Hickie IB, Thomas EE, Guastella AJ. Social and joint attention during shared book reading in young autistic children: a potential marker for social development. J Child Psychol Psychiatry 2024. [PMID: 38659350 DOI: 10.1111/jcpp.13993] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 02/16/2024] [Indexed: 04/26/2024]
Abstract
BACKGROUND Atypical patterns of social engagement and joint attention behaviors are diagnostic criteria for people with autism spectrum disorder. Experimental tasks using eye-tracking methodologies have, however, shown inconsistent results. The development of tasks with greater ecological validity and relevance for developmentally appropriate social milestones has been identified as important for the field. METHODS We developed a novel, dynamic eye-tracking task emulating a shared book reading (SBR) scenario. Four SBR videos of an adult reader engaging with the viewer while reading a children's picture book and including sequenced bids for joint attention were developed. Participants included 90 children (N = 56 autistic children, N = 34 neurotypical children; aged 3-12). Social attention was also measured in a live free play task between participants and an experimenter. RESULTS Compared to neurotypical children, autistic children displayed reduced attention to socially salient stimuli including the reader's face and picture book across SBR videos and during joint attention bids specifically. In contrast, they showed increased attention to nonsalient background stimuli compared to their neurotypical peers. These attention patterns in autistic children were associated with reduced verbal and nonverbal cognitive skills and increased symptoms associated with autism. Interestingly, positive correlations in the frequency of eye gaze between SBR and free play suggested a potential predictive value for social attention in live social interactions. CONCLUSIONS Findings highlight the utility of SBR eye-tracking tasks in understanding underlying divergences in social engagement and joint attention between autistic and neurotypical children. This commonly practiced early childhood activity may provide insights into the relationship between social engagement and learning to reveal how such attentional patterns might influence broader developmental and educational outcomes.
Collapse
Affiliation(s)
- Zahava Ambarchi
- Clinic for Autism and Neurodevelopment Research (CAN Research), Brain and Mind Centre, Sydney Children's Hospital Westmead Clinical School, Faculty of Medicine and Health, The University of Sydney, Camperdown, New South Wales, Australia
| | - Kelsie A Boulton
- Clinic for Autism and Neurodevelopment Research (CAN Research), Brain and Mind Centre, Sydney Children's Hospital Westmead Clinical School, Faculty of Medicine and Health, The University of Sydney, Camperdown, New South Wales, Australia
| | - Rinku Thapa
- Clinic for Autism and Neurodevelopment Research (CAN Research), Brain and Mind Centre, Sydney Children's Hospital Westmead Clinical School, Faculty of Medicine and Health, The University of Sydney, Camperdown, New South Wales, Australia
| | - Joanne Arciuli
- Caring Futures Institute, College of Nursing and Health Sciences, Flinders University, Adelaide, South Australia, Australia
| | - Marilena M DeMayo
- Clinic for Autism and Neurodevelopment Research (CAN Research), Brain and Mind Centre, Sydney Children's Hospital Westmead Clinical School, Faculty of Medicine and Health, The University of Sydney, Camperdown, New South Wales, Australia
| | - Ian B Hickie
- Clinic for Autism and Neurodevelopment Research (CAN Research), Brain and Mind Centre, Sydney Children's Hospital Westmead Clinical School, Faculty of Medicine and Health, The University of Sydney, Camperdown, New South Wales, Australia
| | - Emma E Thomas
- Clinic for Autism and Neurodevelopment Research (CAN Research), Brain and Mind Centre, Sydney Children's Hospital Westmead Clinical School, Faculty of Medicine and Health, The University of Sydney, Camperdown, New South Wales, Australia
| | - Adam J Guastella
- Clinic for Autism and Neurodevelopment Research (CAN Research), Brain and Mind Centre, Sydney Children's Hospital Westmead Clinical School, Faculty of Medicine and Health, The University of Sydney, Camperdown, New South Wales, Australia
| |
Collapse
|
6
|
Huang C, Shi N, Miao Y, Chen X, Wang Y, Gao X. Visual tracking brain-computer interface. iScience 2024; 27:109376. [PMID: 38510138 PMCID: PMC10951983 DOI: 10.1016/j.isci.2024.109376] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2023] [Revised: 01/25/2024] [Accepted: 02/27/2024] [Indexed: 03/22/2024] Open
Abstract
Brain-computer interfaces (BCIs) offer a way to interact with computers without relying on physical movements. Non-invasive electroencephalography-based visual BCIs, known for efficient speed and calibration ease, face limitations in continuous tasks due to discrete stimulus design and decoding methods. To achieve continuous control, we implemented a novel spatial encoding stimulus paradigm and devised a corresponding projection method to enable continuous modulation of decoded velocity. Subsequently, we conducted experiments involving 17 participants and achieved Fitt's information transfer rate (ITR) of 0.55 bps for the fixed tracking task and 0.37 bps for the random tracking task. The proposed BCI with a high Fitt's ITR was then integrated into two applications, including painting and gaming. In conclusion, this study proposed a visual BCI based-control method to go beyond discrete commands, allowing natural continuous control based on neural activity.
Collapse
Affiliation(s)
- Changxing Huang
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing 100084, China
| | - Nanlin Shi
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing 100084, China
| | - Yining Miao
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing 100084, China
| | - Xiaogang Chen
- Institute of Biomedical Engineering, Chinese Academy of Medical Sciences and Peking Union Medical College, Tianjin 300192, China
| | - Yijun Wang
- State Key Laboratory on Integrated Optoelectronics, Institute of Semiconductors, Chinese Academy of Sciences Beijing, Beijing 100083, China
| | - Xiaorong Gao
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing 100084, China
| |
Collapse
|
7
|
Huang K, Zhao T, Sun W, Feng L, Wang Q, Feng J. Memory deficit in patients with cerebral small vessel disease: evidence from eye tracking technology. Cereb Cortex 2024; 34:bhae138. [PMID: 38602738 DOI: 10.1093/cercor/bhae138] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2024] [Revised: 03/14/2024] [Accepted: 03/16/2024] [Indexed: 04/12/2024] Open
Abstract
Cerebral small vessel disease is the one of the most prevalent causes of vascular cognitive impairment. We aimed to find objective and process-based indicators related to memory function to assist in the detection of memory impairment in patients with cerebral small vessel disease. Thirty-nine cerebral small vessel disease patients and 22 healthy controls were invited to complete neurological examinations, neuropsychological assessments, and eye tracking tasks. Eye tracking indicators were recorded and analyzed in combination with imaging features. The cerebral small vessel disease patients scored lower on traditional memory task and performed worse on eye tracking memory task performance compared to the healthy controls. The cerebral small vessel disease patients exhibited longer visit duration and more visit count within areas of interest and targets and decreased percentage value of total visit duration on target images to total visit duration on areas of interest during decoding stage among all levels. Our results demonstrated the cerebral small vessel disease patients performed worse in memory scale and eye tracking memory task, potentially due to their heightened attentional allocation to nontarget images during the retrieval stage. The eye tracking memory task could provide process-based indicators to be a beneficial complement to memory assessment and new insights into mechanism of memory impairment in cerebral small vessel disease patients.
Collapse
Affiliation(s)
- Kailing Huang
- Department of Neurology, Xiangya Hospital, Central South University, No. 87, Xiangya Road, Kaifu District, Changsha 410008, Hunan Province, P.R. China
- National Clinical Research Center for Geriatric Disorders, Xiangya Hospital, Central South University, No. 87, Xiangya Road, Kaifu District, Changsha 410008, Hunan Province, P.R. China
| | - Tingting Zhao
- Department of Neurology, Xiangya Hospital, Central South University, No. 87, Xiangya Road, Kaifu District, Changsha 410008, Hunan Province, P.R. China
- National Clinical Research Center for Geriatric Disorders, Xiangya Hospital, Central South University, No. 87, Xiangya Road, Kaifu District, Changsha 410008, Hunan Province, P.R. China
| | - Weifeng Sun
- Key Laboratory of Biomedical Spectroscopy of Xi'an, Xi'an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, No. 17, Information Avenue, New Industrial Park, High-tech Zone, Xi'an 710119, Shaanxi Province, P.R. China
- Key Laboratory of Spectral Imaging Technology, Xi'an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, No. 17, Information Avenue, New Industrial Park, High-tech Zone, Xi'an 710119, Shaanxi Province, P.R. China
- University of Chinese Academy of Sciences, No. 1, Yanqihu East Road, Huairou District, Beijing 101408, P.R. China
| | - Li Feng
- Department of Neurology, Xiangya Hospital, Central South University, No. 87, Xiangya Road, Kaifu District, Changsha 410008, Hunan Province, P.R. China
- National Clinical Research Center for Geriatric Disorders, Xiangya Hospital, Central South University, No. 87, Xiangya Road, Kaifu District, Changsha 410008, Hunan Province, P.R. China
| | - Quan Wang
- Key Laboratory of Biomedical Spectroscopy of Xi'an, Xi'an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, No. 17, Information Avenue, New Industrial Park, High-tech Zone, Xi'an 710119, Shaanxi Province, P.R. China
- Key Laboratory of Spectral Imaging Technology, Xi'an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, No. 17, Information Avenue, New Industrial Park, High-tech Zone, Xi'an 710119, Shaanxi Province, P.R. China
| | - Jie Feng
- Department of Neurology, Xiangya Hospital, Central South University, No. 87, Xiangya Road, Kaifu District, Changsha 410008, Hunan Province, P.R. China
- National Clinical Research Center for Geriatric Disorders, Xiangya Hospital, Central South University, No. 87, Xiangya Road, Kaifu District, Changsha 410008, Hunan Province, P.R. China
| |
Collapse
|
8
|
Puladi B, Coldewey B, Volmerg JS, Grunert K, Berens J, Rashad A, Hölzle F, Röhrig R, Lipprandt M. Improving detection of oral lesions: Eye tracking insights from a randomized controlled trial comparing standardized to conventional approach. Head Neck 2024. [PMID: 38454656 DOI: 10.1002/hed.27687] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2023] [Revised: 11/23/2023] [Accepted: 02/05/2024] [Indexed: 03/09/2024] Open
Abstract
BACKGROUND Early detection of oral cancer (OC) or its precursors is the most effective measure to improve outcome. The reasons for missing them on conventional oral examination (COE) or possible countermeasures are still unclear. METHODS In this randomized controlled trial, we investigated the effects of standardized oral examination (SOE) compared to COE. 49 dentists, specialists, and dental students wearing an eye tracker had to detect 10 simulated oral lesions drawn into a volunteer's oral cavity. RESULTS SOE had a higher detection rate at 85.4% sensitivity compared to 78.8% in the control (p = 0.017) due to higher completeness (p < 0.001). Detection rate correlated with examination duration (p = 0.002). CONCLUSIONS A standardized approach can improve systematics and thereby detection rates in oral examinations. It should take at least 5 min. Perceptual and cognitive errors and improper technique cause oral lesions to be missed. Its wide implementation could be an additional strategy to enhance early detection of OC.
Collapse
Affiliation(s)
- Behrus Puladi
- Department of Oral and Maxillofacial Surgery, University Hospital RWTH Aachen, Aachen, Germany
- Institute of Medical Informatics, Medical Faculty, RWTH Aachen University, Aachen, Germany
| | - Beatrice Coldewey
- Institute of Medical Informatics, Medical Faculty, RWTH Aachen University, Aachen, Germany
| | - Julia S Volmerg
- Institute of Medical Informatics, Medical Faculty, RWTH Aachen University, Aachen, Germany
| | - Kim Grunert
- Department of Oral and Maxillofacial Surgery, University Hospital RWTH Aachen, Aachen, Germany
- Institute of Medical Informatics, Medical Faculty, RWTH Aachen University, Aachen, Germany
| | - Jeff Berens
- Department of Oral and Maxillofacial Surgery, University Hospital RWTH Aachen, Aachen, Germany
| | - Ashkan Rashad
- Department of Oral and Maxillofacial Surgery, University Hospital RWTH Aachen, Aachen, Germany
| | - Frank Hölzle
- Department of Oral and Maxillofacial Surgery, University Hospital RWTH Aachen, Aachen, Germany
| | - Rainer Röhrig
- Institute of Medical Informatics, Medical Faculty, RWTH Aachen University, Aachen, Germany
| | - Myriam Lipprandt
- Institute of Medical Informatics, Medical Faculty, RWTH Aachen University, Aachen, Germany
| |
Collapse
|
9
|
Kalhan S, Schwartenbeck P, Hester R, Garrido MI. People with a tobacco use disorder exhibit misaligned Bayesian belief updating by falsely attributing non-drug cues as worse predictors of positive outcomes compared to drug cues. Drug Alcohol Depend 2024; 256:111109. [PMID: 38354476 DOI: 10.1016/j.drugalcdep.2024.111109] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/05/2023] [Revised: 01/15/2024] [Accepted: 01/19/2024] [Indexed: 02/16/2024]
Abstract
Adaptive behaviours depend on dynamically updating internal representations of the world based on the ever-changing environmental contingencies. People with a substance use disorder (pSUD) show maladaptive behaviours with high persistence in drug-taking, despite severe negative consequences. We recently proposed a salience misattribution model for addiction (SMMA; Kalhan et al., 2021), arguing that pSUD have aberrations in their updating processes where drug cues are misattributed as strong predictors of positive outcomes, but weaker predictors of negative outcomes. We also argued that conversely, non-drug cues are misattributed as weak predictors of positive outcomes, but stronger predictors of negative outcomes. We tested these hypotheses using a multi-cue reversal learning task, with reversals in whether drug or non-drug cues are relevant in predicting the outcome (monetary win or loss). We show that people with a tobacco use disorder (pTUD), do form misaligned internal representations. We found that pTUD updated less towards learning the drug cue's relevance in predicting a loss. Further, when neither drug nor non-drug cue predicted a win, pTUD updated more towards the drug cue being relevant predictors of that win. Our Bayesian belief updating model revealed that pTUD had a low estimated likelihood of non-drug cues being predictors of wins, compared to drug cues, which drove the misaligned updating. Overall, several hypotheses of the SMMA were supported, but not all. Our results implicate that strengthening the non-drug cue association with positive outcomes may help restore the misaligned internal representation in pTUD, and offers a quantifiable, computational account of these updating processes.
Collapse
Affiliation(s)
- Shivam Kalhan
- The University of Melbourne, Melbourne School of Psychological Sciences, Melbourne, VIC, Australia.
| | - Philipp Schwartenbeck
- Max Planck Institute for Biological Cybernetics, Tübingen, Baden-Württemberg, Germany; University of Tübingen, Tübingen, Germany
| | - Robert Hester
- The University of Melbourne, Melbourne School of Psychological Sciences, Melbourne, VIC, Australia
| | - Marta I Garrido
- The University of Melbourne, Melbourne School of Psychological Sciences, Melbourne, VIC, Australia; Graeme Clark Institute for Biomedical Engineering, Melbourne, VIC, Australia
| |
Collapse
|
10
|
Zhao Q, Ye Z, Deng Y, Chen J, Chen J, Liu D, Ye X, Huan C. An advance in novel intelligent sensory technologies: From an implicit-tracking perspective of food perception. Compr Rev Food Sci Food Saf 2024; 23:e13327. [PMID: 38517017 DOI: 10.1111/1541-4337.13327] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2023] [Revised: 02/19/2024] [Accepted: 03/01/2024] [Indexed: 03/23/2024]
Abstract
Food sensory evaluation mainly includes explicit and implicit measurement methods. Implicit measures of consumer perception are gaining significant attention in food sensory and consumer science as they provide effective, subconscious, objective analysis. A wide range of advanced technologies are now available for analyzing physiological and psychological responses, including facial analysis technology, neuroimaging technology, autonomic nervous system technology, and behavioral pattern measurement. However, researchers in the food field often lack systematic knowledge of these multidisciplinary technologies and struggle with interpreting their results. In order to bridge this gap, this review systematically describes the principles and highlights the applications in food sensory and consumer science of facial analysis technologies such as eye tracking, facial electromyography, and automatic facial expression analysis, as well as neuroimaging technologies like electroencephalography, magnetoencephalography, functional magnetic resonance imaging, and functional near-infrared spectroscopy. Furthermore, we critically compare and discuss these advanced implicit techniques in the context of food sensory research and then accordingly propose prospects. Ultimately, we conclude that implicit measures should be complemented by traditional explicit measures to capture responses beyond preference. Facial analysis technologies offer a more objective reflection of sensory perception and attitudes toward food, whereas neuroimaging techniques provide valuable insight into the implicit physiological responses during food consumption. To enhance the interpretability and generalizability of implicit measurement results, further sensory studies are needed. Looking ahead, the combination of different methodological techniques in real-life situations holds promise for consumer sensory science in the field of food research.
Collapse
Affiliation(s)
- Qian Zhao
- College of Biosystems Engineering and Food Science, National-Local Joint Engineering Research Center of Intelligent Food Technology and Equipment, Fuli Institute of Food Science, Zhejiang Key Laboratory for Agro-Food Processing, Zhejiang International Scientific and Technological Cooperation Base of Health Food Manufacturing and Quality Control, Zhejiang University, Hangzhou, China
- Innovation Center of Yangtze River Delta, Zhejiang University, Jiaxing, China
| | - Zhiyue Ye
- College of Biosystems Engineering and Food Science, National-Local Joint Engineering Research Center of Intelligent Food Technology and Equipment, Fuli Institute of Food Science, Zhejiang Key Laboratory for Agro-Food Processing, Zhejiang International Scientific and Technological Cooperation Base of Health Food Manufacturing and Quality Control, Zhejiang University, Hangzhou, China
- Innovation Center of Yangtze River Delta, Zhejiang University, Jiaxing, China
| | - Yong Deng
- College of Biosystems Engineering and Food Science, National-Local Joint Engineering Research Center of Intelligent Food Technology and Equipment, Fuli Institute of Food Science, Zhejiang Key Laboratory for Agro-Food Processing, Zhejiang International Scientific and Technological Cooperation Base of Health Food Manufacturing and Quality Control, Zhejiang University, Hangzhou, China
- Innovation Center of Yangtze River Delta, Zhejiang University, Jiaxing, China
| | - Jin Chen
- College of Biosystems Engineering and Food Science, National-Local Joint Engineering Research Center of Intelligent Food Technology and Equipment, Fuli Institute of Food Science, Zhejiang Key Laboratory for Agro-Food Processing, Zhejiang International Scientific and Technological Cooperation Base of Health Food Manufacturing and Quality Control, Zhejiang University, Hangzhou, China
| | - Jianle Chen
- College of Biosystems Engineering and Food Science, National-Local Joint Engineering Research Center of Intelligent Food Technology and Equipment, Fuli Institute of Food Science, Zhejiang Key Laboratory for Agro-Food Processing, Zhejiang International Scientific and Technological Cooperation Base of Health Food Manufacturing and Quality Control, Zhejiang University, Hangzhou, China
- Zhongyuan Institute, Zhejiang University, Zhengzhou, China
- Ningbo Innovation Center, Zhejiang University, Ningbo, China
| | - Donghong Liu
- College of Biosystems Engineering and Food Science, National-Local Joint Engineering Research Center of Intelligent Food Technology and Equipment, Fuli Institute of Food Science, Zhejiang Key Laboratory for Agro-Food Processing, Zhejiang International Scientific and Technological Cooperation Base of Health Food Manufacturing and Quality Control, Zhejiang University, Hangzhou, China
- Innovation Center of Yangtze River Delta, Zhejiang University, Jiaxing, China
- Zhongyuan Institute, Zhejiang University, Zhengzhou, China
- Ningbo Innovation Center, Zhejiang University, Ningbo, China
| | - Xingqian Ye
- College of Biosystems Engineering and Food Science, National-Local Joint Engineering Research Center of Intelligent Food Technology and Equipment, Fuli Institute of Food Science, Zhejiang Key Laboratory for Agro-Food Processing, Zhejiang International Scientific and Technological Cooperation Base of Health Food Manufacturing and Quality Control, Zhejiang University, Hangzhou, China
- Zhongyuan Institute, Zhejiang University, Zhengzhou, China
- Ningbo Innovation Center, Zhejiang University, Ningbo, China
| | - Cheng Huan
- College of Biosystems Engineering and Food Science, National-Local Joint Engineering Research Center of Intelligent Food Technology and Equipment, Fuli Institute of Food Science, Zhejiang Key Laboratory for Agro-Food Processing, Zhejiang International Scientific and Technological Cooperation Base of Health Food Manufacturing and Quality Control, Zhejiang University, Hangzhou, China
- Innovation Center of Yangtze River Delta, Zhejiang University, Jiaxing, China
- Zhongyuan Institute, Zhejiang University, Zhengzhou, China
- Ningbo Innovation Center, Zhejiang University, Ningbo, China
| |
Collapse
|
11
|
Eskenazi MA. Best practices for cleaning eye movement data in reading research. Behav Res Methods 2024; 56:2083-2093. [PMID: 37222925 DOI: 10.3758/s13428-023-02137-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/24/2023] [Indexed: 05/25/2023]
Abstract
One challenge that comes with studying eye movement behavior is deciding how to clean the eye movement data (e.g., fixation durations) before conducting analyses. Reading researchers must decide which data cleaning methods they will use and which thresholds they will set to remove eye movements that are not reflective of lexical processing. The purpose of this project was to determine what data cleaning methods are typically used and if there are any consequences of using different data cleaning methods. In the first study, an analysis of 192 recently published articles indicated that there is inconsistency in the reporting and application of data cleaning methods. In the second study, three different data cleaning methods were applied based on the literature analysis in the first study. Analyses were conducted to determine the impact of different data cleaning methods on three commonly studied effects in reading research (frequency, predictability, and length). Overall, standardized estimates decreased for each effect when more data were removed; however, removing more data also resulted in decreased variance. As a result, effects remained significant with each data cleaning method, and simulated power remained high for both a moderate and small sample size. Effect sizes remained consistent for most effects but decreased for the length effect as more data were removed. Seven suggestions are provided that are based on open science practices with the intention of helping researchers, reviewers, and the field as a whole.
Collapse
|
12
|
Menendez E, Martínez S, Díaz-de-María F, Balaguer C. Integrating Egocentric and Robotic Vision for Object Identification Using Siamese Networks and Superquadric Estimations in Partial Occlusion Scenarios. Biomimetics (Basel) 2024; 9:100. [PMID: 38392146 PMCID: PMC10886810 DOI: 10.3390/biomimetics9020100] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2023] [Revised: 01/31/2024] [Accepted: 02/06/2024] [Indexed: 02/24/2024] Open
Abstract
This paper introduces a novel method that enables robots to identify objects based on user gaze, tracked via eye-tracking glasses. This is achieved without prior knowledge of the objects' categories or their locations and without external markers. The method integrates a two-part system: a category-agnostic object shape and pose estimator using superquadrics and Siamese networks. The superquadrics-based component estimates the shapes and poses of all objects, while the Siamese network matches the object targeted by the user's gaze with the robot's viewpoint. Both components are effectively designed to function in scenarios with partial occlusions. A key feature of the system is the user's ability to move freely around the scenario, allowing dynamic object selection via gaze from any position. The system is capable of handling significant viewpoint differences between the user and the robot and adapts easily to new objects. In tests under partial occlusion conditions, the Siamese networks demonstrated an 85.2% accuracy in aligning the user-selected object with the robot's viewpoint. This gaze-based Human-Robot Interaction approach demonstrates its practicality and adaptability in real-world scenarios.
Collapse
Affiliation(s)
- Elisabeth Menendez
- System Engineering and Automation Department, University Carlos III, Av de la Universidad, 30, 28911 Madrid, Spain
| | - Santiago Martínez
- System Engineering and Automation Department, University Carlos III, Av de la Universidad, 30, 28911 Madrid, Spain
| | - Fernando Díaz-de-María
- Signal Theory and Communications Department, University Carlos III, Av de la Universidad, 30, 28911 Madrid, Spain
| | - Carlos Balaguer
- System Engineering and Automation Department, University Carlos III, Av de la Universidad, 30, 28911 Madrid, Spain
| |
Collapse
|
13
|
Hu H, Li H, Wang B, Zhang M, Wu B, Wu X. Application of eye-tracking in nursing research: A scoping review. Nurs Open 2024; 11:e2108. [PMID: 38391099 PMCID: PMC10847623 DOI: 10.1002/nop2.2108] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2023] [Revised: 12/25/2023] [Accepted: 01/11/2024] [Indexed: 02/24/2024] Open
Abstract
AIMS To map the themes and methods of nursing researches involving eye-tracking as a measurement, and offer suggestion for future nursing research using eye-tracking. DESIGN We conducted a scoping review following the methodology outlined in the JBI Manual for Evidence Synthesis on scoping reviews. METHODS Eligibility criteria were established based on Population (involving nursing or nursing students), Concept (utilizing eye-tracking as a research method), and Context (in any setting). Articles were retrieved from the PubMed, Web of Science, Embase, CINAHL, APA PsycInfo, and Scopus databases, spanning from database inception to November 17, 2023. The included studies were analysed using descriptive statistics and content analysis. RESULTS After duplicates were removed, 815 citations were identified from searches of electronic databases and other resources, and 66 met the inclusion criteria finally. Thirty-eight studies were conducted in a simulated environment. Five application domains were identified, and most of the studies (N = 50) were observational. The domains found in our review did not cover all topics of nursing research in the same depth. Additionally, 39 studies did not solely explicate eye-tracking data but instead integrated behavioural measures, scales/questionnaires, or other physiological data. CONCLUSIONS Eye-tracking emerges as a significant research tool in uncovering visual behaviour, particularly in nursing research focused on nursing education. This study not only summarized the application and interpretation of eye-tracking data but also recognized its potential in advancing clinical nursing research and practice. To effectively harness the capabilities of eye-tracking in elucidating cognitive processes, future research should aim for a clearer grasp of the theoretical underpinnings of the addressed research problems and methodological choices. It is crucial to emphasize the standardization of eye-tracking method reporting and ensuring data quality. No Patient or Public Contribution.
Collapse
Affiliation(s)
- Huiling Hu
- School of NursingPeking UniversityBeijingChina
| | - Huijun Li
- School of NursingPeking UniversityBeijingChina
- Department of NursingBeijing Children's Hospital, Capital Medical University, National Center for Children's HealthBeijingChina
| | - Binlin Wang
- School of NursingPeking UniversityBeijingChina
| | | | - Bilin Wu
- School of NursingPeking UniversityBeijingChina
| | - Xue Wu
- School of NursingPeking UniversityBeijingChina
- Peking University Health Science Centre for Evidence‐Based Nursing: A JBI Centre of ExcellenceBeijingChina
| |
Collapse
|
14
|
Zeng G, Simpson EA, Paukner A. Maximizing valid eye-tracking data in human and macaque infants by optimizing calibration and adjusting areas of interest. Behav Res Methods 2024; 56:881-907. [PMID: 36890330 DOI: 10.3758/s13428-022-02056-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/24/2022] [Indexed: 03/10/2023]
Abstract
Remote eye tracking with automated corneal reflection provides insights into the emergence and development of cognitive, social, and emotional functions in human infants and non-human primates. However, because most eye-tracking systems were designed for use in human adults, the accuracy of eye-tracking data collected in other populations is unclear, as are potential approaches to minimize measurement error. For instance, data quality may differ across species or ages, which are necessary considerations for comparative and developmental studies. Here we examined how the calibration method and adjustments to areas of interest (AOIs) of the Tobii TX300 changed the mapping of fixations to AOIs in a cross-species longitudinal study. We tested humans (N = 119) at 2, 4, 6, 8, and 14 months of age and macaques (Macaca mulatta; N = 21) at 2 weeks, 3 weeks, and 6 months of age. In all groups, we found improvement in the proportion of AOI hits detected as the number of successful calibration points increased, suggesting calibration approaches with more points may be advantageous. Spatially enlarging and temporally prolonging AOIs increased the number of fixation-AOI mappings, suggesting improvements in capturing infants' gaze behaviors; however, these benefits varied across age groups and species, suggesting different parameters may be ideal, depending on the population studied. In sum, to maximize usable sessions and minimize measurement error, eye-tracking data collection and extraction approaches may need adjustments for the age groups and species studied. Doing so may make it easier to standardize and replicate eye-tracking research findings.
Collapse
Affiliation(s)
- Guangyu Zeng
- Department of Psychology, University of Miami, Coral Gables, FL, USA
| | | | - Annika Paukner
- Department of Psychology, Nottingham Trent University, Nottingham, UK
| |
Collapse
|
15
|
Qin X, Xia X, Ge Z, Liu Y, Yue P. The Design and Control of a Biomimetic Binocular Cooperative Perception System Inspired by the Eye Gaze Mechanism. Biomimetics (Basel) 2024; 9:69. [PMID: 38392115 PMCID: PMC10886948 DOI: 10.3390/biomimetics9020069] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2023] [Revised: 01/15/2024] [Accepted: 01/16/2024] [Indexed: 02/24/2024] Open
Abstract
Research on systems that imitate the gaze function of human eyes is valuable for the development of humanoid eye intelligent perception. However, the existing systems have some limitations, including the redundancy of servo motors, a lack of camera position adjustment components, and the absence of interest-point-driven binocular cooperative motion-control strategies. In response to these challenges, a novel biomimetic binocular cooperative perception system (BBCPS) was designed and its control was realized. Inspired by the gaze mechanism of human eyes, we designed a simple and flexible biomimetic binocular cooperative perception device (BBCPD). Based on a dynamic analysis, the BBCPD was assembled according to the principle of symmetrical distribution around the center. This enhances braking performance and reduces operating energy consumption, as evidenced by the simulation results. Moreover, we crafted an initial position calibration technique that allows for the calibration and adjustment of the camera pose and servo motor zero-position, to ensure that the state of the BBCPD matches the subsequent control method. Following this, a control method for the BBCPS was developed, combining interest point detection with a motion-control strategy. Specifically, we propose a binocular interest-point extraction method based on frequency-tuned and template-matching algorithms for perceiving interest points. To move an interest point to a principal point, we present a binocular cooperative motion-control strategy. The rotation angles of servo motors were calculated based on the pixel difference between the principal point and the interest point, and PID-controlled servo motors were driven in parallel. Finally, real experiments validated the control performance of the BBCPS, demonstrating that the gaze error was less than three pixels.
Collapse
Affiliation(s)
- Xufang Qin
- Key Laboratory of Road Construction Technology and Equipment of MOE, Chang'an University, Xi'an 710064, China
| | - Xiaohua Xia
- Key Laboratory of Road Construction Technology and Equipment of MOE, Chang'an University, Xi'an 710064, China
| | - Zhaokai Ge
- Key Laboratory of Road Construction Technology and Equipment of MOE, Chang'an University, Xi'an 710064, China
| | - Yanhao Liu
- TianQin Research Center for Gravitational Physics and School of Physics and Astronomy, Sun Yat-sen University (Zhuhai Campus), Zhuhai 519082, China
| | - Pengju Yue
- Key Laboratory of Road Construction Technology and Equipment of MOE, Chang'an University, Xi'an 710064, China
| |
Collapse
|
16
|
Le Cunff AL, Dommett E, Giampietro V. Neurophysiological measures and correlates of cognitive load in attention-deficit/hyperactivity disorder (ADHD), autism spectrum disorder (ASD) and dyslexia: A scoping review and research recommendations. Eur J Neurosci 2024; 59:256-282. [PMID: 38109476 DOI: 10.1111/ejn.16201] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2023] [Revised: 10/27/2023] [Accepted: 11/06/2023] [Indexed: 12/20/2023]
Abstract
Working memory is integral to a range of critical cognitive functions such as reasoning and decision-making. Although alterations in working memory have been observed in neurodivergent populations, there has been no review mapping how cognitive load is measured in common neurodevelopmental conditions such as attention-deficit/hyperactivity disorder (ADHD), autism spectrum disorder (ASD) and dyslexia. This scoping review explores the neurophysiological measures used to study cognitive load in these specific populations. Our findings highlight that electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) are the most frequently used methods, with a limited number of studies employing functional near-infrared spectroscopy (fNIRs), magnetoencephalography (MEG) or eye-tracking. Notably, eye-related measures are less commonly used, despite their prominence in cognitive load research among neurotypical individuals. The review also highlights potential correlates of cognitive load, such as neural oscillations in the theta and alpha ranges for EEG studies, blood oxygenation level-dependent (BOLD) responses in lateral and medial frontal brain regions for fMRI and fNIRS studies and eye-related measures such as pupil dilation and blink rate. Finally, critical issues for future studies are discussed, including the technical challenges associated with multimodal approaches, the possible impact of atypical features on cognitive load measures and balancing data richness with participant well-being. These insights contribute to a more nuanced understanding of cognitive load measurement in neurodivergent populations and point to important methodological considerations for future neuroscientific research in this area.
Collapse
Affiliation(s)
- Anne-Laure Le Cunff
- Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK
| | - Eleanor Dommett
- Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK
| | - Vincent Giampietro
- Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK
| |
Collapse
|
17
|
Murphy TI, Abel LA, Armitage JA, Douglass AG. Effects of tracker location on the accuracy and precision of the Gazepoint GP3 HD for spectacle wearers. Behav Res Methods 2024; 56:43-52. [PMID: 36414846 DOI: 10.3758/s13428-022-02023-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/08/2022] [Indexed: 11/24/2022]
Abstract
Remote view eye-tracking systems are prone to errors when used on spectacle wearers due to reflections from the lenses and frame that result in inaccurate tracking. Traditionally, these trackers are situated below a computer monitor and the viewer's eye moments are recorded while they view the screen. Reflections may be influenced by the pantoscopic tilt of the spectacles, whereby the tilt angle causes incident light to be reflected to the camera. To overcome this problem, we propose mounting the tracker above the monitor to avoid these reflections and test the accuracy and precision of subjects with single vision spectacles, multifocals, and no correction, using both mounting positions. Experimental results showed that this alternate position had overall worse accuracy (4.06° ± 0.13) and precision (0.67° ± 0.05) compared to the standard configuration (2.15° ± 0.06 vs. 0.50° ± 0.03), with more invalid readings (5.91 vs. 19.19%) for single vision lens wearers. Multifocals performed better for the top-mounting position for the top portion of the monitor, suggesting higher-order aberrations from the bottom portion of the lens negatively impact data quality. Higher pantoscopic tilt angles displayed an improved accuracy for this alternate position (r(9) = - 0.69, p = 0.02), with superior accuracy for tilt angles greater than 14° compared to the standard configuration. This study quantifies the impact of spectacle wear on eye-tracking performance and suggests other alternate mounting positions may be viable in certain situations.
Collapse
Affiliation(s)
- Timothy I Murphy
- School of Medicine (Optometry), Deakin University, 75 Pigdons Road, Waurn Ponds, Victoria, 3216, Australia
| | - Larry A Abel
- School of Medicine (Optometry), Deakin University, 75 Pigdons Road, Waurn Ponds, Victoria, 3216, Australia
| | - James A Armitage
- School of Medicine (Optometry), Deakin University, 75 Pigdons Road, Waurn Ponds, Victoria, 3216, Australia
| | - Amanda G Douglass
- School of Medicine (Optometry), Deakin University, 75 Pigdons Road, Waurn Ponds, Victoria, 3216, Australia.
| |
Collapse
|
18
|
Arlidge WNS, Arlinghaus R, Kurvers RHJM, Nassauer A, Oyanedel R, Krause J. Situational social influence leading to non-compliance with conservation rules. Trends Ecol Evol 2023; 38:1154-1164. [PMID: 37634956 DOI: 10.1016/j.tree.2023.08.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2023] [Revised: 07/24/2023] [Accepted: 08/02/2023] [Indexed: 08/29/2023]
Abstract
It is well established that the decisions that we make can be strongly influenced by the behaviour of others. However, testing how social influence can lead to non-compliance with conservation rules during an individual's decision-making process has received little research attention. We synthesise advances in understanding of conformity and rule-breaking in individuals and in groups, and take a situational approach to studying the social dynamics and ensuing social identity changes that can lead to non-compliant decision-making. We focus on situational social influence contagion that are copresent (i.e., same space and same time) or trace-based (i.e., behavioural traces in the same space). We then suggest approaches for testing how situational social influence can lead to certain behaviours in non-compliance with conservation rules.
Collapse
Affiliation(s)
- William N S Arlidge
- Department of Fish Biology, Fisheries, and Aquaculture, Leibniz Institute of Freshwater Ecology and Inland Fisheries, Müggelseedamm 310, 12587 Berlin, Germany.
| | - Robert Arlinghaus
- Department of Fish Biology, Fisheries, and Aquaculture, Leibniz Institute of Freshwater Ecology and Inland Fisheries, Müggelseedamm 310, 12587 Berlin, Germany; Faculty of Life Sciences, Humboldt-Universität zu Berlin, Invalidenstrasse 42, 10115 Berlin, Germany; SCIoI Excellence Cluster, 10587 Berlin, Germany
| | - Ralf H J M Kurvers
- Department of Fish Biology, Fisheries, and Aquaculture, Leibniz Institute of Freshwater Ecology and Inland Fisheries, Müggelseedamm 310, 12587 Berlin, Germany; SCIoI Excellence Cluster, 10587 Berlin, Germany; Center for Adaptive Rationality, Max Planck Institute for Human Development, 14195 Berlin, Germany
| | - Anne Nassauer
- Faculty of Economics, Law and Social Sciences, University of Erfurt, Nordhäuser Str. 63 99089 Erfurt, Germany
| | - Rodrigo Oyanedel
- Instituto Milenio en Socio-Ecología Costera (SECOS), Av. Libertador Bernardo O'Higgins 340, Santiago, Región Metropolitana, Chile; Centro de Investigación en Dinámica de Ecosistemas Marinos de Altas Latitudes (IDEAL)- Universidad Austral de Chile, Edificio Emilio Pugin, piso 1 Campus Isla Teja, Valdivia, Región de los Ríos, Chile
| | - Jens Krause
- Department of Fish Biology, Fisheries, and Aquaculture, Leibniz Institute of Freshwater Ecology and Inland Fisheries, Müggelseedamm 310, 12587 Berlin, Germany; Faculty of Life Sciences, Humboldt-Universität zu Berlin, Invalidenstrasse 42, 10115 Berlin, Germany; SCIoI Excellence Cluster, 10587 Berlin, Germany
| |
Collapse
|
19
|
Hirosawa S, Kato T, Yamashita T, Aoki Y. Action Quality Assessment Model Using Specialists' Gaze Location and Kinematics Data-Focusing on Evaluating Figure Skating Jumps. SENSORS (BASEL, SWITZERLAND) 2023; 23:9282. [PMID: 38005668 PMCID: PMC10675807 DOI: 10.3390/s23229282] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/11/2023] [Revised: 11/11/2023] [Accepted: 11/12/2023] [Indexed: 11/26/2023]
Abstract
Action quality assessment (AQA) tasks in computer vision evaluate action quality in videos, and they can be applied to sports for performance evaluation. A typical example of AQA is predicting the final score from a video that captures an entire figure skating program. However, no previous studies have predicted individual jump scores, which are of great interest to competitors because of the high weight of competition. Despite the presence of unnecessary information in figure skating videos, human specialists can focus and reduce information when they evaluate jumps. In this study, we clarified the eye movements of figure skating judges and skaters while evaluating jumps and proposed a prediction model for jump performance that utilized specialists' gaze location to reduce information. Kinematic features obtained from the tracking system were input into the model in addition to videos to improve accuracy. The results showed that skaters focused more on the face, whereas judges focused on the lower extremities. These gaze locations were applied to the model, which demonstrated the highest accuracy when utilizing both specialists' gaze locations. The model outperformed human predictions and the baseline model (RMSE:0.775), suggesting a combination of human specialist knowledge and machine capabilities could yield higher accuracy.
Collapse
Affiliation(s)
- Seiji Hirosawa
- Graduate School of Science and Technology, Keio University, Yokohama 223-8522, Japan
- Faculty of Sport and Health Sciences, Toin University of Yokohama, Yokohama 225-8503, Japan
| | - Takaaki Kato
- Faculty of Environment and Information Studies, Keio University, Fujisawa 252-0882, Japan
| | | | - Yoshimitsu Aoki
- Graduate School of Science and Technology, Keio University, Yokohama 223-8522, Japan
| |
Collapse
|
20
|
Donniacuo A, Viberti F, Carucci M, Biancalana V, Bellizzi L, Mandalà M. Development of a Magnetoresistive-Based Wearable Eye-Tracking System for Oculomotor Assessment in Neurological and Otoneurological Research-Preliminary In Vivo Tests. Brain Sci 2023; 13:1439. [PMID: 37891805 PMCID: PMC10605460 DOI: 10.3390/brainsci13101439] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Revised: 10/07/2023] [Accepted: 10/09/2023] [Indexed: 10/29/2023] Open
Abstract
Over the past 20 years, several eye-tracking technologies have been developed. This article aims to present a new type of eye tracker capable of producing detailed information on eye and head movements using an array of magnetoresistive detectors fixed on the patient's head and a small magnet inserted into a contact lens, adapted to the curvature of the cornea of the subject. The software used for data analysis can combine or compare eye and head movements and can represent them as 2D or 3D images. Preliminary data involve an initial patient who was asked to perform several tasks to establish the accuracy, reliability, and tolerance of the magnetic eye tracker and software. The tasks included assessment of saccadic eye movements and pursuit, "drawing" alphabetic shapes or letters, and reading. Finally, a Head Impulse Test (HIT) was performed to estimate the VOR gain, comparing the standard deviation established via vHIT with that established via this magnetic eye tracker (mHIT). This prototypical device is minimally invasive, lightweight, relatively cheap, and tolerable, with a high degree of reliability and precision. All these characteristics could lead to the future use of the magnetic eye tracker in neurological and otoneurological fields.
Collapse
Affiliation(s)
- Aniello Donniacuo
- Department of Medicine, Surgery and Neuroscience, University of Siena, U.O.C. Otorinolaringoiatria, Viale Bracci 16, 53100 Siena, Italy; (A.D.); (M.C.); (M.M.)
| | - Francesca Viberti
- Department of Medicine, Surgery and Neuroscience, University of Siena, U.O.C. Otorinolaringoiatria, Viale Bracci 16, 53100 Siena, Italy; (A.D.); (M.C.); (M.M.)
| | - Mario Carucci
- Department of Medicine, Surgery and Neuroscience, University of Siena, U.O.C. Otorinolaringoiatria, Viale Bracci 16, 53100 Siena, Italy; (A.D.); (M.C.); (M.M.)
| | - Valerio Biancalana
- Department of Physical Sciences, Earth and Environment, University of Siena, Via Roma 56, 53100 Siena, Italy;
| | - Lorenzo Bellizzi
- Department of Physics “E. Fermi”, University of Pisa, Largo Pontecorvo 3, 56127 Pisa, Italy;
| | - Marco Mandalà
- Department of Medicine, Surgery and Neuroscience, University of Siena, U.O.C. Otorinolaringoiatria, Viale Bracci 16, 53100 Siena, Italy; (A.D.); (M.C.); (M.M.)
| |
Collapse
|
21
|
Faraji Y, van Rijn JW, van Nispen RMA, van Rens GHMB, Melis-Dankers BJM, Koopman J, van Rijn LJ. A toolkit for wide-screen dynamic area of interest measurements using the Pupil Labs Core Eye Tracker. Behav Res Methods 2023; 55:3820-3830. [PMID: 36253600 PMCID: PMC10616213 DOI: 10.3758/s13428-022-01991-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/26/2022] [Indexed: 11/08/2022]
Abstract
Eye tracking measurements taken while watching a wide field screen are challenging to perform. Commercially available remote eye trackers typically do not measure more than 35 degrees in eccentricity. Analysis software was developed using the Pupil Core Eye Tracking data to analyze viewing behavior under circumstances as natural as possible, on a 1.55-m-wide screen allowing free head movements. Additionally, dynamic area of interest (AOI) analyses were performed on data of participants viewing traffic scenes. A toolkit was created including software for simple allocation of dynamic AOIs (semi-automatically and manually), measurement of parameters such as dwell times and time to first entry, and overlaying gaze and AOIs on video. Participants (n =11) were asked to look at 13 dynamic AOIs in traffic scenes from appearance to disappearance in order to validate the setup and software. Different AOI margins were explored for the included objects. The median ratio between total appearance time and dwell time was about 90% for most objects when appropriate margins were chosen. This validated open-source toolkit is readily available for researchers who want to perform dynamic AOI analyses with the Pupil Core eye tracker, especially when measurements are desired on a wide screen, in various fields such as psychology, transportation, and low vision research.
Collapse
Affiliation(s)
- Yasmin Faraji
- Amsterdam UMC location Vrije Universiteit Amsterdam, Ophthalmology, Amsterdam, The Netherlands
- Amsterdam Public Health, Quality of Care, Societal Participation & Health, Mental Health, Aging and Later Life, Amsterdam, The Netherlands
| | - Joris W van Rijn
- Amsterdam UMC location Vrije Universiteit Amsterdam, Ophthalmology, Amsterdam, The Netherlands
| | - Ruth M A van Nispen
- Amsterdam UMC location Vrije Universiteit Amsterdam, Ophthalmology, Amsterdam, The Netherlands
- Amsterdam Public Health, Quality of Care, Societal Participation & Health, Mental Health, Aging and Later Life, Amsterdam, The Netherlands
| | - Ger H M B van Rens
- Amsterdam UMC location Vrije Universiteit Amsterdam, Ophthalmology, Amsterdam, The Netherlands
- Amsterdam Public Health, Quality of Care, Societal Participation & Health, Mental Health, Aging and Later Life, Amsterdam, The Netherlands
| | - Bart J M Melis-Dankers
- Royal Dutch Visio, Centre of Expertise for Blind and Partially Sighted People, Huizen, The Netherlands
| | - Jan Koopman
- Royal Dutch Visio, Centre of Expertise for Blind and Partially Sighted People, Huizen, The Netherlands
| | - Laurentius J van Rijn
- Amsterdam UMC location Vrije Universiteit Amsterdam, Ophthalmology, Amsterdam, The Netherlands.
- Department of Ophthalmology, Onze Lieve Vrouwe Gasthuis, Amsterdam, The Netherlands.
- Amsterdam Neuroscience, Systems & Network Neurosciences, Amsterdam, The Netherlands.
| |
Collapse
|
22
|
Misthos LM, Krassanakis V, Merlemis N, Kesidis AL. Modeling the Visual Landscape: A Review on Approaches, Methods and Techniques. SENSORS (BASEL, SWITZERLAND) 2023; 23:8135. [PMID: 37836966 PMCID: PMC10574952 DOI: 10.3390/s23198135] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/30/2023] [Revised: 08/14/2023] [Accepted: 09/21/2023] [Indexed: 10/15/2023]
Abstract
Modeling the perception and evaluation of landscapes from the human perspective is a desirable goal for several scientific domains and applications. Human vision is the dominant sense, and human eyes are the sensors for apperceiving the environmental stimuli of our surroundings. Therefore, exploring the experimental recording and measurement of the visual landscape can reveal crucial aspects about human visual perception responses while viewing the natural or man-made landscapes. Landscape evaluation (or assessment) is another dimension that refers mainly to preferences of the visual landscape, involving human cognition as well, in ways that are often unpredictable. Yet, landscape can be approached by both egocentric (i.e., human view) and exocentric (i.e., bird's eye view) perspectives. The overarching approach of this review article lies in systematically presenting the different ways for modeling and quantifying the two 'modalities' of human perception and evaluation, under the two geometric perspectives, suggesting integrative approaches on these two 'diverging' dualities. To this end, several pertinent traditions/approaches, sensor-based experimental methods and techniques (e.g., eye tracking, fMRI, and EEG), and metrics are adduced and described. Essentially, this review article acts as a 'guide-map' for the delineation of the different activities related to landscape experience and/or management and to the valid or potentially suitable types of stimuli, sensors techniques, and metrics for each activity. Throughout our work, two main research directions are identified: (1) one that attempts to transfer the visual landscape experience/management from the one perspective to the other (and vice versa); (2) another one that aims to anticipate the visual perception of different landscapes and establish connections between perceptual processes and landscape preferences. As it appears, the research in the field is rapidly growing. In our opinion, it can be greatly advanced and enriched using integrative, interdisciplinary approaches in order to better understand the concepts and the mechanisms by which the visual landscape, as a complex set of stimuli, influences visual perception, potentially leading to more elaborate outcomes such as the anticipation of landscape preferences. As an effect, such approaches can support a rigorous, evidence-based, and socially just framework towards landscape management, protection, and decision making, based on a wide spectrum of well-suited and advanced sensor-based technologies.
Collapse
Affiliation(s)
- Loukas-Moysis Misthos
- Department of Surveying and Geoinformatics Engineering, University of West Attica, GR-12243 Athens, Greece; (L.-M.M.); (V.K.); (N.M.)
- Department of Public and One Health, University of Thessaly, GR-43100 Karditsa, Greece
| | - Vassilios Krassanakis
- Department of Surveying and Geoinformatics Engineering, University of West Attica, GR-12243 Athens, Greece; (L.-M.M.); (V.K.); (N.M.)
| | - Nikolaos Merlemis
- Department of Surveying and Geoinformatics Engineering, University of West Attica, GR-12243 Athens, Greece; (L.-M.M.); (V.K.); (N.M.)
| | - Anastasios L. Kesidis
- Department of Surveying and Geoinformatics Engineering, University of West Attica, GR-12243 Athens, Greece; (L.-M.M.); (V.K.); (N.M.)
| |
Collapse
|
23
|
Grandon B, Schlechtweg M, Ruigendijk E. Processing of noun plural marking in German-speaking children: an eye-tracking study. JOURNAL OF CHILD LANGUAGE 2023:1-28. [PMID: 37718673 DOI: 10.1017/s0305000923000521] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/19/2023]
Abstract
The ability to process plural marking of nouns is acquired early: at a very young age, children are able to understand if a noun represents one item or more than one. However, little is known about how the segmental characteristics of plural marking are used in this process. Using eye-tracking, we aim at understanding how five to twelve-year old children use the phonetic, phonological, and morphological information available to process noun plural marking in German (i.e., a very complex system) compared to adults. We expected differences with stem vowels, stem-final consonants or different suffixes, alone or in combination, reflecting different processing of their segmental information. Our results show that for plural processing: 1) a suffix is the most helpful cue, an umlaut the least helpful, and voicing does not play a role; 2) one cue can be sufficient and 3) school-age children have not reached adult-like processing of plural marking.
Collapse
Affiliation(s)
- Bénédicte Grandon
- Institute of Dutch Studies, University of Oldenburg and Cluster of Excellence "Hearing4all"
| | - Marcel Schlechtweg
- Institute for English and American Studies, University of Oldenburg and Cluster of Excellence "Hearing4all"
| | - Esther Ruigendijk
- Institute of Dutch Studies, University of Oldenburg and Cluster of Excellence "Hearing4all"
| |
Collapse
|
24
|
Zou L, Herold F, Ludyga S, Kamijo K, Müller NG, Pontifex MB, Heath M, Kuwamizu R, Soya H, Hillman CH, Ando S, Alderman BL, Cheval B, Kramer AF. Look into my eyes: What can eye-based measures tell us about the relationship between physical activity and cognitive performance? JOURNAL OF SPORT AND HEALTH SCIENCE 2023; 12:568-591. [PMID: 37148971 PMCID: PMC10466196 DOI: 10.1016/j.jshs.2023.04.003] [Citation(s) in RCA: 10] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/12/2023] [Revised: 03/07/2023] [Accepted: 03/16/2023] [Indexed: 05/08/2023]
Abstract
BACKGROUND There is a growing interest to understand the neurobiological mechanisms that drive the positive associations of physical activity and fitness with measures of cognitive performance. To better understand those mechanisms, several studies have employed eye-based measures (e.g., eye movement measures such as saccades, pupillary measures such as pupil dilation, and vascular measures such as retinal vessel diameter) deemed to be proxies for specific neurobiological mechanisms. However, there is currently no systematic review providing a comprehensive overview of these studies in the field of exercise-cognition science. Thus, this review aimed to address that gap in the literature. METHODS To identify eligible studies, we searched 5 electronic databases on October 23, 2022. Two researchers independently extracted data and assessed the risk of bias using a modified version of the Tool for the assEssment of Study qualiTy and reporting in EXercise (TESTEX scale, for interventional studies) and the critical appraisal tool from the Joanna Briggs Institute (for cross-sectional studies). RESULTS Our systematic review (n = 35 studies) offers the following main findings: (a) there is insufficient evidence available to draw solid conclusions concerning gaze-fixation-based measures; (b) the evidence that pupillometric measures, which are a proxy for the noradrenergic system, can explain the positive effect of acute exercise and cardiorespiratory fitness on cognitive performance is mixed; (c) physical training- or fitness-related changes of the cerebrovascular system (operationalized via changes in retinal vasculature) are, in general, positively associated with cognitive performance improvements; (d) acute and chronic physical exercises show a positive effect based on an oculomotor-based measure of executive function (operationalized via antisaccade tasks); and (e) the positive association between cardiorespiratory fitness and cognitive performance is partly mediated by the dopaminergic system (operationalized via spontaneous eye-blink rate). CONCLUSION This systematic review offers confirmation that eye-based measures can provide valuable insight into the neurobiological mechanisms that may drive positive associations between physical activity and fitness and measures of cognitive performance. However, due to the limited number of studies utilizing specific methods for obtaining eye-based measures (e.g., pupillometry, retinal vessel analysis, spontaneous eye blink rate) or investigating a possible dose-response relationship, further research is necessary before more nuanced conclusions can be drawn. Given that eye-based measures are economical and non-invasive, we hope this review will foster the future application of eye-based measures in the field of exercise-cognition science.
Collapse
Affiliation(s)
- Liye Zou
- Body-Brain-Mind Laboratory, School of Psychology, Shenzhen University, Shenzhen 518060, China; Research Group Degenerative and Chronic Diseases, Movement, Faculty of Health Sciences Brandenburg, University of Potsdam, Potsdam 14476, Germany.
| | - Fabian Herold
- Body-Brain-Mind Laboratory, School of Psychology, Shenzhen University, Shenzhen 518060, China; Research Group Degenerative and Chronic Diseases, Movement, Faculty of Health Sciences Brandenburg, University of Potsdam, Potsdam 14476, Germany
| | - Sebastian Ludyga
- Department of Sport, Exercise, and Health, University of Basel, Basel 4052, Switzerland
| | - Keita Kamijo
- Faculty of Liberal Arts and Sciences, Chukyo University, Nagoya 466-8666, Japan
| | - Notger G Müller
- Body-Brain-Mind Laboratory, School of Psychology, Shenzhen University, Shenzhen 518060, China; Research Group Degenerative and Chronic Diseases, Movement, Faculty of Health Sciences Brandenburg, University of Potsdam, Potsdam 14476, Germany
| | - Matthew B Pontifex
- Department of Kinesiology, Michigan State University, East Lansing, MI 48824, USA
| | - Matthew Heath
- School of Kinesiology, Faculty of Health Sciences, University of Western Ontario, London ON N6A 3K7, Canada; Canadian Centre for Activity and Aging, University of Western Ontario, London ON, N6A 3K7, Canada; Graduate Program in Neuroscience, University of Western Ontario, London ON, N6A 3K7, Canada
| | - Ryuta Kuwamizu
- Laboratory of Exercise Biochemistry and Neuroendocrinology, Faculty of Health and Sport Sciences, University of Tsukuba, Tsukuba 305-0006, Japan
| | - Hideaki Soya
- Laboratory of Exercise Biochemistry and Neuroendocrinology, Faculty of Health and Sport Sciences, University of Tsukuba, Tsukuba 305-0006, Japan; Sport Neuroscience Division, Advanced Research Initiative for Human High Performance (ARIHHP), Faculty of Health and Sport Sciences, University of Tsukuba, Tsukuba 305-0006, Japan
| | - Charles H Hillman
- Center for Cognitive and Brain Health, Department of Psychology, Department of Physical Therapy, Movement, and Rehabilitation Sciences, Northeastern University, Boston, MA 02115, USA
| | - Soichi Ando
- Graduate School of Informatics and Engineering, The University of Electro-Communications, Tokyo 182-8585, Japan
| | - Brandon L Alderman
- Department of Kinesiology and Health, Rutgers University-New Brunswick, New Brunswick, NJ 08854, USA
| | - Boris Cheval
- Swiss Center for Affective Sciences, University of Geneva, Geneva 1205, Switzerland; Laboratory for the Study of Emotion Elicitation and Expression (E3Lab), Department of Psychology, University of Geneva, Geneva 1205, Switzerland
| | - Arthur F Kramer
- Department of Psychology, Center for Cognitive and Brain Health, Northeastern University, Boston, MA 02115, USA; Beckman Institute, University of Illinois at Urbana-Champaign, Champaign, IL 61820, USA
| |
Collapse
|
25
|
Van der Cruyssen I, Ben-Shakhar G, Pertzov Y, Guy N, Cabooter Q, Gunschera LJ, Verschuere B. The validation of online webcam-based eye-tracking: The replication of the cascade effect, the novelty preference, and the visual world paradigm. Behav Res Methods 2023:10.3758/s13428-023-02221-2. [PMID: 37648844 DOI: 10.3758/s13428-023-02221-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/10/2023] [Indexed: 09/01/2023]
Abstract
The many benefits of online research and the recent emergence of open-source eye-tracking libraries have sparked an interest in transferring time-consuming and expensive eye-tracking studies from the lab to the web. In the current study, we validate online webcam-based eye-tracking by conceptually replicating three robust eye-tracking studies (the cascade effect, n = 134, the novelty preference, n = 45, and the visual world paradigm, n = 32) online using the participant's webcam as eye-tracker with the WebGazer.js library. We successfully replicated all three effects, although the effect sizes of all three studies shrank by 20-27%. The visual world paradigm was conducted both online and in the lab, using the same participants and a standard laboratory eye-tracker. The results showed that replication per se could not fully account for the effect size shrinkage, but that the shrinkage was also due to the use of online webcam-based eye-tracking, which is noisier. In conclusion, we argue that eye-tracking studies with relatively large effects that do not require extremely high precision (e.g., studies with four or fewer large regions of interest) can be done online using the participant's webcam. We also make recommendations for how the quality of online webcam-based eye-tracking could be improved.
Collapse
Affiliation(s)
- Ine Van der Cruyssen
- Department of Clinical Psychology, University of Amsterdam, Nieuwe Achtergracht 129B, 1018, VZ, Amsterdam, The Netherlands.
- Hebrew University of Jerusalem, Mount Scopus, 91905, Jerusalem, Israel.
| | | | - Yoni Pertzov
- Hebrew University of Jerusalem, Mount Scopus, 91905, Jerusalem, Israel
| | - Nitzan Guy
- Hebrew University of Jerusalem, Mount Scopus, 91905, Jerusalem, Israel
| | - Quinn Cabooter
- Department of Clinical Psychology, University of Amsterdam, Nieuwe Achtergracht 129B, 1018, VZ, Amsterdam, The Netherlands
- Ghent University, Henri Dunantlaan 2, 9000, Ghent, Belgium
| | - Lukas J Gunschera
- Department of Clinical Psychology, University of Amsterdam, Nieuwe Achtergracht 129B, 1018, VZ, Amsterdam, The Netherlands
| | - Bruno Verschuere
- Department of Clinical Psychology, University of Amsterdam, Nieuwe Achtergracht 129B, 1018, VZ, Amsterdam, The Netherlands
| |
Collapse
|
26
|
Bhadila GY, Alyafi DA. The Use of Eye-Tracking Technology in Pediatric Orofacial Clefts: A Systematic Review and Meta-Analysis. CHILDREN (BASEL, SWITZERLAND) 2023; 10:1425. [PMID: 37628424 PMCID: PMC10453381 DOI: 10.3390/children10081425] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/20/2023] [Revised: 08/14/2023] [Accepted: 08/18/2023] [Indexed: 08/27/2023]
Abstract
This systematic review and meta-analysis assessed the quality of the peer-reviewed literature and evaluated the usefulness of eye-tracking technology in evaluating observers' perceptions of pediatric patients with orofacial clefts. PubMed, Science Direct, Wiley, and Web of Science were searched. Articles were screened in accordance with the Preferred Reporting Items for Systematic Review and Meta-analysis guidelines, and their methodological quality was assessed. Of the 10,254 identified studies, 12 were included. Eleven studies were cross-sectional, and one was a prospective cohort study. The main areas of interest analyzed were the eyes, nose, and mouth. Nine studies used assessment scales to analyze the link between perceived attractiveness and visualization patterns and measures. For the fixation duration outcome, six studies were eligible for inclusion in the meta-analysis. All studies reported on fixation duration in milliseconds and reported on a standard deviation. The meta-analysis demonstrated a significant difference in the measurements between the control groups and the patients with orofacial clefts. This might indicate the usefulness of eye-tracking technology as a metric for assessing the success of cleft repairs based on the perceptions of different populations. Future studies should be comprehensively reported on for comparability and reproducibility purposes.
Collapse
Affiliation(s)
- Ghalia Y. Bhadila
- Department of Pediatric Dentistry, Faculty of Dentistry, King Abdulaziz University, Jeddah 21589, Saudi Arabia
| | - Dana A. Alyafi
- Department of Orthodontics, Faculty of Dentistry, King Abdulaziz University, Jeddah 21589, Saudi Arabia;
| |
Collapse
|
27
|
Lima DDS, Ventura DF. A review of experimental task design in psychophysical eye tracking research. Front Hum Neurosci 2023; 17:1112769. [PMID: 37662635 PMCID: PMC10469886 DOI: 10.3389/fnhum.2023.1112769] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2022] [Accepted: 07/28/2023] [Indexed: 09/05/2023] Open
Abstract
While eye tracking is a technique commonly used in the experimental study of higher-level perceptual processes such as visual search, working memory, reading, and scene exploration, its use for the quantification of basic visual functions (visual acuity, contrast sensitivity, color vision, motion detection) is less explored. The use of eye movement features as dependent variables in a psychophysical investigation can serve multiple roles. They can be central in studies with neurological patients or infants that cannot comply with verbal instructions, understand task demands, and/or emit manual responses. The technique may also serve a complementary role, determining the conditions under which a manual or verbal response is given, such as stimulus position in the visual field, or it can afford the analysis of new dependent variables, such as the time interval between oculomotor and manual responses. Our objective is to review the literature that applied the eye tracking technique to psychophysical problems. The two questions our review raises are: can eye movements (reflex or voluntary) be an objective index of stimulus detection in psychophysical tasks? If so, under what conditions, and how does it compare with traditional paradigms requiring manual responses? Our (non-systematic) methodological review selected studies that used video-oculography as the technique of choice and had a basic visual function as their primary object of investigation. Studies satisfying those criteria were then categorized into four broad classes reflecting their main research interest: (1) stimulus detection and threshold estimation, (2) the effects of stimulus properties on fixational eye movements, (3) the effects of eye movements on perception, and (4) visual field assessment. The reviewed studies support the idea that eye tracking is a valuable technique for the study of basic perceptual processes. We discuss methodological characteristics within each of the proposed classification area, with the objective of informing future task design.
Collapse
Affiliation(s)
- Diego da Silva Lima
- Laboratory of Clinical Visual Psychophysics and Electrophysiology, University of São Paulo, São Paulo, Brazil
| | | |
Collapse
|
28
|
Campos F, Amaro CM, Duarte JP, Mendes R, Martins F. The Gaze Patterns of Group Fitness Instructors Based on Different Levels of Training and Professional Experience. Sports (Basel) 2023; 11:153. [PMID: 37624133 PMCID: PMC10458799 DOI: 10.3390/sports11080153] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2023] [Revised: 07/28/2023] [Accepted: 08/07/2023] [Indexed: 08/26/2023] Open
Abstract
The way in which group fitness instructors observe participants has a great influence on their pedagogical intervention. Based on the above, the main objective of this research is to characterize and compare their gaze patterns according to their training and professional experience. Twenty group fitness instructors of choreographed classes participated, aged between 18 and 42 years old, and for the comparison, four groups were created. Eye movements were captured with TOBII Pro Glasses 3, and data were coded and analyzed using the TOBII Pro Lab software. For the characterization of the gaze patterns, descriptive statistics were used in terms of count (f/m) and duration (s/m), while the comparison was performed using a one-way ANOVA test. More trained and experienced instructors tend to look at participants less, in count (80.59 ± 0.74) and duration (17.74 ± 0.71), with significant differences between the groups in some areas of interest (head, lower body, and other). There are also significant differences in the total number of eye fixations (F = 34.614; p = 0.001; η2 = 0.866; effect size very high). In conclusion, and projecting future works, it is important to understand how these gaze patterns are related to pedagogical behaviors in general or based on some specific factors (e.g., pedagogical feedback).
Collapse
Affiliation(s)
- Francisco Campos
- Instituto Politécnico de Coimbra, Escola Superior de Educação de Coimbra, 3030-329 Coimbra, Portugal; (R.M.); (F.M.)
- Instituto de Telecomunicações, Delegação da Covilhã, 6201-001 Covilhã, Portugal
| | - Catarina M. Amaro
- Research Unit for Sport and Physical Activity (CIDAF), Faculty of Sport Sciences and Physical Education, University of Coimbra, 3040-256 Coimbra, Portugal; (C.M.A.); (J.P.D.)
| | - João P. Duarte
- Research Unit for Sport and Physical Activity (CIDAF), Faculty of Sport Sciences and Physical Education, University of Coimbra, 3040-256 Coimbra, Portugal; (C.M.A.); (J.P.D.)
| | - Rui Mendes
- Instituto Politécnico de Coimbra, Escola Superior de Educação de Coimbra, 3030-329 Coimbra, Portugal; (R.M.); (F.M.)
- Research Unit for Sport and Physical Activity (CIDAF), Faculty of Sport Sciences and Physical Education, University of Coimbra, 3040-256 Coimbra, Portugal; (C.M.A.); (J.P.D.)
| | - Fernando Martins
- Instituto Politécnico de Coimbra, Escola Superior de Educação de Coimbra, 3030-329 Coimbra, Portugal; (R.M.); (F.M.)
- Instituto de Telecomunicações, Delegação da Covilhã, 6201-001 Covilhã, Portugal
| |
Collapse
|
29
|
Mehringer W, Stoeve M, Krauss D, Ring M, Steussloff F, Güttes M, Zott J, Hohberger B, Michelson G, Eskofier B. Virtual reality for assessing stereopsis performance and eye characteristics in Post-COVID. Sci Rep 2023; 13:13167. [PMID: 37574496 PMCID: PMC10423723 DOI: 10.1038/s41598-023-40263-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2023] [Accepted: 08/08/2023] [Indexed: 08/15/2023] Open
Abstract
In 2019, we faced a pandemic due to the coronavirus disease (COVID-19), with millions of confirmed cases and reported deaths. Even in recovered patients, symptoms can be persistent over weeks, termed Post-COVID. In addition to common symptoms of fatigue, muscle weakness, and cognitive impairments, visual impairments have been reported. Automatic classification of COVID and Post-COVID is researched based on blood samples and radiation-based procedures, among others. However, a symptom-oriented assessment for visual impairments is still missing. Thus, we propose a Virtual Reality environment in which stereoscopic stimuli are displayed to test the patient's stereopsis performance. While performing the visual tasks, the eyes' gaze and pupil diameter are recorded. We collected data from 15 controls and 20 Post-COVID patients in a study. Therefrom, we extracted features of three main data groups, stereopsis performance, pupil diameter, and gaze behavior, and trained various classifiers. The Random Forest classifier achieved the best result with 71% accuracy. The recorded data support the classification result showing worse stereopsis performance and eye movement alterations in Post-COVID. There are limitations in the study design, comprising a small sample size and the use of an eye tracking system.
Collapse
Affiliation(s)
- Wolfgang Mehringer
- Machine Learning and Data Analytics Lab (MaD Lab), Department Artificial Intelligence in Biomedical Engineering (AIBE), Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91052, Erlangen, Bavaria, Germany.
| | - Maike Stoeve
- Machine Learning and Data Analytics Lab (MaD Lab), Department Artificial Intelligence in Biomedical Engineering (AIBE), Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91052, Erlangen, Bavaria, Germany
| | - Daniel Krauss
- Machine Learning and Data Analytics Lab (MaD Lab), Department Artificial Intelligence in Biomedical Engineering (AIBE), Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91052, Erlangen, Bavaria, Germany
| | - Matthias Ring
- Machine Learning and Data Analytics Lab (MaD Lab), Department Artificial Intelligence in Biomedical Engineering (AIBE), Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91052, Erlangen, Bavaria, Germany
| | - Fritz Steussloff
- Department of Ophthalmology, Universitätsklinikum Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg, 91054, Erlangen, Germany
| | - Moritz Güttes
- Department of Ophthalmology, Universitätsklinikum Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg, 91054, Erlangen, Germany
| | - Julia Zott
- Department of Ophthalmology, Universitätsklinikum Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg, 91054, Erlangen, Germany
| | - Bettina Hohberger
- Department of Ophthalmology, Universitätsklinikum Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg, 91054, Erlangen, Germany
| | - Georg Michelson
- Department of Ophthalmology, Universitätsklinikum Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg, 91054, Erlangen, Germany
- Talkingeyes & More GmbH, 91052, Erlangen, Bavaria, Germany
| | - Bjoern Eskofier
- Machine Learning and Data Analytics Lab (MaD Lab), Department Artificial Intelligence in Biomedical Engineering (AIBE), Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91052, Erlangen, Bavaria, Germany
| |
Collapse
|
30
|
Gao J, Zhao L, Zhong T, Li C, He Z, Wei Y, Zhang S, Guo L, Liu T, Han J, Jiang X, Zhang T. Prediction of cognitive scores by joint use of movie-watching fMRI connectivity and eye tracking via Attention-CensNet. PSYCHORADIOLOGY 2023; 3:kkad011. [PMID: 38666131 PMCID: PMC10939348 DOI: 10.1093/psyrad/kkad011] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/05/2023] [Revised: 06/14/2023] [Accepted: 07/06/2023] [Indexed: 04/28/2024]
Abstract
Background Brain functional connectivity under the naturalistic paradigm has been shown to be better at predicting individual behaviors than other brain states, such as rest and doing tasks. Nevertheless, the state-of-the-art methods have found it difficult to achieve desirable results from movie-watching paradigm functional magnetic resonance imaging (mfMRI) -induced brain functional connectivity, especially when there are fewer datasets. Incorporating other physical measurements into the prediction method may enhance accuracy. Eye tracking, becoming popular due to its portability and lower expense, can provide abundant behavioral features related to the output of human's cognition, and thus might supplement the mfMRI in observing participants' subconscious behaviors. However, there are very few studies on how to effectively integrate the multimodal information to strengthen the performance by a unified framework. Objective A fusion approach with mfMRI and eye tracking, based on convolution with edge-node switching in graph neural networks (CensNet), is proposed in this article. Methods In this graph model, participants are designated as nodes, mfMRI derived functional connectivity as node features, and different eye-tracking features are used to compute similarity between participants to construct heterogeneous graph edges. By taking multiple graphs as different channels, we introduce squeeze-and-excitation attention module to CensNet (A-CensNet) to integrate graph embeddings from multiple channels into one. Results The proposed model outperforms those using a single modality and single channel, and state-of-the-art methods. Conclusions The results indicate that brain functional activities and eye behaviors might complement each other in interpreting trait-like phenotypes.
Collapse
Affiliation(s)
- Jiaxing Gao
- School of Automation, Northwestern Polytechnical University, Xi'an 710072, China
| | - Lin Zhao
- Cortical Architecture Imaging and Discovery Laboratory, Department of Computer Science and Bioimaging Research Center, The University of Georgia, Athens, GA 30602, USA
| | - Tianyang Zhong
- School of Automation, Northwestern Polytechnical University, Xi'an 710072, China
| | - Changhe Li
- School of Automation, Northwestern Polytechnical University, Xi'an 710072, China
| | - Zhibin He
- School of Automation, Northwestern Polytechnical University, Xi'an 710072, China
| | - Yaonei Wei
- School of Automation, Northwestern Polytechnical University, Xi'an 710072, China
| | - Shu Zhang
- School of Computer Science, Northwestern Polytechnical University, Xi'an 710072, China
| | - Lei Guo
- School of Automation, Northwestern Polytechnical University, Xi'an 710072, China
| | - Tianming Liu
- Cortical Architecture Imaging and Discovery Laboratory, Department of Computer Science and Bioimaging Research Center, The University of Georgia, Athens, GA 30602, USA
| | - Junwei Han
- School of Automation, Northwestern Polytechnical University, Xi'an 710072, China
| | - Xi Jiang
- School of Life Science and Technology, MOE Key Laboratory for Neuroinformation, University of Electronic Science and Technology of China, Chengdu 611731, China
| | - Tuo Zhang
- School of Automation, Northwestern Polytechnical University, Xi'an 710072, China
| |
Collapse
|
31
|
Zheng Y, Liu C, Lai NYG, Wang Q, Xia Q, Sun X, Zhang S. Current development of biosensing technologies towards diagnosis of mental diseases. Front Bioeng Biotechnol 2023; 11:1190211. [PMID: 37456720 PMCID: PMC10342212 DOI: 10.3389/fbioe.2023.1190211] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2023] [Accepted: 06/16/2023] [Indexed: 07/18/2023] Open
Abstract
The biosensor is an instrument that converts the concentration of biomarkers into electrical signals for detection. Biosensing technology is non-invasive, lightweight, automated, and biocompatible in nature. These features have significantly advanced medical diagnosis, particularly in the diagnosis of mental disorder in recent years. The traditional method of diagnosing mental disorders is time-intensive, expensive, and subject to individual interpretation. It involves a combination of the clinical experience by the psychiatrist and the physical symptoms and self-reported scales provided by the patient. Biosensors on the other hand can objectively and continually detect disease states by monitoring abnormal data in biomarkers. Hence, this paper reviews the application of biosensors in the detection of mental diseases, and the diagnostic methods are divided into five sub-themes of biosensors based on vision, EEG signal, EOG signal, and multi-signal. A prospective application in clinical diagnosis is also discussed.
Collapse
Affiliation(s)
- Yuhan Zheng
- Faculty of Science and Engineering, University of Nottingham Ningbo China, Ningbo, China
- Ningbo Research Center, Ningbo Innovation Center, Zhejiang University, Ningbo, China
- Robotics Institute, Ningbo University of Technology, Ningbo, China
| | - Chen Liu
- Faculty of Science and Engineering, University of Nottingham Ningbo China, Ningbo, China
- Ningbo Research Center, Ningbo Innovation Center, Zhejiang University, Ningbo, China
| | - Nai Yeen Gavin Lai
- Faculty of Science and Engineering, University of Nottingham Ningbo China, Ningbo, China
| | - Qingfeng Wang
- Nottingham Ningbo China Beacons of Excellence Research and Innovation Institute, University of Nottingham Ningbo China, Ningbo, China
| | - Qinghua Xia
- Ningbo Research Center, Ningbo Innovation Center, Zhejiang University, Ningbo, China
| | - Xu Sun
- Faculty of Science and Engineering, University of Nottingham Ningbo China, Ningbo, China
- Nottingham Ningbo China Beacons of Excellence Research and Innovation Institute, University of Nottingham Ningbo China, Ningbo, China
| | - Sheng Zhang
- Faculty of Science and Engineering, University of Nottingham Ningbo China, Ningbo, China
- Ningbo Research Center, Ningbo Innovation Center, Zhejiang University, Ningbo, China
- School of Mechanical Engineering, Zhejiang University, Hangzhou, China
| |
Collapse
|
32
|
Yarmolovsky J, Sabag M, Lipschits O, Geva R. Parents regulate arousal while sharing experiences with their child: a study of pupil diameter change responses. Front Hum Neurosci 2023; 17:1177687. [PMID: 37397856 PMCID: PMC10312006 DOI: 10.3389/fnhum.2023.1177687] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2023] [Accepted: 06/02/2023] [Indexed: 07/04/2023] Open
Abstract
Introduction Parents provide their children with their first exposures to reciprocal shared experiences, and parental modeling of socio-emotional behaviors and regulatory responses largely influences their child's behavioral and neurological development. Some parental reactions are conscious, while others are non-volitional. This project aimed to explore parent-child pupil dilation change responses during shared interactions, specifically, whether parents' neuro-regulatory responses when sharing experiences with their child are different than responses of children interacting with their parents or children and adult peers sharing with each other. Methods To test this, four distinct interacting groups were recruited: (1) Parents sharing with their child; (2) Children sharing with their parent; (3) Children sharing with peers; and (4) Adults sharing with peers. All dyads engaged in a computerized shared imagery task, which facilitates communication and mental imagery during a shared experience. During the task, pupil diameter change was recorded as a measure of regulatory response. Results Findings highlight that parents sharing with their child have lower pupil diameter change than children sharing with their parents (p < 0.01), children sharing with peers (p < 0.01), and adults sharing with peers (p < 0.05), While no differences were seen between children sharing with parents, children sharing with peers or adults sharing with peers. Discussion Findings deepen the understanding of the neuroscience of parenting, by suggesting that parents, even of older children and adolescents, tend to regulate their arousal when interacting with their child, a response that proves to be unique compared to other dyad types for sharing experiences. Considering this dynamic, findings may direct future parent-led intervention methods to improve the child's socio-emotional development.
Collapse
Affiliation(s)
- Jessica Yarmolovsky
- The Developmental Neuropsychology Laboratory, The Department of Psychology, Bar-Ilan University, Ramat Gan, Israel
| | - Maya Sabag
- The Developmental Neuropsychology Laboratory, The Department of Psychology, Bar-Ilan University, Ramat Gan, Israel
- The Susan Gonda Brain Research Center, Bar-Ilan University, Ramat Gan, Israel
| | - Or Lipschits
- The Developmental Neuropsychology Laboratory, The Department of Psychology, Bar-Ilan University, Ramat Gan, Israel
- The Susan Gonda Brain Research Center, Bar-Ilan University, Ramat Gan, Israel
| | - Ronny Geva
- The Developmental Neuropsychology Laboratory, The Department of Psychology, Bar-Ilan University, Ramat Gan, Israel
- The Susan Gonda Brain Research Center, Bar-Ilan University, Ramat Gan, Israel
| |
Collapse
|
33
|
Liu C, Liu H, Tan Z. Choosing optimal means of knowledge visualization based on eye tracking for online education. EDUCATION AND INFORMATION TECHNOLOGIES 2023:1-28. [PMID: 37361846 PMCID: PMC10152425 DOI: 10.1007/s10639-023-11815-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/11/2022] [Accepted: 04/13/2023] [Indexed: 06/28/2023]
Abstract
In online education, the appropriate choice of means of knowledge visualization can reduce cognitive load and improve cognitive efficiency. However, no universal basis for selection can cause confusion in the pedagogical context. This study used the revised Bloom's taxonomy to combine the types of knowledge with cognitive goals. We used a course on marketing research as an example to summarize the choices for visualizing factual knowledge (FK), conceptual knowledge (CK), procedural knowledge (PK), and metacognitive knowledge (MK) through four experiments. Visualized cognitive stages were used to determine the cognitive efficiencies of visualization for different knowledge types. In this stage, eye tracking is used for collecting eye movement indicators to measure cognitive load. The cognitive goals stage is used to get cognitive goals of the means of knowledge visualization. Combining the two stages, we get the conclusions as follows: Teachers and students can mostly benefit from presenting FK and CK points via mind maps. Using mind maps to teach FK online could be indirectly beneficial for improving students' creativity. Concept maps may be chosen for this point if the linked knowledge points are PK and the achievement of the analytical objective is emphasized in the student's knowledge points. The flowchart can be used to display PK, while timelines could be utilized if the PK point is to be presented in a temporal dimension. Teachers should choose the curve area chart to display MK. A pie chart might be chosen and added more instructions. The findings suggest that mind maps are very effective as a means of knowledge visualization in online education. In the meantime, it suggests that overly simplistic graphs increase cognitive load, while it also raises the possibility that redundant information in the text may increase cognitive load.
Collapse
Affiliation(s)
- Chan Liu
- School of Management, China University of Mining & Technology-Beijing, Beijing, 100083 China
| | - Hao Liu
- Northeastern University at Qinhuangdao, Qinhuangdao, 066004 China
| | - Zhanglu Tan
- School of Management, China University of Mining & Technology-Beijing, Beijing, 100083 China
| |
Collapse
|
34
|
Heijsters FACJ, van Loon GAP, Santema JMM, Mullender MG, Bouman M, de Bruijne MC, van Nassau F. A usability evaluation of the perceived user friendliness, accessibility, and inclusiveness of a personalized digital care pathway tool. Int J Med Inform 2023; 175:105070. [PMID: 37121138 DOI: 10.1016/j.ijmedinf.2023.105070] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2022] [Revised: 04/10/2023] [Accepted: 04/11/2023] [Indexed: 05/02/2023]
Abstract
OBJECTIVE This study aimed to acquire insight into the perceived user friendliness, accessibility and inclusiveness of a personalized digital care pathway. MATERIALS & METHODS Usability of the tool was tested in an experimental setting. Mixed methods data collection consisted of scenario-based eye tracking tests in a web- or mobile-based prototype of the tool, followed by a questionnaire assessing user friendliness (System Usability Scale; SUS) and a structured interview. Inclusiveness was assessed by subgroup comparisons based on language proficiency, age and education level. Via purposive sampling a heterogeneous population of users (N = 24) was recruited. Eye tracking was used to measure gaze behavior. RESULTS Overall, participants were satisfied with the tool (scale 0-10, 7.5; SD = 1.29). User friendliness of the mobile version (68.3; SD = 21.6) was higher than the web version (50.9; SD = 17.3) measured by SUS score (0-100). With regard to accessibility, eye tracking scenarios showed that the menu bar was hard to find (17% mobile, 55% web). In all scenario's, information was found faster in the mobile version than the web version. Attention was easily drawn to images. Regarding inclusiveness of the tool, we found significantly longer completing time of the scenario tasks for low language proficiency (p-value = 0.029) and higher age subgroups (p-value = 0.049). Lower language proficiency scored a significant lower SUS score (p-value = 0.012). CONCLUSIONS Overall, user friendliness and accessibility were positively evaluated. Assessment of inclusiveness emphasized the need for tailoring digital tools to those with low language proficiency and/or an older age. Co-creation of digital care tools with users is therefore important to match users' needs, make tools easily understandable and accessible to all users, and ultimately result in better uptake and impact.
Collapse
Affiliation(s)
- F A C J Heijsters
- Amsterdam UMC Location Vrije Universiteit Amsterdam, Department of Plastic, Reconstructive and Hand Surgery, De Boelelaan 1117, Amsterdam, the Netherlands; Amsterdam UMC Location Vrije Universiteit Amsterdam, Department of Strategy and Innovation, De Boelelaan 1117, Amsterdam, the Netherlands.
| | | | - J M M Santema
- Amsterdam UMC Location Vrije Universiteit Amsterdam, Department of Plastic, Reconstructive and Hand Surgery, De Boelelaan 1117, Amsterdam, the Netherlands.
| | - M G Mullender
- Amsterdam UMC Location Vrije Universiteit Amsterdam, Department of Plastic, Reconstructive and Hand Surgery, De Boelelaan 1117, Amsterdam, the Netherlands.
| | - M Bouman
- Amsterdam UMC Location Vrije Universiteit Amsterdam, Department of Plastic, Reconstructive and Hand Surgery, De Boelelaan 1117, Amsterdam, the Netherlands.
| | - M C de Bruijne
- Amsterdam UMC Location Vrije Universiteit Amsterdam, Department of Public and Occupational Health, De Boelelaan 1117, Amsterdam, the Netherlands; Amsterdam Public Health Research Institute, Quality of Care, Amsterdam, the Netherlands.
| | - F van Nassau
- Amsterdam UMC Location Vrije Universiteit Amsterdam, Department of Public and Occupational Health, De Boelelaan 1117, Amsterdam, the Netherlands; Amsterdam Public Health Research Institute, Health Behaviors and Chronic Diseases, Amsterdam, the Netherlands.
| |
Collapse
|
35
|
Schroeder PA, Artemenko C, Kosie JE, Cockx H, Stute K, Pereira J, Klein F, Mehler DMA. Using preregistration as a tool for transparent fNIRS study design. NEUROPHOTONICS 2023; 10:023515. [PMID: 36908680 PMCID: PMC9993433 DOI: 10.1117/1.nph.10.2.023515] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/09/2022] [Accepted: 01/11/2023] [Indexed: 05/04/2023]
Abstract
Significance The expansion of functional near-infrared spectroscopy (fNIRS) methodology and analysis tools gives rise to various design and analytical decisions that researchers have to make. Several recent efforts have developed guidelines for preprocessing, analyzing, and reporting practices. For the planning stage of fNIRS studies, similar guidance is desirable. Study preregistration helps researchers to transparently document study protocols before conducting the study, including materials, methods, and analyses, and thus, others to verify, understand, and reproduce a study. Preregistration can thus serve as a useful tool for transparent, careful, and comprehensive fNIRS study design. Aim We aim to create a guide on the design and analysis steps involved in fNIRS studies and to provide a preregistration template specified for fNIRS studies. Approach The presented preregistration guide has a strong focus on fNIRS specific requirements, and the associated template provides examples based on continuous-wave (CW) fNIRS studies conducted in humans. These can, however, be extended to other types of fNIRS studies. Results On a step-by-step basis, we walk the fNIRS user through key methodological and analysis-related aspects central to a comprehensive fNIRS study design. These include items specific to the design of CW, task-based fNIRS studies, but also sections that are of general importance, including an in-depth elaboration on sample size planning. Conclusions Our guide introduces these open science tools to the fNIRS community, providing researchers with an overview of key design aspects and specification recommendations for comprehensive study planning. As such it can be used as a template to preregister fNIRS studies or merely as a tool for transparent fNIRS study design.
Collapse
Affiliation(s)
- Philipp A. Schroeder
- University of Tuebingen, Department of Psychology, Faculty of Science, Tuebingen, Germany
| | - Christina Artemenko
- University of Tuebingen, Department of Psychology, Faculty of Science, Tuebingen, Germany
| | - Jessica E. Kosie
- Princeton University, Social and Natural Sciences, Department of Psychology, Princeton, New Jersey, United States
| | - Helena Cockx
- Radboud University, Donders Institute for Brain, Cognition and Behaviour, Biophysics Department, Faculty of Science, Nijmegen, The Netherlands
| | - Katharina Stute
- Chemnitz University of Technology, Institute of Human Movement Science and Health, Faculty of Behavioural and Social Sciences, Chemnitz, Germany
| | - João Pereira
- University of Coimbra, Coimbra Institute for Biomedical Imaging and Translational Research, Coimbra, Portugal
| | - Franziska Klein
- University of Oldenburg, Department of Psychology, Neurocognition and functional Neurorehabilitation Group, Oldenburg (Oldb), Germany
- RWTH Aachen University, Medical School, Department of Psychiatry, Psychotherapy and Psychosomatics, Aachen, Germany
| | - David M. A. Mehler
- RWTH Aachen University, Medical School, Department of Psychiatry, Psychotherapy and Psychosomatics, Aachen, Germany
- University of Münster, Institute for Translational Psychiatry, Medical School, Münster, Germany
| |
Collapse
|
36
|
Adhikari K. Application of selected neuroscientific methods in consumer sensory analysis: A review. J Food Sci 2023; 88:53-64. [PMID: 36915966 DOI: 10.1111/1750-3841.16526] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2022] [Revised: 02/19/2023] [Accepted: 02/21/2023] [Indexed: 03/15/2023]
Abstract
Neuromarketing or consumer neuroscience is a relatively new market research subdiscipline that has gained popularity among consumer behavior scientists in the past two decades or so. It combines neurobiology with behavioral psychology to understand consumer behavior, more specifically about their decisions related to choices/preferences and purchase. The purpose of this review is to explore the potential of using neuroscientific methods for consumer sensory science research. By no means, this is an exhaustive review hindered by the fact that there are countless articles on neuromarketing and consumer neuroscience in the literature. The author has tried to show the applicability of neuroscientific methods in consumer sensory sciences, specifically electroencephalography and eye tracking, which could potentially "complement" the sensory methodologies to gain better consumer insight. Both these techniques are relatively inexpensive, portable, and minimally invasive techniques that are already being used by some sensory scientists. They could be incorporated with ease in the research portfolio of consumer sensory researchers who would like to use them to study consumer affect. It is recommended that the researchers use proper experimental design that takes into consideration the confounding variables as much as possible. The two methods mentioned before have been proven to be relatively reliable and repeatable. Lastly, these methods would also require ethical oversight because of the involvement of human subjects.
Collapse
Affiliation(s)
- Koushik Adhikari
- Department of Food Science and Technology, University of Georgia, Griffin, Georgia, USA
| |
Collapse
|
37
|
Liu Y, Odic D, Tang X, Ma A, Laricheva M, Chen G, Wu S, Niu M, Guo Y, Milner-Bolotin M. Effects of Robotics Education on Young Children's Cognitive Development: a Pilot Study with Eye-Tracking. JOURNAL OF SCIENCE EDUCATION AND TECHNOLOGY 2023; 32:295-308. [PMID: 37113265 PMCID: PMC9988604 DOI: 10.1007/s10956-023-10028-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Accepted: 01/11/2023] [Indexed: 06/19/2023]
Abstract
The emerging field of robotics education (RE) is a new and rapidly growing subject area worldwide. It may provide a playful and novel learning environment for children to engage with all aspects of science, technology, engineering, and mathematics (STEM) learning. The purpose of this research is to examine how robotics learning activities may affect the cognitive abilities and cognitive processes of 6-8 years old children. The study adopted the mixed methods approach with a repeated measures design; three waves of data collection over 6 months, including quantitative data obtained from cognitive assessments and eye-tracking, and qualitative data from the interviews. A total of 31 children were recruited from an afterschool robotics program. To the best of our knowledge, this study is the first RE research that used a combination of eye-tracking, cognitive assessments, and interviews for examining the effect of RE on children. Using linear growth models, the results of cognitive assessments showed that children's visuospatial working memory as well as logical and abstract reasoning skills improved over time. The interview data were analyzed by a thematic analysis. The results revealed that children perceived RE activities as game play, which made children more engaged in their study; parents found their children to be more focused on activities comparing to six months ago. Additionally, the visualization of the eye-tracking data suggested that children became more focused on RE activities and got faster to process the information across six months in general, which echoed the findings in assessments and interviews. Our findings may help educators and policymakers better understand the benefits of RE for young children.
Collapse
Affiliation(s)
- Yan Liu
- Department of Psychology, Carleton University, B546 Loeb | 1125 Colonel By Drive, Ottawa, ON K1S 5B6 Canada
| | - Darko Odic
- Department of Psychology, The University of British Columbia, Vancouver, BC Canada
| | - Xuyan Tang
- Department of Educational and Counseling Psychology & Special Education, The University of British Columbia, Vancouver, BC Canada
| | - Andy Ma
- Department of Curriculum and Pedagogy, The University of British Columbia, Vancouver, BC Canada
| | - Maria Laricheva
- Department of Educational and Counseling Psychology & Special Education, The University of British Columbia, Vancouver, BC Canada
| | - Guanyu Chen
- Department of Educational and Counseling Psychology & Special Education, The University of British Columbia, Vancouver, BC Canada
| | - Sirui Wu
- Department of Educational and Counseling Psychology & Special Education, The University of British Columbia, Vancouver, BC Canada
| | - Man Niu
- Department of Educational and Counseling Psychology & Special Education, The University of British Columbia, Vancouver, BC Canada
| | - Yue Guo
- Department of Educational and Counseling Psychology & Special Education, The University of British Columbia, Vancouver, BC Canada
| | - Marina Milner-Bolotin
- Department of Curriculum and Pedagogy, The University of British Columbia, Vancouver, BC Canada
| |
Collapse
|
38
|
Santos SMP, Fernandes NL, Pandeirada JNS. Same but different: The influence of context framing on subjective disgust, eye movements and pupillary responses. Conscious Cogn 2023; 108:103462. [PMID: 36621056 DOI: 10.1016/j.concog.2022.103462] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2022] [Revised: 12/20/2022] [Accepted: 12/20/2022] [Indexed: 01/09/2023]
Abstract
The adaptive value of disgust has been associated with situations of threat to our survival. This study explored this topic using eye-tracking, which provides an objective measurement of attention, while solving previous methodological issues (e.g., not considering discrete emotions and comparing across perceptually-different stimuli). We used the same stimuli and manipulated the emotional state via contextual framing. Participants' eye movements and pupillary responses were recorded while they explored pictures of objects held by clean or dirty hands; the latter were framed in a disease or a non-disease context. Pictures were then rated for arousal, disgust, and valence. Framing stimuli in a disease (vs non-disease) context induced a more adverse subjective emotional experience. Importantly, our objective measures revealed that such manipulation also led to a higher information-seeking behavior and greater pupil constriction. Overall, our data suggest that the same stimuli can effectively be used to induce different emotional states by manipulating their framing.
Collapse
Affiliation(s)
- Sónia M P Santos
- William James Center for Research, Department of Education and Psychology, University of Aveiro, Aveiro, Portugal
| | - Natália Lisandra Fernandes
- William James Center for Research, Department of Education and Psychology, University of Aveiro, Aveiro, Portugal
| | - Josefa N S Pandeirada
- William James Center for Research, Department of Education and Psychology, University of Aveiro, Aveiro, Portugal.
| |
Collapse
|
39
|
Stefan AM, Schönbrodt FD. Big little lies: a compendium and simulation of p-hacking strategies. ROYAL SOCIETY OPEN SCIENCE 2023; 10:220346. [PMID: 36778954 PMCID: PMC9905987 DOI: 10.1098/rsos.220346] [Citation(s) in RCA: 11] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/17/2022] [Accepted: 01/11/2023] [Indexed: 06/18/2023]
Abstract
In many research fields, the widespread use of questionable research practices has jeopardized the credibility of scientific results. One of the most prominent questionable research practices is p-hacking. Typically, p-hacking is defined as a compound of strategies targeted at rendering non-significant hypothesis testing results significant. However, a comprehensive overview of these p-hacking strategies is missing, and current meta-scientific research often ignores the heterogeneity of strategies. Here, we compile a list of 12 p-hacking strategies based on an extensive literature review, identify factors that control their level of severity, and demonstrate their impact on false-positive rates using simulation studies. We also use our simulation results to evaluate several approaches that have been proposed to mitigate the influence of questionable research practices. Our results show that investigating p-hacking at the level of strategies can provide a better understanding of the process of p-hacking, as well as a broader basis for developing effective countermeasures. By making our analyses available through a Shiny app and R package, we facilitate future meta-scientific research aimed at investigating the ramifications of p-hacking across multiple strategies, and we hope to start a broader discussion about different manifestations of p-hacking in practice.
Collapse
Affiliation(s)
- Angelika M. Stefan
- Department of Psychology, University of Amsterdam, Amsterdam, The Netherlands
- Department of Psychology, Universität der Bundeswehr München, München, Germany
| | - Felix D. Schönbrodt
- Department of Psychology, Ludwig-Maximilians-Universität München, Munchen, Germany
| |
Collapse
|
40
|
Li S, Duffy MC, Lajoie SP, Zheng J, Lachapelle K. Using eye tracking to examine expert-novice differences during simulated surgical training: A case study. COMPUTERS IN HUMAN BEHAVIOR 2023. [DOI: 10.1016/j.chb.2023.107720] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/03/2023]
|
41
|
Cho VY, Loh XH, Abbott L, Mohd-Isa NA, Anthonappa RP. Reporting Eye-tracking Studies In DEntistry (RESIDE) checklist. J Dent 2023; 129:104359. [PMID: 36403692 DOI: 10.1016/j.jdent.2022.104359] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2022] [Revised: 10/18/2022] [Accepted: 11/05/2022] [Indexed: 11/18/2022] Open
Abstract
OBJECTIVES To (i) provide a scoping review of eye-tracking studies in dentistry, and (ii) propose a "Reporting Eye-tracking Studies in DEntistry" (RESIDE) checklist to facilitate standard reporting of eye-tracking studies. DATA A comprehensive search of six distinct electronic databases was undertaken. SOURCES Pubmed, OVID, Wed of Knowledge, Scopus, Cochrane and Google Scholar were used to identify studies that employed eye-tracking technology and dentistry as a subfield STUDY SELECTION: 42 studies met the inclusion criteria. Most studies exhibited several inconsistencies or failed to report on the appropriate items in the RESIDE checklist. These essential components include ethical approval, sample size calculation, location and setting, eye-tracking device attributes, participant calibration, sequence of events, and eye-tracking metrics (quantitative, qualitative and data details). CONCLUSIONS Evaluation of the published eye-tracking studies in this scoping review provides empirical data, highlighting the inconsistencies and limitations. Importantly, it illustrates the applicability of the RESIDE Checklist, which provides a comprehensive list of reporting elements to assist authors and reviewers of eye-tracking studies in dentistry. Also, RESIDE provides a framework to overcome critical issues to ensure high-quality scientific publications. CLINICAL SIGNIFICANCE A minimum threshold should be applied before accepting eye-tracking studies for publication in the future. RESIDE checklist promotes transparent and reproducible scientific communication about eye-tracking applications to dentistry. In addition, it provides a comprehensive list of reporting elements to assist authors and reviewers in ensuring high-quality scientific publications.
Collapse
Affiliation(s)
- Vanessa Y Cho
- Dental School, The University of Western Australia, 17 Monash Ave, Nedlands 6009, Perth, Australia.
| | - Xin Hui Loh
- Dental School, The University of Western Australia, 17 Monash Ave, Nedlands 6009, Perth, Australia.
| | - Lyndon Abbott
- Dental School, The University of Western Australia, 17 Monash Ave, Nedlands 6009, Perth, Australia.
| | - Nur Anisah Mohd-Isa
- Dental School, The University of Western Australia, 17 Monash Ave, Nedlands 6009, Perth, Australia.
| | - Robert P Anthonappa
- Dental School, The University of Western Australia, 17 Monash Ave, Nedlands 6009, Perth, Australia.
| |
Collapse
|
42
|
Ben Itzhak N, Kooiker MJG, Pel JJM, Ortibus E. Including visual orienting functions into cerebral visual impairment screening: Reliability, variability, and ecological validity. RESEARCH IN DEVELOPMENTAL DISABILITIES 2023; 132:104391. [PMID: 36493737 DOI: 10.1016/j.ridd.2022.104391] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/12/2022] [Revised: 11/24/2022] [Accepted: 11/29/2022] [Indexed: 06/17/2023]
Abstract
BACKGROUND Cerebral visual impairment (CVI) is a heterogeneous brain-based visual processing disorder in which basic visual orienting functions (VOF) and higher-order perception can be impaired. AIMS To evaluate (1) the test-retest reliability and variability of an eye tracking-based VOF paradigm, and related clinical characteristics, and (2) the relations between VOF (variability) and daily visual functioning and visuoperceptual dimensions. METHODS AND PROCEDURES Thirty-three children with CVI (Males=14; mean age=9 years 10 months) underwent eye tracking thrice, completed a visuoperceptual battery, and parents completed the Flemish CVI questionnaire. VOF reliability and variability of reaction time (RTF), fixation duration and accuracy were assessed with intraclass correlation coefficient (ICC), Bland-Altman plots, and coefficient of variation. Relations were analysed with linear mixed models. OUTCOMES AND RESULTS Highly salient visual stimuli had good RTF reliability (ICCs=0.75) and triggered less variable VOF. Intermediate and low salience stimuli had poor-to-moderate reliability and triggered more variable VOF. Younger performance age related to more VOF variability. Greater visual (dis)interest, clutter and distance viewing impairments, and a weaker visuoperceptual profile related to slower RTF. CONCLUSIONS AND IMPLICATIONS Highly salient stimuli reveal a child's 'optimal' visual performance, whereas intermediate and low salience stimuli uncover VOF variability, which is a key CVI hallmark to detect.
Collapse
Affiliation(s)
- N Ben Itzhak
- Department of Development and Regeneration, University of Leuven (KU Leuven), Leuven, Belgium; Child Youth Institute (L-C&Y), Leuven, Belgium.
| | - M J G Kooiker
- Vestibular and Ocular Motor Research Group, Department of Neuroscience, Erasmus MC, Rotterdam, the Netherlands; Royal Dutch Visio, Amsterdam, the Netherlands
| | - J J M Pel
- Vestibular and Ocular Motor Research Group, Department of Neuroscience, Erasmus MC, Rotterdam, the Netherlands
| | - E Ortibus
- Department of Development and Regeneration, University of Leuven (KU Leuven), Leuven, Belgium; Child Youth Institute (L-C&Y), Leuven, Belgium
| |
Collapse
|
43
|
Holmqvist K, Örbom SL, Hooge ITC, Niehorster DC, Alexander RG, Andersson R, Benjamins JS, Blignaut P, Brouwer AM, Chuang LL, Dalrymple KA, Drieghe D, Dunn MJ, Ettinger U, Fiedler S, Foulsham T, van der Geest JN, Hansen DW, Hutton SB, Kasneci E, Kingstone A, Knox PC, Kok EM, Lee H, Lee JY, Leppänen JM, Macknik S, Majaranta P, Martinez-Conde S, Nuthmann A, Nyström M, Orquin JL, Otero-Millan J, Park SY, Popelka S, Proudlock F, Renkewitz F, Roorda A, Schulte-Mecklenbeck M, Sharif B, Shic F, Shovman M, Thomas MG, Venrooij W, Zemblys R, Hessels RS. Eye tracking: empirical foundations for a minimal reporting guideline. Behav Res Methods 2023; 55:364-416. [PMID: 35384605 PMCID: PMC9535040 DOI: 10.3758/s13428-021-01762-8] [Citation(s) in RCA: 45] [Impact Index Per Article: 45.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/29/2021] [Indexed: 11/08/2022]
Abstract
In this paper, we present a review of how the various aspects of any study using an eye tracker (such as the instrument, methodology, environment, participant, etc.) affect the quality of the recorded eye-tracking data and the obtained eye-movement and gaze measures. We take this review to represent the empirical foundation for reporting guidelines of any study involving an eye tracker. We compare this empirical foundation to five existing reporting guidelines and to a database of 207 published eye-tracking studies. We find that reporting guidelines vary substantially and do not match with actual reporting practices. We end by deriving a minimal, flexible reporting guideline based on empirical research (Section "An empirically based minimal reporting guideline").
Collapse
Affiliation(s)
- Kenneth Holmqvist
- Department of Psychology, Nicolaus Copernicus University, Torun, Poland.
- Department of Computer Science and Informatics, University of the Free State, Bloemfontein, South Africa.
- Department of Psychology, Regensburg University, Regensburg, Germany.
| | - Saga Lee Örbom
- Department of Psychology, Regensburg University, Regensburg, Germany
| | - Ignace T C Hooge
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, The Netherlands
| | - Diederick C Niehorster
- Lund University Humanities Lab and Department of Psychology, Lund University, Lund, Sweden
| | - Robert G Alexander
- Department of Ophthalmology, SUNY Downstate Health Sciences University, Brooklyn, NY, USA
| | | | - Jeroen S Benjamins
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, The Netherlands
- Social, Health and Organizational Psychology, Utrecht University, Utrecht, The Netherlands
| | - Pieter Blignaut
- Department of Computer Science and Informatics, University of the Free State, Bloemfontein, South Africa
| | | | - Lewis L Chuang
- Department of Ergonomics, Leibniz Institute for Working Environments and Human Factors, Dortmund, Germany
- Institute of Informatics, LMU Munich, Munich, Germany
| | | | - Denis Drieghe
- School of Psychology, University of Southampton, Southampton, UK
| | - Matt J Dunn
- School of Optometry and Vision Sciences, Cardiff University, Cardiff, UK
| | | | - Susann Fiedler
- Vienna University of Economics and Business, Vienna, Austria
| | - Tom Foulsham
- Department of Psychology, University of Essex, Essex, UK
| | | | - Dan Witzner Hansen
- Machine Learning Group, Department of Computer Science, IT University of Copenhagen, Copenhagen, Denmark
| | | | - Enkelejda Kasneci
- Human-Computer Interaction, University of Tübingen, Tübingen, Germany
| | | | - Paul C Knox
- Department of Eye and Vision Science, Institute of Life Course and Medical Sciences, University of Liverpool, Liverpool, UK
| | - Ellen M Kok
- Department of Education and Pedagogy, Division Education, Faculty of Social and Behavioral Sciences, Utrecht University, Utrecht, The Netherlands
- Department of Online Learning and Instruction, Faculty of Educational Sciences, Open University of the Netherlands, Heerlen, The Netherlands
| | - Helena Lee
- University of Southampton, Southampton, UK
| | - Joy Yeonjoo Lee
- School of Health Professions Education, Faculty of Health, Medicine, and Life Sciences, Maastricht University, Maastricht, The Netherlands
| | - Jukka M Leppänen
- Department of Psychology and Speed-Language Pathology, University of Turku, Turku, Finland
| | - Stephen Macknik
- Department of Ophthalmology, SUNY Downstate Health Sciences University, Brooklyn, NY, USA
| | - Päivi Majaranta
- TAUCHI Research Center, Computing Sciences, Faculty of Information Technology and Communication Sciences, Tampere University, Tampere, Finland
| | - Susana Martinez-Conde
- Department of Ophthalmology, SUNY Downstate Health Sciences University, Brooklyn, NY, USA
| | - Antje Nuthmann
- Institute of Psychology, University of Kiel, Kiel, Germany
| | - Marcus Nyström
- Lund University Humanities Lab, Lund University, Lund, Sweden
| | - Jacob L Orquin
- Department of Management, Aarhus University, Aarhus, Denmark
- Center for Research in Marketing and Consumer Psychology, Reykjavik University, Reykjavik, Iceland
| | - Jorge Otero-Millan
- Herbert Wertheim School of Optometry and Vision Science, University of California, Berkeley, CA, USA
| | - Soon Young Park
- Comparative Cognition, Messerli Research Institute, University of Veterinary Medicine Vienna, Medical University of Vienna, Vienna, Austria
| | - Stanislav Popelka
- Department of Geoinformatics, Palacký University Olomouc, Olomouc, Czech Republic
| | - Frank Proudlock
- The University of Leicester Ulverscroft Eye Unit, Department of Neuroscience, Psychology and Behaviour, University of Leicester, Leicester, UK
| | - Frank Renkewitz
- Department of Psychology, University of Erfurt, Erfurt, Germany
| | - Austin Roorda
- Herbert Wertheim School of Optometry and Vision Science, University of California, Berkeley, CA, USA
| | | | - Bonita Sharif
- School of Computing, University of Nebraska-Lincoln, Lincoln, Nebraska, USA
| | - Frederick Shic
- Center for Child Health, Behavior and Development, Seattle Children's Research Institute, Seattle, WA, USA
- Department of General Pediatrics, University of Washington School of Medicine, Seattle, WA, USA
| | - Mark Shovman
- Eyeviation Systems, Herzliya, Israel
- Department of Industrial Design, Bezalel Academy of Arts and Design, Jerusalem, Israel
| | - Mervyn G Thomas
- The University of Leicester Ulverscroft Eye Unit, Department of Neuroscience, Psychology and Behaviour, University of Leicester, Leicester, UK
| | - Ward Venrooij
- Electrical Engineering, Mathematics and Computer Science (EEMCS), University of Twente, Enschede, The Netherlands
| | | | - Roy S Hessels
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, The Netherlands
| |
Collapse
|
44
|
Regulez BA, Montrul S. Production, acceptability, and online comprehension of Spanish differential object marking by heritage speakers and L2 learners. Front Psychol 2023; 14:1106613. [PMID: 37151345 PMCID: PMC10157495 DOI: 10.3389/fpsyg.2023.1106613] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2022] [Accepted: 02/15/2023] [Indexed: 05/09/2023] Open
Abstract
We analyzed the production, acceptability and online comprehension of Spanish differential object marking (DOM) by two groups of bilingual speakers living in the U.S.: heritage speakers and L2 learners. DOM is the overt marking of direct objects that are higher on the animacy and referentiality scales, such as animate and specific objects in Spanish, marked by the preposition a (Juan ve a María 'Juan sees DOM María'). Previous studies have reported variability and high omission rates of obligatory DOM in bilingual situations where Spanish is in contact with a non-DOM language.Our study combined different methodologies to tap knowledge of DOM in the two groups. The results showed that heritage speakers and L2 learners (1) exhibited variability with DOM in production (in two oral tasks), comprehension (in an acceptability judgement task), and processing (in an eye-tracking reading task); (2) can integrate DOM into their production, judgments and processing, but they do so inconsistently, and (3) type of task and type of sentence each have an effect on speakers' use of DOM.
Collapse
Affiliation(s)
- Begoña Arechabaleta Regulez
- Department of Romance Languages and Literatures, University of Chicago, Chicago, IL, United States
- *Correspondence: Begoña Arechabaleta Regulez,
| | - Silvina Montrul
- Department of Spanish and Portuguese, University of Illinois at Urbana-Champaign, Urbana, IL, United States
| |
Collapse
|
45
|
Concepcion-Grande P, Chamorro E, Cleva JM, Alonso J, Gómez-Pedrero JA. Correlation between reading time and characteristics of eye fixations and progressive lens design. PLoS One 2023; 18:e0281861. [PMID: 36972226 PMCID: PMC10042365 DOI: 10.1371/journal.pone.0281861] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2022] [Accepted: 02/02/2023] [Indexed: 03/29/2023] Open
Abstract
OBJECTIVE The purpose of this study is to evaluate reading time and characteristics of fixations at different distances when looking through different areas of progressive power lenses (PPL) with different power distributions by means of eye-tracking technology. METHOD A wearable eye tracker system (Tobii-Pro Glasses 3) was used to record the pupil position of 28 PPL subjects when reading at near and distance vision while using 3 different PPL designs: a PPL optimized for distance vision (PPL-Distance), a PPL optimized for near vision (PPL-Near) and one of them balanced for a general use (PPL-Balance). Subjects were asked to read out loud a text displayed on a digital screen located at 5.25m and 0.37m when they were looking through the central and peripheral regions of each PPL. Reading time, total duration of fixations, and the number of fixations were analyzed for each reading condition and PPL. Statistical analysis was carried out using Statgraphics Centurion XVII.II Software. RESULTS The analysis of eye movements at distance-reading vision showed a statistically significant lower reading time (p = 0.004) and lower total duration of fixations (p = 0.01) for PPL-Distance. At near-reading vision, PPL-Near provided statistically significant lower reading time (p<0.001), lower total duration of fixations (p = 0.02), and less fixation count(p<0.001) in comparison with PPL-Balance and PPL-Distance. CONCLUSIONS Reading time and fixations characteristics are affected by the power distribution of a PPL. A PPL design with a wider distance region provides better distance-reading performance while a PPL with a wider near area performs better at a near-reading task. The power distribution of PPLs influences the user performance at vision-based tasks. Thus, to provide the user with the best visual experience, PPL selection must consider user needs.
Collapse
Affiliation(s)
| | - Eva Chamorro
- Clinical Research Department, Indizen Optical Technologies, Madrid, Spain
| | - Jose Miguel Cleva
- Clinical Research Department, Indizen Optical Technologies, Madrid, Spain
| | - Jose Alonso
- Clinical Research Department, Indizen Optical Technologies, Madrid, Spain
| | - Jose Antonio Gómez-Pedrero
- Applied Optics Complutense Group, Optics Department, Optics and Optometry Faculty, Complutense University of Madrid, Madrid, Spain
| |
Collapse
|
46
|
Cognition Assessment Technologies on Deaf People. J Cogn 2023; 6:18. [PMID: 36910582 PMCID: PMC10000328 DOI: 10.5334/joc.262] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2022] [Accepted: 01/17/2023] [Indexed: 03/12/2023] Open
Abstract
In recent years there has been a growing interest in research about the different ways of processing and consolidating cognition in deaf people. It is known that hearing loss can lead to differences in some executive functions like control inhibitory or working memory. This literature review describes executive functions in deaf people and how they could be evaluated through technological devices complementing traditional assessments, like neuropsychological batteries. We identified biometric devices, digital and physical interfaces, and software from the literature, whose goal is to design or adapt technology to assess some cognition domains in several ways. The results of the review suggest the need to understand the cognitive phenomenon that significantly impacts the context of deaf people; moreover, it becomes relevant as a line of research in the Cognitive Science of Hearing. Using technologies to measure them and gain a better understanding of cognition in deaf people may provide possibilities for designing or adapting targeted educational or therapeutic strategies.
Collapse
|
47
|
Wei Q, Cao H, Shi Y, Xu X, Li T. Machine learning based on eye-tracking data to identify Autism Spectrum Disorder: A systematic review and meta-analysis. J Biomed Inform 2023; 137:104254. [PMID: 36509416 DOI: 10.1016/j.jbi.2022.104254] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2022] [Revised: 11/15/2022] [Accepted: 11/17/2022] [Indexed: 12/13/2022]
Abstract
BACKGROUND Machine learning has been widely used to identify Autism Spectrum Disorder (ASD) based on eye-tracking, but its accuracy is uncertain. We aimed to summarize the available evidence on the performances of machine learning algorithms in classifying ASD and typically developing (TD) individuals based on eye-tracking data. METHODS We searched Medline, Embase, Web of Science, Scopus, Cochrane Library, IEEE Xplore Digital Library, Wan Fang Database, China National Knowledge Infrastructure, Chinese BioMedical Literature Database, VIP Database for Chinese Technical Periodicals, from database inception to December 24, 2021. Studies using machine learning methods to classify ASD and TD individuals based on eye-tracking technologies were included. We extracted the data on study population, model performances, algorithms of machine learning, and paradigms of eye-tracking. This study is registered with PROSPERO, CRD42022296037. RESULTS 261 articles were identified, of which 24 studies with sample sizes ranging from 28 to 141 were included (n = 1396 individuals). Machine learning based on eye-tracking yielded the pooled classified accuracy of 81 % (I2 = 73 %), specificity of 79 % (I2 = 61 %), and sensitivity of 84 % (I2 = 61 %) in classifying ASD and TD individuals. In subgroup analysis, the accuracy was 88 % (95 % CI: 85-91 %), 79 % (95 % CI: 72-84 %), 71 % (95 % CI: 59-91 %) for preschool-aged, school-aged, and adolescent-adult group. Eye-tracking stimuli and machine learning algorithms varied widely across studies, with social, static, and active stimuli and Support Vector Machine and Random Forest most commonly reported. Regarding the model performance evaluation, 15 studies reported their final results on validation datasets, four based on testing datasets, and five did not report whether they used validation datasets. Most studies failed to report the information on eye-tracking hardware and the implementation process. CONCLUSION Using eye-tracking data, machine learning has shown potential in identifying ASD individuals with high accuracy, especially in preschool-aged children. However, the heterogeneity between studies, the absence of test set-based performance evaluations, the small sample size, and the non-standardized implementation of eye-tracking might deteriorate the reliability of results. Further well-designed and well-executed studies with comprehensive and transparent reporting are needed to determine the optimal eye-tracking paradigms and machine learning algorithms.
Collapse
Affiliation(s)
- Qiuhong Wei
- Children Nutrition Research Center, Children's Hospital of Chongqing Medical University, National Clinical Research Center for Child Health and Disorders, Ministry of Education Key Laboratory of Child Development and Disorders, China International Science and Technology Cooperation Base of Child Development and Critical Disorders, Chongqing Key Laboratory of Childhood Nutrition and Health, Chongqing, China
| | - Huiling Cao
- Department of Neonatology, Children's Hospital of Chongqing Medical University, Chongqing, China
| | - Yuan Shi
- Department of Neonatology, Children's Hospital of Chongqing Medical University, Chongqing, China
| | - Ximing Xu
- Big Data Center for Children's Medical Care, Children's Hospital of Chongqing Medical University, Chongqing, China.
| | - Tingyu Li
- Children Nutrition Research Center, Children's Hospital of Chongqing Medical University, National Clinical Research Center for Child Health and Disorders, Ministry of Education Key Laboratory of Child Development and Disorders, China International Science and Technology Cooperation Base of Child Development and Critical Disorders, Chongqing Key Laboratory of Childhood Nutrition and Health, Chongqing, China.
| |
Collapse
|
48
|
Central EEG Beta/Alpha Ratio Predicts the Population-Wide Efficiency of Advertisements. Brain Sci 2022; 13:brainsci13010057. [PMID: 36672039 PMCID: PMC9856603 DOI: 10.3390/brainsci13010057] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2022] [Revised: 12/13/2022] [Accepted: 12/23/2022] [Indexed: 12/29/2022] Open
Abstract
Recent studies have demonstrated that the brain activity of a group of people can be used to forecast choices at the population level. In this study, we attempted to neuroforecast aggregate consumer behavior of Internet users. During our electroencephalography (EEG) and eye-tracking study, participants were exposed to 10 banners that were also used in the real digital marketing campaign. In the separate online study, we additionally collected self-reported preferences for the same banners. We explored the relationship between the EEG, eye-tracking, and behavioral indexes obtained in our studies and the banners' aggregate efficiency provided by the large food retailer based on the decisions of 291,301 Internet users. An EEG-based engagement index (central beta/alpha ratio) significantly correlated with the aggregate efficiency of banners. Furthermore, our multiple linear regression models showed that a combination of eye-tracking, EEG and behavioral measurements better explained the market-level efficiency of banner advertisements than each measurement alone. Overall, our results confirm that neural signals of a relatively small number of individuals can forecast aggregate behavior at the population level.
Collapse
|
49
|
Correlation between Eye Movements and Asthenopia: A Prospective Observational Study. J Clin Med 2022; 11:jcm11237043. [PMID: 36498619 PMCID: PMC9739550 DOI: 10.3390/jcm11237043] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2022] [Revised: 11/24/2022] [Accepted: 11/25/2022] [Indexed: 12/05/2022] Open
Abstract
Purpose: To analyze the correlation between eye movements and asthenopia so as to explore the possibility of using eye-tracking techniques for objective assessment of asthenopia. Methods: This prospective observational study used the computer visual syndrome questionnaire to assess the severity of asthenopia in 93 enrolled college students (age 20−30) who complained about asthenopia. Binocular accommodation and eye movements during the reading task were also examined. The correlations between questionnaire score and accommodation examination results and eye movement parameters were analyzed. Differences in eye movement parameters between the first and last reading paragraphs were compared. The trends in eye movement changes over time were observed. Results: About 81.7% of the subjects suffered from computer visual syndrome. Computer visual syndrome questionnaire total score was positively correlated with positive relative accommodation (p < 0.05). In the first reading paragraph, double vision was positively correlated with unknown saccades (all p < 0.05). Difficulty focusing at close range was positively correlated with total fixation duration, total visit duration, and reading speed (all p < 0.05). Feeling that sight was worsening was positively correlated with regressive saccades (p < 0.05). However, visual impairment symptoms were not significantly correlated with any accommodative function. In a total 20 min reading, significantly reduced eye movement parameters were: total fixation duration, fixation count, total visit duration, visit count, fixation duration mean, and reading speed (all p < 0.01). The eye movement parameters that were significantly increased were: visit duration mean and unknown saccades (all p < 0.001). Conclusion: Eye tracking could be used as an effective assessment for asthenopia. Among the various eye movement parameters, a decrease in fixation duration and counts may be one of the potential indicators related to asthenopia.
Collapse
|
50
|
Ban S, Lee YJ, Kim KR, Kim JH, Yeo WH. Advances in Materials, Sensors, and Integrated Systems for Monitoring Eye Movements. BIOSENSORS 2022; 12:1039. [PMID: 36421157 PMCID: PMC9688058 DOI: 10.3390/bios12111039] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/20/2022] [Revised: 11/11/2022] [Accepted: 11/13/2022] [Indexed: 06/16/2023]
Abstract
Eye movements show primary responses that reflect humans' voluntary intention and conscious selection. Because visual perception is one of the fundamental sensory interactions in the brain, eye movements contain critical information regarding physical/psychological health, perception, intention, and preference. With the advancement of wearable device technologies, the performance of monitoring eye tracking has been significantly improved. It also has led to myriad applications for assisting and augmenting human activities. Among them, electrooculograms, measured by skin-mounted electrodes, have been widely used to track eye motions accurately. In addition, eye trackers that detect reflected optical signals offer alternative ways without using wearable sensors. This paper outlines a systematic summary of the latest research on various materials, sensors, and integrated systems for monitoring eye movements and enabling human-machine interfaces. Specifically, we summarize recent developments in soft materials, biocompatible materials, manufacturing methods, sensor functions, systems' performances, and their applications in eye tracking. Finally, we discuss the remaining challenges and suggest research directions for future studies.
Collapse
Affiliation(s)
- Seunghyeb Ban
- School of Engineering and Computer Science, Washington State University, Vancouver, WA 98686, USA
- IEN Center for Human-Centric Interfaces and Engineering, Institute for Electronics and Nanotechnology, Georgia Institute of Technology, Atlanta, GA 30332, USA
| | - Yoon Jae Lee
- IEN Center for Human-Centric Interfaces and Engineering, Institute for Electronics and Nanotechnology, Georgia Institute of Technology, Atlanta, GA 30332, USA
- School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA 30332, USA
| | - Ka Ram Kim
- IEN Center for Human-Centric Interfaces and Engineering, Institute for Electronics and Nanotechnology, Georgia Institute of Technology, Atlanta, GA 30332, USA
- George W. Woodruff School of Mechanical Engineering, Georgia Institute of Technology, Atlanta, GA 30332, USA
| | - Jong-Hoon Kim
- School of Engineering and Computer Science, Washington State University, Vancouver, WA 98686, USA
- Department of Mechanical Engineering, University of Washington, Seattle, WA 98195, USA
| | - Woon-Hong Yeo
- IEN Center for Human-Centric Interfaces and Engineering, Institute for Electronics and Nanotechnology, Georgia Institute of Technology, Atlanta, GA 30332, USA
- George W. Woodruff School of Mechanical Engineering, Georgia Institute of Technology, Atlanta, GA 30332, USA
- Wallace H. Coulter Department of Biomedical Engineering, Georgia Tech and Emory University School of Medicine, Atlanta, GA 30332, USA
- Neural Engineering Center, Institute for Materials, Institute for Robotics and Intelligent Machines, Georgia Institute of Technology, Atlanta, GA 30332, USA
| |
Collapse
|