1
|
Lopes A, Ward AD, Cecchini M. Eye tracking in digital pathology: A comprehensive literature review. J Pathol Inform 2024; 15:100383. [PMID: 38868488 PMCID: PMC11168484 DOI: 10.1016/j.jpi.2024.100383] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2023] [Revised: 04/28/2024] [Accepted: 05/14/2024] [Indexed: 06/14/2024] Open
Abstract
Eye tracking has been used for decades in attempt to understand the cognitive processes of individuals. From memory access to problem-solving to decision-making, such insight has the potential to improve workflows and the education of students to become experts in relevant fields. Until recently, the traditional use of microscopes in pathology made eye tracking exceptionally difficult. However, the digital revolution of pathology from conventional microscopes to digital whole slide images allows for new research to be conducted and information to be learned with regards to pathologist visual search patterns and learning experiences. This has the promise to make pathology education more efficient and engaging, ultimately creating stronger and more proficient generations of pathologists to come. The goal of this review on eye tracking in pathology is to characterize and compare the visual search patterns of pathologists. The PubMed and Web of Science databases were searched using 'pathology' AND 'eye tracking' synonyms. A total of 22 relevant full-text articles published up to and including 2023 were identified and included in this review. Thematic analysis was conducted to organize each study into one or more of the 10 themes identified to characterize the visual search patterns of pathologists: (1) effect of experience, (2) fixations, (3) zooming, (4) panning, (5) saccades, (6) pupil diameter, (7) interpretation time, (8) strategies, (9) machine learning, and (10) education. Expert pathologists were found to have higher diagnostic accuracy, fewer fixations, and shorter interpretation times than pathologists with less experience. Further, literature on eye tracking in pathology indicates that there are several visual strategies for diagnostic interpretation of digital pathology images, but no evidence of a superior strategy exists. The educational implications of eye tracking in pathology have also been explored but the effect of teaching novices how to search as an expert remains unclear. In this article, the main challenges and prospects of eye tracking in pathology are briefly discussed along with their implications to the field.
Collapse
Affiliation(s)
- Alana Lopes
- Department of Medical Biophysics, Western University, London, ON N6A 3K7, Canada
- Gerald C. Baines Centre, London Health Sciences Centre, London, ON N6A 5W9, Canada
| | - Aaron D. Ward
- Department of Medical Biophysics, Western University, London, ON N6A 3K7, Canada
- Gerald C. Baines Centre, London Health Sciences Centre, London, ON N6A 5W9, Canada
- Department of Oncology, Western University, London, ON N6A 3K7, Canada
| | - Matthew Cecchini
- Department of Pathology and Laboratory Medicine, Schulich School of Medicine and Dentistry, Western University, London, ON N6A 3K7, Canada
| |
Collapse
|
2
|
Kassem L, Pang B, Dogramaci S, MacMahon C, Quinn J, Steel KA. Visual search strategies and game knowledge in junior Australian rules football players: testing potential in talent identification and development. Front Psychol 2024; 15:1356160. [PMID: 38903466 PMCID: PMC11188998 DOI: 10.3389/fpsyg.2024.1356160] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2023] [Accepted: 05/07/2024] [Indexed: 06/22/2024] Open
Abstract
This study explored video-based decision-making and eye-movement behavior as a complementary method to assess the decision-making skills and knowledge of elite junior Australian Rules (AR) Football players. Performance was measured twice over an 18-month period. This approach tested a practical and reliable assessment of decision-making and game knowledge that does not contribute to physical training load. N = 59 participants were categorized based on their training age groups, U14 (N = 38, Mage 13.37 ± 0.47) and U16 (N = 21, Mage 14.80 ± 0.39). Participants watched 14 brief video clips and provided action choices while wearing eye-movement recording glasses that captured visual search patterns (e.g., fixations). Decision accuracy and speed of decision-making were also recorded. Participants with accurate decisions made significantly faster decisions compared to less skilled players (p < 0.001). Further, skilled participants had significantly fewer fixations of shorter duration compared to less skilled participants at both the initial and follow-up testing sessions (p < 0.0001). This suggests that eye-movement characteristics, remain a relatively stable measure over moderate periods of time. With the ability to differentiate between more and less skilled decision-makers, this proof-of-concept study proposes that examining eye movements in relation to decision-making and game knowledge is a viable tool for Talent Identification and Development (TID) to complement current measures. We provide a platform for further development and research in the quest for efficient and effective talent identification processes.
Collapse
Affiliation(s)
- Lael Kassem
- School of Health Sciences, Western Sydney University, Sydney, NSW, Australia
| | - Bonnie Pang
- Department for Health, University of Bath, Bath, United Kingdom
| | - Sera Dogramaci
- School of Health Sciences, Western Sydney University, Sydney, NSW, Australia
| | - Clare MacMahon
- Sport, Performance, and Nutrition Research Group, Latrobe University, Melbourne, VIC, Australia
| | - John Quinn
- Greater Western Sydney Giants AFL, Sydney, NSW, Australia
- Quinn Elite Sport Services, Sydney, NSW, Australia
| | - Kylie A. Steel
- School of Health Sciences, Western Sydney University, Sydney, NSW, Australia
- The MARCS Institute for Brain, Behaviour and Development, Sydney, NSW, Australia
| |
Collapse
|
3
|
Enders LR, Gordon SM, Roy H, Rohaly T, Dalangin B, Jeter A, Villarreal J, Boykin GL, Touryan J. Evidence of elevated situational awareness for active duty soldiers during navigation of a virtual environment. PLoS One 2024; 19:e0298867. [PMID: 38728266 PMCID: PMC11086823 DOI: 10.1371/journal.pone.0298867] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2023] [Accepted: 02/01/2024] [Indexed: 05/12/2024] Open
Abstract
U.S. service members maintain constant situational awareness (SA) due to training and experience operating in dynamic and complex environments. Work examining how military experience impacts SA during visual search of a complex naturalistic environment, is limited. Here, we compare Active Duty service members and Civilians' physiological behavior during a navigational visual search task in an open-world virtual environment (VE) while cognitive load was manipulated. We measured eye-tracking and electroencephalogram (EEG) outcomes from Active Duty (N = 21) and Civilians (N = 15) while they navigated a desktop VE at a self-regulated pace. Participants searched and counted targets (N = 15) presented among distractors, while cognitive load was manipulated with an auditory Math Task. Results showed Active Duty participants reported significantly greater/closer to the correct number of targets compared to Civilians. Overall, Active Duty participants scanned the VE with faster peak saccade velocities and greater average saccade magnitudes compared to Civilians. Convolutional Neural Network (CNN) response (EEG P-300) was significantly weighted more to initial fixations for the Active Duty group, showing reduced attentional resources on object refixations compared to Civilians. There were no group differences in fixation outcomes or overall CNN response when comparing targets versus distractor objects. When cognitive load was manipulated, only Civilians significantly decreased their average dwell time on each object and the Active Duty group had significantly fewer numbers of correct answers on the Math Task. Overall, the Active Duty group explored the VE with increased scanning speed and distance and reduced cognitive re-processing on objects, employing a different, perhaps expert, visual search strategy indicative of increased SA. The Active Duty group maintained SA in the main visual search task and did not appear to shift focus to the secondary Math Task. Future work could compare how a stress inducing environment impacts these groups' physiological or cognitive markers and performance for these groups.
Collapse
Affiliation(s)
- Leah R. Enders
- Human in Complex Systems Division, DEVCOM Army Research Laboratory, Aberdeen Proving Ground, Maryland, United States of America
| | | | - Heather Roy
- Human in Complex Systems Division, DEVCOM Army Research Laboratory, Aberdeen Proving Ground, Maryland, United States of America
| | - Thomas Rohaly
- DCS Corporation, Alexandria, Virginia, United States of America
| | - Bianca Dalangin
- DCS Corporation, Alexandria, Virginia, United States of America
| | - Angela Jeter
- DCS Corporation, Alexandria, Virginia, United States of America
| | | | - Gary L. Boykin
- Human in Complex Systems Division, DEVCOM Army Research Laboratory, Aberdeen Proving Ground, Maryland, United States of America
| | - Jonathan Touryan
- Human in Complex Systems Division, DEVCOM Army Research Laboratory, Aberdeen Proving Ground, Maryland, United States of America
| |
Collapse
|
4
|
Del Campo VL, Morán JFO, Cagigal VM, Martín JM, Pagador JB, Hornero R. The use of the eye-fixation-related potential to investigate visual perception in professional domains with high attentional demand: a literature review. Neurol Sci 2024; 45:1849-1860. [PMID: 38157102 DOI: 10.1007/s10072-023-07275-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2023] [Accepted: 12/17/2023] [Indexed: 01/03/2024]
Abstract
INTRODUCTION Visual attention is a cognitive skill related to visual perception and neural activity, and also moderated by expertise, in time-constrained professional domains (e.g., aviation, driving, sport, surgery). However, the contribution of both perceptual and neural processes on performance has been studied separately in the literature. DEVELOPMENT We defend an integration of visual and neural signals to offer a more complete picture of the visual attention displayed by professionals of different skill levels when performing free-viewing tasks. Specifically, we propose to zoom the analysis in data related to the quiet eye and P300 component jointly, as a novel signal processing approach to evaluate professionals' visual attention. CONCLUSION This review highlights the advantages of using portable eye trackers and electroencephalogram systems altogether, as a promising technique for a better understanding of early cognitive components related to attentional processes. Altogether, the eye-fixation-related potentials method may provide a better understanding of the cognitive mechanisms employed by the participants in natural settings, revealing what visual information is of interest for participants and distinguishing the neural bases of visual attention between targets and non-targets whenever they perceive a stimulus during free viewing experiments.
Collapse
Affiliation(s)
- Vicente Luis Del Campo
- Laboratorio de Aprendizaje y Control Motor, Facultad de Ciencias del Deporte, Universidad de Extremadura, Avda. de La Universidad, S/N, 10003, Cáceres, Spain.
| | | | - Víctor Martínez Cagigal
- Grupo de Ingeniería Biomédica, Universidad de Valladolid, E.T.S.I. Telecomunicación, Paseo Belén 15, 47011, Valladolid, Spain
- Centro de Investigación Biomédica en Red - Bioingeniería, Biomateriales y Biomedicina (CIBER-BBN), E.T.S.I. Telecomunicación, Paseo Belén 15, 47011, Valladolid, Spain
| | - Jesús Morenas Martín
- Laboratorio de Aprendizaje y Control Motor, Facultad de Ciencias del Deporte, Universidad de Extremadura, Avda. de La Universidad, S/N, 10003, Cáceres, Spain
| | - J Blas Pagador
- Centro de Cirugía de Mínima Invasión Jesús Usón, Ctra. N-521, Km. 41,8, 10071, Cáceres, Spain
| | - Roberto Hornero
- Grupo de Ingeniería Biomédica, Universidad de Valladolid, E.T.S.I. Telecomunicación, Paseo Belén 15, 47011, Valladolid, Spain
- Centro de Investigación Biomédica en Red - Bioingeniería, Biomateriales y Biomedicina (CIBER-BBN), E.T.S.I. Telecomunicación, Paseo Belén 15, 47011, Valladolid, Spain
| |
Collapse
|
5
|
Paeng S, Kim HF. Gaze patterns reflect the retrieval and selection of memories in a context-dependent object location retrieval task. Sci Rep 2024; 14:9433. [PMID: 38658592 PMCID: PMC11043435 DOI: 10.1038/s41598-024-59815-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2023] [Accepted: 04/15/2024] [Indexed: 04/26/2024] Open
Abstract
Selective retrieval of context-relevant memories is critical for animal survival. A behavioral index that captures its dynamic nature in real time is necessary to investigate this retrieval process. Here, we found a bias in eye gaze towards the locations previously associated with individual objects during retrieval. Participants learned two locations associated with each visual object and recalled one of them indicated by a contextual cue in the following days. Before the contextual cue presentation, participants often gazed at both locations associated with the given object on the background screen (look-at-both), and the frequency of look-at-both gaze pattern increased as learning progressed. Following the cue presentation, their gaze shifted toward the context-appropriate location. Interestingly, participants showed a higher accuracy of memory retrieval in trials where they gazed at both object-associated locations, implying functional advantage of the look-at-both gaze patterns. Our findings indicate that naturalistic eye movements reflect the dynamic process of memory retrieval and selection, highlighting the potential of eye gaze as an indicator for studying these cognitive processes.
Collapse
Affiliation(s)
- Somang Paeng
- School of Biological Sciences, Seoul National University (SNU), Gwanak-ro, Gwanak-gu, Seoul, 08826, Republic of Korea
| | - Hyoung F Kim
- School of Biological Sciences, Seoul National University (SNU), Gwanak-ro, Gwanak-gu, Seoul, 08826, Republic of Korea.
| |
Collapse
|
6
|
Park B, Kim Y, Park J, Choi H, Kim SE, Ryu H, Seo K. Integrating Biomarkers From Virtual Reality and Magnetic Resonance Imaging for the Early Detection of Mild Cognitive Impairment Using a Multimodal Learning Approach: Validation Study. J Med Internet Res 2024; 26:e54538. [PMID: 38631021 PMCID: PMC11063880 DOI: 10.2196/54538] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2023] [Revised: 12/29/2023] [Accepted: 03/09/2024] [Indexed: 04/19/2024] Open
Abstract
BACKGROUND Early detection of mild cognitive impairment (MCI), a transitional stage between normal aging and Alzheimer disease, is crucial for preventing the progression of dementia. Virtual reality (VR) biomarkers have proven to be effective in capturing behaviors associated with subtle deficits in instrumental activities of daily living, such as challenges in using a food-ordering kiosk, for early detection of MCI. On the other hand, magnetic resonance imaging (MRI) biomarkers have demonstrated their efficacy in quantifying observable structural brain changes that can aid in early MCI detection. Nevertheless, the relationship between VR-derived and MRI biomarkers remains an open question. In this context, we explored the integration of VR-derived and MRI biomarkers to enhance early MCI detection through a multimodal learning approach. OBJECTIVE We aimed to evaluate and compare the efficacy of VR-derived and MRI biomarkers in the classification of MCI while also examining the strengths and weaknesses of each approach. Furthermore, we focused on improving early MCI detection by leveraging multimodal learning to integrate VR-derived and MRI biomarkers. METHODS The study encompassed a total of 54 participants, comprising 22 (41%) healthy controls and 32 (59%) patients with MCI. Participants completed a virtual kiosk test to collect 4 VR-derived biomarkers (hand movement speed, scanpath length, time to completion, and the number of errors), and T1-weighted MRI scans were performed to collect 22 MRI biomarkers from both hemispheres. Analyses of covariance were used to compare these biomarkers between healthy controls and patients with MCI, with age considered as a covariate. Subsequently, the biomarkers that exhibited significant differences between the 2 groups were used to train and validate a multimodal learning model aimed at early screening for patients with MCI among healthy controls. RESULTS The support vector machine (SVM) using only VR-derived biomarkers achieved a sensitivity of 87.5% and specificity of 90%, whereas the MRI biomarkers showed a sensitivity of 90.9% and specificity of 71.4%. Moreover, a correlation analysis revealed a significant association between MRI-observed brain atrophy and impaired performance in instrumental activities of daily living in the VR environment. Notably, the integration of both VR-derived and MRI biomarkers into a multimodal SVM model yielded superior results compared to unimodal SVM models, achieving higher accuracy (94.4%), sensitivity (100%), specificity (90.9%), precision (87.5%), and F1-score (93.3%). CONCLUSIONS The results indicate that VR-derived biomarkers, characterized by their high specificity, can be valuable as a robust, early screening tool for MCI in a broader older adult population. On the other hand, MRI biomarkers, known for their high sensitivity, excel at confirming the presence of MCI. Moreover, the multimodal learning approach introduced in our study provides valuable insights into the improvement of early MCI detection by integrating a diverse set of biomarkers.
Collapse
Affiliation(s)
- Bogyeom Park
- Department of Applied Artificial Intelligence, Seoul National University of Science and Technology, Seoul, Republic of Korea
| | - Yuwon Kim
- Department of Applied Artificial Intelligence, Seoul National University of Science and Technology, Seoul, Republic of Korea
| | - Jinseok Park
- Department of Neurology, College of Medicine, Hanyang University, Seoul, Republic of Korea
| | - Hojin Choi
- Department of Neurology, College of Medicine, Hanyang University, Seoul, Republic of Korea
| | - Seong-Eun Kim
- Department of Applied Artificial Intelligence, Seoul National University of Science and Technology, Seoul, Republic of Korea
| | - Hokyoung Ryu
- Graduate School of Technology and Innovation Management, Hanyang University, Seoul, Republic of Korea
| | - Kyoungwon Seo
- Department of Applied Artificial Intelligence, Seoul National University of Science and Technology, Seoul, Republic of Korea
| |
Collapse
|
7
|
Skog E, Meese TS, Sargent IMJ, Ormerod A, Schofield AJ. Classification images for aerial images capture visual expertise for binocular disparity and a prior for lighting from above. J Vis 2024; 24:11. [PMID: 38607637 PMCID: PMC11019598 DOI: 10.1167/jov.24.4.11] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2023] [Accepted: 02/06/2024] [Indexed: 04/13/2024] Open
Abstract
Using a novel approach to classification images (CIs), we investigated the visual expertise of surveyors for luminance and binocular disparity cues simultaneously after screening for stereoacuity. Stereoscopic aerial images of hedges and ditches were classified in 10,000 trials by six trained remote sensing surveyors and six novices. Images were heavily masked with luminance and disparity noise simultaneously. Hedge and ditch images had reversed disparity on around half the trials meaning hedges became ditch-like and vice versa. The hedge and ditch images were also flipped vertically on around half the trials, changing the direction of the light source and completing a 2 × 2 × 2 stimulus design. CIs were generated by accumulating the noise textures associated with "hedge" and "ditch" classifications, respectively, and subtracting one from the other. Typical CIs had a central peak with one or two negative side-lobes. We found clear differences in the amplitudes and shapes of perceptual templates across groups and noise-type, with experts prioritizing binocular disparity and using this more effectively. Contrariwise, novices used luminance cues more than experts meaning that task motivation alone could not explain group differences. Asymmetries in the luminance CIs revealed individual differences for lighting interpretation, with experts less prone to assume lighting from above, consistent with their training on aerial images of UK scenes lit by a southerly sun. Our results show that (i) dual noise in images can be used to produce simultaneous CI pairs, (ii) expertise for disparity cues does not depend on stereoacuity, (iii) CIs reveal the visual strategies developed by experts, (iv) top-down perceptual biases can be overcome with long-term learning effects, and (v) CIs have practical potential for directing visual training.
Collapse
Affiliation(s)
- Emil Skog
- School of Psychology, College of Health and Life Sciences, Aston University, Birmingham, B4 7ET, UK
- Aston Laboratory for Immersive Virtual Environments, College of Health and Life Sciences, Aston University, Birmingham, B4 7ET, UK
- Department of Health, Learning and Technology, Luleå University of Technology, Luleå, Sweden
| | - Timothy S Meese
- Aston Laboratory for Immersive Virtual Environments, College of Health and Life Sciences, Aston University, Birmingham, B4 7ET, UK
- https://research.aston.ac.uk/en/persons/tim-s-meese
| | - Isabel M J Sargent
- Ordnance Survey, Adanac Drive, Southampton, SO16 0AS, UK
- Electronics and Computer Science, University of Southampton, University Road, Southampton, SO17 1BJ, UK
- http://www.os.uk/
| | - Andrew Ormerod
- Ordnance Survey, Adanac Drive, Southampton, SO16 0AS, UK
- http://www.os.uk/
| | - Andrew J Schofield
- School of Psychology, College of Health and Life Sciences, Aston University, Birmingham, B4 7ET, UK
- Aston Laboratory for Immersive Virtual Environments, College of Health and Life Sciences, Aston University, Birmingham, B4 7ET, UK
- https://research.aston.ac.uk/en/persons/andrew-schofield
| |
Collapse
|
8
|
Södervik I, Hanski L, Boshuizen HPA, Katajavuori N. Clinical reasoning in pharmacy: What do eye movements and verbal protocols tell us about the processing of a case task? ADVANCES IN HEALTH SCIENCES EDUCATION : THEORY AND PRACTICE 2024; 29:45-65. [PMID: 37273029 PMCID: PMC10240483 DOI: 10.1007/s10459-023-10242-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/21/2022] [Accepted: 05/14/2023] [Indexed: 06/06/2023]
Abstract
This study investigates pharmacy students' reasoning while solving a case task concerning an acute patient counselling situation in a pharmacy. Participants' (N = 34) reasoning processes were investigated with written tasks utilizing eye-tracking in combination with verbal protocols. The case was presented in three pages, each page being followed by written questions. Eye movements were recorded during case processing. Success in the task required differentiating the relevant information from the task redundant information, and initial activation of several scripts and verification of the most likely one, when additional information became available. 2nd (n = 16) and 3rd (n = 18)-year students' and better and worse succeeding students' processes were compared. The results showed that only a few 2nd-year students solved the case correctly, whereas almost all of the 3rd-year students were successful. Generally, the average total processing times of the case material did not differ between the groups. However, better-succeeding and 3rd-year students processed the very first task-relevant sentences longer, indicating that they were able to focus on relevant information. Differences in the written answers to the 2nd and 3rd question were significant, whereas differences regarding the first question were not. Thus, eye-tracking seems to be able to capture illness script activation during case processing, but other methods are needed to depict the script verification process. Based on the results, pedagogical suggestions for advancing pharmacy education are discussed.
Collapse
Affiliation(s)
- Ilona Södervik
- Centre for University Teaching and Learning (HYPE), Faculty of Educational Sciences, University of Helsinki, Siltavuorenpenger 5B, 00170 Helsinki, Finland
| | - Leena Hanski
- Faculty of Pharmacy, University of Helsinki, Biocenter 2, PO Box 56, 00014 Helsinki, Finland
| | - Henny P. A. Boshuizen
- Faculty of Educational Sciences, Open University of the Netherlands, Valkenburgerweg 177, 6419 AT Heerlen, The Netherlands
| | - Nina Katajavuori
- Centre for University Teaching and Learning (HYPE), Faculty of Educational Sciences, University of Helsinki, Viikinkaari 9, 00140 Helsinki, Finland
| |
Collapse
|
9
|
Veerabhadrappa R, Hettiarachchi IT, Hanoun S, Jia D, Hosking SG, Bhatti A. Evaluating Operator Training Performance Using Recurrence Quantification Analysis of Autocorrelation Transformed Eye Gaze Data. HUMAN FACTORS 2024; 66:818-838. [PMID: 35930698 DOI: 10.1177/00187208221116953] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
OBJECTIVE This research aimed to investigate the relationship between gaze behaviour dynamics and operator performance. BACKGROUND Individuals differ in their approach when learning a new task often resulting in performance disparity. During training some individuals learn the structure and dynamics of the task and develop a systematic approach, whereas others may achieve the same result albeit with increased perceived workload, or indeed some may fail to achieve superior performance levels. Previous research has shown that comparing gaze of experts with novices can provide unique insights into cognitive functioning of superior performers. METHODS Twenty-five individuals participated in a computer-based simulation task. The concept of coefficient of variation (CoV) of task scores was used to compute the participants' consistency of performance. Based on CoV, the cohort was split into two performance categories. The temporal patterns in participants gaze data were transformed using autocorrelation, and recurrence quantification analysis (RQA) was employed to analyse and quantify the patterns. RESULTS A Mann-Whitney U analysis demonstrated significantly (p < .01) higher determinism, entropy and laminarity in the superior group compared to the moderate group. Pearson's correlation revealed a significant (p < .01) negative correlation between the consistency of task performance (CoV) and the RQA measures. CONCLUSION The results demonstrated that eye gaze dynamics can be used as an objective measure of performance. Participants classified as superior performers consistently demonstrated a systematic gaze activity which were in line with the task structure. APPLICATION The methods presented here are applicable to observe and evaluate operators' strategic distribution of gaze. Specifically, for tactical monitoring and decision making in task environments where spatial locations of elements-of-interest vary continuously.
Collapse
Affiliation(s)
| | | | - Samer Hanoun
- Deakin University, Waurn Ponds, Victoria, Australia
| | - Dawei Jia
- Defence Science and Technology Group, Melbourne, Victoria, Australia
| | - Simon G Hosking
- Defence Science and Technology Group, Melbourne, Victoria, Australia
| | - Asim Bhatti
- Deakin University, Waurn Ponds, Victoria, Australia
| |
Collapse
|
10
|
Yuan XF, Ji YQ, Zhang TX, Xiang HB, Ye ZY, Ye Q. Effects of Exercise Habits and Gender on Sports e-Learning Behavior: Evidence from an Eye-Tracking Study. Psychol Res Behav Manag 2024; 17:813-826. [PMID: 38434961 PMCID: PMC10909329 DOI: 10.2147/prbm.s442863] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2023] [Accepted: 02/20/2024] [Indexed: 03/05/2024] Open
Abstract
Background/Objective In the post-epidemic era, an increasing number of individuals were accustomed to learning sports and physical activity knowledge online for fitness and health demands. However, most previous studies have examined the influence of e-learning materials and resources on learners and have neglected intrinsic factors such as experience and physiological characteristics. Therefore, we conducted a study to investigate the effect of exercise habits and gender on sports e-learning behavior via eye-tracking technology. Methods We recruited a sample of 60 undergraduate students (mean age = 19.6) from a university in Nanjing, China. They were randomly assigned into 4 groups based on 2 genders × 2 exercise habits. Their gaze behavior was collected by an eye-tracking device during the experiment. The cognitive Load Test and Learning Effect Test were conducted at the end of the individual experiment. Results (1) Compared to the non-exercise habit group, the exercise habit group had a higher fixation count (P<0.05), a shorter average fixation duration (P<0.05), a smaller average pupil diameter (P<0.05), and a lower subjective cognitive load (P<0.05) and better learning outcome (P<0.05). (2) Male participants showed a greater tendency to process information from the video area of interest (AOIs), and had lower subjective cognitive load (P < 0.05) and better learning outcomes (P < 0.05). (3) There was no interaction effect between exercise habits and gender for any of the indicators (P > 0.05). Conclusion Our results indicate that exercise habits effectively enhance sports e-learning outcomes and reduce cognitive load. The exercise habits group showed significant improvements in fixation counts, average fixation duration, and average pupil diameter. Furthermore, male subjects exhibited superior learning outcomes, experienced lower cognitive load, and demonstrated greater attentiveness to dynamic visual information. These conclusions are expected to improve sports e-learning success and address educational inequality.
Collapse
Affiliation(s)
- Xu-Fu Yuan
- School of Sports Training, Nanjing Sport Institute, Nanjing, Jiangsu, People’s Republic of China
| | - Yu-Qin Ji
- School of Sport and Human Science, Nanjing Sport Institute, Nanjing, Jiangsu, People’s Republic of China
| | - Teng-Xiao Zhang
- School of Physical Education and Humanities, Nanjing Sport Institute, Nanjing, Jiangsu, People’s Republic of China
| | - Hong-Bin Xiang
- School of Sport, Exercise and Health Sciences, Loughborough University, Leicestershire, UK
| | - Zhuo-Yan Ye
- Nanjing Foreign Language School Xianlin Campus, Nanjing, Jiangsu, People’s Republic of China
| | - Qiang Ye
- School of Physical Education and Humanities, Nanjing Sport Institute, Nanjing, Jiangsu, People’s Republic of China
| |
Collapse
|
11
|
Luis-del Campo V, Morenas Martín J, Musculus L, Raab M. Embodied planning in climbing: how pre-planning informs motor execution. Front Psychol 2024; 15:1337878. [PMID: 38440247 PMCID: PMC10911288 DOI: 10.3389/fpsyg.2024.1337878] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2023] [Accepted: 01/11/2024] [Indexed: 03/06/2024] Open
Abstract
Introduction The aim of the study is to address embodied planning in climbing. Embodied planning was conceptualized as the interaction between perceptual-cognitive pre-planning and motor execution. Methods In an experimental study, 18 climbers were asked to pre-plan a climbing route and to perform the route afterward. During pre-planning, the visual search pattern of climbers was captured using a portable eye tracker. After previewing, they were invited to climb the wall. Results Results revealed that holds looked at during pre-planning were used twice as much during route execution than those not looked at. The duration of fixations was longer for holds used than those not used during route execution. The experience of climbers (training years) correlated with visual strategies and climbing performance, such that experienced participants climbed faster and fixated at the holds not used for a shorter time. Discussion The visual behaviors of climbers were influenced by their past sensorimotor experiences during route previewing, impacting subsequent climbing performance.
Collapse
Affiliation(s)
| | | | - Lisa Musculus
- Institute of Psychology, Department of Performance Psychology, German Sport University Cologne, Cologne, North Rhine-Westphalia, Germany
| | - Markus Raab
- Institute of Psychology, Department of Performance Psychology, German Sport University Cologne, Cologne, North Rhine-Westphalia, Germany
| |
Collapse
|
12
|
Vater C. Viewing angle, skill level and task representativeness affect response times in basketball defence. Sci Rep 2024; 14:3337. [PMID: 38336961 PMCID: PMC10858043 DOI: 10.1038/s41598-024-53706-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2023] [Accepted: 02/04/2024] [Indexed: 02/12/2024] Open
Abstract
In basketball defence, it is impossible to keep track of all players without peripheral vision. This is the first study to investigate peripheral vision usage in an experimentally controlled setup, with sport-specific basketball stimuli from a first-person perspective, large viewing eccentricities (up to 90° to the left and right), and natural action responses. A CAVE and a motion-tracking system was used to project the scenarios and capture movement responses of high- and low-skilled basketball players, respectively. Four video conditions were created: (1) a simple reaction time task without crowding (only attackers), (2) a simple reaction time task with crowding (with attackers and defenders), (3) a choice-reaction time task where the player cutting to the basket eventually passed the ball to another player and (4) a game simulation. The results indicated eccentricity effects in all tests, a crowding effect in condition 2, and expertise differences in conditions 3 and 4 only. These findings suggest that viewing eccentricity has an impact on response times, that crowding is a limiting factor for peripheral perception in sports games, and that high-skilled but not low-skilled players can compensate for eccentricity effects in real game situations, indicating their superior positioning and perceptual strategies.
Collapse
Affiliation(s)
- Christian Vater
- Institute of Sport Science, University of Bern, Bremgartenstrasse 145, 3012, Bern, Switzerland.
| |
Collapse
|
13
|
Peng Y, Burling JM, Todorova GK, Neary C, Pollick FE, Lu H. Patterns of saliency and semantic features distinguish gaze of expert and novice viewers of surveillance footage. Psychon Bull Rev 2024:10.3758/s13423-024-02454-y. [PMID: 38273144 DOI: 10.3758/s13423-024-02454-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/04/2024] [Indexed: 01/27/2024]
Abstract
When viewing the actions of others, we not only see patterns of body movements, but we also "see" the intentions and social relations of people. Experienced forensic examiners - Closed Circuit Television (CCTV) operators - have been shown to convey superior performance in identifying and predicting hostile intentions from surveillance footage than novices. However, it remains largely unknown what visual content CCTV operators actively attend to, and whether CCTV operators develop different strategies for active information seeking from what novices do. Here, we conducted computational analysis for the gaze-centered stimuli captured by experienced CCTV operators and novices' eye movements when viewing the same surveillance footage. Low-level image features were extracted by a visual saliency model, whereas object-level semantic features were extracted by a deep convolutional neural network (DCNN), AlexNet, from gaze-centered regions. We found that the looking behavior of CCTV operators differs from novices by actively attending to visual contents with different patterns of saliency and semantic features. Expertise in selectively utilizing informative features at different levels of visual hierarchy may play an important role in facilitating the efficient detection of social relationships between agents and the prediction of harmful intentions.
Collapse
Affiliation(s)
- Yujia Peng
- School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, 100871, China.
- Institute for Artificial Intelligence, Peking University, Beijing, China.
- National Key Laboratory of General Artificial Intelligence, Beijing Institute for General Artificial Intelligence, Beijing, China.
- Department of Psychology, University of California, Los Angeles, CA, USA.
| | - Joseph M Burling
- Department of Psychology, University of California, Los Angeles, CA, USA
| | - Greta K Todorova
- School of Psychology and Neuroscience, University of Glasgow, Glasgow, UK
| | - Catherine Neary
- School of Health and Social Wellbeing, The University of the West of England, Bristol, UK
| | - Frank E Pollick
- School of Psychology and Neuroscience, University of Glasgow, Glasgow, UK
| | - Hongjing Lu
- Department of Psychology, University of California, Los Angeles, CA, USA
- Department of Statistics, University of California, Los Angeles, CA, USA
| |
Collapse
|
14
|
Hirosawa S, Kato T, Yamashita T, Aoki Y. Action Quality Assessment Model Using Specialists' Gaze Location and Kinematics Data-Focusing on Evaluating Figure Skating Jumps. SENSORS (BASEL, SWITZERLAND) 2023; 23:9282. [PMID: 38005668 PMCID: PMC10675807 DOI: 10.3390/s23229282] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/11/2023] [Revised: 11/11/2023] [Accepted: 11/12/2023] [Indexed: 11/26/2023]
Abstract
Action quality assessment (AQA) tasks in computer vision evaluate action quality in videos, and they can be applied to sports for performance evaluation. A typical example of AQA is predicting the final score from a video that captures an entire figure skating program. However, no previous studies have predicted individual jump scores, which are of great interest to competitors because of the high weight of competition. Despite the presence of unnecessary information in figure skating videos, human specialists can focus and reduce information when they evaluate jumps. In this study, we clarified the eye movements of figure skating judges and skaters while evaluating jumps and proposed a prediction model for jump performance that utilized specialists' gaze location to reduce information. Kinematic features obtained from the tracking system were input into the model in addition to videos to improve accuracy. The results showed that skaters focused more on the face, whereas judges focused on the lower extremities. These gaze locations were applied to the model, which demonstrated the highest accuracy when utilizing both specialists' gaze locations. The model outperformed human predictions and the baseline model (RMSE:0.775), suggesting a combination of human specialist knowledge and machine capabilities could yield higher accuracy.
Collapse
Affiliation(s)
- Seiji Hirosawa
- Graduate School of Science and Technology, Keio University, Yokohama 223-8522, Japan
- Faculty of Sport and Health Sciences, Toin University of Yokohama, Yokohama 225-8503, Japan
| | - Takaaki Kato
- Faculty of Environment and Information Studies, Keio University, Fujisawa 252-0882, Japan
| | | | - Yoshimitsu Aoki
- Graduate School of Science and Technology, Keio University, Yokohama 223-8522, Japan
| |
Collapse
|
15
|
Rekik G, Jouira G, Belkhir Y, Jarraya M, Kuo CD, Chen YS. The effect of dynamic versus static visualizations on acquisition of basketball game actions: a diurnal study. Sci Rep 2023; 13:18077. [PMID: 37872241 PMCID: PMC10593838 DOI: 10.1038/s41598-023-45278-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2023] [Accepted: 10/18/2023] [Indexed: 10/25/2023] Open
Abstract
This study aimed to examine the effect of time of day (TOD) on the acquisition of basketball game actions from dynamic and static visualizations in physical education students (novice practitioners). Participants were quasi-randomly assigned to three treatments (static pictures, enriched static-pictures, or video). Morning and late-afternoon sessions were conducted, involving study phases and immediate-recall tests [game comprehension (GC) test and game performance (GP) test]. Oral temperature (OT) and mood states (MS) were also measured. Compared to the morning, the results revealed that afternoon resulted in higher OT, higher negative MS (e.g., anxiety and fatigue), and lower positive MS (i.e., vigor) in all experimental conditions. Moreover, the results showed that: (a) GC and GP decreased throughout the day (regardless of treatments), (b) GC and GP were better with enriched static-pictures (with arrows) than with static pictures, at both TOD, and (c) the video resulted in better GC and GP than the two static presentations, at both TOD. This study (a) highlights the morning's superiority in the acquisition of motor skills from dynamic and static visualizations, due to mood disturbances and lower arousal levels, and (b) encourages basketball teachers to use video modeling by experts, particularly in the morning, for explaining tactical skills.
Collapse
Affiliation(s)
- Ghazi Rekik
- High Institute of Sport and Physical Education, University of Sfax, Sfax, Tunisia
- Research Laboratory: Education, Motricité, Sport et Santé, EM2S, LR19JS01, High Institute of Sport and Physical Education, University of Sfax, Sfax, Tunisia
- Tanyu Research Laboratory, Taipei, 112, Taiwan
| | - Ghada Jouira
- Research Laboratory: Education, Motricité, Sport et Santé, EM2S, LR19JS01, High Institute of Sport and Physical Education, University of Sfax, Sfax, Tunisia
| | - Yosra Belkhir
- Research Laboratory: Education, Motricité, Sport et Santé, EM2S, LR19JS01, High Institute of Sport and Physical Education, University of Sfax, Sfax, Tunisia
| | - Mohamed Jarraya
- High Institute of Sport and Physical Education, University of Sfax, Sfax, Tunisia
- Research Laboratory: Education, Motricité, Sport et Santé, EM2S, LR19JS01, High Institute of Sport and Physical Education, University of Sfax, Sfax, Tunisia
| | - Cheng-Deng Kuo
- Tanyu Research Laboratory, Taipei, 112, Taiwan
- Department of Internal Medicine, Taipei Veterans General Hospital Hsinchu Branch, Hsinchu County, 310, Taiwan
- Department of Internal Medicine, Hsiao Chung-Cheng Healthcare Group, New Taipei City, 220, Taiwan
| | - Yung-Sheng Chen
- Tanyu Research Laboratory, Taipei, 112, Taiwan.
- Department of Exercise and Health Sciences, University of Taipei, No. 101, Sec. 2, Zhongcheng Rd., Shihlin Dist., Taipei City, 111, Taiwan.
- Exercise and Health Promotion Association, New Taipei City, 241, Taiwan.
| |
Collapse
|
16
|
Darici D, Reissner C, Missler M. Webcam-based eye-tracking to measure visual expertise of medical students during online histology training. GMS JOURNAL FOR MEDICAL EDUCATION 2023; 40:Doc60. [PMID: 37881524 PMCID: PMC10594038 DOI: 10.3205/zma001642] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Figures] [Subscribe] [Scholar Register] [Received: 09/30/2022] [Revised: 06/06/2023] [Accepted: 07/07/2023] [Indexed: 10/27/2023]
Abstract
Objectives Visual expertise is essential for image-based tasks that rely on visual cues, such as in radiology or histology. Studies suggest that eye movements are related to visual expertise and can be measured by near-infrared eye-tracking. With the popularity of device-embedded webcam eye-tracking technology, cost-effective use in educational contexts has recently become amenable. This study investigated the feasibility of such methodology in a curricular online-only histology course during the 2021 summer term. Methods At two timepoints (t1 and t2), third-semester medical students were asked to diagnose a series of histological slides while their eye movements were recorded. Students' eye metrics, performance and behavioral measures were analyzed using variance analyses and multiple regression models. Results First, webcam-eye tracking provided eye movement data with satisfactory quality (mean accuracy=115.7 px±31.1). Second, the eye movement metrics reflected the students' proficiency in finding relevant image sections (fixation count on relevant areas=6.96±1.56 vs. irrelevant areas=4.50±1.25). Third, students' eye movement metrics successfully predicted their performance (R2adj=0.39, p<0.001). Conclusion This study supports the use of webcam-eye-tracking expanding the range of educational tools available in the (digital) classroom. As the students' interest in using the webcam eye-tracking was high, possible areas of implementation will be discussed.
Collapse
Affiliation(s)
- Dogus Darici
- Westfälische-Wilhelms-University, Institute of Anatomy and Neurobiology, Münster, Germany
| | - Carsten Reissner
- Westfälische-Wilhelms-University, Institute of Anatomy and Neurobiology, Münster, Germany
| | - Markus Missler
- Westfälische-Wilhelms-University, Institute of Anatomy and Neurobiology, Münster, Germany
| |
Collapse
|
17
|
Zafar A, Martin Calderon C, Yeboah AM, Dalton K, Irving E, Niechwiej-Szwedo E. Investigation of Camera-Free Eye-Tracking Glasses Compared to a Video-Based System. SENSORS (BASEL, SWITZERLAND) 2023; 23:7753. [PMID: 37765810 PMCID: PMC10535734 DOI: 10.3390/s23187753] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/15/2023] [Revised: 09/03/2023] [Accepted: 09/06/2023] [Indexed: 09/29/2023]
Abstract
Technological advances in eye-tracking have resulted in lightweight, portable solutions that are capable of capturing eye movements beyond laboratory settings. Eye-tracking devices have typically relied on heavier, video-based systems to detect pupil and corneal reflections. Advances in mobile eye-tracking technology could facilitate research and its application in ecological settings; more traditional laboratory research methods are able to be modified and transferred to real-world scenarios. One recent technology, the AdHawk MindLink, introduced a novel camera-free system embedded in typical eyeglass frames. This paper evaluates the AdHawk MindLink by comparing the eye-tracking recordings with a research "gold standard", the EyeLink II. By concurrently capturing data from both eyes, we compare the capability of each eye tracker to quantify metrics from fixation, saccade, and smooth pursuit tasks-typical elements in eye movement research-across a sample of 13 adults. The MindLink system was capable of capturing fixation stability within a radius of less than 0.5∘, estimating horizontal saccade amplitudes with an accuracy of 0.04∘± 2.3∘, vertical saccade amplitudes with an accuracy of 0.32∘± 2.3∘, and smooth pursuit speeds with an accuracy of 0.5 to 3∘s, depending on the pursuit speed. While the performance of the MindLink system in measuring fixation stability, saccade amplitude, and smooth pursuit eye movements were slightly inferior to the video-based system, MindLink provides sufficient gaze-tracking capabilities for dynamic settings and experiments.
Collapse
Affiliation(s)
- Abdullah Zafar
- Department of Kinesiology & Health Sciences, University of Waterloo, Waterloo, ON N2L 3G1, Canada; (A.Z.)
| | - Claudia Martin Calderon
- Department of Kinesiology & Health Sciences, University of Waterloo, Waterloo, ON N2L 3G1, Canada; (A.Z.)
| | - Anne Marie Yeboah
- School of Optometry & Vision Science, University of Waterloo, Waterloo, ON N2L 3G1, Canada
| | - Kristine Dalton
- School of Optometry & Vision Science, University of Waterloo, Waterloo, ON N2L 3G1, Canada
| | - Elizabeth Irving
- School of Optometry & Vision Science, University of Waterloo, Waterloo, ON N2L 3G1, Canada
| | - Ewa Niechwiej-Szwedo
- Department of Kinesiology & Health Sciences, University of Waterloo, Waterloo, ON N2L 3G1, Canada; (A.Z.)
| |
Collapse
|
18
|
Goettker A, Borgerding N, Leeske L, Gegenfurtner KR. Cues for predictive eye movements in naturalistic scenes. J Vis 2023; 23:12. [PMID: 37728915 PMCID: PMC10516764 DOI: 10.1167/jov.23.10.12] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2023] [Accepted: 08/23/2023] [Indexed: 09/22/2023] Open
Abstract
We previously compared following of the same trajectories with eye movements, but either as an isolated targets or embedded in a naturalistic scene-in this case, the movement of a puck in an ice hockey game. We observed that the oculomotor system was able to leverage the contextual cues available in the naturalistic scene to produce predictive eye movements. In this study, we wanted to assess which factors are critical for achieving this predictive advantage by manipulating four factors: the expertise of the viewers, the amount of available peripheral information, and positional and kinematic cues. The more peripheral information became available (by manipulating the area of the video that was visible), the better the predictions of all observers. However, expert ice hockey fans were consistently better at predicting than novices and used peripheral information more effectively for predictive saccades. Artificial cues about player positions did not lead to a predictive advantage, whereas impairing the causal structure of kinematic cues by playing the video in reverse led to a severe impairment. When videos were flipped vertically to introduce more difficult kinematic cues, predictive behavior was comparable to watching the original videos. Together, these results demonstrate that, when contextual information is available in naturalistic scenes, the oculomotor system is successfully integrating them and is not relying only on low-level information about the target trajectory. Critical factors for successful prediction seem to be the amount of available information, experience with the stimuli, and the availability of intact kinematic cues for player movements.
Collapse
Affiliation(s)
- Alexander Goettker
- Justus Liebig Universität Giessen, Giessen, Germany
- Center for Mind, Brain and Behavior, University of Marburg and Justus Liebig University, Giessen, Germany
| | | | - Linus Leeske
- Justus Liebig Universität Giessen, Giessen, Germany
| | - Karl R Gegenfurtner
- Justus Liebig Universität Giessen, Giessen, Germany
- Center for Mind, Brain and Behavior, University of Marburg and Justus Liebig University, Giessen, Germany
| |
Collapse
|
19
|
Arsiwala-Scheppach LT, Castner N, Rohrer C, Mertens S, Kasneci E, Cejudo Grano de Oro JE, Krois J, Schwendicke F. Gaze patterns of dentists while evaluating bitewing radiographs. J Dent 2023; 135:104585. [PMID: 37301462 DOI: 10.1016/j.jdent.2023.104585] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2023] [Revised: 05/15/2023] [Accepted: 06/07/2023] [Indexed: 06/12/2023] Open
Abstract
OBJECTIVES Understanding dentists' gaze patterns on radiographs may allow to unravel sources of their limited accuracy and develop strategies to mitigate them. We conducted an eye tracking experiment to characterize dentists' scanpaths and thus their gaze patterns when assessing bitewing radiographs to detect primary proximal carious lesions. METHODS 22 dentists assessed a median of nine bitewing images each, resulting in 170 datasets after excluding data with poor quality of gaze recording. Fixation was defined as an area of attentional focus related to visual stimuli. We calculated time to first fixation, fixation count, average fixation duration, and fixation frequency. Analyses were performed for the entire image and stratified by (1) presence of carious lesions and/or restorations and (2) lesion depth (E1/2: outer/inner enamel; D1-3: outer-inner third of dentin). We also examined the transitional nature of the dentists' gaze. RESULTS Dentists had more fixations on teeth with lesions and/or restorations (median=138 [interquartile range=87, 204]) than teeth without them (32 [15, 66]), p<0.001. Notably, teeth with lesions had longer fixation durations (407 milliseconds [242, 591]) than those with restorations (289 milliseconds [216, 337]), p<0.001. Time to first fixation was longer for teeth with E1 lesions (17,128 milliseconds [8813, 21,540]) than lesions of other depths (p = 0.049). The highest number of fixations were on teeth with D2 lesions (43 [20, 51]) and lowest on teeth with E1 lesions (5 [1, 37]), p<0.001. Generally, a systematic tooth-by-tooth gaze pattern was observed. CONCLUSIONS As hypothesized, while visually inspecting bitewing radiographic images, dentists employed a heightened focus on certain image features/areas, relevant to the assigned task. Also, they generally examined the entire image in a systematic tooth-by-tooth pattern.
Collapse
Affiliation(s)
- Lubaina T Arsiwala-Scheppach
- Department of Oral Diagnostics, Digital Health and Health Services Research, Charité - Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Germany; ITU/WHO Focus Group AI on Health, Topic Group Dental Diagnostics and Digital Dentistry, Switzerland.
| | - Nora Castner
- Department of Computer Science, University of Tuebingen, Tuebingen, Germany
| | - Csaba Rohrer
- Department of Oral Diagnostics, Digital Health and Health Services Research, Charité - Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Germany
| | - Sarah Mertens
- Department of Oral Diagnostics, Digital Health and Health Services Research, Charité - Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Germany
| | - Enkelejda Kasneci
- Department of Computer Science, Technical University of Munich, Germany
| | - Jose Eduardo Cejudo Grano de Oro
- Department of Oral Diagnostics, Digital Health and Health Services Research, Charité - Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Germany
| | - Joachim Krois
- Department of Oral Diagnostics, Digital Health and Health Services Research, Charité - Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Germany; ITU/WHO Focus Group AI on Health, Topic Group Dental Diagnostics and Digital Dentistry, Switzerland
| | - Falk Schwendicke
- Department of Oral Diagnostics, Digital Health and Health Services Research, Charité - Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Germany; ITU/WHO Focus Group AI on Health, Topic Group Dental Diagnostics and Digital Dentistry, Switzerland
| |
Collapse
|
20
|
Kredel R, Hernandez J, Hossner EJ, Zahno S. Eye-tracking technology and the dynamics of natural gaze behavior in sports: an update 2016-2022. Front Psychol 2023; 14:1130051. [PMID: 37359890 PMCID: PMC10286576 DOI: 10.3389/fpsyg.2023.1130051] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2022] [Accepted: 05/16/2023] [Indexed: 06/28/2023] Open
Abstract
Updating and complementing a previous review on eye-tracking technology and the dynamics of natural gaze behavior in sports, this short review focuses on the progress concerning researched sports tasks, applied methods of gaze data collection and analysis as well as derived gaze measures for the time interval of 2016-2022. To that end, a systematic review according to the PRISMA guidelines was conducted, searching Web of Science, PubMed Central, SPORTDiscus, and ScienceDirect for the keywords: eye tracking, gaze behavio*r, eye movement, and visual search. Thirty-one studies were identified for the review. On the one hand, a generally increased research interest and a wider area of researched sports with a particular increase in official's gaze behavior were diagnosed. On the other hand, a general lack of progress concerning sample sizes, amounts of trials, employed eye-tracking technology and gaze analysis procedures must be acknowledged. Nevertheless, first attempts to automated gaze-cue-allocations (GCA) in mobile eye-tracking studies were seen, potentially enhancing objectivity, and alleviating the burden of manual workload inherently associated with conventional gaze analyses. Reinforcing the claims of the previous review, this review concludes by describing four distinct technological approaches to automating GCA, some of which are specifically suited to tackle the validity and generalizability issues associated with the current limitations of mobile eye-tracking studies on natural gaze behavior in sports.
Collapse
|
21
|
Brunyé TT, Balla A, Drew T, Elmore JG, Kerr KF, Shucard H, Weaver DL. From Image to Diagnosis: Characterizing Sources of Error in Histopathologic Interpretation. Mod Pathol 2023; 36:100162. [PMID: 36948400 DOI: 10.1016/j.modpat.2023.100162] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2022] [Revised: 02/11/2023] [Accepted: 03/07/2023] [Indexed: 03/24/2023]
Abstract
An accurate histopathologic diagnosis on surgical biopsy material is necessary for the clinical management of patients and has important implications for research, clinical trial design/enrollment, and public health education. This study used a mixed methods approach to isolate sources of diagnostic error while residents and attending pathologists interpreted digitized breast biopsy slides. Ninety participants including pathology residents and attendings at major United States medical centers reviewed a set of 14 digitized whole slide images of breast biopsies. Each case had a consensus-defined diagnosis and critical region of interest (cROI) representing the most significant pathology on the slide. Participants were asked to view unmarked digitized slides, draw their own participant region of interest (pROI), describe its features, and render a diagnosis. Participants' review behavior was tracked using case viewer software and an eye-tracking device. Diagnostic accuracy was calculated in comparison to the consensus diagnosis. We measured the frequency of errors emerging during four interpretive phases: 1) detecting the cROI, 2) recognizing its relevance, 3) using the correct terminology to describe findings in the pROI, and 4) making a diagnostic decision. According to eye tracking data, both trainees and attending pathologists were very likely (about 94% of the time) to find the cROI when inspecting a slide. However, trainees were less likely to consider the cROI relevant to their diagnosis. Pathology trainees were more likely (41% of cases) to use incorrect terminology to describe pROI features than attending pathologists (21% of cases). Failure to accurately describe features was the only factor strongly associated with an incorrect diagnosis. Identifying where errors emerge in the interpretive and/or descriptive process and working on building organ-specific feature recognition and verbal fluency in describing those features are critical steps for achieving competency in diagnostic decision making.
Collapse
Affiliation(s)
- Tad T Brunyé
- Center for Applied Brain and Cognitive Sciences, Tufts University, 177 College Ave., Suite 090, Medford, MA 02155; Department of Psychology, Tufts University, 490 Boston Ave., Medford, MA 02155.
| | - Agnes Balla
- Department of Pathology, University of Vermont and Vermont Cancer Center, 89 Beaumont Ave., Burlington, VT 05405
| | - Trafton Drew
- Department of Psychology, University of Utah, 380 S 1530 E Beh S 502, Salt Lake City, UT 84112
| | - Joann G Elmore
- David Geffen School of Medicine, Department of Medicine, University of California, Los Angeles, 885 Tiverton Drive, Los Angeles, CA 90095
| | - Kathleen F Kerr
- Department of Biostatistics, University of Washington, 1705 NE Pacific Street, Seattle, WA 98195
| | - Hannah Shucard
- Department of Biostatistics, University of Washington, 1705 NE Pacific Street, Seattle, WA 98195
| | - Donald L Weaver
- Department of Pathology, University of Vermont and Vermont Cancer Center, 89 Beaumont Ave., Burlington, VT 05405
| |
Collapse
|
22
|
Laubrock J, Krutz A, Nübel J, Spethmann S. Gaze patterns reflect and predict expertise in dynamic echocardiographic imaging. J Med Imaging (Bellingham) 2023; 10:S11906. [PMID: 36968293 PMCID: PMC10031643 DOI: 10.1117/1.jmi.10.s1.s11906] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2022] [Accepted: 03/01/2023] [Indexed: 03/24/2023] Open
Abstract
Purpose Echocardiography is the most important modality in cardiac imaging. Rapid valid visual assessment is a critical skill for image interpretation. However, it is unclear how skilled viewers assess echocardiographic images. Therefore, guidance and implicit advice are needed for learners to achieve valid image interpretation. Approach Using a signal detection approach, we compared 15 certified experts with 15 medical students in their diagnostic decision-making and viewing behavior. To quantify attention allocation, we recorded eye movements while viewing dynamic echocardiographic imaging loops of patients with reduced ejection fraction and healthy controls. Participants evaluated left ventricular ejection fraction and image quality (as diagnostic and visual control tasks, respectively). Results Experts were much better at discriminating between patients and healthy controls (d ' of 2.58, versus 0.98 for novices). Eye tracking revealed that experts fixated diagnostically relevant areas earlier and more often, whereas novices were distracted by visually salient task-irrelevant stimuli. We show that expertise status can be almost perfectly classified either based on judgments or purely on eye movements and that an expertise score derived from viewing behavior predicts diagnostic quality. Conclusions Judgments and eye tracking revealed significant differences between echocardiography experts and novices that can be used to derive numerical expertise scores. Experts have implicitly learned to ignore the salient motion cue presented by the mitral valve and to focus on the diagnostically more relevant left ventricle. These findings have implications for echocardiography training, objective characterization of echocardiographic expertise, and the design of user-friendly interfaces for echocardiography.
Collapse
Affiliation(s)
- Jochen Laubrock
- University of Potsdam, Cognitive Science, Department of Psychology, Potsdam, Germany
| | - Alexander Krutz
- Heart Centre Brandenburg, Department of Cardiology, Bernau, Germany
- Brandenburg Medical School Theodor Fontane, Faculty of Health Sciences Brandenburg, Neuruppin, Germany
| | - Jonathan Nübel
- Heart Centre Brandenburg, Department of Cardiology, Bernau, Germany
- Brandenburg Medical School Theodor Fontane, Faculty of Health Sciences Brandenburg, Neuruppin, Germany
| | - Sebastian Spethmann
- Deutsches Herzzentrum der Charité, Department of Cardiology, Angiology, and Intensive Care Medicine, Berlin, Germany
- Charité—Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Berlin, Germany
| |
Collapse
|
23
|
Li S, Duffy MC, Lajoie SP, Zheng J, Lachapelle K. Using eye tracking to examine expert-novice differences during simulated surgical training: A case study. COMPUTERS IN HUMAN BEHAVIOR 2023. [DOI: 10.1016/j.chb.2023.107720] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/03/2023]
|
24
|
Jin P, Ge Z, Fan T. Research on visual search behaviors of basketball players at different levels of sports expertise. Sci Rep 2023; 13:1406. [PMID: 36697486 PMCID: PMC9876905 DOI: 10.1038/s41598-023-28754-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2022] [Accepted: 01/24/2023] [Indexed: 01/26/2023] Open
Abstract
This study aims to examine visual search strategies of skilled basketball players in an anticipation task. This study selected 48 experienced and inexperienced basketball players. The participants were grouped into novice and expert groups based on their experience. The participants were asked to look at series of pictures of offensive patterns of play in a basketball game from a third person perspective and chose one of the three options: passing, shooting and break through. This study measured and recorded the response time, key pressing results, and eye movements. Eye movement data were recorded using the Tobii X-3 120 eye tracker. The results showed that, the expert group demonstrated superior anticipation performance, and were more accuracy. In addition, the results showed that participants in the expert group and faster predicted the offensive way faster than the novice group. The results also showed that experienced basketball players employed a simple and efficient visual search strategy including greater fixation counts and longer fixation duration on more informative areas than the novice group. Furthermore, the visualization metrics showed that the expert group had a more concise fixation trajectory and focused mainly on key information area. Generally, expert players exhibited a more efficient and effective visual search strategy demonstrating better performance on anticipation tasks.
Collapse
Affiliation(s)
- Peng Jin
- Department of Physical Education, Southeast University, Nanjing, China.
| | - Zhigang Ge
- Department of Physical Education, Southeast University, Nanjing, China
| | | |
Collapse
|
25
|
Holmqvist K, Örbom SL, Hooge ITC, Niehorster DC, Alexander RG, Andersson R, Benjamins JS, Blignaut P, Brouwer AM, Chuang LL, Dalrymple KA, Drieghe D, Dunn MJ, Ettinger U, Fiedler S, Foulsham T, van der Geest JN, Hansen DW, Hutton SB, Kasneci E, Kingstone A, Knox PC, Kok EM, Lee H, Lee JY, Leppänen JM, Macknik S, Majaranta P, Martinez-Conde S, Nuthmann A, Nyström M, Orquin JL, Otero-Millan J, Park SY, Popelka S, Proudlock F, Renkewitz F, Roorda A, Schulte-Mecklenbeck M, Sharif B, Shic F, Shovman M, Thomas MG, Venrooij W, Zemblys R, Hessels RS. Eye tracking: empirical foundations for a minimal reporting guideline. Behav Res Methods 2023; 55:364-416. [PMID: 35384605 PMCID: PMC9535040 DOI: 10.3758/s13428-021-01762-8] [Citation(s) in RCA: 45] [Impact Index Per Article: 45.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/29/2021] [Indexed: 11/08/2022]
Abstract
In this paper, we present a review of how the various aspects of any study using an eye tracker (such as the instrument, methodology, environment, participant, etc.) affect the quality of the recorded eye-tracking data and the obtained eye-movement and gaze measures. We take this review to represent the empirical foundation for reporting guidelines of any study involving an eye tracker. We compare this empirical foundation to five existing reporting guidelines and to a database of 207 published eye-tracking studies. We find that reporting guidelines vary substantially and do not match with actual reporting practices. We end by deriving a minimal, flexible reporting guideline based on empirical research (Section "An empirically based minimal reporting guideline").
Collapse
Affiliation(s)
- Kenneth Holmqvist
- Department of Psychology, Nicolaus Copernicus University, Torun, Poland.
- Department of Computer Science and Informatics, University of the Free State, Bloemfontein, South Africa.
- Department of Psychology, Regensburg University, Regensburg, Germany.
| | - Saga Lee Örbom
- Department of Psychology, Regensburg University, Regensburg, Germany
| | - Ignace T C Hooge
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, The Netherlands
| | - Diederick C Niehorster
- Lund University Humanities Lab and Department of Psychology, Lund University, Lund, Sweden
| | - Robert G Alexander
- Department of Ophthalmology, SUNY Downstate Health Sciences University, Brooklyn, NY, USA
| | | | - Jeroen S Benjamins
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, The Netherlands
- Social, Health and Organizational Psychology, Utrecht University, Utrecht, The Netherlands
| | - Pieter Blignaut
- Department of Computer Science and Informatics, University of the Free State, Bloemfontein, South Africa
| | | | - Lewis L Chuang
- Department of Ergonomics, Leibniz Institute for Working Environments and Human Factors, Dortmund, Germany
- Institute of Informatics, LMU Munich, Munich, Germany
| | | | - Denis Drieghe
- School of Psychology, University of Southampton, Southampton, UK
| | - Matt J Dunn
- School of Optometry and Vision Sciences, Cardiff University, Cardiff, UK
| | | | - Susann Fiedler
- Vienna University of Economics and Business, Vienna, Austria
| | - Tom Foulsham
- Department of Psychology, University of Essex, Essex, UK
| | | | - Dan Witzner Hansen
- Machine Learning Group, Department of Computer Science, IT University of Copenhagen, Copenhagen, Denmark
| | | | - Enkelejda Kasneci
- Human-Computer Interaction, University of Tübingen, Tübingen, Germany
| | | | - Paul C Knox
- Department of Eye and Vision Science, Institute of Life Course and Medical Sciences, University of Liverpool, Liverpool, UK
| | - Ellen M Kok
- Department of Education and Pedagogy, Division Education, Faculty of Social and Behavioral Sciences, Utrecht University, Utrecht, The Netherlands
- Department of Online Learning and Instruction, Faculty of Educational Sciences, Open University of the Netherlands, Heerlen, The Netherlands
| | - Helena Lee
- University of Southampton, Southampton, UK
| | - Joy Yeonjoo Lee
- School of Health Professions Education, Faculty of Health, Medicine, and Life Sciences, Maastricht University, Maastricht, The Netherlands
| | - Jukka M Leppänen
- Department of Psychology and Speed-Language Pathology, University of Turku, Turku, Finland
| | - Stephen Macknik
- Department of Ophthalmology, SUNY Downstate Health Sciences University, Brooklyn, NY, USA
| | - Päivi Majaranta
- TAUCHI Research Center, Computing Sciences, Faculty of Information Technology and Communication Sciences, Tampere University, Tampere, Finland
| | - Susana Martinez-Conde
- Department of Ophthalmology, SUNY Downstate Health Sciences University, Brooklyn, NY, USA
| | - Antje Nuthmann
- Institute of Psychology, University of Kiel, Kiel, Germany
| | - Marcus Nyström
- Lund University Humanities Lab, Lund University, Lund, Sweden
| | - Jacob L Orquin
- Department of Management, Aarhus University, Aarhus, Denmark
- Center for Research in Marketing and Consumer Psychology, Reykjavik University, Reykjavik, Iceland
| | - Jorge Otero-Millan
- Herbert Wertheim School of Optometry and Vision Science, University of California, Berkeley, CA, USA
| | - Soon Young Park
- Comparative Cognition, Messerli Research Institute, University of Veterinary Medicine Vienna, Medical University of Vienna, Vienna, Austria
| | - Stanislav Popelka
- Department of Geoinformatics, Palacký University Olomouc, Olomouc, Czech Republic
| | - Frank Proudlock
- The University of Leicester Ulverscroft Eye Unit, Department of Neuroscience, Psychology and Behaviour, University of Leicester, Leicester, UK
| | - Frank Renkewitz
- Department of Psychology, University of Erfurt, Erfurt, Germany
| | - Austin Roorda
- Herbert Wertheim School of Optometry and Vision Science, University of California, Berkeley, CA, USA
| | | | - Bonita Sharif
- School of Computing, University of Nebraska-Lincoln, Lincoln, Nebraska, USA
| | - Frederick Shic
- Center for Child Health, Behavior and Development, Seattle Children's Research Institute, Seattle, WA, USA
- Department of General Pediatrics, University of Washington School of Medicine, Seattle, WA, USA
| | - Mark Shovman
- Eyeviation Systems, Herzliya, Israel
- Department of Industrial Design, Bezalel Academy of Arts and Design, Jerusalem, Israel
| | - Mervyn G Thomas
- The University of Leicester Ulverscroft Eye Unit, Department of Neuroscience, Psychology and Behaviour, University of Leicester, Leicester, UK
| | - Ward Venrooij
- Electrical Engineering, Mathematics and Computer Science (EEMCS), University of Twente, Enschede, The Netherlands
| | | | - Roy S Hessels
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, The Netherlands
| |
Collapse
|
26
|
Ivy S, Rohovit T, Stefanucci J, Stokes D, Mills M, Drew T. Visual expertise is more than meets the eye: an examination of holistic visual processing in radiologists and architects. J Med Imaging (Bellingham) 2023; 10:015501. [PMID: 36710958 PMCID: PMC9871605 DOI: 10.1117/1.jmi.10.1.015501] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2022] [Accepted: 01/02/2023] [Indexed: 01/25/2023] Open
Abstract
Purpose One of the dominant behavioral markers of visual-expert search strategy, holistic visual processing (HVP), suggests that experts process information from a larger region of space in conjunction with a more focused gaze pattern to improve search speed and accuracy. To date, extant literature suggests that visual search expertise is domain specific, including HVP and its associated behaviors. Approach The current study is the first to use eye tracking to directly measure the HVP strategies of two expert groups, radiologists and architects, in comparison to one another and a novice control. Results In doing so, we replicated and extended this prior research: visual expertise is domain specific. However, our eye-tracking data indicate that contrary to this prior work, HVP strategies are transferable across domains. Yet, despite the transfer of HVP strategies, there is neither reduced search time nor greater accuracy in visual search outside of an expert's domain. Conclusions Therefore, our data suggest that HVP behaviors are a particular form of visual search mechanism that, outside of an expert's native search-ecology, are not necessarily conducive to more general visual search success. It is in addition to explicit knowledge of an expert's domain, how to search, and where to search, that HVP strategies are their most effective for visual search success.
Collapse
Affiliation(s)
- Spencer Ivy
- University of Utah, Department of Philosophy, Salt Lake City, Utah, United States
| | - Taren Rohovit
- University of Oregon, Department of Psychology, Eugene, Oregon, United States
| | | | - Dustin Stokes
- University of Utah, Department of Philosophy, Salt Lake City, Utah, United States
| | - Megan Mills
- University of Utah, Department of Radiology and Imaging Sciences, Utah, United States
| | - Trafton Drew
- University of Utah, Department of Psychology, Utah, United States
| |
Collapse
|
27
|
Pizzo A, Fosgaard TR, Tyler BB, Beukel K. Information acquisition and cognitive processes during strategic decision-making: Combining a policy-capturing study with eye-tracking data. PLoS One 2022; 17:e0278409. [PMID: 36454962 PMCID: PMC9714927 DOI: 10.1371/journal.pone.0278409] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2022] [Accepted: 11/15/2022] [Indexed: 12/03/2022] Open
Abstract
Policy-capturing (PC) methodologies have been employed to study decision-making, and to assess how decision-makers use available information when asked to evaluate hypothetical situations. An important assumption of the PC techniques is that respondents develop cognitive models to help them efficiently process the many information cues provided while reviewing a large number of decision scenarios. With this study, we seek to analyze the process of answering a PC study. We do this by investigating the information acquisition and the cognitive processes behind policy-capturing, building on cognitive and attention research and exploiting the tools of eye-tracking. Additionally, we investigate the role of experience in mediating the relationship between the information processed and judgments in order to determine how the cognitive models of student samples differ from those of professionals. We find evidence of increasing efficiency as a function of practice when respondents undergo the PC experiment. We also detect a selective process on information acquisition; such selection is consistent with the respondents' evaluation. While some differences are found in the information processing among the split sample of students and professionals, remarkable similarities are detected. Our study adds confidence to the assumption that respondents build cognitive models to handle the large amounts of information presented in PC experiments, and the defection of such models is not substantially affected by the applied sample.
Collapse
Affiliation(s)
- Alice Pizzo
- Copenhagen Business School, Department of Management, Society and Communication, Frederiksberg C, Denmark
| | - Toke R. Fosgaard
- Department of Food and Resource Economics, University of Copenhagen, København, Denmark
| | - Beverly B. Tyler
- Department of Management, Virginia Tech Pamplin College of Business, Blacksburg, VA, United States of America
| | - Karin Beukel
- Department of Food and Resource Economics, University of Copenhagen, København, Denmark
| |
Collapse
|
28
|
Boutin KD, Davis C, Hevner A, Léger PM, Labonte-LeMoyne E. Don't overthink it: The paradoxical nature of expertise for the detection of errors in conceptual business process models. Front Neurosci 2022; 16:982764. [PMID: 36507322 PMCID: PMC9731113 DOI: 10.3389/fnins.2022.982764] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2022] [Accepted: 10/25/2022] [Indexed: 11/25/2022] Open
Abstract
Business process models are widely used artifacts in design activities to facilitate communication about business domains and processes. Despite being an extensively researched topic, some aspects of conceptual business modeling are yet to be fully explored and understood by academicians and practitioners alike. We study the attentional characteristics specific to experts and novices in a semantic and syntactic error detection task across 75 Business Process Model and Notation (BPMN) models. We find several intriguing results. Experts correctly identify more error-free models than novices, but also tend to find more false positive defects. Syntactic errors are diagnosed faster than semantic errors by both groups. Both groups spend more time on error-free models. Our findings regarding the ambiguous differences between experts and novices highlight the paradoxical nature of expertise and the need to further study how best to train business analysts to design and evaluate conceptual models.
Collapse
Affiliation(s)
- Karl-David Boutin
- Department of Information Technologies, HEC Montréal, Montreal, QC, Canada
| | - Christopher Davis
- School of Information Systems and Management, University of South Florida, Tampa, FL, United States
| | - Alan Hevner
- School of Information Systems and Management, University of South Florida, Tampa, FL, United States
| | | | | |
Collapse
|
29
|
Nespolo RG, Cole E, Wang D, Yi D, Leiderman YI. A Platform for Tracking Surgeon and Observer Gaze as a Surrogate for Attention in Ophthalmic Surgery. OPHTHALMOLOGY SCIENCE 2022; 3:100246. [PMID: 36748062 PMCID: PMC9898791 DOI: 10.1016/j.xops.2022.100246] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/30/2022] [Accepted: 10/25/2022] [Indexed: 11/10/2022]
Abstract
Purpose To develop and validate a platform that can extract eye gaze metrics from surgeons observing cataract and vitreoretinal procedures and to enable post hoc data analysis to assess potential discrepancies in eye movement behavior according to surgeon experience. Design Experimental, prospective, single-center study. Participants Eleven ophthalmic surgeons observing deidentified vitreoretinal and cataract surgical procedures performed at a single university-based medical center. Methods An open-source platform was developed to extract gaze coordinates and metrics from ophthalmic surgeons via a computer vision algorithm in conjunction with a neural network to track and segment instruments and tissues, identifying areas of attention in the visual field of study subjects. Eleven surgeons provided validation data by watching videos of 6 heterogeneous vitreoretinal and cataract surgical phases. Main Outcome Measures Accuracy and distance traveled by the eye gaze of participants and overlap of the participants' eye gaze with instruments and tissues while observing surgical procedures. Results The platform demonstrated repeatability of > 94% when acquiring the eye gaze behavior of subjects. Attending ophthalmic surgeons and clinical fellows exhibited a lower overall cartesian distance traveled in comparison to resident physicians in ophthalmology (P < 0.02). Ophthalmology residents and clinical fellows exhibited more fixations to the display area where surgical device parameters were superimposed than attending surgeons (P < 0.05). There was a trend toward gaze overlap with the instrument tooltip location among resident physicians in comparison to attending surgeons and fellows (41.42% vs. 34.8%, P > 0.2). The number and duration of fixations did not vary substantially among groups (P > 0.3). Conclusions The platform proved effective in extracting gaze metrics of ophthalmic surgeons. These preliminary data suggest that surgeon gaze behavior differs according to experience.
Collapse
Affiliation(s)
- Rogerio G. Nespolo
- Department of Ophthalmology and Visual Sciences - Illinois Eye and Ear Infirmary, University of Illinois Chicago, Chicago, Illinois,Richard and Loan Hill Department of Biomedical Engineering, University of Illinois Chicago, Chicago, Illinois
| | - Emily Cole
- Richard and Loan Hill Department of Biomedical Engineering, University of Illinois Chicago, Chicago, Illinois
| | - Daniel Wang
- Richard and Loan Hill Department of Biomedical Engineering, University of Illinois Chicago, Chicago, Illinois
| | - Darvin Yi
- Department of Ophthalmology and Visual Sciences - Illinois Eye and Ear Infirmary, University of Illinois Chicago, Chicago, Illinois,Richard and Loan Hill Department of Biomedical Engineering, University of Illinois Chicago, Chicago, Illinois
| | - Yannek I. Leiderman
- Department of Ophthalmology and Visual Sciences - Illinois Eye and Ear Infirmary, University of Illinois Chicago, Chicago, Illinois,Richard and Loan Hill Department of Biomedical Engineering, University of Illinois Chicago, Chicago, Illinois,Correspondence: Yannek I. Leiderman, MD, PhD, University of Illinois, 1905 W. Taylor St, Chicago, IL 60612.
| |
Collapse
|
30
|
Millard L, Breukelman GJ, Mathe N, Shaw I, Shaw BS. A review of the essential visual skills required for soccer: Beyond 20-20 optometry. Front Sports Act Living 2022; 4:965195. [PMID: 36311213 PMCID: PMC9596797 DOI: 10.3389/fspor.2022.965195] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2022] [Accepted: 09/23/2022] [Indexed: 11/13/2022] Open
Abstract
In ball sports such as soccer, the visual system is critical in guiding a player's search for crucial information that underpins skillful behavior, which requires the incorporation of all of the relevant information in the environment in order to make successful decisions under pressure. However, vision in sport, and focusing on the specific visual skills required to be successful in a particular sport has largely been a practice ignored by experts and coaches as being an essential component of athletic performance. This is the first attempt to summarize and compile the necessary visual skills for soccer. This review's evidence suggests that, while current research still tends to focus on visual skills as a whole, there is a need to streamline this focus to the necessities of a particular sport. Furthermore, in identifying the visual skills essential for soccer, it allows for the effective training and testing of these skills, as well as for talent identification.
Collapse
Affiliation(s)
- Lourens Millard
- Department of Human Movement Science, University of Zululand, KwaDlangezwa, South Africa
| | - Gerrit Jan Breukelman
- Department of Human Movement Science, University of Zululand, KwaDlangezwa, South Africa
| | - Nonkululeko Mathe
- Department of Human Movement Science, University of Zululand, KwaDlangezwa, South Africa
| | - Ina Shaw
- School of Sport, Rehabilitation and Exercise Sciences, University of Essex, Colchester, United Kingdom
| | - Brandon S. Shaw
- School of Sport, Rehabilitation and Exercise Sciences, University of Essex, Colchester, United Kingdom
| |
Collapse
|
31
|
Silva AF, Afonso J, Sampaio A, Pimenta N, Lima RF, Castro HDO, Ramirez-Campillo R, Teoldo I, Sarmento H, González Fernández F, Kaczmarek A, Oniszczuk A, Murawska-Ciałowicz E. Differences in visual search behavior between expert and novice team sports athletes: A systematic review with meta-analysis. Front Psychol 2022; 13:1001066. [PMID: 36211897 PMCID: PMC9536317 DOI: 10.3389/fpsyg.2022.1001066] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2022] [Accepted: 08/01/2022] [Indexed: 12/01/2022] Open
Abstract
Background For a long time, in sports, researchers have tried to understand an expert by comparing them with novices, raising the doubts if the visual search characteristics distinguish experts from novices. Therefore, the aim of the present study was to review and conduct a meta-analysis to evaluate the differences in visual search behavior between experts and novices in team sports athletes. Methods This systematic review with meta-analysis followed the PRISMA 2020 and Cochrane's guidelines. Healthy team athletes were included, which engaged in regular practice, from any sex or competitive level, specifically classified a priori as expert or novice in the original research (i.e., if they were classified after the experiment, based on one of the tests, the study would be excluded). We considered only research published in peer-reviewed journals, with no limitations regarding date or language. It was considered healthy team sport athletes engaged in regular practice. The scenarios could be in situ or film-based. The databases of EBSCO (Academic Search Complete, Academic Search Ultimate, APA PsycArticles, and APA PsycINFO), PubMed, Scopus, SPORTDiscus, and Web of Science were used to perform the searches. The risk of bias was calculated through the RoBANS tool. Results From a total of 6,257 records, of which 985 were duplicates, titles and abstracts of 5,272 were screened, and 45 required full-text analysis. Of those, 23 were excluded due to not fulfilling the eligibility criteria regarding participants. In the end, 22 studies were selected, however, as two studies were part of the same trial and were analyzed conjointly. Discussion Experts showed to be older and with more years of practice. The ability to distinguish experts from novices was not so clear regarding the variables analyzed. This could be due to the strategies chosen in each study, which were specific to each scenario, and when grouping all together, it was lost information within non-representative averages. The distinction between experts and novices was not clear, showing a lot of heterogeneity in the included studies. The expert classification itself may have been the conditioning aspect for these results, retaining the doubt and the need for more studies in the field. Systematic review registration The protocol was pre-registered in OSF (project https://osf.io/3j4qv/, register https://osf.io/dvk2n).
Collapse
Affiliation(s)
- Ana Filipa Silva
- Escola Superior Desporto e Lazer, Instituto Politécnico de Viana do Castelo, Viana do Castelo, Portugal
- The Research Centre in Sports Sciences, Health Sciences and Human Development (CIDESD), Vila Real, Portugal
- Sport Performance, Recreation, Innovation and Technology (SPRINT), Melgaço, Portugal
| | - José Afonso
- Faculty of Sport, Centre of Research, Education, Innovation, and Intervention in Sport (CIFI2D), University of Porto, Porto, Portugal
| | | | - Nuno Pimenta
- Sport Performance, Recreation, Innovation and Technology (SPRINT), Melgaço, Portugal
- N2i, Polytechnic Institute of Maia, Maia, Portugal
| | - Ricardo Franco Lima
- Escola Superior Desporto e Lazer, Instituto Politécnico de Viana do Castelo, Viana do Castelo, Portugal
- The Research Centre in Sports Sciences, Health Sciences and Human Development (CIDESD), Vila Real, Portugal
- Sport Performance, Recreation, Innovation and Technology (SPRINT), Melgaço, Portugal
| | | | - Rodrigo Ramirez-Campillo
- Department of Physical Activity Sciences, Universidad de Los Lagos, Santiago, Chile
- Exercise and Rehabilitation Sciences Institute, School of Physical Therapy, Faculty of Rehabilitation Sciences, Universidad Andres Bello, Santiago, Chile
| | - Israel Teoldo
- Centre of Research and Studies in Soccer (NUPEF), Universidade Federal de Viçosa, Viçosa, Brazil
| | - Hugo Sarmento
- University of Coimbra, Research Unit for Sport and Physical Activity (CIDAF), Faculty of Sport Sciences and Physical Education, Coimbra, Portugal
| | | | - Agnieszka Kaczmarek
- Department of Physiology and Biochemistry, University School of Physical Education, Wrocław, Poland
| | - Anna Oniszczuk
- Department of Physiology and Biochemistry, University School of Physical Education, Wrocław, Poland
| | | |
Collapse
|
32
|
Analysis of software developers’ coding behavior: A survey of visualization analysis techniques using eye trackers. COMPUTERS IN HUMAN BEHAVIOR REPORTS 2022. [DOI: 10.1016/j.chbr.2022.100213] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
|
33
|
Teachers' visual focus of attention in relation to students' basic academic skills and teachers' individual support for students: An eye-tracking study. LEARNING AND INDIVIDUAL DIFFERENCES 2022. [DOI: 10.1016/j.lindif.2022.102179] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
34
|
Perra J, Latimier A, Poulin-Charronnat B, Baccino T, Drai-Zerbib V. A Meta-analysis on the Effect of Expertise on Eye Movements during Music Reading. J Eye Mov Res 2022; 15:10.16910/jemr.15.4.1. [PMID: 37323997 PMCID: PMC10266858 DOI: 10.16910/jemr.15.4.1] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2023] Open
Abstract
The current meta-analysis was conducted on 12 studies comparing the eye movements of expert versus non-expert musicians and attempted to determine which eye movement measures are expertise dependent during music reading. The total dataset of 61 comparisons was divided into four subsets, each concerning one eye-movement variable (i.e., fixation duration, number of fixations, saccade amplitude, and gaze duration). We used a variance estimation method to aggregate the effect sizes. The results support the robust finding of reduced fixation duration in expert musicians (Subset 1, g = -0.72). Due to low statistical power because of limited effect sizes, the results on the number of fixations, saccade amplitude, and gaze duration were not reliable. We conducted meta-regression analyses to determine potential moderators of the effect of expertise on eye movements (i.e., definition of experimental groups, type of musical task performed, type of musical material used or tempo control). Moderator analyses did not yield any reliable results. The need for consistency in the experimental methodology is discussed.
Collapse
Affiliation(s)
- Joris Perra
- LEAD Université Bourgogne Franche-Comté, Dijon, France
- *The first two authors equally contributed to the first authorship
| | - Alice Latimier
- LEAD Université Bourgogne Franche-Comté, Dijon, France
- *The first two authors equally contributed to the first authorship
| | | | | | | |
Collapse
|
35
|
Kassem L, MacMahon C, Quinn J, Dogramaci S, Pang B, Steel KA. Examining the Eye Movement Behaviors Associated With Skilled Decision-Making by Elite Australian Rules Football Players. Front Sports Act Living 2022; 4:899217. [PMID: 35899141 PMCID: PMC9311377 DOI: 10.3389/fspor.2022.899217] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2022] [Accepted: 06/14/2022] [Indexed: 11/13/2022] Open
Abstract
Exploration of eye-movement behaviors of humans can provide insight into the processes used to inform and make decisions, with a large body of research revealing general trends, especially in the sporting context. Despite this some questions remain within the sport context particularly for elite groups engaged in diverse sports, and the potential for this information to provide for training, development, and performance. Therefore, the purpose of this study was to examine the critical fixation points and durations associated with superior decision-making within an elite group of Australian Rules football players. To achieve this eye-movement behavior (fixations) and associated decision-making skills of (N = 27; Mage = 25.0 ± 3.7 yrs) elite Australian Rules (AR) football players were measured while they watched game-based video clips. The most skilled players made significantly faster decisions compared to less skilled players (p < 0.001), who also had significantly shorter total fixation duration (p < 0.0001). Further, analysis showed that the most skilled players spent more time fixating on potential options within an area of interest (p = 0.003). Thus, within a group of highly skilled group of athletes, distinctions can be made on perceptual-cognitive skills, for outcome decisions and decision processes. That is, skilled decision-makers appear to have more efficient visual search strategies, which may help them process visual information more effectively. Further, examination of these behaviors may aid sport science and coaching staff identify the process that can be refined to increase player ability between and within various teams.
Collapse
Affiliation(s)
- Lael Kassem
- School of Health Sciences, Western Sydney University, Sydney, NSW, Australia
- Greater Western Sydney Giants Australian Football League, Sydney, NSW, Australia
| | - Clare MacMahon
- Sport and Exercise Science, La Trobe University, Melbourne, VIC, Australia
| | - John Quinn
- Greater Western Sydney Giants Australian Football League, Sydney, NSW, Australia
- Quinn Elite Sport Services, Sydney, NSW, Australia
| | - Sera Dogramaci
- School of Health Sciences, Western Sydney University, Sydney, NSW, Australia
| | - Bonnie Pang
- School of Health Sciences, Western Sydney University, Sydney, NSW, Australia
- Department of Health, University of Bath, Bath, United Kingdom
| | - Kylie A. Steel
- School of Health Sciences, Western Sydney University, Sydney, NSW, Australia
- The MARCS Institute for Brain, Behaviour and Development, Sydney, NSW, Australia
- *Correspondence: Kylie A. Steel
| |
Collapse
|
36
|
Meyer J, Fasold F, Schul K, Sonnenschein M, Klatt S. The Defender's Vision-Gaze Behavior of One-on-One Defenders in Basketball. JOURNAL OF SPORT & EXERCISE PSYCHOLOGY 2022; 44:127-137. [PMID: 35245894 DOI: 10.1123/jsep.2021-0149] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/17/2021] [Revised: 12/14/2021] [Accepted: 01/23/2022] [Indexed: 06/14/2023]
Abstract
In fast-paced team sports, anticipation is one important element in defense strategies. The primary objective of this study was to examine the recommendation for action and use of defensive gaze strategies by defensive players in basketball. Four national-level expert-basketball coaches were interviewed and a field study with mobile eye-tracking devices was conducted on 16 expert and 16 novice players defending in a one-on-one situation. Differences in relative fixation times between experts and novices were elaborated for the predetermined gaze zones-head, ball, torso, and feet-as given by the expert coaches. This was done for three phases of the movement sequence: receiving, dribbling, and shooting. The results of the interviews with expert coaches indicated that the existing coaching doctrine instructs players to look at the torso of an opponent to avoid being vulnerable to fakes. Surprisingly, our findings with the players showed a discrepancy in the evaluated gaze behavior of the experts and novices. For the receiving and dribbling phase, experts mainly fixated their gaze on the head while novices focused on the ball. For the final shooting phase, both the groups mainly fixated their gaze on the ball. Fixating the gaze on the ball or head makes the player potentially vulnerable to deceptive movements, as video-based research has shown. Expert coaches also indicated that peripheral vision is of importance to defenders, contradicting the existing assumption in the literature that focusing on the task-relevant areas is key for anticipation performance.
Collapse
Affiliation(s)
- Johannes Meyer
- Institute of Exercise Training and Sport Informatics, German Sport University Cologne, Cologne, Germany
| | - Frowin Fasold
- Institute of Exercise Training and Sport Informatics, German Sport University Cologne, Cologne, Germany
| | - Karsten Schul
- Institute of Exercise Training and Sport Informatics, German Sport University Cologne, Cologne, Germany
| | - Matthias Sonnenschein
- Institute of Exercise Training and Sport Informatics, German Sport University Cologne, Cologne, Germany
| | - Stefanie Klatt
- Institute of Exercise Training and Sport Informatics, German Sport University Cologne, Cologne, Germany
- Sport and Exercise Science and Sports Medicine Research and Enterprise Group, Welkin Laboratories, University of Brighton, United Kingdom
| |
Collapse
|
37
|
Barnes J, Blair MR, Walshe RC, Tupper PF. LAG-1: A dynamic, integrative model of learning, attention, and gaze. PLoS One 2022; 17:e0259511. [PMID: 35298465 PMCID: PMC8929614 DOI: 10.1371/journal.pone.0259511] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2021] [Accepted: 10/21/2021] [Indexed: 11/19/2022] Open
Abstract
It is clear that learning and attention interact, but it is an ongoing challenge to integrate their psychological and neurophysiological descriptions. Here we introduce LAG-1, a dynamic neural field model of learning, attention and gaze, that we fit to human learning and eye-movement data from two category learning experiments. LAG-1 comprises three control systems: one for visuospatial attention, one for saccadic timing and control, and one for category learning. The model is able to extract a kind of information gain from pairwise differences in simple associations between visual features and categories. Providing this gain as a reentrant signal with bottom-up visual information, and in top-down spatial priority, appropriately influences the initiation of saccades. LAG-1 provides a moment-by-moment simulation of the interactions of learning and gaze, and thus simultaneously produces phenomena on many timescales, from the duration of saccades and gaze fixations, to the response times for trials, to the slow optimization of attention toward task relevant information across a whole experiment. With only three free parameters (learning rate, trial impatience, and fixation impatience) LAG-1 produces qualitatively correct fits for learning, behavioural timing and eye movement measures, and also for previously unmodelled empirical phenomena (e.g., fixation orders showing stimulus-specific attention, and decreasing fixation counts during feedback). Because LAG-1 is built to capture attention and gaze generally, we demonstrate how it can be applied to other phenomena of visual cognition such as the free viewing of visual stimuli, visual search, and covert attention.
Collapse
Affiliation(s)
- Jordan Barnes
- Department of Psychology, Simon Fraser University, Burnaby, BC, Canada
| | - Mark R. Blair
- Department of Psychology, Simon Fraser University, Burnaby, BC, Canada
- * E-mail:
| | - R. Calen Walshe
- Center for Perceptual Systems, University of Texas, Austin, Texas, United States of America
| | - Paul F. Tupper
- Department of Mathematics, Simon Fraser University, Burnaby, BC, Canada
| |
Collapse
|
38
|
Amir O, Utterback KJ, Lee J, Lee KS, Kwon S, Carroll DM, Papoutsaki A. The elephant in the room: attention to salient scene features increases with comedic expertise. Cogn Process 2022; 23:203-215. [PMID: 35267116 DOI: 10.1007/s10339-022-01079-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2021] [Accepted: 01/25/2022] [Indexed: 11/03/2022]
Abstract
What differentiates the joke writing strategy employed by professional comedians from non-comedians? Previous MRI work found that professional comedians relied to a greater extent on "bottom-up processes," i.e., associations driven by the prompt stimuli themselves, while controls relied more on prefrontal lobe directed, "top-down" processes. In the present work, professional improv comedians and controls generated humorous captions to cartoons while their eye movements were tracked. Participants' visual fixation patterns were compared to predictions of the saliency model (Harel et al. in Adv Neural Inf Process Syst 19:545-552, 2007)-a computer model for identifying the most salient locations in an image based on visual features. Captions generated by the participants were rated for funniness by independent raters. Relative to controls, professional comedians' gaze was driven to a greater extent by the cartoons' salient visual features. For all participants, captions' funniness positively correlated with visual attention to salient cartoon features. Results suggest that comedic expertise is associated with increased reliance on bottom-up, stimulus-driven creativity, and that a bottom-up strategy results, on average, in funnier captions whether employed by comedians or controls. The cognitive processes underlying successful comedic creativity appear to adhere to the old comedians' adage "pay attention to the elephant in the room."
Collapse
Affiliation(s)
- Ori Amir
- Psychological Science, Pomona College, Claremont, CA, USA.
| | | | - Justin Lee
- Psychological Science, Pomona College, Claremont, CA, USA
| | - Kevin S Lee
- Computer Science, Pomona College, Claremont, CA, USA
| | - Suehyun Kwon
- Psychological Science, Pomona College, Claremont, CA, USA
| | | | | |
Collapse
|
39
|
Lu T, Tang M, Guo Y, Zhou C, Zhao Q, You X. Effect of video game experience on the simulated flight task: the role of attention and spatial orientation. AUSTRALIAN JOURNAL OF PSYCHOLOGY 2022. [DOI: 10.1080/00049530.2021.2007736] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
Affiliation(s)
- Tianjiao Lu
- Student Mental Health Education Center, Northwestern Polytechnical University, Xi’an, Shaanxi, China
| | - Menghan Tang
- Shaanxi Key Laboratory of Behavior and Cognitive Neuroscience, The Institute of Psychology, Shaanxi Normal University, Xi’an, Shaanxi, China
| | - Yu Guo
- Shaanxi Key Laboratory of Behavior and Cognitive Neuroscience, The Institute of Psychology, Shaanxi Normal University, Xi’an, Shaanxi, China
| | - Chenchen Zhou
- Shaanxi Key Laboratory of Behavior and Cognitive Neuroscience, The Institute of Psychology, Shaanxi Normal University, Xi’an, Shaanxi, China
| | - Qingxian Zhao
- Shaanxi Key Laboratory of Behavior and Cognitive Neuroscience, The Institute of Psychology, Shaanxi Normal University, Xi’an, Shaanxi, China
| | - Xuqun You
- Shaanxi Key Laboratory of Behavior and Cognitive Neuroscience, The Institute of Psychology, Shaanxi Normal University, Xi’an, Shaanxi, China
| |
Collapse
|
40
|
Ben Mahfoudh H, Zoudji B. Improving Soccer Players' Memorization of Soccer Tactics: Effects of Visual Realism, Soccer Expertise and Visuospatial Abilities. Percept Mot Skills 2022; 129:747-766. [PMID: 35084241 DOI: 10.1177/00315125221076448] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
In this study we aimed to examine the effect of visual realism on soccer players' memorization of soccer tactics according to their level of expertise and visuospatial abilities. We divided 48 volunteers into novice and expert soccer players and had them first perform a multitask visuospatial abilities (VSA) test and then undergo training with three dynamic soccer scenes, each presented with varied levels of realism (schematic, moderately realistic and highly realistic). We then tested players' memorization and reproduction of the soccer scenes and measured their visual processing with eye-tracking glasses to identify their cognitive processes during memorization. We found that reducing visual realism improved visual processing and memorization when compared to higher realism (p < .001). Second, both higher (versus lower) player expertise and higher (versus lower) VSA influenced visual processing and enhanced memorization efficiency (p < .001). Third, there were significant interaction effects between visual realism, player expertise, and player VSA (p < .001) such that players with high VSA benefited more from reduced (versus accentuated) visual realism than did players with low-VSA. Thus, increasing visual realism can hinder tactical learning effectiveness, especially for learners who lack domain expertise and visuospatial abilities. Practically speaking, coaches and educators might improve their communications by tailoring tactical instructions to learners' cognitive skills.
Collapse
|
41
|
Tolvanen O, Elomaa AP, Itkonen M, Vrzakova H, Bednarik R, Huotarinen A. Eye-Tracking Indicators of Workload in Surgery: A Systematic Review. J INVEST SURG 2022; 35:1340-1349. [PMID: 35038963 DOI: 10.1080/08941939.2021.2025282] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
BackgroundEye tracking is a powerful tool for unobtrusive and real time assessment of workload in clinical settings. Before the complex eye tracking derived surrogates can be proactively utilized to improve surgical safety, the indications, validity and reliability requires careful evaluation.MethodsWe conducted a systematic review of literature from 2010 to 2020 according to PRISMA guidelines. A search on PubMed, Cochrane, Scopus, Web of science, PsycInfo and Google scholar databases was conducted on July 2020. The following search query was used" ("eye tracking" OR "gaze tracking") AND (surgery OR surgical OR operative OR intraoperative) AND (workload OR stress)". Short papers, no peer reviewed or papers in which eye-tracking methodology was not used to investigate workload or stress factors in surgery, were omitted.ResultsA total of 17 (N = 17) studies were identified eligible to this review. Most of the studies (n = 15) measured workload in simulated setting. Task difficulty and expertise were the most studied factors. Studies consistently showed surgeon's eye movements such as pupil responses, gaze patterns, blinks were associated with the level of perceived workload. However, differences between measurements in operational room and simulated environments have been found.ConclusionPupil responses, blink rate and gaze indices are valid indicators of workload. However, the effect of distractions and non-technical factors on workload is underrepresented aspect in the literature even though recognized as underlying factors in successful surgery.
Collapse
Affiliation(s)
- Otto Tolvanen
- School of Medicine, University of Eastern Finland, Kuopio, Finland
| | - Antti-Pekka Elomaa
- Microsurgery Training Center, Kuopio University Hospital, Kuopio, Finland.,Neurosurgery of KUH NeuroCenter, Kuopio University Hospital, Kuopio, Finland
| | - Matti Itkonen
- Center of Brain Science (CBS), CBS-TOYOTA Collaboration Center, RIKEN, Nagoya, Japan
| | - Hana Vrzakova
- Microsurgery Training Center, Kuopio University Hospital, Kuopio, Finland
| | - Roman Bednarik
- School of Computing, University of Eastern Finland, Kuopio, Finland
| | - Antti Huotarinen
- School of Computing, University of Eastern Finland, Kuopio, Finland
| |
Collapse
|
42
|
Laxton V, Mackenzie AK, Crundall D. An exploration into the contributing cognitive skills of lifeguard visual search. APPLIED COGNITIVE PSYCHOLOGY 2022. [DOI: 10.1002/acp.3913] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
|
43
|
Gaczek P, Leszczyński G, Zieliński M. Is AI Augmenting or Substituting Humans? INTERNATIONAL JOURNAL OF TECHNOLOGY AND HUMAN INTERACTION 2022. [DOI: 10.4018/ijthi.293193] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
In this paper, the authors focus on Artificial Intelligence as a tangible technology that is designed to sense, comprehend, act, and learn. There are two manifestations of AI in the medical service: an algorithm that analyzes and interprets the test result and a virtual assistant that communicates the result to the patient. The aim of this paper is to consider how AI can substitute a doctor in measuring human health and how the interaction with virtual assistant impacts one’s visual attention processes. Theoretically, the article refers to the following research strands: Human-Computer Interaction, technology in services, implementation of AI in the medical sector, and behavioral economy. By conducting an eye-tracking experimental study, it is demonstrated that the perception of medical diagnosis does not differ across experimental groups (human vs. AI). However, it is observed that participants exposed to AI-based assistant focused more on button allowing to contact a real doctor.
Collapse
Affiliation(s)
- Piotr Gaczek
- Poznan University of Economics and Business, Poland
| | | | | |
Collapse
|
44
|
Elhamiasl M, Silva G, Cataldo AM, Hadley H, Arnold E, Tanaka JW, Curran T, Scott LS. Dissociations between performance and visual fixations after subordinate- and basic-level training with novel objects. Vision Res 2021; 191:107971. [PMID: 34826750 DOI: 10.1016/j.visres.2021.107971] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2021] [Revised: 10/08/2021] [Accepted: 11/01/2021] [Indexed: 11/26/2022]
Abstract
Previous work suggests that subordinate-level object training improves exemplar-level perceptual discrimination over basic-level training. However, the extent to which visual fixation strategies and the use of visual features, such as color and spatial frequency (SF), change with improved discrimination was not previously known. In the current study, adults (n = 24) completed 6 days of training with 2 families of computer-generated novel objects. Participants were trained to identify one object family at the subordinate level and the other object family at the basic level. Before and after training, discrimination accuracy and visual fixations were measured for trained and untrained exemplars. To examine the impact of training on visual feature use, image color and SF were manipulated and tested before and after training. Discrimination accuracy increased for the object family trained at the subordinate-level, but not for the family trained at the basic level. This increase was seen for all image manipulations (color, SF) and generalized to untrained exemplars within the trained family. Both subordinate- and basic-level training increased average fixation duration and saccadic amplitude and decreased the number of total fixations. Collectively, these results suggest a dissociation between discrimination accuracy, indicative of recognition, and the associated pattern of changes present for visual fixations.
Collapse
Affiliation(s)
- Mina Elhamiasl
- Department of Psychology, University of Florida, United States
| | - Gabriella Silva
- Department of Psychology, University of Florida, United States
| | - Andrea M Cataldo
- Department of Psychological and Brain Sciences, University of Massachusetts Amherst, United States
| | - Hillary Hadley
- Department of Psychological and Brain Sciences, University of Massachusetts Amherst, United States
| | - Erik Arnold
- Department of Psychological and Brain Sciences, University of Massachusetts Amherst, United States
| | - James W Tanaka
- Department of Psychology, University of Victoria, Canada
| | - Tim Curran
- Department of Psychology & Neuroscience, University of Colorado Boulder, United States
| | - Lisa S Scott
- Department of Psychology, University of Florida, United States.
| |
Collapse
|
45
|
Kim HF. Brain substrates for automatic retrieval of value memory in the primate basal ganglia. Mol Brain 2021; 14:168. [PMID: 34784931 PMCID: PMC8597290 DOI: 10.1186/s13041-021-00871-x] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2021] [Accepted: 10/22/2021] [Indexed: 12/20/2022] Open
Abstract
Our behavior is often carried out automatically. Automatic behavior can be guided by past experiences, such as learned values associated with objects. Passive-viewing and free-viewing tasks with no immediate outcomes provide a testable condition in which monkeys and humans automatically retrieve value memories and perform habitual searching. Interestingly, in these tasks, caudal regions of the basal ganglia structures are involved in automatic retrieval of learned object values and habitual gaze. In contrast, rostral regions do not participate in these activities but instead monitor the changes in outcomes. These findings indicate that automatic behaviors based on the value memories are processed selectively by the caudal regions of the primate basal ganglia system. Understanding the distinct roles of the caudal basal ganglia may provide insight into finding selective causes of behavioral disorders in basal ganglia disease.
Collapse
Affiliation(s)
- Hyoung F Kim
- School of Biological Sciences, Seoul National University (SNU), Gwanak-ro, Gwanak-gu, Seoul, 08826, Republic of Korea.
| |
Collapse
|
46
|
Shinoda H, Yamamoto T, Imai-Matsumura K. Teachers' visual processing of children's off-task behaviors in class: A comparison between teachers and student teachers. PLoS One 2021; 16:e0259410. [PMID: 34731202 PMCID: PMC8565755 DOI: 10.1371/journal.pone.0259410] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2021] [Accepted: 10/20/2021] [Indexed: 11/19/2022] Open
Abstract
As teachers are responsible for responding instantaneously to students' statements and actions, the progress of the class, and their teaching purpose, they need to be able to engage in responsive teaching. Teachers obtain information about students' learning by observing them in the classroom, and subsequently make instructional decisions based on this information. Teachers need to be sensitive to student behaviors and respond accordingly, because there are students who follow the teacher's instructions and those who do not in every classroom. Skilled teachers may distribute their gaze over the entire class and discover off-task behaviors. So how does a teacher's visual processing and noticing ability develop? It is important to clarify this process for both experienced teachers and student teachers. Therefore, the purpose of this study was to investigate whether there is a difference in visual processing and the ability to notice off-task behaviors in class between teachers and student teachers through gaze analysis. Using an eye tracking device, 76 teachers and 147 student teachers were asked to watch a video, and gaze measurements were collected. In the video, students exhibiting off-task behaviors in class were prompted by their classroom teacher to participate in the lesson. After the video, the participants were asked if they could identify the students who had displayed off-task behaviors and whom the teachers had warned. The results showed that teachers gazed at students engaging in off-task behaviors in class more often and noticed them at a higher rate than student teachers did. These results may be attributed to differences in the experiences of visual processing of relevant information in the classroom between teachers and student teachers. Thus, the findings on teachers' visual processing by direct measurement of gaze will be able to contribute to teachers' development.
Collapse
Affiliation(s)
- Hirofumi Shinoda
- Graduate School of Education, Bukkyo University, Kita-ku, Kyoto, Japan
| | | | | |
Collapse
|
47
|
Loiseau-Taupin M, Ruffault A, Slawinski J, Delabarre L, Bayle D. Effects of Acute Physical Fatigue on Gaze Behavior and Performance During a Badminton Game. Front Sports Act Living 2021; 3:725625. [PMID: 34676362 PMCID: PMC8523892 DOI: 10.3389/fspor.2021.725625] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2021] [Accepted: 09/08/2021] [Indexed: 11/28/2022] Open
Abstract
In badminton, the ability to quickly gather relevant visual information is one of the most important determinants of performance. However, gaze behavior has never been investigated in a real-game setting (with fatigue), nor related to performance. The aim of this study was to evaluate the effect of fatigue on gaze behavior during a badminton game setting, and to determine the relationship between fatigue, performance and gaze behavior. Nineteen novice badminton players equipped with eye-tracking glasses played two badminton sets: one before and one after a fatiguing task. The duration and number of fixations for each exchange were evaluated for nine areas of interest. Performance in terms of points won or lost and successful strokes was not impacted by fatigue, however fatigue induced more fixations per exchange on two areas of interest (shuttlecock and empty area after the opponent's stroke). Furthermore, two distinct gaze behaviors were found for successful and unsuccessful performance: points won were associated with fixations on the boundary lines and few fixation durations on empty area before the participant's stroke; successful strokes were related to long fixation durations, few fixation durations on empty area and a large number of fixations on the shuttlecock, racket, opponent's upper body and anticipation area. This is the first study to use a mobile eye-tracking system to capture gaze behavior during a real badminton game setting: fatigue induced changes in gaze behavior, and successful and unsuccessful performance were associated with two distinct gaze behaviors.
Collapse
Affiliation(s)
- Mildred Loiseau-Taupin
- Laboratory Sport, Expertise, Performance (EA7370), French Institute of Sport (INSEP), Paris, France
| | - Alexis Ruffault
- Laboratory Sport, Expertise, Performance (EA7370), French Institute of Sport (INSEP), Paris, France.,Unité de Recherche Intrafacultaire Santé et Société, Université de Liège, Liège, Belgium
| | - Jean Slawinski
- Laboratory Sport, Expertise, Performance (EA7370), French Institute of Sport (INSEP), Paris, France
| | - Lucile Delabarre
- Laboratory Sport, Expertise, Performance (EA7370), French Institute of Sport (INSEP), Paris, France
| | - Dimitri Bayle
- LICAE Lab, UFR STAPS, University of Paris, Nanterre, France
| |
Collapse
|
48
|
Improving Airline Pilots’ Visual Scanning and Manual Flight Performance through Training on Skilled Eye Gaze Strategies. SAFETY 2021. [DOI: 10.3390/safety7040070] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
Poor cockpit monitoring has been identified as an important contributor to aviation accidents. Improving pilots’ monitoring strategies could therefore help to enhance flight safety. During two different sessions, we analyzed the flight performance and eye movements of professional airline pilots in a full-flight simulator. In a pre-training session, 20 pilots performed a manual approach scenario as pilot flying (PFs) and were classified into three groups according to their flight performance: unstabilized, standard, and most accurate. The unstabilized pilots either under- or over-focused various instruments. Their number of visual scanning patterns was lower than those of pilots who managed to stabilize their approach. The most accurate pilots showed a higher perceptual efficiency with shorter fixation times and more fixations on important primary flight instruments. Approximately 10 months later, fourteen pilots returned for a post-training session. They received a short training program and performed a similar manual approach as during the pre-training session. Seven of them, the experimental group, received individual feedback on their own performance and visual behavior (i.e., during the pre-training session) and a variety of data obtained from the most accurate pilots, including an eye-tracking video showing efficient visual scanning strategies from one of the most accurate pilots. The other seven, the control group, received general guidelines on cockpit monitoring. During the post-training session, the experimental group had better flight performance (compared to the control group), and its visual scanning strategies became more similar to those of the most accurate pilots. In summary, our results suggest that cockpit monitoring underlies manual flight performance and that it can be improved using a training program based mainly on exposure to eye movement examples from highly accurate pilots.
Collapse
|
49
|
Drew T, Lavelle M, Kerr KF, Shucard H, Brunyé TT, Weaver DL, Elmore JG. More scanning, but not zooming, is associated with diagnostic accuracy in evaluating digital breast pathology slides. J Vis 2021; 21:7. [PMID: 34636845 PMCID: PMC8525842 DOI: 10.1167/jov.21.11.7] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2021] [Accepted: 09/15/2021] [Indexed: 12/02/2022] Open
Abstract
Diagnoses of medical images can invite strikingly diverse strategies for image navigation and visual search. In computed tomography screening for lung nodules, distinct strategies, termed scanning and drilling, relate to both radiologists' clinical experience and accuracy in lesion detection. Here, we examined associations between search patterns and accuracy for pathologists (N = 92) interpreting a diverse set of breast biopsy images. While changes in depth in volumetric images reveal new structures through movement in the z-plane, in digital pathology changes in depth are associated with increased magnification. Thus, "drilling" in radiology may be more appropriately termed "zooming" in pathology. We monitored eye-movements and navigation through digital pathology slides to derive metrics of how quickly the pathologists moved through XY (scanning) and Z (zooming) space. Prior research on eye-movements in depth has categorized clinicians as either "scanners" or "drillers." In contrast, we found that there was no reliable association between a clinician's tendency to scan or zoom while examining digital pathology slides. Thus, in the current work we treated scanning and zooming as continuous predictors rather than categorizing as either a "scanner" or "zoomer." In contrast to prior work in volumetric chest images, we found significant associations between accuracy and scanning rate but not zooming rate. These findings suggest fundamental differences in the relative value of information types and review behaviors across two image formats. Our data suggest that pathologists gather critical information by scanning on a given plane of depth, whereas radiologists drill through depth to interrogate critical features.
Collapse
Affiliation(s)
- Trafton Drew
- Department of Psychology, University of Utah, Salt Lake City, UT, USA
| | - Mark Lavelle
- Department of Psychology, University of Utah, Salt Lake City, UT, USA
| | - Kathleen F Kerr
- Department of Biostatistics, University of Washington, Seattle, WA, USA
| | - Hannah Shucard
- Department of Biostatistics, University of Washington, Seattle, WA, USA
| | - Tad T Brunyé
- Department of Psychology, Tufts University, Medford, MA, USA
| | - Donald L Weaver
- Department of Pathology & Laboratory Medicine, University of Vermont, Burlington, VT, USA
| | - Joann G Elmore
- Department of Medicine, David Geffen School of Medicine at UCLA, Los Angeles, CA, USA
| |
Collapse
|
50
|
Hurzlmeier M, Watzka B, Hoyer C, Girwidz R, Ertl B. Lernergebnisse und individuelle Prozesse des Physik-Lernens mit auditiven und visuellen Hinweisen. ZEITSCHRIFT FUR PADAGOGISCHE PSYCHOLOGIE 2021. [DOI: 10.1024/1010-0652/a000331] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
Abstract
Zusammenfassung. Die vorliegende Studie untersuchte im Kontext einer videobasierten Lernumgebung, inwieweit Personen durch die Darbietung von auditiven und visuellen Hinweisen beim Lernen komplexer Inhalte unterstützt werden können. Vor dem Hintergrund von Theorien des multimedialen Lernens wurden die Wirkungen der Hinweise auf kognitive Belastung, Lernerfolg sowie Blickbewegungen der Lernenden analysiert. In einem experimentellen Zwei-Gruppen-Design mit Vor- und Nachtest lernten 46 Teilnehmerinnen und Teilnehmer mithilfe visueller ( n = 23) oder auditiver ( n = 23) Unterstützung. Den Lerngegenstand bildeten Skizzen elektrischer Schaltungen, die als kognitives Werkzeug zur Lösung physikalischer Aufgaben eingesetzt werden. Es ergaben sich zwischen den Versuchsbedingungen keine signifikanten Unterschiede in Belastungserleben und Lernerfolg (.00 ≤ ηp2 ≤ .08). Allerdings waren Maße der kognitiven Belastung signifikante Prädiktoren des Lernerfolgs. Es zeigten sich auch bedeutsame Einflüsse des Vorwissens auf Wissensabruf ( R2 = .213) und Wissenstransfer ( R2 = .257). Im Rahmen qualitativer Auswertungen wurden zudem die Blickpfade von Personen mit niedrigem und hohem Vorwissen verglichen. Hier zeigte sich in beiden Modalitäten bei Personen mit niedrigem Vorwissen eher ein detailorientiertes Blickmuster auf Einzelelemente der Schaltungen und bei Personen mit hohem Vorwissen eher ein ganzheitlich orientiertes Blickmuster über das System von Schaltungen. In Bezug auf die vorwissensabhängigen Unterschiede in den Blickmustern und die Komplexität des Lerngegenstandes erscheinen sowohl eine zeitliche als auch eine instruktionale Adaptierbarkeit der Lernumgebung für Lernende mit wenig Vorwissen in beiden Hinweismodalitäten sinnvoll. Für die zukünftige Forschung bietet es sich im Sinne eines Mixed-Method-Ansatzes an, Prozesse und Ergebnisse des Lernens stärker aufeinander zu beziehen, um zu tieferen Erkenntnissen über die Nutzung und Wirkung instruktionaler Hinweise zu gelangen.
Collapse
|