1
|
Holmqvist K, Örbom SL, Hooge ITC, Niehorster DC, Alexander RG, Andersson R, Benjamins JS, Blignaut P, Brouwer AM, Chuang LL, Dalrymple KA, Drieghe D, Dunn MJ, Ettinger U, Fiedler S, Foulsham T, van der Geest JN, Hansen DW, Hutton SB, Kasneci E, Kingstone A, Knox PC, Kok EM, Lee H, Lee JY, Leppänen JM, Macknik S, Majaranta P, Martinez-Conde S, Nuthmann A, Nyström M, Orquin JL, Otero-Millan J, Park SY, Popelka S, Proudlock F, Renkewitz F, Roorda A, Schulte-Mecklenbeck M, Sharif B, Shic F, Shovman M, Thomas MG, Venrooij W, Zemblys R, Hessels RS. Eye tracking: empirical foundations for a minimal reporting guideline. Behav Res Methods 2023; 55:364-416. [PMID: 35384605 PMCID: PMC9535040 DOI: 10.3758/s13428-021-01762-8] [Citation(s) in RCA: 45] [Impact Index Per Article: 45.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/29/2021] [Indexed: 11/08/2022]
Abstract
In this paper, we present a review of how the various aspects of any study using an eye tracker (such as the instrument, methodology, environment, participant, etc.) affect the quality of the recorded eye-tracking data and the obtained eye-movement and gaze measures. We take this review to represent the empirical foundation for reporting guidelines of any study involving an eye tracker. We compare this empirical foundation to five existing reporting guidelines and to a database of 207 published eye-tracking studies. We find that reporting guidelines vary substantially and do not match with actual reporting practices. We end by deriving a minimal, flexible reporting guideline based on empirical research (Section "An empirically based minimal reporting guideline").
Collapse
Affiliation(s)
- Kenneth Holmqvist
- Department of Psychology, Nicolaus Copernicus University, Torun, Poland.
- Department of Computer Science and Informatics, University of the Free State, Bloemfontein, South Africa.
- Department of Psychology, Regensburg University, Regensburg, Germany.
| | - Saga Lee Örbom
- Department of Psychology, Regensburg University, Regensburg, Germany
| | - Ignace T C Hooge
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, The Netherlands
| | - Diederick C Niehorster
- Lund University Humanities Lab and Department of Psychology, Lund University, Lund, Sweden
| | - Robert G Alexander
- Department of Ophthalmology, SUNY Downstate Health Sciences University, Brooklyn, NY, USA
| | | | - Jeroen S Benjamins
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, The Netherlands
- Social, Health and Organizational Psychology, Utrecht University, Utrecht, The Netherlands
| | - Pieter Blignaut
- Department of Computer Science and Informatics, University of the Free State, Bloemfontein, South Africa
| | | | - Lewis L Chuang
- Department of Ergonomics, Leibniz Institute for Working Environments and Human Factors, Dortmund, Germany
- Institute of Informatics, LMU Munich, Munich, Germany
| | | | - Denis Drieghe
- School of Psychology, University of Southampton, Southampton, UK
| | - Matt J Dunn
- School of Optometry and Vision Sciences, Cardiff University, Cardiff, UK
| | | | - Susann Fiedler
- Vienna University of Economics and Business, Vienna, Austria
| | - Tom Foulsham
- Department of Psychology, University of Essex, Essex, UK
| | | | - Dan Witzner Hansen
- Machine Learning Group, Department of Computer Science, IT University of Copenhagen, Copenhagen, Denmark
| | | | - Enkelejda Kasneci
- Human-Computer Interaction, University of Tübingen, Tübingen, Germany
| | | | - Paul C Knox
- Department of Eye and Vision Science, Institute of Life Course and Medical Sciences, University of Liverpool, Liverpool, UK
| | - Ellen M Kok
- Department of Education and Pedagogy, Division Education, Faculty of Social and Behavioral Sciences, Utrecht University, Utrecht, The Netherlands
- Department of Online Learning and Instruction, Faculty of Educational Sciences, Open University of the Netherlands, Heerlen, The Netherlands
| | - Helena Lee
- University of Southampton, Southampton, UK
| | - Joy Yeonjoo Lee
- School of Health Professions Education, Faculty of Health, Medicine, and Life Sciences, Maastricht University, Maastricht, The Netherlands
| | - Jukka M Leppänen
- Department of Psychology and Speed-Language Pathology, University of Turku, Turku, Finland
| | - Stephen Macknik
- Department of Ophthalmology, SUNY Downstate Health Sciences University, Brooklyn, NY, USA
| | - Päivi Majaranta
- TAUCHI Research Center, Computing Sciences, Faculty of Information Technology and Communication Sciences, Tampere University, Tampere, Finland
| | - Susana Martinez-Conde
- Department of Ophthalmology, SUNY Downstate Health Sciences University, Brooklyn, NY, USA
| | - Antje Nuthmann
- Institute of Psychology, University of Kiel, Kiel, Germany
| | - Marcus Nyström
- Lund University Humanities Lab, Lund University, Lund, Sweden
| | - Jacob L Orquin
- Department of Management, Aarhus University, Aarhus, Denmark
- Center for Research in Marketing and Consumer Psychology, Reykjavik University, Reykjavik, Iceland
| | - Jorge Otero-Millan
- Herbert Wertheim School of Optometry and Vision Science, University of California, Berkeley, CA, USA
| | - Soon Young Park
- Comparative Cognition, Messerli Research Institute, University of Veterinary Medicine Vienna, Medical University of Vienna, Vienna, Austria
| | - Stanislav Popelka
- Department of Geoinformatics, Palacký University Olomouc, Olomouc, Czech Republic
| | - Frank Proudlock
- The University of Leicester Ulverscroft Eye Unit, Department of Neuroscience, Psychology and Behaviour, University of Leicester, Leicester, UK
| | - Frank Renkewitz
- Department of Psychology, University of Erfurt, Erfurt, Germany
| | - Austin Roorda
- Herbert Wertheim School of Optometry and Vision Science, University of California, Berkeley, CA, USA
| | | | - Bonita Sharif
- School of Computing, University of Nebraska-Lincoln, Lincoln, Nebraska, USA
| | - Frederick Shic
- Center for Child Health, Behavior and Development, Seattle Children's Research Institute, Seattle, WA, USA
- Department of General Pediatrics, University of Washington School of Medicine, Seattle, WA, USA
| | - Mark Shovman
- Eyeviation Systems, Herzliya, Israel
- Department of Industrial Design, Bezalel Academy of Arts and Design, Jerusalem, Israel
| | - Mervyn G Thomas
- The University of Leicester Ulverscroft Eye Unit, Department of Neuroscience, Psychology and Behaviour, University of Leicester, Leicester, UK
| | - Ward Venrooij
- Electrical Engineering, Mathematics and Computer Science (EEMCS), University of Twente, Enschede, The Netherlands
| | | | - Roy S Hessels
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, The Netherlands
| |
Collapse
|
3
|
Gong W, Yi B, Liu X, Luo F. The subsequent interruptive effects of pain on attention. Eur J Pain 2021; 26:786-795. [PMID: 34970813 DOI: 10.1002/ejp.1904] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2021] [Accepted: 12/26/2021] [Indexed: 11/10/2022]
Abstract
BACKGROUND Pain is known to interrupt attentional performance selectively. In a previous study we showed that the interruptive effect of thermal pain on attention could persist up to 1500 ms after painful stimulus offset, but whether the pain modality affects this subsequent interruptive effect remains unclear. METHODS The present study was conducted to determine the time course of the interruptive effect of electrically induced pain on orienting and executive attention using various intervals between electric stimulation and attentional tasks (0, 250, 500, 750, 1000, 1250, and 1500 ms) and three study groups (pain, non-pain, and control). We performed two separate experiments in which participants performed a spatial cue task (experiment 1) and the Stroop task (experiment 2). Participants in the pain and non-pain groups received brief electric somatosensory stimulation, and those in the control group received no physical stimulus. We compared the performance of the three groups under the interstimulus interval (ISI) conditions. RESULTS The impairment of orienting attention prevailed under the first six ISI conditions in the pain and non-pain groups (F2, 63 = 5.72, P < 0.01); executive attention was not affected (F1,66 = 1.64, P = 0.20), confirming the persistence of the interruptive effect after stimulus offset. CONCLUSIONS This study demonstrated the interruptive effect of somatic stimulation on subsequent orienting attention performance, with no effect on executive attention. These findings suggest that pain has differential effects on the components of attention, depending on its modality and salience.
Collapse
Affiliation(s)
- Wenxiao Gong
- CAS Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, 100101, P.R. China.,Department of Psychology, University of Chinese Academy of Sciences, Beijing, 100049, P.R. China
| | - Bing Yi
- Department of Psychology, Renmin University of China, Beijing, 100872, P.R. China
| | - Xiaoqian Liu
- School of Sociology, China University of Political Science and Law, Beijing, 100088, P.R. China
| | - Fei Luo
- CAS Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, 100101, P.R. China.,Department of Psychology, University of Chinese Academy of Sciences, Beijing, 100049, P.R. China
| |
Collapse
|
8
|
Gong W, Fan L, Luo F. Does experimentally induced pain affect attention? A meta-analytical review. J Pain Res 2019; 12:585-595. [PMID: 30787635 PMCID: PMC6368116 DOI: 10.2147/jpr.s184183] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022] Open
Abstract
Background Recent studies have found that clinical pain is related to cognitive impairment. However, there remains a scarcity of systematic reviews on the influence of acute pain on attention. Laboratory-induced pain is often used to simulate acute pain. The current systematic meta-analysis aimed to evaluate the effect of induced-pain on three components of attention (orienting, alerting, and executive attention) in healthy subjects. Methods A systematic search of three databases was performed. Only data from studies that administered laboratory-induced pain and that also included a control group were selected. The effects of experimental pain on orienting attention, alerting attention, and executive attention were analyzed. Two reviewers assessed the studies and extracted relevant data according to the Cochrane Collaboration and Preferred Reporting Items for Systematic Reviews and Meta-Analysis Guidelines. Results Eight studies were included in the meta-analysis. Orienting attention was marginally interrupted by pain under the invalid cue and marginally facilitated by pain under the valid cue condition. Performance on alerting attention was decreased by pain. Executive attention was not significantly affected by pain. Conclusion There was moderate evidence that experimentally induced pain can produce effects on orienting and alerting attention but not on executive attention. This meta-analysis suggests that experimentally induced pain influences some aspects of attention.
Collapse
Affiliation(s)
- Wenxiao Gong
- CAS Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, People's Republic of China, .,Department of Psychology, University of Chinese Academy of Sciences, Beijing 100049, People's Republic of China,
| | - Lu Fan
- CAS Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, People's Republic of China, .,Department of Psychology, University of Chinese Academy of Sciences, Beijing 100049, People's Republic of China,
| | - Fei Luo
- CAS Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, People's Republic of China, .,Department of Psychology, University of Chinese Academy of Sciences, Beijing 100049, People's Republic of China,
| |
Collapse
|
9
|
Schoth DE, Wu J, Zhang J, Guo X, Liossi C. Eye-movement behaviours when viewing real-world pain-related images. Eur J Pain 2019; 23:945-956. [PMID: 30629782 DOI: 10.1002/ejp.1363] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2017] [Revised: 12/10/2018] [Accepted: 12/19/2018] [Indexed: 11/09/2022]
Abstract
BACKGROUND Pain-related cues are evolutionarily primed to capture attention, although evidence of attentional biases towards pain-related information is mixed in healthy individuals. The present study explores whether healthy individuals show significantly different eye-movement behaviours when viewing real-world pain-related scenes compared to neutral scenes. The effect of manipulating via written information the threat value of the pain-related scenes on eye-movement behaviours was also assessed. METHODS Participants were randomized to threatening (n = 28) and non-threatening (n = 27) information conditions. All completed a free-viewing task with real-world pain-related and neutral images while their eye movements were recorded. RESULTS Participants made significantly fewer fixations of significantly longer duration when viewing pain-related images compared to neutral images. No significant differences were found between threatening and non-threatening information groups in their pattern of eye movements. CONCLUSIONS This study shows that healthy individuals demonstrate attentional biases to pain-related real-world complex images compared to neutral images. Future research is needed to establish the implications of these biases, particularly in the context of acute pain, on the onset and/or subsequent maintenance of chronic pain conditions. SIGNIFICANCE Healthy individuals show different eye-movement behaviours when viewing pain-related scenes than neutral scenes, supporting evolutionary accounts of pain. Implications for the onset and/or maintenance of chronic pain need to be explored.
Collapse
Affiliation(s)
- Daniel E Schoth
- Pain Research Laboratory, Department of Psychology, University of Southampton, Southampton, UK
| | - Jun Wu
- School of Psychology, South China Normal University, Guangzhou, China
| | - Jin Zhang
- Pain Research Laboratory, Department of Psychology, University of Southampton, Southampton, UK
| | - Xiaoying Guo
- School of Software Engineering, Shanxi University, Taiyuan, China
| | - Christina Liossi
- Pain Research Laboratory, Department of Psychology, University of Southampton, Southampton, UK
| |
Collapse
|