1
|
Styrkowiec P, Czyż SH, Hyönä J, Li J, Oksama L, Raś M. Gaze Behavior and Cognitive Performance on Tasks of Multiple Object Tracking and Multiple Identity Tracking by Handball Players and Non-Athletes. Percept Mot Skills 2024; 131:818-842. [PMID: 38437881 DOI: 10.1177/00315125241235529] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/06/2024]
Abstract
Multiple object tracking (MOT) and multiple identity tracking (MIT) each measure the ability to track moving objects visually. While prior investigators have mainly compared athletes and non-athletes on MOT, MIT more closely resembles dynamic real-life environments. Here we compared the performance and gaze behavior of handball players with non-athletes on both MOT and MIT. Since previous researchers have shown that MOT and MIT engage different eye movement strategies, we had participants track 3-5 targets among 10 moving objects. In MOT, the objects were identical, while in MIT they differed in shape and color. Although we observed no group differences for tracking accuracy, the eye movements of athletes were more target-oriented than those of non-athletes. We concluded that tasks and stimuli intended by researchers to demonstrate that athletes' show better object tracking than non-athletes should be specific to the athletes' type of sport and should use more perception-action coupled measures. An implication of this conclusion is that the differences in object tracking skills between athletes and non-athletes is highly specific to the skills demanded by the athletes' sport.
Collapse
Affiliation(s)
- Piotr Styrkowiec
- Institute of Psychology, University of Wrocław, Wroclaw, Poland
- Institute of Mind and Biology, University of Chicago, Chicago, IL, USA
| | - Stanisław H Czyż
- Faculty of Physical Education and Sports, Wroclaw University of Health and Sport Sciences, Wroclaw, Poland
- Faculty of Sport Studies, Masaryk University, Brno, Czechia
- Physical Activity, Sport and Recreation (PhASRec), Faculty of Health Sciences, North-West University, Potchefstroom, South Africa
| | - Jukka Hyönä
- Department of Psychology and Speech-Language Pathology, University of Turku, Turku, Finland
| | - Jie Li
- Department of Psychology and Speech-Language Pathology, University of Turku, Turku, Finland
- Center for Cognition and Brain Disorders, The Affiliated Hospital, Hangzhou Normal University, Hangzhou, China
| | - Lauri Oksama
- Department of Psychology and Speech-Language Pathology, University of Turku, Turku, Finland
- Finnish Defence Research Agency, Järvenpää, Finland
| | - Maciej Raś
- Action and Cognition Laboratory, Faculty of Psychology and Cognitive Science, Adam Mickiewicz University, Poznan, Poland
- Cognitive Neuroscience Center, Adam Mickiewicz University, Poznan, Poland
| |
Collapse
|
2
|
Lukavský J, Meyerhoff HS. Gaze coherence reveals distinct tracking strategies in multiple object and multiple identity tracking. Psychon Bull Rev 2024; 31:1280-1289. [PMID: 37940799 DOI: 10.3758/s13423-023-02417-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/21/2023] [Indexed: 11/10/2023]
Abstract
In dynamic environments, a central task of the attentional system is to keep track of objects changing their spatial location over time. In some instances, it is sufficient to track only the spatial locations of moving objects (i.e., multiple object tracking; MOT). In other instances, however, it is also important to maintain distinct identities of moving objects (i.e., multiple identity tracking; MIT). Despite previous research, it is not clear whether MOT and MIT performance emerge from the same tracking mechanism. In the present report, we study gaze coherence (i.e., the extent to which participants repeat their gaze behaviour when tracking the same object locations twice) across repeated MOT and MIT trials. We observed more substantial gaze coherence in repeated MOT trials compared to the repeated MIT trials or mixed MOT-MIT trial pairs. A subsequent simulation study suggests that MOT is based more on a grouping mechanism than MIT, whereas MIT is based more on a target-jumping mechanism than MOT. It thus appears unlikely that MOT and MIT emerge from the same basic tracking mechanism.
Collapse
Affiliation(s)
- Jiří Lukavský
- Institute of Psychology, Czech Academy of Sciences, Pod Vodárenskou věží 1143/4, 182 00, Prague, Czech Republic.
| | | |
Collapse
|
3
|
Baltaretu BR, Stevens WD, Freud E, Crawford JD. Occipital and parietal cortex participate in a cortical network for transsaccadic discrimination of object shape and orientation. Sci Rep 2023; 13:11628. [PMID: 37468709 DOI: 10.1038/s41598-023-38554-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2023] [Accepted: 07/11/2023] [Indexed: 07/21/2023] Open
Abstract
Saccades change eye position and interrupt vision several times per second, necessitating neural mechanisms for continuous perception of object identity, orientation, and location. Neuroimaging studies suggest that occipital and parietal cortex play complementary roles for transsaccadic perception of intrinsic versus extrinsic spatial properties, e.g., dorsomedial occipital cortex (cuneus) is sensitive to changes in spatial frequency, whereas the supramarginal gyrus (SMG) is modulated by changes in object orientation. Based on this, we hypothesized that both structures would be recruited to simultaneously monitor object identity and orientation across saccades. To test this, we merged two previous neuroimaging protocols: 21 participants viewed a 2D object and then, after sustained fixation or a saccade, judged whether the shape or orientation of the re-presented object changed. We, then, performed a bilateral region-of-interest analysis on identified cuneus and SMG sites. As hypothesized, cuneus showed both saccade and feature (i.e., object orientation vs. shape change) modulations, and right SMG showed saccade-feature interactions. Further, the cuneus activity time course correlated with several other cortical saccade/visual areas, suggesting a 'functional network' for feature discrimination. These results confirm the involvement of occipital/parietal cortex in transsaccadic vision and support complementary roles in spatial versus identity updating.
Collapse
Affiliation(s)
- B R Baltaretu
- Centre for Vision Research and Vision: Science to Applications (VISTA) Program, York University, Toronto, ON, M3J 1P3, Canada.
- Department of Biology, York University, Toronto, ON, M3J 1P3, Canada.
- Department of Psychology, Justus-Liebig University Giessen, Otto-Behaghel-Strasse 10F, 35394, Giessen, Hesse, Germany.
| | - W Dale Stevens
- Centre for Vision Research and Vision: Science to Applications (VISTA) Program, York University, Toronto, ON, M3J 1P3, Canada
- Department of Psychology and Neuroscience Graduate Diploma Program, York University, Toronto, ON, M3J 1P3, Canada
| | - E Freud
- Centre for Vision Research and Vision: Science to Applications (VISTA) Program, York University, Toronto, ON, M3J 1P3, Canada
- Department of Psychology and Neuroscience Graduate Diploma Program, York University, Toronto, ON, M3J 1P3, Canada
| | - J D Crawford
- Centre for Vision Research and Vision: Science to Applications (VISTA) Program, York University, Toronto, ON, M3J 1P3, Canada
- Department of Biology, York University, Toronto, ON, M3J 1P3, Canada
- Department of Psychology and Neuroscience Graduate Diploma Program, York University, Toronto, ON, M3J 1P3, Canada
- School of Kinesiology and Health Sciences, York University, Toronto, ON, M3J 1P3, Canada
| |
Collapse
|
4
|
Tullo D, Faubert J, Bertone A. Distinctive patterns of Multiple Object-Tracking performance trajectories in youth with deficits in attention, learning, and intelligence. RESEARCH IN DEVELOPMENTAL DISABILITIES 2023; 133:104402. [PMID: 36565518 DOI: 10.1016/j.ridd.2022.104402] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/24/2021] [Revised: 11/23/2022] [Accepted: 12/16/2022] [Indexed: 06/17/2023]
Abstract
There is a significant overlap in symptomology between individuals with deficits in attention and learning, which is explained by the co-dependent dynamic between the two cognitive constructs. Within this dynamic, attentional resources are allocated to salient stimuli while learning mechanisms distinguish relevant from irrelevant information. Moreover, individuals with deficits in higher-order cognition (i.e., intelligence) can demonstrate difficulties in attention and learning. The Multiple Object-Tracking (MOT) task is a sensitive and versatile measure of attention that has characterized individual differences in attention as a function of higher-order cognition. Exploiting the traditional MOT task's ability to characterize the allocation of attentional resources to task demands, the current study compared learning exhibited on an attention-based task across neurodevelopmental conditions defined by deficits in attention (attention-deficit/hyperactivity disorder; ADHD), learning (specific learning disorder; SLD), and intelligence (intellectual developmental disorder; IDD). Children and adolescents (N = 101) completed 15 sessions on a Multiple Object-Tracking (MOT) task where performance trajectories were analyzed using latent growth curve modeling and conditioned by the presence of ADHD, SLD, or IDD while controlling for performance on a separate measure of attention, age, and sex. The sample, characterized by below-average IQ and problematic levels of attention, exhibited an effect of learning on MOT. However, individuals with an IDD diagnosis demonstrated decreased baseline MOT capability while ADHD and SLD profiles exhibited decreased slopes, relative to other neurodevelopmental conditions. Taken together, the results demonstrate distinct linear performance trajectories between neurodevelopmental conditions defined by deficits in attention, learning, and intelligence. The current study provides additional evidence to repurpose the traditional MOT task as a descriptor of attention and discusses alternative uses for the paradigm. Overall, these results suggest an eclectic approach that considers attention, learning, and higher-order cognition when diagnosing ADHD, SLD, or IDD.
Collapse
Affiliation(s)
- Domenico Tullo
- School of Education, University of California, Irvine, 3200 Education Bldg, Irvine, CA 92697, USA.
| | - Jocelyn Faubert
- École d'optométrie, University of Montreal, 3744, rue Jean-Brillant, Montréal, QC H3T 1P1, Canada
| | - Armando Bertone
- Department of Education & Counselling Psychology, McGill University, 3700 McTavish Street, Montréal, H3A 1Y2 QC, Canada
| |
Collapse
|
5
|
Exploring the effectiveness of auditory, visual, and audio-visual sensory cues in a multiple object tracking environment. Atten Percept Psychophys 2022; 84:1611-1624. [PMID: 35610410 PMCID: PMC9232473 DOI: 10.3758/s13414-022-02492-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/14/2022] [Indexed: 11/08/2022]
Abstract
Maintaining object correspondence among multiple moving objects is an essential task of the perceptual system in many everyday life activities. A substantial body of research has confirmed that observers are able to track multiple target objects amongst identical distractors based only on their spatiotemporal information. However, naturalistic tasks typically involve the integration of information from more than one modality, and there is limited research investigating whether auditory and audio-visual cues improve tracking. In two experiments, we asked participants to track either five target objects or three versus five target objects amongst similarly indistinguishable distractor objects for 14 s. During the tracking interval, the target objects bounced occasionally against the boundary of a centralised orange circle. A visual cue, an auditory cue, neither or both coincided with these collisions. Following the motion interval, the participants were asked to indicate all target objects. Across both experiments and both set sizes, our results indicated that visual and auditory cues increased tracking accuracy although visual cues were more effective than auditory cues. Audio-visual cues, however, did not increase tracking performance beyond the level of purely visual cues for both high and low load conditions. We discuss the theoretical implications of our findings for multiple object tracking as well as for the principles of multisensory integration.
Collapse
|
6
|
Unequal allocation of overt and covert attention in Multiple Object Tracking. Atten Percept Psychophys 2022; 84:1519-1537. [PMID: 35562630 PMCID: PMC9232469 DOI: 10.3758/s13414-022-02501-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/25/2022] [Indexed: 12/03/2022]
Abstract
In many real-life contexts, where objects are moving around, we are often required to allocate our attention unequally between targets or regions of different importance. However, typical multiple object tracking (MOT) tasks, primarily investigate equal attention allocation as the likelihood of each target being probed is the same. In two experiments, we investigated whether participants can allocate attention unequally across regions of the visual field, using a MOT task where two regions were probed with either a high and low or with equal priority. Experiment 1 showed that for high-priority regions, accuracy (for direction of heading judgments) improved, and participants had more frequent and longer fixations in that region compared with a low-priority region. Experiment 2 showed that eye movements were functional in that they slightly improved accuracy when participants could freely move their eyes compared with when they had to centrally fixate. Replicating Experiment 1, we found better tracking performance for high compared with low-priority regions, in both the free and fixed viewing conditions, but the benefit was greater for the free viewing condition. Although unequal attention allocation is possible without eye movements, eye movements seem to improve tracking ability, presumably by allowing participants to fixate more in the high-priority region and get a better, foveal view of the objects. These findings can help us better understand how observers in real-life settings (e.g., CCTV monitoring, driving) can use their limited attentional capacity to allocate their attention unequally in a demand-based manner across different tracking regions.
Collapse
|
7
|
Vu A, Sorel A, Limballe A, Bideau B, Kulpa R. Multiple Players Tracking in Virtual Reality: Influence of Soccer Specific Trajectories and Relationship With Gaze Activity. Front Psychol 2022; 13:901438. [PMID: 35668965 PMCID: PMC9165719 DOI: 10.3389/fpsyg.2022.901438] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2022] [Accepted: 04/19/2022] [Indexed: 11/16/2022] Open
Abstract
The perceptual-cognitive ability to track multiple moving objects and its contribution to team sports performance has traditionally been studied in the laboratory under non-sports specific conditions. It is thus questionable whether the measured visual tracking performance and the underlying gaze activity reflected the actual ability of team sports players to track teammates and opponents on a real field. Using a Virtual Reality-based visual tracking task, the ability of participants to track multiple moving virtual players as they would do on a soccer field was observed to pursue two objectives. (i) See the influence of different scenario types (soccer-specific trajectories versus pseudo-random trajectories) on the visual tracking performance of soccer (n = 15) compared to non-soccer players (n = 16). (ii) Observe the influence of spatial features of the simulated situations on gaze activity between soccer players and non-soccer players. (i) The linear mixed model regression revealed a significant main effect of the group but no interaction effect between group and the type of trajectories, suggesting that the visual tracking ability of soccer players did not benefit from their specific knowledge when they faced scenarios with real game trajectories. (ii) Virtual players’ spatial dispersion and crowding affected the participants’ gaze activity and their visual tracking performance. Furthermore, the gaze activity of soccer players differed in some aspects from the gaze activity of non-soccer players. Assumptions are formulated as to the implication of these results in the difference in visual tracking performance between soccer players and non-soccer players. Overall, using soccer-specific trajectories might not be enough to replicate the representativeness of the field conditions in the study of visual tracking performance. Multitasking constraints should be considered along with motor-cognitive dual-tasks in future research to develop the representativeness of visual exploration conditions.
Collapse
Affiliation(s)
- Alexandre Vu
- Univ Rennes, Inria, M2S - EA 7470, Rennes, France
| | | | | | | | | |
Collapse
|
8
|
Jessop A, Chang F. Thematic role tracking difficulties across multiple visual events influences role use in language production. VISUAL COGNITION 2021. [DOI: 10.1080/13506285.2021.2013374] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Affiliation(s)
- Andrew Jessop
- School of Psychology, The University of Liverpool, Liverpool, UK
- Max Planck Institute for Psycholinguistics, Nijmegen, Netherlands
| | - Franklin Chang
- Department of English Studies, Kobe City University for Foreign Studies, Kobe, Japan
| |
Collapse
|
9
|
The Multiple Object Avoidance (MOA) task measures attention for action: Evidence from driving and sport. Behav Res Methods 2021; 54:1508-1529. [PMID: 34786653 PMCID: PMC9170642 DOI: 10.3758/s13428-021-01679-2] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/02/2021] [Indexed: 11/08/2022]
Abstract
Performance in everyday tasks, such as driving and sport, requires allocation of attention to task-relevant information and the ability to inhibit task-irrelevant information. Yet there are individual differences in this attentional function ability. This research investigates a novel task for measuring attention for action, called the Multiple Object Avoidance task (MOA), in its relation to the everyday tasks of driving and sport. The aim in Study 1 was to explore the efficacy of the MOA task to predict simulated driving behaviour and hazard perception. Whilst also investigating its test-retest reliability and how it correlates to self-report driving measures. We found that superior performance in the MOA task predicted simulated driving performance in complex environments and was superior at predicting performance compared to the Useful Field of View task. We found a moderate test-retest reliability and a correlation between the attentional lapses subscale of the Driving Behaviour Questionnaire. Study 2 investigated the discriminative power of the MOA in sport by exploring performance differences in those that do and do not play sports. We also investigated if the MOA shared attentional elements with other measures of visual attention commonly attributed to sporting expertise: Multiple Object Tracking (MOT) and cognitive processing speed. We found that those that played sports exhibited superior MOA performance and found a positive relationship between MOA performance and Multiple Object Tracking performance and cognitive processing speed. Collectively, this research highlights the utility of the MOA when investigating visual attention in everyday contexts.
Collapse
|
10
|
Kamkar S, Abrishami Moghaddam H, Lashgari R, Oksama L, Li J, Hyönä J. Effectiveness of "rescue saccades" on the accuracy of tracking multiple moving targets: An eye-tracking study on the effects of target occlusions. J Vis 2020; 20:5. [PMID: 33196768 PMCID: PMC7671859 DOI: 10.1167/jov.20.12.5] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Occlusion is one of the main challenges in tracking multiple moving objects. In almost all real-world scenarios, a moving object or a stationary obstacle occludes targets partially or completely for a short or long time during their movement. A previous study (Zelinsky & Todor, 2010) reported that subjects make timely saccades toward the object in danger of being occluded. Observers make these so-called “rescue saccades” to prevent target swapping. In this study, we examined whether these saccades are helpful. To this aim, we used as the stimuli recorded videos from natural movement of zebrafish larvae swimming freely in a circular container. We considered two main types of occlusion: object-object occlusions that naturally exist in the videos, and object-occluder occlusions created by adding a stationary doughnut-shape occluder in some videos. Four different scenarios were studied: (1) no occlusions, (2) only object-object occlusions, (3) only object-occluder occlusion, or (4) both object-object and object-occluder occlusions. For each condition, two set sizes (two and four) were applied. Participants’ eye movements were recorded during tracking, and rescue saccades were extracted afterward. The results showed that rescue saccades are helpful in handling object-object occlusions but had no reliable effect on tracking through object-occluder occlusions. The presence of occlusions generally increased visual sampling of the scenes; nevertheless, tracking accuracy declined due to occlusion.
Collapse
Affiliation(s)
- Shiva Kamkar
- Machine Vision and Medical Image Processing Laboratory, Faculty of Electrical and Computer Engineering, K. N. Toosi University of Technology, Tehran, Iran.,
| | - Hamid Abrishami Moghaddam
- Machine Vision and Medical Image Processing Laboratory, Faculty of Electrical and Computer Engineering, K. N. Toosi University of Technology, Tehran, Iran.,
| | - Reza Lashgari
- Institute of Medical Science and Technology, Shahid Beheshti University, Tehran, Iran.,
| | - Lauri Oksama
- Finnish Defence Research Agency, Human Performance Division, Järvenpää, Finland.,
| | - Jie Li
- Institutes of Psychological Sciences, Hangzhou Normal University, Hangzhou, China.,
| | - Jukka Hyönä
- Department of Psychology, University of Turku, Turku, Finland.,
| |
Collapse
|
11
|
Aminihajibashi S, Hagen T, Andreassen OA, Laeng B, Espeseth T. The effects of cognitive abilities and task demands on tonic and phasic pupil sizes. Biol Psychol 2020; 156:107945. [PMID: 32889001 DOI: 10.1016/j.biopsycho.2020.107945] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2019] [Revised: 07/16/2020] [Accepted: 08/03/2020] [Indexed: 12/22/2022]
Abstract
Previous studies on individual differences in pupil size of healthy individuals and their relation to performance have been inconclusive. Using a novel approach, we tested the effect of general cognitive abilities and level of task performance on pretrial baseline and task-evoked pupil (TEP) sizes (N = 116) while we manipulated the level of task demands using a multiple object tracking task. Results did not reveal an effect of general cognitive abilities, estimated by working memory capacity and gF scores, on either baseline or TEP sizes. In contrast, we found an interaction in TEP sizes between level of overall MOT performance and task demands. We propose that individual differences in TEP sizes are related to state-specific level of task performance and task demands, probably in combination with other factors like age, personality traits, and state-specific level of motivation and arousal. We also suggest methodological confounds that may cause the previous inconclusive findings.
Collapse
Affiliation(s)
| | - Thomas Hagen
- Department of Psychology, University of Oslo, Oslo, Norway
| | - Ole A Andreassen
- NORMENT Centre, Division of Mental Health and Addiction, Oslo University Hospital, Norway; NORMENT Centre, Institute of Clinical Medicine, University of Oslo, Oslo, Norway
| | - Bruno Laeng
- Department of Psychology, University of Oslo, Oslo, Norway; RITMO Centre for Interdisciplinary Studies in Rhythm, Time and Motion, University of Oslo, Oslo, Norway
| | - Thomas Espeseth
- Department of Psychology, University of Oslo, Oslo, Norway; Bjørknes College, Lovisenberggata 13, 0456 Oslo, Norway
| |
Collapse
|
12
|
Tullo D, Perico C, Faubert J, Bertone A. Multiple object-tracking isolates feedback-specific load in attention and learning. J Vis 2020; 20:9. [PMID: 32441736 PMCID: PMC7409588 DOI: 10.1167/jov.20.5.9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2019] [Accepted: 03/09/2020] [Indexed: 11/24/2022] Open
Abstract
Feedback is beneficial for learning. Nevertheless, it remains unclear whether (i) feedback draws attentional resources when integrated and (ii) the benefits of feedback for learning can be demonstrated using an attention-based task. We therefore (i) isolated feedback-specific load from task-specific load via individual differences in attention resource capacity and (ii) examined the effect of trial-by-trial feedback (i.e., present vs. absent) on learning a multiple object-tracking (MOT) paradigm. We chose MOT because it is a robust measure of attention resource capacity. In Study 1 participants tracked one (i.e., lowest attentional load condition) through four target items (i.e., highest load condition) among eight total items. One group (n = 32) received trial-by-trial feedback whereas the other group (n = 32) did not. The absence of feedback resulted in better MOT performance compared with the presence of feedback. Moreover, the difference in MOT capability between groups increased as the task-specific attentional load increased. These findings suggest that feedback integration requires attentional resources. Study 2 examined whether the absence (n = 19) or presence (n = 19) of feedback affects learning on the same MOT task across four testing days. When holding task-specific load constant, improvement in MOT was greater with feedback than without. Although this study is the first to isolate feedback-specific load in attention with MOT, more evidence is needed to demonstrate how the benefits of feedback translate to improvement on an attention-based task. These findings encourage future research to further explore the interaction between feedback, attention and learning.
Collapse
Affiliation(s)
- Domenico Tullo
- Department of Education & Counselling Psychology, McGill University, Montréal, Québec, Canada
| | - Chiara Perico
- Department of Education & Counselling Psychology, McGill University, Montréal, Québec, Canada
| | - Jocelyn Faubert
- École d'optométrie, Université de Montréal, Montréal, Québec, Canada
| | - Armando Bertone
- Department of Education & Counselling Psychology, McGill University, Montréal, Québec, Canada
| |
Collapse
|
13
|
Kamkar S, Ghezloo F, Moghaddam HA, Borji A, Lashgari R. Multiple-target tracking in human and machine vision. PLoS Comput Biol 2020; 16:e1007698. [PMID: 32271746 PMCID: PMC7144962 DOI: 10.1371/journal.pcbi.1007698] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022] Open
Abstract
Humans are able to track multiple objects at any given time in their daily activities—for example, we can drive a car while monitoring obstacles, pedestrians, and other vehicles. Several past studies have examined how humans track targets simultaneously and what underlying behavioral and neural mechanisms they use. At the same time, computer-vision researchers have proposed different algorithms to track multiple targets automatically. These algorithms are useful for video surveillance, team-sport analysis, video analysis, video summarization, and human–computer interaction. Although there are several efficient biologically inspired algorithms in artificial intelligence, the human multiple-target tracking (MTT) ability is rarely imitated in computer-vision algorithms. In this paper, we review MTT studies in neuroscience and biologically inspired MTT methods in computer vision and discuss the ways in which they can be seen as complementary. Multiple-target tracking (MTT) is a challenging task vital for both a human’s daily life and for many artificial intelligent systems, such as those used for urban traffic control. Neuroscientists are interested in discovering the underlying neural mechanisms that successfully exploit cognitive resources, e.g., spatial attention or memory, during MTT. Computer-vision specialists aim to develop powerful MTT algorithms based on advanced models or data-driven computational methods. In this paper, we review MTT studies from both communities and discuss how findings from cognitive studies can inspire developers to construct higher performing MTT algorithms. Moreover, some directions have been proposed through which MTT algorithms could raise new questions in the cognitive science domain, and answering them can shed light on neural processes underlying MTT.
Collapse
Affiliation(s)
- Shiva Kamkar
- Machine Vision and Medical Image Processing Laboratory, Faculty of Electrical and Computer Engineering, K. N. Toosi University of Technology, Tehran, Iran
- Brain Engineering Research Center, Institute for Research in Fundamental Sciences (IPM), Tehran, Iran
| | - Fatemeh Ghezloo
- Brain Engineering Research Center, Institute for Research in Fundamental Sciences (IPM), Tehran, Iran
| | - Hamid Abrishami Moghaddam
- Machine Vision and Medical Image Processing Laboratory, Faculty of Electrical and Computer Engineering, K. N. Toosi University of Technology, Tehran, Iran
- * E-mail: (RL); (HAM)
| | - Ali Borji
- HCL America, Manhattan, New York City, United States of America
| | - Reza Lashgari
- Brain Engineering Research Center, Institute for Research in Fundamental Sciences (IPM), Tehran, Iran
- * E-mail: (RL); (HAM)
| |
Collapse
|
14
|
|
15
|
Mäki-Marttunen V, Hagen T, Laeng B, Espeseth T. Distinct Neural Mechanisms Meet Challenges in Dynamic Visual Attention due to Either Load or Object Spacing. J Cogn Neurosci 2020; 32:65-84. [DOI: 10.1162/jocn_a_01469] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/25/2022]
Abstract
Abstract
When engaged in dynamic visuospatial tasks, the brain copes with perceptual and cognitive processing challenges. During multiple-object tracking (MOT), the number of objects to be tracked (i.e., load) imposes attentional demands, but so does spatial interference from irrelevant objects (i.e., close encounters). Presently, it is not clear whether the effect of load on accuracy solely depends on the number of close encounters. If so, the same cognitive and physiological mechanisms deal with increasing load by preparing for and dealing with spatial interference. However, this has never been directly tested. Such knowledge is important to understand the neurophysiology of dynamic visual attention and resolve conflicting views within visual cognition concerning sources of capacity limitations. We varied the processing challenge in MOT task in two ways: the number of targets and the minimum spatial proximity between targets and distractors. In a first experiment, we measured task-induced pupil dilations and saccades during MOT. In a separate cohort, we measured fMRI activity. In both cohorts, increased load and close encounters (i.e., close spatial proximity) led to reduced accuracy in an additive manner. Load was associated with pupil dilations, whereas close encounters were not. Activity in dorsal attentional areas and frequency of saccades were proportionally larger both with higher levels of load and close encounters. Close encounters recruited additionally ventral attentional areas that may reflect orienting mechanisms. The activity in two brainstem nuclei, ventral tegmental area/substantia nigra and locus coeruleus, showed clearly dissociated patterns. Our results constitute convergent evidence indicating that different mechanisms underlie processing challenges due to load and object spacing.
Collapse
|
16
|
Eye Behavior During Multiple Object Tracking and Multiple Identity Tracking. Vision (Basel) 2019; 3:vision3030037. [PMID: 31735838 PMCID: PMC6802796 DOI: 10.3390/vision3030037] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2019] [Revised: 07/22/2019] [Accepted: 07/23/2019] [Indexed: 11/17/2022] Open
Abstract
We review all published eye-tracking studies to date that have used eye movements to examine multiple object (MOT) or multiple identity tracking (MIT). In both tasks, observers dynamically track multiple moving objects. In MOT the objects are identical, whereas in MIT they have distinct identities. In MOT, observers prefer to fixate on blank space, which is often the center of gravity formed by the moving targets (centroid). In contrast, in MIT observers have a strong preference for the target-switching strategy, presumably to refresh and maintain identity-location bindings for the targets. To account for the qualitative differences between MOT and MIT, two mechanisms have been posited, a position tracking (MOT) and an identity tracking (MOT & MIT) mechanism. Eye-tracking studies of MOT have also demonstrated that observers execute rescue saccades toward targets in danger of becoming occluded or are about to change direction after a collision. Crowding attracts the eyes close to it in order to increase visual acuity for the crowded objects to prevent target loss. It is suggested that future studies should concentrate more on MIT, as MIT more closely resembles tracking in the real world.
Collapse
|
17
|
Hyönä J, Oksama L, Rantanen E. Tracking the identity of moving words: Stimulus complexity and familiarity affects tracking accuracy. APPLIED COGNITIVE PSYCHOLOGY 2019. [DOI: 10.1002/acp.3589] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Affiliation(s)
- Jukka Hyönä
- Department of PsychologyUniversity of Turku Turku Finland
| | - Lauri Oksama
- Human Performance DivisionFinnish Defence Research Agency Järvenpää Finland
| | - Esa Rantanen
- Department of PsychologyRochester Institute of Technology Rochester New York
| |
Collapse
|
18
|
Li J, Oksama L, Hyönä J. Model of Multiple Identity Tracking (MOMIT) 2.0: Resolving the serial vs. parallel controversy in tracking. Cognition 2018; 182:260-274. [PMID: 30384128 DOI: 10.1016/j.cognition.2018.10.016] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2018] [Revised: 10/03/2018] [Accepted: 10/23/2018] [Indexed: 11/29/2022]
Abstract
The present study investigated whether during tracking of multiple moving objects with distinct identities only one identity is tracked at each moment (serial tracking) or whether multiple identities can be tracked simultaneously (parallel tracking). By adopting the gaze-contingent display change technique, we manipulated in real time the presence/absence of object identities during tracking. The data on performance accuracy revealed a serial tracking pattern for facial images and a parallel pattern for color discs: when tracking faces, the presence/absence of only the currently foveated identity impacted the performance, whereas when tracking colors, the presence of multiple identities across the visual field led to improved tracking performance. This pattern is consistent with the identifiability of the different types of objects in the visual field. The eye movements during MIT showed a bias towards visiting and dwelling on individual targets when facial identities were present and towards visiting the blank areas between targets when color identities were present. Nevertheless, the eye visits were predominately on individual targets regardless of the type of objects and the presence of object identities. The eye visits to targets were beneficial for target tracking, particularly in face tracking. We propose the Model of Multiple Identity Tracking (MOMIT) 2.0 which accounts for the results and reconcile the serial vs. parallel controversy. The model suggests that observers cooperatively use attention, eye movements, perception, and working memory for dynamic tracking. Tracking appears more serial when high-resolution information needs to be sampled and maintained for discriminating the targets, whereas it appears more parallel when low-resolution information is sufficient.
Collapse
Affiliation(s)
- Jie Li
- School of Psychology, Beijing Sport University, China.
| | | | - Jukka Hyönä
- Department of Psychology, University of Turku, Finland.
| |
Collapse
|
19
|
Hagen T. Chasing Animals With Split Attention: Are Animals Prioritized in Visual Tracking? Iperception 2018; 9:2041669518795932. [PMID: 30202509 PMCID: PMC6124190 DOI: 10.1177/2041669518795932] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2017] [Accepted: 07/23/2018] [Indexed: 11/16/2022] Open
Abstract
Some evolutionary psychologists have hypothesized that animals have priority in human attention. That is, they should be detected and selected more efficiently than other types of objects, especially man-made ones. Such a priority mechanism should automatically deploy more attentional resources and dynamic monitoring toward animal stimuli than nonanimals. Consequently, we postulated that variations of the multiple object or identity tracking and multiple event monitoring tasks should be particularly suitable paradigms for addressing the animate monitoring hypothesis, given their dynamic properties and dependency on divided attention. We used images of animals and artifacts and found neither a substantial sign of improvement in tracking the positions associated with animal stimuli nor a significant distracting effect of animals. We also failed to observe a significant prioritization in orders of response for positions associated with animals. While we observed an advantage for animals in event monitoring, this appeared to be dependent on properties of the task, as confirmed in further experiments. Moreover, we observed a small but inconclusive advantage for animals in identity accuracy. Thus, under certain conditions, some bias toward animals could be observed, but the evidence was weak and inconclusive. To conclude, effect sizes were generally small and not conclusively in favor of the expected attentional bias for animals. We found moderate to strong evidence that images of animals do not improve positional tracking, do not act as more effective distractors, are not selected prior to artifacts in the response phase, and are not easier to monitor for changes in size.
Collapse
Affiliation(s)
- Thomas Hagen
- Department of Psychology, University of Oslo,
Norway
| |
Collapse
|
20
|
Li J, Oksama L, Hyönä J. Close coupling between eye movements and serial attentional refreshing during multiple-identity tracking. JOURNAL OF COGNITIVE PSYCHOLOGY 2018. [DOI: 10.1080/20445911.2018.1476517] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/14/2022]
Affiliation(s)
- Jie Li
- School of Psychology, Beijing Sport University, Beijing, People’s Republic of China
| | - Lauri Oksama
- Headquarters, National Defence University, Helsinki, Finland
| | - Jukka Hyönä
- Department of Psychology, University of Turku, Turku, Finland
| |
Collapse
|
21
|
Abstract
We investigated the role of two kinds of attention-visual and central attention-for the maintenance of visual representations in working memory (WM). In Experiment 1 we directed attention to individual items in WM by presenting cues during the retention interval of a continuous delayed-estimation task, and instructing participants to think of the cued items. Attending to items improved recall commensurate with the frequency with which items were attended (0, 1, or 2 times). Experiments 1 and 3 further tested which kind of attention-visual or central-was involved in WM maintenance. We assessed the dual-task costs of two types of distractor tasks, one tapping sustained visual attention and one tapping central attention. Only the central attention task yielded substantial dual-task costs, implying that central attention substantially contributes to maintenance of visual information in WM. Experiment 2 confirmed that the visual-attention distractor task was demanding enough to disrupt performance in a task relying on visual attention. We combined the visual-attention and the central-attention distractor tasks with a multiple object tracking (MOT) task. Distracting visual attention, but not central attention, impaired MOT performance. Jointly, the three experiments provide a double dissociation between visual and central attention, and between visual WM and visual object tracking: Whereas tracking multiple targets across the visual filed depends on visual attention, visual WM depends mostly on central attention.
Collapse
|
22
|
Nummenmaa L, Oksama L, Glerean E, Hyönä J. Cortical Circuit for Binding Object Identity and Location During Multiple-Object Tracking. Cereb Cortex 2018; 27:162-172. [PMID: 27913430 PMCID: PMC5939196 DOI: 10.1093/cercor/bhw380] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2016] [Accepted: 11/12/2016] [Indexed: 11/14/2022] Open
Abstract
Sustained multifocal attention for moving targets requires binding object identities with their locations. The brain mechanisms of identity-location binding during attentive tracking have remained unresolved. In 2 functional magnetic resonance imaging experiments, we measured participants’ hemodynamic activity during attentive tracking of multiple objects with equivalent (multiple-object tracking) versus distinct (multiple identity tracking, MIT) identities. Task load was manipulated parametrically. Both tasks activated large frontoparietal circuits. MIT led to significantly increased activity in frontoparietal and temporal systems subserving object recognition and working memory. These effects were replicated when eye movements were prohibited. MIT was associated with significantly increased functional connectivity between lateral temporal and frontal and parietal regions. We propose that coordinated activity of this network subserves identity-location binding during attentive tracking.
Collapse
Affiliation(s)
- Lauri Nummenmaa
- Turku PET Centre, University of Turku, Turku, Finland.,Department of Psychology, University of Turku, Turku, Finland
| | | | - Erico Glerean
- Department of Neuroscience and Biomedical Engineering, School of Science, Aalto University, Espoo, Finland.,Advanced Magnetic Imaging Centre, Aalto Neuroimaging, School of Science, Aalto University, Espoo, Finland
| | - Jukka Hyönä
- Department of Psychology, University of Turku, Turku, Finland
| |
Collapse
|
23
|
Comparing eye movements during position tracking and identity tracking: No evidence for separate systems. Atten Percept Psychophys 2017; 80:453-460. [PMID: 29159571 DOI: 10.3758/s13414-017-1447-x] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
There is an ongoing debate as to whether people track multiple moving objects in a serial fashion or with a parallel mechanism. One recent study compared eye movements when observers tracked identical objects (Multiple Object Tracking-MOT task) versus when they tracked the identities of different objects (Multiple Identity Tracking-MIT task). Distinct eye-movement patterns were found and attributed to two separate tracking systems. However, the same results could be caused by differences in the stimuli viewed during tracking. In the present study, object identities in the MIT task were invisible during tracking, so observers performed MOT and MIT tasks with identical stimuli. Observer were able to track either position and identity depending on the task. There was no difference in eye movements between position tracking and identity tracking. This result suggests that, while observers can use different eye-movement strategies in MOT and MIT, it is not necessary.
Collapse
|
24
|
Studying visual attention using the multiple object tracking paradigm: A tutorial review. Atten Percept Psychophys 2017; 79:1255-1274. [DOI: 10.3758/s13414-017-1338-1] [Citation(s) in RCA: 62] [Impact Index Per Article: 8.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
25
|
Li J, Oksama L, Nummenmaa L, Hyönä J. Angry faces are tracked more easily than neutral faces during multiple identity tracking. Cogn Emot 2017; 32:464-479. [PMID: 28402215 DOI: 10.1080/02699931.2017.1315929] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
We investigated whether and how emotional facial expressions affect sustained attention in face tracking. In a multiple-identity and object tracking paradigm, participants tracked multiple target faces that continuously moved around together with several distractor faces, and subsequently reported where each target face had moved to. The emotional expression (angry, happy, and neutral) of the target and distractor faces was manipulated. Tracking performance was better when the target faces were angry rather than neutral, whereas angry distractor faces did not affect tracking. The effect persisted when the angry faces were presented upside-down and when surface features of the faces were irrelevant to the ongoing task. There was only suggestive and weak evidence for a facilitatory effect of happy targets and a distraction effect of happy distractors in comparison to neutral faces. The results show that angry expressions on the target faces can facilitate sustained attention on the targets via increased vigilance, yet this effect likely depends on both emotional information and visual features of the angry faces.
Collapse
Affiliation(s)
- Jie Li
- a Section of Applied Psychology , Beijing Sport University , Beijing , People's Republic of China
| | - Lauri Oksama
- b Department of Behavioral Sciences , National Defence University , Helsinki , Finland
| | - Lauri Nummenmaa
- c Turku PET Centre , Turku University Hospital , Turku , Finland.,d Department of Psychology , University of Turku , Turku , Finland
| | - Jukka Hyönä
- d Department of Psychology , University of Turku , Turku , Finland
| |
Collapse
|
26
|
Abstract
Suppose you were monitoring a group of people in order to determine if anyone of them did something suspicious (e.g., putting down a bag) or if any two interacted in a suspicious manner (e.g., trading bags). How large a group could you monitor successfully? This paper reports on six experiments in which observers monitor a group of entities, watching for an event. Whether the event was performed by a single entity or was an interaction between a pair, the capacity for event monitoring was two to three items. This was lower than the multiple object tracking capacity for the same stimuli (approximately six items). Capacity was essentially the same whether entities were identical circles or unique cartoon animals; nor was capacity changed by an added requirement to identify the entities involved in an event. Event monitoring appears to be related to, but not identical to, multiple object tracking.
Collapse
Affiliation(s)
- Chia-Chien Wu
- Harvard Medical School, Boston, USA
- Visual Attention Lab, Brigham and Women’s Hospital, Boston, USA
| | - Jeremy M. Wolfe
- Harvard Medical School, Boston, USA
- Visual Attention Lab, Brigham and Women’s Hospital, Boston, USA
| |
Collapse
|
27
|
Mackenzie AK, Harris JM. A link between attentional function, effective eye movements, and driving ability. J Exp Psychol Hum Percept Perform 2016; 43:381-394. [PMID: 27893270 PMCID: PMC5279462 DOI: 10.1037/xhp0000297] [Citation(s) in RCA: 35] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
The misallocation of driver visual attention has been suggested as a major contributing factor to vehicle accidents. One possible reason is that the relatively high cognitive demands of driving limit the ability to efficiently allocate gaze. We present an experiment that explores the relationship between attentional function and visual performance when driving. Drivers performed 2 variations of a multiple-object tracking task targeting aspects of cognition including sustained attention, dual-tasking, covert attention, and visuomotor skill. They also drove a number of courses in a driving simulator. Eye movements were recorded throughout. We found that individuals who performed better in the cognitive tasks exhibited more effective eye movement strategies when driving, such as scanning more of the road, and they also exhibited better driving performance. We discuss the potential link between an individual's attentional function, effective eye movements, and driving ability. We also discuss the use of a visuomotor task in assessing driving behavior. (PsycINFO Database Record
Collapse
Affiliation(s)
| | - Julie M Harris
- School of Psychology & Neuroscience, University of St. Andrews
| |
Collapse
|
28
|
Li J, Oksama L, Hyönä J. How facial attractiveness affects sustained attention. Scand J Psychol 2016; 57:383-92. [DOI: 10.1111/sjop.12304] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2015] [Accepted: 05/10/2016] [Indexed: 11/30/2022]
Affiliation(s)
- Jie Li
- Section of Applied Psychology; Beijing Sport University; China
| | - Lauri Oksama
- Department of Behavioral Sciences; National Defense University; Finland
| | - Jukka Hyönä
- Department of Psychology; University of Turku; Finland
| |
Collapse
|