1
|
Alister M, McKay KT, Sewell DK, Evans NJ. Uncovering the cognitive mechanisms underlying the gaze cueing effect. Q J Exp Psychol (Hove) 2024; 77:803-827. [PMID: 37246917 PMCID: PMC10960327 DOI: 10.1177/17470218231181238] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2022] [Revised: 04/03/2023] [Accepted: 05/16/2023] [Indexed: 05/30/2023]
Abstract
The gaze cueing effect is the tendency for people to respond faster to targets appearing at locations gazed at by others, compared with locations gazed away from by others. The effect is robust, widely studied, and is an influential finding within social cognition. Formal evidence accumulation models provide the dominant theoretical account of the cognitive processes underlying speeded decision-making, but they have rarely been applied to social cognition research. In this study, using a combination of individual-level and hierarchical computational modelling techniques, we applied evidence accumulation models to gaze cueing data (three data sets total, N = 171, 139,001 trials) for the first time to assess the relative capacity that an attentional orienting mechanism and information processing mechanisms have for explaining the gaze cueing effect. We found that most participants were best described by the attentional orienting mechanism, such that response times were slower at gazed away from locations because they had to reorient to the target before they could process the cue. However, we found evidence for individual differences, whereby the models suggested that some gaze cueing effects were driven by a short allocation of information processing resources to the gazed at location, allowing for a brief period where orienting and processing could occur in parallel. There was exceptionally little evidence to suggest any sustained reallocation of information processing resources neither at the group nor individual level. We discuss how this individual variability might represent credible individual differences in the cognitive mechanisms that subserve behaviourally observed gaze cueing effects.
Collapse
Affiliation(s)
- Manikya Alister
- Melbourne School of Psychological Sciences, The University of Melbourne, Melbourne, VIC, Australia
| | - Kate T McKay
- School of Psychology, The University of Queensland, Saint Lucia, QLD, Australia
| | - David K Sewell
- School of Psychology, The University of Queensland, Saint Lucia, QLD, Australia
| | - Nathan J Evans
- School of Psychology, The University of Queensland, Saint Lucia, QLD, Australia
- Department of Psychology, Ludwig Maximilian University of Munich, Munich, Germany
| |
Collapse
|
2
|
Bánki A, Köster M, Cichy RM, Hoehl S. Communicative signals during joint attention promote neural processes of infants and caregivers. Dev Cogn Neurosci 2024; 65:101321. [PMID: 38061133 PMCID: PMC10754706 DOI: 10.1016/j.dcn.2023.101321] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2023] [Revised: 10/13/2023] [Accepted: 11/04/2023] [Indexed: 01/01/2024] Open
Abstract
Communicative signals such as eye contact increase infants' brain activation to visual stimuli and promote joint attention. Our study assessed whether communicative signals during joint attention enhance infant-caregiver dyads' neural responses to objects, and their neural synchrony. To track mutual attention processes, we applied rhythmic visual stimulation (RVS), presenting images of objects to 12-month-old infants and their mothers (n = 37 dyads), while we recorded dyads' brain activity (i.e., steady-state visual evoked potentials, SSVEPs) with electroencephalography (EEG) hyperscanning. Within dyads, mothers either communicatively showed the images to their infant or watched the images without communicative engagement. Communicative cues increased infants' and mothers' SSVEPs at central-occipital-parietal, and central electrode sites, respectively. Infants showed significantly more gaze behaviour to images during communicative engagement. Dyadic neural synchrony (SSVEP amplitude envelope correlations, AECs) was not modulated by communicative cues. Taken together, maternal communicative cues in joint attention increase infants' neural responses to objects, and shape mothers' own attention processes. We show that communicative cues enhance cortical visual processing, thus play an essential role in social learning. Future studies need to elucidate the effect of communicative cues on neural synchrony during joint attention. Finally, our study introduces RVS to study infant-caregiver neural dynamics in social contexts.
Collapse
Affiliation(s)
- Anna Bánki
- University of Vienna, Faculty of Psychology, Vienna, Austria.
| | - Moritz Köster
- University of Regensburg, Institute for Psychology, Regensburg, Germany; Freie Universität Berlin, Faculty of Education and Psychology, Berlin, Germany
| | | | - Stefanie Hoehl
- University of Vienna, Faculty of Psychology, Vienna, Austria
| |
Collapse
|
3
|
Matsunaka R, Hiraki K. Neural correlates of attentional orienting with neutral and fearful gaze cues in 12-month-olds. Soc Neurosci 2023; 18:80-90. [PMID: 37129270 DOI: 10.1080/17470919.2023.2208877] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 05/03/2023]
Abstract
Infants use information on gaze direction and facial expressions for social referencing when encountering various objects in their environment. However, it remains unclear how these social cues influence attentional orienting in infants. Using event-related potentials (ERPs), we investigated the neural correlates of attentional orienting cued by an averted gaze with neutral and fearful expressions in 12-month-olds. We focused on the ERPs in response to a face (N290, P400, and Nc) as well as a saccade toward the target (the presaccadic spike potential: SP) and found that the amplitudes of the face-sensitive ERPs (N290 and P400) were larger for directed than averted gaze direction irrespective of facial expression. Furthermore, the amplitude of the SP involved in overt orienting was larger for fearful expressions than for neutral expressions, irrespective of gaze congruency. These results suggest that information on gaze direction and facial expression, specifically neutral and fearful expressions, may be processed independently, and that fearful expressions dominantly influence the neural correlates of attentional orienting in infants around 12 months of age.
Collapse
Affiliation(s)
- Reiko Matsunaka
- Graduate School of Arts & Sciences, The University of Tokyo, Tokyo, Japan
| | - Kazuo Hiraki
- Graduate School of Arts & Sciences, The University of Tokyo, Tokyo, Japan
| |
Collapse
|
4
|
Lee C, Lew‐Williams C. The dynamic functions of social cues during children's word learning. INFANT AND CHILD DEVELOPMENT 2022. [DOI: 10.1002/icd.2372] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Affiliation(s)
- Crystal Lee
- Department of Psychology Princeton University Princeton New Jersey USA
| | | |
Collapse
|
5
|
Woodruff Carr K, Perszyk DR, Norton ES, Voss JL, Poeppel D, Waxman SR. Developmental changes in auditory‐evoked neural activity underlie infants’ links between language and cognition. Dev Sci 2021; 24:e13121. [DOI: 10.1111/desc.13121] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2020] [Revised: 04/21/2021] [Accepted: 04/27/2021] [Indexed: 11/29/2022]
Affiliation(s)
- Kali Woodruff Carr
- Department of Psychology Northwestern University Evanston Illinois USA
- Department of Communication Sciences and Disorders Northwestern University Evanston Illinois USA
| | | | - Elizabeth S. Norton
- Department of Communication Sciences and Disorders Northwestern University Evanston Illinois USA
- Institute for Innovations in Developmental Sciences Northwestern University Chicago Illinois USA
| | - Joel L. Voss
- Institute for Innovations in Developmental Sciences Northwestern University Chicago Illinois USA
- Department of Medical Social Sciences Ken and Ruth Davee Department of Neurology Department of Psychiatry and Behavioral Sciences Interdepartmental Neuroscience Program, Feinberg School of Medicine Northwestern University Chicago Illinois USA
| | - David Poeppel
- Department of Neuroscience Max Planck Institute for Empirical Aesthetics Frankfurt am Main Germany
- Department of Psychology and Center for Neural Science New York University New York New York USA
| | - Sandra R. Waxman
- Department of Psychology Northwestern University Evanston Illinois USA
- Institute for Innovations in Developmental Sciences Northwestern University Chicago Illinois USA
- Institute for Policy Research Northwestern University Evanston Illinois USA
| |
Collapse
|
6
|
Çetinçelik M, Rowland CF, Snijders TM. Do the Eyes Have It? A Systematic Review on the Role of Eye Gaze in Infant Language Development. Front Psychol 2021; 11:589096. [PMID: 33584424 PMCID: PMC7874056 DOI: 10.3389/fpsyg.2020.589096] [Citation(s) in RCA: 31] [Impact Index Per Article: 10.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2020] [Accepted: 11/25/2020] [Indexed: 11/13/2022] Open
Abstract
Eye gaze is a ubiquitous cue in child–caregiver interactions, and infants are highly attentive to eye gaze from very early on. However, the question of why infants show gaze-sensitive behavior, and what role this sensitivity to gaze plays in their language development, is not yet well-understood. To gain a better understanding of the role of eye gaze in infants' language learning, we conducted a broad systematic review of the developmental literature for all studies that investigate the role of eye gaze in infants' language development. Across 77 peer-reviewed articles containing data from typically developing human infants (0–24 months) in the domain of language development, we identified two broad themes. The first tracked the effect of eye gaze on four developmental domains: (1) vocabulary development, (2) word–object mapping, (3) object processing, and (4) speech processing. Overall, there is considerable evidence that infants learn more about objects and are more likely to form word–object mappings in the presence of eye gaze cues, both of which are necessary for learning words. In addition, there is good evidence for longitudinal relationships between infants' gaze following abilities and later receptive and expressive vocabulary. However, many domains (e.g., speech processing) are understudied; further work is needed to decide whether gaze effects are specific to tasks, such as word–object mapping or whether they reflect a general learning enhancement mechanism. The second theme explored the reasons why eye gaze might be facilitative for learning, addressing the question of whether eye gaze is treated by infants as a specialized socio-cognitive cue. We concluded that the balance of evidence supports the idea that eye gaze facilitates infants' learning by enhancing their arousal, memory, and attentional capacities to a greater extent than other low-level attentional cues. However, as yet, there are too few studies that directly compare the effect of eye gaze cues and non-social, attentional cues for strong conclusions to be drawn. We also suggest that there might be a developmental effect, with eye gaze, over the course of the first 2 years of life, developing into a truly ostensive cue that enhances language learning across the board.
Collapse
Affiliation(s)
- Melis Çetinçelik
- Language Development Department, Max Planck Institute for Psycholinguistics, Nijmegen, Netherlands
| | - Caroline F Rowland
- Language Development Department, Max Planck Institute for Psycholinguistics, Nijmegen, Netherlands.,Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, Netherlands
| | - Tineke M Snijders
- Language Development Department, Max Planck Institute for Psycholinguistics, Nijmegen, Netherlands.,Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, Netherlands
| |
Collapse
|
7
|
Abstract
From playing basketball to ordering at a food counter, we frequently and effortlessly coordinate our attention with others towards a common focus: we look at the ball, or point at a piece of cake. This non-verbal coordination of attention plays a fundamental role in our social lives: it ensures that we refer to the same object, develop a shared language, understand each other's mental states, and coordinate our actions. Models of joint attention generally attribute this accomplishment to gaze coordination. But are visual attentional mechanisms sufficient to achieve joint attention, in all cases? Besides cases where visual information is missing, we show how combining it with other senses can be helpful, and even necessary to certain uses of joint attention. We explain the two ways in which non-visual cues contribute to joint attention: either as enhancers, when they complement gaze and pointing gestures in order to coordinate joint attention on visible objects, or as modality pointers, when joint attention needs to be shifted away from the whole object to one of its properties, say weight or texture. This multisensory approach to joint attention has important implications for social robotics, clinical diagnostics, pedagogy and theoretical debates on the construction of a shared world.
Collapse
Affiliation(s)
- Lucas Battich
- Faculty of Philosophy and Philosophy of Science, Ludwig Maximilian University Munich, Geschwister-Scholl-Platz 1, Munich, 80359, Germany.
- Graduate School of Systemic Neurosciences, Ludwig Maximilian University Munich, Munich, Germany.
| | - Merle Fairhurst
- Faculty of Philosophy and Philosophy of Science, Ludwig Maximilian University Munich, Geschwister-Scholl-Platz 1, Munich, 80359, Germany
- Munich Center for Neuroscience, Ludwig Maximilian University Munich, Munich, Germany
- Institut für Psychologie, Fakultät für Humanwissenschaften, Universität der Bundeswehr München, Munich, Germany
| | - Ophelia Deroy
- Faculty of Philosophy and Philosophy of Science, Ludwig Maximilian University Munich, Geschwister-Scholl-Platz 1, Munich, 80359, Germany
- Munich Center for Neuroscience, Ludwig Maximilian University Munich, Munich, Germany
- Institute of Philosophy, School of Advanced Study, University of London, London, UK
| |
Collapse
|