1
|
Li SYW, Lee ALF, Chiu JWS, Loeb RG, Sanderson PM. Attention capture by own name decreases with speech compression. Cogn Res Princ Implic 2024; 9:29. [PMID: 38735013 PMCID: PMC11089017 DOI: 10.1186/s41235-024-00555-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2023] [Accepted: 04/20/2024] [Indexed: 05/13/2024] Open
Abstract
Auditory stimuli that are relevant to a listener have the potential to capture focal attention even when unattended, the listener's own name being a particularly effective stimulus. We report two experiments to test the attention-capturing potential of the listener's own name in normal speech and time-compressed speech. In Experiment 1, 39 participants were tested with a visual word categorization task with uncompressed spoken names as background auditory distractors. Participants' word categorization performance was slower when hearing their own name rather than other names, and in a final test, they were faster at detecting their own name than other names. Experiment 2 used the same task paradigm, but the auditory distractors were time-compressed names. Three compression levels were tested with 25 participants in each condition. Participants' word categorization performance was again slower when hearing their own name than when hearing other names; the slowing was strongest with slight compression and weakest with intense compression. Personally relevant time-compressed speech has the potential to capture attention, but the degree of capture depends on the level of compression. Attention capture by time-compressed speech has practical significance and provides partial evidence for the duplex-mechanism account of auditory distraction.
Collapse
Affiliation(s)
- Simon Y W Li
- School of Psychological Science, The University of Western Australia, Perth, Australia.
| | - Alan L F Lee
- Department of Psychology, Lingnan University, Hong Kong SAR, China
| | - Jenny W S Chiu
- Department of Psychology, Lingnan University, Hong Kong SAR, China
| | - Robert G Loeb
- School of Psychology, The University of Queensland, Brisbane, Australia
- Department of Anesthesiology, University of Florida School of Medicine, Gainesville, USA
| | - Penelope M Sanderson
- School of Psychology, The University of Queensland, Brisbane, Australia
- School of Information Technology and Electrical Engineering, The University of Queensland, Brisbane, Australia
- School of Clinical Medicine, The University of Queensland, Brisbane, Australia
| |
Collapse
|
2
|
Cowan N, Bao C, Bishop-Chrzanowski BM, Costa AN, Greene NR, Guitard D, Li C, Musich ML, Ünal ZE. The Relation Between Attention and Memory. Annu Rev Psychol 2024; 75:183-214. [PMID: 37713810 DOI: 10.1146/annurev-psych-040723-012736] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/17/2023]
Abstract
The relation between attention and memory has long been deemed important for understanding cognition, and it was heavily researched even in the first experimental psychology laboratory by Wilhelm Wundt and his colleagues. Since then, the importance of the relation between attention and memory has been explored in myriad subdisciplines of psychology, and we incorporate a wide range of these diverse fields. Here, we examine some of the practical consequences of this relation and summarize work with various methodologies relating attention to memory in the fields of working memory, long-term memory, individual differences, life-span development, typical brain function, and neuropsychological conditions. We point out strengths and unanswered questions for our own embedded processes view of information processing, which is used to organize a large body of evidence. Last, we briefly consider the relation of the evidence to a range of other theoretical views before drawing conclusions about the state of the field.
Collapse
Affiliation(s)
- Nelson Cowan
- Department of Psychological Sciences, University of Missouri, Columbia, Missouri, USA;
| | - Chenye Bao
- Department of Psychological Sciences, University of Missouri, Columbia, Missouri, USA;
| | | | - Amy N Costa
- Department of Psychological Sciences, University of Missouri, Columbia, Missouri, USA;
| | - Nathaniel R Greene
- Department of Psychological Sciences, University of Missouri, Columbia, Missouri, USA;
| | - Dominic Guitard
- School of Psychology, Cardiff University, Cardiff, United Kingdom
| | - Chenyuan Li
- Department of Psychological Sciences, University of Missouri, Columbia, Missouri, USA;
| | - Madison L Musich
- Department of Psychological Sciences, University of Missouri, Columbia, Missouri, USA;
| | - Zehra E Ünal
- Department of Psychological Sciences, University of Missouri, Columbia, Missouri, USA;
| |
Collapse
|
3
|
Brown A, Pinto D, Burgart K, Zvilichovsky Y, Zion-Golumbic E. Neurophysiological Evidence for Semantic Processing of Irrelevant Speech and Own-Name Detection in a Virtual Café. J Neurosci 2023; 43:5045-5056. [PMID: 37336758 PMCID: PMC10324990 DOI: 10.1523/jneurosci.1731-22.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2022] [Revised: 04/18/2023] [Accepted: 04/27/2023] [Indexed: 06/21/2023] Open
Abstract
The well-known "cocktail party effect" refers to incidental detection of salient words, such as one's own-name, in supposedly unattended speech. However, empirical investigation of the prevalence of this phenomenon and the underlying mechanisms has been limited to extremely artificial contexts and has yielded conflicting results. We introduce a novel empirical approach for revisiting this effect under highly ecological conditions, by immersing participants in a multisensory Virtual Café and using realistic stimuli and tasks. Participants (32 female, 18 male) listened to conversational speech from a character at their table, while a barista in the back of the café called out food orders. Unbeknownst to them, the barista sometimes called orders containing either their own-name or words that created semantic violations. We assessed the neurophysiological response-profile to these two probes in the task-irrelevant barista stream by measuring participants' brain activity (EEG), galvanic skin response and overt gaze-shifts.SIGNIFICANCE STATEMENT We found distinct neural and physiological responses to participants' own-name and semantic violations, indicating their incidental semantic processing despite being task-irrelevant. Interestingly, these responses were covert in nature and gaze-patterns were not associated with word-detection responses. This study emphasizes the nonexclusive nature of attention in multimodal ecological environments and demonstrates the brain's capacity to extract linguistic information from additional sources outside the primary focus of attention.
Collapse
Affiliation(s)
- Adi Brown
- Gonda Center for Multidisciplinary Brain Research, Bar-Ilan University, Ramat Gan, Israel, 5290002
| | - Danna Pinto
- Gonda Center for Multidisciplinary Brain Research, Bar-Ilan University, Ramat Gan, Israel, 5290002
| | - Ksenia Burgart
- Gonda Center for Multidisciplinary Brain Research, Bar-Ilan University, Ramat Gan, Israel, 5290002
| | - Yair Zvilichovsky
- Gonda Center for Multidisciplinary Brain Research, Bar-Ilan University, Ramat Gan, Israel, 5290002
| | - Elana Zion-Golumbic
- Gonda Center for Multidisciplinary Brain Research, Bar-Ilan University, Ramat Gan, Israel, 5290002
| |
Collapse
|
4
|
Pinto D, Kaufman M, Brown A, Zion Golumbic E. An ecological investigation of the capacity to follow simultaneous speech and preferential detection of ones’ own name. Cereb Cortex 2022; 33:5361-5374. [PMID: 36331339 DOI: 10.1093/cercor/bhac424] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2022] [Revised: 09/11/2022] [Accepted: 09/12/2022] [Indexed: 11/06/2022] Open
Abstract
Abstract
Many situations require focusing attention on one speaker, while monitoring the environment for potentially important information. Some have proposed that dividing attention among 2 speakers involves behavioral trade-offs, due to limited cognitive resources. However the severity of these trade-offs, particularly under ecologically-valid circumstances, is not well understood. We investigated the capacity to process simultaneous speech using a dual-task paradigm simulating task-demands and stimuli encountered in real-life. Participants listened to conversational narratives (Narrative Stream) and monitored a stream of announcements (Barista Stream), to detect when their order was called. We measured participants’ performance, neural activity, and skin conductance as they engaged in this dual-task. Participants achieved extremely high dual-task accuracy, with no apparent behavioral trade-offs. Moreover, robust neural and physiological responses were observed for target-stimuli in the Barista Stream, alongside significant neural speech-tracking of the Narrative Stream. These results suggest that humans have substantial capacity to process simultaneous speech and do not suffer from insufficient processing resources, at least for this highly ecological task-combination and level of perceptual load. Results also confirmed the ecological validity of the advantage for detecting ones’ own name at the behavioral, neural, and physiological level, highlighting the contribution of personal relevance when processing simultaneous speech.
Collapse
Affiliation(s)
- Danna Pinto
- The Gonda Multidisciplinary Center for Brain Research, Bar Ilan University, Ramat Gan, 5290002, Israel
| | - Maya Kaufman
- The Gonda Multidisciplinary Center for Brain Research, Bar Ilan University, Ramat Gan, 5290002, Israel
| | - Adi Brown
- The Gonda Multidisciplinary Center for Brain Research, Bar Ilan University, Ramat Gan, 5290002, Israel
| | - Elana Zion Golumbic
- The Gonda Multidisciplinary Center for Brain Research, Bar Ilan University, Ramat Gan, 5290002, Israel
| |
Collapse
|
5
|
Yaoi K, Osaka M, Osaka N. Does Implicit Self-Reference Effect Occur by the Instantaneous Own-Name? Front Psychol 2021; 12:709601. [PMID: 34671294 PMCID: PMC8521069 DOI: 10.3389/fpsyg.2021.709601] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2021] [Accepted: 09/09/2021] [Indexed: 12/02/2022] Open
Abstract
Self-reference effect (SRE) is defined as better recall or recognition performance when the materials that are memorized refer to the self. The SRE paradigm usually requires participants to explicitly refer items to themselves, but some researchers have found that the SRE also can occur for implicitly self-referenced items. Few studies though have investigated the effect of self-related stimuli without awareness. In this study, we presented self-related (participants’ names) or other (other’s names or nouns) stimuli for a very short time between masks and then explicitly presented subsequent trait adjectives to participants. Recognition performance showed no significant differences between the own-name and the other two conditions in Experiment 1 that had random-order conditions. On the other hand, the result of Experiment 2 that had block-order conditions and greater prime stimuli suggests that SRE can occur as a result of the instantaneous stimulus: Subjects who showed better memory performance also had relatively high recognition of the trait adjectives that they viewed after their instantaneously presented own-name. This effect would show that self-representation can be activated by self-related stimuli without awareness and that subsequent items are unconsciously referenced to that self-representation.
Collapse
Affiliation(s)
- Ken Yaoi
- Research Center for Child Mental Development, Kanazawa University, Kanazawa, Japan.,United Graduate School of Child Development, Osaka University, Suita, Japan.,Department of Psychology, Graduate School of Letters, Kyoto University, Kyoto, Japan
| | - Mariko Osaka
- Center for Information and Neural Networks (CiNet), National Institute of Information and Communications Technology, Suita, Japan
| | - Naoyuki Osaka
- Department of Psychology, Graduate School of Letters, Kyoto University, Kyoto, Japan
| |
Collapse
|
6
|
Har-shai Yahav P, Zion Golumbic E. Linguistic processing of task-irrelevant speech at a cocktail party. eLife 2021; 10:e65096. [PMID: 33942722 PMCID: PMC8163500 DOI: 10.7554/elife.65096] [Citation(s) in RCA: 24] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2020] [Accepted: 04/26/2021] [Indexed: 01/05/2023] Open
Abstract
Paying attention to one speaker in a noisy place can be extremely difficult, because to-be-attended and task-irrelevant speech compete for processing resources. We tested whether this competition is restricted to acoustic-phonetic interference or if it extends to competition for linguistic processing as well. Neural activity was recorded using Magnetoencephalography as human participants were instructed to attend to natural speech presented to one ear, and task-irrelevant stimuli were presented to the other. Task-irrelevant stimuli consisted either of random sequences of syllables, or syllables structured to form coherent sentences, using hierarchical frequency-tagging. We find that the phrasal structure of structured task-irrelevant stimuli was represented in the neural response in left inferior frontal and posterior parietal regions, indicating that selective attention does not fully eliminate linguistic processing of task-irrelevant speech. Additionally, neural tracking of to-be-attended speech in left inferior frontal regions was enhanced when competing with structured task-irrelevant stimuli, suggesting inherent competition between them for linguistic processing.
Collapse
Affiliation(s)
- Paz Har-shai Yahav
- The Gonda Center for Multidisciplinary Brain Research, Bar Ilan UniversityRamat GanIsrael
| | - Elana Zion Golumbic
- The Gonda Center for Multidisciplinary Brain Research, Bar Ilan UniversityRamat GanIsrael
| |
Collapse
|
7
|
Acute alcohol intoxication and the cocktail party problem: do "mocktails" help or hinder? Psychopharmacology (Berl) 2021; 238:3083-3093. [PMID: 34313803 PMCID: PMC8605962 DOI: 10.1007/s00213-021-05924-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/23/2021] [Accepted: 07/06/2021] [Indexed: 11/06/2022]
Abstract
RATIONALE To test the notion that alcohol impairs auditory attentional control by reducing the listener's cognitive capacity. OBJECTIVES We examined the effect of alcohol consumption and working memory span on dichotic speech shadowing and the cocktail party effect-the ability to focus on one of many simultaneous speakers yet still detect mention of one's name amidst the background speech. Alcohol was expected either to increase name detection, by weakening the inhibition of irrelevant speech, or reduce name detection, by restricting auditory attention on to the primary input channel. Low-span participants were expected to show larger drug impairments than high-span counterparts. METHODS On completion of the working memory span task, participants (n = 81) were randomly assigned to an alcohol or placebo beverage treatment. After alcohol absorption, they shadowed speech presented to one ear while ignoring the synchronised speech of a different speaker presented to the other. Each participant's first name was covertly embedded in to-be-ignored speech. RESULTS The "cocktail party effect" was not affected by alcohol or working memory span, though low-span participants made more shadowing errors and recalled fewer words from the primary channel than high-span counterparts. Bayes factors support a null effect of alcohol on the cocktail party phenomenon, on shadowing errors and on memory for either shadowed or ignored speech. CONCLUSION Findings suggest that an alcoholic beverage producing a moderate level of intoxication (M BAC ≈ 0.08%) neither enhances nor impairs the cocktail party effect.
Collapse
|
8
|
Cowan N, Belletier C, Doherty JM, Jaroslawska AJ, Rhodes S, Forsberg A, Naveh-Benjamin M, Barrouillet P, Camos V, Logie RH. How Do Scientific Views Change? Notes From an Extended Adversarial Collaboration. PERSPECTIVES ON PSYCHOLOGICAL SCIENCE 2020; 15:1011-1025. [PMID: 32511059 PMCID: PMC7334077 DOI: 10.1177/1745691620906415] [Citation(s) in RCA: 28] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
There are few examples of an extended adversarial collaboration, in which investigators committed to different theoretical views collaborate to test opposing predictions. Whereas previous adversarial collaborations have produced single research articles, here, we share our experience in programmatic, extended adversarial collaboration involving three laboratories in different countries with different theoretical views regarding working memory, the limited information retained in mind, serving ongoing thought and action. We have focused on short-term memory retention of items (letters) during a distracting task (arithmetic), and effects of aging on these tasks. Over several years, we have conducted and published joint research with preregistered predictions, methods, and analysis plans, with replication of each study across two laboratories concurrently. We argue that, although an adversarial collaboration will not usually induce senior researchers to abandon favored theoretical views and adopt opposing views, it will necessitate varieties of their views that are more similar to one another, in that they must account for a growing, common corpus of evidence. This approach promotes understanding of others' views and presents to the field research findings accepted as valid by researchers with opposing interpretations. We illustrate this process with our own research experiences and make recommendations applicable to diverse scientific areas.
Collapse
Affiliation(s)
- Nelson Cowan
- Department of Psychological Sciences, University of Missouri
| | - Clément Belletier
- Laboratoire de Psychologie Sociale et Cognitive (LAPSCO), Université Clermont Auvergne, CNRS
| | | | | | | | - Alicia Forsberg
- Department of Psychological Sciences, University of Missouri
| | | | - Pierre Barrouillet
- Faculté de Psychologie et des Sciences de l'Éducation, Université de Genève
| | | | | |
Collapse
|
9
|
Shavit-Cohen K, Zion Golumbic E. The Dynamics of Attention Shifts Among Concurrent Speech in a Naturalistic Multi-speaker Virtual Environment. Front Hum Neurosci 2019; 13:386. [PMID: 31780911 PMCID: PMC6857110 DOI: 10.3389/fnhum.2019.00386] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2019] [Accepted: 10/16/2019] [Indexed: 12/18/2022] Open
Abstract
Focusing attention on one speaker on the background of other irrelevant speech can be a challenging feat. A longstanding question in attention research is whether and how frequently individuals shift their attention towards task-irrelevant speech, arguably leading to occasional detection of words in a so-called unattended message. However, this has been difficult to gauge empirically, particularly when participants attend to continuous natural speech, due to the lack of appropriate metrics for detecting shifts in internal attention. Here we introduce a new experimental platform for studying the dynamic deployment of attention among concurrent speakers, utilizing a unique combination of Virtual Reality (VR) and Eye-Tracking technology. We created a Virtual Café in which participants sit across from and attend to the narrative of a target speaker. We manipulated the number and location of distractor speakers by placing additional characters throughout the Virtual Café. By monitoring participant's eye-gaze dynamics, we studied the patterns of overt attention-shifts among concurrent speakers as well as the consequences of these shifts on speech comprehension. Our results reveal important individual differences in the gaze-pattern displayed during selective attention to speech. While some participants stayed fixated on a target speaker throughout the entire experiment, approximately 30% of participants frequently shifted their gaze toward distractor speakers or other locations in the environment, regardless of the severity of audiovisual distraction. Critically, preforming frequent gaze-shifts negatively impacted the comprehension of target speech, and participants made more mistakes when looking away from the target speaker. We also found that gaze-shifts occurred primarily during gaps in the acoustic input, suggesting that momentary reductions in acoustic masking prompt attention-shifts between competing speakers, in line with "glimpsing" theories of processing speech in noise. These results open a new window into understanding the dynamics of attention as they wax and wane over time, and the different listening patterns employed for dealing with the influx of sensory input in multisensory environments. Moreover, the novel approach developed here for tracking the locus of momentary attention in a naturalistic virtual-reality environment holds high promise for extending the study of human behavior and cognition and bridging the gap between the laboratory and real-life.
Collapse
Affiliation(s)
| | - Elana Zion Golumbic
- The Gonda Multidisciplinary Brain Research Center, Bar Ilan University, Ramat Gan, Israel
| |
Collapse
|
10
|
Rhodes S, Jaroslawska AJ, Doherty JM, Belletier C, Naveh-Benjamin M, Cowan N, Camos V, Barrouillet P, Logie RH. Storage and processing in working memory: Assessing dual-task performance and task prioritization across the adult lifespan. J Exp Psychol Gen 2019; 148:1204-1227. [PMID: 30667263 DOI: 10.1037/xge0000539] [Citation(s) in RCA: 21] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
There is a theoretical disagreement in the working memory literature, with some proposing that the storage and processing of information rely on distinct parts of the cognitive system and others who posit that they rely, to some extent, on a shared attentional capacity. This debate is mirrored in the literature on working memory and aging, where there have been mixed findings on the ability of older adults to perform simultaneous storage and processing tasks. We assess the overlap between storage and processing and how this changes with age using a procedure in which both tasks have been carefully adjusted to produce comparable levels of single-task performance across a sample (N = 164) of participants aged 18-81. By manipulating incentives to perform one task over the other, this procedure was also capable of disentangling concurrence costs (single- vs. dual-task performance) from prioritization costs (relative payoffs for storage vs. processing performance) in a theoretically meaningful manner. The study revealed a large general cost to serial letter recall performance associated with concurrent performance of an arithmetic verification processing task, a concurrence cost that increased with age. For the processing task, there was no such general concurrence cost. Rather, there was a prioritization effect in dual-task performance for both tasks, irrespective of age, in which performance levels depended on the relative emphasis assigned to memory versus processing. This prioritization effect was large, albeit with a large residual in performance. The findings place important constraints on both working memory theory and our understanding of how working memory changes across the adult lifespan. (PsycINFO Database Record (c) 2019 APA, all rights reserved).
Collapse
Affiliation(s)
- Stephen Rhodes
- Department of Psychological Sciences, University of Missouri
| | | | | | | | | | - Nelson Cowan
- Department of Psychological Sciences, University of Missouri
| | | | | | | |
Collapse
|
11
|
Mattan BD, Quinn KA, Acaster SL, Jennings RM, Rotshtein P. Prioritization of Self-Relevant Perspectives in Ageing. Q J Exp Psychol (Hove) 2017; 70:1033-1052. [DOI: 10.1080/17470218.2015.1127399] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/18/2022]
Abstract
This study investigated whether age-related sensitivity to self-relevance may benefit perspective taking, despite generally poorer perspective-taking capacity in older adults. In one perceptual matching task and two visual perspective-taking paradigms, we examined age differences in sensitivity to avatars representing self and other. In the matching task, older (60–83 years) and younger (18–20 years) adults were similarly biased toward the self- versus other-associated avatar. In the perspective-taking tasks, participants viewed these avatars within a virtual room. Task-relevant perspectives were either the same (i.e., congruent) or different (i.e., incongruent). In the 3PP–3PP task, both avatars were present, and participants adopted the perspective of one or the other. As in the matching task, young and old were similarly biased toward the self-associated avatar. However, age differences emerged in the 1PP–3PP task, which presented only one avatar per trial (varying between self and other), and participants responded based on their own first-person perspective or the avatar's. In summary, age modulated the ability to take perspectives primarily when participants’ own first-person perspective was task relevant. Relative to younger adults, older adults prioritized the self (vs. other) avatar more during initial perspective computation and the first-person (vs. third-person) perspective more when selecting between incongruent perspectives.
Collapse
Affiliation(s)
| | - Kimberly A. Quinn
- School of Psychology, University of Birmingham, Birmingham, UK
- Department of Psychology, DePaul University, Chicago, IL, USA
| | | | | | - Pia Rotshtein
- School of Psychology, University of Birmingham, Birmingham, UK
| |
Collapse
|