1
|
McLaughlin DJ, Colvett JS, Bugg JM, Van Engen KJ. Sequence effects and speech processing: cognitive load for speaker-switching within and across accents. Psychon Bull Rev 2024; 31:176-186. [PMID: 37442872 PMCID: PMC10867039 DOI: 10.3758/s13423-023-02322-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/08/2023] [Indexed: 07/15/2023]
Abstract
Prior work in speech processing indicates that listening tasks with multiple speakers (as opposed to a single speaker) result in slower and less accurate processing. Notably, the trial-to-trial cognitive demands of switching between speakers or switching between accents have yet to be examined. We used pupillometry, a physiological index of cognitive load, to examine the demands of processing first (L1) and second (L2) language-accented speech when listening to sentences produced by the same speaker consecutively (no switch), a novel speaker of the same accent (within-accent switch), and a novel speaker with a different accent (across-accent switch). Inspired by research on sequential adjustments in cognitive control, we aimed to identify the cognitive demands of accommodating a novel speaker and accent by examining the trial-to-trial changes in pupil dilation during speech processing. Our results indicate that switching between speakers was more cognitively demanding than listening to the same speaker consecutively. Additionally, switching to a novel speaker with a different accent was more cognitively demanding than switching between speakers of the same accent. However, there was an asymmetry for across-accent switches, such that switching from an L1 to an L2 accent was more demanding than vice versa. Findings from the present study align with work examining multi-talker processing costs, and provide novel evidence that listeners dynamically adjust cognitive processing to accommodate speaker and accent variability. We discuss these novel findings in the context of an active control model and auditory streaming framework of speech processing.
Collapse
Affiliation(s)
- Drew J McLaughlin
- Department of Psychological and Brain Sciences, Washington University in St. Louis, St Louis, MO, USA.
- Basque Center on Cognition, Brain and Language, Paseo Mikeletegi, 69, 20009, Donostia-San Sebastián, Gipuzkoa, Spain.
| | - Jackson S Colvett
- Department of Psychological and Brain Sciences, Washington University in St. Louis, St Louis, MO, USA
| | - Julie M Bugg
- Department of Psychological and Brain Sciences, Washington University in St. Louis, St Louis, MO, USA
| | - Kristin J Van Engen
- Department of Psychological and Brain Sciences, Washington University in St. Louis, St Louis, MO, USA
| |
Collapse
|
2
|
Lowe MS, Buchwald A. Role of cognitive control in resolving two types of conflict during spoken word production. LANGUAGE, COGNITION AND NEUROSCIENCE 2023; 38:1082-1097. [PMID: 37927968 PMCID: PMC10622112 DOI: 10.1080/23273798.2023.2202917] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/28/2022] [Accepted: 04/02/2023] [Indexed: 11/07/2023]
Abstract
A theoretically- and clinically-important issue for understanding word retrieval is how speakers resolve conflict during linguistic tasks. This study investigated two types of conflict resolution: prepotent conflict, when one dominant incorrect response must be suppressed; and underdetermined conflict, when multiple reasonable responses compete. The congruency sequence effect paradigm was used to assess trial-to-trial changes in reaction time and accuracy during word production tasks with either prepotent or underdetermined conflict. Pictures were named faster on trials with low-conflict as compared to high-conflict regardless of conflict type. This effect was modulated by the amount of conflict experienced on the previous trial for both tasks. These results suggest that resolution of underdetermined and prepotent conflict may engage the same general cognitive mechanism. This work expands our understanding of the relationship between cognitive control and word production and can inform clinical approaches for people with anomia.
Collapse
Affiliation(s)
- Mara Steinberg Lowe
- Department of Linguistics and Communication Disorders, Queens College, City University of New York
| | - Adam Buchwald
- Department of Communicative Sciences and Disorders, New York University
| |
Collapse
|
3
|
Black J, Nozari N. Precision of phonological errors in aphasia supports resource models of phonological working memory in language production. Cogn Neuropsychol 2023; 40:1-24. [PMID: 37127940 PMCID: PMC10336978 DOI: 10.1080/02643294.2023.2206012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2022] [Revised: 04/12/2023] [Accepted: 04/18/2023] [Indexed: 05/03/2023]
Abstract
Working memory (WM) is critical for many cognitive functions including language production. A key feature of WM is its capacity limitation. Two models have been proposed to account for such capacity limitation: slot models and resource models. In recent years, resource models have found support in both visual and auditory perception, but do they also extend to production? We investigate this by analyzing sublexical errors from four individuals with aphasia. Using tools from computational linguistics, we first define the concept of "precision" of sublexical errors. We then demonstrate that such precision decreases with increased working memory load, i.e., word length, as predicted by resource models. Finally, we rule out alternative accounts of this effect, such as articulatory simplification. These data provide the first evidence for the applicability of the resource model to production and further point to the generalizability of this account as a model of resource division in WM.
Collapse
Affiliation(s)
- Jenah Black
- Department of Psychology, Carnegie Mellon University, Pittsburgh, PA, USA
- Center for the Neural Basis of Cognition (CNBC), Pittsburgh, PA, USA
| | - Nazbanou Nozari
- Department of Psychology, Carnegie Mellon University, Pittsburgh, PA, USA
- Center for the Neural Basis of Cognition (CNBC), Pittsburgh, PA, USA
| |
Collapse
|
4
|
Nozari N. A Comprehension- or a Production-Based Monitor? Response to Roelofs (2020). J Cogn 2020; 3:19. [PMID: 32944682 PMCID: PMC7473204 DOI: 10.5334/joc.102] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2019] [Accepted: 04/16/2020] [Indexed: 11/20/2022] Open
Abstract
Roelofs (2020) has put forth a rebuttal of the criticisms raised against comprehension-based monitoring and has also raised a number of objections against production-based monitors. In this response, I clarify that the model defended by Roelofs is not a comprehension-based monitor, but belongs to a class of monitoring models which I refer to as production-perception models. I review comprehension-based and production-perception models, highlight the strength of each, and point out the differences between them. I then discuss the limitations of both for monitoring production at higher levels, which has been the motivation for production-based monitors. Next, I address the specific criticisms raised by Roelofs (2020) in light of the current evidence. I end by presenting several lines of arguments that preclude a single monitoring mechanism as meeting all the demands of monitoring in a task as complex as communication. A more fruitful avenue is perhaps to focus on what theories are compatible with the nature of representations at specific levels of the production system and with specific aims of monitoring in language production.
Collapse
Affiliation(s)
- Nazbanou Nozari
- Department of Psychology, Carnegie Mellon University, US
- Center for Neural Basis Cognition (CNBC), US
| |
Collapse
|
5
|
Hepner CR, Nozari N. The dual origin of lexical perseverations in aphasia: Residual activation and incremental learning. Neuropsychologia 2020; 147:107603. [PMID: 32877655 DOI: 10.1016/j.neuropsychologia.2020.107603] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2020] [Revised: 08/27/2020] [Accepted: 08/27/2020] [Indexed: 11/30/2022]
Abstract
Lexical perseveration, the inappropriate repetition of a previous response, is common in aphasia. Two underlying mechanisms have been proposed: residual activation and incremental learning. Previous attempts to differentiate the two have relied on experimental paradigms that encourage semantically related errors and analysis techniques designed to detect perseverations over short distances, resulting in a bias towards detecting short-lag, semantically related perseverations that both mechanisms can account for. Two key predictions that differentiate these accounts remain untested: only residual activation can explain short-lag, semantically unrelated perseverations, whereas only incremental learning can explain long-lag, semantically related perseverations. In this paper, we used a large set of picture naming trials and a novel analysis technique to test these key predictions in a multi-session study involving six individuals with aphasia. We found clear evidence for both mechanisms in different individuals, demonstrating that either one is sufficient to cause perseveration. Importantly, perseverations due to residual activation were associated with more severely impaired systems than those due to incremental learning, suggesting that a certain degree of structural and functional integrity was necessary for incremental learning. Finally, the results supported a key prediction of the incremental learning account by showing perseverations over longer lags than have previously been reported.
Collapse
Affiliation(s)
| | - Nazbanou Nozari
- Department of Psychology, Carnegie Mellon University, Pittsburgh, PA, USA
| |
Collapse
|
6
|
Xie L, Cao B, Li Z, Li F. Neural Dynamics of Cognitive Control in Various Types of Incongruence. Front Hum Neurosci 2020; 14:214. [PMID: 32581754 PMCID: PMC7291779 DOI: 10.3389/fnhum.2020.00214] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2019] [Accepted: 05/12/2020] [Indexed: 01/05/2023] Open
Abstract
Conflict-control is a core function of cognitive control. Although numerous studies have considered cognitive control to be domain-general, the shared and distinct brain responses to different types of incongruence or conflict remain unclear. Using a hybrid flanker task, the present study explored the temporal dynamics of brain activation to three types of incongruence: flanker interference, rule-based response switch (rule-switch), and action-based response switch (response-alternation). The results showed that: (1) all three types of incongruence evoked larger N2 amplitudes than the congruent condition in the frontal region, with the N2 amplitudes and topographical distribution of the N2 effect differing between the different types of incongruence; and (2) in the P300 time window, the flanker interference condition yielded the most delayed P300 latency, whereas the rule-switch and response-alternation conditions yielded smaller P300 amplitudes with a longer interval from P300 peak to a keypress. These findings suggest that different types of incongruence are first monitored similarly by the cognitive control system and then resolved differently.
Collapse
Affiliation(s)
- Liufang Xie
- School of Psychology, JiangXi Normal University, Nanchang, China
| | - Bihua Cao
- School of Psychology, JiangXi Normal University, Nanchang, China
| | - Zixia Li
- School of Psychology, JiangXi Normal University, Nanchang, China
| | - Fuhong Li
- School of Psychology, JiangXi Normal University, Nanchang, China
| |
Collapse
|
7
|
Pinet S, Nozari N. Electrophysiological Correlates of Monitoring in Typing with and without Visual Feedback. J Cogn Neurosci 2019; 32:603-620. [PMID: 31702430 DOI: 10.1162/jocn_a_01500] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/20/2023]
Abstract
New theories of monitoring in language production, regardless of their mechanistic differences, all posit monitoring mechanisms that share general computational principles with action monitoring. This perspective, if accurate, would predict that many electrophysiological signatures of performance monitoring should be recoverable from language production tasks. In this study, we examined both error-related and feedback-related EEG indices of performance monitoring in the context of a typing-to-dictation task. To disentangle the contribution of the external from internal monitoring processes, we created a condition where participants immediately saw the word they typed (the immediate-feedback condition) versus one in which displaying the word was delayed until the end of the trial (the delayed-feedback condition). The removal of immediate visual feedback prompted a stronger reliance on internal monitoring processes, which resulted in lower correction rates and a clear error-related negativity. Compatible with domain-general monitoring views, an error positivity was only recovered under conditions where errors were detected or had a high likelihood of being detected. Examination of the feedback-related indices (feedback-related negativity and frontocentral positivity) revealed a two-stage process of integration of internal and external information. The recovery of a full range of well-established EEG indices of action monitoring in a language production task strongly endorses domain-general views of monitoring. Such indices, in turn, are helpful in understanding how information from different monitoring channels are combined.
Collapse
|
8
|
Navarro-Torres CA, Garcia DL, Chidambaram V, Kroll JF. Cognitive Control Facilitates Attentional Disengagement during Second Language Comprehension. Brain Sci 2019; 9:brainsci9050095. [PMID: 31035554 PMCID: PMC6562798 DOI: 10.3390/brainsci9050095] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2019] [Revised: 04/23/2019] [Accepted: 04/25/2019] [Indexed: 11/24/2022] Open
Abstract
Bilinguals learn to resolve conflict between their two languages and that skill has been hypothesized to create long-term adaptive changes in cognitive functioning. Yet, little is known about how bilinguals recruit cognitive control to enable efficient use of one of their languages, especially in the less skilled and more effortful second language (L2). Here we examined how real-time cognitive control engagement influences L2 sentence comprehension (i.e., conflict adaptation). We tested a group of English monolinguals and a group of L2 English speakers using a recently-developed cross-task adaptation paradigm. Stroop sequences were pseudo-randomly interleaved with a visual-world paradigm in which participants were asked to carry out spoken instructions that were either syntactically ambiguous or unambiguous. Consistent with previous research, eye-movement results showed that Stroop-related conflict improved the ability to engage correct-goal interpretations, and disengage incorrect-goal interpretations, during ambiguous instructions. Such cognitive-to-language modulations were similar in both groups, but only in the engagement piece. In the disengagement portion, the modulation emerged earlier in bilinguals than in monolinguals, suggesting group differences in attentional disengagement following cognitive control recruitment. Additionally, incorrect-goal eye-movements were modulated by individual differences in working memory, although differently for each group, suggesting an involvement of both language-specific and domain-general resources.
Collapse
Affiliation(s)
- Christian A Navarro-Torres
- Department of Psychology, University of California, Riverside, 900 University Avenue, Riverside, CA 92521, USA.
| | - Dalia L Garcia
- Department of Psychology, University of California, Riverside, 900 University Avenue, Riverside, CA 92521, USA.
| | - Vrinda Chidambaram
- Department of Comparative Literature and Languages, University of California, Riverside, 2401 HMNSS Building, Riverside, CA 92521, USA.
| | - Judith F Kroll
- Department of Psychology, University of California, Riverside, 900 University Avenue, Riverside, CA 92521, USA.
| |
Collapse
|
9
|
Abstract
According to most models of language production, to name a picture one must first map semantic features onto lexical items. Even if both sets of representations are intact, problems in mapping semantic to lexical representations can impair production. Individuals with this problem, sometimes referred to as "access deficit", often demonstrate evidence of preserved semantic knowledge (e.g., good comprehension), increased rate of lexical (usually semantic) errors in production, and inconsistent accuracy on naming the same picture on different occasions. In this paper, I argue that access deficit can have two distinct etiologies. I will present a case of double dissociation between two individuals with chronic post-stroke aphasia, one of whom shows a profile compatible with impaired activation of the target lexical item from semantic features (activation deficit), while the other shows a profile compatible with impaired inhibition of competing lexical items (inhibition deficit). These results have three key implications: (a) they provide support for the theoretical separation between activation and selection processes in computational models of word production, (b) they point to the critical role of inhibitory control in lexical selection, and (c) they invite a closer inspection of the origin of semantic errors in individuals with access deficit in order to choose the best treatment option.
Collapse
Affiliation(s)
- Nazbanou Nozari
- a Department of Neurology , Johns Hopkins University , Baltimore , MD, USA
- b Department of Cognitive Science , Johns Hopkins University , Baltimore , MD, USA
| |
Collapse
|
10
|
Nozari N. How Special Is Language Production? Perspectives From Monitoring and Control. PSYCHOLOGY OF LEARNING AND MOTIVATION 2018. [DOI: 10.1016/bs.plm.2018.08.006] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
|