1
|
Day TC, Malik I, Boateng S, Hauschild KM, Lerner MD. Vocal Emotion Recognition in Autism: Behavioral Performance and Event-Related Potential (ERP) Response. J Autism Dev Disord 2024; 54:1235-1248. [PMID: 36694007 DOI: 10.1007/s10803-023-05898-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/10/2023] [Indexed: 01/25/2023]
Abstract
Autistic youth display difficulties in emotion recognition, yet little research has examined behavioral and neural indices of vocal emotion recognition (VER). The current study examines behavioral and event-related potential (N100, P200, Late Positive Potential [LPP]) indices of VER in autistic and non-autistic youth. Participants (N = 164) completed an emotion recognition task, the Diagnostic Analyses of Nonverbal Accuracy (DANVA-2) which included VER, during EEG recording. The LPP amplitude was larger in response to high intensity VER, and social cognition predicted VER errors. Verbal IQ, not autism, was related to VER errors. An interaction between VER intensity and social communication impairments revealed these impairments were related to larger LPP amplitudes during low intensity VER. Taken together, differences in VER may be due to higher order cognitive processes, not basic, early perception (N100, P200), and verbal cognitive abilities may underlie behavioral, yet occlude neural, differences in VER processing.
Collapse
Affiliation(s)
- Talena C Day
- Psychology Department, Stony Brook University, Stony Brook, Psychology B-354, Stony Brook, NY, 11794-2500, USA
| | - Isha Malik
- Psychology Department, Stony Brook University, Stony Brook, Psychology B-354, Stony Brook, NY, 11794-2500, USA
| | - Sydney Boateng
- Psychology Department, Stony Brook University, Stony Brook, Psychology B-354, Stony Brook, NY, 11794-2500, USA
| | | | - Matthew D Lerner
- Psychology Department, Stony Brook University, Stony Brook, Psychology B-354, Stony Brook, NY, 11794-2500, USA.
| |
Collapse
|
2
|
Mayor Torres JM, Clarkson T, Hauschild KM, Luhmann CC, Lerner MD, Riccardi G. Facial Emotions Are Accurately Encoded in the Neural Signal of Those With Autism Spectrum Disorder: A Deep Learning Approach. Biol Psychiatry Cogn Neurosci Neuroimaging 2021; 7:688-695. [PMID: 33862256 DOI: 10.1016/j.bpsc.2021.03.015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/03/2021] [Revised: 03/31/2021] [Accepted: 03/31/2021] [Indexed: 11/18/2022]
Abstract
BACKGROUND Individuals with autism spectrum disorder (ASD) exhibit frequent behavioral deficits in facial emotion recognition (FER). It remains unknown whether these deficits arise because facial emotion information is not encoded in their neural signal or because it is encodes but fails to translate to FER behavior (deployment). This distinction has functional implications, including constraining when differences in social information processing occur in ASD, and guiding interventions (i.e., developing prosthetic FER vs. reinforcing existing skills). METHODS We utilized a discriminative and contemporary machine learning approach-deep convolutional neural networks-to classify facial emotions viewed by individuals with and without ASD (N = 88) from concurrently recorded electroencephalography signals. RESULTS The convolutional neural network classified facial emotions with high accuracy for both ASD and non-ASD groups, even though individuals with ASD performed more poorly on the concurrent FER task. In fact, convolutional neural network accuracy was greater in the ASD group and was not related to behavioral performance. This pattern of results replicated across three independent participant samples. Moreover, feature importance analyses suggested that a late temporal window of neural activity (1000-1500 ms) may be uniquely important in facial emotion classification for individuals with ASD. CONCLUSIONS Our results reveal for the first time that facial emotion information is encoded in the neural signal of individuals with (and without) ASD. Thus, observed difficulties in behavioral FER associated with ASD likely arise from difficulties in decoding or deployment of facial emotion information within the neural signal. Interventions should focus on capitalizing on this intact encoding rather than promoting compensation or FER prostheses.
Collapse
Affiliation(s)
- Juan Manuel Mayor Torres
- Department of Information Engineering and Computer Science, University of Trento, Povo Trento, Italy
| | - Tessa Clarkson
- Department of Psychology, Temple University, Philadelphia, Pennsylvania.
| | | | - Christian C Luhmann
- Department of Psychology, Stony Brook University, Stony Brook, New York; Institute for Advanced Computational Science, Stony Brook University, Stony Brook, New York
| | - Matthew D Lerner
- Department of Psychology, Stony Brook University, Stony Brook, New York; Department of Psychology, University of Virginia, Charlottesville, Virginia
| | - Giuseppe Riccardi
- Department of Information Engineering and Computer Science, University of Trento, Povo Trento, Italy
| |
Collapse
|
3
|
Keifer CM, Day TC, Hauschild KM, Lerner MD. Social and Nonsocial Reward Anticipation in Typical Development and Autism Spectrum Disorders: Current Status and Future Directions. Curr Psychiatry Rep 2021; 23:32. [PMID: 33851268 DOI: 10.1007/s11920-021-01247-7] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 03/24/2021] [Indexed: 01/22/2023]
Abstract
PURPOSE OF REVIEW While there has been sustained interest in understanding the role of reward processing in autism spectrum disorder (ASD), researchers are just beginning to focus on the anticipation phase of reward processing in this population. This review aimed to briefly summarize recent advancements in functional imaging studies of anticipatory social and nonsocial reward processing in individuals with and without ASD and provide suggestions for avenues of future research. RECENT FINDINGS Reward salience and activation of the complex network of brain regions supporting reward anticipation vary across development and by important demographic characteristics, such as sex assigned at birth. Current research comparing social and nonsocial reward anticipation may possess confounds related to the mismatch in tangibility and salience of social and nonsocial experimental stimuli. Growing evidence suggests individuals with ASD demonstrate aberrant generalized reward anticipation that is not specific to social reward. Future research should carefully match social and nonsocial reward stimuli and consider employing a longitudinal design to disentangle the complex processes contributing to the development of reward anticipation. It may be useful to conceptualize differences in reward anticipation as a transdiagnostic factor, rather than an ASD-specific deficit.
Collapse
Affiliation(s)
- Cara M Keifer
- Stony Brook University, Stony Brook, NY, USA. .,Yale Child Study Center, New Haven, CT, 06511, USA.
| | | | | | | |
Collapse
|
4
|
Hauschild KM, Pomales-Ramos A, Strauss MS. The visual array task: A novel gaze-based measure of object label and category knowledge. Dev Sci 2020; 24:e13015. [PMID: 32640086 DOI: 10.1111/desc.13015] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2019] [Revised: 05/20/2020] [Accepted: 06/25/2020] [Indexed: 11/30/2022]
Abstract
Visual attention measures of receptive vocabulary place minimal task demand on participants and produce a more accurate measure of language comprehension than parent report measures. However, current gaze-based measures employ visual comparisons limited to two simultaneous items. With this limitation, the degree of similarity of the target to the distractor can have a significant impact on the interpretation of task performance. The current study evaluates a novel gaze-based paradigm that includes an eight-item array. This visual array task (VAT) combines the theoretical frameworks of the Intermodal Preferential Looking Paradigm (IPLP) and looking-while-listening (LWL) methods of language comprehension measurement but using a larger array of simultaneously presented items. The use of a larger array of items and the inclusion of a superordinate category contrast may provide a more sensitive measure of receptive vocabulary as well as an understanding of the extent to which early word comprehension reflects knowledge of broader categories. Results indicated that the tested VAT was a sensitive measure of both object label and category knowledge. This paradigm provides researchers with a flexible and efficient task to measure language comprehension and category knowledge while reducing behavioral demands placed on participants.
Collapse
Affiliation(s)
| | | | - Mark S Strauss
- Department of Psychology, University of Pittsburgh, Pittsburgh, PA, USA
| |
Collapse
|
5
|
Hauschild KM, Felsman P, Keifer CM, Lerner MD. Evidence of an Own-Age Bias in Facial Emotion Recognition for Adolescents With and Without Autism Spectrum Disorder. Front Psychiatry 2020; 11:428. [PMID: 32581859 PMCID: PMC7286307 DOI: 10.3389/fpsyt.2020.00428] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/05/2019] [Accepted: 04/27/2020] [Indexed: 12/15/2022] Open
Abstract
A common interpretation of the face-processing deficits associated with autism spectrum disorder (ASD) is that they arise from a failure to develop normative levels of perceptual expertise. One indicator of perceptual expertise for faces is the own-age bias, operationalized as a processing advantage for faces of one's own age, presumably due to more frequent contact and experience. This effect is especially evident in domains of face recognition memory but less commonly investigated in social-emotional expertise (e.g., facial emotion recognition; FER), where individuals with ASD have shown consistent deficits. In the present study, we investigated whether a FER task would elicit an own-age bias for individuals with and without ASD and explored how the magnitude of an own-age bias may differ as a function of ASD status and symptoms. Ninety-two adolescents (63 male) between the ages of 11 and 14 years completed the child- and adult-face subtests of a standardized FER task. Overall FER accuracy was found to differ by ASD severity, reflecting poorer performance for those with increased symptoms. Results also indicated that an own-age bias was evident, reflecting greater FER performance for child compared to adult faces, for all adolescents regardless of ASD status or symptoms. However, the strength of the observed own-age bias did not differ by ASD status or severity. Findings suggest that face processing abilities of adolescents with ASD may be influenced by experience with specific categories of stimuli, similar to their typically developing peers.
Collapse
Affiliation(s)
- Kathryn M. Hauschild
- Social Competence and Treatment Laboratory, Department of Psychology, Stony Brook University, Stony Brook, NY, United States
| | - Peter Felsman
- Social Competence and Treatment Laboratory, Department of Psychology, Stony Brook University, Stony Brook, NY, United States
- Alan Alda Center for Communicating Science, Stony Brook University, Stony Brook, NY, United States
| | - Cara M. Keifer
- Social Competence and Treatment Laboratory, Department of Psychology, Stony Brook University, Stony Brook, NY, United States
| | - Matthew D. Lerner
- Social Competence and Treatment Laboratory, Department of Psychology, Stony Brook University, Stony Brook, NY, United States
- Department of Psychology, University of Virginia, Charlottesville, VA, United States
| |
Collapse
|
6
|
Marro BM, Kang E, Hauschild KM, Normansell KM, Abu-Ramadan TM, Lerner MD. Social performance–based interventions promote gains in social knowledge in the absence of explicit training for youth with autism spectrum disorder. Bull Menninger Clin 2019; 83:301-325. [DOI: 10.1521/bumc.2019.83.3.301] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
Abstract
Youth with autism spectrum disorder (ASD) experience deficits in social knowledge. It has long been theorized that these youth must learn these skills explicitly, and social skills interventions (SSIs) have followed suit. Recently, performance-based SSIs have emerged, which promote in vivo opportunities for social engagement without explicit instruction. Effects of performance-based SSIs on social knowledge have not been examined. This study employs two discrete samples (one lab-based, one community-based) of youth with ASD to examine the effects of performance-based interventions on social knowledge. Results largely support the efficacy and effectiveness of improving social knowledge by performance-based interventions without explicit teaching. This indicates that youth with ASD may be able to learn these aspects of social cognition implicitly, rather than exclusively explicitly. The results of the current study also suggest that SSI content, dosage, and intensity may relate to these outcomes, which are important considerations in clinical practice and future studies.
Collapse
|