Auditory imagery and the poor-pitch singer

Auditory imagery ability influences accuracy when singing with altered auditory feedback

In this preliminary study, we explored the relationship between auditory imagery ability and the maintenance of tonal and temporal accuracy when singing and audiating with altered auditory feedback (AAF). Actively performing participants sang and audiated (sang mentally but not aloud) a self-selected piece in AAF conditions, including upward pitch-shifts and delayed auditory feedback (DAF), and with speech distraction. Participants with higher self-reported scores on the Bucknell Auditory Imagery Scale (BAIS) produced a tonal reference that was less disrupted by pitch shifts and speech distraction than musicians with lower scores. However, there was no observed effect of BAIS score on temporal deviation when singing with DAF. Auditory imagery ability was not related to the experience of having studied music theory formally, but was significantly related to the experience of performing. The significant effect of auditory imagery ability on tonal reference deviation remained even after partialling out the effect of experience of performing. The results indicate that auditory imagery ability plays a key role in maintaining an internal tonal center during singing but has at most a weak effect on temporal consistency. In this article, we outline future directions in understanding the multifaceted role of auditory imagery ability in singers' accuracy and expression.

Is Hey Jude in the right key? Cognitive components of absolute pitch memory

Most individuals, regardless of formal musical training, have long-term absolute pitch memory (APM) for familiar musical recordings, though with varying levels of accuracy. The present study followed up on recent evidence suggesting an association between singing accuracy and APM (Halpern & Pfordresher, 2022, Attention, Perception, & Psychophysics, 84(1), 260-269), as well as tonal short-term memory (STM) and APM (Van Hedger et al., 2018, Quarterly Journal of Experimental Psychology, 71(4), 879-891). Participants from three research sites (n = 108) completed a battery of tasks including APM, tonal STM, singing accuracy, and self-reported auditory imagery. Both tonal STM and singing accuracy predicted APM, replicating prior results. Tonal STM also predicted singing accuracy, music training, and auditory imagery. Further tests suggested that the association between APM and singing accuracy was fully mediated by tonal STM. This pattern comports well with models of vocal pitch matching that include STM for pitch as a mechanism for sensorimotor translation.

Predictive processing of music and language in autism: Evidence from Mandarin and English speakers

Atypical predictive processing has been associated with autism across multiple domains, based mainly on artificial antecedents and consequents. As structured sequences where expectations derive from implicit learning of combinatorial principles, language and music provide naturalistic stimuli for investigating predictive processing. In this study, we matched melodic and sentence stimuli in cloze probabilities and examined musical and linguistic prediction in Mandarin- (Experiment 1) and English-speaking (Experiment 2) autistic and non-autistic individuals using both production and perception tasks. In the production tasks, participants listened to unfinished melodies/sentences and then produced the final notes/words to complete these items. In the perception tasks, participants provided expectedness ratings of the completed melodies/sentences based on the most frequent notes/words in the norms. While Experiment 1 showed intact musical prediction but atypical linguistic prediction in autism in the Mandarin sample that demonstrated imbalanced musical training experience and receptive vocabulary skills between groups, the group difference disappeared in a more closely matched sample of English speakers in Experiment 2. These findings suggest the importance of taking an individual differences approach when investigating predictive processing in music and language in autism, as the difficulty in prediction in autism may not be due to generalized problems with prediction in any type of complex sequence processing.

Exploring the role of singing, semantics, and amusia screening in speech-in-noise perception in musicians and non-musicians

Sentence repetition has been the focus of extensive psycholinguistic research. The notion that music training can bolster speech perception in adverse auditory conditions has been met with mixed results. In this work, we sought to gauge the effect of babble noise on immediate repetition of spoken and sung phrases of varying semantic content (expository, narrative, and anomalous), initially in 100 English-speaking monolinguals with and without music training. The two cohorts also completed some non-musical cognitive tests and the Montreal Battery of Evaluation of Amusia (MBEA). When disregarding MBEA results, musicians were found to significantly outperform non-musicians in terms of overall repetition accuracy. Sung targets were recalled significantly better than spoken ones across groups in the presence of babble noise. Sung expository targets were recalled better than spoken expository ones, and semantically anomalous content was recalled more poorly in noise. Rerunning the analysis after eliminating thirteen participants who were diagnosed with amusia showed no significant group differences. This suggests that the notion of enhanced speech perception-in noise or otherwise-in musicians needs to be evaluated with caution. Musicianship aside, this study showed for the first time that sung targets presented in babble noise seem to be recalled better than spoken ones. We discuss the present design and the methodological approach of screening for amusia as factors which may partially account for some of the mixed results in the field.

Singing ability is related to vocal emotion recognition: Evidence for shared sensorimotor processing across speech and music

The ability to recognize emotion in speech is a critical skill for social communication. Motivated by previous work that has shown that vocal emotion recognition accuracy varies by musical ability, the current study addressed this relationship using a behavioral measure of musical ability (i.e., singing) that relies on the same effector system used for vocal prosody production. In the current study, participants completed a musical production task that involved singing four-note novel melodies. To measure pitch perception, we used a simple pitch discrimination task in which participants indicated whether a target pitch was higher or lower than a comparison pitch. We also used self-report measures to address language and musical background. We report that singing ability, but not self-reported musical experience nor pitch discrimination ability, was a unique predictor of vocal emotion recognition accuracy. These results support a relationship between processes involved in vocal production and vocal perception, and suggest that sensorimotor processing of the vocal system is recruited for processing vocal prosody.

What do less accurate singers remember? Pitch-matching ability and long-term memory for music

We have only a partial understanding of how people remember nonverbal information such as melodies. Although once learned, melodies can be retained well over long periods of time, remembering newly presented melodies is on average quite difficult. People vary considerably, however, in their level of success in both memory situations. Here, we examine a skill we anticipated would be correlated with memory for melodies: the ability to accurately reproduce pitches. Such a correlation would constitute evidence that melodic memory involves at least covert sensorimotor codes. Experiment 1 looked at episodic memory for new melodies among nonmusicians, both overall and with respect to the Vocal Memory Advantage (VMA): the superiority in remembering melodies presented as sung on a syllable compared to rendered on an instrument. Although we replicated the VMA, our prediction that better pitch matchers would have a larger VMA was not supported, although there was a modest correlation with memory for melodies presented in a piano timbre. Experiment 2 examined long-term memory for the starting pitch of familiar recorded music. Participants selected the starting note of familiar songs on a keyboard, without singing. Nevertheless, we found that better pitch-matchers were more accurate in reproducing the correct starting note. We conclude that sensorimotor coding may be used in storing and retrieving exact melodic information, but is not so useful during early encounters with melodies, as initial coding seems to involve more derived properties such as pitch contour and tonality.

Individual differences in mental imagery in different modalities and levels of intentionality

Mental imagery is a highly common component of everyday cognitive functioning. While substantial progress is being made in clarifying this fundamental human function, much is still unclear or unknown. A more comprehensive account of mental imagery aspects would be gained by examining individual differences in age, sex, and background experience in an activity and their association with imagery in different modalities and intentionality levels. The current online study combined multiple imagery self-report measures in a sample (n = 279) with a substantial age range (18-65 years), aiming to identify whether age, sex, or background experience in sports, music, or video games were associated with aspects of imagery in the visual, auditory, or motor stimulus modality and voluntary or involuntary intentionality level. The findings show weak positive associations between age and increased vividness of voluntary auditory imagery and decreased involuntary musical imagery frequency, weak associations between being female and more vivid visual imagery, and relations of greater music and video game experience with higher involuntary musical imagery frequency. Moreover, all imagery stimulus modalities were associated with each other, for both intentionality levels, except involuntary musical imagery frequency, which was only related to higher voluntary auditory imagery vividness. These results replicate previous research but also contribute new insights, showing that individual differences in age, sex, and background experience are associated with various aspects of imagery such as modality, intentionality, vividness, and frequency. The study's findings can inform the growing domain of applications of mental imagery to clinical and pedagogical settings.

Perception and Production of Statement-Question Intonation in Autism Spectrum Disorder: A Developmental Investigation

Prosody or “melody in speech” in autism spectrum disorder (ASD) is often perceived as atypical. This study examined perception and production of statements and questions in 84 children, adolescents and adults with and without ASD, as well as participants’ pitch direction discrimination thresholds. The results suggested that the abilities to discriminate (in both speech and music conditions), identify, and imitate statement-question intonation were intact in individuals with ASD across age cohorts. Sensitivity to pitch direction predicted performance on intonation processing in both groups, who also exhibited similar developmental changes. These findings provide evidence for shared mechanisms in pitch processing between speech and music, as well as associations between low- and high-level pitch processing and between perception and production of pitch.

Effects of Visual and Auditory Feedback in Violin and Singing Voice Pitch Matching Tasks

Auditory-guided vocal learning is a mechanism that operates both in humans and other animal species making us capable to imitate arbitrary sounds. Both auditory memories and auditory feedback interact to guide vocal learning. This may explain why it is easier for humans to imitate the pitch of a human voice than the pitch of a synthesized sound. In this study, we compared the effects of two different feedback modalities in learning pitch-matching abilities using a synthesized pure tone in 47 participants with no prior music experience. Participants were divided into three groups: a feedback group (N = 15) receiving real-time visual feedback of their pitch as well as knowledge of results; an equal-timbre group (N = 17) receiving additional auditory feedback of the target note with a similar timbre to the instrument being used (i.e., violin or human voice); and a control group (N = 15) practicing without any feedback or knowledge of results. An additional fourth group of violin experts performed the same task for comparative purposes (N = 15). All groups were posteriorly evaluated in a transfer phase. Both experimental groups (i.e., the feedback and equal-timbre groups) improved their intonation abilities with the synthesized sound after receiving feedback. Participants from the equal-timber group seemed as capable as the feedback group of producing the required pitch with the voice after listening to the human voice, but not with the violin (although they also showed improvement). In addition, only participants receiving real-time visual feedback learned and retained in the transfer phase the mapping between the synthesized pitch and its correspondence with the produced vocal or violin pitch. It is suggested that both the effect of an objective external reward, together with the experience of exploring the pitch space with their instrument in an explicit manner, helped participants to understand how to control their pitch production, strengthening their schemas, and favoring retention.

An Exploratory Study of Imagining Sounds and "Hearing" Music in Autism

Individuals with autism spectrum disorder (ASD) reportedly possess preserved or superior music-processing skills compared to their typically developing counterparts. We examined auditory imagery and earworms (tunes that get "stuck" in the head) in adults with ASD and controls. Both groups completed a short earworm questionnaire together with the Bucknell Auditory Imagery Scale. Results showed poorer auditory imagery in the ASD group for all types of auditory imagery. However, the ASD group did not report fewer earworms than matched controls. These data suggest a possible basis in poor auditory imagery for poor prosody in ASD, but also highlight a separability between auditory imagery and control of musical memories. The separability is present in the ASD group but not in typically developing individuals.

Music-related abilities among readers with dyslexia

Research suggests that a central difficulty in dyslexia may be impaired rapid temporal processing. Good temporal processing is also needed for musical perception, which relies on the ability to detect rapid changes. Our study is the first to measure the perception of adults with and without dyslexia on all three dimensions of music (rhythm, pitch, and spectrum), as well as their capacity for auditory imagery and detection of slow changes, while controlling for working memory. Participants were undergraduate students, aged 20-35 years: 26 readers with dyslexia and 30 typical readers. Participants completed a battery of tests measuring aptitude for recognizing the similarity/difference in tone pitch or rhythm, spectral resolution, vividness/control of auditory imagination, the ability to detect slow changes in auditory stimuli, and working memory. As expected, readers with dyslexia showed poorer performance in pitch and rhythm than controls, but outperformed them in spectral perception. The data for each test was analyzed separately while controlling for the letter-number sequencing score. No differences between groups were found in slow-change detection or auditory imagery. Our results demonstrated that rapid temporal processing appears to be the main difficulty of readers with dyslexia, who demonstrated poorer performance when stimuli were presented quickly rather than slowly and better performance on a task when no temporal component was involved. These findings underscore the need for further study of temporal processing in readers with dyslexia. Remediation of temporal processing deficits may unmask the preserved or even superior abilities of people with dyslexia, leading to enhanced ability in all areas that utilize the temporal component.

Pitch-specific contributions of auditory imagery and auditory memory in vocal pitch imitation

Vocal imitation guides both music and language development. Despite the developmental significance of this behavior, a sizable minority of individuals are inaccurate at vocal pitch imitation. Although previous research suggested that inaccurate pitch imitation results from deficient sensorimotor associations between pitch perception and vocal motor planning, the cognitive processes involved in sensorimotor translation are not clearly defined. In the present research, we investigated the roles of basic cognitive processes in the vocal imitation of pitch, as well as the degree to which these processes rely on pitch-specific resources. In the present study, participants completed a battery of pitch and verbal tasks to measure pitch perception, pitch and verbal auditory imagery, pitch and verbal auditory short-term memory, and pitch imitation ability. Information on participants' music background was collected, as well. Pitch imagery, pitch short-term memory, pitch discrimination ability, and musical experience were unique predictors of pitch imitation ability. Furthermore, pitch imagery was a partial mediator of the relationship between pitch short-term memory and pitch imitation ability. These results indicate that vocal imitation recruits cognitive processes that rely on at least partially separate neural resources for pitch and verbal representations.

Verbal and Musical Short-Term Memory: Evidence for Shared Serial Order Processes?

This study explored the validity of an integrative framework for verbal and musical short-term memory (STM). Following this framework, access to domain-specific long-term knowledge bases supports the processing of musical and verbal item information in STM, while domain-general ordering processes support the representation of serial order information in the two domains. We exposed participants to verbal and musical STM tasks assessing either item information, order information, or both item and order information. Using an interindividual differences approach, we observed that performance in item-based STM tasks was not strongly associated between musical and verbal domains. In contrast, strong between-domain associations were observed for STM tasks assessing processing of verbal order and musical rhythm information. These preliminary results are overall in agreement with an integrative approach of verbal and musical STM. At the same time, the results highlight the difficulty of measuring serial order processing in the musical STM domain in a direct and specific manner.

Common cortical areas involved in both auditory and visual imageries for novel stimuli

We examine cross-modality commonalities in visual and auditory imageries during fMRI scanning in a sample of healthy young adults. In a visual task combining viewed and imagined stimuli, 28 participants were asked to imagine novel scenes related to the other images, and in a similar auditory task combining heard and imagined stimuli, to imagine novel sentences spoken by individuals they had heard speaking previously. We identified a common set of regions in medial and lateral Brodmann area 6, as well as inferior frontal gyrus (BA 44/45), partially supporting previous meta-analytic results. Comparing individuals with high or low reported imagery ability, we replicated a previous result showing individuals with lower visual imagery ability showed greater activation in the cerebellum, frontal and dorsolateral prefrontal cortex, while there was no relationship with auditory imagery ability in this sample. The emphasis on imagining novel stimuli, rather than familiar or previously experienced stimuli, confirms the role of the supramodal imagery network underlying creative imagery.

Covert singing in anticipatory auditory imagery

To date, several fMRI studies reveal activation in motor planning areas during musical auditory imagery. We addressed whether such activations may give rise to peripheral motor activity, termed subvocalization or covert singing, using surface electromyography. Sensors placed on extrinsic laryngeal muscles, facial muscles, and a control site on the bicep measured muscle activity during auditory imagery that preceded singing, as well as during the completion of a visual imagery task. Greater activation was found in laryngeal and lip muscles for auditory than for visual imagery tasks, whereas no differences across tasks were found for other sensors. Furthermore, less accurate singers exhibited greater laryngeal activity during auditory imagery than did more accurate singers. This suggests that subvocalization may be used as a strategy to facilitate auditory imagery, which appears to be degraded in inaccurate singers. Taken together, these results suggest that subvocalization may play a role in anticipatory auditory imagery, and possibly as a way of supplementing motor associations with auditory imagery.

Working memory and auditory imagery predict sensorimotor synchronisation with expressively timed music

Sensorimotor synchronisation (SMS) is prevalent and readily studied in musical settings, as most people are able to perceive and synchronise with a beat (e.g., by finger tapping). We took an individual differences approach to understanding SMS to real music characterised by expressive timing (i.e., fluctuating beat regularity). Given the dynamic nature of SMS, we hypothesised that individual differences in working memory and auditory imagery-both fluid cognitive processes-would predict SMS at two levels: (1) mean absolute asynchrony (a measure of synchronisation error) and (2) anticipatory timing (i.e., predicting, rather than reacting to beat intervals). In Experiment 1, participants completed two working memory tasks, four auditory imagery tasks, and an SMS-tapping task. Hierarchical regression models were used to predict SMS performance, with results showing dissociations among imagery types in relation to mean absolute asynchrony, and evidence of a role for working memory in anticipatory timing. In Experiment 2, a new sample of participants completed an expressive timing perception task to examine the role of imagery in perception without action. Results suggest that imagery vividness is important for perceiving and control is important for synchronising with irregular but ecologically valid musical time series. Working memory is implicated in synchronising by anticipating events in the series.

Roles of Supplementary Motor Areas in Auditory Processing and Auditory Imagery

Although the supplementary and pre-supplementary motor areas have been intensely investigated in relation to their motor functions, they are also consistently reported in studies of auditory processing and auditory imagery. This involvement is commonly overlooked, in contrast to lateral premotor and inferior prefrontal areas. We argue here for the engagement of supplementary motor areas across a variety of sound categories, including speech, vocalizations, and music, and we discuss how our understanding of auditory processes in these regions relate to findings and hypotheses from the motor literature. We suggest that supplementary and pre-supplementary motor areas play a role in facilitating spontaneous motor responses to sound, and in supporting a flexible engagement of sensorimotor processes to enable imagery and to guide auditory perception.

Hearing and imagining sounds–including speech, vocalizations, and music–can recruit SMA and pre-SMA, which are normally discussed in relation to their motor functions.

Emerging research indicates that individual differences in the structure and function of SMA and pre-SMA can predict performance in auditory perception and auditory imagery tasks.

Responses during auditory processing primarily peak in pre-SMA and in the boundary area between pre-SMA and SMA. This boundary area is crucially involved in the control of speech and vocal production, suggesting that sounds engage this region in an effector-specific manner.

Activating sound-related motor representations in SMA and pre-SMA might facilitate behavioral responses to sounds. This might also support a flexible generation of sensory predictions based on previous experience to enable imagery and guide perception.

Feel the Noise: Relating Individual Differences in Auditory Imagery to the Structure and Function of Sensorimotor Systems

Humans can generate mental auditory images of voices or songs, sometimes perceiving them almost as vividly as perceptual experiences. The functional networks supporting auditory imagery have been described, but less is known about the systems associated with interindividual differences in auditory imagery. Combining voxel-based morphometry and fMRI, we examined the structural basis of interindividual differences in how auditory images are subjectively perceived, and explored associations between auditory imagery, sensory-based processing, and visual imagery. Vividness of auditory imagery correlated with gray matter volume in the supplementary motor area (SMA), parietal cortex, medial superior frontal gyrus, and middle frontal gyrus. An analysis of functional responses to different types of human vocalizations revealed that the SMA and parietal sites that predict imagery are also modulated by sound type. Using representational similarity analysis, we found that higher representational specificity of heard sounds in SMA predicts vividness of imagery, indicating a mechanistic link between sensory- and imagery-based processing in sensorimotor cortex. Vividness of imagery in the visual domain also correlated with SMA structure, and with auditory imagery scores. Altogether, these findings provide evidence for a signature of imagery in brain structure, and highlight a common role of perceptual–motor interactions for processing heard and internally generated auditory information.

On drawing a line through the spectrogram: how do we understand deficits of vocal pitch imitation?

In recent years there has been a remarkable increase in research focusing on deficits of pitch production in singing. A critical concern has been the identification of “poor pitch singers,” which we refer to more generally as individuals having a “vocal pitch imitation deficit.” The present paper includes a critical assessment of the assumption that vocal pitch imitation abilities can be treated as a dichotomy. Though this practice may be useful for data analysis and may be necessary within educational practice, we argue that this approach is complicated by a series of problems. Moreover, we argue that a more informative (and less problematic) approach comes from analyzing vocal pitch imitation abilities on a continuum, referred to as effect magnitude regression, and offer examples concerning how researchers may analyze data using this approach. We also argue that the understanding of this deficit may be better served by focusing on the effects of experimental manipulations on different individuals, rather than attempt to treat values of individual measures, and isolated tasks, as absolute measures of ability.

The Pitch Imagery Arrow Task: effects of musical training, vividness, and mental control

Musical imagery is a relatively unexplored area, partly because of deficiencies in existing experimental paradigms, which are often difficult, unreliable, or do not provide objective measures of performance. Here we describe a novel protocol, the Pitch Imagery Arrow Task (PIAT), which induces and trains pitch imagery in both musicians and non-musicians. Given a tonal context and an initial pitch sequence, arrows are displayed to elicit a scale-step sequence of imagined pitches, and participants indicate whether the final imagined tone matches an audible probe. It is a staircase design that accommodates individual differences in musical experience and imagery ability. This new protocol was used to investigate the roles that musical expertise, self-reported auditory vividness and mental control play in imagery performance. Performance on the task was significantly better for participants who employed a musical imagery strategy compared to participants who used an alternative cognitive strategy and positively correlated with scores on the Control subscale from the Bucknell Auditory Imagery Scale (BAIS). Multiple regression analysis revealed that Imagery performance accuracy was best predicted by a combination of strategy use and scores on the Vividness subscale of BAIS. These results confirm that competent performance on the PIAT requires active musical imagery and is very difficult to achieve using alternative cognitive strategies. Auditory vividness and mental control were more important than musical experience in the ability to perform manipulation of pitch imagery.

Making and monitoring errors based on altered auditory feedback

Previous research has demonstrated that altered auditory feedback (AAF) disrupts music performance and causes disruptions in both action planning and the perception of feedback events. It has been proposed that this disruption occurs because of interference within a shared representation for perception and action (Pfordresher, 2006). Studies reported here address this claim from the standpoint of error monitoring. In Experiment 1 participants performed short melodies on a keyboard while hearing no auditory feedback, normal auditory feedback, or alterations to feedback pitch on some subset of events. Participants overestimated error frequency when AAF was present but not for normal feedback. Experiment 2 introduced a concurrent load task to determine whether error monitoring requires executive resources. Although the concurrent task enhanced the effect of AAF, it did not alter participants' tendency to overestimate errors when AAF was present. A third correlational study addressed whether effects of AAF are reduced for a subset of the population who may lack the kind of perception/action associations that lead to AAF disruption: poor-pitch singers. Effects of manipulations similar to those presented in Experiments 1 and 2 were reduced for these individuals. We propose that these results are consistent with the notion that AAF interference is based on associations between perception and action within a forward internal model of auditory-motor relationships.