Modeling Noise-Related Timbre Semantic Categories of Orchestral Instrument Sounds With Audio Features, Pitch Register, and Instrument Family

Audio features such as inharmonicity, noisiness, and spectral roll-off have been identified as correlates of "noisy" sounds. However, such features are likely involved in the experience of multiple semantic timbre categories of varied meaning and valence. This paper examines the relationships of stimulus properties and audio features with the semantic timbre categories raspy/grainy/rough, harsh/noisy, and airy/breathy. Participants (n = 153) rated a random subset of 52 stimuli from a set of 156 approximately 2-s orchestral instrument sounds representing varied instrument families (woodwinds, brass, strings, percussion), registers (octaves 2 through 6, where middle C is in octave 4), and both traditional and extended playing techniques (e.g., flutter-tonguing, bowing at the bridge). Stimuli were rated on the three semantic categories of interest, as well as on perceived playing exertion and emotional valence. Correlational analyses demonstrated a strong negative relationship between positive valence and perceived physical exertion. Exploratory linear mixed models revealed significant effects of extended technique and pitch register on valence, the perception of physical exertion, raspy/grainy/rough, and harsh/noisy. Instrument family was significantly related to ratings of airy/breathy. With an updated version of the Timbre Toolbox (R-2021 A), we used 44 summary audio features, extracted from the stimuli using spectral and harmonic representations, as input for various models built to predict mean semantic ratings for each sound on the three semantic categories, on perceived exertion, and on valence. Random Forest models predicting semantic ratings from audio features outperformed Partial Least-Squares Regression models, consistent with previous results suggesting that non-linear methods are advantageous in timbre semantic predictions using audio features. Relative Variable Importance measures from the models among the three semantic categories demonstrate that although these related semantic categories are associated in part with overlapping features, they can be differentiated through individual patterns of audio feature relationships.

Articulatory motor planning and timbral idiosyncrasies as underlying mechanisms of instrument-specific absolute pitch in expert musicians

The study of musical expertise illustrates how intense training in a specialized domain may instigate development of implicit skills. While absolute pitch, or the ability to identify musical pitches without external reference, is rare even in professional musicians and is understood to have a genetic component, anecdotal evidence and pilot data suggest that some musicians without traditional absolute pitch are nonetheless better able to name notes played on their musical instrument of expertise than notes played on less familiar instruments. We have previously termed this particular gain in absolute pitch identification ability “instrument-specific absolute pitch” (ISAP) and have proposed that this skill is related to learned instrument type-specific timbral and intonational idiosyncrasies and articulatory motor planning activated by the timbre of the instrument. In this Registered Report Protocol, we describe two experiments designed to investigate ISAP in professional oboists. Experiment 1 tests for ISAP ability by comparing oboists’ pitch identification accuracies for notes played on the oboe and on the piano. A subset of the participants from Experiment 1 who demonstrate this ability will be recruited for Experiment 2; the purpose of Experiment 2 is to test hypotheses concerning a mechanistic explanation for ISAP. The outcome of these experiments may provide support for the theory that some individuals have ISAP and that the underlying mechanisms of this ability may rely on the perception of subtle timbral/intonational idiosyncrasies and on articulatory motor planning developed through intensive long-term training. In general, this work will contribute to the understanding of specialized expertise, specifically of implicit abilities and biases that are not addressed directly in training, but that may yet develop through practice of a related skill set.

A Theory of Instrument-Specific Absolute Pitch

While absolute pitch (AP)—the ability to name musical pitches globally and without reference—is rare in expert musicians, anecdotal evidence suggests that some musicians may better identify pitches played on their primary instrument than pitches played on other instruments. We call this phenomenon “instrument-specific absolute pitch” (ISAP). In this paper we present a theory of ISAP. Specifically, we offer the hypothesis that some expert musicians without global AP may be able to more accurately identify pitches played on their primary instrument(s), and we propose timbral cues and articulatory motor imagery as two underlying mechanisms. Depending on whether informative timbral cues arise from performer- or instrument-specific idiosyncrasies or from timbre-facilitated tonotopic representations, we predict that performance may be enhanced for notes played by oneself, notes played on one’s own personal instrument, and/or notes played on any exemplar of one’s own instrument type. Sounds of one’s primary instrument may moreover activate kinesthetic memory and motor imagery, aiding pitch identification. In order to demonstrate how our theory can be tested, we report the methodology and analysis of two exemplary experiments conducted on two case-study participants who are professional oboists. The aim of the first experiment was to determine whether the oboists demonstrated ISAP ability, while the purpose of the second experiment was to provide a preliminary investigation of the underlying mechanisms. The results of the first experiment revealed that only one of the two oboists showed an advantage for identifying oboe tones over piano tones. For this oboist demonstrating ISAP, the second experiment demonstrated that pitch-naming accuracy decreased and variance around the correct pitch value increased as an effect of transposition and motor interference, but not of instrument or performer. These preliminary data suggest that some musicians possess ISAP while others do not. Timbral cues and motor imagery may both play roles in the acquisition of this ability. Based on our case study findings, we provide methodological considerations and recommendations for future empirical testing of our theory of ISAP.