A Multimodal Neural Network Recruited by Expertise with Musical Notation

An early perceptual locus of absolute pitch

Absolute pitch (AP) refers to the naming of musical tone without external reference. The influential two-component model states that AP is limited by the late-emerging pitch labeling process only and not the earlier perceptual and memory processes. Over the years, however, support for this model at the neural level has been mixed with various methodological limitations. Here, the electroencephalography responses of 27 AP possessors and 27 non-AP possessors were recorded. During both name verification and passive listening, event-related potential analyses showed a difference between AP and non-AP possessors at about 200 ms in their response toward tones compared with noise stimuli. Multivariate pattern analyses suggested that pitch naming was subserved by a series of transient processes for the first 250 ms, followed by a stage-like process for both AP and non-AP possessors with no group differences between them. These findings are inconsistent with the predictions of the two-component model, and instead suggest the existence of an early perceptual locus of AP.

Role of line junctions in expert object recognition: The case of musical notation

Line junctions are well-known to be important for real-world object recognition, and sensitivity to line junctions is enhanced with perceptual experience with an object category. However, it remains unclear whether these very simple visual features are involved in expert object representations at the neural level, and if yes, at what level(s) they are involved. In this EEG study, 31 music reading experts and 31 novices performed a one-back task with intact musical notation, musical notation with line junctions removed and pseudo-letters. We observed more separable neural representations of musical notation from pseudo-letter for experts than for novices when line junctions were present and during 180-280 ms after stimulus onset. Also, the presence of line junctions was better decoded in experts than in novices during 320-580 ms, and the decoding accuracy in this time window predicted the behavioral recognition advantage of musical notation when line junctions were present. These suggest that, with perceptual expertise, line junctions are more involved in category selective representation of objects, and are more explicitly represented in later stages of processing to support expert recognition performance.

A Meta-analysis on the Effect of Expertise on Eye Movements during Music Reading

The current meta-analysis was conducted on 12 studies comparing the eye movements of expert versus non-expert musicians and attempted to determine which eye movement measures are expertise dependent during music reading. The total dataset of 61 comparisons was divided into four subsets, each concerning one eye-movement variable (i.e., fixation duration, number of fixations, saccade amplitude, and gaze duration). We used a variance estimation method to aggregate the effect sizes. The results support the robust finding of reduced fixation duration in expert musicians (Subset 1, g = -0.72). Due to low statistical power because of limited effect sizes, the results on the number of fixations, saccade amplitude, and gaze duration were not reliable. We conducted meta-regression analyses to determine potential moderators of the effect of expertise on eye movements (i.e., definition of experimental groups, type of musical task performed, type of musical material used or tempo control). Moderator analyses did not yield any reliable results. The need for consistency in the experimental methodology is discussed.

Experiential and Cognitive Predictors of Sight-Singing Performance in Music Higher Education

Sight-singing is prevalent in aural skill classes, where learners differ in experience and cognitive abilities. In this research, we investigated whether musical experience, level of study, and working memory capacity (WMC) can predict sight-singing performance and if there is a correlation between WMC and performance among some subgroups of participants. We hypothesized that more experienced students and those with a higher WMC might sight-sing better than those with less experience and lesser WMC. We also hypothesized that the relationship between WMC and sight-singing performance would be more salient for less experienced and less proficient sight-singers. We surveyed 56 subjects about their experience with music, assessed their WMC, and evaluated their performance on a short sight-singing task. The results showed that the age when students began learning music could predict sight-singing performance independently from the number of years of experience and the educational level, suggesting a possible developmental component to sight-singing skill. We also found a negative relationship between WMC and pitch score in the low-performing group and between rhythm and pitch score, suggesting that pitch and rhythm are processed differently. Teachers should be aware of how students' backgrounds might be related to performance and encourage them to develop strong automated skills, such as reading music or singing basic tonal patterns.

How Visual Expertise Changes Representational Geometry: A Behavioral and Neural Perspective

Many people develop expertise in specific domains of interest, such as chess, microbiology, radiology, and, the case in point in our study: ornithology. It is poorly understood to what extent such expertise alters brain function. Previous neuroimaging studies of expertise have typically focused upon the category level, for example, selectivity for birds versus nonbird stimuli. We present a multivariate fMRI study focusing upon the representational similarity among objects of expertise at the subordinate level. We compare the neural representational spaces of experts and novices to behavioral judgments. At the behavioral level, ornithologists (n = 20) have more fine-grained and task-dependent representations of item similarity that are more consistent among experts compared to control participants. At the neural level, the neural patterns of item similarity are more distinct and consistent in experts than in novices, which is in line with the behavioral results. In addition, these neural patterns in experts show stronger correlations with behavior compared to novices. These findings were prominent in frontal regions, and some effects were also found in occipitotemporal regions. This study illustrates the potential of an analysis of representational geometry to understand to what extent expertise changes neural information processing.

Music-reading expertise associates with face but not Chinese character processing ability

A growing number of behavioural and neuroimaging studies have investigated the cognitive mechanisms and neural substrates underlying various forms of visual expertise, such as face and word processing. However, it remains poorly understood whether and to what extent the acquisition of one form of expertise would be associated with that of another. The current study examined the relationship between music-reading expertise and face and Chinese character processing abilities. In a series of experiments, music experts and novices performed discrimination and recognition tasks of musical notations, faces, and words. Results consistently showed that musical experts responded more accurately to musical notations and faces, but not to words, than did musical novices. More intriguingly, the music expert's age of training onset could well predict their face but not word processing performance: the earlier musical experts began musical notation reading, the better their face processing performance. Taken together, our findings provide preliminary and converging evidence that music-reading expertise links with face, but not word, processing, and lend support to the notion that the development of different types of visual expertise may not be independent, but rather interact with each other during their acquisition.

Domain-specific and domain-general contributions to reading musical notation

Musical practice may benefit not only domain-specific abilities, such as pitch discrimination and music performance, but also domain-general abilities, like executive functioning and memory. Behavioral and neural changes in visual processing have been associated with music-reading experience. However, it is still unclear whether there is a domain-specific visual ability to process musical notation. This study investigates the specificity of the visual skills relevant to simple decisions about musical notation. Ninety-six participants varying in music-reading experience answered a short survey to quantify experience with musical notation and completed a test battery that assessed musical notation reading fluency and accuracy at the level of individual note or note sequence. To characterize how this ability may relate to domain-general abilities, we also estimated general intelligence (as measured with the Raven's Progressive Matrices) and general object-recognition ability (as measure by a recently proposed construct o). We obtained reliable measurements on our various tasks and found evidence for a domain-specific ability of the perception of musical notation. This music-reading ability and domain-general abilities were found to contribute to performance on specific tasks differently, depending on the level of experience reading music.

The impact of early musical training on striatal functional connectivity

Evidence from language, visual and sensorimotor learning suggests that training early in life is more effective. The present work explores the hypothesis that learning during sensitive periods involves distinct brain networks in addition to those involved when learning later in life. Expert pianists were tested who started their musical training early (<7 years of age; n = 21) or late (n = 15), but were matched for total lifetime practice. Motor timing expertise was assessed using a musical scale playing task. Brain activity at rest was measured using fMRI and compared with a control group of nonmusicians (n = 17). Functional connectivity from seeds in the striatum revealed a striatal-cortical-sensorimotor network that was observed only in the early-onset group. In this network, higher connectivity correlated with greater motor timing expertise, which resulted from early/late group differences in motor timing expertise. By contrast, networks that differentiated musicians and nonmusicians, namely a striatal-occipital-frontal-cerebellar network in which connectivity was higher in musicians, tended to not show differences between early and late musicians and not be correlated with motor timing expertise. These results parcel musical sensorimotor neuroplasticity into a set of musicianship-related networks and a distinct set of predominantly early-onset networks. The findings lend support to the possibility that we can learn skills more easily early in development because during sensitive periods we recruit distinct brain networks that are no longer implicated in learning later in life.

Perceptual expertise with Chinese characters predicts Chinese reading performance among Hong Kong Chinese children with developmental dyslexia

This study explores the theoretical proposal that developmental dyslexia involves a failure to develop perceptual expertise with words despite adequate education. Among a group of Hong Kong Chinese children diagnosed with developmental dyslexia, we investigated the relationship between Chinese word reading and perceptual expertise with Chinese characters. In a perceptual fluency task, the time of visual exposure to Chinese characters was manipulated and limited such that the speed of discrimination of a short sequence of Chinese characters at an accuracy level of 80% was estimated. Pair-wise correlations showed that perceptual fluency for characters predicted speeded and non-speeded word reading performance. Exploratory hierarchical regressions showed that perceptual fluency for characters accounted for 5.3% and 9.6% variance in speeded and non-speeded reading respectively, in addition to age, non-verbal IQ, phonological awareness, morphological awareness, rapid automatized naming (RAN) and perceptual fluency for digits. The findings suggest that perceptual expertise with words plays an important role in Chinese reading performance in developmental dyslexia, and that perceptual training is a potential remediation direction.

Stable habituation deficits in the early stage of psychosis: a 2-year follow-up study

Neural habituation, the decrease in brain response to repeated stimuli, is a fundamental, highly conserved mechanism that acts as an essential filter for our complex sensory environment. Convergent evidence indicates neural habituation is disrupted in both early and chronic stages of schizophrenia, with deficits co-occurring in brain regions that show inhibitory dysfunction. As inhibitory deficits have been proposed to contribute to the onset and progression of illness, habituation may be an important treatment target. However, a crucial first step is clarifying whether habituation deficits progress with illness. In the present study, we measured neural habituation in 138 participants (70 early psychosis patients (<2 years of illness), 68 healthy controls), with 108 participants assessed longitudinally at both baseline and 2-year follow-up. At follow-up, all early psychosis patients met criteria for a schizophrenia spectrum disorder (i.e., schizophreniform disorder, schizophrenia, schizoaffective disorder). Habituation slopes (i.e., rate of fMRI signal change) to repeated images were computed for the anterior hippocampus, occipital cortex, and the fusiform face area. Habituation slopes were entered into a linear mixed model to test for effects of group and time by region. We found that early psychosis patients showed habituation deficits relative to healthy control participants across brain regions, and that these deficits were maintained, but did not worsen, over two years. These results suggest a stable period of habituation deficits in the early stage of schizophrenia.

A reliable and valid tool for measuring visual recognition ability with musical notation

Recognizing musical notation is an important skill to a full participation of Western classical music, but remains a largely under-researched topic in the psychology of music. One plausible reason of such omission is that, in the past, the research field has heavily relied on self-report of music reading ability, which was subjective and highly variable. This paper presents a reliable and valid tool for objectively measuring individual abilities in visual recognition of musical notation. The visual fluency task measures how fast one can accurately recognize a sequence of musical notation at a desired accuracy level using the adaptive psychometric method QUEST. We checked the reliability of this task in over 200 participants in terms of Guttman's λ-2 and Cronbach's alpha. Also, we evaluated the construct validity of this task by considering the convergent validity of this task with multiple external real-world measures of one's musical training background, with numerous experimental measures of visual tendencies of musical notation recognition and with sight-reading performance. Overall, the visual fluency task achieved satisfactory reliability and validity for measuring abilities in recognizing musical notation. This opens the door for characterizing the cognitive mechanisms, development, and individual differences in musical notation recognition, for understanding music learning and music psychology and for understanding of visual perceptual expertise in general.

Musicians use speech-specific areas when processing tones: The key to their superior linguistic competence?

It is known that musicians compared to non-musicians have some superior speech and language competence, yet the mechanisms how musical training leads to this advantage are not well specified. This event-related fMRI study confirmed that musicians outperformed non-musicians in processing not only of musical tones but also syllables and identified a network differentiating musicians from non-musicians during processing of linguistic sounds. Within this network, the activation of bilateral superior temporal gyrus was shared with all subjects during processing of the acoustically well-matched musical and linguistic sounds, and with the activation distinguishing tones with a complex harmonic spectrum (bowed tone) from a simpler one (plucked tone). These results confirm that better speech processing in musicians relies on improved cross-domain spectral analysis. Activation of left posterior superior temporal sulcus (pSTS), premotor cortex, inferior frontal and fusiform gyrus (FG) also distinguishing musicians from non-musicians during syllable processing overlapped with the activation segregating linguistic from musical sounds in all subjects. Since these brain-regions were not involved during tone processing in non-musicians, they could code for functions which are specialized for speech. Musicians recruited pSTS and FG during tone processing, thus these speech-specialized brain-areas processed musical sounds in the presence of musical training. This study shows that the linguistic advantage of musicians is linked not only to improved cross-domain spectral analysis, but also to the functional adaptation of brain resources that are specialized for speech, but accessible to the domain of music in the presence of musical training.

Reading music and words: The anatomical connectivity of musicians' visual cortex

Musical score reading and word reading have much in common, from their historical origins to their cognitive foundations and neural correlates. In the ventral occipitotemporal cortex (VOT), the specialization of the so-called Visual Word Form Area for word reading has been linked to its privileged structural connectivity to distant language regions. Here we investigated how anatomical connectivity relates to the segregation of regions specialized for musical notation or words in the VOT. In a cohort of professional musicians and non-musicians, we used probabilistic tractography combined with task-related functional MRI to identify the connections of individually defined word- and music-selective left VOT regions. Despite their close proximity, these regions differed significantly in their structural connectivity, irrespective of musical expertise. The music-selective region was significantly more connected to posterior lateral temporal regions than the word-selective region, which, conversely, was significantly more connected to anterior ventral temporal cortex. Furthermore, musical expertise had a double impact on the connectivity of the music region. First, music tracts were significantly larger in musicians than in non-musicians, associated with marginally higher connectivity to perisylvian music-related areas. Second, the spatial similarity between music and word tracts was significantly increased in musicians, consistently with the increased overlap of language and music functional activations in musicians, as compared to non-musicians. These results support the view that, for music as for words, very specific anatomical connections influence the specialization of distinct VOT areas, and that reciprocally those connections are selectively enhanced by the expertise for word or music reading.

Expertise effects on attention and eye-movement control during visual search: Evidence from the domain of music reading

Experts in many domains use their domain-specific knowledge to rapidly locate relevant information. To explore this ability in music reading, we contrasted the eye movements of 30 expert musicians (with at least 10 years of music reading training) and 30 non-musicians (who could not read music) while they completed a visual search task that required them to match a section of a complex piano music score (i.e., the search template) to its identical counterpart within a larger music score (i.e., the search array). Critically, both the search template and array were presented simultaneously throughout each trial in the experiment, which allowed for visual comparisons between the search template and the array. Relative to the non-musicians, the experts had higher accuracy and also spent more time looking at the relevant regions and less time looking at irrelevant regions. Also, as evidence that the experts and non-musicians adopted qualitatively different search strategies, the experts spent more time than non-musicians looking at the search template at the beginning of the trial, and the experts returned to this region less often than non-musicians. Taken together, our results indicate that experts use domain-specific knowledge in the form of "chunks" (Chase & Simon, 1973a, 1973b) and "templates" (Gobet & Simon, 1996b, 2000) to acquire accurate representations of highly complex search templates.

Visual training with musical notes changes late but not early electrophysiological responses in the visual cortex

Visual expertise with musical notation is unique. Fluent music readers show selectively higher activity to musical notes than to other visually similar patterns in both the retinotopic and higher-level visual areas and both very early (e.g., C1) and later (e.g., N170) visual event-related potential (ERP) components. This is different from domains such as face and letter perception, of which the neural expertise marker is typically found in the higher-level ventral visual areas and later (e.g., N170) ERP components. An intriguing question concerns whether the visual skills and neural selectivity observed in music-reading experts are a result of the effects of extensive visual experience with musical notation. The current study aimed to investigate the causal relationship between visual experience and its neural changes with musical notation. Novices with no formal musical training experience were trained to visually discriminate between note patterns in the laboratory for 10-26 hr such that their performance was comparable with fluent music readers. The N170 component became more selective for musical notes after training. Training was not, however, followed by changes in the earlier C1 component. The findings show that visual training is enough for causing changes in the responses of the higher-level visual areas to musical notation while the engagement of the early visual areas may involve additional nonvisual factors.

Disrupted Habituation in the Early Stage of Psychosis

BACKGROUND

Learning and memory are impaired in schizophrenia. Some theories have proposed that one form of memory, habituation, is particularly impaired. Preliminary evidence suggests that memory impairment is associated with failed hippocampal habituation in patients with chronic schizophrenia. We studied how abnormal habituation of the hippocampus is related to relational memory deficits in the early stage of psychosis.

METHODS

We measured hippocampal activity in 62 patients with early psychosis and 70 healthy individuals using functional magnetic resonance imaging. Habituation was defined as the slope of functional magnetic resonance imaging signal change to repeated presentations of faces and objects. Relational memory ability was measured as the slope of preferential viewing during a face-scene pair eye movement task outside the scanner.

RESULTS

Patients with early psychosis showed impaired relational memory (p < .001) and less hippocampal habituation to objects (p = .01) than healthy control subjects. In the healthy control group, better relational memory was associated with faster anterior hippocampal habituation (faces, r = -.28, p = .03). In contrast, patients with early psychosis showed no brain-behavior relationship (r = .12, p = .40).

CONCLUSIONS

We found evidence for disrupted hippocampal habituation in the early stage of psychosis along with an altered association between hippocampal habituation and relational memory ability. These results suggest that neural habituation may provide a novel target for early cognitive interventions in psychosis.

The role of line junctions in object recognition: The case of reading musical notation

Previous work has shown that line junctions are informative features for visual perception of objects, letters, and words. However, the sources of such sensitivity and their generalizability to other object categories are largely unclear. We addressed these questions by studying perceptual expertise in reading musical notation, a domain in which individuals with different levels of expertise are readily available. We observed that removing line junctions created by the contact between musical notes and staff lines selectively impaired recognition performance in experts and intermediate readers, but not in novices. The degree of performance impairment was predicted by individual fluency in reading musical notation. Our findings suggest that line junctions provide diagnostic information about object identity across various categories, including musical notation. However, human sensitivity to line junctions does not readily transfer from familiar to unfamiliar object categories, and has to be acquired through perceptual experience with the specific objects.

Three dimensional motion capture applied to violin playing: A study on feasibility and characterization of the motor strategy

BACKGROUND AND OBJECTIVE

Playing string instruments requires advanced motor skills and a long training that is often spent in uncomfortable postures that may lead to injuries or musculoskeletal disorders. Thus, it is interesting to objectively characterize the motor strategy adopted by the players. In this work, we implemented a method for the quantitative analysis of the motor performance of a violin player.

METHODS

The proposed protocol takes advantage of an optoelectronic system and some infra-red reflecting markers in order to track player's motion. The method was tested on a professional violin player performing a legato bowing task. The biomechanical strategy of the upper limb and bow positioning were described by means of quantitative parameters and motion profiles. Measured quantities were: bow trajectory, angles, tracks, velocity, acceleration and jerk.

RESULTS

A good repeatability of the bowing motion (CV < 2%) and high smoothness (jerk < 5 m/s³) were observed. Motion profiles of shoulder, elbow and wrist were repeatable (CV < 7%) and comparable to the curves observed in other studies. Jerk and acceleration profiles demonstrated high smoothness in the ascending and descending phases of bowing. High variability was instead observed for the neck angle (CV ∼56%).

CONCLUSIONS

"Quantitative" measurements, instead of "qualitative" observation, can support the diagnosis of motor disorders and the accurate evaluation of musicians' skills. The proposed protocol is a powerful tool for the description of musician's performance, that may be useful to document improvements in playing abilities and to adjust training strategies.

What is special about expertise? Visual expertise reveals the interactive nature of real-world object recognition

Ever since Diamond and Carey (1986. J. Exp. Psychol.: Gen., vol. 115, pp. 107-117) seminal work, the main model for studying expertise in visual object recognition ("visual expertise") has been face perception. The underlying assumption was that since faces may be considered the ultimate domain of visual expertise, any face-processing signature might actually be a general characteristic of visual expertise. However, while humans are clearly experts in face recognition, visual expertise is not restricted to faces and can be observed in a variety of domains. This raises the question of whether face recognition is in fact the right model to study visual expertise, and if not, what are the common cognitive and neural characteristics of visual expertise. The current perspective article addresses this question by revisiting past and recent neuroimaging and behavioural works on visual expertise. The view of visual expertise that emerges from these works is that expertise is a unique phenomenon, with distinctive neural and cognitive characteristics. Specifically, visual expertise is a controlled, interactive process that develops from the reciprocal interactions between the visual system and multiple top-down factors, including semantic knowledge, top-down attentional control, and task relevance. These interactions enable the ability to flexibly access domain-specific information at multiple scales and levels guided by multiple recognition goals. Extensive visual experience with a given object category culminates in the recruitment of these multiple systems, and is reflected in widespread neural activity, extending well beyond visual cortex, to include higher-level cortical areas.

Investigating the brain basis of facial expression perception using multi-voxel pattern analysis

Humans can readily decode emotion expressions from faces and perceive them in a categorical manner. The model by Haxby and colleagues proposes a number of different brain regions with each taking over specific roles in face processing. One key question is how these regions directly compare to one another in successfully discriminating between various emotional facial expressions. To address this issue, we compared the predictive accuracy of all key regions from the Haxby model using multi-voxel pattern analysis (MVPA) of functional magnetic resonance imaging (fMRI) data. Regions of interest were extracted using independent meta-analytical data. Participants viewed four classes of facial expressions (happy, angry, fearful and neutral) in an event-related fMRI design, while performing an orthogonal gender recognition task. Activity in all regions allowed for robust above-chance predictions. When directly comparing the regions to one another, fusiform gyrus and superior temporal sulcus (STS) showed highest accuracies. These results underscore the role of the fusiform gyrus as a key region in perception of facial expressions, alongside STS. The study suggests the need for further specification of the relative role of the various brain areas involved in the perception of facial expression. Face processing appears to rely on more interactive and functionally overlapping neural mechanisms than previously conceptualised.

Separate and concurrent symbolic predictions of sound features are processed differently

The studies investigated the impact of predictive visual information about the pitch and location of a forthcoming sound on the sound processing. In Symbol-to-Sound matching paradigms, symbols induced predictions of particular sounds. The brain's error signals (IR and N2b components of the event-related potential) were measured in response to occasional violations of the prediction, i.e., when a sound was incongruent to the corresponding symbol. IR and N2b index the detection of prediction violations at different levels, IR at a sensory and N2b at a cognitive level. Participants evaluated the congruency between prediction and actual sound by button press. When the prediction referred to only the pitch or only the location feature (Experiment 1), the violation of each feature elicited IR and N2b. The IRs to pitch and location violations revealed differences in the in time course and topography, suggesting that they were generated in feature-specific sensory areas. When the prediction referred to both features concurrently (Experiment 2), that is, the symbol predicted the sound's pitch and location, either one or both predictions were violated. Unexpectedly, no significant effects in the IR range were obtained. However, N2b was elicited in response to all violations. N2b in response to concurrent violations of pitch and location had a shorter latency. We conclude that associative predictions can be established by arbitrary rule-based symbols and for different sound features, and that concurrent violations are processed in parallel. In complex situations as in Experiment 2, capacity limitations appear to affect processing in a hierarchical manner. While predictions were presumably not reliably established at sensory levels (absence of IR), they were established at more cognitive levels, where sounds are represented categorially (presence of N2b).

The perceptual effects of learning object categories that predict perceptual goals

In classic category learning studies, subjects typically learn to assign items to 1 of 2 categories, with no further distinction between how items on each side of the category boundary should be treated. In real life, however, we often learn categories that dictate further processing goals, for instance, with objects in only 1 category requiring further individuation. Using methods from category learning and perceptual expertise, we studied the perceptual consequences of experience with objects in tasks that rely on attention to different dimensions in different parts of the space. In 2 experiments, subjects first learned to categorize complex objects from a single morphspace into 2 categories based on 1 morph dimension, and then learned to perform a different task, either naming or a local feature judgment, for each of the 2 categories. A same-different discrimination test before and after each training measured sensitivity to feature dimensions of the space. After initial categorization, sensitivity increased along the category-diagnostic dimension. After task association, sensitivity increased more for the category that was named, especially along the nondiagnostic dimension. The results demonstrate that local attentional weights, associated with individual exemplars as a function of task requirements, can have lasting effects on perceptual representations.

Perceptual expertise and top-down expectation of musical notation engages the primary visual cortex

Most theories of visual processing propose that object recognition is achieved in higher visual cortex. However, we show that category selectivity for musical notation can be observed in the first ERP component called the C1 (measured 40-60 msec after stimulus onset) with music-reading expertise. Moreover, the C1 note selectivity was observed only when the stimulus category was blocked but not when the stimulus category was randomized. Under blocking, the C1 activity for notes predicted individual music-reading ability, and behavioral judgments of musical stimuli reflected music-reading skill. Our results challenge current theories of object recognition, indicating that the primary visual cortex can be selective for musical notation within the initial feedforward sweep of activity with perceptual expertise and with a testing context that is consistent with the expertise training, such as blocking the stimulus category for music reading.

Beyond perceptual expertise: revisiting the neural substrates of expert object recognition

Real-world expertise provides a valuable opportunity to understand how experience shapes human behavior and neural function. In the visual domain, the study of expert object recognition, such as in car enthusiasts or bird watchers, has produced a large, growing, and often-controversial literature. Here, we synthesize this literature, focusing primarily on results from functional brain imaging, and propose an interactive framework that incorporates the impact of high-level factors, such as attention and conceptual knowledge, in supporting expertise. This framework contrasts with the perceptual view of object expertise that has concentrated largely on stimulus-driven processing in visual cortex. One prominent version of this perceptual account has almost exclusively focused on the relation of expertise to face processing and, in terms of the neural substrates, has centered on face-selective cortical regions such as the Fusiform Face Area (FFA). We discuss the limitations of this face-centric approach as well as the more general perceptual view, and highlight that expert related activity is: (i) found throughout visual cortex, not just FFA, with a strong relationship between neural response and behavioral expertise even in the earliest stages of visual processing, (ii) found outside visual cortex in areas such as parietal and prefrontal cortices, and (iii) modulated by the attentional engagement of the observer suggesting that it is neither automatic nor driven solely by stimulus properties. These findings strongly support a framework in which object expertise emerges from extensive interactions within and between the visual system and other cognitive systems, resulting in widespread, distributed patterns of expertise-related activity across the entire cortex.

Absolute pitch memory: its prevalence among musicians and dependence on the testing context

Absolute pitch (AP) is widely believed to be a rare ability possessed by only a small group of gifted and special individuals (AP possessors). While AP has fascinated psychologists, neuroscientists, and musicians for more than a century, no theory can satisfactorily explain why this ability is so rare and difficult to learn. Here, we show that AP ability appears rare because of the methodological issues of the standard pitch-naming test. Specifically, the standard test unnecessarily poses a high decisional demand on AP judgments and uses a testing context that is highly inconsistent with one's musical training. These extra cognitive challenges are not central to AP memory per se and have thus led to consistent underestimation of AP ability in the population. Using the standard test, we replicated the typical findings that the accuracy for general violinists was low (12.38 %; chance level = 0 %). With identical stimuli, scoring criteria, and participants, violinists attained 25 % accuracy in a pitch verification test in which the decisional demand of AP judgment was reduced. When the testing context was increasingly similar to their musical experience, verification accuracy improved further and reached 39 %, three times higher than that for the standard test. Results were replicated with a separate group of pianists. Our findings challenge current theories about AP and suggest that the prevalence of AP among musicians has been highly underestimated in prior work. A multimodal framework is proposed to better explain AP memory.

More to Explore in Music Reading as a Cross-Modal Process: A Comment on Lee and Lei (2012)

Lee and Lei (2012) used a pitch task and a duration task in different blocks of trials and measured event-related potentials in 12 musicians and 24 non-musicians as they read musical scores. The authors claimed to disentangle pitch and duration processing. From the perspectives of cognitive neuropsychology there is great interest in studying the processes involved in reading musical scores. However, we argue that the design used by Lee and Lei (2012) does not allow disentangling pitch and duration processing because both are expressed within the musical score. Moreover, we emphasize the importance of longitudinal studies over cross-sectional studies to pinpoint the specific influence of musical expertise on score reading.

Interaction of Pitch and Duration Processing by Non-Musicians in Reading Musical Notation

To study the relation of pitch and duration processing in reading musical notation, a Stroop-like task was used by 20 non-musicians. A probe display was presented before each target note. Participants were required to process the tonal and metric information of the probe and then to make a match or mismatch decision between probe and target. The target's color informed participants which dimension (pitch or duration) required analysis. The congruity of the irrelevant dimension of the target was manipulated to examine the effect on the relevant dimension. The interference effect of the irrelevant dimension on the relevant dimension was obvious for number of errors and reaction times. This result is consistent with pitch and duration being processed interdependently and reconciles with the theory of dynamic attention.

Auditory short-term memory activation during score reading

Performing music on the basis of reading a score requires reading ahead of what is being played in order to anticipate the necessary actions to produce the notes. Score reading thus not only involves the decoding of a visual score and the comparison to the auditory feedback, but also short-term storage of the musical information due to the delay of the auditory feedback during reading ahead. This study investigates the mechanisms of encoding of musical information in short-term memory during such a complicated procedure. There were three parts in this study. First, professional musicians participated in an electroencephalographic (EEG) experiment to study the slow wave potentials during a time interval of short-term memory storage in a situation that requires cross-modal translation and short-term storage of visual material to be compared with delayed auditory material, as it is the case in music score reading. This delayed visual-to-auditory matching task was compared with delayed visual-visual and auditory-auditory matching tasks in terms of EEG topography and voltage amplitudes. Second, an additional behavioural experiment was performed to determine which type of distractor would be the most interfering with the score reading-like task. Third, the self-reported strategies of the participants were also analyzed. All three parts of this study point towards the same conclusion according to which during music score reading, the musician most likely first translates the visual score into an auditory cue, probably starting around 700 or 1300 ms, ready for storage and delayed comparison with the auditory feedback.

Music-reading expertise alters visual spatial resolution for musical notation

Crowding occurs when the perception of a suprathreshold target is impaired by nearby distractors, reflecting a fundamental limitation on visual spatial resolution. It is likely that crowding limits music reading, as each musical note is crowded by adjacent notes and by the five-line staff, similar to word reading, in which letter recognition is reduced by crowding from adjacent letters. Here, we tested the hypothesis that, with extensive experience, music-reading experts have acquired visual skills such that they experience a smaller crowding effect, resulting in higher music-reading fluency. Experts experienced a smaller crowding effect than did novices, but only for musical stimuli, not for control stimuli (Landolt Cs). The magnitude of the crowding effect for musical stimuli could be predicted by individual fluency in music reading. Our results highlight the role of experience in crowding: Visual spatial resolution can be improved specifically for objects associated with perceptual expertise. Music-reading rates are likely limited by crowding, and our results are consistent with the idea that experience alleviates these limitations.

Neuroimaging during trance state: a contribution to the study of dissociation

Despite increasing interest in pathological and non-pathological dissociation, few researchers have focused on the spiritual experiences involving dissociative states such as mediumship, in which an individual (the medium) claims to be in communication with, or under the control of, the mind of a deceased person. Our preliminary study investigated psychography – in which allegedly “the spirit writes through the medium's hand” – for potential associations with specific alterations in cerebral activity. We examined ten healthy psychographers – five less expert mediums and five with substantial experience, ranging from 15 to 47 years of automatic writing and 2 to 18 psychographies per month – using single photon emission computed tomography to scan activity as subjects were writing, in both dissociative trance and non-trance states. The complexity of the original written content they produced was analyzed for each individual and for the sample as a whole. The experienced psychographers showed lower levels of activity in the left culmen, left hippocampus, left inferior occipital gyrus, left anterior cingulate, right superior temporal gyrus and right precentral gyrus during psychography compared to their normal (non-trance) writing. The average complexity scores for psychographed content were higher than those for control writing, for both the whole sample and for experienced mediums. The fact that subjects produced complex content in a trance dissociative state suggests they were not merely relaxed, and relaxation seems an unlikely explanation for the underactivation of brain areas specifically related to the cognitive processing being carried out. This finding deserves further investigation both in terms of replication and explanatory hypotheses.

High-resolution imaging of expertise reveals reliable object selectivity in the fusiform face area related to perceptual performance

The fusiform face area (FFA) is a region of human cortex that responds selectively to faces, but whether it supports a more general function relevant for perceptual expertise is debated. Although both faces and objects of expertise engage many brain areas, the FFA remains the focus of the strongest modular claims and the clearest predictions about expertise. Functional MRI studies at standard-resolution (SR-fMRI) have found responses in the FFA for nonface objects of expertise, but high-resolution fMRI (HR-fMRI) in the FFA [Grill-Spector K, et al. (2006) Nat Neurosci 9:1177-1185] and neurophysiology in face patches in the monkey brain [Tsao DY, et al. (2006) Science 311:670-674] reveal no reliable selectivity for objects. It is thus possible that FFA responses to objects with SR-fMRI are a result of spatial blurring of responses from nonface-selective areas, potentially driven by attention to objects of expertise. Using HR-fMRI in two experiments, we provide evidence of reliable responses to cars in the FFA that correlate with behavioral car expertise. Effects of expertise in the FFA for nonface objects cannot be attributed to spatial blurring beyond the scale at which modular claims have been made, and within the lateral fusiform gyrus, they are restricted to a small area (200 mm(2) on the right and 50 mm(2) on the left) centered on the peak of face selectivity. Experience with a category may be sufficient to explain the spatially clustered face selectivity observed in this region.

Neuroanatomical correlates of visual car expertise

Expertise in non-visual domains such as musical performance is associated with differences in gray matter volume of particular regions of the human brain. Whether this is also the case for expertise in visual object recognition is unknown. Here we tested whether individual variability in the ability to recognize car models, from novice performance to high level of expertise, is associated with specific structural changes in gray matter volume. We found that inter-individual variability in expertise with cars was significantly and selectively correlated with gray matter volume in prefrontal cortex. Inter-individual differences in the recognition of airplanes, that none of the participants had expertise with, were correlated with structural variability of regions bordering the visual cortex. These results highlight the role of prefrontal regions outside the visual cortex in accessing and processing visual knowledge about objects from the domain of expertise and suggest that expertise in visual object recognition may entail structural changes in regions associated with semantic knowledge.

Musical Training Effect on Reading Musical Notation: Evidence from Event-Related Potentials

Musical training enhances a range of non-musical cognitive functions, including visuospatial abilities. The aim of this study was to explore which event-related potential (ERP) components were enhanced or reduced as a result of musical training. Both electrophysiological and behavioral methods were used to compare musicians and non-musicians in the processing of pitch and duration when reading single musical notes. It was observed that in the early stage of note reading, the musician/non-musician differences emerged in the latency range of the N1 and N2. The N1 component was enhanced; in contrast, the N2 component was reduced in musicians. It is possible that musicians receive auditory meanings from visual music notations, so they therefore did not find it necessary to spend more resources on executing spatial attention than non-musicians do during pitch processing.

Smaller holistic processing of faces associated with face drawing experience

The type of experience involved with an object category has been regarded as one important factor in shaping of the human object recognition system. Laboratory training studies have shown that different kinds of learning experience with the same set of novel objects resulted in different perceptual and neural changes. Whether this applies to natural real-world objects remains to be seen. We compared two groups of observers who had different learning experiences with faces, using holistic processing as a dependent measure. We found that, while ordinary observers had extensive individuation experience with faces and displayed typical holistic face processing, art students who had acquired additional experience in drawing faces, and thus in attending to parts of a face, showed less holistic processing than did ordinary observers. These results converge with laboratory training studies on the role of type of experience in the development of different perceptual markers for different object categories. It is thus insufficient to categorize expertise simply in terms of object domains (e.g., expertise with faces). Instead, perceptual expertise should be classified in terms of the underlying process or task demand.

Exploring the Association between Visual Perception Abilities and Reading of Musical Notation

In the reading of music, the acquisition of pitch information depends primarily upon the spatial position of notes as well as upon an individual's spatial processing ability. This study investigated the relationship between the ability to read single notes and visual-spatial ability. Participants with high and low single-note reading abilities were differentiated based upon differences in musical notation-reading abilities and their spatial processing; object recognition abilities were then assessed. It was found that the group with lower note-reading abilities made more errors than did the group with a higher note-reading abilities in the mental rotation task. In contrast, there was no apparent significant difference between the two groups in the object recognition task. These results suggest that note-reading may be related to visual spatial processing abilities, and not to an individual's ability with object recognition.

The nature of experience determines object representations in the visual system

Visual perceptual learning (PL) and perceptual expertise (PE) traditionally lead to different training effects and recruit different brain areas, but reasons for these differences are largely unknown. Here, we tested how the learning history influences visual object representations. Two groups were trained with tasks typically used in PL or PE studies, with the same novel objects, training duration and parafoveal stimulus presentation. We observed qualitatively different changes in the cortical representations of these objects following PL and PE training, replicating typical training effects in each field. These effects were also modulated by testing tasks, suggesting that experience interacts with attentional set and that the choice of testing tasks critically determines the pattern of training effects one can observe after a short-term visual training. Experience appears sufficient to account for prior differences in the neural locus of learning between PL and PE. The nature of the experience with an object's category can determine its representation in the visual system.

Visual prediction and perceptual expertise

Making accurate predictions about what may happen in the environment requires analogies between perceptual input and associations in memory. These elements of predictions are based on cortical representations, but little is known about how these processes can be enhanced by experience and training. On the other hand, studies on perceptual expertise have revealed that the acquisition of expertise leads to strengthened associative processing among features or objects, suggesting that predictions and expertise may be tightly connected. Here we review the behavioral and neural findings regarding the mechanisms involving prediction and expert processing, and highlight important possible overlaps between them. Future investigation should examine the relations among perception, memory and prediction skills as a function of expertise. The knowledge gained by this line of research will have implications for visual cognition research, and will advance our understanding of how the human brain can improve its ability to predict by learning from experience.

Visual processing of music notation: a study of event-related potentials

In reading music, the acquisition of pitch information depends mostly on the spatial position of notes, hence more spatial processing, whereas the acquisition of temporal information depends mostly on the visual features of notes and object recognition. This study used both electrophysiological and behavioral methods to compare the processing of pitch and duration in reading single musical notes. It was observed that in the early stage of note reading, identification of pitch could elicit greater N1 and N2 amplitude than identification of duration at the parietal lobe electrodes. In the later stages of note reading, identifying pitch elicited a greater negative slow wave at parietal electrodes than did identifying note duration. The sustained contribution of parietal processes for pitch suggests that the dorsal pathway is essential for pitch processing. However, the duration task did not elicit greater amplitude of any early ERP components than the pitch task at temporal electrodes. Accordingly, a double dissociation, suggesting involvement of the dorsal visual stream, was not observed in spatial pitch processing and ventral visual stream in processing of note durations.

Holistic processing predicts face recognition

The concept of holistic processing is a cornerstone of face-recognition research. In the study reported here, we demonstrated that holistic processing predicts face-recognition abilities on the Cambridge Face Memory Test and on a perceptual face-identification task. Our findings validate a large body of work that relies on the assumption that holistic processing is related to face recognition. These findings also reconcile the study of face recognition with the perceptual-expertise work it inspired; such work links holistic processing of objects with people's ability to individuate them. Our results differ from those of a recent study showing no link between holistic processing and face recognition. This discrepancy can be attributed to the use in prior research of a popular but flawed measure of holistic processing. Our findings salvage the central role of holistic processing in face recognition and cast doubt on a subset of the face-perception literature that relies on a problematic measure of holistic processing.

Holistic processing of musical notation: Dissociating failures of selective attention in experts and novices

Holistic processing (i.e., the tendency to process objects as wholes) is associated with face perception and also with expertise individuating novel objects. Surprisingly, recent work also reveals holistic effects in novice observers. It is unclear whether the same mechanisms support holistic effects in experts and in novices. In the present study, we measured holistic processing of music sequences using a selective attention task in participants who vary in music-reading expertise. We found that holistic effects were strategic in novices but were relatively automatic in experts. Correlational analyses revealed that individual holistic effects were predicted by both individual music-reading ability and neural responses for musical notation in the right fusiform face area (rFFA), but in opposite directions for experts and novices, suggesting that holistic effects in the two groups may be of different natures. To characterize expert perception, it is important not only to measure the tendency to process objects as wholes, but also to test whether this effect is dependent on task constraints.

Interference in character processing reflects common perceptual expertise across writing systems

Perceptual expertise, even within the visual domain, can take many forms, depending on the goals of the practiced task and the visual information available to support performance. Given the same goals, expertise for different categories can recruit common perceptual resources, which could lead to interference during concurrent processing. We measured whether irrelevant characters of one writing system produce interference during visual search for characters of another writing system, as a function of expertise. Chinese-English bilinguals and English readers searched for target Roman letters among other distractors in a rapid serial visual presentation (RSVP) sequence. Chinese character distractors interfered with Roman letter search more than pseudoletter distractors, only for bilingual readers, suggesting a common perceptual bottleneck for Roman and Chinese processing in experts with both domains. We ruled out an explanation at the level of phonetic codes, by showing that concurrent verbal rehearsal has no effect on the magnitude of such interference. These findings converge with results showing competition between faces and cars in car experts to suggest that different domains of expertise that overlap in their cortical representations also possess a common perceptual bottleneck.