Prediction of external events with our motor system: towards a new framework

Brain activation during anticipation of sound sequences

Music consists of sound sequences that require integration over time. As we become familiar with music, associations between notes, melodies, and entire symphonic movements become stronger and more complex. These associations can become so tight that, for example, hearing the end of one album track can elicit a robust image of the upcoming track while anticipating it in total silence. Here, we study this predictive "anticipatory imagery" at various stages throughout learning and investigate activity changes in corresponding neural structures using functional magnetic resonance imaging. Anticipatory imagery (in silence) for highly familiar naturalistic music was accompanied by pronounced activity in rostral prefrontal cortex (PFC) and premotor areas. Examining changes in the neural bases of anticipatory imagery during two stages of learning conditional associations between simple melodies, however, demonstrates the importance of fronto-striatal connections, consistent with a role of the basal ganglia in "training" frontal cortex (Pasupathy and Miller, 2005). Another striking change in neural resources during learning was a shift between caudal PFC earlier to rostral PFC later in learning. Our findings regarding musical anticipation and sound sequence learning are highly compatible with studies of motor sequence learning, suggesting common predictive mechanisms in both domains.

Violation of expectation: neural correlates reflect bases of prediction

Setting perceptual expectations can be based on different sources of information that determine which functional networks will be involved in implementing preparatory top-down influences and dealing with situations in which expectations are violated. The goal of the present study was to investigate and directly compare brain activations triggered by violating expectations within two different task contexts. In the serial prediction task, participants monitored ordered perceptual sequences for predefined sequential deviants. In contrast, the target detection task entailed a presentation of stimuli which had to be monitored for predefined nonsequential deviants. Detection of sequential deviants triggered an increase of activity in premotor and cerebellar components of the "standard" sequencing network and activations in additional frontal areas initially not involved in sequencing. This pattern of activity reflects the detection of a mismatch between the expected and presented stimuli, updating of the underlying sequence representation (i.e., forward model), and elaboration of the violation. In contrast, target detection elicited activations in posterior temporal and parietal areas, reflecting an increase in perceptual processing evoked by the nonsequential deviant. The obtained results suggest that distinct functional networks involved in detecting deviants in different contexts reflect the origin and the nature of expectations being violated.

Encoding of spectral correlation over time in auditory cortex

Natural sounds contain multiple spectral components that vary over time. The degree of variation can be characterized in terms of correlation between successive time frames of the spectrum, or as a time window within which any two frames show a minimum degree of correlation: the greater the correlation of the spectrum between successive time frames, the longer the time window. Recent studies suggest differences in the encoding of shorter and longer time windows in left and right auditory cortex, respectively. The present functional magnetic resonance imaging study assessed brain activation in response to the systematic variation of the time window in complex spectra that are more similar to natural sounds than in previous studies. The data show bilateral activity in the planum temporale and anterior superior temporal gyrus as a function of increasing time windows, as well as activity in the superior temporal sulcus that was significantly lateralized to the right. The results suggest a coexistence of hierarchical and lateralization schemes for representing increasing time windows in auditory association cortex.

Juggling with the brain - thought and action in the human motor system

Empirical findings from various research fields indicate that cognitive and motor processes are far less dissimilar than previously thought. The present chapter takes a neuroscientific perspective and offers evidence for similarities between cognition and action focusing on three key players of the classical motor system: the primary motor cortex, the cerebellum, and the premotor cortex. Briefly, although movement execution is apparently supported in part by the same cerebral resources engaged in cognitive processes, the three brain regions reviewed here are differentially engaged in more or less action-bound cognitive processes.

Using time-to-contact information to assess potential collision modulates both visual and temporal prediction networks

Accurate estimates of the time-to-contact (TTC) of approaching objects are crucial for survival. We used an ecologically valid driving simulation to compare and contrast the neural substrates of egocentric (head-on approach) and allocentric (lateral approach) TTC tasks in a fully factorial, event-related fMRI design. Compared to colour control tasks, both egocentric and allocentric TTC tasks activated left ventral premotor cortex/frontal operculum and inferior parietal cortex, the same areas that have previously been implicated in temporal attentional orienting. Despite differences in visual and cognitive demands, both TTC and temporal orienting paradigms encourage the use of temporally predictive information to guide behaviour, suggesting these areas may form a core network for temporal prediction. We also demonstrated that the temporal derivative of the perceptual index tau (tau-dot) held predictive value for making collision judgements and varied inversely with activity in primary visual cortex (V1). Specifically, V1 activity increased with the increasing likelihood of reporting a collision, suggesting top-down attentional modulation of early visual processing areas as a function of subjective collision. Finally, egocentric viewpoints provoked a response bias for reporting collisions, rather than no-collisions, reflecting increased caution for head-on approaches. Associated increases in SMA activity suggest motor preparation mechanisms were engaged, despite the perceptual nature of the task.

Pre-emptive perception

How can an action to a target be selected without yet knowing what it is? Pre-emptive perception (PEP) is a framework which orders neuronal mechanisms in association with voluntary actions before an action is started and until it is completed. It is assumed that PEP serves the purpose of perception, but a conscious, perceptual identification of the goal is not obligatorily completed during the time period of PEP itself. The concept of PEP is that the brain pre-emptively optimizes an action plan to maximize eventual perception, even before being sure what the goal is. Experimental studies of voluntary saccadic eye movements are considered as prototypic activity within the framework of PEP. The core concept of pre-emption is that a particular saccade is selected while a large number of other possible actions are deselected. Pre-emptive computations include mechanisms associated with internal context and reward. Neurophysiological studies which show anatomically and functionally separate cortical and some subcortical neuronal groups in computing saccades are summarized. There is a potential relationship of PEP as a neurobiological framework and some philosophical concepts. Terms for processes between planning and action, such as intention, anticipation, and attention, are often incongruent in everyday language and in epistemology. It is proposed here that a scrutiny of these terms can be rigorously approached by temporal subdivision of PEP and conversely, clear definitions of these terms can lead to organized experimental designs of cognitive neurobiology. The temporal subdivision of PEP allows a critique of The Will in the definition of Schopenhauer and distinguishes it from the 'free will'.

Dissociating explicit timing from temporal expectation with fMRI

Explicit timing is engaged whenever subjects make a deliberate estimate of discrete duration in order to compare it with a previously memorised standard. Conversely, implicit timing is engaged, even without a specific instruction to time, whenever sensorimotor information is temporally structured and can be used to predict the duration of future events. Both emergent timing (motor) and temporal expectation (perceptual) are forms of implicit timing. Recent fMRI studies demonstrate discrete neural substrates for explicit and implicit timing. Specifically, basal ganglia are activated almost invariably by explicit timing, with co-activation of prefrontal, premotor and cerebellar areas being more context-dependent. Conversely, implicit perceptual timing (or "temporal expectation") recruits cortical action circuits, comprising inferior parietal and premotor areas, highlighting its role in the optimisation of prospective behaviour.

The grasping side of odours

Background

Research on multisensory integration during natural tasks such as reach-to-grasp is still in its infancy. Crossmodal links between vision, proprioception and audition have been identified, but how olfaction contributes to plan and control reach-to-grasp movements has not been decisively shown. We used kinematics to explicitly test the influence of olfactory stimuli on reach-to-grasp movements.

Methodology/Principal Findings

Subjects were requested to reach towards and grasp a small or a large visual target (i.e., precision grip, involving the opposition of index finger and thumb for a small size target and a power grip, involving the flexion of all digits around the object for a large target) in the absence or in the presence of an odour evoking either a small or a large object that if grasped would require a precision grip and a whole hand grasp, respectively. When the type of grasp evoked by the odour did not coincide with that for the visual target, interference effects were evident on the kinematics of hand shaping and the level of synergies amongst fingers decreased. When the visual target and the object evoked by the odour required the same type of grasp, facilitation emerged and the intrinsic relations amongst individual fingers were maintained.

Conclusions/Significance

This study demonstrates that olfactory information contains highly detailed information able to elicit the planning for a reach-to-grasp movement suited to interact with the evoked object. The findings offer a substantial contribution to the current debate about the multisensory nature of the sensorimotor transformations underlying grasping.

Processing of abstract rule violations in audition

The ability to encode rules and to detect rule-violating events outside the focus of attention is vital for adaptive behavior. Our brain recordings reveal that violations of abstract auditory rules are processed even when the sounds are unattended. When subjects performed a task related to the sounds but not to the rule, rule violations impaired task performance and activated a network involving supratemporal, parietal and frontal areas although none of the subjects acquired explicit knowledge of the rule or became aware of rule violations. When subjects tried to behaviorally detect rule violations, the brain's automatic violation detection facilitated intentional detection. This shows the brain's capacity for abstraction – an important cognitive function necessary to model the world. Our study provides the first evidence for the task-independence (i.e. automaticity) of this ability to encode abstract rules and for its immediate consequences for subsequent mental processes.