Cortical networks recruited for time perception: a monkey positron emission tomography (PET) study

Different subregions of monkey lateral prefrontal cortex respond to abstract sequences and their components

Sequential information permeates daily activities, such as when watching for the correct series of buildings to determine when to get off the bus or train. These sequences include periodicity (the spacing of the buildings), the identity of the stimuli (the kind of house), and higher-order more abstract rules that may not depend on the exact stimulus (e.g. house, house, house, business). Previously, we found that the posterior fundus of area 46 in the monkey lateral prefrontal cortex (LPFC) responds to rule changes in such abstract visual sequences. However, it is unknown if this region responds to other components of the sequence, i.e., image periodicity and identity, in isolation. Further, it is unknown if this region dissociates from other, more ventral LPFC subregions that have been associated with sequences and their components. To address these questions, we used awake functional magnetic resonance imaging in three male macaque monkeys during two no-report visual tasks. One task contained abstract visual sequences, and the other contained no visual sequences but maintained the same image periodicity and identities. We found the fundus of area 46 responded only to abstract sequence rule violations. In contrast, the ventral bank of area 46 responded to changes in image periodicity and identity, but not changes in the abstract sequence. These results suggest a functional specialization within anatomical substructures of LPFC to signal different kinds of stimulus regularities. This specialization may provide key scaffolding to identify abstract patterns and construct complex models of the world for daily living.

Significance Statement

Daily tasks, such as a bus commute, require tracking or monitoring your place (same, same, same, different building) until your stop. Sequence components such as rule, periodicity (timing), and item identity are involved in this process. While prior work located responses to sequence rule changes to area 46 of monkey lateral prefrontal cortex (LPFC) using awake monkey fMRI, less was known about other components. We found that LPFC subregions differentiated between sequence components. Area 46 posterior fundus responded to abstract visual sequence rule changes, but not to changes in image periodicity or identity. The converse was true for the more ventral, adjacent shoulder region. These results suggest that interactions between adjacent LPFC subregions provide key scaffolding for complex daily behaviors.

Neural dynamics of delayed feedback in robot teleoperation: insights from fNIRS analysis

Introduction

As robot teleoperation increasingly becomes integral in executing tasks in distant, hazardous, or inaccessible environments, operational delays remain a significant obstacle. These delays, inherent in signal transmission and processing, adversely affect operator performance, particularly in tasks requiring precision and timeliness. While current research has made strides in mitigating these delays through advanced control strategies and training methods, a crucial gap persists in understanding the neurofunctional impacts of these delays and the efficacy of countermeasures from a cognitive perspective.

Methods

This study addresses the gap by leveraging functional Near-Infrared Spectroscopy (fNIRS) to examine the neurofunctional implications of simulated haptic feedback on cognitive activity and motor coordination under delayed conditions. In a human-subject experiment (N = 41), sensory feedback was manipulated to observe its influences on various brain regions of interest (ROIs) during teleoperation tasks. The fNIRS data provided a detailed assessment of cerebral activity, particularly in ROIs implicated in time perception and the execution of precise movements.

Results

Our results reveal that the anchoring condition, which provided immediate simulated haptic feedback with a delayed visual cue, significantly optimized neural functions related to time perception and motor coordination. This condition also improved motor performance compared to the asynchronous condition, where visual and haptic feedback were misaligned.

Discussion

These findings provide empirical evidence about the neurofunctional basis of the enhanced motor performance with simulated synthetic force feedback in the presence of teleoperation delays. The study highlights the potential for immediate haptic feedback to mitigate the adverse effects of operational delays, thereby improving the efficacy of teleoperation in critical applications.

Interaction between spatial perception and temporal perception enables preservation of cause-effect relationship: Visual psychophysics and neuronal dynamics

INTRODUCTION

Visual perception of moving objects is integral to our day-to-day life, integrating visual spatial and temporal perception. Most research studies have focused on finding the brain regions activated during motion perception. However, an empirically validated general mathematical model is required to understand the modulation of the motion perception. Here, we develop a mathematical formulation of the modulation of the perception of a moving object due to a change in speed, under the formulation of the invariance of causality.

METHODS

We formulated the perception of a moving object as the coordinate transformation from a retinotopic space onto perceptual space and derived a quantitative relationship between spatiotemporal coordinates. To validate our model, we undertook the analysis of two experiments: (i) the perceived length of the moving arc, and (ii) the perceived time while observing moving stimuli. We performed a magnetic resonance imaging (MRI) tractography investigation of subjects to demarcate the anatomical correlation of the modulation of the perception of moving objects.

RESULTS

Our theoretical model shows that the interaction between visual-spatial and temporal perception, during the perception of moving object is described by coupled linear equations; and experimental observations validate our model. We observed that cerebral area V5 may be an anatomical correlate for this interaction. The physiological basis of interaction is shown by a Lotka-Volterra system delineating interplay between acetylcholine and dopamine neurotransmitters, whose concentrations vary periodically with the orthogonal phase shift between them, occurring at the axodendritic synapse of complex cells at area V5.

CONCLUSION

Under the invariance of causality in the representation of events in retinotopic space and perceptual space, the speed modulates the perception of a moving object. This modulation may be due to variations of the tuning properties of complex cells at area V5 due to the dynamic interaction between acetylcholine and dopamine. Our analysis is the first significant study, to our knowledge, that establishes a mathematical linkage between motion perception and causality invariance.

Bromazepam increases the error of the time interval judgments and modulates the EEG alpha asymmetry during time estimation

AIM

This study investigated the bromazepam effects in male subjects during the time estimation performance and EEG alpha asymmetry in electrodes associated with the frontal and motor cortex.

MATERIAL AND METHODS

This is a double-blind, crossover study with a sample of 32 healthy adults under control (placebo) vs. experimental (bromazepam) during visual time-estimation task in combination with electroencephalographic analysis.

RESULTS

The results demonstrated that the bromazepam increased the relative error in the 4 s, 7 s, and 9 s intervals (p = 0.001). In addition, oral bromazepam modulated the EEG alpha asymmetry in cortical areas during the time judgment (p ≤ 0.025).

CONCLUSION

The bromazepam decreases the precision of time estimation judgments and modulates the EEG alpha asymmetry, with greater left hemispheric dominance during time perception. Our findings suggest that bromazepam influences internal clock synchronization via the modulation of GABAergic receptors, strongly relating to attention, conscious perception, and behavioral performance.

Spatial conceptual mapping of words with temporal semantics

Unlike concrete words related to sensory perception (e.g., hear, sun), abstract words (including the words with temporal semantics, e.g., year, tomorrow) do not have direct embodied sensory correlates. Nevertheless, existing research indicates that abstract concepts’ representations make regular reference to sensorimotor processes, e.g., visual perception. For example, regular expressions such as “the future is ahead” or “the flow of time” are common in different languages reflecting a relatively universal nature of space-time correspondences. Moreover, these regular correspondences are commonly demonstrated in experimental studies; for example — by registering attentional displacement during processing of past and future related words. Here, the main theoretical approaches as well as existing experimental data documenting neurocognitive foundations of space-time representations are reviewed. A detailed overview of research on spatial-conceptual mapping of time concepts in three-dimensional visual space is offered. We also consider features of space-time associations that reflect linguistic and socio-cultural differences. In conclusion, the main areas of current and future that will allow an integration of the existing data within a common theoretical framework are defined.

Neuronal activity in the monkey prefrontal cortex during a duration discrimination task with visual and auditory cues

To investigate neuronal processing involved in the integration of auditory and visual signals for time perception, we examined neuronal activity in prefrontal cortex (PFC) of macaque monkeys during a duration discrimination task with auditory and visual cues. In the task, two cues were consecutively presented for different durations between 0.2 and 1.8 s. Each cue was either auditory or visual and was followed by a delay period. After the second delay, subjects indicated whether the first or the second cue was longer. Cue- and delay-responsive neurons were found in PFC. Cue-responsive neurons mostly responded to either the auditory or the visual cue, and to either the first or the second cue. The neurons responsive to the first delay showed activity that changed depending on the first cue duration and were mostly sensitive to cue modality. The neurons responsive to the second delay exhibited activity that represented which cue, the first or second cue, was presented longer. Nearly half of this activity representing order-based duration was sensitive to cue modality. These results suggest that temporal information with visual and auditory signals was separately processed in PFC in the early stage of duration discrimination and integrated for the final decision.

Neural correlates of episodic memory modulated by temporally delayed rewards

When a stimulus is associated with an external reward, its chance of being consolidated into long-term memory is boosted via dopaminergic facilitation of long-term potentiation in the hippocampus. Given that higher temporal distance (TD) has been found to discount the subjective value of a reward, we hypothesized that memory performance associated with a more immediate reward will result in better memory performance. We tested this hypothesis by measuring both behavioral memory performance and brain activation using functional magnetic resonance imaging (fMRI) during memory encoding and retrieval tasks. Contrary to our hypothesis, both behavioral and fMRI results suggest that the TD of rewards might enhance the chance of the associated stimulus being remembered. The fMRI data demonstrate that the lateral prefrontal cortex, which shows encoding-related activation proportional to the TD, is reactivated when searching for regions that show activation proportional to the TD during retrieval. This is not surprising given that this region is not only activated to discriminate between future vs. immediate rewards, it is also a part of the retrieval-success network. These results provide support for the conclusion that the encoding-retrieval overlap provoked as the rewards are more delayed may lead to better memory performance of the items associated with the rewards.

Audio-visual combination of syllables involves time-sensitive dynamics following from fusion failure

In face-to-face communication, audio-visual (AV) stimuli can be fused, combined or perceived as mismatching. While the left superior temporal sulcus (STS) is presumably the locus of AV integration, the process leading to combination is unknown. Based on previous modelling work, we hypothesize that combination results from a complex dynamic originating in a failure to integrate AV inputs, followed by a reconstruction of the most plausible AV sequence. In two different behavioural tasks and one MEG experiment, we observed that combination is more time demanding than fusion. Using time-/source-resolved human MEG analyses with linear and dynamic causal models, we show that both fusion and combination involve early detection of AV incongruence in the STS, whereas combination is further associated with enhanced activity of AV asynchrony-sensitive regions (auditory and inferior frontal cortices). Based on neural signal decoding, we finally show that only combination can be decoded from the IFG activity and that combination is decoded later than fusion in the STS. These results indicate that the AV speech integration outcome primarily depends on whether the STS converges or not onto an existing multimodal syllable representation, and that combination results from subsequent temporal processing, presumably the off-line re-ordering of incongruent AV stimuli.

The role of duration and frequency of occurrence in perceived pitch structure

INTRODUCTION

To survive, organisms need to organize perceptual input into coherent, usable structures. Research has illuminated the potential role of frequency of occurrence and duration as cues to extract statistical regularities from our environment. Musical stimuli provide a unique opportunity to study how these cues are used to organize auditory input into higher level perceptual entities, i.e., pitch structure, and to assess the influence of cognitive schema.

METHODS

To examine the relative importance of these two cues in pitch structure perception, we constructed novel tone sequences in which frequency of occurrence and duration cues were pitted against each other. We assessed perceived pitch structure in musically trained and untrained listeners using a probe tone paradigm.

RESULTS

In all experiments, a 3-tiered hierarchy of pitch structure emerged, with highest ratings for tones of longer duration, next highest for shorter, more frequent tones and lowest for probe tones that did not occur in the sequence. The hierarchy did not reflect assimilation to Western tonal schema.

DISCUSSION

Our results argue against theories positing the same mechanism for the processing of duration and frequency of occurrence, and that duration is weighted preferentially. We further suggest that the organization of perceptual information will proceed according to whatever information is relevant, available, and most easily acquired.

Uncoupling Sensation and Perception in Human Time Processing

Timing emerges from a hierarchy of computations ranging from early encoding of physical duration (time sensation) to abstract time representations (time perception) suitable for storage and decisional processes. However, the neural basis of the perceptual experience of time remains elusive. To address this, we dissociate brain activity uniquely related to lower-level sensory and higher-order perceptual timing operations, using event-related fMRI. Participants compared subsecond (500 msec) sinusoidal gratings drifting with constant velocity (standard) against two probe stimuli: (1) control gratings drifting at constant velocity or (2) accelerating gratings, which induced illusory shortening of time. We tested two probe intervals: a 500-msec duration (Short) and a longer duration required for an accelerating probe to be perceived as long as the standard (Long—individually determined). On each trial, participants classified the probe as shorter or longer than the standard. This allowed for comparison of trials with an “Objective” (physical) or “Subjective” (perceived) difference in duration, based on participant classifications. Objective duration revealed responses in bilateral early extrastriate areas, extending to higher visual areas in the fusiform gyrus (at more lenient thresholds). By contrast, Subjective duration was reflected by distributed responses in a cortical/subcortical areas. This comprised the left superior frontal gyrus and the left cerebellum, and a wider set of common timing areas including the BG, parietal cortex, and posterior cingulate cortex. These results suggest two functionally independent timing stages: early extraction of duration information in sensory cortices and Subjective experience of duration in a higher-order cortical–subcortical timing areas.

Monocular channels have a functional role in phasic alertness and temporal expectancy

The literature has long emphasized the neocortex's role in the tangled phasic-alertness and temporal-expectancy processes. In this work, we examined whether subcortical, monocular mechanisms have a functional role in these processes. This was done by assessing phasic alertness and temporal expectancy independently using a cue-target eye-of-origin manipulation. Participants performed target detection tasks in which a central cue and its ensuing peripheral target were each presented either to the same eye or to a different eye. In Experiment 1, phasic alertness, independent of temporal expectancy, was manipulated by presenting an alerting cue prior to the target presentation. The alerting effect elicited by the cue lasted for a longer duration when the cue and target were presented to the same eye than when they were presented to different eyes, indicating the involvement of subcortical regions in phasic alertness. In Experiment 2, the cue's temporal predictability regarding the target's onset time was manipulated by changing the cue-target interval's foreperiod distribution. A modulation in temporal expectancy was found when both the cue and the target were presented to the same eye, demonstrating the importance of subcortical mechanisms in temporal expectancy. Together, the results demonstrate that monocular channels are functionally involved in both phasic alertness and temporal expectancy. This study suggests that both phasic alertness and temporal expectancy are functionally dependent on monocular channels of the visual stream, and highlights the importance of direct examination of primitive, subcortical regions in higher cognitive functioning (e.g., temporal expectancy).

Network Brain-Computer Interface (nBCI): An Alternative Approach for Cognitive Prosthetics

Brain computer interfaces (BCIs) have been applied to sensorimotor systems for many years. However, BCI technology has broad potential beyond sensorimotor systems. The emerging field of cognitive prosthetics, for example, promises to improve learning and memory for patients with cognitive impairment. Unfortunately, our understanding of the neural mechanisms underlying these cognitive processes remains limited in part due to the extensive individual variability in neural coding and circuit function. As a consequence, the development of methods to ascertain optimal control signals for cognitive decoding and restoration remains an active area of inquiry. To advance the field, robust tools are required to quantify time-varying and task-dependent brain states predictive of cognitive performance. Here, we suggest that network science is a natural language in which to formulate and apply such tools. In support of our argument, we offer a simple demonstration of the feasibility of a network approach to BCI control signals, which we refer to as network BCI (nBCI). Finally, in a single subject example, we show that nBCI can reliably predict online cognitive performance and is superior to certain common spectral approaches currently used in BCIs. Our review of the literature and preliminary findings support the notion that nBCI could provide a powerful approach for future applications in cognitive prosthetics.

Retrospective time estimation following damage to the prefrontal cortex

Time estimation in patients with prefrontal cortex (PFC) damage is often inaccurate. The relationship between PFC and estimation of short time intervals has been examined. However, it remains unclear whether PFC damage affects estimation of longer time intervals. Here, we investigated the ability of patients and healthy subjects to verbally estimate a period of 30 min, using a method easily applied in clinical settings. In 99 patients with brain damage, we compared under and normal ranges of time in patients with PFC damage or damage to other brain areas with the chi-squared test. Subsequently, we conducted a discriminant analysis and a multiple linear regression analysis to identify specific brain areas affecting time estimation. We observed a significantly larger number of patients who overestimated 30 min in the group with bilateral PFC damage compared to patients with damage to other regions. Discriminant analysis revealed that damage of right lateral PFC and left medial PFC contributed to discrimination between the normal range and overestimation groups. Multiple linear regression analysis indicated that right lateral PFC damage strongly affected overestimation of a 30-min interval. Neuropsychological test results revealed lower general cognitive function scores and orientation scores in overestimation group. The length of estimated time and the score of delayed word recall were negatively correlated. We propose that these may require encoding, maintenance, and updating of memory and are indirectly related to contextual memory. We discuss hypotheses on contextual memory segmentation and reconstruction to clarify the mechanism of impaired time overestimation in PFC-damaged patients.

Distinct Dynamics of Striatal and Prefrontal Neural Activity During Temporal Discrimination

The frontal cortex-basal ganglia circuit plays an important role in interval timing. We examined neuronal discharges in the dorsomedial and dorsolateral striatum (DMS and DLS) in rats performing a temporal categorization task and compared them with previously recorded neuronal activity in the medial prefrontal cortex (mPFC). All three structures conveyed significant temporal information, but striatal neurons seldom showed the prolonged, full-interval spanning ramping activity frequently observed in the mPFC. Instead, the majority fired briefly during sample intervals. Also, the precision of neural time decoding became progressively worse with increasing time duration in the mPFC, but not in the striatum. With the caveat that mPFC and striatal units were recorded from different animals, our results suggest that the striatum and mPFC convey temporal information via distinct neural processes.

Sequential Firing Codes for Time in Rodent Medial Prefrontal Cortex

A subset of hippocampal neurons, known as "time cells" fire sequentially for circumscribed periods of time within a delay interval. We investigated whether medial prefrontal cortex (mPFC) also contains time cells and whether their qualitative properties differ from those in the hippocampus and striatum. We studied the firing correlates of neurons in the rodent mPFC during a temporal discrimination task. On each trial, the animals waited for a few seconds in the stem of a T-maze. A subpopulation of units fired in a sequence consistently across trials for a circumscribed period during the delay interval. These sequentially activated time cells showed temporal accuracy that decreased as time passed as measured by both the width of their firing fields and the number of cells that fired at a particular part of the interval. The firing dynamics of the time cells was significantly better explained with the elapse of time than with the animals' position and velocity. The findings observed here in the mPFC are consistent with those previously reported in the hippocampus and striatum, suggesting that the sequentially activated time cells are not specific to these areas, but are part of a common representational motif across regions.

Interference between Space and Time Estimations: From Behavior to Neurons

Influences between time and space can be found in our daily life in which we are surrounded by numerous spatial metaphors to refer to time. For instance, when we move files from one folder to another in our computer a horizontal line that grows from left to right informs us about the elapsed and remaining time to finish the procedure and, similarly, in our communication we use several spatial terms to refer to time. Although with some differences in the degree of interference, not only space has an influence on time but both magnitudes influence each other. Indeed, since our childhood our estimations of time are influenced by space even when space should be irrelevant and the same occurs when estimating space with time as distractor. Such interference between magnitudes has also been observed in monkeys even if they do not use language or computers, suggesting that the two magnitudes are tightly coupled beyond communication and technology. Imaging and lesion studies have indicated that same brain areas are involved during the processing of both magnitudes and have suggested that rather than coding the specific magnitude itself the brain represents them as abstract concepts. Recent neurophysiological studies in prefrontal cortex, however, have shown that the coding of absolute and relative space and time in this area is realized by independent groups of neurons. Interestingly, instead, a high overlap was observed in this same area in the coding of goal choices across tasks. These results suggest that rather than during perception or estimation of space and time the interference between the two magnitudes might occur, at least in the prefrontal cortex, in a subsequent phase in which the goal has to be chosen or the response provided.

Differential Encoding of Time by Prefrontal and Striatal Network Dynamics

Telling time is fundamental to many forms of learning and behavior, including the anticipation of rewarding events. Although the neural mechanisms underlying timing remain unknown, computational models have proposed that the brain represents time in the dynamics of neural networks. Consistent with this hypothesis, changing patterns of neural activity dynamically in a number of brain areas-including the striatum and cortex-has been shown to encode elapsed time. To date, however, no studies have explicitly quantified and contrasted how well different areas encode time by recording large numbers of units simultaneously from more than one area. Here, we performed large-scale extracellular recordings in the striatum and orbitofrontal cortex of mice that learned the temporal relationship between a stimulus and a reward and reported their response with anticipatory licking. We used a machine-learning algorithm to quantify how well populations of neurons encoded elapsed time from stimulus onset. Both the striatal and cortical networks encoded time, but the striatal network outperformed the orbitofrontal cortex, a finding replicated both in simultaneously and nonsimultaneously recorded corticostriatal datasets. The striatal network was also more reliable in predicting when the animals would lick up to ∼1 s before the actual lick occurred. Our results are consistent with the hypothesis that temporal information is encoded in a widely distributed manner throughout multiple brain areas, but that the striatum may have a privileged role in timing because it has a more accurate "clock" as it integrates information across multiple cortical areas.

SIGNIFICANCE STATEMENT

The neural representation of time is thought to be distributed across multiple functionally specialized brain structures, including the striatum and cortex. However, until now, the neural code for time has not been compared quantitatively between these areas. Here, we performed large-scale recordings in the striatum and orbitofrontal cortex of mice trained on a stimulus-reward association task involving a delay period and used a machine-learning algorithm to quantify how well populations of simultaneously recorded neurons encoded elapsed time from stimulus onset. We found that, although both areas encoded time, the striatum consistently outperformed the orbitofrontal cortex. These results suggest that the striatum may refine the code for time by integrating information from multiple inputs.

Probing the timing network: A continuous theta burst stimulation study of temporal categorization

Time perception in the millisecond and second ranges is thought to be processed by different neural mechanisms. However, whether there is a sharp boundary between these ranges and whether they are implemented in the same, overlapped or separate brain areas is still not certain. To probe the role of the right dorsolateral prefrontal cortex (dlPFC), the right supplementary motor area (SMA), and the cerebellum on time perception, we temporarily altered their activity on healthy volunteers on separate sessions using transcranial magnetic stimulation with the continuous Theta Burst Stimulation (cTBS) protocol. A control session was reserved for the stimulation of the primary somatosensory cortex (S1). Before and after stimulation, participants were tested on a temporal categorization task using intervals in the hundreds and thousands of milliseconds ranges, as well as on a pitch categorization task which was used as a further control. We then looked for changes in the Relative Threshold and the Constant Error, which, respectively, reflect participants' sensitivity to interval duration and their accuracy at setting an interval that acts as a boundary between categories. We found that after cTBS in all of the studied regions, the Relative Threshold, but not the Constant Error, was affected and only when hundreds of milliseconds intervals were being categorized. Categorization of thousands of milliseconds intervals and of pitch was not affected. These results suggest that the fronto-cerebellar circuit is particularly involved in the estimation of intervals in the hundreds of milliseconds range.

Time Perception Mechanisms at Central Nervous System

The five senses have specific ways to receive environmental information and lead to central nervous system. The perception of time is the sum of stimuli associated with cognitive processes and environmental changes. Thus, the perception of time requires a complex neural mechanism and may be changed by emotional state, level of attention, memory and diseases. Despite this knowledge, the neural mechanisms of time perception are not yet fully understood. The objective is to relate the mechanisms involved the neurofunctional aspects, theories, executive functions and pathologies that contribute the understanding of temporal perception. Articles form 1980 to 2015 were searched by using the key themes: neuroanatomy, neurophysiology, theories, time cells, memory, schizophrenia, depression, attention-deficit hyperactivity disorder and Parkinson’s disease combined with the term perception of time. We evaluated 158 articles within the inclusion criteria for the purpose of the study. We conclude that research about the holdings of the frontal cortex, parietal, basal ganglia, cerebellum and hippocampus have provided advances in the understanding of the regions related to the perception of time. In neurological and psychiatric disorders, the understanding of time depends on the severity of the diseases and the type of tasks.

Systematic Underreproduction of Time Is Independent of Judgment Certainty

We recently proposed that systematic underreproduction of time is caused by a general judgment bias towards earlier responses, instead of reflecting a genuine misperception of temporal intervals. Here we tested whether this bias can be explained by the uncertainty associated with temporal judgments. We applied transcranial magnetic stimulation (TMS) to inhibit neuronal processes in the right posterior parietal cortex (PPC) and tested its effects on time discrimination and reproduction tasks. The results show increased certainty for discriminative time judgments after PPC inhibition. They suggest that the right PPC plays an inhibitory role for time perception, possibly by mediating the multisensory integration between temporal stimuli and other quantities. Importantly, this increased judgment certainty had no influence on the degree of temporal underreproduction. We conclude that the systematic underreproduction of time is not caused by uncertainty for temporal judgments.

Context-Dependent Duration Signals in the Primate Prefrontal Cortex

The activity of some prefrontal (PF) cortex neurons distinguishes short from long time intervals. Here, we examined whether this property reflected a general timing mechanism or one dependent on behavioral context. In one task, monkeys discriminated the relative duration of 2 stimuli; in the other, they discriminated the relative distance of 2 stimuli from a fixed reference point. Both tasks had a pre-cue period (interval 1) and a delay period (interval 2) with no discriminant stimulus. Interval 1 elapsed before the presentation of the first discriminant stimulus, and interval 2 began after that stimulus. Both intervals had durations of either 400 or 800 ms. Most PF neurons distinguished short from long durations in one task or interval, but not in the others. When neurons did signal something about duration for both intervals, they did so in an uncorrelated or weakly correlated manner. These results demonstrate a high degree of context dependency in PF time processing. The PF, therefore, does not appear to signal durations abstractedly, as would be expected of a general temporal encoder, but instead does so in a highly context-dependent manner, both within and between tasks.

The "serendipitous brain": Low expectancy and timing uncertainty of conscious events improve awareness of unconscious ones (evidence from the Attentional Blink)

To anticipate upcoming sensory events, the brain picks-up and exploits statistical regularities in the sensory environment. However, it is untested whether cumulated predictive knowledge about consciously seen stimuli improves the access to awareness of stimuli that usually go unseen. To explore this issue, we exploited the Attentional Blink (AB) effect, where conscious processing of a first visual target (T1) hinders detection of early following targets (T2). We report that timing uncertainty and low expectancy about the occurrence of consciously seen T2s presented outside the AB period, improve detection of early and otherwise often unseen T2s presented inside the AB. Recording of high-resolution Event Related Potentials (ERPs) and the study of their intracranial sources showed that the brain achieves this improvement by initially amplifying and extending the pre-conscious storage of T2s' traces signalled by the N2 wave originating in the extra-striate cortex. This enhancement in the N2 wave is followed by specific changes in the latency and amplitude of later components in the P3 wave (P3a and P3b), signalling access of the sensory trace to the network of parietal and frontal areas modulating conscious processing. These findings show that the interaction between conscious and unconscious processing changes adaptively as a function of the probabilistic properties of the sensory environment and that the combination of an active attentional state with loose probabilistic and temporal expectancies on forthcoming conscious events favors the emergence to awareness of otherwise unnoticed visual events. This likely provides an insight on the attentional conditions that predispose an active observer to unexpected "serendipitous" findings.

Of magnitudes and metaphors: explaining cognitive interactions between space, time, and number

Space, time, and number are fundamental to how we act within and reason about the world. These three experiential domains are systematically intertwined in behavior, language, and the brain. Two main theories have attempted to account for cross-domain interactions. A Theory of Magnitude (ATOM) posits a domain-general magnitude system. Conceptual Metaphor Theory (CMT) maintains that cross-domain interactions are manifestations of asymmetric mappings that use representations of space to structure the domains of number and time. These theories are often viewed as competing accounts. We propose instead that ATOM and CMT are complementary, each illuminating different aspects of cross-domain interactions. We argue that simple representations of magnitude cannot, on their own, account for the rich, complex interactions between space, time and number described by CMT. On the other hand, ATOM is better at accounting for low-level and language-independent associations that arise early in ontogeny. We conclude by discussing how magnitudes and metaphors are both needed to understand our neural and cognitive web of space, time and number.

Temporal-order judgment of audiovisual events involves network activity between parietal and prefrontal cortices

Our perception of the temporal order of everyday external events depends on the integrated sensory information in the brain. Our understanding of the brain mechanism for temporal-order judgment (TOJ) of unisensory events, particularly in the visual domain, is advanced. In case of multisensory events, however, there are unanswered questions. Here, by using physically synchronous and asynchronous auditory-visual events in functional magnetic resonance imaging (fMRI) experiments, we identified the brain network that is associated with the perception of the temporal order of multisensory events. The activation in the right temporo-parietal junction was modulated by the perception of asynchronous audiovisual events. During this perception of temporal order, the right dorsolateral prefrontal cortex coordinated activity with the right temporo-parietal and the left inferior parietal cortices. These results suggest that the TOJ in the multisensory domain underlies a network activity between parietal and prefrontal cortices unlike the regional activity in the right temporo-parietal junction in the unisensory visual domain.

Neural correlates of interval timing in rodent prefrontal cortex

Time interval estimation is involved in numerous behavioral processes, but its underlying neural mechanisms remain unclear. In particular, it has been controversial whether time is encoded on a linear or logarithmic scale. Based on our previous finding that inactivation of the medial prefrontal cortex (mPFC) profoundly impairs rat's ability to discriminate time intervals, we investigated how the mPFC processes temporal information by examining activity of mPFC neurons in rats performing a temporal bisection task. Many mPFC neurons conveyed temporal information based on monotonically changing activity profiles over time with negative accelerations, so that their activity profiles were better described by logarithmic than linear functions. Moreover, the precision of time-interval discrimination based on neural activity was lowered in proportion to the elapse of time, but without proportional increase in neural variability, which is well accounted for by logarithmic, but not by linear functions. As a population, mPFC neurons conveyed precise information about the elapse of time with their activity tightly correlated with the animal's choice of target. These results suggest that the mPFC might be part of an internal clock in charge of controlling interval-timing behavior, and that linearly changing neuronal activity on a logarithmic time scale might be one way of representing the elapse of time in the brain.

Representation of abstract quantitative rules applied to spatial and numerical magnitudes in primate prefrontal cortex

Processing quantity information based on abstract principles is central to intelligent behavior. Neural correlates of quantitative rule selectivity have been identified previously in the prefrontal cortex (PFC). However, whether individual neurons represent rules applied to multiple magnitude types is unknown. We recorded from PFC neurons while monkeys switched between "greater than/less than" rules applied to spatial and numerical magnitudes. A majority of rule-selective neurons responded only to the quantitative rules applied to one specific magnitude type. However, another population of neurons generalized the magnitude principle and represented the quantitative rules related to both magnitudes. This indicates that the primate brain uses rule-selective neurons specialized in guiding decisions related to a specific magnitude type only, as well as generalizing neurons that respond abstractly to the overarching concept "magnitude rules."

The importance of integration and top-down salience when listening to complex multi-part musical stimuli

In listening to multi-part music, auditory streams can be attended to either selectively or globally. More specifically, musicians rely on prioritized integrative attention which incorporates both stream segregation and integration to assess the relationship between concurrent parts. In this fMRI study, we used a piano duet to investigate which factors of a leader-follower relationship between parts grab the listener's attention and influence the perception of multi-part music. The factors considered included the structural relationship between melody and accompaniment as well as the temporal relationship (asynchronies) between parts. The structural relationship was manipulated by cueing subjects to the part of the duet that had to be prioritized. The temporal relationship was investigated by synthetically shifting the onset times of melody and accompaniment to either a consistent melody or accompaniment lead. The relative importance of these relationship factors for segregation and integration as attentional mechanisms was of interest. Participants were required to listen to the cued part and then globally assess if the prioritized stream was leading or following compared to the second stream. Results show that the melody is judged as more leading when it is globally temporally ahead whereas the accompaniment is not judged as leading when it is ahead. This bias may be a result of the interaction of salience of both leader-follower relationship factors. Interestingly, the corresponding interaction effect in the fMRI-data yields an inverse bias for melody in a fronto-parietal attention network. Corresponding parameter estimates within the dlPFC and right IPS show higher neural activity for attending to melody when listening to a performance without a temporal leader, pointing to an interaction of salience of both factors in listening to music. Both frontal and parietal activation implicate segregation and integration mechanisms and a top-down influence of salience on attention and the perception of leader-follower relations in music.

Delay activity of saccade-related neurons in the caudal dentate nucleus of the macaque cerebellum

The caudal dentate nucleus (DN) in lateral cerebellum is connected with two visual/oculomotor areas of the cerebrum: the frontal eye field and lateral intraparietal cortex. Many neurons in frontal eye field and lateral intraparietal cortex produce "delay activity" between stimulus and response that correlates with processes such as motor planning. Our hypothesis was that caudal DN neurons would have prominent delay activity as well. From lesion studies, we predicted that this activity would be related to self-timing, i.e., the triggering of saccades based on the internal monitoring of time. We recorded from neurons in the caudal DN of monkeys (Macaca mulatta) that made delayed saccades with or without a self-timing requirement. Most (84%) of the caudal DN neurons had delay activity. These neurons conveyed at least three types of information. First, their activity was often correlated, trial by trial, with saccade initiation. Correlations were found more frequently in a task that required self-timing of saccades (53% of neurons) than in a task that did not (27% of neurons). Second, the delay activity was often tuned for saccade direction (in 65% of neurons). This tuning emerged continuously during a trial. Third, the time course of delay activity associated with self-timed saccades differed significantly from that associated with visually guided saccades (in 71% of neurons). A minority of neurons had sensory-related activity. None had presaccadic bursts, in contrast to DN neurons recorded more rostrally. We conclude that caudal DN neurons convey saccade-related delay activity that may contribute to the motor preparation of when and where to move.

Coding of abstract quantity by 'number neurons' of the primate brain

Humans share with nonhuman animals a quantification system for representing the number of items as nonverbal mental magnitudes. Over the past decade, the anatomical substrates and neuronal mechanisms of this quantification system have been unraveled down to the level of single neurons. Work with behaviorally trained nonhuman primates identified a parieto-frontal cortical network with individual neurons selectively tuned to the number of items. Such 'number neurons' can track items across space, time, and modality to encode numerosity in a most abstract, supramodal way. The physiological properties of these neurons can explain fundamental psychophysical phenomena during numerosity judgments. Functionally overlapping groups of parietal neurons represent not only numerable-discrete quantity (numerosity), but also innumerable-continuous quantity (extent) and relations between quantities (proportions), supporting the idea of a generalized magnitude system in the brain. These studies establish putative homologies between the monkey and human brain and demonstrate the suitability of nonhuman primates as model system to explore the neurobiological roots of the brain's nonverbal quantification system, which may constitute the evolutionary foundation of all further, more elaborate numerical skills in humans.

The food reaching test: a sensitive test of behavioral improvements by deep brain stimulation in MPTP-treated monkey

We modified an objective behavioral test, namely the food reaching test (FRT), for quantitative assessment of motor performance improved by deep brain stimulation (DBS) of the subthalamic nucleus (STN) in the Parkinsonian monkeys. The symptomatic features and their severity in 3 monkeys treated with 1-methyl-4-phenyl-1,2,3,6-tetrahydropyridine (MPTP) were evaluated with a subjective monkey Parkinson's disease rating scale (PDRS). We then performed STN-DBS with the minimum current intensity that stopped the tremor. The time required for the monkeys to pick up all 5 pieces of potato (FRT time) was measured as a major index to evaluate bradykinesia. The success rate was adopted as another index for assessing overall motor impairments. Although both FRT time and PDRS score were similarly improved by STN-DBS, change of FRT time appeared more sensitive than that of PDRS scores. FRT is an easily trained behavioral test with high objectivity and sensitivity that can be applied for assessing motor performance in MPTP-treated monkeys during experiments in a restrained condition such as functional imaging of the brain.

Modeling pharmacological clock and memory patterns of interval timing in a striatal beat-frequency model with realistic, noisy neurons

In most species, the capability of perceiving and using the passage of time in the seconds-to-minutes range (interval timing) is not only accurate but also scalar: errors in time estimation are linearly related to the estimated duration. The ubiquity of scalar timing extends over behavioral, lesion, and pharmacological manipulations. For example, in mammals, dopaminergic drugs induce an immediate, scalar change in the perceived time (clock pattern), whereas cholinergic drugs induce a gradual, scalar change in perceived time (memory pattern). How do these properties emerge from unreliable, noisy neurons firing in the milliseconds range? Neurobiological information relative to the brain circuits involved in interval timing provide support for an striatal beat frequency (SBF) model, in which time is coded by the coincidental activation of striatal spiny neurons by cortical neural oscillators. While biologically plausible, the impracticality of perfect oscillators, or their lack thereof, questions this mechanism in a brain with noisy neurons. We explored the computational mechanisms required for the clock and memory patterns in an SBF model with biophysically realistic and noisy Morris–Lecar neurons (SBF–ML). Under the assumption that dopaminergic drugs modulate the firing frequency of cortical oscillators, and that cholinergic drugs modulate the memory representation of the criterion time, we show that our SBF–ML model can reproduce the pharmacological clock and memory patterns observed in the literature. Numerical results also indicate that parameter variability (noise) – which is ubiquitous in the form of small fluctuations in the intrinsic frequencies of neural oscillators within and between trials, and in the errors in recording/retrieving stored information related to criterion time – seems to be critical for the time-scale invariance of the clock and memory patterns.

Learned timing of motor behavior in the smooth eye movement region of the frontal eye fields

Proper timing is a critical aspect of motor learning. We report a relationship between a representation of time and an expression of learned timing in neurons in the smooth eye movement region of the frontal eye fields (FEF(SEM)). During prelearning pursuit of target motion at a constant velocity, each FEF(SEM) neuron is most active at a distinct time relative to the onset of pursuit tracking. In response to an instructive change in target direction, a neuron expresses the most learning when the instruction occurs near the time of its maximal participation in prelearning pursuit. Different neurons are most active, and undergo the most learning, at distinct times during pursuit. We suggest that the representation of time in the FEF(SEM) drives learning that is temporally linked to an instructive change in target motion, and that this may be a general function of motor areas of the cortex.

Representations of visual proportions in the primate posterior parietal and prefrontal cortices

The primate prefrontal (PFC) and posterior parietal cortices (PPC) have been shown to be cardinal structures in processing abstract absolute magnitudes, such as numerosity or length. The neuronal representation of quantity relations, however, remained largely elusive. Recent functional imaging studies in humans showed that blood flow changes systematically both in the PFC and the PPC as a function of relational distance between proportions. We investigated the response properties of single neurons in the lateral PFC and the inferior parietal lobule (IPL, area 7) in rhesus monkeys performing a lengths-proportion-discrimination task. Neurons in both areas shared many characteristics and showed peaked tuning functions with preferred proportions. However, a significantly higher percentage of neurons coding proportions was found in the PFC compared with the IPL. In agreement with human studies, our study shows that proportions are represented in the fronto-parietal network that has already been implicated for absolute magnitude processing.

Do monkeys think in metaphors? Representations of space and time in monkeys and humans

Research on the relationship between the representation of space and time has produced two contrasting proposals. ATOM posits that space and time are represented via a common magnitude system, suggesting a symmetrical relationship between space and time. According to metaphor theory, however, representations of time depend on representations of space asymmetrically. Previous findings in humans have supported metaphor theory. Here, we investigate the relationship between time and space in a nonverbal species, by testing whether non-human primates show space-time interactions consistent with metaphor theory or with ATOM. We tested two rhesus monkeys and 16 adult humans in a nonverbal task that assessed the influence of an irrelevant dimension (time or space) on a relevant dimension (space or time). In humans, spatial extent had a large effect on time judgments whereas time had a small effect on spatial judgments. In monkeys, both spatial and temporal manipulations showed large bi-directional effects on judgments. In contrast to humans, spatial manipulations in monkeys did not produce a larger effect on temporal judgments than the reverse. Thus, consistent with previous findings, human adults showed asymmetrical space-time interactions that were predicted by metaphor theory. In contrast, monkeys showed patterns that were more consistent with ATOM.

Genetic determinants of time perception mediated by the serotonergic system

Background

The present study investigates neurobiological underpinnings of individual differences in time perception.

Methodology

Forty-four right-handed Russian Caucasian males (18–35 years old) participated in the experiment. The polymorphism of the genes related to the activity of serotonin (5-HT) and dopamine (DA)-systems (such as 5-HTT, 5HT2a, MAOA, DAT, DRD2, COMT) was determined upon the basis of DNA analysis according to a standard procedure. Time perception in the supra-second range (mean duration 4.8 s) was studied, using the duration discrimination task and parametric fitting of psychometric functions, resulting in individual determination of the point of subjective equality (PSE). Assuming the ‘dual klepsydra model’ of internal duration representation, the PSE values were transformed into equivalent values of the parameter (kappa), which is a measure of the ‘loss rate’ of the duration representation. An association between time representation parameters (PSE and , respectively) and 5-HT-related genes was found, but not with DA-related genes. Higher ‘loss rate’ () of the cumulative duration representation were found for the carriers of genotypes characterized by higher 5-HT transmission, i.e., 1) lower 5-HT reuptake, known for the 5-HTTLPR SS polymorphism compared with LL, 2) lower 5-HT degradation, described for the ‘low expression’ variant of MAOA VNTR gene compared with ‘high expression’ variant, and 3) higher 5-HT2a receptor density, proposed for the TT polymorphism of 5-HT2a T102C gene compared with CC.

Conclusion

Convergent findings of the present study and previous psychopharmacological studies suggest an action path from 5-HT-activity-related genes, via activity of 5-HT in the brain, to time perception. An involvement of the DA-system in the encoding of durations in the supra-second range is questioned.

Cortical activation during color discrimination task in macaques as revealed by positron emission tomography

Physiological and lesion studies have shown that the anterior inferior temporal (IT) cortex (aITC) is involved in the color vision of macaque monkeys. However, some functional imaging studies using awake monkeys contradicted the involvement of aITC in color vision. Thus, in most of the imaging studies, cortical activation has been observed during a fixation task. However, because the neuronal activity of aITC is highly affected by the behavioral task, it is desirable to investigate cortical activity during a color discrimination task to determine the functional role of aITC in the color vision of macaque monkeys. In this study, we investigated the cortical activity of aITC of macaque monkeys during color discrimination by positron emission tomography. Two monkeys were trained in a color discrimination task. Cortical areas involved in color processing were investigated by comparing activities during the color discrimination and lever release tasks. In addition to area V4 and the posterior IT cortex (pITC), we found color-related activities in the anterior IT gyrus. Consistent activation was observed in the region posterior to the anterior medial temporal sulcus (AMTS), although the exact location and the size of activations differed between monkeys and hemispheres. We also found color-related activities in the anterior portion of the superior temporal sulcus (STS), suggesting its involvement in the color vision. The present results revealed that aITC is involved in the color vision of macaque monkeys by a functional imaging technique.

Encoding of temporal probabilities in the human brain

Anticipating the timing of future events is a necessary precursor to preparing actions and allocating resources to sensory processing. This requires elapsed time to be represented in the brain and used to predict the temporal probability of upcoming events. While neuropsychological, imaging, magnetic stimulation studies, and single-unit recordings implicate the role of higher parietal and motor-related areas in temporal estimation, the role of earlier, purely sensory structures remains more controversial. Here we demonstrate that the temporal probability of expected visual events is encoded not by a single area but by a wide network that importantly includes neuronal populations at the very earliest cortical stages of visual processing. Moreover, we show that activity in those areas changes dynamically in a manner that closely accords with temporal expectations.

Carving the clock at its component joints: neural bases for interval timing

Models of time perception often describe an "internal clock" that involves at least two components: an accumulator and a comparator. We used functional magnetic resonance imaging to test the hypothesis that distinct distributed neural networks mediate these components of time perception. Subjects performed a temporal discrimination task that began with a visual stimulus (S1) that varied parametrically in duration of presentation. A varying interstimulus interval was followed by a second visual stimulus (S2). After the S2 offset, the subject indicated whether S2 was longer or shorter than S1. We reasoned that neural activity that correlated with S1 duration would represent accumulator networks. We also reasoned that neural activity that correlated with the difficulty of comparisons for each paired-judgment would represent comparator networks. Using anatomically defined regions of interest, we found duration of S1 significantly correlated with left inferior frontal, supplementary motor area (SMA) and superior temporal regions. Furthermore, task difficulty correlated with activity within bilateral inferior frontal gyri. Therefore accumulator and comparator functioning of the internal clock are mediated by distinct as well as partially overlapping neural regions.

Positron emission tomography analysis of the analgesic effects of acupuncture in rhesus monkeys

The purpose of this study was to examine whether pain-induced brain activation was suppressed by acupuncture analgesia. We investigated the suppression of the pain-induced neuronal activation in specific brain areas of three male rhesus monkeys (aged four years old) using positron emission tomography (PET), in which changes in the regional cerebral blood flow (rCBF) were examined as an index of the neuronal activation. The brain areas such as the thalamus, insula and anterior cingulate cortex were activated by heating the tail of monkeys in 47 degrees C water compared to the heating at 37 degrees C. Those activations were suppressed by electroacupuncture (EA) with a 2 sec alteration of the frequency of 4 Hz/60 Hz at the right ST36 (the upper anterior tibial muscle) and the right LI4 (the back palm between the first and second metacarpal) acupoints. Meanwhile, this EA analgesic effect was confirmed by prolonging the tail withdrawal latencies from hot water in the temperature range from 45 to 50 degrees C.These brain areas were corresponded to the pain-related areas as reported in previous studies. In conclusion, we were able to visualize the acupuncture analgesia in the CNS. We also detected the brain areas activated or inactivated by acupuncture. The areas that responded to acupuncture stimulation at 47 degrees C water were different from the regions at 37 degrees C. We consider that this difference in the response to acupuncture may support the variation of the clinical efficacy of acupuncture in patients bearing pain or other disorders.

Default mode of brain activity demonstrated by positron emission tomography imaging in awake monkeys: higher rest-related than working memory-related activity in medial cortical areas

Human neuroimaging studies have demonstrated the presence of a "default system" in the brain, which shows a "default mode of brain activity," i.e., greater activity during the resting state than during an attention-demanding cognitive task. The default system mainly involves the medial prefrontal and medial parietal areas, including the anterior and posterior cingulate cortex. It has been proposed that this default activity is concerned with internal thought processes. Recently, it has been indicated that chimpanzees show high metabolic levels in these medial brain areas during rest. Correlated low-frequency spontaneous activity as measured by functional magnetic resonance imaging was observed between the medial parietal and medial prefrontal areas in the anesthetized monkey. However, there have been few attempts to demonstrate a default system that shows task-induced deactivation in nonhuman primates. We conducted a positron emission tomography study with [(15)O]H(2)O to demonstrate a default mode of brain activity in the awake monkey sitting on a primate chair. Macaque monkeys showed higher level of regional blood flow in these medial brain areas as well as lateral and orbital prefrontal areas during rest compared with that under a working memory task, suggesting the existence of internal thought processes in the monkey. However, during rest in the monkey, the highest level of blood flow relative to that in other brain regions was observed not in the default system but in the dorsal striatum, suggesting that regions with the highest cerebral blood flow during rest may differ depending on the resting condition and/or species.

Inactivation of medial prefrontal cortex impairs time interval discrimination in rats

Several lines of evidence suggest the involvement of prefrontal cortex in time interval estimation. The underlying neural processes are poorly understood, however, in part because of the paucity of physiological studies. The goal of this study was to establish an interval timing task for physiological recordings in rats, and test the requirement of intact medial prefrontal cortex (mPFC) for performing the task. We established a temporal bisection procedure using six different time intervals ranging from 3018 to 4784 ms that needed to be discriminated as either long or short. Bilateral infusions of muscimol (GABA_A receptor agonist) into the mPFC significantly impaired animal's performance in this task, even when the animals were required to discriminate between only the longest and shortest time intervals. These results show the requirement of intact mPFC in rats for time interval discrimination in the range of a few seconds.

Neural representation of time in cortico-basal ganglia circuits

Encoding time is universally required for learning and structuring motor and cognitive actions, but how the brain keeps track of time is still not understood. We searched for time representations in cortico-basal ganglia circuits by recording from thousands of neurons in the prefrontal cortex and striatum of macaque monkeys performing a routine visuomotor task. We found that a subset of neurons exhibited time-stamp encoding strikingly similar to that required by models of reinforcement-based learning: They responded with spike activity peaks that were distributed at different time delays after single task events. Moreover, the temporal evolution of the population activity allowed robust decoding of task time by perceptron models. We suggest that time information can emerge as a byproduct of event coding in cortico-basal ganglia circuits and can serve as a critical infrastructure for behavioral learning and performance.