Stimulus-dependent processing of temporal order

Temporal integration characteristics of an image defined by binocular disparity cues

We can correctly recognize the content of an image by presenting all of the elements within a limited time, such as in a slit view or a divided painting image. It is important to clarify how temporally divided information is integrated and perceived to understand the temporal properties of the information-processing mechanism of visual systems. Previous studies related to this topic have often used two-dimensional pictorial stimuli; however, few have considered the temporal integration of binocular disparity for the recognition of objects defined with disparity. In this study, we examined image recognition properties based on the temporal integration of binocular disparity, by comparing that based on the temporal integration of luminance. The effect of element onset asynchrony (the time lag among presented elements) was somewhat similar between disparity and luminance with respect to randomly divided elements. On the other hand, under slit-vision conditions, the tolerance range of spatiotemporal integration for luminance stimuli was much wider than that for disparity stimuli. These results indicate that the temporal integration mechanism in localized areas is common to disparity and luminance, but that for global motion shows differences between the two mechanisms. Thus, we conclude that global motion has little contribution to the temporal integration of binocular disparity information for image recognition.

A common timing mechanism across different millisecond domains: evidence from perceptual and motor tasks

Temporal information processing (TIP) constitutes a complex construct that underlies many cognitive functions and operates in a few hierarchically ordered time domains. This study aimed to verify the relationship between the tens of milliseconds and hundreds of milliseconds domains, referring to perceptual and motor timing, respectively. Sixty four young healthy individuals participated in this study. They underwent two auditory temporal order judgement tasks to assess their performance in the tens of milliseconds domain; on this basis, groups of high-level performers (HLP) and low-level performers (LLP) were identified. Then, a maximum tapping task was used to evaluate performance in the hundreds of milliseconds domain. The most remarkable result was that HLP achieved a faster tapping rate and synchronised quicker with their "internal clock" during the tapping task than did LLP. This result shows that there is a relationship between accuracy in judging temporally asynchronous stimuli and ability to achieve and maintain the pace of a movement adequate to one's internal pacemaker. This could indicate the strong contribution of a common timing mechanism, responsible for temporal organisation and coordination of behaviours across different millisecond domains.

Holistic temporal order judgment of tones requires top-down disentanglement

How temporal sequence gets organized is a central topic in cognitive processing. In a high-frequency time window of tens of milliseconds, the temporal order is reconstructed rather than mirroring the sequence of events objectively in physical time. Two separate phases or strategies, a holistic coding phase that groups successively presented events as a gestalt and a disentanglement phase that decodes the temporal order of discrete events from the gestalt representation, may presumably be involved in the perception of temporal order across different modalities. With a temporal order adaptation protocol of pure tones using glide adaptors, the present study demonstrated a dissociation between constant discriminability and shifted subjective simultaneity across different adaptor directions. While discriminability of temporal order was not adapted by glides, revealing a constant coding sensitivity of different asynchronies, the shift of subjective simultaneity indicated the recalibration of a top-down disentanglement of the holistic processing under the influence of glide adaptors. The results suggest a dual-phase holistic processing in temporal order perception, supporting two separate cognitive strategies for event timing on the sub-second level.

Insights into the perceptual moment theory: Experimental evidence from simultaneity judgment

The perception appears to flow in a continuous pattern but evidence suggest that perception may involve discrete temporal sampling of peripheral cues. Stroud's perceptual moment theory proposes that perception occurs in discrete moments; however, more experimental evidence is required to support this theory. The present study characterized the decision function for asynchrony detection using variable stimulus-onset asynchronies (SOAs). Fourteen healthy volunteers (twelve males and two females), ages 21.5 ± 3.8 years (mean ± SD) participated in the study. A microcontroller was used to randomly present 280 events of paired stimuli (two red LEDs) with varying SOAs from -65 to 65 ms in steps of 5 ms. Participants were asked to press the "L" or "R" response key based on whether the left or right LED lit up first and to press the "S" key if they could not perceive the order. Asynchrony detection does not exhibit a fixed threshold value; instead, its decision function shows a monotonic increase with increasing SOAs. The asynchrony detection was 50% at an SOA of 27.8 ± 1.7 ms (mean ± SE). The curve plateaued off near 100% at SOA of 57.2 ms, which may correspond to the duration of one perceptual moment for visual perception. Data from a separate group of ten volunteers was used to validate the results. Results indicate that perception is temporally discretized rather than continuous, and the estimated duration of one perceptual moment is around 57.2 ms. This simple experiment gives objective evidence for Stroud's perceptual moment theory.

Time marking in perception

Several authors have proposed that perceptual information carries labels that identify temporal features, including time of occurrence, ordinal temporal relations, and brief durations. These labels serve to locate and organise perceptual objects, features, and events in time. In some proposals time marking has local, specific functions such as synchronisation of different features in perceptual processing. In other proposals time marking has general significance and is responsible for rendering perceptual experience temporally coherent, just as various forms of spatial information render the visual environment spatially coherent. These proposals, which all concern time marking on the millisecond time scale, are reviewed. It is concluded that time marking is vital to the construction of a multisensory perceptual world in which things are orderly with respect to both space and time, but that much more research is needed to ascertain its functions in perception and its neurophysiological foundations.

Resting-state fMRI functional connectivity of the left temporal parietal junction is associated with visual temporal order threshold

The study aimed to determine the relationship between the millisecond timing, measured by visual temporal order threshold (TOT), i.e. a minimum gap between two successive stimuli necessary to judge a before-after relation, and resting-state fMRI functional connectivity (rsFC). We assume that the TOT reflects a relatively stable feature of local internal state networks and is associated with rsFC of the temporal parietal junction (TPJ). Sixty five healthy young adults underwent the visual TOT, fluid intelligence (G_f) and an eyes-open resting-state fMRI examination. After controlling for the influence of gender, the higher the TOT, the stronger was the left TPJ’s rsFC with the left postcentral and the right precentral gyri, bilateral putamen and the right supplementary motor area. When the effects of G_f and TOT × G_f interaction were additionally controlled, the TOT—left TPJ’s rsFC relationship survived for almost all above regions with the exception of the left and right putamen. This is the first study demonstrating that visual TOT is associated with rsFC between the areas involved both in sub-second timing and motor control. Current outcomes indicate that the local neural networks are prepared to process brief, rapidly presented, consecutive events, even in the absence of such stimulation.

The Effects of Psychophysical Methods on Spectral and Spatial TOJ Thresholds

(1) Background: A large number of studies have used different psychophysical methods for measuring temporal order judgment (TOJ) thresholds, which makes it difficult to compare the results of different studies. In this study, we aimed to compare the thresholds measured by the two main procedures used in many studies, the adaptive procedure, and the method of constant stimuli; (2) Methods: Study 1 tested spatial TOJ and included 109 participants, 50 using the adaptive procedure and 59 using the constant stimuli procedure. Study 2 tested spectral TOJ and included 223 participants, 119 using the adaptive procedure and 104 using constant stimuli; (3) Results: Both the spatial and spectral TOJ results showed no difference between the psychophysical methods, either in (1) the form of the distribution; (2) the mean; or (3) the standard deviation. However, Bayesian analysis showed a large Bayes factor only for spatial TOJ; (4) Conclusions: There is no difference between spatial TOJ thresholds measured by an adaptive procedure and the method of constant stimuli, and their results can be compared across studies. A similar conclusion can be drawn also for spectral TOJ, but should be considered more cautiously.

The role of tone duration in dichotic temporal order judgment II: Extending the boundaries of duration and age

Temporal order judgment (TOJ) measures the ability to correctly perceive the order of consecutive stimuli presented rapidly. Our previous research suggested that the major predictor of auditory dichotic TOJ threshold, a paradigm that requires the identification of the order of two tones, each of which is presented to a different ear, is the time separating the onset of the first tone from the onset of the second tone (stimulus-onset-asynchrony, SOA). Data supporting this finding, however, was based on a young adult population and a tone duration range of 10–40 msec. The current study aimed to evaluate the generalizability of the earlier finding by manipulating the experimental model in two different ways: a) extending the tone duration range to include shorter stimulus durations (3–8 msec; Experiment 1) and b) repeating the identical testing procedure on a different population with temporal processing deficits, i.e., older adults (Experiment 2). We hypothesized that the SOA would predict the TOJ threshold regardless of tone duration and participant age. Experiment 1 included 226 young adults divided into eight groups (each group receiving a different tone duration) with duration ranging from 3–40 msec. Experiment 2 included 98 participants aged 60–75 years, divided into five groups by tone duration (10–40 msec). The results of both experiments confirmed the hypothesis, that the SOA required for performing dichotic TOJ was constant regardless of stimulus duration, for both age groups: about 66.5 msec for the young adults and 33 msec longer (100 msec) for the older adults. This finding suggests that dichotic TOJ threshold is controlled by a general mechanism that changes quantitatively with age. Clinically, this has significance because quantitative changes can be more easily remedied than qualitative changes. Theoretically, our findings show that, with dichotic TOJ, tone duration affects threshold by providing more time between the onsets of the consecutive stimuli to the two ears. The findings also imply that a temporal processing deficit, at least among older adults, does not elicit the use of a different mechanism in order to judge temporal order.

Sub- and Supra-Second Timing in Auditory Perception: Evidence for Cross-Domain Relationships

Previous studies indicate that there are at least two levels of temporal processing: the sub- and supra-second domains. The relationship between these domains remains unclear. The aim of this study was to test whether performance on the sub-second level is related to that on the supra-second one, or whether these two domains operate independently. Participants were 118 healthy adults (mean age = 23 years). The sub-second level was studied with a temporal-order judgment task and indexed by the Temporal Order Threshold (TOT), on which lower values corresponded to better performance. On the basis of TOT results, the initial sample was classified into two groups characterized by either higher temporal efficiency (HTE) or lower temporal efficiency (LTE). Next, the efficiency of performance on the supra-second level was studied in these two groups using the subjective accentuation task, in which participants listened to monotonous sequences of beats and were asked to mentally accentuate every n-th beat to create individual rhythmic patterns. The extent of temporal integration was assessed on the basis of the number of beats being united and better performance corresponded to longer units. The novel results are differences between groups in this temporal integration. The HTE group integrated beats in significantly longer units than did the LTE group. Moreover, for tasks with higher mental load, the HTE group relied more on a constant time strategy, whereas the LTE group relied more on mental counting, probably because of less efficient temporal integration. These findings provide insight into associations between sub- and supra-second levels of processing and point to a common time keeping system, which is active independently of temporal domain.

The extended present: an informational context for perception

Several previous authors have proposed a kind of specious or subjective present moment that covers a few seconds of recent information. This article proposes a new hypothesis about the subjective present, renamed the extended present, defined not in terms of time covered but as a thematically connected information structure held in working memory and in transiently accessible form in long-term memory. The three key features of the extended present are that information in it is thematically connected, both internally and to current attended perceptual input, it is organised in a hierarchical structure, and all information in it is marked with temporal information, specifically ordinal and duration information. Temporal boundaries to the information structure are determined by hierarchical structure processing and by limits on processing and storage capacity. Supporting evidence for the importance of hierarchical structure analysis is found in the domains of music perception, speech and language processing, perception and production of goal-directed action, and exact arithmetical calculation. Temporal information marking is also discussed and a possible mechanism for representing ordinal and duration information on the time scale of the extended present is proposed. It is hypothesised that the extended present functions primarily as an informational context for making sense of current perceptual input, and as an enabler for perception and generation of complex structures and operations in language, action, music, exact calculation, and other domains.

Evidence for visual temporal order processing below the threshold for conscious perception

Correctly discriminating the order of events arising in our environment is a fundamental temporal process that allows us to better understand and interact with our dynamic world. However, if consecutive events are separated by an interval of less than 20-40 ms, we cannot consciously perceive their relative order. Nevertheless, indirect evidence suggests that the sequential order of events separated by less than 20 ms might still be processed subconsciously. In our study, we aimed to provide evidence that temporal order processing can occur below the threshold for conscious perception. We developed a novel paradigm in which participants were instructed that a visual cue, composed of two coloured stimuli appearing in a particular order, would allow them to predict the shape of a subsequent target. The interval between the two stimuli allowed temporal order to be consciously perceived (66 ms interval) or not (17 ms interval), as verified by performance on a separate temporal order judgment task. Performance was compared to a control condition that provided no predictive information. In both experiments, reaction times were faster in the order-cue conditions compared to the control condition, whether the SOA separating events was longer (66 ms) or shorter (17 ms) than the typical temporal order threshold. Therefore, even when participants could not consciously perceive the temporal order of two consecutive stimuli, the relative sequence of events was nevertheless processed and used to optimise performance. These results suggest that temporal order can be processed subconsciously.

Event timing in human vision: Modulating factors and independent functions

Essential for successful interaction with the environment is the human capacity to resolve events in time. Typical event timing paradigms are judgements of simultaneity (SJ) and of temporal order (TOJ). It remains unclear whether SJ and TOJ are based on the same underlying mechanism and whether there are fixed thresholds for resolution. The current study employed four visual event timing task versions: horizontal and vertical SJ and TOJ. Binary responses were analysed using multilevel binary regression modelling. Modulatory effects of potential explanatory variables on event timing perception were investigated: (1) Individual factors (sex and age), (2) temporal factors (SOA, trial number, order of experiment, order of stimuli orientation, time of day) and (3) spatial factors (left or right stimulus first, top or bottom stimulus first, horizontal vs. vertical orientation). The current study directly compares for the first time, performance on SJ and TOJ tasks using the same paradigm and presents evidence that a variety of factors and their interactions selectively modulate event timing functions in humans, explaining the variance found in previous studies. We conclude that SJ and TOJ are partially independent functions, because they are modulated differently by individual and contextual variables.

The perceived present: What is it, and what is it there for?

It is proposed that the perceived present is not a moment in time, but an information structure comprising an integrated set of products of perceptual processing. All information in the perceived present carries an informational time marker identifying it as "present". This marker is exclusive to information in the perceived present. There are other kinds of time markers, such as ordinality ("this stimulus occurred before that one") and duration ("this stimulus lasted for 50 ms"). These are different from the "present" time marker and may be attached to information regardless of whether it is in the perceived present or not. It is proposed that the perceived present is a very short-term and very high-capacity holding area for perceptual information. The maximum holding time for any given piece of information is ~100 ms: This is affected by the need to balance the value of informational persistence for further processing against the problem of obsolescence of the information. The main function of the perceived present is to facilitate access by other specialized, automatic processes.

Spatial and Spectral Auditory Temporal-Order Judgment (TOJ) Tasks in Elderly People Are Performed Using Different Perceptual Strategies

The Temporal-Order Judgment (TOJ) paradigm has been widely investigated in previous studies as an accurate measure of temporal resolution and sequencing abilities in the millisecond time range. Two auditory TOJ tasks are often used: (1) a spatial TOJ task, in which two identical stimuli are presented in rapid succession monaurally and the task is to indicate which ear received the first stimulus and which ear received the second one (left-right or right-left), and (2) a spectral TOJ task, in which two tones of different frequencies are presented asynchronously to both ears binaurally and the task is to report the sequence of these tones (low-high or high-low). The previous literature studies conducted on young volunteers indicated that the measured temporal acuity on these two tasks depended on the procedure used. As considerable data are now available about age-related decline in temporal resolution ability, the aim of the present study was to compare in elderly subjects the pattern of performance on these two tasks. A total of 40 normal healthy volunteers aged from 62 to 78 years performed two TOJ tasks. The measurement was repeated in two consecutive sessions. Temporal resolution was indexed by the Auditory Temporal-Order Threshold (ATOT), i.e., the minimum time gap between successive stimuli necessary for a participant to report a before-after relation with 75% correctness. The main finding of the present study was the indication of differences in the elderly in performance on two tasks. In the spatial task, the distribution of obtained ATOT values did not deviate from the Gaussian distribution. In contrast, the distribution of data in the spectral task deviated significantly from the Gaussian and was spread more to the right. Although lower ATOT values were usually observed in Session 2 than in Session 1, such difference was significant only in the spectral task. We conclude that although temporal acuity and sequencing abilities in the millisecond time range are probably based in neuronal oscillatory activity, the measured ATOTs in the elderly seem to be stimulus-dependent, procedure-related, and influenced by the perceptual strategies used by participants.

Motor Reproduction of Time Interval Depends on Internal Temporal Cues in the Brain: Sensorimotor Imagery in Rhythm

How the human brain perceives time intervals is a fascinating topic that has been explored in many fields of study. This study examined how time intervals are replicated in three conditions: with no internalized cue (PT), with an internalized cue without a beat (AS), and with an internalized cue with a beat (RS). In PT, participants accurately reproduced the time intervals up to approximately 3 s. Over 3 s, however, the reproduction errors became increasingly negative. In RS, longer presentations of over 5.6 s and 13 beats induced accurate time intervals in reproductions. This suggests longer exposure to beat presentation leads to stable internalization and efficiency in the sensorimotor processing of perception and reproduction. In AS, up to approximately 3 s, the results were similar to those of RS whereas over 3 s, the results shifted and became similar to those of PT. The time intervals between the first two stimuli indicate that the strategies of time-interval reproduction in AS may shift from RS to PT. Neural basis underlying the reproduction of time intervals without a beat may depend on length of time interval between adjacent stimuli in sequences.

Auditory temporal processing, reading, and phonological awareness among aging adults

Auditory temporal processing (ATP) has been related in the literature to both speech perception as well as reading and phonological awareness. In aging adults, it is known to be related to difficulties in speech perception. In the present study, we aimed to test whether an age-related deficit in ATP would also be accompanied by poor reading and phonological awareness. Thirty-eight aging adults were compared to 55 readers with dyslexia and 42 young normal readers on temporal order judgment (TOJ), speech perception, reading, and phonological awareness tests. Aging adults had longer TOJ thresholds than young normal readers, but shorter than readers with dyslexia; however, they had lower speech perception accuracy than both groups. Phonological awareness of the aging adults was better than readers with dyslexia, but poorer than young normal readers, although their reading accuracy was similar to that of the young controls. This is the first report on poor phonological awareness among aging adults. Suprisingly, it was not accompanied by difficulties in reading ability, and might instead be related to aging adults' difficulties in speech perception. This newly discovered relationship between ATP and phonological awareness among aging adults appears to extend the existing understanding of this relationship, and suggests it should be explored in other groups with ATP deficits.

Is conscious perception a series of discrete temporal frames?

This paper reviews proposals that conscious perception consists, in whole or part, of successive discrete temporal frames on the sub-second time scale, each frame containing information registered as simultaneous or static. Although the idea of discrete frames in conscious perception cannot be regarded as falsified, there are many problems. Evidence does not consistently support any proposed duration or range of durations for frames. EEG waveforms provide evidence of periodicity in brain activity, but not necessarily in conscious perception. Temporal properties of perceptual processes are flexible in response to competing processing demands, which is hard to reconcile with the relative inflexibility of regular frames. There are also problems concerning the definition of frames, the need for informational connections between frames, the means by which boundaries between frames are established, and the apparent requirement for a storage buffer for information awaiting entry to the next frame.

How neuroscience can inform the study of individual differences in cognitive abilities

Theories of human mental abilities should be consistent with what is known in neuroscience. Currently, tests of human mental abilities are modeled by cognitive constructs such as attention, working memory, and speed of information processing. These constructs are in turn related to a single general ability. However, brains are very complex systems and whether most of the variability between the operations of different brains can be ascribed to a single factor is questionable. Research in neuroscience suggests that psychological processes such as perception, attention, decision, and executive control are emergent properties of interacting distributed networks. The modules that make up these networks use similar computational processes that involve multiple forms of neural plasticity, each having different time constants. Accordingly, these networks might best be characterized in terms of the information they process rather than in terms of abstract psychological processes such as working memory and executive control.

Multisensory integration and ADHD-like traits: Evidence for an abnormal temporal integration window in ADHD

Abnormalities in multimodal processing have been found in many developmental disorders such as autism and dyslexia. However, surprisingly little empirical work has been conducted to test the integrity of multisensory integration in Attention Deficit Hyperactivity Disorder (ADHD). The main aim of the present study was to examine links between symptoms of ADHD (as measured using a self-report scale in a healthy adult population) and the temporal aspects of multisensory processing. More specifically, a Simultaneity Judgement (SJ) and a Temporal Order Judgement (TOJ) task were used in participants with low and high levels of ADHD-like traits to measure the temporal integration window and Just-Noticeable Difference (JND) (respectively) between the timing of an auditory beep and a visual pattern presented over a broad range of stimulus onset asynchronies. The Point of Subjective Similarity (PSS) was also measured in both cases. In the SJ task, participants with high levels of ADHD-like traits considered significantly fewer stimuli to be simultaneous than participants with high levels of ADHD-like traits, and the former were found to have significantly smaller temporal windows of integration (although no difference was found in the PSS in the SJ or TOJ tasks, or the JND in the latter). This is the first study to identify an abnormal temporal integration window in individuals with ADHD-like traits. Perceived temporal misalignment of two or more modalities can lead to distractibility (e.g., when the stimulus components from different modalities occur separated by too large of a temporal gap). Hence, an abnormality in the perception of simultaneity could lead to the increased distractibility seen in ADHD.

The effect of stimulus frequency, spectrum, duration, and location on temporal order judgment thresholds: distribution analysis

The present study aimed to examine whether the judgments of temporal order are made by the same "central processor" regardless of the characteristics of the sound stimuli. The influence of stimulus parameters (e.g., frequency, spectrum, duration, location) on auditory temporal order judgment (TOJ) thresholds was tested in seven groups with a total of 192 participants received two-tone sequences of different: frequencies (3 groups); spectrum widths, via a pure tone and a Gaussian noise burst (1 group); durations (2 groups); or locations, via asynchronous presentation to each ear (1 group). No difference in the mean rankings of TOJ thresholds was found for frequency, spectrum, and location parameters. TOJ thresholds for the duration condition, however, were significantly longer than for any of the other conditions. Notably, the threshold distributions for all the parameters (frequency, spectrum, duration, location) differed in shape. These findings raise the question as to whether we can rely upon the mean or median threshold as truly representative of TOJ threshold data. Furthermore, the data suggest that temporal order judgments for the different stimulus parameters are processed differently. The differences observed when analyzing the data with central tendency measures, as compared to analyzing the threshold distributions, may explain some of the mixed results reported in the literature on the mechanisms involved in temporal processing of different parameters. Stimulus parameters influence TOJ threshold distributions and response patterns, and may provide additional cues, beyond the standard temporal cue inherent in the TOJ procedure, by which participants may judge the order of the stimuli.

The Effect of Attention-Deficit/Hyperactivity Disorder and Methylphenidate Treatment on the Adult Auditory Temporal Order Judgment Threshold

PURPOSE

The Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition notes that attention-deficit/hyperactivity disorder (ADHD) diagnosed in childhood will persist into adulthood among at least some individuals. There is a paucity of evidence, however, regarding whether other difficulties that often accompany childhood ADHD will also continue into adulthood, specifically auditory processing deficits. The aim of this study was to examine the effect of ADHD and the stimulant medication methylphenidate on auditory perception performance among adults.

METHOD

A total of 33 adults diagnosed with ADHD according to Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition criteria (ADHD group) and 48 adults without ADHD (non-ADHD group) performed an auditory temporal order judgment task. Participants with ADHD performed the task twice: with and without taking methylphenidate (Ritalin), in random order.

RESULTS

Temporal order judgment thresholds of the ADHD group were significantly higher than those of the non-ADHD group. Methylphenidate significantly decreased temporal order judgment thresholds within the ADHD group, making their performance similar to the non-ADHD participants.

CONCLUSIONS

Auditory processing difficulties of those diagnosed with ADHD seem to persist into adulthood. Similar to findings with children, methylphenidate treatment improves performance on tasks requiring this ability among adults. Therefore, given the association between auditory temporal processing and linguistic skills, the beneficial effect of methylphenidate on adults' academic achievement may be accomplished by positively affecting auditory temporal processing. Further studies in this line of research are needed.

What Happens in a Moment

There has been evidence for the very brief, temporal quantization of perceptual experience at regular intervals below 100 ms for several decades. We briefly describe how earlier studies led to the concept of "psychological moment" of between 50 and 60 ms duration. According to historical theories, within the psychological moment all events would be processed as co-temporal. More recently, a link with physiological mechanisms has been proposed, according to which the 50-60 ms psychological moment would be defined by the upper limit required by neural mechanisms to synchronize and thereby represent a snapshot of current perceptual event structure. However, our own experimental developments also identify a more fine-scaled, serialized process structure within the psychological moment. Our data suggests that not all events are processed as co-temporal within the psychological moment and instead, some are processed successively. This evidence questions the analog relationship between synchronized process and simultaneous experience and opens debate on the ontology and function of "moments" in psychological experience.

Temporal structure of consciousness and minimal self in schizophrenia

The concept of the minimal self refers to the consciousness of oneself as an immediate subject of experience. According to recent studies, disturbances of the minimal self may be a core feature of schizophrenia. They are emphasized in classical psychiatry literature and in phenomenological work. Impaired minimal self-experience may be defined as a distortion of one’s first-person experiential perspective as, for example, an “altered presence” during which the sense of the experienced self (“mineness”) is subtly affected, or “altered sense of demarcation,” i.e., a difficulty discriminating the self from the non-self. Little is known, however, about the cognitive basis of these disturbances. In fact, recent work indicates that disorders of the self are not correlated with cognitive impairments commonly found in schizophrenia such as working-memory and attention disorders. In addition, a major difficulty with exploring the minimal self experimentally lies in its definition as being non-self-reflexive, and distinct from the verbalized, explicit awareness of an “I.” In this paper, we shall discuss the possibility that disturbances of the minimal self observed in patients with schizophrenia are related to alterations in time processing. We shall review the literature on schizophrenia and time processing that lends support to this possibility. In particular we shall discuss the involvement of temporal integration windows on different time scales (implicit time processing) as well as duration perception disturbances (explicit time processing) in disorders of the minimal self. We argue that a better understanding of the relationship between time and the minimal self as well of issues of embodiment require research that looks more specifically at implicit time processing. Some methodological issues will be discussed.

Temporal order perception of auditory stimuli is selectively modified by tonal and non-tonal language environments

The close relationship between temporal perception and speech processing is well established. The present study focused on the specific question whether the speech environment could influence temporal order perception in subjects whose language backgrounds are distinctively different, i.e., Chinese (tonal language) vs. Polish (non-tonal language). Temporal order thresholds were measured for both monaurally presented clicks and binaurally presented tone pairs. Whereas the click experiment showed similar order thresholds for the two language groups, the experiment with tone pairs resulted in different observations: while Chinese demonstrated better performance in discriminating the temporal order of two "close frequency" tone pairs (600 Hz and 1200 Hz), Polish subjects showed a reversed pattern, i.e., better performance for "distant frequency" tone pairs (400 Hz and 3000 Hz). These results indicate on the one hand a common temporal mechanism for perceiving the order of two monaurally presented stimuli, and on the other hand neuronal plasticity for perceiving the order of frequency-related auditory stimuli. We conclude that the auditory brain is modified with respect to temporal processing by long-term exposure to a tonal or a non-tonal language. As a consequence of such an exposure different cognitive modes of operation (analytic vs. holistic) are selected: the analytic mode is adopted for "distant frequency" tone pairs in Chinese and for "close frequency" tone pairs in Polish subjects, whereas the holistic mode is selected for "close frequency" tone pairs in Chinese and for "distant frequency" tone pairs in Polish subjects, reflecting a double dissociation of function.

Different Response Patterns Between Auditory Spectral and Spatial Temporal Order Judgment (TOJ)

Temporal order judgment (TOJ) thresholds have been widely reported as valid estimates of the temporal disparity necessary for correctly identifying the order of two stimuli. Data for two auditory TOJ paradigms are often reported in the literature: (1) spatially-based TOJ in which the order of presentation of the same stimulus to the right and left ear differs; and (2) spectrally-based TOJ in which the order of two stimuli differing in frequency is presented to one ear or to both ears simultaneously. Since the thresholds reported using the two paradigms differ, the aim of the current study was to compare their response patterns. The results from three different experiments showed that: (1) while almost none of the participants were able to perform the spatial TOJ task when ISI = 5 ms, with the spectral task, 50% reached an accuracy level of 75% when ISI = 5 ms; (2) temporal separation was only a partial predictor for performance in the spectral task, while it fully predicted performance in the spatial task; and (3) training improved performance markedly in the spectral TOJ task, but had no effect on spatial TOJ. These results suggest that the two paradigms may reflect different perceptual mechanisms.

Moments in time

It has been suggested that perception and action can be understood as evolving in temporal epochs or sequential processing units. Successive events are fused into units forming a unitary experience or "psychological present." Studies have identified several temporal integration levels on different time scales which are fundamental for our understanding of behavior and subjective experience. In recent literature concerning the philosophy and neuroscience of consciousness these separate temporal processing levels are not always precisely distinguished. Therefore, empirical evidence from psychophysics and neuropsychology on these distinct temporal processing levels is presented and discussed within philosophical conceptualizations of time experience. On an elementary level, one can identify a functional moment, a basic temporal building block of perception in the range of milliseconds that defines simultaneity and succession. Below a certain threshold temporal order is not perceived, individual events are processed as co-temporal. On a second level, an experienced moment, which is based on temporal integration of up to a few seconds, has been reported in many qualitatively different experiments in perception and action. It has been suggested that this segmental processing mechanism creates temporal windows that provide a logistical basis for conscious representation and the experience of nowness. On a third level of integration, continuity of experience is enabled by working memory in the range of multiple seconds allowing the maintenance of cognitive operations and emotional feelings, leading to mental presence, a temporal window of an individual's experienced presence.

Audiotactile interactions in temporal perception

In the present review, we focus on how commonalities in the ontogenetic development of the auditory and tactile sensory systems may inform the interplay between these signals in the temporal domain. In particular, we describe the results of behavioral studies that have investigated temporal resolution (in temporal order, synchrony/asynchrony, and simultaneity judgment tasks), as well as temporal numerosity perception, and similarities in the perception of frequency across touch and hearing. The evidence reviewed here highlights features of audiotactile temporal perception that are distinctive from those seen for other pairings of sensory modalities. For instance, audiotactile interactions are characterized in certain tasks (e.g., temporal numerosity judgments) by a more balanced reciprocal influence than are other modality pairings. Moreover, relative spatial position plays a different role in the temporal order and temporal recalibration processes for audiotactile stimulus pairings than for other modality pairings. The effect exerted by both the spatial arrangement of stimuli and attention on temporal order judgments is described. Moreover, a number of audiotactile interactions occurring during sensory-motor synchronization are highlighted. We also look at the audiotactile perception of rhythm and how it may be affected by musical training. The differences emerging from this body of research highlight the need for more extensive investigation into audiotactile temporal interactions. We conclude with a brief overview of some of the key issues deserving of further research in this area.

Changes in fMRI BOLD response to increasing and decreasing task difficulty during auditory perception of temporal order

We have discovered changes in brain activation during difficult and easy milliseconds timing. Structures engaged in difficult and easier auditory temporal-order judgment were identified in 17 young healthy listeners presented with paired-white-noises of different durations. Within each pair, a short (10 ms) and a long (50 ms) noise was separated by a silent gap of 10, 60 or 160 ms, corresponding to three levels of task difficulty, i.e. difficult, moderate and easy conditions, respectively. A block design paradigm was applied. In temporal-order judgment task subjects were required to define the order of noises within each pair, i.e. short-long or long-short. In the control task they only detected the presentation of the stimulus pair. A multiple regression with 'task difficulty' as a regressor ('difficult', 'moderate', 'easy') showed dynamic changes in neural activity. Increasing activations accompanying increased task difficulty were found in both bilateral inferior parietal lobuli and inferior frontal gyri, thus, in classic regions related to attentional and working memory processes. Conversely, decreased task difficulty was accompanied by increasing involvement of more specific timing areas, namely bilateral medial frontal gyri and left cerebellum. These findings strongly suggest engagement of different neural networks in difficult or easier timing and indicate a framework for understanding timing representation in the brain.

Functional neuroimaging of duration discrimination on two different time scales

Analyses of neural mechanisms of duration processing are essential for the understanding of psychological phenomena which evolve in time. Different mechanisms are presumably responsible for the processing of shorter (below 500 ms) and longer (above 500 ms) events but have not yet been a subject of an investigation with functional magnetic resonance imaging (fMRI). In the present study, we show a greater involvement of several brain regions - including right-hemispheric midline structures and left-hemispheric lateral regions - in the processing of visual stimuli of shorter as compared to longer duration. We propose a greater involvement of lower-level cognitive mechanisms in the processing of shorter events as opposed to higher-level mechanisms of cognitive control involved in longer events.

Minding time in an amodal representational space

How long did it take you to read this sentence? Chances are your response is a ball park estimate and its value depends on how fast you have scanned the text, how prepared you have been for this question, perhaps your mood or how much attention you have paid to these words. Time perception is here addressed in three sections. The first section summarizes theoretical difficulties in time perception research, specifically those pertaining to the representation of time and temporal processing. The second section reviews non-exhaustively temporal effects in multisensory perception. Sensory modalities interact in temporal judgement tasks, suggesting that (i) at some level of sensory analysis, the temporal properties across senses can be integrated in building a time percept and (ii) the representational format across senses is compatible for establishing such a percept. In the last section, a two-step analysis of temporal properties is sketched out. In the first step, it is proposed that temporal properties are automatically encoded at early stages of sensory analysis, thus providing the raw material for the building of a time percept; in the second step, time representations become available to perception through attentional gating of the raw temporal representations and via re-encoding into abstract representations.

Pre-semantically defined temporal windows for cognitive processing

Neuronal oscillations of different frequencies are hypothesized to be basic for temporal perception; this theoretical concept provides the frame to discuss two temporal mechanisms that are thought to be essential for cognitive processing. One such mechanism operates with periods of oscillations in the range of some tens of milliseconds, and is used for complexity reduction of temporally and spatially distributed neuronal activities. Experimental evidence comes from studies on temporal-order threshold, choice reaction time, single-cell activities, evoked responses in neuronal populations or latency distributions of oculomotor responses. The other mechanism refers to pre-semantic integration in the temporal range of approximately 2-3 s. Experimental evidence comes from studies on temporal reproduction, sensorimotor synchronization, intentional movements, speech segmentation, the shift rate of ambiguous stimuli in the visual or auditory modality or the temporal modulation of the mismatch negativity. These different observations indicate the existence of a universal process of temporal integration underlying the mental machinery. This process is believed to be basic for maintenance and change of perceptual identity. Owing to the omnipresence of this kind of temporal segmentation, it is suggested to use this process for a pragmatic definition of the states of being conscious or the 'subjective presence'.

The inner experience of time

The striking diversity of psychological and neurophysiological models of 'time perception' characterizes the debate on how and where in the brain time is processed. In this review, the most prominent models of time perception will be critically discussed. Some of the variation across the proposed models will be explained, namely (i) different processes and regions of the brain are involved depending on the length of the processed time interval, and (ii) different cognitive processes may be involved that are not necessarily part of a core timekeeping system but, nevertheless, influence the experience of time. These cognitive processes are distributed over the brain and are difficult to discern from timing mechanisms. Recent developments in the research on emotional influences on time perception, which succeed decades of studies on the cognition of temporal processing, will be highlighted. Empirical findings on the relationship between affect and time, together with recent conceptualizations of self- and body processes, are integrated by viewing time perception as entailing emotional and interoceptive (within the body) states. To date, specific neurophysiological mechanisms that would account for the representation of human time have not been identified. It will be argued that neural processes in the insular cortex that are related to body signals and feeling states might constitute such a neurophysiological mechanism for the encoding of duration.

Individual differences in the perception of temporal order: the effect of age and cognition

Temporal-order judgements in the time range of some milliseconds were assessed by using two auditory tasks in 86 participants, aged from 20 to 69 years. Two stimulus presentation modes, binaural versus monaural, were compared. Elderly participants performed worse than the younger participants; however, different patterns of age-related declines were observed, depending on the presentation mode. In the monaural mode considerable deterioration was observed beyond 60 years of age, whereas in the binaural mode declines were found much earlier, from 40 years of age. Performance of the monaural task correlated with cognitive competences and provided important insight into neuronal timing mechanisms. In contrast, the binaural mode reflected a bias towards an integrated perception of sequential stimuli and was less related to cognitive resources. These findings provide evidence that age-related declines in human sequencing abilities involve, besides temporal mechanisms, also a mode-specific processing, presumably associated with different neuronal mechanisms.

Alcohol slows interhemispheric transmission, increases the flash-lag effect, and prolongs masking: evidence for a slowing of neural processing and transmission

While the alcohol literature is extensive, relatively little addresses the relationship between physiological effects and behavioural changes. Using the visual system as a model, we examined alcohol's influence on neural temporal processing as a potential means for alcohol's effects. We did this by using tasks that provided a measure of processing speed: Poffenberger paradigm, flash-lag, and backward masking. After moderate alcohol, participants showed longer interhemispheric transmission times, larger flash-lags, and prolonged masking. Our data are consistent with the view that alcohol slows neural processing, and provide support for a reduction in processing efficiency underlying alcohol-induced changes in temporal visual processing.