Pure perceptual-based learning of second-, third-, and fourth-order sequential probabilities

Concurrent visual sequence learning

Many researchers in the field of implicit statistical learning agree that there does not exist one general implicit learning mechanism, but rather, that implicit learning takes place in highly specialized encapsulated modules. However, the exact representational content of these modules is still under debate. While there is ample evidence for a distinction between modalities (e.g., visual, auditory perception), the representational content of the modules might even be distinguished by features within the same modalities (e.g., location, color, and shape within the visual modality). In implicit sequence learning, there is evidence for the latter hypothesis, as a stimulus-color sequence can be learned concurrently with a stimulus-location sequence. Our aim was to test whether this also holds true for non-spatial features within the visual modality. This has been shown in artificial grammar learning, but not yet in implicit sequence learning. Hence, in Experiment 1, we replicated an artificial grammar learning experiment of Conway and Christiansen (2006) in which participants were supposed to learn color and shape grammars concurrently. In Experiment 2, we investigated concurrent learning of sequences with an implicit sequence learning paradigm: the serial reaction time task. Here, we found evidence for concurrent learning of two sequences, a color and shape sequence. Overall, the findings converge to the assumption that implicit learning might be based on features.

Inhibition of Eye Movements Disrupts Spatial Sequence Learning

Implicit sequence learning is an integral part of human experience, yet the nature of the mechanisms underlying this type of learning remains a matter of debate. In the current study, we provide a test for two accounts of implicit sequence learning, that is, one that highlights sequence learning in the absence of any motor responses (with suppressed eye movements) and one that highlights the relative contribution of the motor processes (i.e., eye movements) to learning. To adjudicate between these accounts and determine whether a motor response is a requisite process in sequence learning, we used anticipation measures to compare performance on the standard oculomotor serial reaction time (SRT) task and on a version of the SRT task where the eye movements were restricted during the learning phase. our results demonstrated an increased proportion of correct anticipations in the standard SRT task compared to the restricted-movement task.

Order, please! Explicit sequence learning in hybrid search in younger and older age

Sequence learning effects in simple perceptual and motor tasks are largely unaffected by normal aging. However, less is known about sequence learning in more complex cognitive tasks that involve attention and memory processes and how this changes with age. In this study, we examined whether incidental and intentional sequence learning would facilitate hybrid visual and memory search in younger and older adults. Observers performed a hybrid search task, in which they memorized four or 16 target objects and searched for any of those target objects in displays with four or 16 objects. The memorized targets appeared either in a repeating sequential order or in random order. In the first experiment, observers were not told about the sequence before the experiment. Only a subset of younger adults and none of the older adults incidentally learned the sequence. The "learners" acquired explicit knowledge about the sequence and searched faster in the sequence compared to random condition. In the second experiment, observers were told about the sequence before the search task. Both younger and older adults searched faster in sequence blocks than random blocks. Older adults, however, showed this sequence-learning effect only in blocks with smaller target sets. Our findings indicate that explicit sequence knowledge can facilitate hybrid search, as it allows observers to predict the next target and restrict their visual and memory search. In older age, the sequence-learning effect is constrained by load, presumably due to age-related decline in executive functions.

Implicit perceptual learning of visual-auditory modality sequences

We examined perceptual modality sequence learning by presenting number words either visually (V) or auditorily (A). Manual responses were assigned to number identity, which was random, but the stimulus modalities followed a predictable 6-element sequence (e.g., VVAAVA). In two experiments, we assessed sequence-specific learning as the performance difference between the predictable sequence and a random transfer sequence. We expected learning benefits, but for visual trials we did not find any clear predictability benefits, and, surprisingly, for auditory trials we even found a general processing disadvantage (i.e., a predictability cost) for auditory trials (Experiment 1) or a cost-benefit pattern (Experiment 2, with equated shift rates in predictable and random sequences), with costs for auditory repetition trials and benefits for shifting to auditory processing. Hence, overall there was a general learning "cost" (Experiment 1) or a null net benefit of predictability for performance (Experiment 2). Together, the findings reveal a modality-specific sensitivity towards variations in shift frequency and modality predictability only for auditory trials, but there was no overall benefit of modality-specific sequence learning.

The influence of eye-movements on the development of a movement sequence representation during observational and physical practice

An experiment was conducted to examine the development of a movement sequence representation and the role of eye-movements during observational and physical practice. The task was to reproduce a 1300ms spatial-temporal pattern of a sequence of elbow flexions and extensions. An inter-manual transfer design with a retention and two effector transfer tests (contralateral limb) was used. The mirror transfer test required the same pattern of homologous muscle activation and a sequence of joint angles as experienced during the acquisition phase, and the non-mirror transfer test required the same visual-spatial pattern as performed or observed during acquisition. Participants were randomly assigned to one of four groups differing in eye-movements (free to use their eyes vs. instruction to fixate) and the practice type (observational practice vs. physical practice). The results indicated that permitting to use eye-movements facilitates sequence learning. This advantage was found on both practice types. The results of the transfer tests indicated that participants of the physical practice group who were permitted to use their eyes demonstrated superior transfer performance in the mirror transfer test, while participants in the observational practice group demonstrated better performance on the non-mirror transfer test. These findings indicated that eye-movements enhanced the development of a visual-spatial representation during observational practice as well as a motor representation during physical practice.

Fluency Expresses Implicit Knowledge of Tonal Symmetry

The purposes of the present study were twofold. First, we sought to establish whether tonal symmetry produces processing fluency. Second, we sought to explore whether symmetry and chunk strength express themselves differently in fluency, as an indication of different mechanisms being involved for sub- and supra-finite state processing. Across two experiments, participants were asked to listen to and memorize artificial poetry showing a mirror symmetry (an inversion, i.e., a type of cross serial dependency); after this training phase, people completed a four-choice RT task in which they were presented with new artificial poetry. Participants were required to identify the stimulus displayed. We found that symmetry sped up responding to the second half of strings, indicating a fluency effect. Furthermore, there was a dissociation between fluency effects arising from symmetry vs. chunk strength, with stronger fluency effects for symmetry rather than chunks in the second half of strings. Taken together, we conjecture a divide between finite state and supra-finite state mechanisms in learning grammatical sequences.

Does consolidation of visuospatial sequence knowledge depend on eye movements?

In the current study, we assessed whether visuospatial sequence knowledge is retained over 24 hours and whether this retention is dependent on the occurrence of eye movements. Participants performed two sessions of a serial reaction time (SRT) task in which they had to manually react to the identity of a target letter pair presented in one of four locations around a fixation cross. When the letter pair 'XO' was presented, a left response had to be given, when the letter pair 'OX' was presented, a right response was required. In the Eye Movements (EM) condition, eye movements were necessary to perform the task since the fixation cross and the target were separated by at least 9° visual angle. In the No Eye Movements (NEM) condition, on the other hand, eye movements were minimized by keeping the distance from the fixation cross to the target below 1° visual angle and by limiting the stimulus presentation to 100 ms. Since the target identity changed randomly in both conditions, no manual response sequence was present in the task. However, target location was structured according to a deterministic sequence in both the EM and NEM condition. Learning of the target location sequence was determined at the end of the first session and 24 hours after initial learning. Results indicated that the sequence learning effect in the SRT task diminished, yet remained significant, over the 24 hour interval in both conditions. Importantly, the difference in eye movements had no impact on the transfer of sequence knowledge. These results suggest that the retention of visuospatial sequence knowledge occurs alike, irrespective of whether this knowledge is supported by eye movements or not.

Unconsciously learning task-irrelevant perceptual sequences

We demonstrated unconscious learning of task-irrelevant perceptual regularities in a Serial Reaction Time (SRT) task in both visual and auditory domains. Participants were required to respond to different letters ('F' or 'J', experiment 1) or syllables ('can' or 'you', experiment 2) which occurred in random order. Unbeknownst to participants, the color (red, green, blue or yellow) of the two letters or the tone (1-4) of the syllables varied according to certain rules. Reaction times indicated that people indeed learnt both the color and tonal regularities indicating that task-irrelevant sequence structure can be learned perceptually. In a subsequent prediction test of knowledge of the color or tonal cues using subjective measures, we showed that people could acquire task irrelevant knowledge unconsciously.

Overnight consolidation aids the transfer of statistical knowledge from the medial temporal lobe to the striatum

Sleep is important for abstraction of the underlying principles (or gist) which bind together conceptually related stimuli, but little is known about the neural correlates of this process. Here, we investigate this issue using overnight sleep monitoring and functional magnetic resonance imaging (fMRI). Participants were exposed to a statistically structured sequence of auditory tones then tested immediately for recognition of short sequences which conformed to the learned statistical pattern. Subsequently, after consolidation over either 30 min or 24h, they performed a delayed test session in which brain activity was monitored with fMRI. Behaviorally, there was greater improvement across 24h than across 30 min, and this was predicted by the amount of slow wave sleep (SWS) obtained. Functionally, we observed weaker parahippocampal responses and stronger striatal responses after sleep. Like the behavioral result, these differences in functional response were predicted by the amount of SWS obtained. Furthermore, connectivity between striatum and parahippocampus was weaker after sleep, whereas connectivity between putamen and planum temporale was stronger. Taken together, these findings suggest that abstraction is associated with a gradual shift from the hippocampal to the striatal memory system and that this may be mediated by SWS.

Visuospatial Perceptual Sequence Learning and Eye Movements

We examined perceptual sequence learning by means of an adapted serial reaction time task in which eye movements were unnecessary for performing the sequence learning task. Participants had to respond to the identity of a target letter pair (“OX” or “XO”) appearing in one of four locations. On the other locations, similar distractor letter pairs (“QY” or “YQ”) were shown. While target identity changed randomly, target location was structured according to a deterministic sequence. To render eye movements superfluous, (1) stimulus letter pairs appeared around a fixation cross with a visual angle of 0.63°, which means that they appeared within the foveal visual area and (2) the letter pairs were presented for only 100 ms, a period too short to allow proper eye movements. Reliable sequence knowledge was acquired under these conditions, as responses were both slower and less accurate when the trained sequence was replaced by an untrained sequence. These results support the notion that perceptual sequence learning can be based on shifts of attention without overt oculomotor movements.