The strategic control of gaze direction in the Tower-of-London task

Eye Gaze Patterns during Reasoning Provide Insights Regarding Individual Differences in Underlying Cognitive Abilities

Sequences of eye movements during performance of a reasoning task has provided insights into the strategies individuals use to solve that specific task; however, prior studies have not examined whether eye gaze metrics reflect cognitive abilities in a way that transcends a specific task. Thus, our study aimed to explore the relationship between eye movement sequences and other behavioral measures. Here, we present two studies that related different eye gaze metrics in a matrix reasoning task with performance on a different test of fluid reasoning and tests of planning, working memory, and cognitive flexibility. Additionally, we related gaze metrics to self-reported executive functioning in daily life, as measured by BRIEF-A. To perform this, we classified the participants' eye gaze in each item of the matrices test using an algorithm and then used LASSO regression models with the cognitive abilities as the dependent variable to select eye-tracking metrics to predict it. Overall, specific and distinct eye gaze metrics predicted 57% variance in the fluid reasoning scores; 17% variance in the planning scores; and 18% variance in the working memory scores. Taken together, these results support the hypothesis that the selected eye-tracking metrics reflect cognitive abilities that transcend specific tasks.

Gaze behaviour: A window into distinct cognitive processes revealed by the Tower of London test

The analysis of gaze behaviour during complex tasks provides a promising non-invasive method to examine how specific eye movement patterns relate to various aspects of cognition and action. Notably, the association between aspects of gaze behaviour and subsequent goal-directed action during high-level visuospatial problem solving remains elusive. Therefore, the current study comprehensively examined gaze behaviour using traditional and entropy-based gaze analyses in healthy adults (N = 27) while they performed the Freiburg version of the Tower of London task. Results demonstrated that both gaze analyses provided crucial temporal and spatial information related to planning, solution elaboration and execution. Specifically, gaze biases toward task-relevant areas (i.e., the work space) and an increase in gaze complexity (i.e., gaze transition entropy) during optimal performance reflected changes in cognitive demands as task difficulty increased. A comparison between optimal and non-optimal performance revealed sub-optimal gaze patterns that occurred in the early stages of planning, which were taken to reflect poor information extraction from the task environment and impaired maintenance of information in visuospatial working memory. Gaze behaviour during movement execution indicated an increased need to extract and process information from the goal space. Consequently, movement execution time increased in order to reverse erroneous movements and re-sequence the problem solution. Taken together, the traditional and entropy-based gaze analyses applied in the present study provide a promising approach to identify eye movement patterns that support neurocognitive performance on tasks relying on visuospatial planning and problem solving.

Where Do Parkinson's Disease Patients Look while Walking?

BACKGROUND

Parkinson's disease (PD) is associated with gait and visuomotor abnormalities, but it is not clear where PD patients look during ambulation.

OBJECTIVE

We sought to characterize the visual areas of interest explored by PD patients, with and without freezing of gait (FOG), compared to healthy volunteers (HVs).

METHODS

Using an eye-tracking device, we compared visual fixation patterns in 17 HVs and 18 PD patients, with and without FOG, during an ambulatory and a nonambulatory, computer-based task.

RESULTS

During ambulation, PD patients with FOG fixated more on proximal areas of the ground and less on the target destination. PD patients without FOG displayed a fixation pattern more similar to that of HVs. Similar patterns were observed during the nonambulatory, computer-based task.

CONCLUSIONS

Our findings suggest increased dependence on visual feedback from nearby areas in the environment in PD patients with FOG, even in the absence of motor demands. © 2022 International Parkinson and Movement Disorder Society.

Eye-hand coordination: memory-guided grasping during obstacle avoidance

When reaching to grasp previously seen, now out-of-view objects, we rely on stored perceptual representations to guide our actions, likely encoded by the ventral visual stream. So-called memory-guided actions are numerous in daily life, for instance, as we reach to grasp a coffee cup hidden behind our morning newspaper. Little research has examined obstacle avoidance during memory-guided grasping, though it is possible obstacles with increased perceptual salience will provoke exacerbated avoidance maneuvers, like exaggerated deviations in eye and hand position away from obtrusive obstacles. We examined the obstacle avoidance strategies adopted as subjects reached to grasp a 3D target object under visually-guided (closed loop or open loop with full vision prior to movement onset) and memory-guided (short- or long-delay) conditions. On any given trial, subjects reached between a pair of flanker obstacles to grasp a target object. The positions and widths of the obstacles were manipulated, though their inner edges remained a constant distance apart. While reach and grasp behavior was consistent with the obstacle avoidance literature, in that reach, grasp, and gaze positions were biased away from obstacles most obtrusive to the reaching hand, our results reveal distinctive avoidance approaches undertaken depend on the availability of visual feedback. Contrary to expectation, we found subjects reaching to grasp after a long delay in the absence of visual feedback failed to modify their final fixation and grasp positions to accommodate the different positions of obstacles, demonstrating a more moderate, rather than exaggerative, obstacle avoidance strategy.

New Caledonian Crows Use Mental Representations to Solve Metatool Problems

One of the mysteries of animal problem-solving is the extent to which animals mentally represent problems in their minds. Humans can imagine both the solution to a problem and the stages along the way [1, 2, 3], such as when we plan one or two moves ahead in chess. The extent to which other animals can do the same is far less clear [4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25]. Here, we presented New Caledonian crows with a series of metatool problems where each stage was out of sight of the others and the crows had to avoid either a distractor apparatus containing a non-functional tool or a non-functional apparatus containing a functional tool. Crows were able to mentally represent the sub-goals and goals of metatool problems: crows kept in mind the location and identities of out-of-sight tools and apparatuses while planning and performing a sequence of tool behaviors. This provides the first conclusive evidence that birds can plan several moves ahead while using tools.

•

Crows solved metatool problems where each stage was out of sight of the others

•

Crows avoided distractor apparatuses during problem-solving

•

This shows crows mentally represent the goals and sub-goals of metatool problems

•

Crows can preplan three behaviors into the future while using tools

Eye Movements in Neuropsychological Tasks

This chapter reviews how recording and analysis of eye movements have been applied to understanding cognitive functioning in patients with neurological disease. Measures derived from the performance of instructed eye movement tests such as the anti-saccade and memory-guided saccade tasks have been shown to be associated with cognitive test performance and the early stages of neurodegenerative disorders including Alzheimer's and Parkinson's disease. Other researchers have taken an ecological approach and recorded the uninstructed pattern of saccades made by patients during performance of established neuropsychological tasks. Studies that have analysed the eye movement strategies used in a number of widely used tests are reviewed, including the Corsi blocks, Tower of London, 'CANTAB' Spatial Working Memory and Brixton Spatial Anticipation test. The findings illustrate that eye movements are not purely in the service of vision, but support visuospatial working memory and forward action planning. Eye movement tests and measures also have potential for application in the assessment and diagnosis of neurological disease and cognitive impairment. Establishing large-scale normative data sets in healthy older adults and use of machine learning multivariate classifier algorithms may be key to further developing eye tracking applications in neuropsychological assessment.

Eye Movements in the "Morris Maze" Spatial Working Memory Task Reveal Deficits in Strategic Planning

Analysis of eye movements can provide insights into processes underlying performance of cognitive tasks. We recorded eye movements in healthy participants and people with idiopathic Parkinson disease during a token foraging task based on the spatial working memory component of the widely used Cambridge Neuropsychological Test Automated Battery. Participants selected boxes (using a mouse click) to reveal hidden tokens. Tokens were never hidden under a box where one had been found before, such that memory had to be used to guide box selections. A key measure of performance in the task is between search errors (BSEs) in which a box where a token has been found is selected again. Eye movements were found to be most commonly directed toward the next box to be clicked on, but fixations also occurred at rates higher than expected by chance on boxes farther ahead or back along the search path. Looking ahead and looking back in this way was found to correlate negatively with BSEs and was significantly reduced in patients with Parkinson disease. Refixating boxes where tokens had already been found correlated with BSEs and the severity of Parkinson disease symptoms. It is concluded that eye movements can provide an index of cognitive planning in the task. Refixations on locations where a token has been found may also provide a sensitive indicator of visuospatial memory integrity. Eye movement measures derived from the spatial working memory task may prove useful in the assessment of executive functions as well as neurological and psychiatric diseases in the future.

Longer Fixation Times During Reading Are Correlated With Decreased Connectivity in Cognitive-Control Brain Regions During Rest in Children

Dyslexia, or reading difficulty (RD), is characterized by slow, inaccurate reading and accompanied by deficit in executive functions (EF) and altered functional connectivity (FC) in the related networks (i.e., cingulo-opercular). Individuals with RD also present with altered oculomotor gaze patterns that include longer fixation times. The researchers examined the relationship between fixation times and FC of neural circuits related to EF during rest in children with RD and typical readers. Nineteen children participated in a 10-min resting-state scan. FC analysis was performed with the anterior cingulate cortex (ACC), related to cognitive control, chosen as a seed. Fixation time during word reading was used as a covariate of interest. Results demonstrated that FC between the ACC and the left inferior frontal cortex pars triangularis and left inferior prefrontal cortex during rest were negatively correlated with fixation times during word reading. These exploratory results support the critical role for the cingulo-opercular network, which is related to cognitive control, in the reading process, and likely also in reading impairment.

Eye Movements Reveal Optimal Strategies for Analogical Reasoning

Analogical reasoning refers to the process of drawing inferences on the basis of the relational similarity between two domains. Although this complex cognitive ability has been the focus of inquiry for many years, most models rely on measures that cannot capture individuals' thought processes moment by moment. In the present study, we used participants' eye movements to investigate reasoning strategies in real time while solving visual propositional analogy problems (A:B::C:D). We included both a semantic and a perceptual lure on every trial to determine how these types of distracting information influence reasoning strategies. Participants spent more time fixating the analogy terms and the target relative to the other response choices, and made more saccades between the A and B items than between any other items. Participants' eyes were initially drawn to perceptual lures when looking at response choices, but they nonetheless performed the task accurately. We used participants' gaze sequences to classify each trial as representing one of three classic analogy problem solving strategies and related strategy usage to analogical reasoning performance. A project-first strategy, in which participants first extrapolate the relation between the AB pair and then generalize that relation for the C item, was both the most commonly used strategy as well as the optimal strategy for solving visual analogy problems. These findings provide new insight into the role of strategic processing in analogical problem solving.

When you have to climb downhill to reach the top: the effect of action versus state orientation on solvinga goal-subgoal conflict in the Tower of Hanoi task

Complex problems often include a response conflict between a subgoal and a final goal. The present experiment investigated the roles of situational demands and individual differences in self-regulation on solving goal-subgoal conflicts in a computerized Tower of Hanoi task. Action-oriented versus state-oriented individuals were randomly assigned to a demanding condition in which they deliberated about a personal decision problem, or to a nondemanding control condition. In line with expectations state-oriented individuals had greater difficulties to solve goal-subgoal conflicts in the demanding compared to the nondemanding condition. Action-oriented individuals performed well in both conditions. In line with Personality Systems Interactions theory (Kuhl, 2000) the findings show that complex problem solving depends on how well people are able to deal with situational demands.

Ocular motor abnormalities in neurodegenerative disorders

Eye movements are a source of valuable information to both clinicians and scientists as abnormalities of them frequently act as clues to the localization of a disease process. Classically, they are divided into two main types: those that hold the gaze, keeping images steady on the retina (vestibulo-ocular and optokinetic reflexes) and those that shift gaze and redirect the line of sight to a new object of interest (saccades, vergence, and smooth pursuit). Here we will review some of the major ocular motor abnormalities present in neurodegenerative disorders.

In your eyes only: deficits in executive functioning after frontal TMS reflect in eye movements

This study investigated the roles of the right and left dorsolateral prefrontal (rDLPFC, lDLPFC) and the medial frontal cortex (MFC) in executive functioning using a theta burst transcranial magnetic stimulation (TMS) approach. Healthy subjects solved two visual search tasks: a number search task with low cognitive demands, and a number and letter search task with high cognitive demands. To observe how subjects solved the tasks, we assessed their behavior with and without TMS using eye movements when subjects were confronted with specific executive demands. To observe executive functions, we were particularly interested in TMS-induced changes in visual exploration strategies found to be associated with good or bad performance in a control condition without TMS stimulation. TMS left processing time unchanged in both tasks. Inhibition of the rDLPFC resulted in a decrease in anticipatory fixations in the number search task, i.e., a decrease in a good strategy in this low demand task. This was paired with a decrease in stimulus fixations. Together, these results point to a role of the rDLPFC in planning and response selection. Inhibition of the lDLPFC and the MFC resulted in an increase in anticipatory fixations in the number and letter search task, i.e., an increase in the application of a good strategy in this task. We interpret these results as a compensatory strategy to account for TMS-induced deficits in attentional switching when faced with high switching demands. After inhibition of the lDLPFC, an increase in regressive fixations was found in the number and letter search task. In the context of high working memory demands, this strategy appears to support TMS-induced working memory deficits. Combining an experimental TMS approach with the recording of eye movements proved sensitive to discrete decrements of executive functions and allows pinpointing the functional organization of the frontal lobes.

Planning: fixed-foreperiod event-related potentials during the Tower of London task

Slow wave ERPs were recorded from 28 young adults as they generated plans for various difficulty levels of a fixed-foreperiod version of the Tower of London task. The resulting waveform included three segments: (1) a left-lateralized negative early-interval wave, which was frontally maximal but not sensitive to difficulty, (2) a right-lateralized frontally maximal mid-interval wave, which was more positive for more difficult problems, and (3) a left lateralized centrally maximal negative-ramping contingent negative variation (CNV) late wave, which was more negative for more difficult problems. The current study adds to the current literature in that it finds that the frontal and central neural utilization with difficulty changes across plan generation. This suggests that plan generation should be considered in terms of when component processes of planning are differentially utilized as plan generation unfolds.

Eye movements reveal solution knowledge prior to insight

In two experiments, participants solved anagram problems while their eye movements were monitored. Each problem consisted of a circular array of five letters: a scrambled four-letter solution word containing three consonants and one vowel, and an additional randomly-placed distractor consonant. Viewing times on the distractor consonant compared to the solution consonants provided an online measure of knowledge of the solution. Viewing times on the distractor consonant and the solution consonants were indistinguishable early in the trial. In contrast, several seconds prior to the response, viewing times on the distractor consonant decreased in a gradual manner compared to viewing times on the solution consonants. Importantly, this pattern was obtained across both trials in which participants reported the subjective experience of insight and trials in which they did not. These findings are consistent with the availability of partial knowledge of the solution prior to such information being accessible to subjective phenomenal awareness.

Dissociable contributions of left and right dorsolateral prefrontal cortex in planning

It is well established that the mid-dorsolateral prefrontal cortex (dlPFC) plays a critical role in planning. Neuroimaging studies have yielded predominantly bilateral dlPFC activations, but the existence and nature of functionally specific contributions of left and right dlPFC have remained elusive. In recent experiments, 2 independent parameters have been identified which substantially determine planning: 1) the degree of interdependence between consecutive steps (search depth) and 2) the degree to which the configuration of the goal state renders the order of single steps either clearly evident or ambiguous (goal hierarchy). Thus, search depth affects the actual mental generation and evaluation of action sequences, whereas goal hierarchy reflects the extraction of goal information from an encountered problem. Here, both parameters were independently manipulated in an event-related functional magnetic resonance imaging study using the Tower of London task. Results revealed a double dissociation as indicated by a significant crossover interaction of hemisphere and task parameter: in left dlPFC, activations were stronger for higher demands on goal hierarchy than on search depth, whereas the reversed result emerged in right dlPFC. In conclusion, often observed bilateral patterns of dlPFC activation in complex tasks may reflect the concomitant operation of specific cognitive processes that show opposing lateralizations.

Performance of humans vs. exploration algorithms on the Tower of London Test

The Tower of London Test (TOL) used to assess executive functions was inspired in Artificial Intelligence tasks used to test problem-solving algorithms. In this study, we compare the performance of humans and of exploration algorithms. Instead of absolute execution times, we focus on how the execution time varies with the tasks and/or the number of moves. This approach used in Algorithmic Complexity provides a fair comparison between humans and computers, although humans are several orders of magnitude slower. On easy tasks (1 to 5 moves), healthy elderly persons performed like exploration algorithms using bounded memory resources, i.e., the execution time grew exponentially with the number of moves. This result was replicated with a group of healthy young participants. However, for difficult tasks (5 to 8 moves) the execution time of young participants did not increase significantly, whereas for exploration algorithms, the execution time keeps on increasing exponentially. A pre-and post-test control task showed a 25% improvement of visuo-motor skills but this was insufficient to explain this result. The findings suggest that naive participants used systematic exploration to solve the problem but under the effect of practice, they developed markedly more efficient strategies using the information acquired during the test.

Rats' learning of a new motor skill: insight into the evolution of motor sequence learning

Recent behavioral and neural evidence has suggested that ethologically relevant sub-movements (movement primitives) are used by primates for more complex motor skill learning. These primitives include extending the hand, grasping an object, and holding food while moving it toward the mouth. In prior experiments with rats performing a reach-to-grasp-food task, we observed that especially during early task learning, rats appeared to have movement primitives similar to those seen in primates. Unlike primates, however, during task learning the rats performed these sub-movements in a disordered manner not seen in humans or macaques, e.g. with the rat chewing before placing the food pellet in its mouth. Here, in two experiments, we tested the hypothesis that for rats, learning this ecologically relevant skill involved learning to concatenate the sub-movements in the correct order. The results confirmed our initial observations, and suggested that several aspects of forepaw/hand use, taken for granted in primate studies, must be learned by rats to perform a logically connected and seemingly ecologically important series of sub-movements. We discuss our results from a comparative and evolutionary perspective.

Acoustic scanning of natural scenes by echolocation in the big brown bat, Eptesicus fuscus

Echolocation allows bats to orient and localize prey in complete darkness. The sonar beam of the big brown bat, Eptesicus fuscus, is directional but broad enough to provide audible echo information from within a 60-90 deg. cone. This suggests that the big brown bat could interrogate a natural scene without fixating each important object separately. We tested this idea by measuring the directional aim and duration of the bat's sonar beam as it performed in a dual task, obstacle avoidance and insect capture. Bats were trained to fly through one of two openings in a fine net to take a tethered insect at variable distances behind the net. The bats sequentially scanned the edges of the net opening and the prey by centering the axis of their sonar beam with an accuracy of approximately 5 deg. The bats also shifted the duration of their sonar calls, revealing sequential sampling along the range axis. Changes in duration and directional aim were correlated, showing that the bat first inspected the hole, and then shifted its gaze to the more distant insect, before flying through the net opening. Contrary to expectation based on the sonar beam width, big brown bats encountering a complex environment accurately pointed and shifted their sonar gaze to sequentially inspect closely spaced objects in a manner similar to visual animals using saccades and fixations to scan a scene. The findings presented here from a specialized orientation system, echolocation, offer insights into general principles of active sensing across sensory modalities for the perception of natural scenes.

Gaze strategies during planning in first-episode psychosis

Eye movements were measured during the performance of a computerized Tower of London task to specify the source of planning abnormalities in patients with 1st-episode schizophrenia or schizoaffective disorder. Subjects viewed 2 arrays of colored balls in the upper and lower parts of the screen. They were asked to plan the shortest sequence of moves required to rearrange the balls in the lower screen to match the upper arrangement. Compared with healthy controls, patients made more planning errors, and decision times were longer. However, the patients showed the same gaze biases as controls prior to making a response, indicating that they understood the requirements of the task, approached the task in a strategic manner by identifying the nature of the problem, and used appropriate fixation strategies to plan and elaborate solutions. The patients showed increased duration of long-gaze periods toward both parts of the screen. This suggests that the patients had difficulty in encoding the essential features of the stimulus array. This finding is compatible with slowing of working memory consolidation.

Eye movement correlates of younger and older adults' strategies for complex addition

This study examined performance measures and eye movements associated with complex arithmetic strategies in young and older adults. Participants added pairs of three-digit numbers using two different strategies, under choice and no-choice conditions. Older adults made more errors but were not significantly slower than young adults, and response times and errors showed no interaction between age and the number of carries. Older adults chose strategies less adaptively than young adults. Eye movements were consistent with use of required strategies on no-choice trials and reported strategies on choice trials. Eye movement data also suggested that young adults more successfully distinguished between strategies. Implications of these findings for understanding aging effects in complex arithmetic are discussed.

Look-ahead fixations: anticipatory eye movements in natural tasks

During performance of natural tasks subjects sometimes fixate objects that are manipulated several seconds later. Such early looks are known as "look-ahead fixations" (Pelz and Canosa in Vision Res 41(25-26):3587-3596, 2001). To date, little is known about their function. To investigate the possible role of these fixations, we measured fixation patterns in a model-building task. Subjects assembled models in two sequences where reaching and grasping were interrupted in one sequence by an additional action. Results show look-ahead fixations prior to 20% of the reaching and grasping movements, occurring on average 3 s before the reach. Their frequency was influenced by task sequence, suggesting that they are purposeful and have a role in task planning. To see if look-aheads influenced the subsequent eye movement during the reach, we measured eye-hand latencies and found they increased by 122 ms following a look-ahead to the target. The initial saccades to the target that accompanied a reach were also more accurate following a look-ahead. These results demonstrate that look-aheads influence subsequent visuo-motor coordination, and imply that visual information on the temporal and spatial structure of the scene was retained across intervening fixations and influenced subsequent movement programming. Additionally, head movements that accompanied look-aheads were significantly smaller in amplitude (by 10 degrees) than those that accompanied reaches to the same locations, supporting previous evidence that head movements play a role in the control of hand movements. This study provides evidence of the anticipatory use of gaze in acquiring information about objects for future manipulation.

Cognitive processes in the development of TOL performance

Components of executive function continue to develop through adolescence. There is limited knowledge of how these cognitive components impact complex cognitive function requiring their integration. This study examines the development of response planning, a complex cognitive function, and the contributions of selected cognitive processes, including speed of processing, response inhibition, and working memory to its development. We tested 100 healthy 8-30 year old individuals with a computerized version to the Tower of London (TOL) task and cognitive oculomotor tests including the visually guided saccade, oculomotor delayed response, and antisaccade tasks. Speed of processing, response inhibition, working memory, and TOL performance all demonstrated maturation in adolescence. While all processes were correlated with the development of TOL performance, antisaccade performance showed the strongest association indicating an important role for response inhibition in planning. These results indicate that the development of converging cognitive processes in adolescence, including response inhibition and working memory, support response planning and may serve as a model for the development of performance in other complex problem solving tasks.

Question asking and eye tracking during cognitive disequilibrium: comprehending illustrated texts on devices when the devices break down

The PREG model of question asking assumes that questions emerge when there is cognitive disequilibrium, as in the case of contradictions, obstacles, and anomalies. Participants read illustrated texts about everyday devices (e.g., a cylinder lock) and then were placed in cognitive disequilibrium through a breakdown scenario (e.g., the key turns but the bolt does not move). The participants asked questions when given the breakdown scenario, and an eyetracker recorded their fixations. As was predicted, deep comprehenders asked better questions and fixated on device components that explained the malfunction. The eye fixations were examined before, during, and after the participants' questions in order to trace the occurrence and timing of convergence on faults, causal reasoning, and other cognitive processes.

The case for the development and use of "ecologically valid" measures of executive function in experimental and clinical neuropsychology

This article considers the scientific process whereby new and better clinical tests of executive function might be developed, and what form they might take. We argue that many of the traditional tests of executive function most commonly in use (e.g., the Wisconsin Card Sorting Test; Stroop) are adaptations of procedures that emerged almost coincidentally from conceptual and experimental frameworks far removed from those currently in favour, and that the prolongation of their use has been encouraged by a sustained period of concentration on "construct-driven" experimentation in neuropsychology. This resulted from the special theoretical demands made by the field of executive function, but was not a necessary consequence, and may not even have been a useful one. Whilst useful, these tests may not therefore be optimal for their purpose. We consider as an alternative approach a function-led development programme which in principle could yield tasks better suited to the concerns of the clinician because of the transparency afforded by increased "representativeness" and "generalisability." We further argue that the requirement of such a programme to represent the interaction between the individual and situational context might also provide useful constraints for purely experimental investigations. We provide an example of such a programme with reference to the Multiple Errands and Six Element tests.

The impact of problem structure on planning: insights from the Tower of London task

Despite the large number of behavioral and functional neuroimaging studies employing the Tower of London (ToL), the task's structural parameters and particularly their impact on planning have not been addressed so far. In this paper, we highlight the structural properties of ToL problems and provide evidence for their systematic and substantial effects on the cognitive processes involved in planning. In a problem set with three-move problems, the following structural parameters were experimentally manipulated: the ambiguity of goal hierarchy, the demand for subgoal generation, and the existence of suboptimal alternatives. Analysis of preplanning time as an indicator for the planning process revealed highly significant effects for all three parameters which seems to reflect differences in cognitive processing due to structural task properties. Therefore, we suggest that the common consideration of ToL problem difficulty solely in terms of the minimum number of moves is not sufficient. Moreover, the applied problem sets should be more carefully selected and their structural parameters explicitly noted.

Eye Movements during Task Switching: Reflexive, Symbolic, and Affective Contributions to Response Selection

Active vision is a dynamic process involving the flexible coordination of different gaze strategies to achieve behavioral goals. Although many complex behaviors rely on an ability to efficiently switch between gaze-control strategies, few studies to date have examined mechanisms of task level oculomotor control in detail. Here, we report five experiments in which subjects alternated between conflicting stimulus-saccade mappings within a block of trials. The first experiment showed that there is no performance cost associated with switching between pro and anti saccades. However, follow-up experiments demonstrate that whenever subjects alternate between arbitrary stimulus-saccade mappings, latency costs are apparent on the first trial after a task change. More detailed analysis of switch costs showed that latencies were particularly elevated for saccades directed toward the same location that had been the target for a saccade on the preceeding trial. This saccade “inhibition of return” effect was most marked when unexpected error feedbacks cued task switches, suggesting that saccade selection processes are modulated by reward. We conclude that there are two systems for saccade control that differ in their characteristics following a task switch. The “reflexive” control system can be enabled/disabled in advance of saccade execution without incurring any performance cost. Switch costs are only observed when two or more arbitrary stimulus-saccade mappings have to be coordinated by a “symbolic” control system.

Using saccades as a research tool in the clinical neurosciences

Saccades are rapid eye movements that move the line of sight between successive points of fixation; they are among the best understood of movements, possessing dynamic properties that are easily measured. Saccades have become a popular means to study motor control, cognition and memory, and are often used in conjunction with techniques such as functional imaging and transcranial magnetic stimulation. It has been possible to identify several, distinct populations of neurons, from brainstem to cerebral cortex, that contribute to behaviours ranging from reflexive glances to memorized sequences of saccades during learned tasks. This progress has led to the development of schemes for the neurobiology of saccades that imply an equivalence of a region of the brain with specific behaviours (e.g. prefrontal cortex with memory-guided saccades). In fact, multiple neuronal populations contribute to each type of saccadic behaviour, be it 'reflexive' or 'complex'. Furthermore, an important difference exists between cortical areas that encode visual stimuli or desired saccades over a population of neurons as 'place maps', and motoneurons in oculomotor, trochlear and abducens nuclei that dictate eye rotations in terms of their discharge rates. This dichotomy implies that a 'spatial-temporal transformation' of saccadic signals must occur between cerebral cortex and ocular motoneurons, to which the superior colliculus and cerebellum contribute. Consideration of such factors may broaden the value of saccades, which can be used to test a range of hypotheses, and provide a simple scheme for understanding clinical disorders of saccades; some illustrative video clips are available as supplementary material at Brain Online.

Dynamic functional changes associated with cognitive skill learning of an adapted version of the Tower of London task

In this study, we used a modified version of the Tower of London (TOL) planning task, in conjunction with positron emission tomography, to examine the neural substrates mediating cognitive skill learning. Twelve healthy, right-handed participants solved a total of 90 different TOL problems. They were scanned on four occasions during the fast learning stage as well as in a condition designed to control for internally guided movements. Practice of the TOL task resulted in a significant decrease in planning, execution, and total time taken to solve the problems. Consistent with the results of previous studies, early performance of the TOL task was associated with increased blood flow activity in the dorsolateral prefrontal, orbitofrontal, and parietal cortices on the left, as well as in the caudate nucleus, cerebellum, and premotor cortex, bilaterally. Interestingly, however, activity in the left caudate nucleus was maintained from the beginning to the end of the learning process, suggesting that this structure plays a role in this type of cognitive skill learning. In addition, correlational analyses revealed that improved performance on the TOL task was associated with a significant decrease of activity in the medial orbitofrontal and frontopolar cortices over the course of learning, areas thought to be involved in decision making, guessing, and monitoring of feedback information. In sum, the results lend further support to the idea that the learning of cognitive skills requiring planning and working memory capacities is mediated through a fronto-striatal network.

The Tower of London: the impact of instructions, cueing, and learning on planning abilities

The Tower of London (ToL) is a well-known test of planning ability, and commonly used for the purpose of neuropsychological assessment and cognitive research. Its widespread application has led to numerous versions differing in a number of respects. The present study addressed the question whether differences in instruction, cueing, and learning processes systematically influence ToL performance across five difficulty levels (three to seven moves). A total of 81 normal adults were examined in a mixed design with the between-subject factor instruction (online versus mental preplanning) and the within-subject factors cueing (cue versus non-cue test version) and learning processes (first block and second block). We also assessed general intelligence for further analyses of differences between instruction groups. In general, there was a significant main effect across the difficulty levels indicating that the rate of incorrect solutions increased with problem difficulty. The participants who were instructed to make full mental plans before beginning to execute movements (preplanning) solved significantly more problems than people who started immediately with task-related movements (online). As for the cueing conditions, participants with the minimum number of moves predetermined (cue) could solve more trials than people who were only instructed to solve the problems in as few moves as possible (non-cue). Participants generally increased performance in the second part of the test session. However, an interaction of presentation order of the cueing condition with learning indicated that people who started the tasks with the non-cue version showed significantly better performance in the following cue condition, while participants who started with the cue condition stayed at the same performance level for both versions. These findings suggest that instruction, cueing conditions, and learning processes are important determinants of ToL performance, and they stress the necessity of standardized application in research and clinical practice.

Eye movements and problem solving: guiding attention guides thought

Overt visual attention during diagram-based problem solving, as measured by eye movements, has been used in numerous studies to reveal critical aspects of the problem-solving process that traditional measures like solution time and accuracy cannot address. In Experiment 1, we used this methodology to show that particular fixation patterns correlate with success in solving the tumor-and-lasers radiation problem. Given this correlation between attention to a particular diagram feature and problem-solving insight, we investigated participants' cognitive sensitivity to perceptual changes in that diagram feature. In Experiment 2, we found that perceptually highlighting the critical diagram component, identified in Experiment 1, significantly increased the frequency of correct solutions. Taking a situated perspective on cognition, we suggest that environmentally controlled perceptual properties can guide attention and eye movements in ways that assist in developing problem-solving insights that dramatically improve reasoning.

Mental fatigue and the control of cognitive processes: effects on perseveration and planning

We tested whether behavioural manifestations of mental fatigue may be linked to compromised executive control, which refers to the ability to regulate perceptual and motor processes for goal-directed behaviour. In complex tasks, compromised executive control may become manifest as decreased flexibility and sub-optimal planning. In the study we use the Wisconsin Card Sorting Test (WCST) and the Tower of London (TOL), which respectively measure flexibility (e.g., perseverative errors) and planning. A simple memory task was used as a control measure. Fatigue was induced through working for 2 h on cognitively demanding tasks. The results showed that compared to a non-fatigued group, fatigued participants displayed more perseveration on the WCST and showed prolonged planning time on the TOL. Fatigue did not affect performance on the simple memory task. These findings indicate compromised executive control under fatigue, which may explain the typical errors and sub-optimal performance that are often found in fatigued people.

Individual differences in prefrontal cortical activation on the Tower of London planning task: implication for effortful processing

Solving challenging ('effortful') problems is known to involve the dorsal and dorsolateral prefrontal cortex in normal volunteers, although there is considerable individual variation. In this functional magnetic resonance imaging study, we show that healthy subjects with different levels of performance in the Tower of London planning task exhibit different patterns of brain activation. All subjects exhibited significant bilateral activation in the dorsolateral prefrontal cortex, the anterior and posterior cingulate areas and the parietal cortex. However, 'standard performers' (performance < 70% correct) and 'superior performers' (performance >70% correct) differed in the patterns of activation exhibited. Superior performers showed a significantly more spatially extended activation in the left dorsolateral prefrontal cortex than did standard performers, whereas the latter group tended to show increased activation of the anterior cingulate region.

Memory-motor transformations are impaired in Parkinson's disease

Parkinson's disease patients are known to suffer loss of dopaminergic input to the rostral caudate nucleus. Recent functional magnetic resonance imaging (fMRI) studies have implicated this structure in the transformation of spatial information in memory to guide action, suggesting that memory to motor transformations may be selectively impaired in Parkinson's disease. In order to investigate this possibility we tested a group of Parkinson's disease patients (PDs) using a memory-guided pointing task. Of interest was whether patients showed reduced accuracy in the task as a function of memory load. Twelve PD patients and 13 elderly controls were asked to recall single or four step target sequences with 2 time delays (500 and 3,500 ms). In all memory-guided conditions PD patients showed increased variability in memory-guided movement end-points. This effect was not affected by delay, number of items, or the sequence familiarity. The results are consistent with increased variability in memory-motor transformations in early PD, due to dopamine depletion within the rostral caudate nucleus.

Orbitofrontal cortex mediates inhibition of return

Recent accounts have proposed that orbitofrontal cerebral cortex mediates the control of behavior based on emotional feedback and its somatic correlates. Here, we describe the performance of a patient with circumscribed damage to orbitofrontal cortex during a task that requires switching between sensory-motor mappings, contingent on the occurrence of positive and negative reward feedbacks. In this test, normal subjects and other patients with prefrontal damage show an increase in latencies for eye movements towards locations at which a negative feedback was presented on the preceding trial. In contrast, our patient does not show this reward-dependent inhibition of return effect on saccades. She was also found to make an increased rate of ocular refixations during visual search and used a disorganized search strategy in a token foraging task. These findings suggest that orbital regions of the prefrontal cortex mediate an inhibitory effect on actions directed towards locations that have been subject to negative reinforcement. Further, this mechanism seems to play a role in controlling natural search and foraging behavior.

Engagement of gaze in capturing targets for future sequential manual actions

We investigated the role of saccadic gaze fixations in encoding target locations for planning a future manual task consisting of a sequence of discrete target-oriented actions. We hypothesized that fixations of the individual targets are necessary for accurate encoding of target locations and that there is a transfer of sequence information from visual encoding to manual recall. Subjects viewed four targets presented at random positions on a screen. After various delays following target extinction, the subjects marked the remembered target locations on the screen with the tip of a hand-held stick. When the targets were presented simultaneously among distracting elements, the overall accuracy of marking increased with presentation time and total number of targets fixated because the subjects had to serially fixate the individual targets to locate them. Without distractors, the marking accuracy was similarly high regardless of duration of target presentation (0.25-8 s) and number of targets fixated; it was comparable to that with distractors when all four targets had been fixated. This indicates parallel encoding of target locations largely based on peripheral vision. Location memory was stable in these tasks over the delay periods investigated (0.5-8 s). With parallel encoding there was a "shrinkage" in the visuomotor transformation, i.e., the distances between the markings were systematically smaller than the corresponding inter-target distances. When the targets were presented sequentially without distractors, marking accuracy improved with the total number of targets fixated and shrinkage in the visuomotor transformation occurred only with parallel encoding, i.e., when subjects did not fixate the targets. In all experimental conditions for trials in which targets were fixated during encoding, there was little correspondence between the marking sequence and the sequence in which the targets were fixated. We conclude that subjects benefit from fixating targets for subsequent target-oriented manual actions when the targets are presented among distractors and when presented sequentially; when distinct targets are presented simultaneously against a blank background, they are efficiently encoded in parallel largely by peripheral vision.

Scanpaths: the path to understanding abnormal cognitive processing in neurological disease

Scanpaths, the sequence of saccades and fixations during visual search, provide the means to study a range of cognitive activities: planning, visuospatial attention, and spatial working memory. By measuring scanpaths, we have been able to identify impairment of working memory in patients with spatial hemineglect. Scanpaths during cognitively demanding tasks indicate a defect of working memory in patients with Parkinson's disease. Studies of scanpaths in patients with homonymous hemianopia have provided the means to develop a new strategy for visual rehabilitation.

Generation of rapid eye movements during paradoxical sleep in humans

Although rapid eye movements (REMs) are a prominent feature of paradoxical sleep (PS), their origin and functional significance remain poorly understood in humans. In animals, including nonhuman primates, REMs during PS are closely related to the occurrence of the so-called PGO waves, i.e., prominent phasic activities recorded throughout the brain but predominantly and most easily in the pons (P), the lateral geniculate bodies (G), and the occipital cortex (O). Therefore, and because the evolution of species is parsimonious, a plausible hypothesis would be that during PS in humans, REMs are generated by mechanisms similar to PGO waves. Using positron emission tomography and iterative cerebral blood flow measurements by H(2)(15)O infusions, we predicted that the brain regions where the PGO waves are the most easily recorded in animals would be differentially more active in PS than in wakefulness, in relation with the density of the REM production [i.e., we looked for the condition (PS versus wakefulness) by performance (REM density) interaction]. Accordingly, we found a significant interaction effect in the right geniculate body and in the primary occipital cortex. The result supports the hypothesis of the existence of processes similar to PGO waves in humans, responsible for REM generation. The interest in the presence of PGO waves in humans is outstanding because the cellular processes involved in, or triggered by, PGO waves might favor brain plasticity during PS.