Worth a glance: using eye movements to investigate the cognitive neuroscience of memory

Eye movements reinstate remembered locations during episodic simulation

Imagining the future, like recalling the past, relies on the ability to retrieve and imagine a spatial context. Research suggests that eye movements support this process by reactivating spatial contextual details from memory, a process termed gaze reinstatement. While gaze reinstatement has been linked to successful memory retrieval, it remains unclear whether it supports the related process of future simulation. In the present study, we recorded both eye movements and audio while participants described familiar locations from memory and subsequently imagined future events occurring in those locations while either freely moving their eyes or maintaining central fixation. Restricting viewing during simulation significantly reduced self-reported vividness ratings, supporting a critical role for eye movements in simulation. When viewing was unrestricted, participants spontaneously reinstated gaze patterns specific to the simulated location, replicating findings of gaze reinstatement during memory retrieval. Finally, gaze-based location reinstatement was predictive of simulation success, indexed by the number of internal (episodic) details produced, with both measures peaking early and co-varying over time. Together, these findings suggest that the same oculomotor processes that support episodic memory retrieval - that is, gaze-based reinstatement of spatial context - also support episodic simulation.

Eye tracking evidence for the reinstatement of emotionally negative and neutral memories

Recent eye tracking studies have linked gaze reinstatement-when eye movements from encoding are reinstated during retrieval-with memory performance. In this study, we investigated whether gaze reinstatement is influenced by the affective salience of information stored in memory, using an adaptation of the emotion-induced memory trade-off paradigm. Participants learned word-scene pairs, where scenes were composed of negative or neutral objects located on the left or right side of neutral backgrounds. This allowed us to measure gaze reinstatement during scene memory tests based on whether people looked at the side of the screen where the object had been located. Across two experiments, we behaviorally replicated the emotion-induced memory trade-off effect, in that negative object memory was better than neutral object memory at the expense of background memory. Furthermore, we found evidence that gaze reinstatement was related to recognition memory for the object and background scene components. This effect was generally comparable for negative and neutral memories, although the effects of valence varied somewhat between the two experiments. Together, these findings suggest that gaze reinstatement occurs independently of the processes contributing to the emotion-induced memory trade-off effect.

Early Eye Disengagement Is Regulated by Task Complexity and Task Repetition in Visual Tracking Task

Understanding human actions often requires in-depth detection and interpretation of bio-signals. Early eye disengagement from the target (EEDT) represents a significant eye behavior that involves the proactive disengagement of the gazes from the target to gather information on the anticipated pathway, thereby enabling rapid reactions to the environment. It remains unknown how task difficulty and task repetition affect EEDT. We aim to provide direct evidence of how these factors influence EEDT. We developed a visual tracking task in which participants viewed arrow movement videos while their eye movements were tracked. The task complexity was increased by increasing movement steps. Every movement pattern was performed twice to assess the effect of repetition on eye movement. Participants were required to recall the movement patterns for recall accuracy evaluation and complete cognitive load assessment. EEDT was quantified by the fixation duration and frequency within the areas of eye before arrow. When task difficulty increased, we found the recall accuracy score decreased, the cognitive load increased, and EEDT decreased significantly. The EEDT was higher in the second trial, but significance only existed in tasks with lower complexity. EEDT was positively correlated with recall accuracy and negatively correlated with cognitive load. Performing EEDT was reduced by task complexity and increased by task repetition. EEDT may be a promising sensory measure for assessing task performance and cognitive load and can be used for the future development of eye-tracking-based sensors.

Gaze patterns reflect the retrieval and selection of memories in a context-dependent object location retrieval task

Selective retrieval of context-relevant memories is critical for animal survival. A behavioral index that captures its dynamic nature in real time is necessary to investigate this retrieval process. Here, we found a bias in eye gaze towards the locations previously associated with individual objects during retrieval. Participants learned two locations associated with each visual object and recalled one of them indicated by a contextual cue in the following days. Before the contextual cue presentation, participants often gazed at both locations associated with the given object on the background screen (look-at-both), and the frequency of look-at-both gaze pattern increased as learning progressed. Following the cue presentation, their gaze shifted toward the context-appropriate location. Interestingly, participants showed a higher accuracy of memory retrieval in trials where they gazed at both object-associated locations, implying functional advantage of the look-at-both gaze patterns. Our findings indicate that naturalistic eye movements reflect the dynamic process of memory retrieval and selection, highlighting the potential of eye gaze as an indicator for studying these cognitive processes.

Spontaneous eye movements reflect the representational geometries of conceptual spaces

Functional neuroimaging studies indicate that the human brain can represent concepts and their relational structure in memory using coding schemes typical of spatial navigation. However, whether we can read out the internal representational geometries of conceptual spaces solely from human behavior remains unclear. Here, we report that the relational structure between concepts in memory might be reflected in spontaneous eye movements during verbal fluency tasks: When we asked participants to randomly generate numbers, their eye movements correlated with distances along the left-to-right one-dimensional geometry of the number space (mental number line), while they scaled with distance along the ring-like two-dimensional geometry of the color space (color wheel) when they randomly generated color names. Moreover, when participants randomly produced animal names, eye movements correlated with low-dimensional similarity in word frequencies. These results suggest that the representational geometries used to internally organize conceptual spaces might be read out from gaze behavior.

Recognition memory deficits detected through eye-tracking in well-controlled children with self-limited epilepsy with centrotemporal spikes

OBJECTIVE

Children with self-limited epilepsy characterized by centrotemporal spikes (SeLECTS) exhibit cognitive deficits in memory during the active phase, but there is currently a lack of studies and techniques to assess their memory development after well-controlled seizures. In this study, we employed eye-tracking techniques to investigate visual memory and its association with clinical factors and global intellectual ability, aiming to identify potential risk factors by examining encoding and recognition processes.

METHODS

A total of 26 recruited patients diagnosed with SeLECTS who had been seizure-free for at least 2 years, along with 24 control subjects, underwent Wechsler cognitive assessment and an eye-movement-based memory task while video-electroencephalographic (EEG) data were recorded. Fixation and pupil data related to eye movements were utilized to detect distinct memory processes and subsequently to compare the cognitive performance of patients exhibiting different regression patterns on EEG.

RESULTS

The findings revealed persistent impairments in visual memory among children with SeLECTS after being well controlled, primarily observed in the recognition stage rather than the encoding phase. Furthermore, the age at onset, frequency of seizures, and interictal epileptiform discharges exhibited significant correlations with eye movement data.

SIGNIFICANCE

Children with SeLECTS exhibit persistent recognition memory impairment after being well controlled for the disease. Controlling the frequency of seizures and reducing prolonged epileptiform activity may improve memory cognitive development. The application of the eye-tracking technique may provide novel insights into exploring memory cognition as well as underlying mechanisms associated with pediatric epilepsy.

Overlapping and distinct phenotypic profiles in Alzheimer's disease and late onset epilepsy: a biologically-based approach

Due to shared hippocampal dysfunction, patients with Alzheimer's dementia and late-onset epilepsy (LOE) report memory decline. Multiple studies have described the epidemiological, pathological, neurophysiological, and behavioral overlap between Alzheimer's Disease and LOE, implying a bi-directional relationship. We describe the neurobiological decline occurring at different spatial in AD and LOE patients, which may explain why their phenotypes overlap and differ. We provide suggestions for clinical recognition of dual presentation and novel approaches for behavioral testing that reflect an "inside-out," or biologically-based approach to testing memory. New memory and language assessments could detect-and treat-memory impairment in AD and LOE at an earlier, actionable stage.

Use of eye tracking in medical education

Eye tracking has become increasingly applied in medical education research for studying the cognitive processes that occur during the performance of a task, such as image interpretation and surgical skills development. However, analysis and interpretation of the large amount of data obtained by eye tracking can be confusing. In this article, our intention is to clarify the analysis and interpretation of the data obtained from eye tracking. Understanding the relationship between eye tracking metrics (such as gaze, pupil and blink rate) and cognitive processes (such as visual attention, perception, memory and cognitive workload) is essential. The importance of calibration and how the limitations of eye tracking can be overcome is also highlighted.

Cross-modal associative memory impairment in schizophrenia

Impaired associative memory function in patients with schizophrenia has received considerable attention. However, previous studies have primarily concentrated on unisensory materials, which limits our understanding of the broader implications of this impairment. In this study, we sought to expand on this knowledge by examining two types of associative memory domains in individuals with schizophrenia, leveraging both visual (Vis) and auditory (Aud) materials. A total of 32 patients with schizophrenia and 29 healthy controls were recruited to participate in the study. Each participant participated in an experiment composed of three paradigms in which different abstract materials (Aud-Aud, Aud-Vis, and Vis-Vis) were presented. Subsequently, the discriminability scores of the two groups were calculated and compared in different modal tasks. Results from the study indicated that individuals with schizophrenia demonstrated varying degrees of associative memory dysfunction in both the same and cross-modalities, with the latter having a significantly lower score than healthy controls (t = 4.120, p < 0.001). Additionally, the cross-modal associative memory function was significantly and negatively correlated with the severity of negative symptoms among individuals diagnosed with schizophrenia (r = -0.362, p = 0.042). This study provides evidence of abnormalities in the processing and memorization of information that integrates multiple sensory modalities in individuals with schizophrenia. This is of great significance for further understanding the cognitive symptoms and pathological mechanisms of schizophrenia, potentially guiding the development of relevant interventions and treatment methods.

Prolonged development of forced-choice recognition when targets are paired with non-corresponding lures

Previous research suggests that mnemonic discrimination (i.e., the ability to discriminate between previously encountered and novel stimuli even when they are highly similar) improves substantially during childhood. To further understand the development of mnemonic discrimination during childhood, the current study had 4-year-old children, 6-year-old children, and young adults complete the forced-choice Mnemonic Similarity Task (MST). The forced-choice MST offers a significant advantage in the context of developmental research because it is not sensitive to age-related differences in response criteria and includes three test formats that are theorized to be supported by different cognitive processes. A target (i.e., a previously encountered item) is paired with either a novel item (A-X), a corresponding lure (A-A'; i.e., an item mnemonically similar to the target), or a non-corresponding lure (A-B'; i.e., an item mnemonically similar to a different previously encoded item). We observed that 4-year-olds performed more poorly than 6-year-olds on the A-X and A-A' test formats, whereas both 4- and 6-year-olds performed more poorly than young adults on the A-B' test format. The MINERVA 2.2 computational model effectively accounted for these age-related differences. The model suggested that 4-year-olds have a lower learning rate (i.e., probability of encoding stimulus features) than 6-year-olds and young adults and that both 4- and 6-year-olds have greater encoding variability than young adults. These findings provide new insight into possible mechanisms underlying memory development during childhood and serve as the basis for multiple avenues of future research.

Conscious and unconscious memory and eye movements in context-guided visual search: A computational and experimental reassessment of Ramey, Yonelinas, and Henderson (2019)

Are eye movements unconsciously guided towards target locations in familiar scenes? In a recent eyetracking study, Ramey, Yonelinas, and Henderson (2019) measured eye-movement efficiency (scanpath ratio) and memory judgments when participants searched for targets in repeated and novel scenes. When trials judged new with high confidence were selected, scanpath ratio was lower for old scenes (misses) than for new scenes (correct rejections). In addition, familiarity as measured by recognition confidence did not significantly predict scanpath ratio. Ramey et al. attributed these results to unconscious learning guiding eye movements. In a re-assessment of Ramey et al.'s data, we show that their findings can be accounted for by a single-system computational model in which eye movements and memory judgments are driven by a common latent memory representation. In particular, (a) the scanpath ratio difference between high-confidence misses and correct rejections is a consequence of regression to the mean, while (b) the null correlation between familiarity and scanpath ratio, partly a natural consequence of the low reliability of the scanpath ratio measure, is also reproduced by the model. Two pre-registered experiments confirm a novel prediction of the alternative single-system model. This work offers a parsimonious account of Ramey et al.'s findings without recourse to unconscious guidance of eye movements.

Task-Dependent Visual Behavior in Immersive Environments: A Comparative Study of Free Exploration, Memory and Visual Search

Visual behavior depends on both bottom-up mechanisms, where gaze is driven by the visual conspicuity of the stimuli, and top-down mechanisms, guiding attention towards relevant areas based on the task or goal of the viewer. While this is well-known, visual attention models often focus on bottom-up mechanisms. Existing works have analyzed the effect of high-level cognitive tasks like memory or visual search on visual behavior; however, they have often done so with different stimuli, methodology, metrics and participants, which makes drawing conclusions and comparisons between tasks particularly difficult. In this work we present a systematic study of how different cognitive tasks affect visual behavior in a novel within-subjects design scheme. Participants performed free exploration, memory and visual search tasks in three different scenes while their eye and head movements were being recorded. We found significant, consistent differences between tasks in the distributions of fixations, saccades and head movements. Our findings can provide insights for practitioners and content creators designing task-oriented immersive applications.

Conscious awareness and memory systems in the brain

The term "memory" typically refers to conscious retrieval of events and experiences from our past, but experience can also change our behaviour without corresponding awareness of the learning process or the associated outcome. Based primarily on early neuropsychological work, theoretical perspectives have distinguished between conscious memory, said to depend critically on structures in the medial temporal lobe (MTL), and a collection of performance-based memories that do not. The most influential of these memory systems perspectives, the declarative memory theory, continues to be a mainstay of scientific work today despite mounting evidence suggesting that contributions of MTL structures go beyond the kinds or types of memory that can be explicitly reported. Consistent with these reports, more recent perspectives have focused increasingly on the processing operations supported by particular brain regions and the qualities or characteristics of resulting representations whether memory is expressed with or without awareness. These alternatives to the standard model generally converge on two key points. First, the hippocampus is critical for relational memory binding and representation even without awareness and, second, there may be little difference between some types of priming and explicit, familiarity-based recognition. Here, we examine the evolution of memory systems perspectives and critically evaluate scientific evidence that has challenged the status quo. Along the way, we highlight some of the challenges that researchers encounter in the context of this work, which can be contentious, and describe innovative methods that have been used to examine unconscious memory in the lab. This article is categorized under: Psychology > Memory Psychology > Theory and Methods Philosophy > Consciousness.

Ocular microtremor: a structured review

Ocular microtremor (OMT) is the smallest of three involuntary fixational micro eye movements, which has led to it being under researched in comparison. The link between OMT and brain function generates a strong rationale for further study as there is potential for its use as a biomarker in populations with neurological injury and disease. This structured review focused on populations previously studied, instrumentation used for measurement, commonly reported OMT outcomes, and recommendations concerning protocol design and future studies. Current methods of quantifying OMT will be reviewed to analyze their efficacy and efficiency and guide potential development and understanding of novel techniques. Electronic databases were systematically searched and compared with predetermined inclusion criteria. 216 articles were identified in the search and screened by two reviewers. 16 articles were included for review. Findings showed that piezoelectric probe is the most common method of measuring OMT, with fewer studies involving non-invasive approaches, such as contact lenses and laser imaging. OMT frequency was seen to be reduced during general anesthesia at loss of consciousness and in neurologically impaired participants when compared to healthy adults. We identified the need for a non-invasive technique for measuring OMT and highlight its potential in clinical applications as an objective biomarker for neurological assessments. We highlight the need for further research on the clinical validation of OMT to establish its potential to identify or predict a meaningful clinical or functional state, specifically, regarding accuracy, precision, and reliability of OMT.

Prior knowledge about events depicted in scenes decreases oculomotor exploration

The visual input that the eyes receive usually contains temporally continuous information about unfolding events. Therefore, humans can accumulate knowledge about their current environment. Typical studies on scene perception, however, involve presenting multiple unrelated images and thereby render this accumulation unnecessary. Our study, instead, facilitated it and explored its effects. Specifically, we investigated how recently-accumulated prior knowledge affects gaze behavior. Participants viewed sequences of static film frames that contained several 'context frames' followed by a 'critical frame'. The context frames showed either events from which the situation depicted in the critical frame naturally followed, or events unrelated to this situation. Therefore, participants viewed identical critical frames while possessing prior knowledge that was either relevant or irrelevant to the frames' content. In the former case, participants' gaze behavior was slightly more exploratory, as revealed by seven gaze characteristics we analyzed. This result demonstrates that recently-gained prior knowledge reduces exploratory eye movements.

Relational memory weakness in autism despite the use of a controlled encoding task

Introduction

Recent work challenged past findings that documented relational memory impairments in autism. Previous studies often relied solely on explicit behavioral responses to assess relational memory integrity, but successful performance on behavioral tasks may rely on other cognitive abilities (e.g., executive functioning) that are impacted in some autistic individuals. Eye-tracking tasks do not require explicit behavioral responses, and, further, eye movements provide an indirect measure of memory. The current study examined whether memory-specific viewing patterns toward scenes differ between autistic and non-autistic individuals.

Methods

Using a long-term memory paradigm that equated for complexity between item and relational memory tasks, participants studied a series of scenes. Following the initial study phase, scenes were re-presented, accompanied by an orienting question that directed participants to attend to either features of an item (i.e., in the item condition) or spatial relationships between items (i.e., in the relational condition) that might be subsequently modified during test. At test, participants viewed scenes that were unchanged (i.e., repeated from study), scenes that underwent an "item" modification (an exemplar switch) or a "relational" modification (a location switch), and scenes that had not been presented before. Eye movements were recorded throughout.

Results

During study, there were no significant group differences in viewing directed to regions of scenes that might be manipulated at test, suggesting comparable processing of scene details during encoding. However, there was a group difference in explicit recognition accuracy for scenes that underwent a relational change. Marginal group differences in the expression of memory-based viewing effects during test for relational scenes were consistent with this behavioral outcome, particularly when analyses were limited to scenes recognized correctly with high confidence. Group differences were also evident in correlational analyses that examined the association between study phase viewing and recognition accuracy and between performance on the Picture Sequence Memory Test and recognition accuracy.

Discussion

Together, our findings suggest differences in the integrity of relational memory representations and/or in the relationships between subcomponents of memory in autism.

The effect of memory load on object reconstruction: Insights from an online mouse-tracking task

Why can't we remember everything that we experience? Previous work in the domain of object memory has suggested that our ability to resolve interference between relevant and irrelevant object features may limit how much we can remember at any given moment. Here, we developed an online mouse-tracking task to study how memory load influences object reconstruction, testing participants synchronously over virtual conference calls. We first tested up to 18 participants concurrently, replicating memory findings from a condition where participants were tested individually. Next, we examined how memory load influenced mouse trajectories as participants reconstructed target objects. We found interference between the contents of working memory and what was perceived during object reconstruction, an effect that interacted with visual similarity and memory load. Furthermore, we found interference from previously studied but currently irrelevant objects, providing evidence of object-to-location binding errors. At the greatest memory load, participants were nearly three times more likely to move their mouse cursor over previously studied nontarget objects, an effect observed primarily during object reconstruction rather than in the period before the final response. As evidence of the dynamic interplay between working memory and perception, these results show that object reconstruction behavior may be altered by (i) interference between what is represented in mind and what is currently being viewed, and (ii) interference from previously studied but currently irrelevant information. Finally, we discuss how mouse tracking can provide a rich characterization of participant behavior at millisecond temporal resolution, enormously increasing power in cognitive psychology experiments.

The Development of Flexible Problem Solving: An Integrative Approach

Flexible problem solving, the ability to deal with currently goal-irrelevant information that may have been goal-relevant in previous, similar situations, plays a prominent role in cognitive development and has been repeatedly investigated in developmental research. However, this research, spanning from infancy to the school years, lacks a unifying framework, obscuring the developmental timing of flexible problem solving. Therefore, in this review paper, previous findings are gathered, organized, and integrated under a common framework to unveil how and when flexible problem solving develops. It is showed that the development of flexible problem solving coincides with increases in executive functions, that is, inhibition, working memory and task switching. The analysis of previous findings shows that dealing with goal-irrelevant, non-salient information received far more attention than generalizing in the presence of goal-irrelevant, salient information. The developmental timing of the latter can only be inferred from few transfer studies, as well as executive functions, planning and theory of mind research, to highlight gaps in knowledge and sketch out future research directions. Understanding how transfer in the presence of seemingly relevant but truly irrelevant information develops has implications for well-balanced participation in information societies, early and lifespan education, and investigating the evolutionary trajectory of flexible problem solving.

Computational cross-species views of the hippocampal formation

The discovery of place cells and head direction cells in the hippocampal formation of freely foraging rodents has led to an emphasis of its role in encoding allocentric spatial relationships. In contrast, studies in head-fixed primates have additionally found representations of spatial views. We review recent experiments in freely moving monkeys that expand upon these findings and show that postural variables such as eye/head movements strongly influence neural activity in the hippocampal formation, suggesting that the function of the hippocampus depends on where the animal looks. We interpret these results in the light of recent studies in humans performing challenging navigation tasks which suggest that depending on the context, eye/head movements serve one of two roles-gathering information about the structure of the environment (active sensing) or externalizing the contents of internal beliefs/deliberation (embodied cognition). These findings prompt future experimental investigations into the information carried by signals flowing between the hippocampal formation and the brain regions controlling postural variables, and constitute a basis for updating computational theories of the hippocampal system to accommodate the influence of eye/head movements.

Effect of encoding variability on rejection of non-corresponding lures: Role of retrieval processes

The primary goal of the current study was to assess whether different retrieval processes moderated the effect of encoding variability on accurate performance on the A-B' test format of the forced-choice Mnemonic Similarity Task (MST). Young adults completed the A-B' test format of the forced-choice MST and determined whether their recognition memory judgment was based on recall-to-reject processing, recall-to-accept processing, familiarity, or guessing. When guesses were excluded from correct trials, fixation counts were higher to the A stimulus than the B stimulus at encoding. Contrary to our expectation that greater fixations to the A versus B stimulus at encoding would be associated with reliance on familiarity or recall-to-accept processing and greater fixations to the B versus A stimulus would be associated with recall-to-reject processing, no interaction between the stimulus and the subsequently reported memory process was observed.

The promise of eye-tracking in the detection of concealed memories

There is a need for validated, theory-driven methods for memory detection. We review how physiological, neurophysiological, and oculomotor measures can be utilized to reveal concealed memories. Recent advances and future directions are discussed in light of the potential of eye-tracking to improve detection efficiency and resolve problems in real-world settings.

The influence of stimulus eccentricity on prosaccade outcomes in patients with Alzheimer's Disease dementia at an early stage and amnestic mild cognitive impairment

INTRODUCTION

Prosaccade task is a widely used objective method to evaluate reflexive saccade and visual attention. The study aimed to investigate prosaccade stimulus eccentricity, compare prosaccade parameters in patients with Alzheimer's disease dementia (AD), amnestic mild cognitive impairment (aMCI), and neurotypical adults (NA), and examine the relationship between prosaccade and neuropsychological tests.

METHODS

Thirty patients with AD, 34 with aMCI, and 32 NA were included in the study. Eye movements were recorded with the EyeLink 1000 Plus in the prosaccade task, and this study evaluated cognitive function with comprehensive neuropsychological tests assessing attention, memory, executive function, visuospatial function, and language domains.

RESULTS

The correct saccade rates of patients with AD were significantly lower than NA in the 5^° and 10^° stimulus eccentricities. Patients with AD had significantly longer latencies in the 10° stimulus eccentricity than those with aMCI and NA. Patients with aMCI did not differ in prosaccade performance compared to NA. Prosaccade parameters were significantly correlated with all cognitive domains. As the amplitude of the stimuli increased, the rate of correct saccades decreased, while the express saccade rate, latency, amplitude, and peak velocity increased.

CONCLUSION

Our findings that correct saccade rates and latency may be distinguishing parameters of early AD are promising. This study also found that stimulus eccentricity affects prosaccade measures in AD, MCI, and NA.

Emerging Wearable Biosensor Technologies for Stress Monitoring and Their Real-World Applications

Wearable devices are being developed faster and applied more widely. Wearables have been used to monitor movement-related physiological indices, including heartbeat, movement, and other exercise metrics, for health purposes. People are also paying more attention to mental health issues, such as stress management. Wearable devices can be used to monitor emotional status and provide preliminary diagnoses and guided training functions. The nervous system responds to stress, which directly affects eye movements and sweat secretion. Therefore, the changes in brain potential, eye potential, and cortisol content in sweat could be used to interpret emotional changes, fatigue levels, and physiological and psychological stress. To better assess users, stress-sensing devices can be integrated with applications to improve cognitive function, attention, sports performance, learning ability, and stress release. These application-related wearables can be used in medical diagnosis and treatment, such as for attention-deficit hyperactivity disorder (ADHD), traumatic stress syndrome, and insomnia, thus facilitating precision medicine. However, many factors contribute to data errors and incorrect assessments, including the various wearable devices, sensor types, data reception methods, data processing accuracy and algorithms, application reliability and validity, and actual user actions. Therefore, in the future, medical platforms for wearable devices and applications should be developed, and product implementations should be evaluated clinically to confirm product accuracy and perform reliable research.

Active vision in sight recovery individuals with a history of long-lasting congenital blindness

What we see is intimately linked to how we actively and systematically explore the world through eye movements. However, it is unknown to what degree visual experience during early development is necessary for such systematic visual exploration to emerge. The present study investigated visual exploration behavior in ten human participants whose sight had been restored only in childhood or adulthood, after a period of congenital blindness due to dense bilateral congenital cataracts. Participants freely explored real-world images while their eye movements were recorded. Despite severe residual visual impairments and gaze instability (nystagmus), visual exploration patterns were preserved in individuals with reversed congenital cataract. Modelling analyses indicated that similar to healthy controls, visual exploration in individuals with reversed congenital cataract was based on the low-level (luminance contrast) and high-level (object components) visual content of the images. Moreover, participants used visual short-term memory representations for narrowing down the exploration space. More systematic visual exploration in individuals with reversed congenital cataract was associated with better object recognition, suggesting that active vision might be a driving force for visual system development and recovery. The present results argue against a sensitive period for the development of neural mechanisms associated with visual exploration.SIGNIFICANCE STATEMENTHumans explore the visual world with systematic patterns of eye movements, but it is unknown whether early visual experience is necessary for the acquisition of visual exploration. Here, we show that sight recovery individuals who had been born blind demonstrate highly systematic eye movements while exploring real-world images, despite visual impairments and pervasive gaze instability. In fact, their eye movement patterns were predicted by those of normally sighted controls and models calculating eye movements based on low- and high-level visual features, and they moreover took memory information into account. Since object recognition performance was associated with systematic visual exploration it was concluded that eye movements might be a driving factor for the development of the visual system.

A novel deep learning approach for diagnosing Alzheimer's disease based on eye-tracking data

Eye-tracking technology has become a powerful tool for biomedical-related applications due to its simplicity of operation and low requirements on patient language skills. This study aims to use the machine-learning models and deep-learning networks to identify key features of eye movements in Alzheimer's Disease (AD) under specific visual tasks, thereby facilitating computer-aided diagnosis of AD. Firstly, a three-dimensional (3D) visuospatial memory task is designed to provide participants with visual stimuli while their eye-movement data are recorded and used to build an eye-tracking dataset. Then, we propose a novel deep-learning-based model for identifying patients with Alzheimer's Disease (PwAD) and healthy controls (HCs) based on the collected eye-movement data. The proposed model utilizes a nested autoencoder network to extract the eye-movement features from the generated fixation heatmaps and a weight adaptive network layer for the feature fusion, which can preserve as much useful information as possible for the final binary classification. To fully verify the performance of the proposed model, we also design two types of models based on traditional machine-learning and typical deep-learning for comparison. Furthermore, we have also done ablation experiments to verify the effectiveness of each module of the proposed network. Finally, these models are evaluated by four-fold cross-validation on the built eye-tracking dataset. The proposed model shows 85% average accuracy in AD recognition, outperforming machine-learning methods and other typical deep-learning networks.

Eye-tracking training improves the learning and memory of children with learning difficulty

Children who experience difficulty in learning at mainstream schools usually are provided with remediation classes after school to facilitate their learning. The present study aims to evaluate an innovative eye-tracking training as possible alternative remediation. Our previous findings showed that children who received eye-tracking training demonstrated improved attention and inhibitory control, and the present randomized controlled study aims to evaluate if eye-tracking training can also enhance the learning and memory of children. Fifty-three primary school students with learning difficulty (including autism spectrum disorder, attention-deficit/hyperactivity disorder, specific learning disorder, specific language impairment and borderline intellectual functioning) were recruited and randomly assigned to either the Eye-tracking Training group or the after-school remediation class. They were assessed on their learning and memory using the Hong Kong List Learning Test before and after 8-month training. Twenty weekly parallel sessions of training, 50 min per session, were provided to each group. Children who received the eye-tracking training, not those in the control group, showed a significant improvement in memory as measured by the delayed recall. In addition, the Eye-Tracking Training group showed significantly faster learning than the control group. Also, the two groups showed a significant improvement in their reading abilities. In sum, eye-tracking training may be effective training for enhancing the learning and memory of children with learning difficulties.

The eyes reflect an internal cognitive state hidden in the population activity of cortical neurons

Decades of research have shown that global brain states such as arousal can be indexed by measuring the properties of the eyes. The spiking responses of neurons throughout the brain have been associated with the pupil, small fixational saccades, and vigor in eye movements, but it has been difficult to isolate how internal states affect the eyes, and vice versa. While recording from populations of neurons in the visual and prefrontal cortex (PFC), we recently identified a latent dimension of neural activity called "slow drift," which appears to reflect a shift in a global brain state. Here, we asked if slow drift is correlated with the action of the eyes in distinct behavioral tasks. We recorded from visual cortex (V4) while monkeys performed a change detection task, and PFC, while they performed a memory-guided saccade task. In both tasks, slow drift was associated with the size of the pupil and the microsaccade rate, two external indicators of the internal state of the animal. These results show that metrics related to the action of the eyes are associated with a dominant and task-independent mode of neural activity that can be accessed in the population activity of neurons across the cortex.

Unrestricted eye movements strengthen effective connectivity from hippocampal to oculomotor regions during scene construction

Scene construction is a key component of memory recall, navigation, and future imagining, and relies on the medial temporal lobes (MTL). A parallel body of work suggests that eye movements may enable the imagination and construction of scenes, even in the absence of external visual input. There are vast structural and functional connections between regions of the MTL and those of the oculomotor system. However, the directionality of connections between the MTL and oculomotor control regions, and how it relates to scene construction, has not been studied directly in human neuroimaging. In the current study, we used dynamic causal modeling (DCM) to interrogate effective connectivity between the MTL and oculomotor regions using a scene construction task in which participants' eye movements were either restricted (fixed-viewing) or unrestricted (free-viewing). By omitting external visual input, and by contrasting free- versus fixed- viewing, the directionality of neural connectivity during scene construction could be determined. As opposed to when eye movements were restricted, allowing free-viewing during construction of scenes strengthened top-down connections from the MTL to the frontal eye fields, and to lower-level cortical visual processing regions, suppressed bottom-up connections along the visual stream, and enhanced vividness of the constructed scenes. Taken together, these findings provide novel, non-invasive evidence for the underlying, directional, connectivity between the MTL memory system and oculomotor system associated with constructing vivid mental representations of scenes.

A corollary discharge mediates saccade-related inhibition of single units in mnemonic structures of the human brain

Despite the critical link between visual exploration and memory, little is known about how neuronal activity in the human mesial temporal lobe (MTL) is modulated by saccades. Here, we characterize saccade-associated neuronal modulations, unit-by-unit, and contrast them to image onset and to occipital lobe neurons. We reveal evidence for a corollary discharge (CD)-like modulatory signal that accompanies saccades, inhibiting/exciting a unique population of broad-/narrow-spiking units, respectively, before and during saccades and with directional selectivity. These findings comport well with the timing, directional nature, and inhibitory circuit implementation of a CD. Additionally, by linking neuronal activity to event-related potentials (ERPs), which are directionally modulated following saccades, we recontextualize the ERP associated with saccades as a proxy for both the strength of inhibition and saccade direction, providing a mechanistic underpinning for the more commonly recorded saccade-related ERP in the human brain.

Emotion schema effects on associative memory differ across emotion categories at the behavioural, physiological and neural level: Emotion schema effects on associative memory differs for disgust and fear

Previous behavioural and neuroimaging studies have consistently reported that memory is enhanced for associations congruent or incongruent with the structure of prior knowledge, termed as schemas. However, it remains unclear if similar effects arise with emotion-related associations, and whether they depend on the type of emotions. Here, we addressed this question using a novel face-word pair association paradigm combined with fMRI and eye-tracking techniques. In two independent studies, we demonstrated and replicated that both congruency with emotion schemas and emotion category interact to affect associative memory. Overall, memory retrieval was higher for faces from pairs congruent vs. incongruent with emotion schemas, paralleled by a greater recruitment of left inferior frontal gyrus (IFG) during successful encoding. However, emotion schema effects differed across two negative emotion categories. Disgust was remembered better than fear, and only disgust activated left IFG stronger during encoding of congruent vs. incongruent pairs, suggestive of deeper semantic processing for the associations. On the contrary, encoding of congruent fear vs. disgust-related pairs was accompanied with greater activity in right fusiform gyrus (FG), suggesting a stronger sensory processing of faces. In addition, successful memory formation for congruent disgust pairs was associated with a higher pupil dilation index related to sympathetic activation, longer gaze time on words compared to faces, and more gaze switches between paired words and faces. This was reversed for fear-related congruent pairs where the faces attracted longer gaze time (compared to words). Overall, our results provide converging evidence from behavioural, physiological, and neural measures to suggest that congruency with available emotion schemas influence memory associations in a similar manner to semantic schemas. However, these effects vary across distinct emotion categories, pointing to a differential role of semantic processing and visual attention processes in the modulation of memory by disgust and fear, respectively.

Preserved Extra-Foveal Processing of Object Semantics in Alzheimer's Disease

Alzheimer's disease (AD) patients underperform on a range of tasks requiring semantic processing, but it is unclear whether this impairment is due to a generalised loss of semantic knowledge or to issues in accessing and selecting such information from memory. The objective of this eye-tracking visual search study was to determine whether semantic expectancy mechanisms known to support object recognition in healthy adults are preserved in AD patients. Furthermore, as AD patients are often reported to be impaired in accessing information in extra-foveal vision, we investigated whether that was also the case in our study. Twenty AD patients and 20 age-matched controls searched for a target object among an array of distractors presented extra-foveally. The distractors were either semantically related or unrelated to the target (e.g., a car in an array with other vehicles or kitchen items). Results showed that semantically related objects were detected with more difficulty than semantically unrelated objects by both groups, but more markedly by the AD group. Participants looked earlier and for longer at the critical objects when these were semantically unrelated to the distractors. Our findings show that AD patients can process the semantics of objects and access it in extra-foveal vision. This suggests that their impairments in semantic processing may reflect difficulties in accessing semantic information rather than a generalised loss of semantic memory.

The contributions of eye gaze fixations and target-lure similarity to behavioral and fMRI indices of pattern separation and pattern completion

Pattern separation and pattern completion are generally studied in humans using mnemonic discrimination tasks such as the Mnemonic Similarity Task (MST) where participants identify similar lures and repeated items from a series of images. Failures to correctly discriminate lures are thought to reflect a failure of pattern separation and a propensity toward pattern completion. Recent research has challenged this perspective, suggesting that poor encoding rather than pattern completion accounts for the occurrence of false alarm responses to similar lures. In two experiments, participants completed a continuous recognition task version of the MST while eye movement (Experiments 1 and 2) and fMRI data (Experiment 2) were collected. In Experiment 1, we replicated the result that fixation counts at study predicted accuracy on lure trials (consistent with poor encoding predicting mnemonic discrimination performance), but this effect was not observed in our fMRI task. In both experiments, we found that target-lure similarity was a strong predictor of accuracy on lure trials. Further, we found that fMRI activation changes in the hippocampus were significantly correlated with the number of fixations at study for correct but not incorrect mnemonic discrimination judgments when controlling for target-lure similarity. Our findings indicate that while eye movements during encoding predict subsequent hippocampal activation changes for correct mnemonic discriminations, the predictive power of eye movements for activation changes for incorrect mnemonic discrimination trials was modest at best.

Looking for the neural basis of memory

Memory neuroscientists often measure neural activity during task trials designed to recruit specific memory processes. Behavior is championed as crucial for deciphering brain-memory linkages but is impoverished in typical experiments that rely on summary judgments. We criticize this approach as being blind to the multiple cognitive, neural, and behavioral processes that occur rapidly within a trial to support memory. Instead, time-resolved behaviors such as eye movements occur at the speed of cognition and neural activity. We highlight successes using eye-movement tracking with in vivo electrophysiology to link rapid hippocampal oscillations to encoding and retrieval processes that interact over hundreds of milliseconds. This approach will improve research on the neural basis of memory because it pinpoints discrete moments of brain-behavior-cognition correspondence.

Deep Convolutional Symmetric Encoder—Decoder Neural Networks to Predict Students’ Visual Attention

Prediction of visual attention is a new and challenging subject, and to the best of our knowledge, there are not many pieces of research devoted to the anticipation of students’ cognition when solving tests. The aim of this paper is to propose, implement, and evaluate a machine learning method that is capable of predicting saliency maps of students who participate in a learning task in the form of quizzes based on quiz questionnaire images. Our proposal utilizes several deep encoder–decoder symmetric schemas which are trained on a large set of saliency maps generated with eye tracking technology. Eye tracking data were acquired from students, who solved various tasks in the sciences and natural sciences (computer science, mathematics, physics, and biology). The proposed deep convolutional encoder–decoder network is capable of producing accurate predictions of students’ visual attention when solving quizzes. Our evaluation showed that predictions are moderately positively correlated with actual data with a coefficient of 0.547 ± 0.109. It achieved better results in terms of correlation with real saliency maps than state-of-the-art methods. Visual analyses of the saliency maps obtained also correspond with our experience and expectations in this field. Both source codes and data from our research can be downloaded in order to reproduce our results.

New Approach to Intelligence Screening for Children With Global Development Delay Using Eye-Tracking Technology: A Pilot Study

Objective: There has become a consensus for detecting intellectual disability in its early stages and implementing effective intervention. However, there are many difficulties and limitations in the evaluation of intelligence-related scales in low-age children. Eye-tracking technology may effectively solve some of the pain points in the evaluation.

Method: We used an eye-tracking technology for cognitive assessment. The subjects looked at a series of task pictures and short videos, the fixation points of which were recorded by the eye-movement analyzer, and the data were statistically analyzed. A total of 120 children aged between 1.5 and 4 years participated in the study, including 60 typically developing children and 60 children with global development delay, all of whom were assessed via the Bayley scale, Peabody Picture Vocabulary Test (PPVT), and Gesell scale.

Results: Cognitive scores from eye-tracking technology are closely related to the scores of neuropsychological tests, which shows that the technique performs well as an early diagnostic test of children's intelligence.

Conclusions: The results show that children's cognitive development can be quickly screened using eye-tracking technology and that it can track quantitative intelligence scores and sensitively detect intellectual impairment.

Effects of pointing movements on visuospatial working memory in a joint-action condition: Evidence from eye movements

Previous studies showed that (a) performing pointing movements towards to-be-remembered locations enhanced their later recognition, and (b) in a joint-action condition, experimenter-performed pointing movements benefited memory to the same extent as self-performed movements. The present study replicated these findings and additionally recorded participants’ fixations towards studied arrays. Each trial involved the presentation of two consecutive spatial arrays, where each item occupied a different spatial location. The item locations of one array were encoded by mere visual observation (the no-move array), whereas the locations of the other array were encoded by observation plus pointing movements (the move array). Critically, in Experiment 1, participants took turns with the experimenter in pointing towards the move arrays (joint-action condition), while in Experiment 2 pointing was performed only by the experimenter (passive condition). The results showed that the locations of move arrays were recognized better than the locations of no-move arrays in Experiment 1, but not in Experiment 2. The pattern of eye-fixations was in line with behavioral findings, indicating that in Experiment 1, fixations to the locations of move arrays were higher in number and longer in duration than fixations to the locations of no-move arrays, irrespective of the agent who performed the movements. In contrast, no differences emerged in Experiment 2. We propose that, in the joint-action condition, self- and other-performed pointing movements are coded at the same representational level and their functional equivalency is reflected in a similar pattern of eye-fixations.

Saccadic scanpath length: an index for human threat conditioning

Threat-conditioned cues are thought to capture overt attention in a bottom-up process. Quantification of this phenomenon typically relies on cue competition paradigms. Here, we sought to exploit gaze patterns during exclusive presentation of a visual conditioned stimulus, in order to quantify human threat conditioning. To this end, we capitalized on a summary statistic of visual search during CS presentation, scanpath length. During a simple delayed threat conditioning paradigm with full-screen monochrome conditioned stimuli (CS), we observed shorter scanpath length during CS+ compared to CS- presentation. Retrodictive validity, i.e., effect size to distinguish CS+ and CS-, was maximized by considering a 2-s time window before US onset. Taking into account the shape of the scan speed response resulted in similar retrodictive validity. The mechanism underlying shorter scanpath length appeared to be longer fixation duration and more fixation on the screen center during CS+ relative to CS- presentation. These findings were replicated in a second experiment with similar setup, and further confirmed in a third experiment using full-screen patterns as CS. This experiment included an extinction session during which scanpath differences appeared to extinguish. In a fourth experiment with auditory CS and instruction to fixate screen center, no scanpath length differences were observed. In conclusion, our study suggests scanpath length as a visual search summary statistic, which may be used as complementary measure to quantify threat conditioning with retrodictive validity similar to that of skin conductance responses.

Early detection of cognitive decline in mild cognitive impairment and Alzheimer's disease with a novel eye tracking test

Due to an increasing number of dementia patients, the development of a rapid and sensitive method for cognitive assessment is awaited. Here, we examined the usefulness of a novel and short (3 min) eye tracking device to evaluate the cognitive function of normal control (NC, n = 52), mild cognitive impairment (MCI, n = 52), and Alzheimer's disease (AD, n = 70) subjects. Eye tracking total score declined significantly in MCI (**p < 0.01 vs NC) and AD (**p < 0.01 vs NC, ^##p < 0.01 vs MCI), and correlated well with the mini-mental state examination (MMSE) score (r = 0.57, *p < 0.05). Furthermore, the eye tracking test, especially memory and deductive reasoning tasks, effectively discriminated NC, MCI and AD. The present novel eye tracking test clearly discriminated cognitive functions among NC, MCI, and AD subjects, thereby providing an advantage for the early detection of MCI and AD in screening.

Rapid coordination of effective learning by the human hippocampus

Although the human hippocampus is necessary for long-term memory, controversial findings suggest that it may also support short-term memory in the service of guiding effective behaviors during learning. We tested the counterintuitive theory that the hippocampus contributes to long-term memory through remarkably short-term processing, as reflected in eye movements during scene encoding. While viewing scenes for the first time, short-term retrieval operative within the episode over only hundreds of milliseconds was indicated by a specific eye-movement pattern, which was effective in that it enhanced spatiotemporal memory formation. This viewing pattern was predicted by hippocampal theta oscillations recorded from depth electrodes and by shifts toward top-down influence of hippocampal theta on activity within visual perception and attention networks. The hippocampus thus supports short-term memory processing that coordinates behavior in the service of effective spatiotemporal learning.

Encoding and retrieval eye movements mediate age differences in pattern completion

Older adults often mistake new information as 'old', yet the mechanisms underlying this response bias remain unclear. Typically, false alarms by older adults are thought to reflect pattern completion - the retrieval of a previously encoded stimulus in response to partial input. However, other work suggests that age-related retrieval errors can be accounted for by deficient encoding processes. In the present study, we used eye movement monitoring to quantify age-related changes in behavioral pattern completion as a function of eye movements during both encoding and partially cued retrieval. Consistent with an age-related encoding deficit, older adults executed more gaze fixations and more similar eye movements across repeated image presentations than younger adults, and such effects were predictive of subsequent recognition memory. Analysis of eye movements at retrieval further indicated that in response to partial lure cues, older adults reactivated the similar studied image, indexed by the similarity between encoding and retrieval gaze patterns, and did so more than younger adults. Critically, reactivation of encoded image content via eye movements was associated with lure false alarms in older adults, providing direct evidence for a pattern completion bias. Together, these findings suggest that age-related changes in both encoding and retrieval processes, indexed by eye movements, underlie older adults' increased vulnerability to memory errors.

Eye-tracking indices of impaired encoding of visual short-term memory in familial Alzheimer's disease

The basis of visual short-term memory (VSTM) impairments in preclinical Alzheimer's disease (AD) remains unclear. Research suggests that eye movements may serve as indirect surrogates to investigate VSTM. Yet, investigations in preclinical populations are lacking. Fifty-two individuals from a familial Alzheimer's disease (FAD) cohort (9 symptomatic carriers, 17 presymptomatic carriers and 26 controls) completed the "Object-localisation" VSTM task while an eye-tracker recorded eye movements during the stimulus presentation. VSTM function and oculomotor performance were compared between groups and their association during encoding investigated. Compared to controls, symptomatic FAD carriers showed eye movement patterns suggestive of an ineffective encoding and presymptomatic FAD carriers within 6 years of their expected age at symptom onset, were more reliant on the stimuli fixation time to achieve accuracy in the localisation of the target. Consequently, for shorter fixation times on the stimuli, presymptomatic carriers were less accurate at localising the target than controls. By contrast, the only deficits detected on behavioural VSTM function was in symptomatic individuals. Our findings provide novel evidence that encoding processes may be vulnerable and weakened in presymptomatic FAD carriers, most prominently for spatial memory, suggesting a possible explanation for the subtle VSTM impairments observed in the preclinical stages of AD.

Recent updates of eye movement abnormalities in patients with schizophrenia: A scoping review

AIM

Although eye-tracking technology expands beyond capturing eye data just for the sole purpose of ensuring participants maintain their gaze at the presented fixation cross, gaze technology remains of less importance in clinical research. Recently, impairments in visual information encoding processes indexed by novel gaze metrics have been frequently reported in patients with schizophrenia. This work undertakes a scoping review of research on saccadic dysfunctions and exploratory eye movement deficits among patients with schizophrenia. It gathers promising pieces of evidence of eye movement abnormalities in attention-demanding tasks on the schizophrenia spectrum that have mounted in recent years and their outcomes as potential biological markers.

METHODS

The protocol was drafted based on PRISMA for scoping review guidelines. Electronic databases were systematically searched to identify articles published between 2010 and 2020 that examined visual processing in patients with schizophrenia and reported eye movement characteristics as potential biomarkers for this mental illness.

RESULTS

The use of modern eye-tracking instrumentation has been reported by numerous neuroscientific studies to successfully and non-invasively improve the detection of visual information processing impairments among the screened population at risk of and identified with schizophrenia.

CONCLUSIONS

Eye-tracking technology has the potential to contribute to the process of early intervention and more apparent separation of the diagnostic entities, being put together by the syndrome-based approach to the diagnosis of schizophrenia. However, context-processing paradigms should be conducted and reported in equally accessible publications to build comprehensive models.

A short digital eye-tracking assessment predicts cognitive status among adults

Current cognitive assessments suffer from limited scalability and high user burden. This study aimed to (1) examine the relationship between a brief eye-tracking-based visual paired-comparison (VPC) and gold standard cognitive assessments, (2) examine longitudinal stability of the VPC task, (3) determine the ability of the VPC task to differentiate between cognitively normal (CN) individuals and individuals with mild cognitive impairment (MCI). Fifty-five adults (n = 44 CN, n = 11 MCI; 56.4 ± 26.7 years) were tested on two occasions, separated by at least 14 days. Visit 1 included VPC, Montreal Cognitive Assessment (MoCA), Digit Symbol Coding test (DSC), and NIH Toolbox Cognitive Battery (NIHTB-CB). Visit 2 included VPC, DSC, NIHTB-CB, and dual-task (DT). Significant differences existed between baseline VPC scores for CN and MCI groups (p < .001). VPC scores remained stable over time in both groups (p < .05). Significant associations existed between VPC and MoCA (p < .01), DSC (p < .001), and various NIHTB-CB subtests at both time points. The VPC test significantly predicts cognitive outcomes (p < .05), with age and VPC being the only significant predictors. Additionally, area under the curve (receiver operator characteristic = 0.80) for VPC scores demonstrated good classification accuracy. VPC reliably predicted cognitive status while remaining stable over time and displayed significant associations with gold standard cognitive assessments. VPC is a less burdensome and more scalable assessment than traditional tests, enabling longitudinal monitoring of cognitive status in resource-limited environments.

Information stored in memory affects abductive reasoning

Abductive reasoning describes the process of deriving an explanation from given observations. The theory of abductive reasoning (TAR; Johnson and Krems, Cognitive Science 25:903-939, 2001) assumes that when information is presented sequentially, new information is integrated into a mental representation, a situation model, the central data structure on which all reasoning processes are based. Because working memory capacity is limited, the question arises how reasoning might change with the amount of information that has to be processed in memory. Thus, we conducted an experiment (N = 34) in which we manipulated whether previous observation information and previously found explanations had to be retrieved from memory or were still visually present. Our results provide evidence that people experience differences in task difficulty when more information has to be retrieved from memory. This is also evident in changes in the mental representation as reflected by eye tracking measures. However, no differences are found between groups in the reasoning outcome. These findings suggest that individuals construct their situation model from both information in memory as well as external memory stores. The complexity of the model depends on the task: when memory demands are high, only relevant information is included. With this compensation strategy, people are able to achieve similar reasoning outcomes even when faced with tasks that are more difficult. This implies that people are able to adapt their strategy to the task in order to keep their reasoning successful.

Functional Use of Eye Movements for an Acting System

Movements of the eyes assist vision and support hand and body movements in a cooperative way. Despite their strong functional coupling, different types of movements are usually studied independently. We integrate knowledge from behavioral, neurophysiological, and clinical studies on how eye movements are coordinated with goal-directed hand movements and how they facilitate motor learning. Understanding the coordinated control of eye and hand movements can provide important insights into brain functions that are essential for performing or learning daily tasks in health and disease. This knowledge can also inform applications such as robotic manipulation and clinical rehabilitation.

Foliage colors improve relaxation and emotional status of university students from different countries

The therapeutic advantages of seeing plants have gained increasing consideration in stressful modern societies, however, evidence-based studies on how physiological and emotional states of individuals from different nationalities change when seeing different foliage colors are limited. The study was conducted to explore the physiological and psychological advantages of foliage colors as visual stimuli. The experiment included 40 men from two nations (age: 21.34 ± 3.50 years) and was carried out using five foliage colors including green, light green, green-yellow, green-red and green-white. Participants were exposed to each color for 2 min, when seeing the foliage colors, eye movements and oxy-Hb concentrations were continuously measured. Subjective evaluations of emotions were performed utilizing a semantic differential questionnaire. A significant decrease in oxy-Hb concentration in the frontal lobe was associated with the viewing of green and green-white plants by the Japanese participants and with viewing light green and green-yellow by the Egyptian participants. Participants spent higher fixation numbers and longer durations on these colors. The findings indicate that viewing of these plant colors was positively associated with physiological relaxation. Furthermore, these colors were associated with more positive feelings, such as calmness, comfort and naturalness. Therefore, the presence of these colors in spaces may have positive impacts on relaxation and emotional status.

Validation of virtual reality system based on eye-tracking technologies to support clinical assessment of glaucoma

AIM

The aim was to develop and implement a virtual reality tool based on eye-tracking technologies that allow to evaluate the characteristics of the gaze patterns of glaucoma patients in order to have a better understanding of the limitations that these patients experience in their daily life.

SETTING

This study took place on the Ophthalmology department of Hospital Clínico San Carlos, Madrid, Spain.

METHODS

In total, 56 participants collaborated in the study. They were divided in two groups, a group composed of 33 glaucoma patients selected by the Ophthalmology department and a control group composed of 23 healthy individuals. Both groups completed two virtual tasks while their gaze was being monitored. The first task, defined as "static" consisted in two exercises based on the observation of images. The second task, defined as "dynamic," consisted in a virtual driving simulator. Number of fixations, fixations duration, saccades amplitude and velocity, fixations/saccades ratio, total execution time, and other specific metrics were measured. These are the total search time for the second exercise of the first task and the number of collisions for the dynamic task. In addition, the dispersion of fixations was also discussed.

RESULTS

For the two exercises of the static task, patients exhibited significative differences in terms of number of fixations (p = 0.012 in free observation exercise), mean saccadic velocity (p = 0.023 and 0.017), fixations/saccades ratio (p = 0.035 and 0.04), and also the search and total execution times of the visual search exercise (p = 0.004 and 0.027, respectively). For the dynamic task, significative differences were found on average saccades amplitude (p = 0.02), average saccades velocity (p = 0.03), and the number of collisions (p = 0.02).

CONCLUSION

The results show that eye-tracking technologies can be used as a tool for evaluating the gaze patterns of glaucoma patients and differentiate them of healthy individuals. However, further studies with a larger cohort of participants and additional tasks are needed.

Restricting Visual Exploration Directly Impedes Neural Activity, Functional Connectivity, and Memory

We move our eyes to explore the visual world, extract information, and create memories. The number of gaze fixations-the stops that the eyes make-has been shown to correlate with activity in the hippocampus, a region critical for memory, and with later recognition memory. Here, we combined eyetracking with fMRI to provide direct evidence for the relationships between gaze fixations, neural activity, and memory during scene viewing. Compared to free viewing, fixating a single location reduced: 1) subsequent memory, 2) neural activity along the ventral visual stream into the hippocampus, 3) neural similarity between effects of subsequent memory and visual exploration, and 4) functional connectivity among the hippocampus, parahippocampal place area, and other cortical regions. Gaze fixations were uniquely related to hippocampal activity, even after controlling for neural effects due to subsequent memory. Therefore, this study provides key causal evidence supporting the notion that the oculomotor and memory systems are intrinsically related at both the behavioral and neural level. Individual gaze fixations may provide the basic unit of information on which memory binding processes operate.