Eye movements during information processing tasks: individual differences and cultural effects

Exploring power-law behavior in human gaze shifts across tasks and populations

Visual perception is an integral part of human cognition. Vision comprises sampling information and processing them. Tasks and stimuli influence human sampling behavior, while cognitive and neurological processing mechanisms remain unchanged. A question still controversial today is whether the components interact with each other. Some theories see the components of visual cognition as separate and their influence on gaze behavior as additive. Others see gaze behavior as an emergent structure of visual cognition that emerges through multiplicative interactions. One way to approach this problem is to examine the magnitude of gaze shifts. Demonstrating that gaze shifts show a constant behavior across tasks would argue for the existence of an independent component in human visual behavior. However, studies attempting to generally describe gaze shift magnitudes deliver contradictory results. In this work, we analyze data from numerous experiments to advance the debate on visual cognition by providing a more comprehensive view of visual behavior. The data show that the magnitude of eye movements, also called saccades, cannot be described by a consistent distribution across different experiments. However, we also propose a new way of measuring the magnitude of saccades: relative saccade lengths. We find that a saccade's length relative to the preceding saccade's length consistently follows a power-law distribution. We observe this distribution for all datasets we analyze, regardless of the task, stimulus, age, or native language of the participants. Our results indicate the existence of an independent component utilized by other cognitive processes without interacting with them. This suggests that a part of human visual cognition is based on an additive component that does not depend on stimulus features.

Neural correlates for word-frequency effect in Chinese natural reading

Word frequency effect has always been of interest for reading research because of its critical role in exploring mental processing underlying reading behaviors. Access to word frequency information has long been considered an indicator of the beginning of lexical processing and the most sensitive marker for studying when the brain begins to extract semantic information Sereno & Rayner, Brain and Cognition, 42, 78-81, (2000), Trends in Cognitive Sciences, 7, 489-493, (2003). While the word frequency effect has been extensively studied in numerous eye-tracking and traditional EEG research using the RSVP paradigm, there is a lack of corresponding evidence in studies of natural reading. To find the neural correlates of the word frequency effect, we conducted a study of Chinese natural reading using EEG and eye-tracking coregistration to examine the time course of lexical processing. Our results reliably showed that the word frequency effect first appeared in the N200 time window and the bilateral occipitotemporal regions. Additionally, the word frequency effect was reflected in the N400 time window, spreading from the occipital region to the central parietal and frontal regions. Our current study provides the first neural correlates for word-frequency effect in natural Chinese reading so far, shedding new light on understanding lexical processing in natural reading and could serve as an important basis for further reading study when considering neural correlates in a realistic manner.

Early visual modulation and selection predict saccadic timing during visual search: An ERP study

Saccadic eye movements, a critical aspect of real-world visual behavior, are preceded by an initial accumulation of visual information followed by the selection of a single location to move one's eyes. However, it is currently unclear how each of these stages uniquely affects saccadic timing. In this study, participants searched for a contour integration target while EEG was used to measure posterior cortical activity between search display onset and first saccade initiation. The goal was to determine whether saccade timing could be attributed to differences in early ERP amplitudes, with the P1 reflecting the magnitude of early perceptual information accumulation and the N1 reflecting the strength of selection leading to the saccadic decision. EOG was used to measure saccade timing, and trials were divided into fast, middle, and slow bins. The N1 response was smallest in the slow saccade tertile, relative to both the fast and middle tertiles, suggesting weak selection. In contrast, the P1 response was largest for this same slow saccadic tertile relative to the middle saccadic tertile, suggesting vigorous information accumulation. Therefore, delays in saccadic behavior may occur when the visual system is overwhelmed with visual input, thus increasing the time to reach a saccadic decision. These findings reconcile models of eye movement behavior which often prioritize either the impact of information accrual or selection, rather than regarding both as an integrated whole.

Tasks Reflected in the Eyes: Egocentric Gaze-Aware Visual Task Type Recognition in Virtual Reality

With eye tracking finding widespread utility in augmented reality and virtual reality headsets, eye gaze has the potential to recognize users' visual tasks and adaptively adjust virtual content displays, thereby enhancing the intelligence of these headsets. However, current studies on visual task recognition often focus on scene-specific tasks, like copying tasks for office environments, which lack applicability to new scenarios, e.g., museums. In this paper, we propose four scene-agnostic task types for facilitating task type recognition across a broader range of scenarios. We present a new dataset that includes eye and head movement data recorded from 20 participants while they engaged in four task types across 15 360-degree VR videos. Using this dataset, we propose an egocentric gaze-aware task type recognition method, TRCLP, which achieves promising results. Additionally, we illustrate the practical applications of task type recognition with three examples. Our work offers valuable insights for content developers in designing task-aware intelligent applications. Our dataset and source code are available at zhimin-wang.github.io/TaskTypeRecognition.html.

Visual search in infantile nystagmus syndrome

CLINICAL RELEVANCE

Research on infantile nystagmus syndrome (INS) and visual search is limited. Conducting this research could assist practitioners in understanding how INS affects the real-life visual activities of patients and aid in developing new clinical visual function assessments for INS.

BACKGROUND

The aim of this work is to investigate how subjects with INS perform visual search tasks, and, particularly, to assess how INS subjects perform when targets are located at their null position or away from it, and when under additional cognitive demands.

METHODS

INS subjects (N = 15) and controls (N = 20) performed conjunction and feature search tasks, both with and without mental arithmetic. Search performance was assessed using log-transformed total search time, gaze-dependent search time, and accuracy. Cognitive demand was quantified by pupil size and the NASA task-load index score.

RESULTS

INS subjects showed longer search times compared to controls in conjunction search (P < 0.01), but not in feature search. Within INS and control subjects, the total search times were significantly increased by the addition of mental arithmetic (P < 0.0001). There was no difference in gaze-dependent search times between null target position and 15° away from null target position of subjects in conjunction search (P > 0.05). Accuracies were 100% for both control and INS subjects in both conjunction and feature search.

CONCLUSION

Conjunction visual search was impaired in adult INS subjects, and further worsened under increased cognitive demand. The null position did not affect the visual search performance in INS.

Oculomotor Patterns in Children with Poor Reading Abilities Measured Using the Development Eye Movement Test

Objectives: The main purpose of this work was to clinically assess the oculomotricity of one hundred Mexican children with poor reading skills but without any specific learning disorder. Methods: The D.E.M. psychometric test was used. Sex and age analyses of the ratio, type, horizontal and vertical performance, and errors were carried out. Results: Our data suggest that 84% of poor readers exhibit oculomotor difficulties. Sex did not significantly influence the results (p > 0.05), whereas age was associated with the horizontal (p = 0.04) and vertical (p = 0.29) performance, as well as the number of errors (p = 0.001). Omissions were the most prevalent error type. Conclusions: This research gives insights into the role of oculomotricity in children with poor reading skills. Our results suggest that oculomotor performance should be included in the evaluation protocol to assess poor readers to identify any influence of the visual system.

Gaze and behavioural metrics in the refractive correction of presbyopia

PURPOSE

To investigate gaze and behavioural metrics at different viewing distances with multifocal contact lenses (MFCLs), single vision contact lenses (SVCLs) and progressive addition lenses (PALs).

METHODS

Fifteen presbyopic contact lens wearers participated over five separate study visits. At each visit, participants were randomly assigned to wear one of five refractive corrections: habitual PAL spectacles, delefilcon A (Alcon Inc.) MFCLs and three separate pairs of delefilcon A single vision lenses worn as distance, intermediate and near corrections. Participants wore a Pupil Core headset to record eye and head movements while performing three visual tasks: reading, visual search and scene observation. Data were investigated using linear regression and post-hoc testing. Parameters of interest included gaze (fixation duration, head movement) and behavioural (reading speed, reading accuracy, visual search time) metrics.

RESULTS

Reading speed in SVCLs was significantly faster than in MFCLs and PAL spectacles (F = 16.3, p < 0.0001). Refractive correction worn did not influence visual search times (F = 0.16, p = 0.85). Fixation duration was significantly affected by the type of visual task (F = 60.2, p < 0.001), and an interaction effect was observed between viewing distance and refractive correction (F = 4.3, p = 0.002). There was significantly more horizontal and vertical head movement (F = 3.2, p = 0.01 and F = 3.3, p = 0.01, respectively) during visual search tasks when wearing PAL spectacles compared to SVCLs or MFCLs.

CONCLUSION

This work showed that the type of refractive correction affects behavioural metrics such as reading speed and gaze behaviour by affecting horizontal and vertical head movements. The findings of this study suggest that under certain conditions, wearers of MFCLs make fewer head movements compared to PAL spectacles. Gaze behaviour metrics offer a new approach to compare and understand contact lens and spectacle performance, with potential applications including peripheral optical designs for myopia management.

Grandiose narcissism associates with higher cognitive performance under stress through more efficient attention distribution: An eye-tracking study

Narcissism is a part of the Dark Triad that consists also of the traits of Machiavellianism and psychopathy. Two main types of narcissism exist: grandiose and vulnerable narcissism. Being a Dark Triad trait, narcissism is typically associated with negative outcomes. However, recent research suggests that at least the grandiose type may be linked (directly or indirectly) to positive outcomes including lower levels of psychopathology, higher school grades in adolescents, deeper and more strategic learning in university students and higher cognitive performance in experimental settings. The current pre-registered, quasi-experimental study implemented eye-tracking to assess whether grandiose narcissism indirectly predicts cognitive performance through wider distribution of attention on the Raven's Progressive Matrices task. Fifty-four adults completed measures of the Dark Triad, self-esteem and psychopathology. Eight months to one year later, participants completed the Raven's, while their eye-movements were monitored during high stress conditions. When controlling for previous levels of psychopathology, grandiose narcissism predicted higher Raven's scores indirectly, through increased variability in the number of fixations across trials. These findings suggest that grandiose narcissism predicts higher cognitive performance, at least in experimental settings, and call for further research to understand the implications of this seemingly dark trait for performance across various settings.

Oculomotor routines for perceptual judgments

In everyday life we frequently make simple visual judgments about object properties, for example, how big or wide is a certain object? Our goal is to test whether there are also task-specific oculomotor routines that support perceptual judgments, similar to the well-established exploratory routines for haptic perception. In a first study, observers saw different scenes with two objects presented in a photorealistic virtual reality environment. Observers were asked to judge which of two objects was taller or wider while gaze was tracked. All tasks were performed with the same set of virtual objects in the same scenes, so that we can compare spatial characteristics of exploratory gaze behavior to quantify oculomotor routines for each task. Width judgments showed fixations around the center of the objects with larger horizontal spread. In contrast, for height judgments, gaze was shifted toward the top of the objects with larger vertical spread. These results suggest specific strategies in gaze behavior that presumably are used for perceptual judgments. To test the causal link between oculomotor behavior and perception, in a second study, observers could freely gaze at the object or we introduced a gaze-contingent setup forcing observers to fixate specific positions on the object. Discrimination performance was similar between free-gaze and the gaze-contingent conditions for width and height judgments. These results suggest that although gaze is adapted for different tasks, performance seems to be based on a perceptual strategy, independent of potential cues that can be provided by the oculomotor system.

An updating-based working memory load alters the dynamics of eye movements but not their spatial extent during free viewing of natural scenes

The relationship between spatial deployments of attention and working memory load is an important topic of study, with clear implications for real-world tasks such as driving. Previous research has generally shown that attentional breadth broadens under higher load, while exploratory eye-movement behaviour also appears to change with increasing load. However, relatively little research has compared the effects of working memory load on different kinds of spatial deployment, especially in conditions that require updating of the contents of working memory rather than simple retrieval. The present study undertook such a comparison by measuring participants' attentional breadth (via an undirected Navon task) and their exploratory eye-movement behaviour (a free-viewing recall task) under low and high updating working memory loads. While spatial aspects of task performance (attentional breadth, and peripheral extent of image exploration in the free-viewing task) were unaffected by the load manipulation, the exploratory dynamics of the free-viewing task (including fixation durations and scan-path lengths) changed under increasing load. These findings suggest that temporal dynamics, rather than the spatial extent of exploration, are the primary mechanism affected by working memory load during the spatial deployment of attention. Further, individual differences in exploratory behaviour were observed on the free-viewing task: all metrics were highly correlated across working memory load blocks. These findings suggest a need for further investigation of individual differences in eye-movement behaviour; potential factors associated with these individual differences, including working memory capacity and persistence versus flexibility orientations, are discussed.

Autobiographical Implicit Association Test and eye movements: fixations topography enables detection of autobiographical memories

Introduction

Autobiographical memory is the capacity to recollect memories of personally experienced events. The detection of such memories plays a key role in criminal trials. Among behavioral memory-detection methods, the autobiographical Implicit Association Test (aIAT) has gained popularity for its flexibility and suitability for forensic applications. The aIAT is a reaction time-based methodology aiming to assess whether information about an event is encoded in the respondent's mind. Here, we introduced the eye-D index, a measure based on the topography of fixations while performing the aIAT, as an additional measure to detect autobiographical memories covertly.

Methods

In this study, participants were involved in a mock-crime experiment in which they could act as Guilty or Innocent. One week later all participants underwent the aIAT combined with eye-tracking to investigate the presence of the crime-related memory.

Results

Guilty participants showed a higher number of fixations towards the category labels in the block in which true sentences shared the same response key with crime-related sentences, as compared to the block in which true sentences were paired with sentences describing an alternative version. Innocent participants showed the opposite pattern. This unbalanced allocation of attention to the category labels was quantified by the eye-D index and was found to be highly correlated to the standard aIAT-D index.

Discussion

This suggests that more fixations to the category labels could indicate increased cognitive load and monitoring of response conflicts. These preliminary results highlight eye-tracking as a tool to detect autobiographical memories covertly while performing the aIAT.

Effect of ethnic diversity on the saccadic reaction time among healthy Indian and Dutch adults

Eye movement perimetry (EMP) expresses the decline in visual field (VF) responsiveness based on the deviation in saccadic reaction times (SRTs) from their expected age-similar responses (normative database). Since ethnic dissimilarities tend to affect saccade parameters, we evaluated the effect of such a factor on SRT and its interaction with age, stimulus eccentricity, and intensity. 149 healthy adults, spread into five age groups, drawn from Indian and Dutch ethnicities underwent a customized EMP protocol integrated with a saccade task from which the SRTs to 'seen' visual stimuli were computed. The EMP test had a total of 54 coordinates (five stimulus eccentricities) tested using Goldmann size III visual stimuli presented at four stimulus intensity (SI) levels against a constant background. Considering SRT as a dependent variable, a Generalized Linear Mixed Model analysis was conducted that revealed a statistically significant (p < 0.001) influence of ethnicity and interaction between the tested factors (ethnicity × age × stimulus eccentricity × intensity). However, during the post hoc analysis, out of the 100 possible pair-wise comparisons, only 6% (minor proportion) of the estimates showed statistical significance. Hence, the ethnic-specific differences need not be accounted for while implementing EMP in a diverse set of populations instead a collective database might serve the purpose.

Differences in eye movements for face recognition between Canadian and Chinese participants are not modulated by social orientation

Face recognition strategies do not generalize across individuals. Many studies have reported robust cultural differences between West Europeans/North Americans and East Asians in eye movement strategies during face recognition. The social orientation hypothesis posits that individualistic vs. collectivistic (IND/COL) value systems, respectively defining West European/North American and East Asian societies, would be at the root of many cultural differences in visual perception. Whether social orientation is also responsible for such cultural contrast in face recognition remains to be clarified. To this aim, we conducted two experiments with West European/North American and Chinese observers. In Experiment 1, we probed the existence of a link between IND/COL social values and eye movements during face recognition, by using an IND/COL priming paradigm. In Experiment 2, we dissected the latter relationship in greater depth, by using two IND/COL questionnaires, including subdimensions to those concepts. In both studies, cultural differences in fixation patterns were revealed between West European/North American and East Asian observers. Priming IND/COL values did not modulate eye movement visual sampling strategies, and only specific subdimensions of the IND/COL questionnaires were associated with distinct eye-movement patterns. Altogether, we show that the typical contrast between IND/COL cannot fully account for cultural differences in eye movement strategies for face recognition. Cultural differences in eye movements for faces might originate from mechanisms distinct from social orientation.

GECO-CN: Ghent Eye-tracking COrpus of sentence reading for Chinese-English bilinguals

The current work presents the very first eye-tracking corpus of natural reading by Chinese-English bilinguals, whose two languages entail different writing systems and orthographies. Participants read an entire novel in these two languages, presented in paragraphs on screen. Half of the participants first read half of the novel in their native language (Simplified Chinese) and then the rest of the novel in their second language (English), while the other half read in the reverse language order. This article presents some important basic descriptive statistics of reading times and compares the difference between reading in the two languages. However, this unique eye-tracking corpus also allows the exploration of theories of language processing and bilingualism. Importantly, it provides a solid and reliable ground for studying the difference between Eastern and Western languages, understanding the impact and consequences of having a completely different first language on bilingual processing. The materials are freely available for use by researchers interested in (bilingual) reading.

Test-retest reliability of eye tracking measures in a computerized Trail Making Test

The Trail Making Test (TMT) is a frequently applied neuropsychological test that evaluates participants' executive functions based on their time to connect a sequence of numbers (TMT-A) or alternating numbers and letters (TMT-B). Test performance is associated with various cognitive functions ranging from visuomotor speed to working memory capabilities. However, although the test can screen for impaired executive functioning in a variety of neuropsychiatric disorders, it provides only little information about which specific cognitive impairments underlie performance detriments. To resolve this lack of specificity, recent cognitive research combined the TMT with eye tracking so that eye movements could help uncover reasons for performance impairments. However, using eye-tracking-based test scores to examine differences between persons, and ultimately apply the scores for diagnostics, presupposes that the reliability of the scores is established. Therefore, we investigated the test-retest reliabilities of scores in an eye-tracking version of the TMT recently introduced by Recker et al. (2022). We examined two healthy samples performing an initial test and then a retest 3 days (n = 31) or 10 to 30 days (n = 34) later. Results reveal that, although reliabilities of classic completion times were overall good, comparable with earlier versions, reliabilities of eye-tracking-based scores ranged from excellent (e.g., durations of fixations) to poor (e.g., number of fixations guiding manual responses). These findings indicate that some eye-tracking measures offer a strong basis for assessing interindividual differences beyond classic behavioral measures when examining processes related to information accumulation processes but are less suitable to diagnose differences in eye-hand coordination.

Analytic and holistic cognitive style as a set of independent manifests: Evidence from a validation study of six measurement instruments

Cognitive styles are commonly studied constructs in cognitive psychology. The theory of field dependence-independence was one of the most important cognitive styles. Yet in the past, its measurement had significant shortcomings in validity and reliability. The theory of analytic and holistic cognitive styles attempted to extend this theory and overcome its shortcomings. Unfortunately, the psychometric properties of its measurement methods were not properly verified. Furthermore, new statistical approaches, such as analysis of reaction times, have been overlooked by current research. The aim of this pre-registered study was to verify the psychometric properties (i.e., factor structure, split-half reliability, test-retest reliability, discriminant validity with intelligence and personality, and divergent, concurrent and predictive validity) of several methods routinely applied in the field. We developed/adapted six methods based on self-report questionnaires, rod-and-frame principles, embedded figures, and hierarchical figures. The analysis was conducted on 392 Czech participants, with two data collection waves. The results indicate that the use of methods based on the rod-and-frame principle may be unreliable, demonstrating no absence of association with intelligence. The use of embedded and hierarchical figures is recommended. The self-report questionnaire used in this study showed an unsatisfactory factor structure and also cannot be recommended without futher validation on independent samples. The findings also did not correspond with the original two-dimensional theory.

Working memory control predicts fixation duration in scene-viewing

When viewing scenes, observers differ in how long they linger at each fixation location and how far they move their eyes between fixations. What factors drive these differences in eye-movement behaviors? Previous work suggests individual differences in working memory capacity may influence fixation durations and saccade amplitudes. In the present study, participants (N = 98) performed two scene-viewing tasks, aesthetic judgment and memorization, while viewing 100 photographs of real-world scenes. Working memory capacity, working memory processing ability, and fluid intelligence were assessed with an operation span task, a memory updating task, and Raven's Advanced Progressive Matrices, respectively. Across participants, we found significant effects of task on both fixation durations and saccade amplitudes. At the level of each individual participant, we also found a significant relationship between memory updating task performance and participants' fixation duration distributions. However, we found no effect of fluid intelligence and no effect of working memory capacity on fixation duration or saccade amplitude distributions, inconsistent with previous findings. These results suggest that the ability to flexibly maintain and update working memory is strongly related to fixation duration behavior.

Deep-SAGA: a deep-learning-based system for automatic gaze annotation from eye-tracking data

With continued advancements in portable eye-tracker technology liberating experimenters from the restraints of artificial laboratory designs, research can now collect gaze data from real-world, natural navigation. However, the field lacks a robust method for achieving this, as past approaches relied upon the time-consuming manual annotation of eye-tracking data, while previous attempts at automation lack the necessary versatility for in-the-wild navigation trials consisting of complex and dynamic scenes. Here, we propose a system capable of informing researchers of where and what a user's gaze is focused upon at any one time. The system achieves this by first running footage recorded on a head-mounted camera through a deep-learning-based object detection algorithm called Masked Region-based Convolutional Neural Network (Mask R-CNN). The algorithm's output is combined with frame-by-frame gaze coordinates measured by an eye-tracking device synchronized with the head-mounted camera to detect and annotate, without any manual intervention, what a user looked at for each frame of the provided footage. The effectiveness of the presented methodology was legitimized by a comparison between the system output and that of manual coders. High levels of agreement between the two validated the system as a preferable data collection technique as it was capable of processing data at a significantly faster rate than its human counterpart. Support for the system's practicality was then further demonstrated via a case study exploring the mediatory effects of gaze behaviors on an environment-driven attentional bias.

[Formula: see text] A cross-cultural study of visual attention in autism spectrum disorder

Differences in visual attention have been documented in ASD, and appear linked to clinical symptoms. However, most research has been conducted in Western cultures. Because striking differences in visual attention patterns have been documented in other cultures, it is important to understand how culture may influence attentional patterns in ASD. This study compared differences in visual attention in ASD across Western and East Asian cultures, where differences in attention to contextual and global information have been repeatedly demonstrated, to investigate potential culturally-specific ASD phenotypes. One hundred thirty-two total participants included individuals with ASD (n = 24) and controls (n = 47) from Hong Kong (HK), along with a previously studied group of age- and IQ-comparable participants from the United States (n = 26 ASD; n = 35 control). Gaze was tracked while participants completed two narrative tasks that differed in social-emotional complexity. Proportions of fixations to face, bodies, and setting were examined across groups using linear mixed-effect models and a series of growth curve models. Cultural differences were found across tasks and groups. Both the ASD and control HK groups attended more to global contextual setting information, more to the body regions, and less toward faces of characters compared to US groups. Growth curve models indicated that these differences attenuated over time in certain stimuli. ASD-related effects were only observed in the more complex stimuli depicting characters with ambiguous facial expressions. Findings indicate a notable cultural influence on visual attention patterns in ASD, and underscore the importance of stimuli complexity in differentiating cultural versus diagnostic effects on attentional styles.

Do they 'look' different(ly)? Dynamic face recognition in Malaysians: Chinese, Malays and Indians compared

Previous cross-cultural eye-tracking studies examining face recognition discovered differences in the eye movement strategies that observers employ when perceiving faces. However, it is unclear (1) the degree to which this effect is fundamentally related to culture and (2) to what extent facial physiognomy can account for the differences in looking strategies when scanning own- and other-race faces. In the current study, Malay, Chinese and Indian young adults who live in the same multiracial country performed a modified yes/no recognition task. Participants' recognition accuracy and eye movements were recorded while viewing muted face videos of own- and other-race individuals. Behavioural results revealed a clear own-race advantage in recognition memory, and eye-tracking results showed that the three ethnic race groups adopted dissimilar fixation patterns when perceiving faces. Chinese participants preferentially attended more to the eyes than Indian participants did, while Indian participants made more and longer fixations on the nose than Malay participants did. In addition, we detected statistically significant, though subtle, differences in fixation patterns between the faces of the three races. These findings suggest that the racial differences in face-scanning patterns may be attributed both to culture and to variations in facial physiognomy between races.

Emphasizing speed or accuracy in an eye-tracking version of the Trail-Making-Test: Towards experimental diagnostics for decomposing executive functions

The Trail-Making-Test (TMT) is one of the most widely used neuropsychological tests for assessing executive functions, the brain functions underlying cognitively controlled thought and action. Obtaining a number of test scores at once, the TMT allows to characterize an assortment of executive functions efficiently. Critically, however, as most test scores are derived from test completion times, the scores only provide a summary measure of various cognitive control processes. To address this problem, we extended the TMT in two ways. First, using a computerized eye-tracking version of the TMT, we added specific eye movement measures that deliver a richer set of data with a higher degree of cognitive process specificity. Second, we included an experimental manipulation of a fundamental executive function, namely participants' ability to emphasize speed or accuracy in task performance. Our study of healthy participants showed that eye movement measures differed between TMT conditions that are usually compared to assess the cognitive control process of alternating between task sets for action control. This demonstrates that eye movement measures are indeed sensitive to executive functions implicated in the TMT. Crucially, comparing performance under cognitive control sets of speed vs. accuracy emphasis revealed which test scores primarily varied due to this manipulation (e.g., trial duration, number of fixations), and which were still more sensitive to other differences between individuals (e.g., fixation duration, saccade amplitude). This provided an experimental construct validation of the test scores by distinguishing scores primarily reflecting the executive function of emphasizing speed vs. accuracy and those independent from it. In sum, both the inclusion of eye movement measures and of the experimental manipulation of executive functions in the TMT enabled a more specific interpretation of the TMT in terms of cognitive functions and mechanisms, which offers more precise diagnoses in clinical applications and basic research.

The influence of magnocellular and parvocellular visual information on global processing in White and Asian populations

Humans have the remarkable ability to efficiently group elements of a scene together to form a global whole. However, cross-cultural comparisons show that East Asian individuals process scenes more globally than White individuals. This experiment presents new insights into global processing, revealing the relative contributions of two types of visual cells in mediating global and local visual processing in these two groups. Participants completed the Navon hierarchical letters task under divided-attention conditions, indicating whether a target letter “H” was present in the stimuli. Stimuli were either ‘unbiased’, displayed as black letters on a grey screen, or biased to predominantly process low spatial frequency information using psychophysical thresholds that converted unbiased stimuli into achromatic magnocellular-biased stimuli and red-green isoluminant parvocellular-biased stimuli. White participants processed stimuli more globally than Asian participants when low spatial frequency information was conveyed via the parvocellular pathway, while Asian participants showed a global processing advantage when low spatial frequency information was conveyed via the magnocellular pathway, and to a lesser extent through the parvocellular pathway. These findings suggest that the means by which a global processing bias is achieved depends on the subcortical pathway through which visual information is transmitted, and provides a deeper understanding of the relationship between global/local processing, subcortical pathways and spatial frequencies.

Neural sensitivity to faces is increased by immersion into a novel ethnic environment: Evidence from ERPs

Previous reports suggest that East-Asians may show larger face-elicited N170 components in the ERP as compared to Caucasian participants. Since the N170 can be modulated by perceptual expertise, such group differences may be accounted for by differential experience, for example, with logographic versus alphabetic scripts (script system hypothesis) or by exposure to abundant novel faces during the immersion into a new social and/or ethnic environment (social immersion hypothesis). We conducted experiments in Hong Kong and Berlin, recording ERPs in a series of one-back tasks, using same- and other-ethnicity face stimuli in upright and inverted orientation and doodle stimuli. In Hong Kong we tested local Chinese residents and foreign guest students who could not read the logographic script; in Berlin we tested German residents who could not read the logographic script and foreign Chinese visitors. In both experiments, we found significantly larger N170 amplitudes to faces, regardless of ethnicity, in the foreign than in the local groups. Moreover, this effect did not depend on stimulus orientation, suggesting that the N170 group differences do not reflect differences in configural visual processing. A group of short-term German residents in Berlin did not differ in N170 amplitude from long-term residents. Together, these findings indicate that the extensive confrontation with novel other-ethnicity faces during immersion in a foreign culture may enhance the neural response to faces, reflecting the short-term plasticity of the underlying neural system.

Inhibitory Control of Saccadic Eye Movements and Cognitive Impairment in Mild Cognitive Impairment

Background

Mild cognitive impairment (MCI) may occur due to several forms of neurodegenerative diseases and non-degenerative conditions and is associated with cognitive impairment that does not affect everyday activities. For a timely diagnosis of MCI to prevent progression to dementia, a screening tool of fast, low-cost and easy access is needed. Recent research on eye movement hints it a potential application for the MCI screening. However, the precise extent of cognitive function decline and eye-movement control alterations in patients with MCI is still unclear.

Objective

This study examined executive control deficits and saccade behavioral changes in patients with MCI using comprehensive neuropsychological assessment and interleaved saccade paradigms.

Methods

Patients with MCI (n = 79) and age-matched cognitively healthy controls (HC) (n = 170) completed four saccadic eye-movement paradigms: prosaccade (PS)/antisaccade (AS), Go/No-go, and a battery of neuropsychological tests.

Results

The findings revealed significantly longer latency in patients with MCI than in HC during the PS task. Additionally, patients with MCI had a lower proportion of correct responses and a marked increase in inhibition errors for both PS/AS and Go/No-go tasks. Furthermore, when patients with MCI made errors, they failed to self-correct many of these inhibition errors. In addition to the increase in inhibition errors and uncorrected inhibition errors, patients with MCI demonstrated a trend toward increased correction latencies. We also showed a relationship between neuropsychological scores and correct and error saccade responses.

Conclusion

Our results demonstrate that, similar to patients with Alzheimer’s dementia (AD), patients with MCI generate a high proportion of erroneous saccades toward the prepotent target and fail to self-correct many of these errors, which is consistent with an impairment of inhibitory control and error monitoring.

Significance

The interleaved PS/AS and Go/No-go paradigms are sensitive and objective at detecting subtle cognitive deficits and saccade changes in MCI, indicating that these saccadic eye movement paradigms have clinical potential as a screening tool for MCI.

Cultural Differences in Digital Game Experiences

The literature proposes that East Asians have a holistic view focusing on both salient objects and their backgrounds, whereas Westerners maintain an analytic view paying attention to focal objects and their attributes. Moreover, East Asians stress interdependency of self, while Westerners emphasize independency of self. The current study examined how cultural differences in world views and self-construals influence players' digital game experience, including visual attention, avatar identification, sense of agency, and spatial presence. Supporting the hypotheses, results showed that South Korean participants, compared to European participants, did pay greater attention to background objects, feel greater spatial presence, and lower agency over their avatar. Participants also differed in the association between spatial presence and enjoyment: spatial presence positively predicted enjoyment for South Korean participants, but not for European participants. Theoretical and practical implications of the study are discussed.

Eye movements during text reading align with the rate of speech production

Across languages, the speech signal is characterized by a predominant modulation of the amplitude spectrum between about 4.3 and 5.5 Hz, reflecting the production and processing of linguistic information chunks (syllables and words) every ~200 ms. Interestingly, ~200 ms is also the typical duration of eye fixations during reading. Prompted by this observation, we demonstrate that German readers sample written text at ~5 Hz. A subsequent meta-analysis of 142 studies from 14 languages replicates this result and shows that sampling frequencies vary across languages between 3.9 Hz and 5.2 Hz. This variation systematically depends on the complexity of the writing systems (character-based versus alphabetic systems and orthographic transparency). Finally, we empirically demonstrate a positive correlation between speech spectrum and eye movement sampling in low-skilled non-native readers, with tentative evidence from post hoc analysis suggesting the same relationship in low-skilled native readers. On the basis of this convergent evidence, we propose that during reading, our brain's linguistic processing systems imprint a preferred processing rate-that is, the rate of spoken language production and perception-onto the oculomotor system.

Eye Movements during Dynamic Scene Viewing are Affected by Visual Attention Skills and Events of the Scene: Evidence from First-Person Shooter Gameplay Videos

The role of individual differences during dynamic scene viewing was explored. Participants (N=38) watched a gameplay video of a first-person shooter (FPS) videogame while their eye movements were recorded. In addition, the participants’ skills in three visual attention tasks (attentional blink, visual search, and multiple object tracking) were assessed. The results showed that individual differences in visual attention tasks were associated with eye movement patterns observed during viewing of the gameplay video. The differences were noted in four eye movement measures: number of fixations, fixation durations, saccade amplitudes and fixation distances from the center of the screen. The individual differences showed during specific events of the video as well as during the video as a whole. The results highlight that an unedited, fast-paced and cluttered dynamic scene can bring about individual differences in dynamic scene viewing.

Reward Expectation Differentially Modulates Global and Local Spatial Working Memory Accuracy

Although it has been suggested that reward expectation affects the performance of spatial working memory tasks, controversial results have been found in previous experiments. Hence, it is still unclear to what extent reward expectation has an effect on working memory. To clarify this question, a memory-guided saccade task was applied, in which participants were instructed to retain and reconstruct a temporospatial sequence of four locations by moving their eyes in each trial. The global- and local-level spatial working memory accuracies were calculated to determine the reward effect on the global and local level of processing in spatial working memory tasks. Although high reward expectation enhanced the encoding of spatial information, the percentage of trials in which the cued location was correctly fixated decreased with increment of reward expectation. The reconstruction of the global temporospatial sequence was enhanced by reward expectation, whereas the local reconstruction performance was not affected by reward. Furthermore, the improvements in local representations of uncued locations and local sequences were at the cost of the representation of cued locations. The results suggest that the reward effect on spatial working memory is modulated by the level of processing, which supports the flexible resource theory during maintenance.

Visual exploration dynamics are low-dimensional and driven by intrinsic factors

When looking at visual images, the eyes move to the most salient and behaviourally relevant objects. Saliency and semantic information significantly explain where people look. Less is known about the spatiotemporal properties of eye movements (i.e., how people look). We show that three latent variables explain 60% of eye movement dynamics of more than a hundred observers looking at hundreds of different natural images. The first component explaining 30% of variability loads on fixation duration, and it does not relate to image saliency or semantics; it approximates a power-law distribution of gaze steps, an intrinsic dynamic measure, and identifies observers with two viewing styles: static and dynamic. Notably, these viewing styles were also identified when observers look at a blank screen. These results support the importance of endogenous processes such as intrinsic dynamics to explain eye movement spatiotemporal properties.

Active visual inhibition is preserved in the presence of a distracter: A cross-cultural, ageing and dementia study

The current study investigated a novel visual distracter task as a potential diagnostic marker for the detection of cognitive impairment and the extent to which this compares in healthy ageing across two cultures. The Inhibition of a Recent Distracter Effect (IRD) refers to the inhibition of a saccadic eye movement towards a target that is presented at the location of a previous distracter. Two studies compared the IRD across a large cross-cultural sample comprising of young (N = 75), old European participants (N = 119), old south Asian participants (N = 83), participants with Dementia due to Alzheimer's disease (N = 65) and Mild cognitive impairment (N = 91). Significantly longer saccadic reaction times on the target to distracter trials, in comparison to the target to target trials were evident in all groups and age cohorts. Importantly, the IRD was also preserved in participants with Alzheimer's Disease and mild cognitive impairment demonstrating that the IRD is robust across cultures, age groups and clinical populations. Eye-tracking is increasingly used as a dual diagnostic and experimental probe for the investigation of cognitive control in Alzheimer's disease. As a promising methodology for the early diagnosis of dementia, it is important to understand the cognitive operations in relation to eye-tracking that are well preserved as well as those that are abnormal. Paradigms should also be validated across ethnicity/culture, clinical groups and age cohorts.

Eye movement analysis with hidden Markov models (EMHMM) with co-clustering

The eye movement analysis with hidden Markov models (EMHMM) method provides quantitative measures of individual differences in eye-movement pattern. However, it is limited to tasks where stimuli have the same feature layout (e.g., faces). Here we proposed to combine EMHMM with the data mining technique co-clustering to discover participant groups with consistent eye-movement patterns across stimuli for tasks involving stimuli with different feature layouts. Through applying this method to eye movements in scene perception, we discovered explorative (switching between the foreground and background information or different regions of interest) and focused (mainly looking at the foreground with less switching) eye-movement patterns among Asian participants. Higher similarity to the explorative pattern predicted better foreground object recognition performance, whereas higher similarity to the focused pattern was associated with better feature integration in the flanker task. These results have important implications for using eye tracking as a window into individual differences in cognitive abilities and styles. Thus, EMHMM with co-clustering provides quantitative assessments on eye-movement patterns across stimuli and tasks. It can be applied to many other real-life visual tasks, making a significant impact on the use of eye tracking to study cognitive behavior across disciplines.

Individual differences in first-pass fixation duration in reading are related to resting-state functional connectivity

Although there are considerable individual differences in eye movements during text reading, their neural correlates remain unclear. In this study, we investigated the relationship between the first-pass fixation duration (FPFD) in natural reading and resting-state functional connectivity (RSFC) in the brain. We defined the brain regions associated with early visual processing, word identification, attention shifts, and oculomotor control as seed regions. The results showed that individual FPFDs were positively correlated with individual RSFCs between the early visual network, visual word form area, and eye movement control/dorsal attention network. Our findings provide new evidence on the neural correlates of eye movements in text reading and indicate that individual differences in fixation time may shape the RSFC differences in the brain through the time-on-task effect and the mechanism of Hebbian learning.

Foliage colors improve relaxation and emotional status of university students from different countries

The therapeutic advantages of seeing plants have gained increasing consideration in stressful modern societies, however, evidence-based studies on how physiological and emotional states of individuals from different nationalities change when seeing different foliage colors are limited. The study was conducted to explore the physiological and psychological advantages of foliage colors as visual stimuli. The experiment included 40 men from two nations (age: 21.34 ± 3.50 years) and was carried out using five foliage colors including green, light green, green-yellow, green-red and green-white. Participants were exposed to each color for 2 min, when seeing the foliage colors, eye movements and oxy-Hb concentrations were continuously measured. Subjective evaluations of emotions were performed utilizing a semantic differential questionnaire. A significant decrease in oxy-Hb concentration in the frontal lobe was associated with the viewing of green and green-white plants by the Japanese participants and with viewing light green and green-yellow by the Egyptian participants. Participants spent higher fixation numbers and longer durations on these colors. The findings indicate that viewing of these plant colors was positively associated with physiological relaxation. Furthermore, these colors were associated with more positive feelings, such as calmness, comfort and naturalness. Therefore, the presence of these colors in spaces may have positive impacts on relaxation and emotional status.

Cultural variations in global and local attention and eye-movement patterns during the perception of complex visual scenes: Comparison of Czech and Taiwanese university students

Previous research on cross-cultural differences in visual attention has been inconclusive. Some studies have suggested the existence of systematic differences in global and local attention and context sensitivity, while others have produced negative or mixed results. The objective in this study was to examine the similarities and differences in holistic and analytic cognitive styles in a sample of Czech and Taiwanese university students. Two cognitive tasks were conducted: a Compound Figures Test and a free-viewing scene perception task which manipulated several focal objects and measured eye-movement patterns. An analysis of the reaction times in the Compound Figures Test showed no clear differences between either sample. An analysis of eye-movement metrics showed certain differences between the samples. While Czechs tended to focus relatively more on the focal objects measured by the number of fixations, the Taiwanese subjects spent more time fixating on the background. The results were consistent for scenes with one or two focal objects. The results of a correlation analysis of both tasks showed that they were unrelated. These results showed certain differences between the samples in visual perception but were not as systematic as the theory of holistic and analytic cognitive styles would suggest. An alternative model of cross-cultural differences in cognition and perception is discussed.

Effect of Acute Aerobic Exercise on Ocular Measures of Attention to Emotionally Expressive Faces

BACKGROUND

Mechanisms underlying exercise-induced mood enhancement are not well understood, but it is plausible that adaptive changes in attention to emotional stimuli underlie this effect. Thus, this study examined the effects of acute aerobic exercise on eye-tracking metrics while participants viewed emotionally expressive faces.

METHODS

Thirty-four adults (18 women) aged 21.1 ± 1.4 years completed two counterbalanced 30-min conditions: vigorous running or seated rest. Eye tracking occurred pre- and 20-min post-condition. Participants viewed positive (n = 15), negative (n = 15), and neutral (n = 15) emotional facial expressions from the NimStim repository. Fixation duration, longest fixation, number of fixations, and scan path length were analyzed using repeated measures ANOVAs.

RESULTS

Exercise improved mood, but had no effect on the dependent measures (all 3-way interactions p > 0.66). However, a main effect of emotionally expressive content for fixation duration (p = 0.04, η = 0.10) and a marginally significant effect for longest fixation (p = 0.06, ηp2 = 0.09) were detected, such that fixation duration and longest fixation were greatest for faces expressing positive emotions.

CONCLUSION

These preliminary findings indicated that acute exercise did not alter the processing of expressive faces as indexed by eye-tracking metrics of attention. However, eye tracking effectively detected processing patterns indicative of a pleasure bias while viewing emotional facial expressions.

The Disengagement of Visual Attention: An Eye-Tracking Study of Cognitive Impairment, Ethnicity and Age

Various studies have shown that Alzheimer’s disease (AD) is associated with an impairment of inhibitory control, although we do not have a comprehensive understanding of the associated cognitive processes. The ability to engage and disengage attention is a crucial cognitive operation of inhibitory control and can be readily investigated using the “gap effect” in a saccadic eye movement paradigm. In previous work, various demographic factors were confounded; therefore, here, we examine separately the effects of cognitive impairment in Alzheimer’s disease, ethnicity/culture and age. This study included young (N = 44) and old (N = 96) European participants, AD (N = 32), mildly cognitively impaired participants (MCI: N = 47) and South Asian older adults (N = 94). A clear reduction in the mean reaction times was detected in all the participant groups in the gap condition compared to the overlap condition, confirming the effect. Importantly, this effect was also preserved in participants with MCI and AD. A strong effect of age was also evident, revealing a slowing in the disengagement of attention during the natural process of ageing.

A comparison of post-saccadic oscillations in European-Born and China-Born British University Undergraduates

Previous research has revealed that people from different genetic, racial, biological, and/or cultural backgrounds may display fundamental differences in eye-tracking behavior. These differences may have a cognitive origin or they may be at a lower level within the neurophysiology of the oculomotor network, or they may be related to environment factors. In this paper we investigated one of the physiological aspects of eye movements known as post-saccadic oscillations and we show that this type of eye movement is very different between two different populations. We compared the post-saccadic oscillations recorded by a video-based eye tracker between two groups of participants: European-born and Chinese-born British students. We recorded eye movements from a group of 42 Caucasians defined as White British or White Europeans and 52 Chinese-born participants all with ages ranging from 18 to 36 during a prosaccade task. The post-saccadic oscillations were extracted from the gaze data which was compared between the two groups in terms of their first overshoot and undershoot. The results revealed that the shape of the post-saccadic oscillations varied significantly between the two groups which may indicate a difference in a multitude of genetic, cultural, physiologic, anatomical or environmental factors. We further show that the differences in the post-saccadic oscillations could influence the oculomotor characteristics such as saccade duration. We conclude that genetic, racial, biological, and/or cultural differences can affect the morphology of the eye movement data recorded and should be considered when studying eye movements and oculomotor fixation and saccadic behaviors.

Investigating Visitor Engagement in Interactive Science Museum Exhibits with Multimodal Bayesian Hierarchical Models

Engagement plays a critical role in visitor learning in museums. Devising computational models of visitor engagement shows significant promise for enabling adaptive support to enhance visitors’ learning experiences and for providing analytic tools for museum educators. A salient feature of science museums is their capacity to attract diverse visitor populations that range broadly in age, interest, prior knowledge, and socio-cultural background, which can significantly affect how visitors interact with museum exhibits. In this paper, we introduce a Bayesian hierarchical modeling framework for predicting learner engagement with Future Worlds, a tabletop science exhibit for environmental sustainability. We utilize multi-channel data (e.g., eye tracking, facial expression, posture, interaction logs) captured from visitor interactions with a fully-instrumented version of Future Worlds to model visitor dwell time with the exhibit in a science museum. We demonstrate that the proposed Bayesian hierarchical modeling approach outperforms competitive baseline techniques. These findings point toward significant opportunities for enriching our understanding of visitor engagement in science museums with multimodal learning analytics.

Investigating sex differences, cognitive effort, strategy, and performance on a computerised version of the mental rotations test via eye tracking

Mental rotation tests (MRTs) have previously shown one of the most prominent sex differences in cognitive psychology, marked by a large male performance advantage. However, debate continues over the reasons for these sex differences. Previously, we used pupillometry to demonstrate sex differences in the cognitive effort invoked during the original MRT. Here, we evaluated the magnitude of sex differences during performance on a computerized version of the Vandenberg and Kuse MRT. Secondly, we examined whether fixation metrics could illuminate strategy use by participants. Finally, we used pupillometry to investigate whether cognitive effort differed between sexes and trials of different difficulty. While our results demonstrate no performance differences between sexes on the computerized MRT, fixation patterns provided evidence that gaze strategy was associated with performance on different parts of the test. Moreover, we show the cognitive demand of the V&K MRT, evidenced by large task dependent increases in participants’ pupil diameters.

What Color Was It? A Psychophysical Paradigm for Tracking Subjective Progress in Continuous Tasks

When making a sequence of fixations, how does the timing of visual experience compare with the timing of fixation onsets? Previous studies have tracked shifts of attention or perceived gaze direction using self-report methods. We used a similar method, a dynamic color technique, to measure subjective timing in continuous tasks involving fixation sequences. Does the time that observers report reading a word coincide with their fixation on it, or is there an asynchrony, and does this relationship depend on the observer’s task? Observers read sentences that continuously changed in hue and identified the color of a word at the time that they read it using a color palette. We compared responses with a nonreading condition, where observers reproduced their fixations, but viewed nonword stimuli. Results showed a delay between the color of stimuli at fixation onset and the reported color during perception. For nonword tasks, the delay was constant. However, in the reading task, the delay was larger for earlier compared with later words in the sentence. Our results offer a new method for measuring awareness or subjective progress within fixation sequences, which can be extended to other continuous tasks.

Using principal component analysis to characterize eye movement fixation patterns during face viewing

Human faces contain dozens of visual features, but viewers preferentially fixate just two of them: the eyes and the mouth. Face-viewing behavior is usually studied by manually drawing regions of interest (ROIs) on the eyes, mouth, and other facial features. ROI analyses are problematic as they require arbitrary experimenter decisions about the location and number of ROIs, and they discard data because all fixations within each ROI are treated identically and fixations outside of any ROI are ignored. We introduce a data-driven method that uses principal component analysis (PCA) to characterize human face-viewing behavior. All fixations are entered into a PCA, and the resulting eigenimages provide a quantitative measure of variability in face-viewing behavior. In fixation data from 41 participants viewing four face exemplars under three stimulus and task conditions, the first principal component (PC1) separated the eye and mouth regions of the face. PC1 scores varied widely across participants, revealing large individual differences in preference for eye or mouth fixation, and PC1 scores varied by condition, revealing the importance of behavioral task in determining fixation location. Linear mixed effects modeling of the PC1 scores demonstrated that task condition accounted for 41% of the variance, individual differences accounted for 28% of the variance, and stimulus exemplar for less than 1% of the variance. Fixation eigenimages provide a useful tool for investigating the relative importance of the different factors that drive human face-viewing behavior.

Reliability and correlates of intraindividual variability in the oculomotor system

Even if all external circumstances are kept equal, the oculomotor system shows intraindividual variability over time, affecting measures such as microsaccade rate, blink rate, pupil size, and gaze position. Recently, some of these measures have been associated with ADHD on a between-subject level. However, it remains unclear to what extent these measures constitute stable individual traits. In the current study, we investigate the intraindividual reliability of these oculomotor features. Combining results over three experiments (> 100 healthy participants), we find that most measures show good intra-individual reliability over different time points (repeatability) as well as over different conditions (generalisation). However, we find evidence against any correlation with self-assessed ADHD tendencies, mind wandering, and impulsivity. As such, the oculomotor system shows reliable intra-individual reliability, but its benefit for investigating self-assessed individual differences in healthy subjects remains unclear. With our results, we highlight the importance of reliability and statistical power when studying between-subject differences.

Increased overt attention to objects in early deaf adults: An eye-tracking study of complex naturalistic scenes

The study of selective attention in people with profound deafness has repeatedly documented enhanced attention to the peripheral regions of the visual field compared to hearing controls. This finding emerged from covert attention studies (i.e., without eye-movements) involving extremely simplified visual scenes and comprising few visual items. In this study, we aimed to test whether this key finding extends also to overt attention, using a more ecologically valid experimental context in which complex naturalistic images were presented for 3 s. In Experiment 1 (N = 35), all images contained a single central object superimposed on a congruent naturalistic background (e.g., a tiger in the woods). At the end of the visual exploration phase, an incidental memory task probed the participants' recollection of the seen central objects and image backgrounds. Results showed that hearing controls explored and remembered the image backgrounds more than deaf participants, who lingered on the central object to a greater extent. In Experiment 2 we aimed to disentangle if this behaviour of deaf participants reflected a bias in overt space-based attention towards the centre of the image, or instead, enhanced object-centred attention. We tested new participants (N = 42) in the visual exploration task adding images with lateralized objects, as well as images with multiple object or images without any object. Results confirmed increased exploration of objects in deaf participants. Taken together our novel findings show limitations of the well-known peripheral attention bias of deaf people and suggest that visual object-centred attention may also change after prolonged auditory deprivation.

Urbanisation, the arousal system, and covert and overt attentional selection

Urbanisation is growing rapidly. We review evidence that this growth is altering the default information processing style of human beings by impacting both overt and covert processes of attentional selection (i.e. attentional selection with and without eye movements respectively), in ways consistent with reduced attentional engagement and increased exploration. While the factors and systems mediating these effects are likely to be many and various, we focus on one system which may be responsible for mediating effects on both covert and overt attentional selection. Specifically, the neuromodulatory locus coeruleus-norepinephrine (LC-NE) system is key to regulating cognitive function in a behaviourally relevant and arousal-dependent manner and therefore well suited to supporting adaptation to the profound socio-ecological changes inherent in urbanisation.

What do we know about volumetric medical image interpretation?: a review of the basic science and medical image perception literatures

Interpretation of volumetric medical images represents a rapidly growing proportion of the workload in radiology. However, relatively little is known about the strategies that best guide search behavior when looking for abnormalities in volumetric images. Although there is extensive literature on two-dimensional medical image perception, it is an open question whether the conclusions drawn from these images can be generalized to volumetric images. Importantly, volumetric images have distinct characteristics (e.g., scrolling through depth, smooth-pursuit eye-movements, motion onset cues, etc.) that should be considered in future research. In this manuscript, we will review the literature on medical image perception and discuss relevant findings from basic science that can be used to generate predictions about expertise in volumetric image interpretation. By better understanding search through volumetric images, we may be able to identify common sources of error, characterize the optimal strategies for searching through depth, or develop new training and assessment techniques for radiology residents.

Time-Course of Motor Involvement in Literal and Metaphoric Action Sentence Processing: A TMS Study

There is evidence that the motor cortex is involved in reading sentences containing an action verb ("The spike was hammered into the ground") as well as metaphoric sentences ("The army was hammered in the battle"). Verbs such as 'hammered' may be homonyms, with separate meanings belonging to the literal action and metaphoric action, or they may be polysemous, with the metaphoric sense grounded in the literal sense. We investigated the time course of the effects of single-pulse transcranial magnetic stimulation to primary motor cortex on literal and metaphoric sentence comprehension. Stimulation 300 ms post-verb presentation impaired comprehension of both literal and metaphoric sentences, supporting a causal role of sensory-motor areas in comprehension. Results suggest that the literal meaning of an action verb remains activated during metaphor comprehension, even after the temporal window of homonym disambiguation. This suggests that such verbs are polysemous, and both senses are related and grounded in motor cortex.