Validity of eye movement methods and indices for capturing semantic (associative) priming effects

Visual Attention to Semantic and Orthographic Associations in Fluent Aphasia: Evidence from Eye-Tracking

We examined the allocation of visual attention in an association task by both neurotypical participants (n = 11) and adults with fluent aphasia (n = 12). Participants were presented with a picture (e.g., a basket) followed by a semantically related association (i.e., "strawberry") and an orthographically related association (i.e., "b," the first letter of "basket"). An eye tracker recorded their eye movements for three areas of interest (AOI): the picture, the semantic associate, and the orthographic associate, over 1396 observations. Results showed that both neurotypical participants and participants with aphasia looked longer at the semantic associate than at the picture, and this difference was more pronounced for neurotypicals than for people with aphasia (PWA). Neurotypicals also looked longer than the PWA group at the orthographic associate than at the prior picture. Regarding eye fixation counts, both participant groups looked more frequently at the semantic associate than at either the picture or the orthographic associate. Notably, this pattern was more pronounced among neurotypical participants than PWA. Our findings emphasize the importance of semantic associations in fluent aphasia and suggest a potential rehabilitative approach in speech and language therapy.

Detecting cognitive hacking in visual inspection with physiological measurements

Cyber threats are targeting vulnerabilities of human workers performing tasks in manufacturing processes, including visual inspection to bias their decision-making, thereby sabotaging product quality. This article examines the use of priming as a form of "cognitive hacking" to adversely affect quality inspection decisions in manufacturing, and investigates physiological measurements as means to detect such intrusion. In a within-subject design experiment, twenty participants inspected surface roughness of a manufactured component with and without exposure to priming on the display of an inspection logging system. The results show that the presence of primes impacted accuracy on surface roughness, cortical activities at parietal lobe P4, and eye gaze for inspecting components. The experiment provides supporting evidence that basic hacking of a worker display can be an effective method to alter decision making in inspection. The findings also illustrate that cortical activities and eye gaze can be useful indicators of cognitive hacking. A major implication of the study results is that physiological indicators can be effective at revealing unconscious cognitive influence in visual inspection.

Implicit Measures of Receptive Vocabulary Knowledge in Individuals With Level 3 Autism

Implicit measures of cognition are essential for assessing knowledge in people with Level 3 autism because such individuals are often unable to make reliable overt behavioral responses. In this study, we investigated whether three implicit measures-eye movement (EM) monitoring, pupillary dilation (PD), and event-related potentials (ERPs)-can be used to reliably estimate vocabulary knowledge in individuals with Level 3 autism. Five adults with Level 3 autism were tested in a repeated-measures design with two tasks. High-frequency 'known' words (eg, bus, airplane) and low-frequency 'unknown' words (eg, ackee, cherimoya) were presented in a visual world task (during which EM and PD data were collected) and a picture-word congruity task (during which ERP data were collected). Using a case-study approach with single-subject analyses, we found that these implicit measures have the potential to provide estimates of receptive vocabulary knowledge in individuals with Level 3 autism. Participants differed with respect to which measures were the most sensitive and which variables best predicted vocabulary knowledge. These implicit measures may be useful to assess language abilities in individuals with Level 3 autism, but their use should be tailored to each individual.

Validity of an eyetracking method for capturing auditory-visual cross-format semantic priming

INTRODUCTION

Semantic priming paradigms are important for understanding lexical-semantic processing and the nature of linguistic deficits accompanying language performance in neurologically impaired individuals such as people with aphasia. Reaction-time-(RT)-based traditional semantic priming tasks entail potential confounds, especially problematic when applied to people with aphasia, who may have concomitant neurocognitive challenges that limit task performance. Some of these confounds include requirements of following complex instructions, making metalinguistic judgments, and using speech or limb-based motor actions to indicate overt responses. Eyetracking methods have great potential for avoiding some of these confounds. We tested the validity of an eyetracking method in capturing semantic priming in an auditory-visual cross-format priming paradigm (auditory word prime-visual image target).

METHOD

A total of 72 neurologically unimpaired adults participated in two phases: a stimulus development phase using traditional priming (n = 32) and an experimental eyetracking phase (n = 40). Each phase included two conditions, representing distinct levels of prime-target semantic relatedness: unrelated and related. Mean RT data from the traditional priming (stimuli development) phase guided image selection for the eyetracking experiment. Eyetracking indices of fixation duration and latency of fixation were recorded to capture semantic priming in the eyetracking experiment.

RESULTS

Eye fixation data indicated that images related to auditory primes were attended to earlier and attracted significantly greater visual attention than unrelated images. These results mirrored RT data from the traditional priming method, which showed faster RT latencies and more accurate naming performance for related images than for unrelated images.

CONCLUSIONS

Results support the validity of eyetracking indices of semantic priming and offer a robust testing protocol for future studies in this line of research. Current clinical relevance for people with aphasia is highlighted. Further empirical testing of the psychometric properties of the eyetracking measures in various semantic priming contexts is recommended.

Affective associations with negativity: Why popular peers attract youths' visual attention

Visual attention to high-status peers is well documented, but whether this attentional bias is due to high-status individuals' leadership and prosocial characteristics or due to their more agonistic behaviors has yet to be examined. To identify the affective associations that may underlie visual attention for high-status versus low-status peers, 122 early adolescents (67 girls; M_age=11.0years, SD=0.7) completed a primed attention paradigm. Visual attention was measured using eye tracking as participants looked simultaneously at photographs of two classmates: one nominated by peers as popular and one nominated by peers as unpopular. Prior to each trial, the early adolescents were presented with a positive prime, the word "nice"; a negative prime, the word "stupid"; or no prime. Primary analyses focused on first-gaze preference and total gaze time The results showed a stronger first gaze preference for popular peers than for unpopular peers in the no-prime and negative prime trials than in the positive prime trials. The visual preference for a popular peer, thus, was attenuated by the positive prime. These findings are consistent with the notion that youths may visually attend to high-status peers due to their association with more negative characteristics and the threat they may pose to youths' own social standing and ability to gain interpersonal resources.

More Than the Verbal Stimulus Matters: Visual Attention in Language Assessment for People With Aphasia Using Multiple-Choice Image Displays

PURPOSE

Language comprehension in people with aphasia (PWA) is frequently evaluated using multiple-choice displays: PWA are asked to choose the image that best corresponds to the verbal stimulus in a display. When a nontarget image is selected, comprehension failure is assumed. However, stimulus-driven factors unrelated to linguistic comprehension may influence performance. In this study we explore the influence of physical image characteristics of multiple-choice image displays on visual attention allocation by PWA.

METHOD

Eye fixations of 41 PWA were recorded while they viewed 40 multiple-choice image sets presented with and without verbal stimuli. Within each display, 3 images (majority images) were the same and 1 (singleton image) differed in terms of 1 image characteristic. The mean proportion of fixation duration (PFD) allocated across majority images was compared against the PFD allocated to singleton images.

RESULTS

PWA allocated significantly greater PFD to the singleton than to the majority images in both nonverbal and verbal conditions. Those with greater severity of comprehension deficits allocated greater PFD to nontarget singleton images in the verbal condition.

CONCLUSION

When using tasks that rely on multiple-choice displays and verbal stimuli, one cannot assume that verbal stimuli will override the effect of visual-stimulus characteristics.

Development of an eye-tracking method to assess mental set switching in people with aphasia

BACKGROUND

Deficits in cognitive flexibility contribute to impaired functional communication in people with aphasia. Understanding the relationship between functional communication and cognitive flexibility in people with neurologic communication disorders is important. However, traditional methods to assess mental set switching pose significant linguistic, cognitive and motoric response confounds. Eye-tracking methods have great potential to address these challenges.

AIMS

The goal of this study was to develop and validate an eye-tracking method to index mental set switching in individuals without neurological impairment based upon performance on a nonlinguistic switching task.

METHODS

Eye movements of 20 adults without communication disorders were recorded as they completed a switching task, requiring participants to match stimuli to one or two search criteria (colour or shape) in single- and mixed-task conditions. Differences between single and mixed conditions were assessed with eye-tracking measures. Performance on the eye-tracking task was compared to standardized measures of cognitive flexibility.

RESULTS

Eye-tracking measures indexed significant differences between nonswitch and switch trials within and between single- and mixed-task condition. Some standardized assessment measures correlated significantly with the eye movement measures.

CONCLUSIONS

Results support the construct validity of the novel eye-tracking method for assessing cognitive switching in language-normal adults. Clinical and research implications are discussed.

Abstract Conceptual Feature Ratings Predict Gaze Within Written Word Arrays: Evidence From a Visual Wor(l)d Paradigm

The Abstract Conceptual Feature (ACF) framework predicts that word meaning is represented within a high-dimensional semantic space bounded by weighted contributions of perceptual, affective, and encyclopedic information. The ACF, like latent semantic analysis, is amenable to distance metrics between any two words. We applied predictions of the ACF framework to abstract words using eyetracking via an adaptation of the classical "visual word paradigm" (VWP). Healthy adults (n = 20) selected the lexical item most related to a probe word in a 4-item written word array comprising the target and three distractors. The relation between the probe and each of the four words was determined using the semantic distance metrics derived from ACF ratings. Eye movement data indicated that the word that was most semantically related to the probe received more and longer fixations relative to distractors. Importantly, in sets where participants did not provide an overt behavioral response, the fixation rates were nonetheless significantly higher for targets than distractors, closely resembling trials where an expected response was given. Furthermore, ACF ratings which are based on individual words predicted eye fixation metrics of probe-target similarity at least as well as latent semantic analysis ratings which are based on word co-occurrence. The results provide further validation of Euclidean distance metrics derived from ACF ratings as a measure of one facet of the semantic relatedness of abstract words and suggest that they represent a reasonable approximation of the organization of abstract conceptual space. The data are also compatible with the broad notion that multiple sources of information (not restricted to sensorimotor and emotion information) shape the organization of abstract concepts. While the adapted "VWP" is potentially a more metacognitive task than the classical visual world paradigm, we argue that it offers potential utility for studying abstract word comprehension.

A novel eye-tracking method to assess attention allocation in individuals with and without aphasia using a dual-task paradigm

Numerous authors report that people with aphasia have greater difficulty allocating attention than people without neurological disorders. Studying how attention deficits contribute to language deficits is important. However, existing methods for indexing attention allocation in people with aphasia pose serious methodological challenges. Eye-tracking methods have great potential to address such challenges. We developed and assessed the validity of a new dual-task method incorporating eye tracking to assess attention allocation. Twenty-six adults with aphasia and 33 control participants completed auditory sentence comprehension and visual search tasks. To test whether the new method validly indexes well-documented patterns in attention allocation, demands were manipulated by varying task complexity in single- and dual-task conditions. Differences in attention allocation were indexed via eye-tracking measures. For all participants significant increases in attention allocation demands were observed from single- to dual-task conditions and from simple to complex stimuli. Individuals with aphasia had greater difficulty allocating attention with greater task demands. Relationships between eye-tracking indices of comprehension during single and dual tasks and standardized testing were examined. Results support the validity of the novel eye-tracking method for assessing attention allocation in people with and without aphasia. Clinical and research implications are discussed.

LEARNING OUTCOMES

Readers will be able to: (1) summarize the nature of dual-task paradigms, (2) identify shortcomings of existing dual-task measures of attention allocation for application to people with aphasia, (3) describe how eye-tracking measures may be recorded and analyzed to reflect differences in attention allocation across conditions, and (4) summarize potential clinical applications for eye-tracking measures of attention allocation.

Phonological facilitation effects on naming latencies and viewing times during noun and verb naming in agrammatic and anomic aphasia

BACKGROUND

Phonological priming has been shown to facilitate naming in individuals with aphasia as well as healthy speakers, resulting in faster naming latencies. However, the mechanisms of phonological facilitation (PF) in aphasia remain unclear.

AIMS

Within discrete vs. interactive models of lexical access, this study examined whether PF occurs via the sub-lexical or lexical route during noun and verb naming in agrammatic and anomic aphasia.

METHODS AND PROCEDURES

Thirteen participants with agrammatic aphasia and 10 participants with anomic aphasia and their young and age-matched controls (n=20/each) were tested. Experiment 1 examined noun and verb naming deficit patterns in an off-line confrontation naming task. Experiment 2 examined PF effects on naming both word categories using eyetracking priming paradigm.

RESULTS

Results of Experiment 1 showed greater naming difficulty for verbs than for nouns in the agrammatic group, with no difference between the two word categories in the anomic group. For both participant groups, errors were dominated by semantic paraphasias, indicating impaired lexical selection. In the phonological priming task (Experiment 2), young and age-matched control groups showed PF in both noun and verb naming. Interestingly, the agrammatic group showed PF when naming verbs, but not nouns, whereas the anomic group showed PF for nouns only.

CONCLUSIONS

Consistent with lexically mediated PF in interactive models of lexical access, selective PF for different word categories in our agrammatic and anomic groups suggest that phonological primes facilitate lexical selection via feedback activation, resulting in greater PF for more difficult (i.e., verbs in agrammatic and possibly nouns in anomic group) lexical items.

Eye-tracking measures reveal how changes in the design of aided AAC displays influence the efficiency of locating symbols by school-age children without disabilities

PURPOSE Many individuals with communication impairments use aided augmentative and alternative communication (AAC) systems involving letters, words, or line drawings that rely on the visual modality. It seems reasonable to suggest that display design should incorporate information about how users attend to and process visual information. The organization of AAC symbols can influence the speed and accuracy with which children select a target symbol on a display. This research examined why some displays facilitate responding. METHOD Eye-tracking technology recorded point-of-gaze while children without disabilities engaged in a visual search task with 2 AAC displays. In 1 display, symbols sharing an internal color were clustered together. In the other display, like-colored symbols were distributed. Dependent measures were (a) latency to fixate on the target compared with distracters and (b) the number of fixations to target and distracters. RESULTS Participants were significantly slower to fixate on the target when like-colored symbols were distributed; there was a significant increase in the number of fixations to distracters that did not share color with the target. CONCLUSIONS Efficient search was related to minimizing fixations to nonrelevant distracters. Vulnerability to distraction can be a significant problem in individuals with disabilities who use AAC. Minimizing the intrusion of such distraction may, therefore, be of importance in AAC display design.

Perceptual factors influence visual search for meaningful symbols in individuals with intellectual disabilities and Down syndrome or autism spectrum disorders

Augmentative and alternative communication (AAC) systems often supplement oral communication for individuals with intellectual and communication disabilities. Research with preschoolers without disabilities has demonstrated that two visual-perceptual factors influence speed and/or accuracy of finding a target: the internal color and spatial organization of symbols. Twelve participants with Down syndrome and 12 with autism spectrum disorders (ASDs) completed two search tasks. In one, the symbols were clustered by internal color; in the other, the identical symbols had no arrangement cue. Visual search was superior in participants with ASDs compared to those with Down syndrome. In both groups, responses were significantly faster when the symbols were clustered by internal color. Construction of aided AAC displays may benefit from attention to their physical and perceptual features.

A tutorial on aphasia test development in any language: Key substantive and psychometric considerations

BACKGROUND

There are a limited number of aphasia language tests in the majority of the world's commonly spoken languages. Furthermore, few aphasia tests in languages other than English have been standardized and normed, and few have supportive psychometric data pertaining to reliability and validity. The lack of standardized assessment tools across many of the world's languages poses serious challenges to clinical practice and research in aphasia.

AIMS

The current review addresses this lack of assessment tools by providing conceptual and statistical guidance for the development of aphasia assessment tools and establishment of their psychometric properties.

MAIN CONTRIBUTION

A list of aphasia tests in the 20 most widely spoken languages is included. The pitfalls of translating an existing test into a new language versus creating a new test are outlined. Factors to consider in determining test content are discussed. Further, a description of test items corresponding to different language functions is provided, with special emphasis on implementing important controls in test design. Next, a broad review of principal psychometric properties relevant to aphasia tests is presented, with specific statistical guidance for establishing psychometric properties of standardized assessment tools.

CONCLUSIONS

This article may be used to help guide future work on developing, standardizing and validating aphasia language tests. The considerations discussed are also applicable to the development of standardized tests of other cognitive functions.

Preliminary investigation of visual attention to human figures in photographs: potential considerations for the design of aided AAC visual scene displays

PURPOSE

Many individuals with complex communication needs may benefit from visual aided augmentative and alternative communication systems. In visual scene displays (VSDs), language concepts are embedded into a photograph of a naturalistic event. Humans play a central role in communication development and might be important elements in VSDs. However, many VSDs omit human figures. In this study, the authors sought to describe the distribution of visual attention to humans in naturalistic scenes as compared with other elements.

METHOD

Nineteen college students observed 8 photographs in which a human figure appeared near 1 or more items that might be expected to compete for visual attention (such as a Christmas tree or a table loaded with food). Eye-tracking technology allowed precise recording of participants' gaze. The fixation duration over a 7-s viewing period and latency to view elements in the photograph were measured.

RESULTS

Participants fixated on the human figures more rapidly and for longer than expected based on the size of these figures, regardless of the other elements in the scene.

CONCLUSIONS

Human figures attract attention in a photograph even when presented alongside other attractive distracters. Results suggest that humans may be a powerful means to attract visual attention to key elements in VSDs.

Effects of perceptual and contextual enrichment on visual confrontation naming in adult aging

PURPOSE

The purpose of this study was to determine the effects of enriching line drawings with color/texture and environmental context as a facilitator of naming speed and accuracy in older adults.

METHOD

Twenty young and 23 older adults named high-frequency picture stimuli from the Boston Naming Test (Kaplan, Goodglass, & Weintraub, 2001) under three conditions: (a) black-and-white items, (b) colorized-texturized items, and (c) scene-primed colored items (e.g., "hammock" preceded 1,000 ms by a backyard scene).

RESULTS

With respect to speeded naming latencies, mixed-model analyses of variance revealed that young adults did not benefit from colorization-texturization but did show scene-priming effects. In contrast, older adults failed to show facilitation effects from either colorized-texturized or scene-primed items. Moreover, older adults were consistently slower to initiate naming than were their younger counterparts across all conditions.

CONCLUSIONS

Perceptual and contextual enrichment of sparse line drawings does not appear to facilitate visual confrontation naming in older adults, whereas younger adults do tend to show benefits of scene priming. We interpret these findings as generally supportive of a processing speed account of age-related object picture-naming difficulty.

When seeing depends on knowing: adults with Autism Spectrum Conditions show diminished top-down processes in the visual perception of degraded faces but not degraded objects

Behavioural, neuroimaging and neurophysiological approaches emphasise the active and constructive nature of visual perception, determined not solely by the environmental input, but modulated top-down by prior knowledge. For example, degraded images, which at first appear as meaningless 'blobs', can easily be recognized as, say, a face, after having seen the same image un-degraded. This conscious perception of the fragmented stimuli relies on top-down priming influences from systems involved in attention and mental imagery on the processing of stimulus attributes, and feature-binding [Dolan, R. J., Fink, G. R., Rolls, E., Booth, M., Holmes, A., Frackowiak, R. S. J., et al. (1997). How the brain learns to see objects and faces in an impoverished context. Nature, 389, 596-599]. In Autism Spectrum Conditions (ASC), face processing abnormalities are well-established, but top-down anomalies in various domains have also been shown. Thus, we tested two alternative hypotheses: (i) that people with ASC show overall reduced top-down modulation in visual perception, or (ii) that top-down anomalies affect specifically the perception of faces. Participants were presented with sets of three consecutive images: degraded images (of faces or objects), corresponding or non-corresponding grey-scale photographs, and the same degraded images again. In a passive viewing sequence we compared gaze times (an index of focal attention) on faces/objects vs. background before and after viewers had seen the undegraded photographs. In an active viewing sequence, we compared how many faces/objects were identified pre- and post-exposure. Behavioural and gaze tracking data showed significantly reduced effects of prior knowledge on the conscious perception of degraded faces, but not objects in the ASC group. Implications for future work on the underlying mechanisms, at the cognitive and neurofunctional levels, are discussed.