A Comparison of the Visual Attention Patterns of People With Aphasia and Adults Without Neurological Conditions for Camera-Engaged and Task-Engaged Visual Scenes

Exploring high-technology augmentative and alternative communication interfaces: the effect of age and technology experience

PURPOSE

Many people with aphasia have inadequate language skills for functional communication thereby necessitating well-designed augmentative and alternative communication (AAC) interfaces. Using both a grid and a VSD interface with single word hotspots by neurologically healthy adults, across ages and with different technology experiences, this study examines the utility of these interfaces prior to investigating their use with people with aphasia in future studies.

METHOD

Participants include 18 young adults, 24 older adults with technology experience, and 20 older adults with limited technology experience. The older adult groups were matched for mean age and for sex. Participants described pictures with each interface, and performance was measured based on four dependent variables: (a) the total number of correct information units (CIUs), (b) the percentage of CIUs, (c) CIUs per minute, and (d) preferred interface.

RESULTS

There was a significant difference between older adults and the young adult group for the total number of CIUs (p < 0.001) and CIUs per minute (p < 0.001). Despite the changes in technology experience between the two older groups, there was no significant difference in performance. Additionally, there was no significant difference in performance across the two interfaces in any of the groups.

CONCLUSION

Findings suggest age does impact performance on AAC. However, the difference in technology experience in older adult groups did not affect performance. Furthermore, both interfaces used in the current study were equally beneficial when describing pictures by healthy adults. Implications for RehabilitationAugmentative and alternative communication (AAC) systems involve various interface designs. Consequently, the comparative utility of these interfaces must be examined across populations and communicative functions.Advancement in technology has given rise to numerous high-tech AAC interface designs. However, older adults with acquired language difficulties whose technology experience is limited may become reluctant to use high-tech AAC. Hence, the  influence of technology experience on high-tech AAC performance should be investigated.Prior to examining interfaces with individuals with acquired language difficulties, the current study examined the use of a) grid display and b) visual scene display (VSD) with single word hotspots, by healthy adults of different ages and technology experiences.The study revealed that older adults with limited technology experience were equally competent in using high-tech AAC interfaces, as those with technology experience. Hence, an individual's technology experience should not be considered a deterrent to using high-tech AAC interfaces.Additionally, the study found no differences in performance between the two interfaces, making it essential to consider user's personal preference when adopting AAC interface designs.

Examining the Visual Attention Patterns and Identification Accuracy of Adults With Aphasia for Grids and Visual Scene Displays

PURPOSE

We compared the degree of cognitive processing needed by people with aphasia to identify themes depicted in grids and visual scene displays (VSDs). We also compared the accuracy of theme identification for both display types.

METHOD

Eye-tracking technology was employed to measure the visual processing patterns of 21 adults with aphasia when interpreting themes presented through grids and VSDs. Additionally, we assessed theme identification accuracy by having participants select themes from four choices after viewing each display.

RESULTS

Participants more rapidly identified VSDs than grid displays, and VSDs required fewer visual fixations to process than grids. No significant differences were noted between grids and VSDs for theme identification accuracy; however, results indicate a ceiling effect for the variable, as participant accuracy levels were nearly 100% for both display conditions.

CONCLUSIONS

Results from this study add to a growing body of evidence supporting the use of VSDs for adults with aphasia. Both display types were accurately identified; however, VSDs were processed more efficiently than grids indicating that both display types may prove effective for people with aphasia; however, VSDs may require less cognitive effort to effectively use than grid displays.

Judicious Arrangement of Symbols on a Simulated Augmentative and Alternative Communication Display Optimizes Visual Attention by Individuals With Down Syndrome

PURPOSE

Aided augmentative and alternative communication (AAC) displays are often designed as symmetrical row-column grids, with each square in the grid containing a symbol. To maximize vocabulary on displays, symbols are often placed close to one another, and background color cuing is used to signal/differentiate symbols across different grammatical categories. However, from a visual and developmental standpoint, these display features (close-set symbols and use of background color cues) may not be optimal. In particular, placing symbols quite close together may result in visual crowding, in which individual symbols cannot be distinguished due to the presence of many neighbors, or flankers. This research sought to examine the role of display arrangement and background color cuing on the efficiency of visual attention during search.

METHOD

Ten adolescents and adults with Down syndrome underwent a visual search task while a research-based eye tracking system recorded their patterns of visual attention. Participants searched for symbol targets on displays with varying levels of visual crowding and background color cuing.

RESULTS

Spatial arrangements that reduced visual crowding and that used the spatial organization to cue the grammatical category of symbols resulted in significantly fewer fixations to nonrelevant distracters during search and reduced the likelihood of fixations away from the target once it was located. Background color was helpful in reducing the latency to find the target.

DISCUSSION

Spatial cues may offer a powerful means to maximize the efficiency of search within AAC displays. Background color cuing may facilitate speed to locate targets in these older individuals. Implications for AAC design, as well as future avenues for maximizing (growing) vocabulary, are discussed.

What's in a Photograph? The Perspectives of Composition Experts on Factors Impacting Visual Scene Display Complexity for Augmentative and Alternative Communication and Strategies for Improving Visual Communication

Purpose Visual scene displays (VSDs) can support augmentative and alternative communication (AAC) success for children and adults with complex communication needs. Static VSDs incorporate contextual photographs that include meaningful events, places, and people. Although the processing of VSDs has been studied, their power as a medium to effectively convey meaning may benefit from the perspective of individuals who regularly engage in visual storytelling. The aim of this study was to evaluate the perspectives of individuals with expertise in photographic and/or artistic composition regarding factors contributing to VSD complexity and how to limit the time and effort required to apply principles of photographic composition. Method Semistructured interviews were completed with 13 participants with expertise in photographic and/or artistic composition. Results Four main themes were noted, including (a) factors increasing photographic image complexity and decreasing cohesion, (b) how complexity impacts the viewer, (c) composition strategies to decrease photographic image complexity and increase cohesion, and (d) strategies to support the quick application of composition strategies in a just-in-time setting. Findings both support and extend existing research regarding best practice for VSD design. Conclusions Findings provide an initial framework for understanding photographic image complexity and how it differs from drawn AAC symbols. Furthermore, findings outline a toolbox of composition principles that may help limit VSD complexity, along with providing recommendations for AAC development to support the quick application of compositional principles to limit burdens associated with capturing photographic images. Supplemental Material https://doi.org/10.23641/asha.15032700.

Clinical and Research Perspectives on Visual Scene Displays

Purpose The purposes of this study were to measure the perceptions of speech-language pathologists (SLPs) and researchers regarding the design of visual scene displays (VSDs) and to investigate the perceived difficulties of SLPs in regard to the acquisition and programming of VSDs. Method We recruited 270 SLPs and nine researchers who focus on VSDs to complete an online survey. The SLP survey addressed both perception of VSD design and difficulties associated with implementing these images as communication supports in the clinical realm. The researcher group was surveyed solely regarding their opinions associated with VSD design. Results SLPs and researchers both ranked high-context VSDs as more effective at supporting communication than low-context VSDs. In addition, both groups ranked VSDs with task-engaged people as more effective at supporting communication than VSDs with camera-engaged people or no people. SLPs reported difficulties with acquiring high-quality VSDs from online sources as well as difficulties with maintenance and upkeep of VSDs. In addition, a large portion of SLPs reported challenges with representing complex concepts through VSDs. Conclusions Results from this study provide evidence of general agreement between SLPs and researchers regarding perception of VSD design. SLPs continue to report challenges with the acquisition and programming of VSDs. Further research is needed to develop evidence-based guidelines to support clinical endeavors in these areas.

Visual Attention to Cued Targets in Simulated Aided Augmentative and Alternative Communication Displays for Individuals With Intellectual and Developmental Disabilities

Purpose Many aided augmentative and alternative communication (AAC) systems require the use of an external display that is represented via a visual modality. It is critical to evaluate and understand visual-perceptual processing in individuals with disabilities who could benefit from AAC. One way to evaluate how individuals process visual materials is through research-based automated eye-tracking technologies that obtain a fine-grained stream of data concerning gaze paths of visual attention. Method The current study examined how individuals with autism spectrum disorder (n = 13), Down syndrome (n = 13), intellectual and developmental disabilities (n = 9), or typical development (n = 20) responded to a spoken prompt to find a thumbnail-sized navigation key within a complex AAC display, including a main visual scene display (VSD) and a navigation bar of four thumbnail-sized VSDs. Stimuli were presented on a monitor containing automated eye-tracking research technology that recorded patterns of visual attention. Results Participants across groups spent more time fixating on a target thumbnail VSD navigation image after the presentation of the spoken cue to look at the target, compared to before the presentation of the spoken cue; they also spent more time looking at the target thumbnail VSD than the other thumbnail-sized VSDs in the navigation bar after the cue. Discussion Participants were able to locate the target thumbnail VSDs, even within the context of a visually complex AAC display. Implications for the design of AAC displays and for assessment of comprehension are discussed.

Personalization of Visual Scene Displays: Preliminary Investigations of Adults with Aphasia, Typical Females across the Age-Span, and Young Adult Males and Females

Visual scene displays (VSDs) are becoming an increasingly popular method of message representation within augmentative and alternative communication (AAC) supports; however, design factors can influence the effectiveness of these images as communication supports. One issue that has come to light in recent years is the fact that selecting personalized VSDs, which depict the person with complex communication needs or an individual with whom they are familiar, are preferred over generic VSDs, which depict unfamiliar individuals. Although personalization is likely an important factor in the usability of VSDs, these images may be difficult for clinicians to obtain. As such, compromises must be identified. The purpose of this study was to explore the effects of controlling personal relevance factors (i.e., age and gender of the people depicted in generic VSDs) on the image preference patterns of adults with and without aphasia. Results from three very preliminary study summaries indicate that gender and age are both mitigating factors in image preference, as males tended to indicate preference for VSDs containing males over those containing females. In addition, females tended to indicate preference for females of a similar age depicted in VSDs.

Speech-Language pathologists' decisions when designing an aided AAC display for a compilation case study of a beginning communicator

PURPOSE

The current study sought to identify decisions speech-language pathologists (SLPs) make and their rationale for those decisions when designing an AAC display for a hypothetical school-aged child who was a beginning communicator. Augmentative and alternative communication (AAC) displays support communicative interactions for children who are unable to use spoken language to meet their communication needs. Children who are at the early stages of learning language, often termed beginning or emerging communicators, may rely heavily on the AAC display to support comprehension and expression. Thus, it is important for speech-language pathologists (SLPs) to design a display that facilitates beginning communicators' communication development.

METHODS

This paper reports on the answers related to a specific case study presented in an online survey completed by 77 SLPs with experience in AAC.

RESULTS

Data illustrated design decisions driven by child-specific characteristics and informed by research regarding type of layout, representation, and the importance of various design features.

CONCLUSIONS

Suggestions for future research are provided, including identifying goals and communicative functions best supported by different types of displays, clinicians' challenges/successes growing a system with the child, and determining the importance of symbol arrangement and organisation in communicative tasks by AAC users.Implications for RehabilitationIdentification of current practices reported by speech-language pathologists given a case study to develop and implement future research.A gap between research and practice suggests the need for better dissemination and application of research supporting the inclusion of people engaged in the event depicted in a visual scene display.Foundations for future research to provide guidance regarding best design of and communication goals supported by visual scene displays and grid-based displays.

Identification and Expression of Themes Depicted in Visual Scene and Grid Displays by Adults With Traumatic Brain Injury

Purpose The study purpose was to compare the speed and accuracy with which people with traumatic brain injury (TBI) identified themes depicted in visual scene and grid displays. Additionally, we compared the verbal responses associated with the 2 display types to determine whether adults with TBI tended to produce more action or naming messages. Method Thirteen adults with and 13 without TBI viewed grid and visual scene displays matched for content and theme. They then provided verbal responses stating the theme or central idea of each image. Results Although no significant differences were noted between groups for theme identification accuracy, adults with TBI required significantly more time than adults without TBI to process both display types. Both participant groups more rapidly and accurately identified visual scenes than grid displays. Additionally, participants with and without TBI produced more action messages in response to visual scenes and naming messages in response to grid displays. Conclusions This investigation provides preliminary evidence that themes that depicted visual scenes maybe more rapidly and accurately identified than those depicted in grid displays. Additionally, visual scenes may more effectively represent action messages, and grids may more effectively represent naming messages for people with TBI.

Designing effective AAC displays for individuals with developmental or acquired disabilities: State of the science and future research directions

This paper reviews research on the impact of AAC display variables on visual attention and performance of children with developmental disabilities and adults with acquired conditions, and considers implications for designing effective visual scene displays (VSDs) or grids. When using VSDs with children with developmental disabilities or adults with acquired conditions, research supports the use of personalized photo VSDs that include familiar people engaged in meaningful activities, with navigation bars with thumbnail VSDs, located adjacent to the main VSD. Adults with acquired conditions seem to benefit from the inclusion of text boxes adjacent to the scene. Emerging evidence supports the use of motion to capture visual attention to VSDs (video VSDs) or to specific elements in VSDs. When using grid displays with children with developmental disabilities, research supports the use of spatial cues and clustering based on internal symbol colour to facilitate visual searching and selection. Background colour does not seem to facilitate searching for symbols on smaller displays, and may actually distract children from processing the meaningful components of symbols. Preliminary research suggests that the organization of onscreen keyboards and the number, types, and pairings of symbols in grids may impact performance of adults with acquired conditions. Directions for future research are discussed.

Using Images With Individuals With Aphasia: Current Research and Clinical Trends

PURPOSE

Visuographic supports in the form of images are utilized during assessment and treatment for individuals with aphasia to supplement speech, language, and cognitive losses limiting communication. Clinicians rely on prior experience and intuition to make decisions regarding image-based support design and selection (e.g., augmentative and alternative communication strategies). Researchers have begun to focus on the relationship between the images and the benefits they provide for adults with aphasia.

METHOD

The aim of this review-resulting from a roundtable discussion at the 2016 Clinical Aphasiology Conference-was to disseminate summaries of current and past researches regarding image use by individuals with aphasia and to highlight areas of need within research and practice.

RESULTS

Review of the literature illuminated 4 major themes: (a) image creation, capture, and sharing; (b) image characteristics; (c) image use across linguistic domains and contexts; and (d) implications for clinical and research practices.

CONCLUSIONS

Reviewing current knowledge and practice regarding the use of visual supports for individuals with aphasia is essential to advancing therapeutic practices and providing evidence-based protocols for creating, selecting, and implementing images within augmentative and alternative communication strategies. Several gaps in knowledge were identified as future research needs (e.g., caregiver training and enhanced image feature investigation).

Effect of Message Type on the Visual Attention of Adults With Traumatic Brain Injury

PURPOSE

The purpose of this investigation was to measure the effect of message type (i.e., action, naming) on the visual attention patterns of individuals with and without traumatic brain injury (TBI) when viewing grids composed of 3 types of images (i.e., icons, decontextualized photographs, and contextualized photographs).

METHOD

Fourteen adults with TBI and 14 without TBI-assigned either to an action or naming message condition-viewed grids composed of 3 different image types. Participants' task was to select/sustain visual fixation on the image they felt best represented a stated message (i.e., action or naming).

RESULTS

With final fixation location serving as a proxy for selection, participants in the naming message condition selected decontextualized photographs significantly more often than the other 2 image types. Participants in the action message condition selected contextualized photographs significantly more frequently than the other 2 image types. Minimal differences were noted between participant groups.

CONCLUSIONS

This investigation provides preliminary evidence of the relationship between image and message type. Clinicians involved in the selection of images used for message representation should consider the message being represented when designing supports for people with TBI. Further research is necessary to fully understand the relationship between images and message type.