Preliminary investigation of visual attention to human figures in photographs: potential considerations for the design of aided AAC visual scene displays

The ability of typically developing 2-3 year olds to infer the control mechanism for eye-gaze technology and the impact of causal language instruction

PURPOSE

Little is known about how children learn to control eye-gaze technology, and clinicians lack information to guide decision-making. This paper examines whether typically developing 2-3 year olds can infer for themselves the causal mechanisms by which eye-gaze technology is controlled, whether a teaching intervention based on causal language improves performance and how their performance compares to the same task accessed via a touchscreen.Methods and materials: Typically developing children's (n = 9, Mean Age 28.7 months) performance on a cause and effect game presented on eye-gaze and touchscreen devices was compared. The game was presented first with no specific instruction on how to control the devices. This was followed by a subsequent presentation with explicit instruction about how the access methods worked, using a causal language approach. A final presentation examined whether children had retained any learning.

RESULTS

Performance in the eye-gaze condition without instruction (42.5% successful trials) was significantly below performance in the corresponding touchscreen condition (75%). However, when causal language instruction was added, performance with both access methods rose to comparable levels (90.7% eye-gaze and 94.6% touchscreen success). Performance gains were not retained post-intervention.

CONCLUSIONS

Although 2-3 years in the study could make use of eye-gaze technology with support, this study found no evidence that these children could infer the causal mechanisms of control independently or intuitively. The lack of spatial contiguity and the comparative lack of feedback from eye-gaze devices are discussed as possible contributory factors.

Visual fixation patterns to AAC displays are significantly correlated with motor selection for individuals with Down syndrome or individuals on the autism spectrum

Eye tracking research technologies are often used to study how individuals attend visually to different types of AAC displays (e.g. visual scene displays, grid displays). The assumption is that efficiency of visual search may relate to efficiency of motor selection necessary for communication via aided AAC; however, this assumption has not received direct empirical study. We examined the relation between speed of visual search and speed of motor selection of symbols. Ten individuals on the autism spectrum (AS; Study 1) and nine with Down syndrome (DS; Study 2) participated in a search task using simulated AAC displays with a main visual scene display (VSD) and a navigation bar of thumbnail VSDs. Participants were given an auditory prompt to find one of four thumbnail VSDs in the navigation bar. Eye tracking technologies measured how long it took participants to fixate visually on the thumbnail VSD, and recorded how long it took participants to select the thumbnail VSD with a finger. A statistically significant relationship emerged between visual fixation and selection latencies, confirming the positive relationship between visual processing and motor selection for both groups of participants. Eye tracking data may serve as a useful proxy measure for evaluating how display design influences selection of AAC symbols, especially when individuals are unwilling or unable to comply with traditional behaviorally-based assessment tasks.

Considering preferences, speed and the animation of multiple symbols in developing P300 brain-computer interface for children

PURPOSE

Prior research has begun establishing the efficacy of animation in brain-computer interfaces access to augmentative and alternative communication (BCI-AAC). However, the use of animation in P300-BCI-AAC for children is in the early stages and largely limited to single item highlighting of extended durations. In pursuit of practical application, the present study aims to evaluate children's event-related potential (ERP) characteristics and user experience during a task involving an animated P300-BCI-AAC system.

MATERIALS AND METHODS

The system utilizes multi-item zoom animations to access a 28-pictorial symbols. Participants completed a fast (100 ms) and slow (200 ms) zoom animation highlighting conditions wherein four pictorial symbols were highlighted concurrently.

RESULTS

The proposed display appears feasible, eliciting all targeted ERPs. However, ERP amplitudes may be reduced in comparison to single-item animation highlighting, possibly due to distraction. Ratings of mental effort were significantly higher for the 100 ms condition, though differences in the frontal P200/P300 ERP did not achieve significance. Most participants identified a preference for the 100 ms condition, though age may impact preference.

CONCLUSIONS

Overall, findings support the preliminary feasibility of a proposed 28-item interface that utilises group zoom animation highlighting of pictorial symbols. Further research is needed evaluating ERP characteristics and outcomes from online (real-time) use of animation-based P300-BCI-AAC for children with severe speech and physical impairments across multiple training sessions.

Exploring high-technology augmentative and alternative communication interfaces: the effect of age and technology experience

PURPOSE

Many people with aphasia have inadequate language skills for functional communication thereby necessitating well-designed augmentative and alternative communication (AAC) interfaces. Using both a grid and a VSD interface with single word hotspots by neurologically healthy adults, across ages and with different technology experiences, this study examines the utility of these interfaces prior to investigating their use with people with aphasia in future studies.

METHOD

Participants include 18 young adults, 24 older adults with technology experience, and 20 older adults with limited technology experience. The older adult groups were matched for mean age and for sex. Participants described pictures with each interface, and performance was measured based on four dependent variables: (a) the total number of correct information units (CIUs), (b) the percentage of CIUs, (c) CIUs per minute, and (d) preferred interface.

RESULTS

There was a significant difference between older adults and the young adult group for the total number of CIUs (p < 0.001) and CIUs per minute (p < 0.001). Despite the changes in technology experience between the two older groups, there was no significant difference in performance. Additionally, there was no significant difference in performance across the two interfaces in any of the groups.

CONCLUSION

Findings suggest age does impact performance on AAC. However, the difference in technology experience in older adult groups did not affect performance. Furthermore, both interfaces used in the current study were equally beneficial when describing pictures by healthy adults. Implications for RehabilitationAugmentative and alternative communication (AAC) systems involve various interface designs. Consequently, the comparative utility of these interfaces must be examined across populations and communicative functions.Advancement in technology has given rise to numerous high-tech AAC interface designs. However, older adults with acquired language difficulties whose technology experience is limited may become reluctant to use high-tech AAC. Hence, the  influence of technology experience on high-tech AAC performance should be investigated.Prior to examining interfaces with individuals with acquired language difficulties, the current study examined the use of a) grid display and b) visual scene display (VSD) with single word hotspots, by healthy adults of different ages and technology experiences.The study revealed that older adults with limited technology experience were equally competent in using high-tech AAC interfaces, as those with technology experience. Hence, an individual's technology experience should not be considered a deterrent to using high-tech AAC interfaces.Additionally, the study found no differences in performance between the two interfaces, making it essential to consider user's personal preference when adopting AAC interface designs.

Strategies for highlighting items within visual scene displays to support augmentative and alternative communication access for those with physical impairments

PURPOSE

In contrast to the traditional grid-based display, visual scene displays (VSDs) offer a new paradigm for aided communication. For individuals who cannot select items from an AAC display by direct selection due to physical impairments, AAC access can be supported via methods such as item scanning. Item scanning sequentially highlights items on a display until the individual signals for selection. How items are highlighted or scanned for AAC access can impact performance outcomes. Further, the effectiveness of a VSD interface may be enhanced through consultation with experts in visual communication. Therefore, to support AAC access for those with physical impairments, the aim of this study was to evaluate the perspectives of experts in visual communication regarding effective methods for highlighting VSD elements.

METHODS

Thirteen participants with expertise related to visual communication (e.g., photographers, artists) completed semi-structured interviews regarding techniques for item highlighting.

RESULTS

Study findings identified four main themes to inform how AAC items may be highlighted or scanned, including (1) use of contrast related to light and dark, (2) use of contrast as it relates to colour, (3) outline highlighting, and (4) use of scale and motion.

CONCLUSION

By identifying how compositional techniques can be utilized to highlight VSD elements, study findings may inform current practice for scanning-based AAC access, along with other selection techniques where feedback or highlighting is used (e.g., eye-gaze, brain-computer interface). Further, avenues for just-in-time programming are discussed to support effective implementation for those with physical impairments.IMPLICATIONS FOR REHABILITATIONFindings identify multiple potential techniques to improve scanning through items in a photograph for individuals with severe motor impairments using alternative access strategies.Study findings inform current practice for scanning-based AAC access, along with other selection techniques where feedback or highlighting is used (e.g., eye-gaze, brain-computer interface).Avenues for just in time programming of AAC displays are discussed to decrease programming demands and support effective implementation of study findings.

Preference and visual cognitive processing demands of alphabetic and QWERTY keyboards of individuals with and without brain injury

Following a severe brain injury (BI), some literate individuals who require augmentative and alternative communication (AAC) strategies to support communication may benefit from the use of onscreen keyboards to generate text. A range of layouts are available to these individuals within specialized communication software. However, a paucity of information is available to describe user preferences, user perceptions, as well as the visual-cognitive processing demands of such layouts. Such information is critical to guide clinical decision-making for keyboard selection and to provide patient-centered services. This study: (a) described the preferences and perceptions of two onscreen keyboard layouts (QWERTY and alphabetic) and (b) used eye-tracking analysis to investigate the visual-cognitive processing demands between these onscreen keyboards for individuals with and without BI. Results indicated participants in both groups held a strong preference for QWERTY keyboard interfaces and had extensive prior experience using the QWERTY keyboard layout on mobile devices. Eye-tracking analysis revealed less visual-cognitive processing demands using a QWERTY keyboard layout for both groups but were only statistically significant for those without BI. Results suggest that use of a keyboard layout that aligns with client preferences and prior experiences (i.e., the QWERTY keyboard for these participants) may lead to increased satisfaction with the communication experience and increased communication efficiency.

What's in a Photograph? The Perspectives of Composition Experts on Factors Impacting Visual Scene Display Complexity for Augmentative and Alternative Communication and Strategies for Improving Visual Communication

Purpose Visual scene displays (VSDs) can support augmentative and alternative communication (AAC) success for children and adults with complex communication needs. Static VSDs incorporate contextual photographs that include meaningful events, places, and people. Although the processing of VSDs has been studied, their power as a medium to effectively convey meaning may benefit from the perspective of individuals who regularly engage in visual storytelling. The aim of this study was to evaluate the perspectives of individuals with expertise in photographic and/or artistic composition regarding factors contributing to VSD complexity and how to limit the time and effort required to apply principles of photographic composition. Method Semistructured interviews were completed with 13 participants with expertise in photographic and/or artistic composition. Results Four main themes were noted, including (a) factors increasing photographic image complexity and decreasing cohesion, (b) how complexity impacts the viewer, (c) composition strategies to decrease photographic image complexity and increase cohesion, and (d) strategies to support the quick application of composition strategies in a just-in-time setting. Findings both support and extend existing research regarding best practice for VSD design. Conclusions Findings provide an initial framework for understanding photographic image complexity and how it differs from drawn AAC symbols. Furthermore, findings outline a toolbox of composition principles that may help limit VSD complexity, along with providing recommendations for AAC development to support the quick application of compositional principles to limit burdens associated with capturing photographic images. Supplemental Material https://doi.org/10.23641/asha.15032700.

Clinical and Research Perspectives on Visual Scene Displays

Purpose The purposes of this study were to measure the perceptions of speech-language pathologists (SLPs) and researchers regarding the design of visual scene displays (VSDs) and to investigate the perceived difficulties of SLPs in regard to the acquisition and programming of VSDs. Method We recruited 270 SLPs and nine researchers who focus on VSDs to complete an online survey. The SLP survey addressed both perception of VSD design and difficulties associated with implementing these images as communication supports in the clinical realm. The researcher group was surveyed solely regarding their opinions associated with VSD design. Results SLPs and researchers both ranked high-context VSDs as more effective at supporting communication than low-context VSDs. In addition, both groups ranked VSDs with task-engaged people as more effective at supporting communication than VSDs with camera-engaged people or no people. SLPs reported difficulties with acquiring high-quality VSDs from online sources as well as difficulties with maintenance and upkeep of VSDs. In addition, a large portion of SLPs reported challenges with representing complex concepts through VSDs. Conclusions Results from this study provide evidence of general agreement between SLPs and researchers regarding perception of VSD design. SLPs continue to report challenges with the acquisition and programming of VSDs. Further research is needed to develop evidence-based guidelines to support clinical endeavors in these areas.

Personalization of Visual Scene Displays: Preliminary Investigations of Adults with Aphasia, Typical Females across the Age-Span, and Young Adult Males and Females

Visual scene displays (VSDs) are becoming an increasingly popular method of message representation within augmentative and alternative communication (AAC) supports; however, design factors can influence the effectiveness of these images as communication supports. One issue that has come to light in recent years is the fact that selecting personalized VSDs, which depict the person with complex communication needs or an individual with whom they are familiar, are preferred over generic VSDs, which depict unfamiliar individuals. Although personalization is likely an important factor in the usability of VSDs, these images may be difficult for clinicians to obtain. As such, compromises must be identified. The purpose of this study was to explore the effects of controlling personal relevance factors (i.e., age and gender of the people depicted in generic VSDs) on the image preference patterns of adults with and without aphasia. Results from three very preliminary study summaries indicate that gender and age are both mitigating factors in image preference, as males tended to indicate preference for VSDs containing males over those containing females. In addition, females tended to indicate preference for females of a similar age depicted in VSDs.

Speech-Language pathologists' decisions when designing an aided AAC display for a compilation case study of a beginning communicator

PURPOSE

The current study sought to identify decisions speech-language pathologists (SLPs) make and their rationale for those decisions when designing an AAC display for a hypothetical school-aged child who was a beginning communicator. Augmentative and alternative communication (AAC) displays support communicative interactions for children who are unable to use spoken language to meet their communication needs. Children who are at the early stages of learning language, often termed beginning or emerging communicators, may rely heavily on the AAC display to support comprehension and expression. Thus, it is important for speech-language pathologists (SLPs) to design a display that facilitates beginning communicators' communication development.

METHODS

This paper reports on the answers related to a specific case study presented in an online survey completed by 77 SLPs with experience in AAC.

RESULTS

Data illustrated design decisions driven by child-specific characteristics and informed by research regarding type of layout, representation, and the importance of various design features.

CONCLUSIONS

Suggestions for future research are provided, including identifying goals and communicative functions best supported by different types of displays, clinicians' challenges/successes growing a system with the child, and determining the importance of symbol arrangement and organisation in communicative tasks by AAC users.Implications for RehabilitationIdentification of current practices reported by speech-language pathologists given a case study to develop and implement future research.A gap between research and practice suggests the need for better dissemination and application of research supporting the inclusion of people engaged in the event depicted in a visual scene display.Foundations for future research to provide guidance regarding best design of and communication goals supported by visual scene displays and grid-based displays.

Eye Tracking Measures Reveal How Changes in the Design of Displays for Augmentative and Alternative Communication Influence Visual Search in Individuals With Down Syndrome or Autism Spectrum Disorder

Purpose This research note reports on how small changes to the organization of a simulated display for augmentative and alternative communication influence the visual search patterns of individuals with Down syndrome or autism, as measured through eye tracking technologies. Prior research had demonstrated that clustering symbols by their internal color facilitates search and reduces attention to distracters, in children with typical development. This research systematically replicated the procedures with individuals with Down syndrome or autism spectrum disorder. Method Participants engaged in a visual search task on a monitor with embedded automated eye tracking technology. Patterns of gaze during search were measured via this technology. Results Participants were significantly faster to fixate on the target and to select it with the mouse when the like-colored symbols were clustered together. In addition, participants were significantly less likely to fixate on distracters in the clustered condition. No group differences were found. Conclusions Small changes to the organization of the simulated augmentative and alternative communication display resulted in substantial differences in eye gaze and speed to find a target. Of greatest clinical import is the finding that clustering symbols reduced attention to distracters, given that individuals with disabilities may be prone to distraction.

Effects of a nutritional intervention using pictorial representations for promoting knowledge and practices of healthy eating among Brazilian adolescents

This study aimed to evaluate the effect of a nutritional intervention involving a problem-raising approach and the use of pictorial representations on the promotion of knowledge and practices of healthy eating among adolescents. This randomized study included 461 adolescents from public schools in Brasilia, Federal District, Brazil (intervention group: 273 students from four schools; control group: 188 students from three schools). Mean age was 14.8±1.0, and 52.9% were boys. The intervention consisted of three meetings with interactive activities about principles of healthy eating, food classification, importance of reading labels and analyzing food advertising critically, and representations of healthy and unhealthy meals and their sugar, salt, and fat content. Pictorial materials consisted of food drawings, food models, and a food packaging model. Controls were not exposed to any activity. Dietary knowledge, consumption, and behaviors were the variables of interest. The intervention group showed a higher mean score of correct answers to questions about dietary knowledge than the control group (p = 0.0006), with higher odds of correctly answering questions about in natura (OR: 3.7; 95% CI: 1.9–6.6), minimally processed (OR: 3.6; 95% CI: 1.9–6.4), processed (OR: 2.2; 95% CI: 1.1–4.3), and ultra-processed foods (OR: 3.5; 95% CI: 1.8–6.6) and composition of ultra-processed foods (OR: 2.4; 95% CI: 1.3–4.4). Participants in the intervention group were also 2.5 times more likely to correctly answer questions about the importance of the dietary environment (95% CI: 1.1–5.5) and caution with food advertising (95% CI: 1.2–5.3) than controls. Increased weekly consumption of vegetables (p = 0.0077; OR: 2.4; 95% CI: 1.26–4.51) and reduced consumption of soft drinks (p = 0.0212; OR: 0.36; 95% CI: 0.15–0.86) were observed in the intervention group compared to the control group. The proposed intervention increased adolescents’ knowledge and improved some of their dietary habits. Educational activities using a problem-raising approach and pictorial representations of food appear to be effective in promoting healthy eating practices among adolescents.

Designing effective AAC displays for individuals with developmental or acquired disabilities: State of the science and future research directions

This paper reviews research on the impact of AAC display variables on visual attention and performance of children with developmental disabilities and adults with acquired conditions, and considers implications for designing effective visual scene displays (VSDs) or grids. When using VSDs with children with developmental disabilities or adults with acquired conditions, research supports the use of personalized photo VSDs that include familiar people engaged in meaningful activities, with navigation bars with thumbnail VSDs, located adjacent to the main VSD. Adults with acquired conditions seem to benefit from the inclusion of text boxes adjacent to the scene. Emerging evidence supports the use of motion to capture visual attention to VSDs (video VSDs) or to specific elements in VSDs. When using grid displays with children with developmental disabilities, research supports the use of spatial cues and clustering based on internal symbol colour to facilitate visual searching and selection. Background colour does not seem to facilitate searching for symbols on smaller displays, and may actually distract children from processing the meaningful components of symbols. Preliminary research suggests that the organization of onscreen keyboards and the number, types, and pairings of symbols in grids may impact performance of adults with acquired conditions. Directions for future research are discussed.

Gaze Toward Naturalistic Social Scenes by Individuals With Intellectual and Developmental Disabilities: Implications for Augmentative and Alternative Communication Designs

PURPOSE

A striking characteristic of the social communication deficits in individuals with autism is atypical patterns of eye contact during social interactions. We used eye-tracking technology to evaluate how the number of human figures depicted and the presence of sharing activity between the human figures in still photographs influenced visual attention by individuals with autism, typical development, or Down syndrome. We sought to examine visual attention to the contents of visual scene displays, a growing form of augmentative and alternative communication support.

METHOD

Eye-tracking technology recorded point-of-gaze while participants viewed 32 photographs in which either 2 or 3 human figures were depicted. Sharing activities between these human figures are either present or absent. The sampling rate was 60 Hz; that is, the technology gathered 60 samples of gaze behavior per second, per participant. Gaze behaviors, including latency to fixate and time spent fixating, were quantified.

RESULTS

The overall gaze behaviors were quite similar across groups, regardless of the social content depicted. However, individuals with autism were significantly slower than the other groups in latency to first view the human figures, especially when there were 3 people depicted in the photographs (as compared with 2 people). When participants' own viewing pace was considered, individuals with autism resembled those with Down syndrome.

CONCLUSION

The current study supports the inclusion of social content with various numbers of human figures and sharing activities between human figures into visual scene displays, regardless of the population served. Study design and reporting practices in eye-tracking literature as it relates to autism and Down syndrome are discussed.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.6066545.

The effect of human engagement depicted in contextual photographs on the visual attention patterns of adults with traumatic brain injury

Photographs are a frequently employed tool for the rehabilitation of adults with traumatic brain injury (TBI). Speech-language pathologists (SLPs) working with these individuals must select photos that are easily identifiable and meaningful to their clients. In this investigation, we examined the visual attention response to camera- (i.e., depicted human figure looking toward camera) and task-engaged (i.e., depicted human figure looking at and touching an object) contextual photographs for a group of adults with TBI and a group of adults without neurological conditions. Eye-tracking technology served to accurately and objectively measure visual fixations. Although differences were hypothesized given the cognitive deficits associated with TBI, study results revealed little difference in the visual fixation patterns of adults with and without TBI. Specifically, both groups of participants tended to fixate rapidly on the depicted human figure and fixate more on objects in which a human figure was task-engaged than when a human figure was camera-engaged. These results indicate that strategic placement of human figures in a contextual photograph may modify the way in which individuals with TBI visually attend to and interpret photographs. In addition, task-engagement appears to have a guiding effect on visual attention that may be of benefit to SLPs hoping to select more effective contextual photographs for their clients with TBI. Finally, the limited differences in visual attention patterns between individuals with TBI and their age and gender matched peers without neurological impairments indicates that these two groups find similar photograph regions to be worthy of visual fixation.

LEARNING OUTCOMES

Readers will gain knowledge regarding the photograph selection process for individuals with TBI. In addition, readers will be able to identify camera- and task-engaged photographs and to explain why task-engagement may be a beneficial component of contextual photographs.

AAC Technologies with Visual Scene Displays and "Just in Time" Programming and Symbolic Communication Turns Expressed by Students with Severe Disability

BACKGROUND

The current study investigated the impact of an intervention that included aided augmentative and alternative communication (AAC) technologies on the frequency of symbolic communication turns of school-age children, adolescents, and young adults with severe disability.

METHOD

Nine students ages 8-20 were engaged in interactive activities using an aided AAC system with visual scene displays (VSDs; concepts embedded within a photograph of a naturally occurring event), and "just-in-time" (JIT) programming (the capability to add new contexts "on the fly"). Effectiveness was evaluated using a single subject multiple probe across participants design.

RESULTS

All participants demonstrated increases in symbolic communication turns upon introduction of the AAC technologies with VSDs using JIT technology.

CONCLUSIONS

AAC with VSDs and JIT programming may be effective in increasing symbolic communication for students with severe developmental disability. The fast and easy creation of VSDs and hotspots to provide communication may be a valuable tool for interventionists.

More Than the Verbal Stimulus Matters: Visual Attention in Language Assessment for People With Aphasia Using Multiple-Choice Image Displays

PURPOSE

Language comprehension in people with aphasia (PWA) is frequently evaluated using multiple-choice displays: PWA are asked to choose the image that best corresponds to the verbal stimulus in a display. When a nontarget image is selected, comprehension failure is assumed. However, stimulus-driven factors unrelated to linguistic comprehension may influence performance. In this study we explore the influence of physical image characteristics of multiple-choice image displays on visual attention allocation by PWA.

METHOD

Eye fixations of 41 PWA were recorded while they viewed 40 multiple-choice image sets presented with and without verbal stimuli. Within each display, 3 images (majority images) were the same and 1 (singleton image) differed in terms of 1 image characteristic. The mean proportion of fixation duration (PFD) allocated across majority images was compared against the PFD allocated to singleton images.

RESULTS

PWA allocated significantly greater PFD to the singleton than to the majority images in both nonverbal and verbal conditions. Those with greater severity of comprehension deficits allocated greater PFD to nontarget singleton images in the verbal condition.

CONCLUSION

When using tasks that rely on multiple-choice displays and verbal stimuli, one cannot assume that verbal stimuli will override the effect of visual-stimulus characteristics.

Comparing the Effects of Speech-Generating Device Display Organization on Symbol Comprehension and Use by Three Children With Developmental Delays

PURPOSE

Three children ages 3;6 to 5;3 with developmental and language delays were provided experience with a traditional grid-based display and a contextually organized visual scene display on a speech-generating device to illustrate considerations for practice and future research in augmentative and alternative communication assessment and intervention.

METHOD

Twelve symbols were taught in a grid display and visual scene display using aided input during dramatic play routines. Teaching sessions were 30 minutes a day, 5 days a week for 3 weeks. Symbol comprehension and use was assessed pre and post 3 weeks of experience.

RESULTS

Comprehension of symbol vocabulary on both displays increased after 3 weeks of experience. Participants 1 and 2 used both displays largely for initiation. Participant 3 had limited expressive use of either display.

CONCLUSIONS

The methods used in this study demonstrate one way to inform individual differences in learning and preference for speech-generating device displays when making clinical decisions regarding augmentative and alternative communication supports for a child and their family. Future research should systematically examine the role of extant comprehension, symbol experience, functional communication needs, and the role of vocabulary type in the learning and use of grid displays versus visual scene displays.

A Comparison of the Visual Attention Patterns of People With Aphasia and Adults Without Neurological Conditions for Camera-Engaged and Task-Engaged Visual Scenes

PURPOSE

The purpose of the study was to compare the visual attention patterns of adults with aphasia and adults without neurological conditions when viewing visual scenes with 2 types of engagement.

METHOD

Eye-tracking technology was used to measure the visual attention patterns of 10 adults with aphasia and 10 adults without neurological conditions. Participants viewed camera-engaged (i.e., human figure facing camera) and task-engaged (i.e., human figure looking at and touching an object) visual scenes.

RESULTS

Participants with aphasia responded to engagement cues by focusing on objects of interest more for task-engaged scenes than camera-engaged scenes; however, the difference in their responses to these scenes were not as pronounced as those observed in adults without neurological conditions. In addition, people with aphasia spent more time looking at background areas of interest and less time looking at person areas of interest for camera-engaged scenes than did control participants.

CONCLUSIONS

Results indicate people with aphasia visually attend to scenes differently than adults without neurological conditions. As a consequence, augmentative and alternative communication (AAC) facilitators may have different visual attention behaviors than the people with aphasia for whom they are constructing or selecting visual scenes. Further examination of the visual attention of people with aphasia may help optimize visual scene selection.

A comparison of two approaches for representing AAC vocabulary for young children

PURPOSE

Young children with complex communication needs often experience difficulty in using currently available graphic symbol systems as a method of augmentative and alternative communication (AAC). Information on young children's performance with graphic representations based on this population's conceptualizations of these vocabulary items may assist in the development of more effective AAC systems.

METHOD

This study developed Developmentally Appropriate Symbols (DAS) for 10 early emerging vocabulary concepts using procedures designed to address both conceptual and appeal issues for graphic representations for young children. Using a post-test only, between-subjects comparison group design, 40 typically-developing 2.5-3.5-year-old children were randomly assigned to receive a brief training in either of two different types of graphic symbol sets: (a) DAS or (b) Picture Communication Symbols (PCS), a, commercially available graphic symbol system.

RESULT

Results of a two sample independent t-test provide evidence that children in the DAS condition correctly identified more symbols than children trained with the PCS symbols. There was no evidence of a preference between the symbol sets.

CONCLUSION

The results provide support for careful consideration of children's use and understanding of language in developing AAC systems for young children.

Eye tracking research to answer questions about augmentative and alternative communication assessment and intervention

Recently, eye tracking technologies (i.e., technologies that automatically track the point of an individual's gaze while that person views or interacts with a visual image) have become available for research purposes. Based on the sampling of the orientation of the individual's eyes, researchers can quantify which locations within the visual image were fixated (viewed), for how long, and how many times. These automated eye tracking research technologies open up a wealth of avenues for investigating how individuals with developmental or acquired communication disabilities may respond to aided augmentative and alternative communication (AAC) systems. In this paper, we introduce basic terminology and explore some of the special challenges of conducting eye tracking research with populations with disabilities who might use AAC, including challenges of inferring attention from the presence of fixation and challenges related to calibration that may result from participant characteristics, behavioral idiosyncracies, and/or the number of calibration points. We also examine how the technology can be applied to ask well-structured experimental questions that have direct clinical relevance, with a focus on the unique contributions that eye tracking research can provide by (a) allowing evaluation of skills in individuals who are difficult to assess via traditional methods, and (b) facilitating access to information on underlying visual cognitive processes that is not accessible via traditional behavioral measures.

Predicting language outcomes for children learning augmentative and alternative communication: child and environmental factors

PURPOSE

To investigate a model of language development for nonverbal preschool-age children learning to communicate with augmentative or alternative communication.

METHOD

Ninety-three preschool children with intellectual disabilities were assessed at Time 1, and 82 of these children were assessed 1 year later, at Time 2. The outcome variable was the number of different words the children produced (with speech, sign, or speech-generating devices). Children's intrinsic predictor for language was modeled as a latent variable consisting of cognitive development, comprehension, play, and nonverbal communication complexity. Adult input at school and home, and amount of augmentative or alternative communication instruction, were proposed mediators of vocabulary acquisition.

RESULTS

A confirmatory factor analysis revealed that measures converged as a coherent construct, and a structural equation model indicated that the intrinsic child predictor construct predicted different words children produced. The amount of input received at home, but not at school, was a significant mediator.

CONCLUSIONS

The hypothesized model accurately reflects a latent construct of Intrinsic Symbolic Factor (ISF). Children who evidenced higher initial levels of ISF and more adult input at home produced more words 1 year later. The findings support the need to assess multiple child variables and suggest interventions directed to the indicators of ISF and input.

Considerations for the composition of visual scene displays: potential contributions of information from visual and cognitive sciences

Aided augmentative and alternative (AAC) interventions have been demonstrated to facilitate a variety of communication outcomes in persons with intellectual disabilities. Most aided AAC systems rely on a visual modality. When the medium for communication is visual, it seems likely that the effectiveness of intervention depends in part on the effectiveness and efficiency with which the information presented in the display can be perceived, identified, and extracted by communicators and their partners. Understanding of visual-cognitive processing - that is, how a user attends, perceives, and makes sense of the visual information on the display - therefore seems critical to designing effective aided AAC interventions. In this Forum Note, we discuss characteristics of one particular type of aided AAC display, that is, Visual Scene Displays (VSDs) as they may relate to user visual and cognitive processing. We consider three specific ways in which bodies of knowledge drawn from the visual cognitive sciences may be relevant to the composition of VSDs, with the understanding the direct research with children with complex communication needs is necessary to verify or refute our speculations.