Performing Locomotion Tasks in Immersive Computer Games with an Adapted Eye-Tracking Interface

A Multimodal Direct Gaze Interface for Wheelchairs and Teleoperated Robots

Gaze-based interfaces are especially useful for people with disabilities involving the upper limbs or hands. Typically, users select from a number of options (e.g. letters or commands) displayed on a screen by gazing at the desired option. However, in some applications, e.g. gaze-based driving, it may be dangerous to direct gaze away from the environment towards a separate display. In addition, a purely gaze based interface can present a high cognitive load to users, as gaze is not normally used for selection and/or control, but rather for other purposes, such as information gathering. To address these issues, this paper presents a cost-effective multi-modal system for gaze based driving which combines appearance-based gaze estimates derived from webcam images with push button inputs that trigger command execution. This system uses an intuitive "direct interface", where users determine the direction of motion by gazing in the corresponding direction in the environment. We have implemented the system for both wheelchair control and robotic teleoperation. The use of our system should provide substantial benefits for patients with severe motor disabilities, such as ALS, by providing them with a more natural and affordable method of wheelchair control. We compare the performance of our system to the more conventional and common "indirect" system where gaze is used to select commands from a separate display, showing that our system enables faster and more efficient navigation.

A systematic review investigating outcome measures and uptake barriers when children and youth with complex disabilities use eye gaze assistive technology

Children with complex disabilities sometimes have difficulty communicating with their parents, caregivers, and teachers. For these children, eye gaze assistive technology can be used to facilitate communication. Eye gaze assistive technology outcomes for children and youth were analyzed in this systematic review. Database and hand-searches yielded 4412 unduplicated results, of which 11 articles were eligible for this review. Outcome measures, as well as environmental and personal factors, were mapped to the World Health Organization's International Classification of Functioning, Disability and Health framework. Communication outcomes were most prevalent and co-occurred with outcomes in all reported activities and participation domains. Environmental and personal factors were classified as either facilitators or as barriers in relation to device uptake and success. Although comprehensive professional and caregiver support was the primary facilitator for success, barriers could lead to rejection of the technology even when children were successful using the system.

Design and Development of One-Switch Video Games for Children with Severe Motor Disabilities

Video games are not just played for fun; they have become a handy instrument for the cognitive, emotional, and social development of children. However, several barriers prevent many children with disabilities from playing action-oriented video games, alone or with their peers. In particular, children with severe motor disabilities, who rely on one-switch interaction for accessing electronic devices, find fast-paced games that require rapid decision-making and timely responses, completely unplayable. This article contributes to lowering such barriers by presenting GNomon ( G aming NOMON ), a software framework based on the NOMON mode of interaction that allows the creation of action-oriented single-switch video games. The article reports the results of two studies that evaluate the playability and rehabilitation suitability of GNomon-based video games. The playability of GNomon-based games is evaluated by assessing their learnability, effectiveness, errors, satisfaction, memorability, and enjoyability with a group of eight children with severe motor disabilities. The suitability for pediatric rehabilitation is determined by means of a focus group with a team of speech therapists, physiotherapists, and psychologists from a Local Health Agency in Turin, Italy. The results of the playability study are positive: All children had fun playing GNomon-based video games, and seven of eight were able to interact and play autonomously. The results of the rehabilitation-suitability study also entail that GNomon-based games can be exploited in training hand-eye coordination and maintenance of selective attention over time. The article finally offers critical hindsight and reflections and shows possible new future game concepts.