1
|
Mitchell CL, Cler GJ, Fager SK, Contessa P, Roy SH, De Luca G, Kline JC, Vojtech JM. Ability-Based Methods for Personalized Keyboard Generation. MULTIMODAL TECHNOLOGIES AND INTERACTION 2022; 6:67. [PMID: 36313956 PMCID: PMC9608338 DOI: 10.3390/mti6080067] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
This study introduces an ability-based method for personalized keyboard generation, wherein an individual's own movement and human-computer interaction data are used to automatically compute a personalized virtual keyboard layout. Our approach integrates a multidirectional point-select task to characterize cursor control over time, distance, and direction. The characterization is automatically employed to develop a computationally efficient keyboard layout that prioritizes each user's movement abilities through capturing directional constraints and preferences. We evaluated our approach in a study involving 16 participants using inertial sensing and facial electromyography as an access method, resulting in significantly increased communication rates using the personalized keyboard (52.0 bits/min) when compared to a generically optimized keyboard (47.9 bits/min). Our results demonstrate the ability to effectively characterize an individual's movement abilities to design a personalized keyboard for improved communication. This work underscores the importance of integrating a user's motor abilities when designing virtual interfaces.
Collapse
Affiliation(s)
| | - Gabriel J. Cler
- Department of Speech and Hearing Sciences, University of Washington, Seattle, WA 98105, USA
| | - Susan K. Fager
- Institute of Rehabilitation Science and Engineering, Madonna Rehabilitation Hospital, Lincoln, NE 68506, USA
| | - Paola Contessa
- Delsys, Inc., Natick, MA 01760, USA
- Altec, Inc., Natick, MA 01760, USA
| | - Serge H. Roy
- Delsys, Inc., Natick, MA 01760, USA
- Altec, Inc., Natick, MA 01760, USA
| | - Gianluca De Luca
- Delsys, Inc., Natick, MA 01760, USA
- Altec, Inc., Natick, MA 01760, USA
| | - Joshua C. Kline
- Delsys, Inc., Natick, MA 01760, USA
- Altec, Inc., Natick, MA 01760, USA
| | | |
Collapse
|
2
|
Mitchell C, Cler G, Fager S, Contessa P, Roy S, De Luca G, Kline J, Vojtech J. Ability-based Keyboards for Augmentative and Alternative Communication: Understanding How Individuals’ Movement Patterns Translate to More Efficient Keyboards. CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS EXTENDED ABSTRACTS 2022; 2022. [PMID: 36287777 PMCID: PMC9589473 DOI: 10.1145/3491101.3519845] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
This study presents the evaluation of ability-based methods extended to keyboard generation for alternative communication in people with dexterity impairments due to motor disabilities. Our approach characterizes user-specific cursor control abilities from a multidirectional point-select task to configure letters on a virtual keyboard based on estimated time, distance, and direction of movement. These methods were evaluated in three individuals with motor disabilities against a generically optimized keyboard and the ubiquitous QWERTY keyboard. We highlight key observations relating to the heterogeneity of the manifestation of motor disabilities, perceived importance of communication technology, and quantitative improvements in communication performance when characterizing an individual’s movement abilities to design personalized AAC interfaces.
Collapse
Affiliation(s)
| | - Gabriel Cler
- Department of Speech and Hearing Sciences, University of Washington, United States
| | - Susan Fager
- Institute of Rehabilitation Science and Engineering, Madonna Rehabilitation Hospital, United States
| | | | - Serge Roy
- Delsys, Inc. and Altec, Inc., United States
| | | | | | | |
Collapse
|