User modeling for people with special needs

LEAP Motion Technology and Psychology: A Mini-Review on Hand Movements Sensing for Neurodevelopmental and Neurocognitive Disorders

Technological advancement is constantly evolving, and it is also developing in the mental health field. Various applications, often based on virtual reality, have been implemented to carry out psychological assessments and interventions, using innovative human-machine interaction systems. In this context, the LEAP Motion sensing technology has raised interest, since it allows for more natural interactions with digital contents, via an optical tracking of hand and finger movements. Recent research has considered LEAP Motion features in virtual-reality-based systems, to meet specific needs of different clinical populations, varying in age and type of disorder. The present paper carried out a systematic mini-review of the available literature using Preferred Reporting Items for Systematic Reviews and Meta-analysis (PRISMA) guidelines. The inclusion criteria were (i) publication date between 2013 and 2020, (ii) being an empirical study or project report, (iii) written in English or Italian languages, (iv) published in a scholarly peer-reviewed journal and/or conference proceedings, and (v) assessing LEAP Motion intervention for four specific psychological domains (i.e., autism spectrum disorder, attention-deficit/hyperactivity disorder, dementia, and mild cognitive impairment), objectively. Nineteen eligible empirical studies were included. Overall, results show that protocols for attention-deficit hyperactivity disorder and autism spectrum disorder can promote psychomotor and psychosocial rehabilitation in contexts that stimulate learning. Moreover, virtual reality and LEAP Motion seem promising for the assessment and screening of functional abilities in dementia and mild cognitive impairment. As evidence is, however, still limited, deeper investigations are needed to assess the full potential of the LEAP Motion technology, possibly extending its applications. This is relevant, considering the role that virtual reality could have in overcoming barriers to access assessment, therapies, and smart monitoring.

Parametric Cognitive Modeling of Information and Computer Technology Usage by People with Aging- and Disability-Derived Functional Impairments

Despite the speedy evolution of Information and Computer Technology (ICT), and the growing recognition of the importance of the concept of universal design in all domains of daily living, mainstream ICT-based product designers and developers still work without any truly structured tools, guidance or support to effectively adapt their products and services to users’ real needs. This paper presents the approach used to define and evaluate parametric cognitive models that describe interaction and usage of ICT by people with aging- and disability-derived functional impairments. A multisensorial training platform was used to train, based on real user measurements in real conditions, the virtual parameterized user models that act as subjects of the test-bed during all stages of simulated disabilities-friendly ICT-based products design. An analytical study was carried out to identify the relevant cognitive functions involved, together with their corresponding parameters as related to aging- and disability-derived functional impairments. Evaluation of the final cognitive virtual user models in a real application has confirmed that the use of these models produce concrete valuable benefits to the design and testing process of accessible ICT-based applications and services. Parameterization of cognitive virtual user models allows incorporating cognitive and perceptual aspects during the design process.