Multimedia Interventions for Neurodiversity: Leveraging Insights from Developmental Cognitive Neuroscience to Build an Innovative Practice

Multimedia technologies and virtual reality offer unique possibilities to manipulate sensory, motor, interpersonal, and cognitive processes contributing to atypical developmental trajectories, thus holding an explosive potential to design innovative and engaging interventions. However, there has been little progress in developing interventions that go beyond the patient’s diagnosis or the fascination of technology and rather spring from a deep understanding of the specific neuropsychological processes to be nurtured in individuals. This perspective paper outlines how recent insights from developmental cognitive neuroscience can be leveraged to promote children’s multidimensional development and highlight future directions and challenges for innovating both research and clinical practice. Finally, we focus on some practical examples of multimedia and virtual reality activities we have designed to stimulate bodily-self experiences, which are crucial for building up a coherent sense of self and lay the foundation for interacting with the external world. Atypical bodily self is an early marker of heterogeneous neurodevelopmental conditions (such as autism spectrum disorders) and seems to be under-targeted in research and clinical approaches.

Perception and Motion in Real and Virtual Environments: A Narrative Review of Autism Spectrum Disorders

Atypical sensorimotor developmental trajectories greatly contribute to the profound heterogeneity that characterizes Autism Spectrum Disorders (ASD). Individuals with ASD manifest deviations in sensorimotor processing with early markers in the use of sensory information coming from both the external world and the body, as well as motor difficulties. The cascading effect of these impairments on the later development of higher-order abilities (e.g., executive functions and social communication) underlines the need for interventions that focus on the remediation of sensorimotor integration skills. One of the promising technologies for such stimulation is Immersive Virtual Reality (IVR). In particular, head-mounted displays (HMDs) have unique features that fully immerse the user in virtual realities which disintegrate and otherwise manipulate multimodal information. The contribution of each individual sensory input and of multisensory integration to perception and motion can be evaluated and addressed according to a user’s clinical needs. HMDs can therefore be used to create virtual environments aimed at improving people’s sensorimotor functioning, with strong potential for individualization for users. Here we provide a narrative review of the sensorimotor atypicalities evidenced by children and adults with ASD, alongside some specific relevant features of IVR technology. We discuss how individuals with ASD may interact differently with IVR versus real environments on the basis of their specific atypical sensorimotor profiles and describe the unique potential of HMD-delivered immersive virtual environments to this end.

Immersive virtual reality health games: a narrative review of game design

BACKGROUND

High quality head-mounted display based virtual reality (HMD-VR) has become widely available, spurring greater development of HMD-VR health games. As a behavior change approach, these applications use HMD-VR and game-based formats to support long-term engagement with therapeutic interventions. While the bulk of research to date has primarily focused on the therapeutic efficacy of particular HMD-VR health games, how developers and researchers incorporate best-practices in game design to achieve engaging experiences remains underexplored. This paper presents the findings of a narrative review exploring the trends and future directions of game design for HMD-VR health games.

METHODS

We searched the literature on the intersection between HMD-VR, games, and health in databases including MEDLINE, Embase, CINAHL, PsycINFO, and Compendex. We identified articles describing HMD-VR games designed specifically as health applications from 2015 onwards in English. HMD-VR health games were charted and tabulated according to technology, health context, outcomes, and user engagement in game design.

FINDINGS

We identified 29 HMD-VR health games from 2015 to 2020, with the majority addressing health contexts related to physical exercise, motor rehabilitation, and pain. These games typically involved obstacle-based challenges and extrinsic reward systems to engage clients in interventions related to physical functioning and pain. Less common were games emphasizing narrative experiences and non-physical exercise interventions. However, discourse regarding game design was diverse and often lacked sufficient detail. Game experience was evaluated using primarily ad-hoc questionnaires. User engagement in the development of HMD-VR health games primarily manifested as user studies.

CONCLUSION

HMD-VR health games are promising tools for engaging clients in highly immersive experiences designed to address diverse health contexts. However, more in-depth and structured attention to how HMD-VR health games are designed as game experiences is needed. Future development of HMD-VR health games may also benefit from greater involvement of end-users in participatory approaches.