Evaluation Tools for Assistive Technologies: A Scoping Review

Designing electronic graphic symbol-based AAC systems: a scoping review. Part 2: application of human-centred design

PURPOSE

This is the second of two papers summarizing studies reporting on the design of electronic graphic symbol-based augmentative and alternative communication (AAC) systems. The aim of this paper was to describe the design approaches used and to determine to what extent the principles of human-centred design (HCD) were reflected in the design approaches and processes used.

METHODS

A scoping review was conducted. A multifaceted search resulted in the identification of 28 studies meeting the selection criteria. Data were extracted relating to four areas of interest, namely, (1) the general characteristics of the studies, (2) features of the systems designed, (3) availability of the systems to the public and (4) the design processes followed. In this paper, findings related to the last area are presented.

RESULTS

Design approaches were often inconsistently described. User-centred design was mentioned more often than HCD. Even so, various HCD principles were considered in most studies. Notably, stakeholders were involved in the design process in all studies. However, users were not involved in all studies and stakeholder roles were predominantly informative rather than collaborative. Prototype and product evaluations focussed mostly on usability rather than user experience. Although many design teams were multidisciplinary, engineers and computer scientists predominated.

CONCLUSIONS

There is a need for designers to be more transparent about the type of design approach used to guide the system design and also to clearly report on design approaches and processes used. The application of HCD to the design of graphic symbol-based AAC systems is still limited.Implications for rehabilitationHuman-centred design approaches can productively guide the design of electronic graphic symbol-based augmentative and alternative communication (AAC) systems.Creative methods are needed to involve stakeholders with complex communication needs in all phases of the design process.Evaluation of electronic graphic symbol-based AAC systems should consider both usability and user experience.

The experiences and perceptions of health-care professionals regarding assistive technology training: A systematic review

Worldwide, there is an increasing demand for assistive technologies (ATs) that can support people to live independently for longer. Health-care professionals (HCPs) often recommend AT devices, however there exists a lack of availability of devices and appropriate training in the field. This systematic review aimed to synthesize the available evidence into the experiences and training needs of HCPs in relation to AT. Six electronic databases were searched without date restrictions: MEDLINE, PsycINFO, SPP, SSCI, CINAHL, and ASSIA. Journal handsearching, searching reference lists of included studies and relevant reviews, and contacting experts in the field of AT were also conducted. Findings were analyzed using narrative synthesis. Data from 7846 participants from 62 studies were synthesized, eliciting perceived challenges in access to and provision of training, resulting in knowledge gaps across disciplines and geographic locations. Mechanisms to mitigate these issues included ongoing support following training and tailoring education to meet individual needs since comprehensive training is essential to maintain and improve competence, knowledge, and confidence. Further research is required to explore the impact and effectiveness of AT training for HCPs to ensure that users of devices are supported to live independent and healthy lives.

Psychosocial predictors of mobility assistive devices non-adherence among older adults

Background: Mobility assistive devices (MADs) provide support to older adults to improve their quality of life; however, research shows that as many as 75% of older adults are non-adherent to prescribed MADs. This study investigated the psychosocial factors that predict non-adherence to MADs among older adults.Methods: A sample of Canadian older adult MADs users who resided in a long-term care facility was included. The data was collected using the Psychosocial Impact of Assistive Devices Scale (PIADS), and the Medical Outcomes Study Social Support Survey (mMOS-SS). Data analysis was performed using SPSS 28. Descriptive statistics were used to describe the sample and the study variables. Pearson correlation coefficients were used to evaluate the association between the study variables. Variables that were associated with non-adherence in a univariate analysis were subsequently entered into a multiple regression analysis.Results: The sample comprised 48 residents (26 females and 22 males), with a mean age of 86.8. In the univariate analysis, scores from the three PIADS subscales, namely, Competence, Adaptability, and Self-esteem, and the Social Support scale were significantly correlated with non-adherence (p < 0.05). In the multiple regression analyses, only Self-esteem significantly predicted non-adherence (p < 0.05), and this model explained between 43.5 and 54.3% of the variance in non-adherence.Conclusion: This study revealed that the Self-esteem construct, which includes several concepts related to psychological well-being, was the only significant predictor of non-adherence among the studied sample of older adults. The clinical implications of the findings are subsequently discussed.

Available Assistive Technology Outcome Measures: Systematic Review

BACKGROUND

The World Health Organization claimed that measuring outcomes is necessary to understand the benefits of assistive technology (AT) and create evidence-based policies and systems to ensure universal access to it. In clinical practice, there is an increasing need for standardized methods to track AT interventions using outcome assessments.

OBJECTIVE

This review provides an overview of the available outcome measures that can be used at the follow-up stage of any AT intervention and integrated into daily clinical or service practice.

METHODS

We systematically searched for original manuscripts regarding available and used AT outcome measures by searching for titles and abstracts in the PubMed, Scopus, and Web of Science databases up to March 2023.

RESULTS

We analyzed 955 articles, of which 50 (5.2%) were included in the review. Within these, 53 instruments have been mentioned and used to provide an AT outcome assessment. The most widely used tool is the Quebec User Evaluation of Satisfaction with Assistive Technology, followed by the Psychosocial Impact of Assistive Technology Scale. Moreover, the identified measures addressed 8 AT outcome domains: functional efficacy, satisfaction, psychosocial impact, caregiver burden, quality of life, participation, confidence, and usability. The AT category Assistive products for activities and participation relating to personal mobility and transportation was the most involved in the reviewed articles.

CONCLUSIONS

Among the 53 cited instruments, only 17 (32%) scales were designed to evaluate specifically assistive devices. Moreover, 64% (34/53) of the instruments were only mentioned once to denote poor uniformity and concordance in the instruments to be used, limiting the possibility of comparing the results of studies. This work could represent a good guide for promoting the use of validated AT outcome measures in clinical practice that can be helpful to AT assessment teams in their everyday activities and the improvement of clinical practice.

"Functioning better is doing better": older adults' priorities for the evaluation of assistive technology

Despite the benefits of assistive technology (AT), barriers to technology adoption still exist and are uniquely affecting older populations. Improving technology adoption can be achieved by involving end-users in the development and evaluation process. However, existing AT evaluation tools rarely take into account older adults' experiences. The goal of this study was to fill this gap by determining which AT evaluation criteria are important for older adults. We conducted 4 nominal group meetings with 21 participants aged 50+ in Vancouver, Canada. In the meetings, participants generated AT evaluation criteria and organized them in the order of importance. The content from the meetings was analyzed using qualitative content analysis. Final rankings were collated to reveal which criteria were the most important across the groups. We found that promotion of independence, affordability, ease of use and ethics are the most important AT evaluation criteria for older adults. Some aspects of ATs that older adults value, such as reliability, are not featured in AT evaluation tools. This study provides insight into older adults' priorities for AT evaluation criteria, and concerns that older adults have about AT use. The findings are supplemented with a comprehensive analysis of the group discussions that contextualizes the criteria.

Functional impact of augmentative and alternative communication scale: development of an outcome measure for educators of students with complex communication needs

PURPOSE

The study aim was to develop and assess the measurement properties of the Functional Impact of Augmentative and Alternative Communication - Educator (FIAAC-E) scale - an educator-reported measure designed to detect change in factors associated with communicative participation in students who use augmentative and alternative communication (AAC).

METHODS

The study had three phases. In phase 1 (content validity), 22 content specialists independently rated the relevancy of 22 dimensions proposed for the new scale. In phase 2 (item generation, face validity), 8 educators independently completed a preliminary version of the FIAAC-E scale and flagged items that were unclear. Next, these educators adjusted the wording of unclear items during consensus-building sessions. In phase 3 (item reduction, reliability, convergent validity), 62 educators completed an online survey that included the revised FIAAC-E scale. Survey data were used to shorten the scale, estimate its reliability, and evaluate support for its convergent validity.

RESULTS

In phase 1, the 11 dimensions ranked most highly by content specialists were selected for inclusion in the preliminary scale. In phase 2, educators reviewed 113 items and revised 33 to improve clarity. In phase 3, correlational statistics informed the selection of 77 items for the shortened scale. Subsequent data analyses indicated acceptable levels of internal consistency and test-retest reliability and support for convergent validity of the preliminary measure.

CONCLUSION

The study provides emerging evidence that supports the FIAAC-E scale as a reliable way to evaluate communicative participation in children and youth who use AAC systems at school.Implications for rehabilitationUsing a reliable means to measure the effectiveness of AAC for children and youth at school may reveal important factors that influence successful communicative, academic, and social participation in school.The FIAAC-E scale is a promising educator-reported questionnaire to inform the development of communication goals and monitor progress towards meeting these goals for students with complex communication needs.

Patient-reported benefits of bone-anchored transfemoral prostheses as assessed by MedTech20: A general outcome measure for medical products

BACKGROUND

The medical community demands evidence for the benefits of medical devices such as bone-anchored prostheses (BAPs). MedTech20  is a novel instrument aiming to address general benefits of medical devices.

OBJECTIVE

To describe general patient-reported benefits of BAPs measured with MedTech20.

STUDY DESIGN

This is a cross-sectional descriptive survey.

METHODS

Patients treated in Sweden who had used a BAP for >1 year were mailed the MedTech20  Questionnaire. Responses to each attribute were described, and the MedTech20   Index (0-1), in which a higher figure represents larger benefits from the product, was calculated. Index values were compared based on demographic variables (sex, unilateral or bilateral transfemoral amputation (TFA), and those having experienced any complication of implant parts or the prosthetic connection device).

RESULTS

The response rate was 72%. The 62 participants (41 men and 21 women; mean age 57 years) had 11 ± 6.9 mean years of BAP experience. Single attributes stated as highly relevant and with high benefit for BAPs included perceived reliability, perceived safety, sense of control of the disability, facilitation of movement outside home, no discomfort at use, and ease of use. Attributes with less relevance included aid to remember tasks, reduction of barriers to a good sleep, and reduced sense of compromised integrity. The MedTech20  Index was 0.655 ± 0.188 and was not statistically significantly different based on any of the demographic variables.

CONCLUSIONS

By using a general measure on attributes of medical devices, this study provides new insights strengthening the evidence regarding the benefits that BAPs provide for patients with TFA who had difficulties with socket-suspended prostheses.

Different effects of using pictures as stimuli in a P300 brain-computer interface under rapid serial visual presentation or row-column paradigm

Previous proposals for controlling a P300-based BCI speller have shown an improvement using alternative images instead of letters as target stimuli under a row-column paradigm (RCP). However, the RCP is not suitable for those patients with a lack of gaze control. To solve that, the rapid serial visual presentation (RSVP) paradigm has been proposed in previous studies. The aim of the present work is to assess if a set of alternative pictures that improved performance in RCP could also improve performance in RSVP. Sixteen participants controlled four conditions in calibration and online tasks: letters in RCP, pictures in RCP, letters in RSVP and pictures in RSVP. The effect given by pictures was greater under RCP than under RSVP, both for performance and event-related potential analyses. Indeed, pictures did not show any improvement under RSVP in comparison to letters. In addition, the condition with pictures under RCP was declared the favourite by most users (68.75%), while the condition with pictures under RSVP was not chosen as favourite by any participant. Therefore, this work shows that the improvement related to the use of pictures as alternative flashing stimuli under RCP may not be transferred to RSVP. Graphical abstract.

Addressing the Ethics of Telepresence Applications Through End-User Engagement

Portacolone et al.'s Ethics Review highlights the ethical challenges associated with the implementation of telepresence devices and applications in the context of aging and dementia. In this response, we review ethical considerations as they relate to specific modalities of telepresence, with an emphasis on the continuum of potential interaction agents, from known individuals to fully automated and intelligent interlocutors. We further discuss areas in need of empirical evidence to inform regulatory efforts in telepresence. We close with a call for meaningful end-user engagement at all stages of technology development.