An integrated telehealth system for remote administration of an adult autism assessment

Usability Assessment Methods for Mobile Apps for Physical Rehabilitation: Umbrella Review

BACKGROUND

Usability has been touted as one determiner of success of mobile health (mHealth) interventions. Multiple systematic reviews of usability assessment approaches for different mHealth solutions for physical rehabilitation are available. However, there is a lack of synthesis in this portion of the literature, which results in clinicians and developers devoting a significant amount of time and effort in analyzing and summarizing a large body of systematic reviews.

OBJECTIVE

This study aims to summarize systematic reviews examining usability assessment instruments, or measurements tools, in mHealth interventions including physical rehabilitation.

METHODS

An umbrella review was conducted according to a published registered protocol. A topic-based search of PubMed, Cochrane, IEEE Xplore, Epistemonikos, Web of Science, and CINAHL Complete was conducted from January 2015 to April 2023 for systematic reviews investigating usability assessment instruments in mHealth interventions including physical exercise rehabilitation. Eligibility screening included date, language, participant, and article type. Data extraction and assessment of the methodological quality (AMSTAR 2 [A Measurement Tool to Assess Systematic Reviews 2]) was completed and tabulated for synthesis.

RESULTS

A total of 12 systematic reviews were included, of which 3 (25%) did not refer to any theoretical usability framework and the remaining (n=9, 75%) most commonly referenced the ISO framework. The sample referenced a total of 32 usability assessment instruments and 66 custom-made, as well as hybrid, instruments. Information on psychometric properties was included for 9 (28%) instruments with satisfactory internal consistency and structural validity. A lack of reliability, responsiveness, and cross-cultural validity data was found. The methodological quality of the systematic reviews was limited, with 8 (67%) studies displaying 2 or more critical weaknesses.

CONCLUSIONS

There is significant diversity in the usability assessment of mHealth for rehabilitation, and a link to theoretical models is often lacking. There is widespread use of custom-made instruments, and preexisting instruments often do not display sufficient psychometric strength. As a result, existing mHealth usability evaluations are difficult to compare. It is proposed that multimethod usability assessment is used and that, in the selection of usability assessment instruments, there is a focus on explicit reference to their theoretical underpinning and acceptable psychometric properties. This could be facilitated by a closer collaboration between researchers, developers, and clinicians throughout the phases of mHealth tool development.

TRIAL REGISTRATION

PROSPERO CRD42022338785; https://www.crd.york.ac.uk/prospero/#recordDetails.

Use of Telehealth in Autism Spectrum Disorder Assessment in Children: Evaluation of an Online Diagnostic Protocol Including the Brief Observation of Symptoms of Autism

The COVID-19 pandemic revealed the need to develop the field of remote assessment for autism spectrum disorders (ASD). The purpose of the study was to evaluate an online assessment protocol that includes the Brief Observation of Symptoms of Autism (BOSA). The online protocol consisting of BOSA and the Autism Diagnostic Interview-Revised (ADI-R) was administered by experienced examiners to 29 children with suspected ASD. The participants were then evaluated by clinical psychologists in a standard clinical setting using the Autism Diagnostic Observation Schedule-2 (ADOS-2) and other methods, and the ASD diagnosis was confirmed or ruled out. The results show substantial to moderate inter-rater agreement between the online and face-to-face raters with the value of Cohen's Kappa = 0.66 (P < 0.001); this corresponds with 79.8% agreement. The sensitivity of the protocol was approx. 94.7%, the specificity was 70%, the positive predictive value was 85.7%, and the negative predictive value was 87.5%. Further, direct false positive or false negative diagnostic conclusions based on the online protocol were absent when the possible conclusion of "I cannot decide" was included. The items B9 Showing, B10 Spontaneous Initiation of Joint Attention, B1 Unusual Eye Contact, B3 Facial Expressions Directed to Others, and C2 Imagination/Creativity were shown to be well observable in BOSA when related to ADOS-2 scoring. The results indicate that the protocol consisting of BOSA and ADI-R administered by an experienced examiner is a promising combination of tools for remote autism assessment.

Does the Integration of Telehealth into Occupational Therapy Practice Impact Clinical Outcomes for Hand and Upper Limb Rehabilitation? A Matched Case Control Study

Health services are capitalizing on the rise of telehealth and seeking to develop sustainable models incorporating telehealth into standard care. Further research is required to explore the service and clinical outcomes of telehealth in occupational therapy hand and upper limb practice. This research utilized a case-control study to explore the feasibility and clinical outcomes of case matched patients who received a telehealth hybrid model versus traditional in-person care. One hundred and two patients were recruited (n=51 in the controls and cases) with a mean age of 45 years. Telehealth was not inferior to standard care with no significant increase in therapy time (p=0.441) or length of referral (p=0.047). There was no difference in clinical adverse events (p=0.741). Patients who received telehealth had significantly less withdrawals from the service (p = 0.031). Patient and therapist satisfaction were high, supporting the ongoing use and continued implementation of telehealth in occupational therapy.

Can the Rorschach be Administered Remotely? A Review of Options and a Pilot Study Using a Newly Developed R-PAS App

The ongoing COVID-19 pandemic has required psychologists to adopt measures like physical distancing and mask wearing, though other safety procedures such as travel restrictions or prohibitions on in-person practice and research have fostered the use of tele-health tools. In this article, we review options for using the Rorschach task via videoconference and provide preliminary data from using a new electronic app for remote R-PAS administration to determine whether the remote administration in an electronic form yields different information than in-person administration with the cards in hand. As a pilot study, our focus is on the "first factor" of all Rorschach scores, i.e., complexity. Data were collected from 60 adult Italian community volunteers, and statistical analyses evaluated the extent to which the average complexity score significantly departed from R-PAS normative expectations (SS = 100), accompanied by Bayesian likelihoods for supporting the null hypothesis. Results suggest that the general level of complexity shown by the test-takers when administered the Rorschach remotely with the new R-PAS app closely resembles that previously observed using "standard" in-person procedures. Tentative analyses of other R-PAS scores suggested normative departures that could be due to the effects of the app, testing at home, or responses to the pandemic. We offer recommendations for future research and discuss practical implications.

A scoping review of telehealth diagnosis of autism spectrum disorder

Background

Considering the COVID-19 pandemic, understanding the reliability, validity, social validity, and feasibility of using telehealth to diagnose ASD is a critical public health issue. This paper examines evidence supporting the use of telehealth methods to diagnose ASD and outlines the necessary modifications and adaptations to support telehealth diagnosis.

Methods and procedures

Studies were identified by searching PubMed and PsychInfo electronic databases and references lists of relevant articles. Only peer reviewed articles published in English with a focus on using telehealth for the purposes of diagnosing ASD were included. Searches were conducted through June 3^rd, 2021.

Outcomes and results

A total of 10 studies were identified as meeting inclusion criteria. Of the eight papers that reported on reliability (e.g., accuracy), telehealth methods to diagnose ASD were between 80–91% accurate when compared with traditional in-person diagnosis. Six studies reported on validity (i.e., sensitivity and/or specificity). All six studies calculated sensitivity, with values ranging from 75% and 100%. Five of the six studies calculated specificity, with values ranging from 68.75% and 100%. The seven papers that reported social validity indicated that caregivers, as well as adult participants and clinicians, were mostly satisfied with telehealth. Feasibility was reported by seven studies and suggests that telehealth methods appear largely viable, though some challenges were reported.

Conclusions and implications

Although findings reviewed here are promising, more research is needed to verify the accuracy, validity, and feasibility of utilizing telehealth to diagnose ASD. Studies with larger sample sizes and samples across sites will be critical, as these will allow clinicians to identify subjects most likely to benefit from telehealth as well as those more likely to require an in-person assessment. This research is important not only due to the current pandemic, but also due to increased prevalence rates of ASD and an insufficient number of diagnostic providers—particularly in rural and/or otherwise under-served communities.

"It was surprisingly equivalent to the appointment I had in person": Advantages and disadvantages of synchronous telehealth for delivering primary care for autistic adults

LAY ABSTRACT

Autistic adults face many barriers to receiving quality primary health care like clinics that are far away and sensory sensitivities. Real-time telehealth visits, called "virtual visits," are live video chats between the patient and provider. Virtual visits may minimize barriers to care for autistic adults. We wanted to describe advantages and disadvantages of using virtual visits for delivering primary health care for autistic adults. We interviewed 7 autistic adults and 12 caregivers of autistic adults who receive primary care through one clinic. Autistic adults and caregivers said advantages to virtual visits were that (1) patients were more comfortable at home, (2) patients could get health care while avoiding physical contact with other people during the pandemic, and (3) virtual visits were similar to or better than in-person visits. The disadvantages included that (1) there could be technology problems like grainy video, (2) the doctor could not physically examine the patient (e.g. look in ears), and (3) patients sometimes participated less in the virtual visit than they would in person. Virtual visits may be beneficial for autistic adults by eliminating travel to the clinic and avoiding stressful sensory stimuli. We recognize that virtual visits may not work for all patients or in all situations. However, our study shows that primary care virtual visits may be beneficial for autistic adults during and beyond the pandemic.

Feasibility and acceptability of a telehealth model for autism diagnostic evaluations in children, adolescents, and adults

This study examined the feasibility and acceptability of a telehealth diagnostic model deployed at an autism center in the southwestern United States to safely provide autism spectrum disorder (ASD) diagnostic evaluations to children, adolescents, and adults during the COVID-19 pandemic. Participants included all clients for whom a telehealth diagnostic evaluation was scheduled at the diagnostic clinic (n = 121) over a 6-month period. Of 121 scheduled clients, 102 (84%) completed the telehealth evaluation. A diagnostic determination was made for 91% of clients (93 out of 102) using only telehealth procedures. Nine participants (two females; ages 3 to 11 years) required an in-person evaluation. Responses from psychologist and parent acceptability surveys indicated the model was acceptable for most clients. Psychologist ratings suggested that telehealth modalities used in the current study may be less acceptable for evaluating school-aged children with subtle presentations compared to children in the early developmental period, adolescents, and adults. Parents of females reported higher acceptability than parents of males. Findings contribute to the small but growing literature on feasibility and acceptability of telehealth evaluations for ASD and have implications for improving access to care during and after the COVID-19 pandemic. LAY SUMMARY: This study described telehealth methods for evaluating children, adolescents, and adults for autism spectrum disorder. Telehealth methods were generally acceptable to psychologists conducting the evaluations and parents of diagnostic clients. Psychologists reported the methods to be less acceptable for school-aged children and parents of males found the methods less acceptable than parents of females. The telehealth methods described may help to increase access to diagnostic professionals and reduce wait times for evaluations during and after the COVID-19 pandemic.

Virtual health care for adult patients with intellectual and developmental disabilities: A scoping review

Background

The COVID-19 pandemic led to an abrupt shift to virtual health care for many patients, including adults with intellectual and developmental disabilities (IDD). Approaches to virtual care that are successful for people without IDD may need to be adapted for adults with IDD.

Objective

The aim of this scoping review was to examine what is known about virtual health care for adults with IDD and in particular, the impact of virtual delivery on access to care for this population.

Methods

A comprehensive search was conducted of the academic and grey literature. A two-stage screening process was conducted by two independent reviewers and a structured data extraction template was populated for each included study. Findings were analyzed thematically using Access to Care Framework domains.

Results

In total, 22 studies met inclusion criteria. The majority were published in the past three years and focused on specialized IDD services. A subset of 12 studies reported findings on access to care for adults with IDD. Participants generally reported high acceptability of virtual care, though some preferred face-to-face encounters. Initial results on effectiveness were positive, though limited by small sample sizes. Challenges included internet quality and technical skill or comfort.

Conclusions

This review suggests that it is possible to deliver accessible, high quality virtual care for adults with IDD, however, relatively little research has been conducted on this topic. Due to COVID-19 there is currently a unique opportunity and urgency to learn when and for whom virtual care can be successful and how it can be supported.

A Teleneuropsychology Protocol for the Cognitive Assessment of Older Adults During COVID-19

The Coronavirus Disease 2019 (COVID-19) pandemic prompted the need for a teleneuropsychology protocol for the cognitive assessment of older adults, who are at increased risk for both COVID-19 and dementia. Prior recommendations for teleneuropsychological assessment did not consider many of the unique challenges posed by COVID-19. The field is still in need of clear guidelines and standards of care for the assessment of older adults under the current circumstances. Advantages of teleneuropsychological assessment during the COVID-19 pandemic include reduced risk of contracting the virus, eliminating travel time and reducing cost, and more rapid access to needed services. Challenges include disparities in technology access among patients, reduced control over the testing environment, impeded ability to make behavioral observations, and limited research on valid and reliable cognitive assessment measures. The aim of this perspective review is to propose a teleneuropsychological protocol to facilitate neuropsychological assessment utilizing a virtual platform. The proposed protocol has been successful with our clinical and research populations and may help neuropsychologists implement teleneuropsychology services without compromising validity or reliability. However, there is increasing need for research on teleneuropsychological assessment options for both clinical and research purposes.

Bringing the Laboratory Home: PANDABox Telehealth-Based Assessment of Neurodevelopmental Risk in Children

Background

Advances in clinical trials have revealed a pressing need for outcome measures appropriate for children with neurogenetic syndromes (NGS). However, the field lacks a standardized, flexible protocol for collecting laboratory-grade experimental data remotely. To address this challenge, we developed PANDABox (Parent-Administered Neurodevelopmental Assessment), a caregiver-facilitated, remotely administered assessment protocol for collecting integrated and high quality clinical, behavioral, and spectral data relevant to a wide array of research questions. Here, we describe PANDABox development and report preliminary data regarding: (1) logistics and cost, (2) caregiver fidelity and satisfaction, and (3) data quality.

Methods

We administered PANDABox to a cohort of 16 geographically diverse caregivers and their infants with Down syndrome. Tasks assessed attention, language, motor, and atypical behaviors. Behavioral and physiological data were synchronized and coded offline by trained research assistants.

Results

PANDABox required low resources to administer and was well received by families, with high caregiver fidelity (94%) and infant engagement (91%), as well as high caregiver-reported satisfaction (97% positive). Missing data rates were low for video frames (3%) and vocalization recordings (6%) but were higher for heart rate (25% fully missing and 13% partially missing) and discrete behavioral presses (8% technical issues and 19% not enough codable behavior), reflecting the increased technical demands for these activities.

Conclusion

With further development, low-cost laboratory-grade research protocols may be remotely administered by caregivers in the family home, opening a new frontier for cost-efficient, scalable assessment studies for children with NGS other neurodevelopmental disorders.

Use of telehealth for facilitating the diagnostic assessment of Autism Spectrum Disorder (ASD): A scoping review

There is a significant delay between seeking help and a confirmed diagnosis of Autism Spectrum Disorder (ASD). This delay can lead to poor outcomes for both the families and individuals. Telehealth potentially offers a way of improving the diagnostic pathway for ASD. We conducted a scoping review examining which telehealth approaches are used in the diagnosis and assessment of ASD in children and adults, whether they are feasible and acceptable, and how they compare with face-to-face diagnosis and assessment methods. A search for all peer-reviewed articles, combining the terms of autism and telehealth was conducted from 2000 to 2019. A total of 10 studies were identified for inclusion in the review. This review of the literature found there to be two methods of using telehealth: (a) Real-Time method e.g. video conferencing that enables teams in different areas to consult with the families and to assess the child/adult in real time and (b) A Store-and-Forward method as Naturalistic Observation Diagnostic Assessment (NODA) system to upload videos of child’s behaviors to a webportal that enables the clinicians to make an assessment remotely. The findings were positive, finding there to be high agreement in terms of the diagnosis between remote methods and face to face methods and with high levels of satisfaction among the families and clinicians. This field is in the very early stages and so only studies with small sample size using surveys and interviews were identified but the findings suggest that there is potential for telehealth methods to improve access to assessment and diagnosis of ASD used in conjunction with existing methods, especially for those with clear autism traits and adults with ASD. Larger randomised controlled trials of this technology are warranted.

Forensic mental telehealth assessment (FMTA) in the context of COVID-19

Due to the present COVID-19 pandemic, forensic mental telehealth assessment (FMTA) is an increasingly utilized means of conducting court-sanctioned psychiatric and psychological evaluations. FMTA is not a novel development, and studies have been published during the past two decades that opine on the positive and negative implications of conducting testing and interview procedures online, in forensic and traditionally clinical matters alike. The present article examines prospects for eventual legal challenges to FMTA, describes considerations for conducting FMTA in both institutional and residential settings, and concludes that FMTA is now-due to predicted accommodations on the part of courts, attorneys, institutions, and professional guilds-a permanent part of the forensic evaluation landscape, even once the present COVID-19 pandemic has subsided.

Common themes and emerging trends for the use of technology to support mental health and psychosocial well-being in limited resource settings: A review of the literature

There are significant disparities in access to mental health care. With the burgeoning of technologies for health, digital tools have been leveraged within mental health and psychosocial support programming (eMental health). A review of the literature was conducted to understand and identify how eMental health has been used in resource-limited settings in general. PubMed, Ovid Medline and Web of Science were searched. Six-hundred and thirty full-text articles were identified and assessed for eligibility; of those, 67 articles met the inclusion criteria and were analyzed. The most common mental health use cases were for depression (n = 25) and general mental health and well-being (n = 21). Roughly one-third used a website or Internet-enabled intervention (n = 23) and nearly one-third used an SMS intervention (n = 22). Technology was applied to enhance service delivery (n = 32), behavior change communication (n = 26) and data collection (n = 8), and specifically dealt with adherence (n = 7), ecological momentary assessments (n = 7), well-being promotion (n = 5), education (n = 8), telemedicine (n = 28), machine learning (n = 5) and games (n = 2). Emerging trends identified wearables, predictive analytics, robots and virtual reality as promising areas. eMental health interventions that leverage low-tech tools can introduce, strengthen and expand mental health and psychosocial support services and can be a starting point for future, advanced tools.

Evaluating the Feasibility of a Play-Based Telehealth Intervention Program for Children with Prader-Willi Syndrome

Here we report the feasibility and acceptability of telehealth for direct intervention in children with Prader-Willi syndrome (PWS). Children with PWS have social-cognitive challenges that are similar to children with ASD. However, developing behavioral interventions for individuals with PWS is faced with the significant challenge of enrolling enough participants for local studies where multiple visits per week are indicated for effective intervention. This study delivered a 6-week play-based intervention via telehealth directly to eight children with PWS (6-12 years). Participants completed the program with minimal behavioral or technological difficulty (#sessions M = 11.875/12). Behavioral Intervention Rating Scale results indicate good acceptability (M = 5.54/6.00). These findings support using telehealth in rare disorders and delivering intervention directly to children with developmental delays through this modality.

Telepsychiatry for Children and Adolescents: A Review of the PROMETTED Project

BACKGROUND

Telemedicine for children and adolescents is a public health topic, and since 2009 in France, the legal framework defines practical modalities. Some children with Attention Deficit with or without Hyperactivity Disorder, social anxiety, or Autism Spectrum Disorder (ASD) can be easily engaged within a teleconsultation model. Literature suggests new opportunities to facilitate the care process for the ASD person and his family: diagnosis with the use of validated instruments and parental accompaniment.

METHODS

Since 2015, a pilot project called PROMETTED was supported by the Regional Health Agency of Ile de France. It was developed and managed by the team of the Center for Diagnosis and Evaluation for Autism (CDEA) of Sainte-Anne Hospital and associated PEDIATED, the CDEA of Versailles.

RESULTS

Five medico-social structures for children and adolescents with ASD and the two CDEAs co-elaborated a scheme of intervention with telemedicine. The remote evaluation is a four-step process structured around the medical history and the observation of the young subject; the Autism Diagnostic Interview; the use of the Childhood Autism Rating Scale and the Vineland Adaptive Behavior Scales; and feedback to parents.

CONCLUSIONS

Medico-economic and satisfaction evaluations are in progress.

How a diverse research ecosystem has generated new rehabilitation technologies: Review of NIDILRR's Rehabilitation Engineering Research Centers

Over 50 million United States citizens (1 in 6 people in the US) have a developmental, acquired, or degenerative disability. The average US citizen can expect to live 20% of his or her life with a disability. Rehabilitation technologies play a major role in improving the quality of life for people with a disability, yet widespread and highly challenging needs remain. Within the US, a major effort aimed at the creation and evaluation of rehabilitation technology has been the Rehabilitation Engineering Research Centers (RERCs) sponsored by the National Institute on Disability, Independent Living, and Rehabilitation Research. As envisioned at their conception by a panel of the National Academy of Science in 1970, these centers were intended to take a "total approach to rehabilitation", combining medicine, engineering, and related science, to improve the quality of life of individuals with a disability. Here, we review the scope, achievements, and ongoing projects of an unbiased sample of 19 currently active or recently terminated RERCs. Specifically, for each center, we briefly explain the needs it targets, summarize key historical advances, identify emerging innovations, and consider future directions. Our assessment from this review is that the RERC program indeed involves a multidisciplinary approach, with 36 professional fields involved, although 70% of research and development staff are in engineering fields, 23% in clinical fields, and only 7% in basic science fields; significantly, 11% of the professional staff have a disability related to their research. We observe that the RERC program has substantially diversified the scope of its work since the 1970's, addressing more types of disabilities using more technologies, and, in particular, often now focusing on information technologies. RERC work also now often views users as integrated into an interdependent society through technologies that both people with and without disabilities co-use (such as the internet, wireless communication, and architecture). In addition, RERC research has evolved to view users as able at improving outcomes through learning, exercise, and plasticity (rather than being static), which can be optimally timed. We provide examples of rehabilitation technology innovation produced by the RERCs that illustrate this increasingly diversifying scope and evolving perspective. We conclude by discussing growth opportunities and possible future directions of the RERC program.

Functional assessment in mental health: lessons from occupational therapy

Occupational therapists have been conducting functional assessments since World War I, and this accumulated experience has taught us several critical lessons. First, a comprehensive profile of a patient's functioning requires multiple assessment methods. Second, assessment content and measurement constructs must change with the times. Third, technology can enhance and extend functional assessment. Fourth, performance-based assessments of everyday activities can also be used to measure body functions/impairments. However, while deconstructing activities into body functions/impairments is possible, the results do not reflect patients' abilities to integrate the cognitive, motor, sensory and affective functions necessary to complete a complex activity. Finally, the differential complexity of everyday activities that a patient can master or successfully complete can also provide a ruler with which to measure progress.

Feasibility of Using Telehealth to Deliver the "Powerful Tools for Caregivers" Program

Caregivers report poorer health and wellness than the general population and identify numerous barriers to their attending programs to improve health and wellness. The purpose of this study was to explore the feasibility of employing a telehealth delivery method to enhance access to caregiver wellness programs. This article presents the quantitative results of a mixed methods feasibility study of translating the Powerful Tools for Caregivers (PTC) program to a telehealth delivery format. Four unpaid family caregivers of older adults participated in a telehealth delivered PTC program, a wellness program with established outcomes in the in-person environment. The program was delivered using synchronous videoconferencing methods. High class attendance and a high median total average Telehealth Usability Questionnaire score of 5.7 indicated the telehealth delivery method was feasible. This research suggests that telehealth is a feasible delivery format for a caregiver program traditionally delivered in an in-person format.

A Flexible and Integrated System for the Remote Acquisition of Neuropsychological Data in Stroke Research

BACKGROUND

Neuropsychological testing is a central aspect of stroke research because it provides critical information about the cognitive-behavioral status of stroke survivors, as well as the diagnosis and treatment of stroke-related disorders. Standard neuropsychological methods rely upon face-to-face interactions between a patient and researcher, which creates geographic and logistical barriers that impede research progress and treatment advances.

INTRODUCTION

To overcome these barriers, we created a flexible and integrated system for the remote acquisition of neuropsychological data (RAND). The system we developed has a secure architecture that permits collaborative videoconferencing. The system supports shared audiovisual feeds that can provide continuous virtual interaction between a participant and researcher throughout a testing session. Shared presentation and computing controls can be used to deliver auditory and visual test items adapted from standard face-to-face materials or execute computer-based assessments. Spoken and manual responses can be acquired, and the components of the session can be recorded for offline data analysis.

MATERIALS AND METHODS

To evaluate its feasibility, our RAND system was used to administer a speech-language test battery to 16 stroke survivors with a variety of communication, sensory, and motor impairments. The sessions were initiated virtually without prior face-to-face instruction in the RAND technology or test battery.

RESULTS

Neuropsychological data were successfully acquired from all participants, including those with limited technology experience, and those with a communication, sensory, or motor impairment. Furthermore, participants indicated a high level of satisfaction with the RAND system and the remote assessment that it permits.

CONCLUSIONS

The results indicate the feasibility of using the RAND system for virtual home-based neuropsychological assessment without prior face-to-face contact between a participant and researcher. Because our RAND system architecture uses off-the-shelf technology and software, it can be duplicated without specialized expertise or equipment. In sum, our RAND system offers a readily available and promising alternative to face-to-face neuropsychological assessment in stroke research.

Speech-language pathology teletherapy in rural and remote educational settings: Decreasing service inequities

PURPOSE

The objectives of this study were to investigate the efficacy of a speech-language pathology teletherapy program for children attending schools and early childcare settings in rural New South Wales, Australia, and their parents' views on the program's feasibility and acceptability.

METHOD

Nineteen children received speech-language pathology sessions delivered via Adobe Connect®, Facetime^© or Skype^© web-conferencing software. During semi-structured interviews, parents (n = 5) described factors that promoted or threatened the program's feasibility and acceptability.

RESULT

Participation in a speech-language pathology teletherapy program using low-bandwidth videoconferencing improved the speech and language skills of children in both early childhood settings and primary school. Emergent themes related to (a) practicality and convenience, (b) learning, (c) difficulties and (d) communication.

CONCLUSION

Treatment outcome data and parental reports verified that the teletherapy service delivery was feasible and acceptable. However, it was also evident that regular discussion and communication between the various stakeholders involved in teletherapy programs may promote increased parental engagement and acceptability.

Investigating the accuracy of a novel telehealth diagnostic approach for autism spectrum disorder

Research indicates that a substantial amount of time elapses between parents' first concerns about their child's development and a formal diagnosis of autism spectrum disorder (ASD). Telehealth presents an opportunity to expedite the diagnostic process. This project compared a novel telehealth diagnostic approach that utilizes clinically guided in-home video recordings to the gold standard in-person diagnostic assessment. Participants included 40 families seeking an ASD evaluation for their child and 11 families of typically developing children. Children were between the ages of 18 months and 6 years 11 months; mean adaptive behavior composite = 75.47 (SD = 15.94). All parent participants spoke English fluently. Families completed the Naturalistic Observation Diagnostic Assessment (NODA) for ASD, which was compared to an in-person assessment (IPA). Agreement between the 2 methods, as well as sensitivity, specificity, and interrater reliability, were calculated for the full sample and the subsample of families seeking an ASD evaluation. Diagnostic agreement between NODA and the IPA was 88.2% (κ = 0.75) in the full sample and 85% (κ = 0.58) in the subsample. Sensitivity was 84.9% in both, whereas specificity was 94.4% in the full sample and 85.7% in the subsample. Kappa coefficients for interrater reliability indicated 85% to 90% accuracy between raters. NODA utilizes telehealth technology for families to share information with professionals and provides a method to inform clinical judgment for a diagnosis of ASD. Due to the high level of agreement with the IPA in this sample, NODA has potential to improve the efficiency of the diagnostic process for ASD. (PsycINFO Database Record

Towards a Framework for Evaluating Mobile Mental Health Apps

INTRODUCTION

Mobile phones are ubiquitous in society and owned by a majority of psychiatric patients, including those with severe mental illness. Their versatility as a platform can extend mental health services in the areas of communication, self-monitoring, self-management, diagnosis, and treatment. However, the efficacy and reliability of publicly available applications (apps) have yet to be demonstrated. Numerous articles have noted the need for rigorous evaluation of the efficacy and clinical utility of smartphone apps, which are largely unregulated. Professional clinical organizations do not provide guidelines for evaluating mobile apps.

MATERIALS AND METHODS

Guidelines and frameworks are needed to evaluate medical apps. Numerous frameworks and evaluation criteria exist from the engineering and informatics literature, as well as interdisciplinary organizations in similar fields such as telemedicine and healthcare informatics.

RESULTS

We propose criteria for both patients and providers to use in assessing not just smartphone apps, but also wearable devices and smartwatch apps for mental health. Apps can be evaluated by their usefulness, usability, and integration and infrastructure. Apps can be categorized by their usability in one or more stages of a mental health provider's workflow.

CONCLUSIONS

Ultimately, leadership is needed to develop a framework for describing apps, and guidelines are needed for both patients and mental health providers.

A Novel System for Supporting Autism Diagnosis Using Home Videos: Iterative Development and Evaluation of System Design

BACKGROUND

Observing behavior in the natural environment is valuable to obtain an accurate and comprehensive assessment of a child's behavior, but in practice it is limited to in-clinic observation. Research shows significant time lag between when parents first become concerned and when the child is finally diagnosed with autism. This lag can delay early interventions that have been shown to improve developmental outcomes.

OBJECTIVE

To develop and evaluate the design of an asynchronous system that allows parents to easily collect clinically valid in-home videos of their child's behavior and supports diagnosticians in completing diagnostic assessment of autism.

METHODS

First, interviews were conducted with 11 clinicians and 6 families to solicit feedback from stakeholders about the system concept. Next, the system was iteratively designed, informed by experiences of families using it in a controlled home-like experimental setting and a participatory design process involving domain experts. Finally, in-field evaluation of the system design was conducted with 5 families of children (4 with previous autism diagnosis and 1 child typically developing) and 3 diagnosticians. For each family, 2 diagnosticians, blind to the child's previous diagnostic status, independently completed an autism diagnosis via our system. We compared the outcome of the assessment between the 2 diagnosticians, and between each diagnostician and the child's previous diagnostic status.

RESULTS

The system that resulted through the iterative design process includes (1) NODA smartCapture, a mobile phone-based application for parents to record prescribed video evidence at home; and (2) NODA Connect, a Web portal for diagnosticians to direct in-home video collection, access developmental history, and conduct an assessment by linking evidence of behaviors tagged in the videos to the Diagnostic and Statistical Manual of Mental Disorders criteria. Applying clinical judgment, the diagnostician concludes a diagnostic outcome. During field evaluation, without prior training, parents easily (average rating of 4 on a 5-point scale) used the system to record video evidence. Across all in-home video evidence recorded during field evaluation, 96% (26/27) were judged as clinically useful, for performing an autism diagnosis. For 4 children (3 with autism and 1 typically developing), both diagnosticians independently arrived at the correct diagnostic status (autism versus typical). Overall, in 91% of assessments (10/11) via NODA Connect, diagnosticians confidently (average rating 4.5 on a 5-point scale) concluded a diagnostic outcome that matched with the child's previous diagnostic status.

CONCLUSIONS

The in-field evaluation demonstrated that the system's design enabled parents to easily record clinically valid evidence of their child's behavior, and diagnosticians to complete a diagnostic assessment. These results shed light on the potential for appropriately designed telehealth technology to support clinical assessments using in-home video captured by families. This assessment model can be readily generalized to other conditions where direct observation of behavior plays a central role in the assessment process.

Usability and reliability of a remotely administered adult autism assessment, the autism diagnostic observation schedule (ADOS) module 4

INTRODUCTION

The Autism Diagnostic Observation Schedule (ADOS) Module 4 is an autism assessment designed for verbally fluent adolescents and adults. Because of a shortage of available clinical expertise, it can be difficult for adults to receive a proper autism spectrum disorder (ASD) diagnostic assessment. A potential option to address this shortage is remote assessment. The objective of this study was to examine the feasibility, usability, and reliability of administering the ADOS Module 4 remotely using the Versatile and Integrated System for Telerehabilitation (VISYTER).

MATERIALS AND METHODS

VISYTER consists of computer stations at the client site and clinician site for video communication and a Web portal for managing and coordinating the assessment process. Twenty-three adults with an ASD diagnosis participated in a within-subject crossover design study in which both a remote ADOS and a face-to-face ADOS were administered. After completing the remote ADOS, participants completed a satisfaction survey.

RESULTS

Participant satisfaction with the remote ADOS delivery system was high. The kappa value was greater than 0.61 on 21 of 31 ADOS items. There was substantial agreement on ADOS classification (i.e., diagnosis) between assessments delivered face-to-face versus assessments delivered remotely (interclass coefficient=0.92). Non-agreement may have been due to outside factors or practice effect despite a washout period.

CONCLUSIONS

The results of this study demonstrate that an autism assessment designed to be delivered face to face can be administered remotely using an integrated Web-based system with high levels of usability and reliability.

The Evaluation of Children with an Autism Spectrum Disorder: Adaptations to Accommodate a Telepractice Model of Clinical Care

Telepractice is increasingly applied to assessment and intervention for persons with autism spectrum disorders (ASD), and the use of telepractice for delivering augmentative and alternative communication (AAC) services is expanding. To date, no studies have focused on the assessment of communication in children with ASD who are minimally verbal. This case exploration represents a first attempt to apply the clinical assessment approach (also known as Visual Immersion System) developed in the Autism Language Program in the Center for Communication Enhancement (CCE) at Boston Children's Hospital (BCH) through a telepractice service delivery model. In this paper we detail an on-site evaluation, and then describe the application of the various evaluation components to telepractice delivery. Our findings provide preliminary evidence that communication assessment information can be successfully obtained for this population via telepractice. The results demonstrated that the telepractice evaluation took greater time to complete than the on-site evaluation, likely due to both technical and cultural factors. Further study is warranted particularly in the delivery of family instruction materials prior to the evaluation and to quality assurance measures.

Technologies as support tools for persons with autistic spectrum disorder: a systematic review

This study analyzes the technologies most widely used to work on areas affected by the Autistic Spectrum Disorder (ASD). Technologies can focus on the strengths and weaknesses of this disorder as they make it possible to create controlled environments, reducing the anxiety produced by real social situations. Extensive research has proven the efficiency of technologies as support tools for therapy and their acceptation by ASD sufferers and the people who are with them on a daily basis. This article is organized by the types of systems developed: virtual reality applications, telehealth systems, social robots and dedicated applications, all of which are classified by the areas they center on: communication, social learning and imitation skills and other ASD-associated conditions. 40.5% of the research conducted is found to be focused on communication as opposed to 37.8% focused on learning and social imitation skills and 21.6% which underlines problems associated with this disorder. Although most of the studies reveal how useful these tools are in therapy, they are generic tools for ASD sufferers in general, which means there is a lack of personalised tools to meet each person's needs.

Telepractice: An Overview and Best Practices

Telepractice is the use of telecommunications technology to deliver speech therapy and audiology services to a client who is in a different physical location than the practitioner. This article presents a general overview of telepractice, including terminology and definitions; ethical considerations; privacy and security; reimbursement policy and trends; considerations for client selection; and telepractice resources. It was written to provide foundational information about telepractice for practitioners who are engaged with alternative and augmentative communication (AAC).

Teaching self-management skills in persons with chronic lower limb swelling and limited mobility: evidence for usability of telerehabilitation

The purpose of this study was to evaluate the usability of telerehabilitation as a method of teaching self-management for chronic swelling of the lower limbs in persons with limited mobility. An in-home telerehabilitation self-management education protocol for chronic swelling of the lower limbs, termed Telerehabilitation to Empower You to Manage and Prevent Swelling (TR-PUMPS), was implemented using the Versatile and Integrated System for Telerehabilitation (VISYTER) software platform. Participants (n=11) were 36–79 years old, predominately female (72.7%) and diagnosed with a variety of health conditions. Participants’ perceived usability scores of the remote delivery of TR-PUMPS was high with a median score of 6.67 (range 4.90 – 7.00) on a Likert scale: 1= disagree to 7= agree. There was no correlation between participants’ familiarity with information technology and their perception of telerehabilitation usability. These results support telerehabilitation as a viable method for teaching a home-based, self-management protocol for chronic swelling.