1
|
Tagavi DM, Dai YG, Berger NI, Petruccelli M, Scott SE, Oosting D, Howard M, Carter AS, Ingersoll B, Wainer AL, Broder-Fingert S, Stone WL. Applying a User-Centered Design Framework to Develop a Remote Research Assessment Protocol for a Randomized Clinical Trial for Toddlers with Early Autism Characteristics. J Autism Dev Disord 2024:10.1007/s10803-024-06455-7. [PMID: 38985370 DOI: 10.1007/s10803-024-06455-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/24/2024] [Indexed: 07/11/2024]
Abstract
COVID-19 required many research teams to shift from in-person to remote assessments, which posed both procedural and theoretical challenges. While research has explored the utility of remote assessments for autism diagnosis from the perspective of families and clinicians, less is known about their application in clinical trials. This paper describes the development of a remote research assessment protocol for a randomized clinical trial focusing on the implementation of reciprocal imitation teaching (RIT) with toddlers in Part C early intervention. This project spans two phases. For Phase 1, our team developed and documented a series of steps utilizing user-centered design (UCD) strategies (e.g., recruiting potential users, creating a prototype, engaging in iterative development) for the purpose of redesigning an assessment protocol for a remote environment. For Phase 2, we examined preliminary outcomes of the redesign process. Primary end users (assessors) rated post-redesign usability and acceptability, while acceptability was examined using attrition data from secondary end users (family participants). Preliminary fidelity of implementation was also examined. The iterative redesign process allowed the research team to refine aspects of the assessment that ultimately led to promising preliminary ratings of usability, acceptability, and feasibility, as well as high fidelity. Preliminary data suggest that the redesigned assessment appears to be an acceptable, feasible, and usable tool for autism clinical trial research and that assessors can use it with fidelity. Further research is needed to examine the reliability and validity of the assessment, as well as implementation characteristics on a larger scale.
Collapse
Affiliation(s)
- Daina M Tagavi
- Department of Psychiatry and Behavioral Sciences, University of Washington, 6200 NE 74th Street, Suite 100, Seattle, WA, 98115, USA.
| | - Yael G Dai
- Department of Psychology, Florida International University, Miami, USA
| | - Natalie I Berger
- Department of Psychiatry and Behavioral Sciences, Rush University Medical Center, Chicago, USA
| | | | - Sabine E Scott
- Special Education and Clinical Sciences Department, University of Oregon, Eugene, USA
| | - Devon Oosting
- Department of Psychology, University of Massachusetts Boston, Boston, USA
| | - Mya Howard
- Department of Human Services, University of Virginia, Charlottesville, USA
| | - Alice S Carter
- Department of Psychology, University of Massachusetts Boston, Boston, USA
| | - Brooke Ingersoll
- Department of Psychology, Michigan State University, East Lansing, USA
| | - Allison L Wainer
- Department of Psychiatry and Behavioral Sciences, Rush University Medical Center, Chicago, USA
| | | | - Wendy L Stone
- Department of Psychology, University of Washington, Seattle, USA
| |
Collapse
|
2
|
Buck A, Hurewitz S, Franklin MS. Workforce perspective on racial and ethnic equity in early childhood autism evaluation and treatment: "The cornerstone of everything we do". AUTISM : THE INTERNATIONAL JOURNAL OF RESEARCH AND PRACTICE 2024:13623613241235522. [PMID: 38477296 DOI: 10.1177/13623613241235522] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/14/2024]
Abstract
LAY ABSTRACT Black and non-White Latinx children tend to receive autism diagnoses later in life and with a higher degree of impairment than White children. The purpose of this study was to learn what is currently helping as well as preventing Black and non-White Latinx children from getting access to autism evaluation and services. We held virtual interviews with 26 experts who work with autistic children and their families, including clinical providers, researchers, advocates, and policymakers/government representatives. From these interviews, we identified four themes that have an impact on equity in autism services: (1) who makes up the workforce, (2) workforce capacity and accessibility, (3) workforce payment structure, and (4) changes due to the COVID-19 pandemic. These findings show the need for improved workforce diversity, autism-specific education, payment structures, and additional support for workforce members to avoid burnout. To make childhood autism services more equitable, diversity in recruitment across training levels, cultural awareness, increased autism education for all pediatric providers, and partnerships with caregivers as experts must be prioritized. These investments in the autism workforce will allow professionals in the field to better meet the needs of children and families from Black and non-White Latinx communities and achieve equity in early childhood autism services.
Collapse
|
3
|
Ludwig NN, Holingue C, Hong JS, Kalb LG, Pfeiffer D, Reetzke R, Menon D, Landa R. Diagnostic certainty during in-person and telehealth autism evaluations. JCPP ADVANCES 2024; 4:e12201. [PMID: 38486947 PMCID: PMC10933595 DOI: 10.1002/jcv2.12201] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2022] [Accepted: 08/24/2023] [Indexed: 03/17/2024] Open
Abstract
Background Many diagnostic evaluations abruptly shifted to telehealth during the COVID-19 pandemic; however, little is known about the impact on diagnosis patterns for children evaluated for autism spectrum disorder (ASD). The purpose of this clinical research study was to examine (1) the frequency of diagnoses evaluated beyond ASD; (2) the frequency of diagnoses made, including ASD; and (3) clinician diagnostic certainty for all diagnoses evaluated for children who received an evaluation due to primary concerns about ASD via telehealth during the pandemic compared to those evaluated in person before the pandemic at an ASD specialty clinic. Methods The sample included 2192 children, 1-17 years (M = 6.5 years; SD = 3.9), evaluated by a physician/psychologist at an ASD specialty center. A total of 649 children were evaluated in-person September 1, 2019-March 13, 2020 (pre-pandemic) and 1543 were evaluated via telehealth March 14, 2020-July 26, 2021 (during pandemic). Upon completion of each evaluation, clinicians provided a final diagnostic determination (i.e., "Yes," "No," "Possible," or "Not Assessed") for the following DSM-5 conditions: ASD, attention-deficit/hyperactivity disorder (ADHD), intellectual developmental disorder (IDD), anxiety (ANX), depression (DEP), and behavioral disorder (BD). "Possible" indicated lower certainty and the diagnosis was not provided. "Not Assessed" indicated the disorder was not evaluated. Results Diagnostic certainty for ASD and ADHD was lower and clinicians evaluated for and made diagnoses of IDD less often during evaluations that occurred via telehealth during the pandemic versus in person before the pandemic. DEP and BD were diagnosed more frequently, diagnostic certainty of DEP was lower, and no differences in the frequency of ANX diagnoses emerged during evaluations conducted via telehealth during the pandemic compared to those conducted in person before the pandemic. Conclusions Differences emerged in the frequency of diagnoses evaluated and made and diagnostic certainty for evaluations conducted via telehealth during the pandemic compared to in person before the pandemic, which likely impacted patients and reflect real-word challenges. Future work should examine whether these patterns are generalizable and the mechanisms that contribute to these differences.
Collapse
Affiliation(s)
- Natasha N. Ludwig
- Department of NeuropsychologyKennedy Krieger InstituteBaltimoreMarylandUSA
- Department of Psychiatry and Behavioral SciencesJohns Hopkins School of MedicineBaltimoreMarylandUSA
| | - Calliope Holingue
- Center for Autism and Related DisordersKennedy Krieger InstituteBaltimoreMarylandUSA
- Department of Mental HealthJohns Hopkins Bloomberg School of Public HealthBaltimoreMarylandUSA
| | - Ji Su Hong
- Department of Psychiatry and Behavioral SciencesJohns Hopkins School of MedicineBaltimoreMarylandUSA
- Center for Autism and Related DisordersKennedy Krieger InstituteBaltimoreMarylandUSA
| | - Luther G. Kalb
- Department of NeuropsychologyKennedy Krieger InstituteBaltimoreMarylandUSA
- Center for Autism and Related DisordersKennedy Krieger InstituteBaltimoreMarylandUSA
- Department of Mental HealthJohns Hopkins Bloomberg School of Public HealthBaltimoreMarylandUSA
| | - Danika Pfeiffer
- Department of Psychiatry and Behavioral SciencesJohns Hopkins School of MedicineBaltimoreMarylandUSA
- Center for Autism and Related DisordersKennedy Krieger InstituteBaltimoreMarylandUSA
| | - Rachel Reetzke
- Department of Psychiatry and Behavioral SciencesJohns Hopkins School of MedicineBaltimoreMarylandUSA
- Center for Autism and Related DisordersKennedy Krieger InstituteBaltimoreMarylandUSA
| | - Deepa Menon
- Center for Autism and Related DisordersKennedy Krieger InstituteBaltimoreMarylandUSA
- Department of NeurologyJohns Hopkins School of MedicineBaltimoreMarylandUnited States
| | - Rebecca Landa
- Department of Psychiatry and Behavioral SciencesJohns Hopkins School of MedicineBaltimoreMarylandUSA
- Center for Autism and Related DisordersKennedy Krieger InstituteBaltimoreMarylandUSA
| |
Collapse
|
4
|
Brunt S, Sadikova E, Pappagianopoulos J, Mazurek MO. The impact of COVID-19 on receipt of health services among children with and without autism. AUTISM : THE INTERNATIONAL JOURNAL OF RESEARCH AND PRACTICE 2024; 28:580-586. [PMID: 37243353 PMCID: PMC10225807 DOI: 10.1177/13623613231176930] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/28/2023]
Abstract
ABSTRACT TThe COVID-19 pandemic disrupted a range of health services for children across the United States. Autistic children have well-documented deficits in health-related services compared to nonautistic children. Parents of autistic children reported an increase in mental health and behavior problems with the onset of the pandemic, increasing the need for supportive services. The current study used data from the National Survey of Children’s Health from 2019 and 2020 to conduct logistic regressions predicting the likelihood of having unmet service needs before and after the onset of the pandemic. Results suggested that autistic children were more likely to have unmet medical, dental, and mental health service needs across years compared to nonautistic children, but there were no interactions by year. All children experienced an increased likelihood of having unmet needs from pre- to post-pandemic. Results suggest that although the pandemic disrupted services across the board, autistic children lacked health services regardless of the pandemic, pointing to persisting disparities in service receipt. A discussion of ongoing barriers to services and issues related to virtual services is included. Future research should further investigate the feasibility of virtual services as well as ways of reducing barriers to all services for autistic children.
Collapse
|
5
|
Fell LA, Albright CM, Kryszak EM, Butter E, Kuhlthau KA. Provider Perspectives on Telehealth Services for Children With Autism Spectrum Disorder During the Coronavirus Disease 2019 Pandemic. Acad Pediatr 2023; 23:1196-1203. [PMID: 36871611 PMCID: PMC9985515 DOI: 10.1016/j.acap.2023.02.016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/01/2022] [Revised: 02/13/2023] [Accepted: 02/24/2023] [Indexed: 03/07/2023]
Abstract
OBJECTIVE The purpose of the current study was to explore provider perspectives on the strengths and challenges of telehealth services (e.g., behavioral interventions, physical, speech, and occupational therapy, medication management) for children with autism spectrum disorder during coronavirus disease 2019 related shutdowns. METHODS From September 2020 to May 2021, we conducted qualitative interviews with 35 providers across multiple disciplines from 17 sites in the Autism Care Network. Qualitative data were analyzed using a framework approach and common themes were identified. RESULTS Providers across clinical disciplines identified strengths of the virtual model, such as its flexibility and the opportunity it provided to see children in their home environment. They also indicated that some interventions worked better virtually than others, and that there were several factors that impacted their success. Respondents were generally satisfied providing parent-mediated interventions but expressed mixed satisfaction in using telehealth for direct-to-patient care. CONCLUSIONS Results suggest that telehealth services for children with autism spectrum disorder could be a helpful tool in decreasing barriers and improving service delivery, especially when tailored to the individual needs of the patient. More research is needed on the factors contributing to its success in order to eventually inform clinical guidelines regarding the prioritization of children seen for in-person visits.
Collapse
Affiliation(s)
- Lucy A Fell
- Department of Pediatrics (LA Fell, and KA Kuhlthau), Massachusetts General Hospital, Boston.
| | - Charles M Albright
- Nationwide Children...s Hospital (CM Albright, EM Kryszak, and E Butter), Columbus, OH; Department of Pediatrics and Psychology (CM Albright, EM Kryszak, and E Butter), The Ohio State University, Child Development Center, Nationwide Children's Hospital, Westerville
| | - Elizabeth M Kryszak
- Nationwide Children...s Hospital (CM Albright, EM Kryszak, and E Butter), Columbus, OH; Department of Pediatrics and Psychology (CM Albright, EM Kryszak, and E Butter), The Ohio State University, Child Development Center, Nationwide Children's Hospital, Westerville
| | - Eric Butter
- Nationwide Children...s Hospital (CM Albright, EM Kryszak, and E Butter), Columbus, OH; Department of Pediatrics and Psychology (CM Albright, EM Kryszak, and E Butter), The Ohio State University, Child Development Center, Nationwide Children's Hospital, Westerville
| | - Karen A Kuhlthau
- Department of Pediatrics (LA Fell, and KA Kuhlthau), Massachusetts General Hospital, Boston; Department of Pediatrics (KA Kuhlthau), Harvard Medical School, Boston, MA
| |
Collapse
|
6
|
Pomales-Ramos A, Tokish H, Howard M, Straiton D, Ingersoll B. A mixed-methods examination of clinicians' perceived barriers to telehealth delivered applied behavior analysis. Front Psychol 2023; 14:1173644. [PMID: 37546433 PMCID: PMC10399227 DOI: 10.3389/fpsyg.2023.1173644] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2023] [Accepted: 06/14/2023] [Indexed: 08/08/2023] Open
Abstract
Following the COVID-19 pandemic, clinicians relied on telehealth to ensure continuity of essential healthcare services, such as Applied Behavior Analysis (ABA). Identifying barriers and examining them in the context of other implementation outcomes is important to support appropriate adaptations and sustainability of telehealth-delivered ABA services. Convergent mixed methods design was utilized to identify barriers experienced by ABA clinicians (N = 388) when delivering ABA services over telehealth to autistic children and their families following the first six months of the COVID-19 pandemic. Additionally, barriers were examined in relation to telehealth implementation outcomes and intentions for continued adoption. Findings reveal that clinicians rated providing direct services (M = 3.52, SD = 1.14) as more difficult than conducting assessments (M = 3.29, SD = 1.06), and both as more difficult than providing parent-mediated interventions [(M = 2.47, SD = 1.11), F(2, 381) = 162.26, p < 0.001]. A principal components analysis indicated a 3-factor solution of barriers related to: (1) technology (α = 0.82), (2) administrative tasks (α = 0.88), and (3) client characteristics (α = 0.88). The most frequently endorsed barriers were related to client characteristics, including increased difficulty providing telehealth services to children who elope (M = 4.37, SD = 0.81), children who exhibit challenging behaviors (M = 4.31; SD = 0.83), and children who are in the preverbal stage or use nonverbal language to communicate (M = 4.07; SD = 1.00). Fewer barriers related to client characteristics uniquely predicted implementation variables including acceptability, appropriateness, and feasibility. Thematic analysis revealed challenges related to technology, caregiver involvement, child engagement, implementation of intervention strategies over telehealth, and administrative or logistical barriers. These findings highlight the need for targeted strategies that facilitate telehealth use to address specific client needs and support the implementation of telehealth services in usual care settings.
Collapse
|
7
|
Spain D, Stewart GR, Mason D, Milner V, Fairhurst B, Robinson J, Gillan N, Ensum I, Stark E, Happe F. Telehealth Autism Diagnostic Assessments With Children, Young People, and Adults: Qualitative Interview Study With England-Wide Multidisciplinary Health Professionals. JMIR Ment Health 2022; 9:e37901. [PMID: 35857358 PMCID: PMC9302612 DOI: 10.2196/37901] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/10/2022] [Revised: 04/27/2022] [Accepted: 04/27/2022] [Indexed: 11/30/2022] Open
Abstract
BACKGROUND Autism spectrum disorder (hereafter, autism) is a common neurodevelopmental condition. Core traits can range from subtle to severe and fluctuate depending on context. Individuals can present for diagnostic assessments during childhood or adulthood. However, waiting times for assessment are typically lengthy, and many individuals wait months or even years to be seen. Traditionally, there has been a lack of standardization between services regarding how many and which multidisciplinary health professionals are involved in the assessment and the methods (diagnostic tools) that are used. The COVID-19 pandemic has affected routine service provision because of stay-at-home mandates and social distancing guidelines. Autism diagnostic services have had to adapt, such as by switching from conducting assessments in person to doing these fully via telehealth (defined as the use of remote technologies for the provision of health care) or using blended in-person or telehealth methods. OBJECTIVE This study explored health professionals' experiences of and perspectives about conducting telehealth autism diagnostic assessments, including barriers and facilitators to this, during the COVID-19 pandemic; potential telehealth training and supervision needs of health professionals; how the quality and effectiveness of telehealth autism diagnostic services can be enhanced; and experiences of delivering postdiagnostic support remotely. METHODS A total of 45 health professionals, working in varied settings across England, participated in one-off, in-depth semistructured qualitative interviews. These were conducted via videoconferencing or telephone. Altogether, participants represented 7 professional disciplines (psychiatry, medicine, psychology, speech and language therapy, occupational therapy, nursing, and social work). The data were then analyzed thematically. RESULTS Thematic analysis indicated the following 7 themes: practicalities of telehealth, telehealth autism diagnostic assessments, diagnostic conclusions, clinical considerations, postdiagnostic support, future ways of working, and health professionals' experiences and needs. Overall, telehealth autism diagnostic assessments were deemed by many participants to be convenient, flexible, and efficient for some patients, families, and health professionals. However, not all patients could be assessed in this way, for example, because of digital poverty, complex clinical presentation, or concerns about risk and safeguarding. Working remotely encouraged innovation, including the development of novel assessment measures. However, some participants expressed significant concerns about the validity and reliability of remotely assessing social communication conditions. CONCLUSIONS A shift to telehealth meant that autism diagnostic services remained operational during the COVID-19 pandemic. However, this method of working has potentially affected the parity of service, with people presenting with clinical complexity having to potentially wait longer to be seen or given a diagnostic opinion. There is also a lack of standardization in the provision of services. Further research should identify evidence-based ways of enhancing the timeliness, accessibility, and robustness of the autism diagnostic pathway, as well as the validity and reliability of telehealth methods.
Collapse
Affiliation(s)
- Debbie Spain
- Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, United Kingdom.,The National Psychology Clinic, London, United Kingdom
| | - Gavin R Stewart
- Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, United Kingdom
| | - David Mason
- Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, United Kingdom
| | - Victoria Milner
- Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, United Kingdom.,The National Psychology Clinic, London, United Kingdom
| | - Bryony Fairhurst
- The National Psychology Clinic, London, United Kingdom.,Berrywood Hospital, Northampton Healthcare National Health Service Foundation Trust, Northampton, United Kingdom
| | - Janine Robinson
- Cambridge Lifespan Autism Spectrum Service, Cambridgeshire and Peterborough National Health Service Foundation Trust, Cambridge, United Kingdom
| | - Nicola Gillan
- Bristol Autism Spectrum Service, Avon and Wiltshire Mental Health Partnership National Health Service Trust, Bristol, United Kingdom
| | - Ian Ensum
- Bristol Autism Spectrum Service, Avon and Wiltshire Mental Health Partnership National Health Service Trust, Bristol, United Kingdom
| | | | - Francesca Happe
- Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, United Kingdom
| |
Collapse
|