Functioning assessment short test (FAST): validity and reliability in adults with Autism Spectrum Disorder

An Internal Consistency Reliability Study of the Catalyst Datafinch Applied Behavior Analysis Data Collection Application With Autistic Individuals

Introduction Many psychometric studies have scrutinized the dependability of different instruments for evaluating and treating autism using applied behavior analysis (ABA). However, there has been no exploration into the psychometric attributes of the Catalyst Datafinch Applied Behavior Analysis Data Collection Application, namely, internal consistency reliability measures. Materials and methods  Four datasets were extracted (n=100, 98, 103, and 62) from published studies at The Oxford Center, Brighton, MI, ranging from March 19, 2023, through January 8, 2024, using Catalyst Datafinch as the data collection tool. All data were gathered by Board Certified Behavior Analysts (BCBAs) and behavioral technicians and designed to replicate how practitioners collect traditional paper and pencil data. SPSS Statistics (v. 29.0) computed internal consistency reliability measures, including Cronbach's alpha, inter-item, split-half, and interclass correlation coefficients. Results  Dataset #1: Cronbach's alpha was 0.916 with seven items, indicating excellent reliability. Cronbach's split-half reliability for Part 1 was 0.777, indicating good reliability, and for Part 2 was 0.972, indicating excellent reliability. Guttman split-half coefficient was 0.817, indicating good reliability. Inter-item correlation coefficients ranged from 0.474 to 0.970. The average measures interclass correlation (ICC) was 0.916, indicating excellent reliability. Single measures (ICC) reliability was 0.609, indicating acceptable reliability. Dataset #2: Cronbach's alpha was 0.954 with three items, indicating excellent reliability. Cronbach's split-half reliability for Part 1 was 0.912, indicating excellent reliability, and for Part 2 was 0.975, indicating excellent reliability. Guttman split-half coefficient was 0.917, indicating excellent reliability. Inter-item correlation coefficients ranged from 0.827 to 0.977. Average measures (ICC) was 0.954, indicating excellent reliability. Single measures (ICC) reliability was 0.875, indicating good reliability. Dataset #3: Cronbach's alpha was 0.974 with three items, indicating excellent reliability. Cronbach's split-half reliability for Part 1 was 0.978, indicating excellent reliability. Split-half reliability for Part 2 was 0.970, indicating excellent reliability. Guttman split-half coefficient was 0.935, indicating excellent reliability. Inter-item correlation coefficients ranged from 0.931 to 0.972. The average measures (ICC) was 0.974, indicating excellent reliability. Single measures (ICC) reliability was 0.926, indicating excellent reliability. Dataset #4: Cronbach's alpha was 0.980 with 12 items, indicating excellent reliability. Cronbach's split-half reliability for Part 1 was 0.973, indicating excellent reliability. Split-half reliability for Part 2 was 0.996, indicating excellent reliability. Guttman split-half coefficient was 0.838, indicating good reliability. Inter-item correlation coefficients ranged from 0.692 to 0.999. The average measures (ICC) was 0.980, indicating excellent reliability. Single measures (ICC) reliability was 0.804, indicating good reliability. Conclusions These results suggest that Catalyst Datafinch demonstrates high internal consistency reliability when used with individuals with autism. This indicates that the application is reliable for collecting and analyzing behavioral data in this population. The ratings ranged from good to excellent, indicating a high consistency in the measurements.

Functional assessment short test (FAST): Self-administration in outpatient mental health settings

The Functional Assessment Short Test (FAST) is a clinician-administered assessment scale of psychosocial dysfunction across various domains typically impacted in individuals with bipolar disorder. The FAST is formally validated as a clinician-administered measure, but support for self-administration would allow its wider use. Therefore, this study aimed to determine whether the FAST could reliably serve as a self-report measure in individuals seeking mental health treatment. Participants completed both the self-report and clinician-administered versions of the FAST as part of their routine outpatient clinical care at the Bipolar Disorders Clinic at The University of Texas Health Austin (UTHA). We investigated correlations between self-report and clinician-administered FAST scores. There were significant positive correlations between self-report and clinician-administered scores in a diverse group of 84 individuals undergoing outpatient mental health treatment (Total FAST scores r_S = 0.75; p < .001). These findings support using the FAST as a self-report scale, further increasing its utility to measure functional disability in mental health conditions such as bipolar disorder. Self-report application will increase the utility of the FAST in busy clinical workflows and, therefore, contribute to a more comprehensive clinical assessment of recovery and spur interventions that improve psychosocial functioning and quality of life.

Validity and Reliability of the Digital Functioning Assessment Short Test (D-FAST) in the Brazilian Sample

Background

The COVID-19 pandemic has caused major disruptions in all aspects of daily functioning, from school and work to interactions with friends and family. The Functioning Assessment Short Test (FAST) is an interviewer-administered scale validated in the psychiatric sample with no previous study assessing its validity and reliability in a digital format. Thus, we aimed to analyse the psychometric properties of the digital version of the FAST and understand the implications of COVID-19 and restrictive measures on functioning.

Methods

Data were collected using an online survey. The psychometric properties of the digital FAST were assessed by confirmatory factor analysis, Cronbach's alpha, and discriminant functional by cluster analysis in a community sample.

Results

Out of the total sample, 2,543 (84.1%) were female, and the mean (SD) age was 34.28 (12.46) years. The digital FAST retained the six factors structure observed in the original version, with Cronbach's alpha above 0.9. In addition, we showed evidence of discriminant validity by differentiating three clusters of psychosocial functioning. Clinical and demographic differences between groups explained, in part, the heterogeneity of functioning, thus providing support for the construct validity of the instrument.

Conclusion

The digital FAST is a simple and easy-to-understand instrument that provides a multidimensional assessment of functioning without the need for an interviewer. Furthermore, our findings may help to better understand the psychosocial implications of the pandemic and the importance of planning specific interventions to rehabilitee the affected group.

Validity of the Functioning Assessment Short Tests (FAST), in patients with schizophrenia

INTRODUCTION

Functional impairment in schizophrenia is one of the main features of the disorder and implies a great impact on the patient's quality of life. The Brief Functioning Assessment Scale (FAST), originally validated in bipolar disorder, has also been validated for its application in other mental disorders. However, we only found one study on the reliability and validity of the Brazilian version in schizophrenia. The purpose of this study was to analyze the psychometric properties of the Spanish version of the FAST in patients diagnosed with schizophrenia.

MATERIAL AND METHODS

A total of 226 patients with a diagnosis of schizophrenia were evaluated by mean the FAST, the GAF and the self-care requirements scale (ERA). Scale properties were analyzed in terms of internal consistency, inter-observer agreement and test-retest reliability. Convergent validity with the GAF and ERA scales was also analyzed, as well as construct validity by means of a Confirmatory Factor Analysis (CFA).

RESULTS

For the total scale, the results showed high internal consistency (Cronbach's Alpha of, 87), as well as good inter-observer (ICC=,86) and test-retest (ICC=,77) agreement. Concurrent validity with the GAF scale was discrete (r=-,32; P<,001) and with the ERA scale was moderate (r=,50; P<,001). CFA showed an internal structure that matched the six factors proposed by the original scale, with a good level of item saturation for each factor.

CONCLUSIONS

The FAST scale showed good psychometric properties in terms of reliability and validity in its Spanish version for its application in patients with schizophrenia. It can be considered as a good tool to assess different areas of functional impairment in clinical practice and research.