A Systematic Review of Behaviour-Related Outcome Assessments for Children on the Autism Spectrum with Intellectual Disabilities in Education Settings

Measurement tools for behaviours that challenge and behavioural function in people with intellectual disability: A systematic review and meta-analysis of internal consistency, inter-rater reliability, and test-retest reliability

Behaviours that challenge (BtC) are common in people with intellectual disability (ID) and associated with negative long-term outcomes. Reliable characterisation of BtC and behavioural function is integral to person-centred interventions. This systematic review and meta-analytic study quantitatively synthesised the evidence-base for the internal consistency, inter-rater reliability, and test-retest reliability of measures of BtC and behavioural function in people with ID (PROSPERO: CRD42021239042). Web of Science, Embase, PsycINFO and MEDLINE were searched from inception to March 2024. Retrieved records (n = 3691) were screened independently to identify studies assessing eligible measurement properties in people with ID. Data extracted from 83 studies, across 29 measures, were synthesised in a series of random-effects meta-analyses. Subgroup analyses assessed the influence of methodological quality and study-level characteristics on pooled estimates. COSMIN criteria were used to evaluate the measurement properties of each measure. Pooled estimates ranged across measures: internal consistency (0.41-0.97), inter-rater reliability (0.29-0.93) and test-retest reliability (0.52-0.98). The quantity and quality of evidence varied substantially across measures; evidence was frequently unavailable or limited to a single study. Based on current evidence, candidate measures with the most evidence for internal consistency and reliability are discussed; however, continued assessment of measurement properties in ID populations is a key priority.

Assessment of Adaptive Behavior in People with Autism Spectrum Disorders through the ICAP

Evaluating adaptive behavior in people with Autism Spectrum Disorder (ASD) requires attending to a set of cognitive processes associated with social interaction skills and functional communication that are altered. This paper presents the analysis of an instrument to assess and diagnose adaptive behavior in people with Autism Spectrum Disorder (ASD), given the need for rigorous, standardized, and statistically reliable tools to address this dimension, incorporated into the diagnosis since 1992. The Inventory for Service Planning and Individual Programming (ICAP) was applied to n = 209 children with ASD. Its psychometric properties were studied to provide statistical criteria for its usefulness in assessing adaptive behavior. Results highlighted variations in its original structure, reducing the number of items from 77 to 60 by eliminating those with little discriminative power, and of dimensions from four to three given their greater congruence with the results of the exploratory analysis: daily life skills (α = 0.892–0.935), communication and linguistic skills (α = 0.860–0.931), and motor skills (α = 0.828–0.857). This again raises questions about the use of instruments similar in their dimensions, and about the interaction between variables and items, a frequent issue in the field of mind, social, and health sciences.

'There isn't a checklist in the world that's got that on it': Special needs teachers' opinions on the assessment and teaching priorities of pupils on the autism spectrum

Two focus groups were conducted with special needs teachers to: (a) identify barriers to learning for autistic pupils, (b) consider broad assessment domains and specific skills or behaviours which teachers consider important for these pupils, and (c) give their opinions on teacher assessments. Data analysis resulted in six main themes: (a) barriers to learning, (b) teacher priorities for autistic pupils, (c) ways of overcoming barriers, (d) the concept of 'true mastery', (e) assessing the bigger picture, and (f) practicalities of assessment. Results showed that teachers have priorities for the pupils they know well and concerns about the assessments they regularly use. To ensure face and content validity of teacher assessments, and for assessments to be useful to and valued by the teachers who use them, it is recommended that teachers have opportunities to input during various aspects of the assessment development process.

The preliminary validity and reliability of the Assessment of Barriers to Learning in Education - Autism

BACKGROUND

Few robust autism-specific outcome assessments have been developed specifically for use by teachers in special schools. The Assessment of Barriers to Learning in Education - Autism (ABLE-Autism) is a newly developed teacher assessment to identify and show progress in barriers to learning for pupils on the autism spectrum with coexisting intellectual disabilities.

AIMS

This study aimed to conduct a preliminary validity and reliability evaluation of the ABLE-Autism.

METHODS AND PROCEDURES

Forty-eight autistic pupils attending special schools were assessed using the ABLE-Autism. Multi-level modelling was used to evaluate test-retest reliability, internal consistency and convergent validity with the Teacher Autism Progress Scale.

OUTCOMES AND RESULTS

Results showed excellent test-retest reliability and internal consistency. A large effect size suggested that the ABLE-Autism is strongly correlated with the Teacher Autism Progress Scale. Teacher feedback was positive and suggested that the ABLE-Autism is easily understood by teachers, relevant to autistic pupils in special schools, and adequately covers the skills and behaviours that teachers believe are important to assess for these pupils.

CONCLUSIONS AND IMPLICATIONS

Although further validation is recommended, the preliminary evaluation of the ABLE-Autism suggests that it is a useful and has the potential to be an effective outcome assessment for autistic pupils in special schools.