Improving question-asking initiations in young children with autism using pivotal response treatment

Using Pivotal Response Treatment to Improve Language Functions of Autistic Children in Special Schools: A Randomized Controlled Trial

Language difficulties exert profound negative effects on the cognitive and social development of autistic children. Pivotal Response Treatment (PRT) is a promising intervention for improving social communication in autistic children, but there is a lack of a comprehensive examination of language functions. This study aimed to investigate the effectiveness of PRT in promoting the primary language functions (requesting, labeling, repeating, responding) defined by (Skinner, B. F. (1957). Verbal behavior. Martino Publishing.) theory of verbal behavior in autistic children. Thirty autistic children were randomly divided into the PRT group (Mage = 6.20, SDage = 1.21) and control group (Mage = 6.07, SDage = 1.49). The PRT group were provided with an 8-week training of the PRT motivation component in addition to treatment as usual (TAU) in their schools, whereas the control group only received TAU. Parents of the PRT group were also trained to practice the PRT motivation procedures at home. The PRT group demonstrated greater improvements in all four measured language functions compared to the control group. The improvement in language functions in the PRT group was generalized and maintained at the follow-up assessment. In addition, the PRT intervention enhanced untargeted social and communicative functioning, cognition, motor skills, imitation, and adaptive behaviors in the autistic children. In conclusion, language intervention using the motivation component of PRT is effective in promoting language functions as well as widespread untargeted cognitive and social functions in autistic children.

A Pilot Randomized Controlled Trial of Motivation-Based Social Skills Group Treatment with Parent Training

Despite the popularity of social skills groups, there remains a need for empirical investigation of treatment effects, especially when targeting pivotal aspects of social functioning such as initiations to peers. The goal of the present study was to conduct a randomized controlled trial of a 12-week social intervention (SUCCESS), which combined an inclusive social group with a parent education program. Twenty-five 4- to 6-year-olds with Autism Spectrum Disorder (ASD) were randomized to SUCCESS (N = 11) or to treatment as usual (N = 14). Combining a peer group model with a parent training program, the SUCCESS intervention used naturalistic behavioral techniques (e.g., environmental arrangement, natural reinforcement) to increase social initiations to peers. After 12 weeks, children participating in the SUCCESS program made more frequent initiations to peers than children in the treatment-as-usual group, including more prompted and unprompted initiations to request. Additional gains in clinician-rated social functioning were observed in children randomized to SUCCESS, while differential treatment effects were not detected in parent-rated measures. However, lower baseline social motivation was associated with greater parent-reported initiation improvement. This study provides preliminary support for the efficacy of a naturalistic, behavioral social skills intervention to improve peer initiations for children with ASD. The findings suggest that using a motivation-based social skills group was effective in increasing both prompted and spontaneous initiations to peers, and highlights the need for further research into the role of baseline social motivation in predicting social skills treatment response.

Frequency, Form and Function of Dyadic Questions in Children with Autism: A CHILDES corpus study

Children's questions to their caregivers - and caregivers' questions to their children - play an important role in child development. For children on the autism spectrum, who often experience cognitive, linguistic and social difficulties, prior research on questions has resulted in inconsistent and incomplete findings. The present study characterized the frequency, form, and function of queries posed by children on the autism spectrum (n = 12), non-spectrum peers (n =20), and parents using the Nadig ASD English Corpus in the Child Language Data Exchange System (CHILDES). Results suggested that children on the autism spectrum and their caregivers produced fewer questions than non-spectrum dyads; however, whereas wh- questions were under-represented in the repertoire of children on the spectrum, they were over-represented in the repertoire of their parents. Finally, question function was similarly diverse for parents and children across groups. These findings offer important clinical implications for question-asking interventions targeting this population.

Using the high-probability instructional sequence to improve initiation and completion of low-probability instructions in young autistic children

This study examined the use of the high-probability (high-p) instructional sequence during pre-academic or academic activities for three young children diagnosed with autism spectrum disorder (ASD) served in public elementary schools. Specifically, we examined the effects of the high-p instructional sequence on the children's initiation and completion of low-probability (low-p) instructions, implemented by their classroom teachers. A nonconcurrent multiple-baseline design across participants was used to evaluate the intervention outcomes. The results indicated that the high-p instructional sequence may be an effective antecedent-based intervention for autistic children who typically initiate the low-p instructions but have difficulty completing the instructions. A strong magnitude of effect was shown for initiation across children. For one child, initiation and completion increased during high-p, and the improvement was maintained above criterion levels when high-p instructions in sequence were faded. For two children, we found high levels of initiation but variable performance in completion during high-p. The use of programmed reinforcement for one child suggests that for autistic children who do not often initiate the low-p instructions, the addition of programmed reinforcement may be needed to increase completion of low-probability instructions.

Intervention Goals for Preschoolers With Language Difficulties and Disorders: A Scoping Review Using the International Classification of Functioning, Disability and Health Framework

PURPOSE

The primary aim of this scoping review was to categorize language therapy goals reported in intervention studies for preschoolers (i.e., children from birth to 5;0 [years;months]) with language difficulties and disorders within the World Health Organization's International Classification of Functioning, Disability and Health (ICF) framework. A secondary aim was to determine whether different therapy goals were reported for two language difficulty/disorder subtypes (i.e., comparing language difficulty/disorder associated with a biomedical condition to those without an associated biomedical condition).

METHOD

The scoping review followed Arksey and O'Malley (2005) guidelines. Articles were retrieved from speechBITE, with age (under 5 years), intervention area (language), and study design (all but systematic reviews and clinical practice guidelines) specified as inclusion criteria. Language goals were extracted and categorized into the ICF components, and the distribution of goals across ICF components was compared for studies involving children with the two language difficulty/disorder subtypes.

RESULTS

A total of 287 articles were identified; 140 met inclusion criteria. Of the 293 goals extracted, 48% aligned with the activities component of the ICF framework, followed by participation (26%), environmental factors (20%), body functions and structures (3%), and personal factors (3%). Most participation-focused goals were reported from intervention studies involving preschoolers with a language difficulty/disorder associated with a biomedical condition.

CONCLUSIONS

Few participation-focused goals were reported in intervention studies for preschoolers with language difficulty/disorder without an associated condition. Future work is needed to support integrating the ICF framework in goal setting for both research and practice.

The Effects of Right Hemisphere Brain Damage on Question-Asking in Conversation

BACKGROUND

Right hemisphere brain damage (RHD) can cause challenges with information gathering. Cognitive processes aid in implicit and explicit information gathering, yet the relationship between these processes and question-asking, the most explicit avenue of information gathering, has not been explored. The purpose of this exploratory descriptive study was to test the hypothesis that adults with RHD differ from controls in the types of questions produced during a conversational discourse task and whether observed differences are associated with cognitive limitations.

METHOD

Adults with RHD (n = 15) and controls (n = 15) participated in a 5-min "first-encounter conversation" and were assessed for attention, memory, executive functioning (EF), visuospatial skills, and language domains using the Cognitive Linguistic Quick Test (CLQT). Questions produced during the conversation were coded and tallied by type: polar (yes/no), content (wh-), or alternative (A or B) using Computerized Language Analysis programs. Groups were compared on total questions used, use of questions by type, and CLQT domain scores; associations were computed between cognitive domain scores and question types.

RESULTS

Compared with controls, adults with RHD used half as many questions overall and scored significantly lower on the attention, executive function, and visuospatial domains of the CLQT. For the RHD group, there was a significant correlation between EF scores and the production of content and polar questions.

CONCLUSIONS

The frequency of question-asking is important to understanding the communication profile in adults with RHD. Executive function, attention, and, to a lesser extent, visuospatial capabilities may contribute to question-asking behaviors in conversation in this population. The RHD Framework for Asking Questions is proposed to illustrate the potential areas of deficit in the question-asking process after RHD.

The Effect of Teaching Initiations on the Communication of Children with Autism Spectrum Disorder: A Randomized Clinical Trial

This study examined the effect of Pivotal response treatment (PRT) to improve verbal initiations in children with Autism Spectrum Disorder, age 6-12 years old, using a Randomized Clinical Trial design. Intervention was conducted three times a week for 2 months, for a total of 24 one-hour sessions. The PRT intervention taught a variety of questions and attention/assistance-seeking initiations. The treatment as usual (TAU) group received standard language intervention. Results showed that the PRT group made significant improvements in their number of verbal initiations as well as collateral gains in general communicative skills and mean length of utterance (MLU) compared to the TAU group. Theoretical implications of including motivational approaches to develop social initiations are reviewed.

The Efficacy of Pivotal Response Treatment in Teaching Question-Asking Initiations to Young Turkish Children with Autism Spectrum Disorder

In the present study, a concurrent multiple baseline design across participants was used to evaluate the efficacy of pivotal response treatment (PRT) on the acquisition, maintenance, and generalization of the question-asking initiations by four children with autism spectrum disorder (ASD). The researchers also examined whether the implementation of PRT resulted in collateral changes in language development and other areas of development. The results of this study indicate that PRT is highly effective in teaching question-asking initiations. Participating children with ASD were able to generalize in natural settings and maintain long-term question-asking initiations. Furthermore, PRT resulted in positive collateral changes in language and other areas of development. Implications for future research and practice are then discussed.

Enhancing Social Initiations Using Naturalistic Behavioral Intervention: Outcomes from a Randomized Controlled Trial for Children with Autism

Deficits in social skills are common in children with Autism Spectrum Disorder (ASD), and there is an urgent need for effective social skills interventions, especially for improving interactions with typically developing peers. This study examined the effects of a naturalistic behavioral social skills intervention in improving social initiations to peers through a randomized controlled trial. Analyses of multimethod, multi-informant measures indicated that children in the active group (SIMI) demonstrated greater improvement in the types of initiations which were systematically prompted and reinforced during treatment (i.e., behavior regulation). Generalization to joint attention and social interaction initiation types, as well as collateral gains in broader social functioning on clinician- and parent-rated standardized measures were also observed.

Coconuts and curtain cakes: The production of wh-questions in ASD

BACKGROUND AND AIMS

Children with autism spectrum disorders (ASD) have been found to exhibit difficulties in wh-question production. It is unclear whether these difficulties are pragmatic or syntactic in nature. The current study used a question elicitation task to assess the production of subject and object wh-questions of children with ASD in two different languages (Hebrew and French) wherein the syntactic structure of wh-questions is different, a fact that may contribute to better understanding of the underlying deficits affecting wh-question production. Crucially, beyond the general correct/error rate we also performed an in-depth analysis of error types, comparing syntactic to pragmatic errors and comparing the distribution of errors in the ASD group to that of children with typical development (TD) and children with Developmental Language Disorder (DLD).

RESULTS

Correct production rates were found to be similar for the ASD and DLD groups, but error analysis revealed important differences between the ASD groups in the two languages and the DLD group. The Hebrew- and French ASD groups were found to produce pragmatic errors, which were not found in children with DLD. The pragmatic errors were similar in the two ASD groups. Syntactic errors were affected by the structure of each language.

CONCLUSIONS

Our results have shown that although the two ASD groups come from different countries and speak different languages, the correct production rates and more importantly, the error types were very similar in the two ASD groups, and very different compared to TD children and children with DLD.Implications: Our results highlight the importance of creating research tasks that test different linguistic functions independently and strengthen the need for conducting fine-grained error analysis to differentiate between groups and gain insights into the deficits underlying each of them.

Play-based interventions to support social and communication development in autistic children aged 2-8 years: A scoping review

BACKGROUND AND AIMS

Play is used by practitioners from across disciplinary backgrounds as a natural and enjoyable context for providing intervention and support in early childhood. In the case of autism interventions, many therapies are based on the association between social play and the development of social skills, language development, and communication skills, as these are often particular areas of challenge for autistic children. However, play is a wide-ranging concept and the extant literature on play-based interventions is large and heterogeneous. This means it is challenging for practitioners and families to navigate the evidence base and make choices about differing intervention strategies. This review aims to provide a comprehensive map of the research on this topic and to develop a conceptual framework to inform clinical decision-making.

METHODS

An initial stakeholder consultation confirmed the relevance of the topic to practitioners and autistic people. A scoping review methodology (preregistered) was used to identify relevant literature. We systematically searched seven databases to find peer-reviewed primary intervention studies of play-based approaches targeting language, social and communication outcomes for autistic children aged 2-8 years. We then summarised the literature using narrative synthesis and Evidence Gap Maps (EGMs). The literature was summarised according to a range of characteristics, including study design, population characteristics, agent of intervention and outcomes measured, among others. These summaries were then used to develop a framework for some key considerations for practitioners appraising play-based approaches.

RESULTS

388 studies met inclusion criteria. Approximately 21% of studies were RCTs, and over 50% had ≤10 participants. Over 45% of studies reported multiple relevant outcomes, with social play skills being the most common single intervention target. Girls and minority background groups are under-represented. A range of intervention types were identified, and some high-level categorisations are proposed.Main contribution: On the basis of the evidence synthesis we suggest important dimensions for appraisal of play-based interventions, including the role of play within an intervention (as a context, a key developmental mechanism, or a component of a larger approach), the underpinning philosophy (e.g. behaviourist or developmental), and the role of the practitioner (providing parent feedback, 1:1 intervention, group facilitation).

CONCLUSIONS

The wide range of approaches uncovered by this review is a testament to the wonderful diversity inherent to both play and autism. However, research could usefully focus on consolidating the evidence base for existing approaches, rather than aiming for further diversification. Implications: The conceptual framework proposed in this review can help practitioners appraise the literature and aid their advice to families when making shared intervention decisions.

A Longitudinal Study of Parent-Child Interactions and Language Outcomes in Fragile X Syndrome and Other Neurodevelopmental Disorders

Difficulties with pragmatic language (i.e., language in social contexts, such as conversational ability) are a noted characteristic of the language profiles of both fragile X syndrome (FXS) and autism spectrum disorder (ASD), conditions which show significant phenotypic overlap. Understanding the origins and developmental course of pragmatic language problems in FXS and other developmental conditions associated with language impairment is a critical step for the development of targeted interventions to promote communicative competence across the lifespan. This study examined pragmatic language in the context of parent-child interactions in school-age children with FXS (who did and did not meet ASD criteria on the ADOS; n = 85), idiopathic ASD (n = 32), Down syndrome (DS; n = 38), and typical development (TD; n = 39), and their parents. Parent-child communicative interactions were examined across multiple contexts, across groups, and in relationship to pragmatic language outcomes assessed 2 years later. Results showed both overlapping and divergent patterns across the FXS-ASD and idiopathic ASD child and parent groups, and also highlighted key differences in pragmatic profiles based on situational context, with more pragmatic language difficulties occurring for both ASD groups in less structured interactions. Differences in parental language styles during parent-child interactions were associated with child language outcomes, likely reflecting the complex interplay of discourse style inherent to a parent, with the inevitable influence of child characteristics on parent language as well. Together, findings help delineate the dynamic and multifactorial nature of impaired pragmatic skills among children with FXS and other neurodevelopmental disorders associated with language impairment, with potential implications for the development of targeted interventions for pragmatic communication skills.

Teaching Initiated Question Asking to Children with Autism Spectrum Disorder Through a Short-Term Parent-Mediated Program

This study investigated whether a brief parent-mediated intervention would increase the frequency of question asking in children with ASD. Mothers participated in a 3-week training consisting of 2-h sessions twice weekly. Data were collected in the context of concurrent multiple baseline design. Results demonstrate all three children increased frequency of question asking with two children maintaining gains. All three children demonstrated generalization of question asking to novel items, family members, and/or settings. Affect improved for two of the three children. Overall, mothers were able to reach Fidelity of Implementation during most sessions and rated the intervention as highly acceptable. Results are discussed in regard to the feasibility of providing a short-term parent-implemented intervention to increase social initiations through question asking.

Mothers' Perspectives on the Inclusion of Young Autistic Children in Kuwait

There is a lack of information on early childhood inclusive education and the parental perspectives towards the inclusion of autistic children in Kuwait. The aim of this study was to explore the perspectives and experiences amongst mothers of young autistic children regarding the inclusion of their children in general education kindergarten settings. Focus group and individual semi-structured interviews were conducted with (n = 34) Kuwaiti mothers of children with (ASD). The study participants were of the opinion that the behaviours unique to (ASD) can only be managed in highly structured special education settings. The themes that emerged from the interviews demonstrate that the general view amongst the study participants is that the inclusive educational model will not meet the autistic children's needs.

A Systematic Review of Linguistic and Verbal Behavior Outcomes of Pivotal Response Treatment

Pivotal Response Treatment (PRT) is a popular intervention for improving targeted and untargeted communication skills for learners with autism. We systematically reviewed communication outcomes reported in experimental research to determine linguistic forms and verbal behavior functions associated with PRT. We found most researchers aggregated results or did not report sufficient detail to determine linguistic forms and/or verbal behavior functions. Generalization of communication skills to untargeted people, settings, materials, and/or activities was evident. However, only one study clearly indicated untargeted linguistic forms emerged following PRT, and no researchers described results that indicated improved generalized and collateral verbal behavior functions. We suggest PRT researchers more clearly define and report primary, generalized, and collateral communication-specific outcomes in order to advance research and practice.

Clinical outcomes of interactive, intensive and individual (3i) play therapy for children with ASD: a two-year follow-up study

Background

The outcomes of psycho-educational interventions for Autism Spectrum Disorders (ASDs) comorbid with severe to moderate intellectual disability (ID) are insufficiently documented. In this prospective study, we examined a developmental individual, interactive and intensive approach, called the ‘3i method’, which is based on play therapy.

Methods

Twenty DSM-IV-TR ASD subjects (mean chronological age 63.8 ± 37.8 months; mean developmental age 19.5 ± 6.6 months) were included and followed the 3i method for 24 months. Developmental and behavioural skills were assessed at baseline and after 24 months using the VABS, PEP-R and Nadel Imitation scale. Autism severity was evaluated using the Child Autism Rating Scale (CARS) and the Autism Diagnostic Interview (ADI-R).

Results

After 2 years of the 3i method, our 3 primary outcome variables significantly increased (VABS developmental age of socialization increased by 83%, age of communication by 34%, and Nadel Imitation score by 53%). Almost all VABS and PEP-R domains significantly improved. Additionally, increases in the VABS socialization score were positively correlated with the total number of treatment hours and CARS score; all ADI-R areas significantly decreased; and diagnoses had changed in 47.5% of the subjects (37% for PDD-NOS and even 10.5% for ID without PDD).

Conclusion

Children who followed the 3i method for 2 years had significantly improved behavioural and developmental skills and showed a clear decrease in autism severity. These results suggest that the 3i method may be useful for autistic children by improving their daily interactions with their social environment.

Trial registration

was retrospectively registered on May 20th, 2014 by the French Agency for drug and health (ANSM) under number ID-RCB 2014-A00542–45, reference: B148558–31.

Electronic supplementary material

The online version of this article (10.1186/s12887-018-1126-7) contains supplementary material, which is available to authorized users.

Remote follow-up to speech-language intervention for children with Autism Spectrum Disorders (ASD): parents' feedback regarding structured activities

Purpose

This paper aims to present the first descriptions of experiences of parents and caretakers of children with Autism Spectrum Disorders (ASD) enrolled as mediators in a structured program of speech-language intervention with remote follow-up.

Methods

Research with focus on speech-language intervention for children with ASD was carried out with remote follow-up. Forty parents were instructed to perform daily activities focused on communication and interaction with their children, at home, for a period of six weeks. Parents and caretakers were questioned about the experience and by means of a structured questionnaire.

Results

Only 40% of the parents/caretakers conducted the activities proposed every day. Difficulties were reported by 60% of the parents/caretakers. Behavioral problems were also reported as reasons for the difficulties to conduct the activities proposed.

Conclusion

the importance of parents who provide detailed information about the child's development, discuss doubts and exchange experiences for the development of intervention programs that include families.

Increasing Opportunities for Question-Asking in School-Aged Children with Autism Spectrum Disorder: Effectiveness of Staff Training in Pivotal Response Treatment

Deficits in question-asking are common in children with autism spectrum disorder (ASD). Furthermore, their opportunities to self-initiate questions are often hindered by directive behavior of their conversation partners. This study assessed the effectiveness of staff training in pivotal response treatment (PRT) on staff member-created opportunities and self-initiated questions of school-aged children with ASD. Generalization and maintenance were also assessed. Participants were 14 staff members and children with ASD attending an inpatient treatment facility. Data showed that PRT resulted in significant increases in both staff member-created opportunities and child-initiated questions. Generalization to group situations and collateral changes in children's language, pragmatic, and adaptive skills, and maladaptive behaviors did not occur. Implications for clinical practice and directions for future research are discussed.

Applied Behavior Analysis is a Science and, Therefore, Progressive

Applied behavior analysis (ABA) is a science and, therefore, involves progressive approaches and outcomes. In this commentary we argue that the spirit and the method of science should be maintained in order to avoid reductionist procedures, stifled innovation, and rote, unresponsive protocols that become increasingly removed from meaningful progress for individuals diagnosed with autism spectrum disorder (ASD). We describe this approach as progressive. In a progressive approach to ABA, the therapist employs a structured yet flexible process, which is contingent upon and responsive to child progress. We will describe progressive ABA, contrast it to reductionist ABA, and provide rationales for both the substance and intent of ABA as a progressive scientific method for improving conditions of social relevance for individuals with ASD.

School-based social skills training for preschool-age children with autism spectrum disorder

Individuals with autism spectrum disorder display impairments in social interactions and communication that appear at early ages and result in short- and long-term negative outcomes. As such, there is a need for effective social skills training programs for young children with autism spectrum disorder—particularly interventions capable of being delivered in educational settings. The study evaluated the effects of the Superheroes Social Skills program on accurate demonstration of social skills in young children with autism spectrum disorder. Two preschool-age children with autism spectrum disorder participated in a weekly social skills intervention. A multiple probe design across skills was used to determine the effects of the intervention. Both participants demonstrated substantial improvements in skill accuracy. Social skills checklists also indicated improvements in social functioning over baseline levels.

Peer-mediated intervention for pre-schoolers with ASD: Effects on responses and initiations

PURPOSE

This study investigates the effects of peer-mediated intervention on the responses and initiations of pre-schoolers (aged 4;2-5;1) with Autism Spectrum Disorder (ASD).

METHOD

A speech-language pathologist and three early childhood educators trained typically-developing peers to facilitate responses and initiations from three pre-schoolers with ASD during playtime. A multiple baseline design across subjects was used to determine the effects of the intervention. Play sessions between the children with ASD and their typically-developing peers were videotaped. Videotapes were analysed using an interval coding system in order to collect information regarding responses and initiations.

RESULT

All three target children demonstrated improvements in their responses and initiations to their peers during intervention. Moreover, they maintained these gains 4 weeks later and generalized their response and initiation skills to an untrained peer. Social validity data, obtained using unbiased, independent, lay, observers to rate the children's performance provided external validation of an observable treatment effect (i.e. increased responses and initiations) following intervention.

CONCLUSION

The results suggest that training typically-developing peers to implement intervention strategies using the collaboration between a speech-language pathologist and early childhood educators may be an effective model of service delivery to enhance peer interaction skills of pre-schoolers with ASD.

Psychosocial treatments for individuals with autism spectrum disorder across the lifespan: new developments and underlying mechanisms

Researchers have studied many interventions to address the core impairment in social interactions in autism spectrum disorder. We reviewed the social skills intervention literature over the past two years (2012-2014). Social skills intervention studies have increased by 35% over our previous review of 2010-2012. Nearly equal numbers of studies reported results using single subject research designs (n = 29) and group designs (n = 25). Consistent with our previous review, many studies focused on joint attention/joint engagement for young children and interventions addressing peer interactions for older children. Advancements in this review period included more replications of intervention models, longitudinal outcomes, and a focus on minimally verbal children. Notably absent are social interventions for adults, and interventions addressing school-based inclusion. In addition to these target areas, future studies should isolate active ingredients of social interventions, include broader participant representation, and further examine the relation between neural development and behavioral outcomes.

Video-feedback Intervention to promote Positive Parenting adapted to Autism (VIPP-AUTI): A randomized controlled trial

In a randomized controlled trial, we evaluated the early intervention program Video-feedback Intervention to promote Positive Parenting adapted to Autism (VIPP-AUTI) with 78 primary caregivers and their child (16-61 months) with Autism Spectrum Disorder. VIPP-AUTI is a brief attachment-based intervention program, focusing on improving parent-child interaction and reducing the child's individual Autism Spectrum Disorder-related symptomatology in five home visits. VIPP-AUTI, as compared with usual care, demonstrated efficacy in reducing parental intrusiveness. Moreover, parents who received VIPP-AUTI showed increased feelings of self-efficacy in child rearing. No significant group differences were found on other aspects of parent-child interaction or on child play behavior. At 3-months follow-up, intervention effects were found on child-initiated joint attention skills, not mediated by intervention effects on parenting. Implementation of VIPP-AUTI in clinical practice is facilitated by the use of a detailed manual and a relatively brief training of interveners.