Dynamic assessment and response to intervention: two sides of one coin

Does cognitive learning potential measured with the dynamic Wisconsin Card Sorting Test predict rehabilitation outcome in elderly patients post-stroke?

OBJECTIVE

To determine whether cognitive learning potential measured with the dynamic Wisconsin Card Sorting Test has added value in predicting rehabilitation outcome in elderly patients post-stroke after controlling for age, ADL independence at admission, global cognitive functioning and depressive symptoms.

METHODS

Participants were patients with stroke admitted to a geriatric rehabilitation unit. ADL independence (Barthel Index) at discharge was used as measure for rehabilitation outcome. Predictor variables included age, ADL independence at admission, global cognitive functioning (Montreal Cognitive Assessment), depressive symptoms (Geriatric Depression Scale) and cognitive learning potential measured with the dWCST.

RESULTS

Thirty participants were included. Bivariate analyses showed that rehabilitation outcome was significantly correlated with ADL independence at admission (r = 0.443, p = 0.014) and global cognitive functioning (r = 0.491, p = 0.006). Regression analyses showed that the dWCST was not an independent predictor of rehabilitation outcome. ADL independence at admission was the only significant predictor of rehabilitation outcome (beta = 0.480, p = 0.007).

CONCLUSIONS

Cognitive learning potential, measured with the dWCST has no added value in predicting rehabilitation outcome in elderly patients post-stroke. ADL independence at admission was the only significant predictor of rehabilitation outcome.

REGISTRATION NUMBER NETHERLANDS TRIAL REGISTER

Trial NL7947.

The critical role of instructional response in defining and identifying students with dyslexia: a case for updating existing definitions

We address defining and identifying students with dyslexia within the context of multi-tier systems of support (MTSS). We review proposed definitions of dyslexia, evidence for proposed definitional attributes, and emphasize the role of instructional response in identifying students with dyslexia. We identify dyslexia as individuals with specific deficits in reading and spelling single words combined with inadequate response to evidence-based instruction. We propose a hybrid identification process in which assessment is utilized within school-wide MTSS allowing for integration of routinely collected progress monitoring data as well integrating with more formal diagnostic measures. This proposed "hybrid" method demonstrates strong evidence for valid decision-making and directly informs instruction. We close proposing a revised definition of dyslexia that incorporates these elements.

Fostering self-regulated learning in preschool through dynamic assessment methodologies

Self-regulated learning is a transversal competency which plays a central role in acquiring autonomy. This investigation aimed to support approaches that foster self-regulated learning in preschool. We proposed to improve preschoolers' self-regulated learning strategies (i.e., forethought, performance, and self-reflection) through the educational intervention Pipo and Mia, the magic knights, hypothesizing different results when comparing levels of the program intervention. Participants included 115 preschoolers and their nine teachers. Teachers implemented the program to children, and engaged in professional training simultaneously. Aiming to validate the Dynamic Assessment of Self-regulation in Preschool (DASP) method socially, it was used as children's pre and post-measure, and focus groups were conducted with teachers to assess its validity. Results showed improvements in children's use of strategies, and some significant differences between intervention levels. Teachers highlighted the DASP method potentialities. The study's contributions and constraints are discussed considering implications for practice, research, theory, and policy.

Dyslexia, the Amsterdam Way

The current aim is to illustrate our research on dyslexia conducted at the Developmental Psychology section of the Department of Psychology, University of Amsterdam, in collaboration with the nationwide IWAL institute for learning disabilities (now RID). The collaborative efforts are institutionalized in the Rudolf Berlin Center. The first series of studies aimed at furthering the understanding of dyslexia using a gamified tool based on an artificial script. Behavioral measures were augmented with diffusion modeling in one study, and indices derived from the electroencephalogram were used in others. Next, we illustrated a series of studies aiming to assess individuals who struggle with reading and spelling using similar research strategies. In one study, we used methodology derived from the machine learning literature. The third series of studies involved intervention targeting the phonics of language. These studies included a network analysis that is now rapidly gaining prominence in the psychopathology literature. Collectively, the studies demonstrate the importance of letter-speech sound mapping and word decoding in the acquisition of reading. It was demonstrated that focusing on these abilities may inform the prediction, classification, and intervention of reading difficulties and their neural underpinnings. A final section examined dyslexia, conceived as a neurobiological disorder. This analysis converged on the conclusion that recent developments in the psychopathology literature inspired by the focus on research domain criteria and network analysis might further the field by staying away from longstanding debates in the dyslexia literature (single vs. a multiple deficit, category vs. dimension, disorder vs. lack of skill).

Does Dynamic Assessment Offer An Alternative Approach to Identifying Reading Disorder? A Systematic Review

Traditional static tests of reading and reading-related skills offer some ability to predict future reading performance, though such screeners may misclassify children with or at risk of reading disorder (RD). Dynamic assessment (DA) is an alternative approach that measures learning potential and may be less dependent on learning background. A systematic review was carried out to examine the ability of DA to classify children with or at risk of RD. A database search yielded 14 eligible articles assessing DA of decoding, phonological awareness (PA), and working memory (WM). Results suggest that DA explains unique variance in the prediction of later RD status, and although models with a single dynamic predictor sometimes achieved good classification accuracy, this was enhanced somewhat by the addition of static predictors. Higher classification accuracy was found for DA targeting constructs more proximal to reading, particularly decoding, but the predictive power of DA of decoding and PA appeared to wane with increasing age as static measures explained more variance in outcomes. Some evidence emerged that DA provides benefits over static tests for the prediction of RD in bilingual students, though no studies examined outcomes by administration format or orthographic depth. Limitations and suggestions for future work are discussed.

Assessing learning potential in elderly stroke patients: The validity of the dynamic Clock Drawing Task in comparison with the dynamic Wisconsin Card Sorting Test

Currently, there is no valid and feasible dynamic test available for assessing learning potential in elderly stroke patients. We designed a dynamic version of the Clock Drawing Task (dCDT) which we compared to the dynamic Wisconsin Card Sorting Test (dWCST). The dWCST has shown adequate validity in adult patients with brain injury but has a long administration time. Participants were 47 stroke patients admitted to a geriatric rehabilitation unit. All participants completed the dCDT, the mean administration time was 7 min. 90.7% of the participants were able to complete the dWCST, the mean administration time was 36 min. The numerical learning potential indices of the dCDT were not significantly correlated. Based on the dCDT, 70.2% of the participants were classified as high achiever, 10.6% as strong learner, 19.2% as poor learner, and none as decliner. The numerical learning potential indices of the dWCST correlated significantly. Based on the dWCST, 5.3% of the participants were classified as high achiever, 42.1% as strong learner, 50% as poor learner, and 2.6% as decliner. The learning potential indices of the dCDT and those of the dWCST were not significantly correlated, indicating poor convergent validity of the dCDT. The results provide no clear support for the use of the dCDT in elderly stroke patients. The dWCST does show adequate validity and feasibility in the elderly stroke population, despite longer administration time. Future research should focus on examining the validity of the dCDT in a larger sample as well as examining the predictive validity of the dWCST.

Exploring Senior Phase teachers’ competencies in supporting learners with specific learning difficulties: Implications for inclusive education

Background

Teaching learners with specific learning difficulties requires competent teachers who can provide learning support. Competencies such as identifying learning difficulties, assessing learners, designing interventions such as curriculum differentiation and facilitating referral systems are crucial. However, Senior Phase teachers in South Africa seem to be challenged when it comes to providing learning support. Consequently, learners do not meet the desired learning outcomes.

Objectives

The purpose of this study was to explore Senior Phase teachers’ competencies in supporting learners with specific learning difficulties in four mainstream schools.

Methods

A qualitative research approach and phenomenological research design were used. Eighteen teachers who were members of the school-based support teams, including learning support educators, were selected through purposive sampling. Data were collected through individual and focus group interviews, the analysis of support forms and field notes. A thematic data analysis was used to generate findings.

Results

The thematic data analysis revealed discrepancies relating to participants’ competencies in identifying language difficulties, short-term memory problems and contextual barriers. Also, participants differed in collaborating with peers, social workers, and the district-based support teams. Furthermore, some participants were able to design intervention programmes and facilitate internal and external referral processes.

Conclusion

The study concludes that teachers have different competencies in providing learning support. Therefore, the Department of Basic Education should provide a clear practical learning support strategy in the Senior Phase mainstream schools as well as continuous professional development for teachers couple with monitoring.

Contribution

It is envisioned that the study will contribute to understanding teachers’ competences in providing learning support for learners with specific learning difficulties in the senior phase. The study advocates for collaborative continuous professional teacher development focusing on interventions programmes to support learners with specific learning difficulties in the mainstream schools.

Inclusion of Individuals With Neurodevelopmental Disorders in Norm-Referenced Language Assessments

Standardized, norm-referenced language assessment tools are used for a variety of purposes, including in education, clinical practice, and research. Unfortunately, norm-referenced language assessment tools can demonstrate floor effects (i.e., a large percentage of individuals scoring at or near the lowest limit of the assessment tool) when used with some groups with neurodevelopmental disorders (NDDs), such as individuals with intellectual disability and neurogenetic syndromes. Without variability at the lower end of these assessment tools, professionals cannot accurately measure language strengths and difficulties within or across individuals. This lack of variability may be tied to poor representation of individuals with NDDs in normative samples. Therefore, the purpose of this study was to identify and examine common standardized, norm-referenced language assessment tools to report the representation of individuals with NDDs in normative samples and the range of standard/index scores provided. A systematic search identified 57 assessment tools that met inclusion criteria. Coding of the assessment manuals identified that most assessment tools included a “disability” or “exceptionality” group in their normative sample. However, the total number of individuals in these groups and the number of individuals with specific NDDs was small. Further, the characteristics of these groups (e.g., demographic information; disability type) were often poorly defined. The floor standard/index scores of most assessment tools were in the 40s or 50s. Only four assessment tools provided a standard score lower than 40. Findings of this study can assist clinicians, educators, and researchers in their selections of norm-referenced assessment tools when working with individuals with NDDs.

Development of an Adaptive Computer-Aided Soft Sensor Diagnosis System for Assessment of Executive Functions

The main objective of the present study is to highlight the role of technological (soft sensor) methodologies in the assessment of the neurocognitive dysfunctions specific to neurodevelopmental disorders (for example, autism spectrum disorder (ASD), attention deficit hyperactivity disorder (ADHD), and specific learning disorder). In many cases neurocognitive dysfunctions can be detected in neurodevelopmental disorders, some of them having a well-defined syndrome-specific clinical pattern. A number of evidence-based neuropsychological batteries are available for identifying these domain-specific functions. Atypical patterns of cognitive functions such as executive functions are present in almost all developmental disorders. In this paper, we present a novel adaptation of the Tower of London Test, a widely used neuropsychological test for assessing executive functions (in particular planning and problem-solving). Our version, the Tower of London Adaptive Test, is based on computer adaptive test theory (CAT). Adaptive testing using novel algorithms and parameterized task banks allows the immediate evaluation of the participant's response which in turn determines the next task's difficulty level. In this manner, the subsequent item is adjusted to the participant's estimated capability. The adaptive procedure enhances the original test's diagnostic power and sensitivity. By measuring the targeted cognitive capacity and its limitations more precisely, it leads to more accurate diagnoses. In some developmental disorders (e.g., ADHD, ASD) it could be very useful in improving the diagnosis, planning the right interventions, and choosing the most suitable assistive digital technological service.

Dynamic assessment of self-regulated learning in preschool

The assessment of self-regulated learning is a relevant research topic in early childhood development. However, there are few ecologic measures to assess self-regulated learning in preschool as a dynamic and multidimensional process. This study aims to fill this gap by presenting the development and validation of the Dynamic Assessment of Self-regulated learning in Preschool (DASP) method. A dynamic assessment of the construct may constitute an important contribution as it enables the acquisition of cross observational, verbal, and performance data. The DASP method was developed within a theoretical framework of self-regulation, including all cyclical phases, namely, forethought, performance, and self-reflection. Specifically, this method requires children to be questioned in the forethought and self-reflection phases, and observed in the performance phase, as the researcher notes their strategies. This method is used while children engage in authentic preschool tasks. To achieve the study's aim, 214 preschool children were asked to participate. In this research, children performed the Clown task (cognitive task) and the Head-Toes-Knees-Shoulders task (motor task). Item Response Theory analyses provided good item fit for the DASP method (forethought: .99, performance: 1.00, self-reflection: .99), good values of the tasks' reliability (Clown: .92; HTKS: .85), and evidence of the participants' difficulty level in completing the tasks. Results indicated that the children experienced more difficulty in the performance phase, as opposed to the other phases. The potentialities, constraints, and practical implications of the DASP method will be discussed in terms of contributions for theory and practice.

Current and Potential Cognitive Development in Healthy Children: A New Approach to Raven Coloured Progressive Matrices

In clinical practice and research, Raven’s Coloured Progressive Matrices (RCPMs) continue to be used according to a single procedure that aims to evaluate a single overall score of the current general intelligence level. This study aimed to examine potential cognitive development in a sample of 450 typically developing children, aged from 6 to 10 years, by administering RCPMs according to the standard procedure followed immediately by a standardized interview on incorrect items. In addition, the study aimed to analyze how performance differed across age groups. The results analysis was examined on the basis of three different factors in which the items were grouped in previous factorial studies. The results found that performance improved markedly and significantly after the interview; however, the improvement was not homogeneous in the three factors across age groups or within each age group. The age groups showed a different development potential in relation to the nature of the task: the younger ones showed a greater increase on items requiring figure completion, and the older ones showed a greater increase on analogical reasoning items. Finally, the children who showed the greatest improvement were those with the best performance in standard RCPM administration. The procedure described in the present research could represent a useful tool in clinical practice and in the research for a broader cognitive assessment focused on potential cognitive development, as well as on real cognitive development, and to favor the planning of more adequate rehabilitation and educational treatments.

The zone of actual and the zone of proximal development measured through preschool dynamic assessment as predictors of later school performance - a longitudinal study

The goal of the study was to examine whether the zone of actual (ZAD) and the zone of proximal development (ZPD) in children, measured through preschool dynamic assessment, could be used as predictors of later school performance. A longitudinal study was conducted. The participants were 114 students from the ?Stevan Colovic? primary school in Arilje (54 boys, and 60 girls), Serbia. The findings generally confirm that measures from preschool dynamic assessment can be used as predictors of later school performance. ZAD was shown to be a better predictor than ZPD. ZPD is an independent predictor only for performance in language and mathematics tests in a final trial test. Affective-motivational scaffolding is a better predictor than cognitive scaffolding. These results are considered in the context of Vygotsky?s theory and also in that of dynamic assessment procedures. Theoretical and practical implications for future studies of affective-motivational and cognitive factors as predictors of school performance are being considered.

Dynamic assessment in spelling and morphological awareness in Greek: The case of a transparent orthography

BACKGROUND

Recent research is in favor of the use of dynamic assessment as an important method of combining assessment and intervention in a unified framework for typically and non-typically developing children. However, research is still sparse, in the evaluation of morphological awareness, especially for phonologically regular languages.

AIMS

This study aimed to investigate the role of dynamic assessment in the evaluation of morphological awareness in Greek children.

METHODS

Forty Greek participants (7-8 years old) allocated to an experimental (N = 21) and a control group (N = 19) were preliminary assessed on reading syllables/words, spelling words, vocabulary and morphological awareness. They were also evaluated on static assessments of spelling and word-formation of morphologically complex words, while only the experimental group was evaluated on dynamic assessments of the same tasks.

RESULTS

Children achieved significantly higher performance on the dynamic assessment tasks in comparison to their static ones. Correlations indicated that the degree of children's progress depended greatly on their initial literacy and language skills, while regression analyses revealed that static tasks made a unique contribution to their dynamic performance.

CONCLUSIONS

The results underline the role of dynamic assessment in the evaluation of morphological awareness in a phonologically regular language with rich morphology, such as Greek.

Spreading the Wealth: Developing Assessments of Cognitive Abilities in Non-WEIRD Countries

In this brief essay I reminisce on the ideas I encountered in Lev Vygotsky's lectures on pedology as an undergraduate student at Moscow State University in the USSR. Some of these ideas have been reliably stored in my professional memory and have influenced how my colleagues and I have approached the assessment of IQ (or general cognitive abilities) in countries other than the ones in which they were developed. Whereas the essay is autobiographical in nature, it attempts to make a generalizable point that spreading the wealth of existing knowledge, principles, and practice is as central to the progress of science as generating new knowledge.

Predicting Response to Vocabulary Intervention Using Dynamic Assessment

Purpose The purpose of this study was to examine how well students' response to a morphological vocabulary intervention can be predicted before the start of the intervention from traditional static assessments and to determine whether a dynamic assessment with graduated prompts improves the prediction. Method A planned secondary analysis of a randomized trial of a morphological vocabulary intervention for fifth-grade students with limited vocabulary was conducted. Response to this intervention was examined for 111 participants based on their development in definitions of morphologically transparent words from pretest to posttest. Traditional static measures of vocabulary, knowledge of morphology, and morphological analysis as well as a dynamic assessment of morphological analysis were evaluated as predictors of students' response to intervention. Results The static pretest measures predicted more than half of the overall variance in students' response to intervention and provided a good classification of students with subsequent poor or good response to intervention. The single best static predictor was the static assessment of morphological analysis. Furthermore, the dynamic assessment added significantly to the prediction of the overall variance in students' response to intervention and to the correct early classification of students as poor or good responders. Conclusions The results suggest that an acceptable level of prediction of students' response to morphological vocabulary intervention can be obtained by means of a couple of static morphological measures. This study also provides evidence for the added predictive value of a dynamic assessment of morphological analysis.

Cognitive Assessment of Children Who Are Deafblind: Perspectives and Suggestions for Assessments

The overall goal of a cognitive assessment is to improve communication, learning, and quality of life for a child who is deafblind. This article will give a brief description and perspective on different evaluation approaches as a basis for reliable cognitive assessments and offer suggestions on how to improve the quality of a cognitive assessment in our clinical practice. The assessor should be aware of the limitations of norm-referenced tests if standardized normative measures are applied to evaluate the cognitive functions of a child who is deafblind. However, if engaging a child with deafblindness in a standardized normative assessment, special considerations and assessment concessions would be required. Furthermore, key issues on how to improve the quality of a cognitive assessment by affording multiple assessment pathways for cognitive assessments will be addressed. Particular attention is given to the following assessment approaches: multi-method, multi-informant assessment, ecological assessment, and dynamic assessment. The use of multiple assessment pathways is necessary to reveal the genuine cognitive abilities and potentials of a child with deafblindness.

Developing and using hints in computerized dynamic assessment of a TOEFL iBT reading exam

This study investigated the impacts of computerized dynamic assessment (C-DA) on a TOEFL iBT reading exam among 185 upper-intermediate EFL Iranian learners. The exam included five question types: Vocabulary, detail, negative fact, purpose, and inference items whose answers yielded three types of scores: Actual, mediated, and learning potential. Results indicated statistically significant differences between actual and mediated scores with various reading ability levels in using hints in the question types. Even though C-DA improved the scores in the mediated test items and resulted in significant correlations, there was no empirical evidence that C-DA was conducive to a comprehensive diagnosis of the ability in the Zone of Actual Development (ZAD). The study had direct pedagogical and methodological implications by suggesting more individualized and, accordingly, more effective mediation to learners, such as the interactionist approach.

Progression and individual differences in children's series completion after dynamic testing

Background

The need to focus more on children's abilities to change requires new assessment technologies in education. Process‐oriented assessment can be useful in this regard. Dynamic testing has the potential to provide in‐depth information about children's learning processes and cognitive abilities.

Aim

This study implemented a process‐oriented dynamic testing procedure to obtain information regarding children's changes in series‐completion skills in a computerised test setting. We studied whether children who received a graduated prompts training would show more progression in series‐completion than children who received no training, and whether trained children would use more advanced explanations of their solutions than their untrained peers.

Sample

Participants were 164 second‐grade children with a mean age of 7;11 years. Children were split into an unguided practice or a dynamic testing condition.

Methods

The study employed a pre‐test‐training‐post‐test design. Half of the children were trained in series‐completion, and the other half did not receive any feedback on their problem solving. Using item response theory analysis, we inspected the progression paths of the children in the two conditions.

Results and conclusions

Children who received training showed more progression in their series‐completion skills than the children who received no training. In addition, the trained children explained their solutions in a more advanced manner, when compared with the non‐trained control group. This information is valuable for educational practice as it provides a better understanding of how learning occurs and which factors contribute to cognitive changes.

Dynamic Assessment for Identifying Spanish-Speaking English Learners' Risk for Mathematics Disabilities: Does Language of Administration Matter?

We examined dynamic assessment's (DA's) added value over traditional assessments for identifying Spanish-speaking English learners' (ELs) risk for developing mathematics disabilities, as a function of the language of test administration (English vs. Spanish), type of math outcome, and EL's language dominance. At the start of first grade, ELs (N = 368) were randomly assigned to English-DA or Spanish-DA conditions, were assessed on static mathematics measures and domain-general (language, reasoning) measures in English, and completed DA in their assigned language condition. At year's end, they were assessed on calculation and word-problem solving outcomes in English. Results from multigroup path models indicated that Spanish-DA mitigates the impact of ELs' language dominance on DA performance. Moreover, ELs' language dominance moderated DA's predictive validity differentially depending on DA language and type of outcome. Spanish-DA showed higher predictive validity in Spanish-dominant ELs than English-dominant ELs when predicting calculations but not word-problem solving. English-DA was predictive for both outcomes, regardless of ELs' language dominance.

Understanding, educating, and supporting children with specific learning disabilities: 50 years of science and practice

Specific learning disabilities (SLDs) are highly relevant to the science and practice of psychology, both historically and currently, exemplifying the integration of interdisciplinary approaches to human conditions. They can be manifested as primary conditions-as difficulties in acquiring specific academic skills-or as secondary conditions, comorbid to other developmental disorders such as attention-deficit hyperactivity disorder. In this synthesis of historical and contemporary trends in research and practice, we mark the 50th anniversary of the recognition of SLDs as a disability in the United States. Specifically, we address the manifestations, occurrence, identification, comorbidity, etiology, and treatment of SLDs, emphasizing the integration of information from the interdisciplinary fields of psychology, education, psychiatry, genetics, and cognitive neuroscience. SLDs, exemplified here by specific word reading, reading comprehension, mathematics, and written expression disabilities, represent spectrum disorders, each occurring in approximately 5% to 15% of the school-aged population. In addition to risk for academic deficiencies and related functional social, emotional, and behavioral difficulties, those with SLDs often have poorer long-term social and vocational outcomes. Given the high rate of occurrence of SLDs and their lifelong negative impact on functioning if not treated, it is important to establish and maintain effective prevention, surveillance, and treatment systems involving professionals from various disciplines trained to minimize the risk and maximize the protective factors for SLDs. (PsycINFO Database Record (c) 2020 APA, all rights reserved).

Consequential differences in perspectives and practices concerning children with developmental language disorders: an integrative review

BACKGROUND

Inter-professional collaboration (IPC) has been recommended for many years as a means by which the needs of children with developmental language disorders (DLD) can be met at school. However, effective IPC remains difficult to achieve and our knowledge of how to support it is limited. A shared understanding between those involved has been identified as critical to IPC.

AIMS

To examine the literature, as one source of data, for evidence of a shared understanding between the fields of speech and language therapy (SLT) and education about children with DLD and how such needs can best be met at school.

METHODS & PROCEDURES

An integrative review of the literature was undertaken. A systematic search of the published, peer-reviewed literature (between 2006 and 2016) was conducted for empirical and theoretical papers and a manual search was undertaken to obtain a representative sample of policy/professional guidelines. A total of 81 papers across SLT and education were included in the review. The papers were scrutinized using a qualitative content analysis.

MAIN CONTRIBUTION

Although some commonality between perspectives in the literature was identified, differences between the fields dominated. These differences related to how DLD is conceptualized; how children's needs are assessed; which outcomes are prioritized and how best these outcomes can be achieved. We also found differences about what constitutes useful knowledge to guide practice. We suggest that the nature of the differences we identified in the literature may have negative implications for practitioners wishing to collaborate to meet the needs of children with DLD in school. The perspectives of practising SLTs and teachers need to be sought to determine whether the findings from the literature reflect dilemmas in practice.

CONCLUSIONS

Effective IPC is essential to meet the needs of children with DLD in school; yet, it remains difficult to achieve. Our review of the literature across SLT and education indicates evidence of a lack of shared understanding about DLD. If these differences are also evident in practice, then a conceptual model to support IPC may be warranted.

Investigating Primary School Children's Creative Potential Through Dynamic Assessment

This paper focused on examining primary school students' creative potential (CP) through dynamic assessment (DA). The study was carried out through a quasi-experimental design. The sample consisted of 90 Greek primary school students between fourth and sixth grade who were randomly divided into a group that received DA (N = 37) and a control group (N = 53). Both groups were initially tested with the graphic-artistic form of the Evaluation of Potential Creativity (EPoC) test. The DA group received mediation with graduated prompting while no such treatment was applied to the control group, and both groups were post-tested. The results demonstrated that mediation significantly improved DA group's CP. It appeared that DA contributes in demonstrating a clearer portrait of students' CP which can be of valuable assistance for nurturing creativity.

An Embodied Tutoring System for Literal vs. Metaphorical Concepts

In this paper we combine motion captured data with linguistic notions (preliminary study) in a game-like tutoring system (study 1), in order to help elementary school students to better differentiate literal from metaphorical uses of motion verbs, based on embodied information. In addition to the thematic goal, we intend to improve young students' attention and spatiotemporal memory, by presenting sensorimotor data experimentally collected from thirty two participants in our motion capturing labs. Furthermore, we examine the accomplishment of tutor's goals and compare them to curriculum's approach (study 2). Sixty nine elementary school students were randomly divided in two experimental groups (game-like and traditional) and one control group, which did not undergo an intervention. All groups were tested in pre and post-tests. Even though the diagnostic pretests present a uniform picture, two way analysis of variance suggests that the experimental groups showed progress in post-tests and, more specifically, game-like group showed less wrong answers in the linguistics task and higher learning achievements compared to the other two groups. Furthermore, in the game-like condition the participants needed gradually shorter period of time to identify the avatar's actions. This finding was considered as a first indication of attentional and spatiotemporal memory's improvement, while the tutor's assistance features cultivated students' metacognitive perception.

Predicting Reading Problems 6 Years Into the Future: Dynamic Assessment Reduces Bias and Increases Classification Accuracy

Purpose

The purpose of this study was to examine how well a kindergarten dynamic assessment of decoding predicts future reading difficulty at 2nd, 3rd, 4th, and 5th grade and to determine whether the dynamic assessment improves the predictive validity of traditional static kindergarten reading measures.

Method

With a small variation in sample size by grade, approximately 370 Caucasian and Hispanic students were administered a 3-min dynamic assessment of decoding and static measures of letter identification and phonemic awareness at the beginning of kindergarten. Oral reading fluency was then assessed at the end of Grades 2–5. In this prospective, longitudinal study, predictive validity was estimated for the Caucasian and Hispanic students by examining the amount of variance the static and dynamic assessments explained and by referring to area under the curve and sensitivity and specificity values.

Results

The dynamic assessment accounted for variance in reading ability over and above the static measures, with fair to good area under the curve values and sensitivity and specificity. Classification accuracy worsened when the static measures were included as predictor measures. The results of this study indicate that a very brief dynamic assessment can predict with approximately 75%–80% accuracy, which kindergarten students will have difficulty in learning to decode up to 6 years into the future.

Conclusions

Dynamic assessment of decoding is a promising approach to identifying future reading difficulty of young kindergarten students, mitigating the cultural and linguistic bias found in traditional static early reading measures.

Integrating Curriculum-Based Dynamic Assessment in Computerized Adaptive Testing: Development and Predictive Validity of the EDPL-BAI Battery on Reading Competence

In recent decades there have been significant changes in the conceptualization of reading as well as in the perception of how this activity should be assessed. Interest in the analysis of reading processes has led to the emergence of new explanatory models based primarily on the contributions of cognitive psychology. In parallel, there have been notable advances in measurement procedures, especially in models based on Item Response Theory (IRT), as well as in the capacity and performance of specific software programs that allow data to be managed and analyzed. These changes have contributed significantly to the rise of testing procedures such as computerized adaptive tests (CATs), whose fundamental characteristic is that the sequence of items presented in the tests is adapted to the level of competence that the subject manifests. Likewise, the incorporation of elements of dynamic assessment (DA) as the prompts are gradually offered allows for obtaining information about the type and degree of support required to optimize the subject’s performance. In this sense, the confluence of contributions from DA and CATs offers a new possibility for approaching the assessment of learning processes. In this article, we present a longitudinal research developed in two phases, through which a computerized dynamic adaptive assessment battery of reading processes (EDPL-BAI) was configured. The research frame involved 1,831 students (46% girls) from 13 public schools in three regions of Chile. The purpose of this study was to analyze the differential contribution on reading competence of dynamic scores obtained in a subsample composed of 324 (47% girls) students from third to sixth grade after the implementation of a set of adaptive dynamic tests of morpho-syntactic processes. The results achieved in the structural equation modeling indicate a good global fit. Individual relationships show a significant contribution of calibrated score that reflects estimated knowledge level on reading competence, as well as dynamic scores based on the assigned value of graduated prompts required by the students. These results showed significant predictive values on reading competence and incremental validity in relation to predictions made by static criterion tests.

Predicting reading disabilities using dynamic assessment of decoding before and after the onset of reading instruction: a longitudinal study from kindergarten through grade 2

The present study examined the predictive validity of a dynamic test of decoding in which participants are taught three novel letters and how to synthesize the corresponding letter sounds into new words. One version of this dynamic test was administered to 158 kindergarten children before the onset of formal reading instruction along with traditional predictors of reading. Similarly, a parallel version of the dynamic test was administered to the same children after a few months of formal reading instruction. At the end of grade 2, the children were assessed on outcome measures of reading and categorized as having disabilities with either accuracy or fluency measures. Administered before as well as after the onset of formal reading instruction, the dynamic test of decoding contributed uniquely to the prediction of difficulties with reading accuracy at the end of grade 2 after control for traditional predictors of reading. Difficulties with reading fluency were also predicted by the dynamic decoding test, but the unique prediction value was more limited. This study showed that a dynamic assessment of decoding can be a useful addition to traditional test batteries for early identification of children at risk for reading disabilities. Even when taken before formal reading instruction, a combination of the dynamic assessment and two traditional measures (letter knowledge and rapid automatized naming) yielded a very high prediction accuracy of reading difficulties at the end of grade 2.

Response-To-Intervention in Finland and the United States: Mathematics Learning Support as an Example

Response to Intervention (RTI) was accepted in the early 2000s as a new framework for identifying learning difficulties (LD) in the U.S. In Finland, a similar multi-tiered framework has existed since 2010. In the present study, these frameworks are presented from the viewpoint of the role of assessment and instruction as expressed in documents that describe the frameworks, as it seems that these two components of RTI are the most disparate between the U.S. and Finland. We present a suggestion for the Finnish framework as an example of support in mathematics learning that incorporates principles of RTI (such as systematized assessment and instruction, cyclic support, and modifiable instruction). Finally, recommendations are presented for further refining and developing assessment and instruction policies in the two countries.

Predicting Response to Treatment in a Tier 2 Supplemental Vocabulary Intervention

PURPOSE

To effectively implement a response to intervention approach, there is a need for timely and specific information about student learning in response to treatment to ensure that treatment decisions are appropriate. This exploratory study examined responsivity to a supplemental, Tier 2 vocabulary intervention delivered to preschool children with limited language abilities.

METHOD

A secondary analysis of a cluster-randomized trial of a supplemental vocabulary intervention was conducted. Responsivity (e.g., adequate learning) to the intervention was examined, and learning in the 1st few weeks of intervention was evaluated as a possible predictor of response to intervention.

RESULTS

Using a criterion of learning of 20% of target vocabulary, nearly one third of participants were identified as poor responders. A 1st unit benchmark was identified that maximized the sensitivity to identification of children who were likely to respond to the intervention.

CONCLUSIONS

Even for generally effective interventions, there is likely to be a substantial proportion of children who are not responsive. Learning in the 1st few weeks of intervention may be a useful indicator of appropriate response to treatment and could inform instructional decisions.

Development of a sickle cell disease readiness for transition assessment

BACKGROUND

Instrumentation with established reliability and validity is not yet routinely utilized to assess readiness for transition from pediatric to adult care for youth and young adults with chronic conditions, including sickle cell disease (SCD).

OBJECTIVE

The aim of this study was to develop a SCD specific readiness for transition assessment tool.

SUBJECTS

Fifty-seven youths with SCD, ages 15-21 years, completed the initial version of the Transition Intervention Program - Readiness for Transition (TIP-RFT) assessment; 113 youths/young adults with SCD, ages 14-26 years, at two distinct sites of care completed a refined version of the TIP-RFT.

METHODS

The TIP-RFT was constructed based on a literature review, provider and patient consensus and assessed domains including knowledge and skills in medical self-care, social support, health benefits and independent living and educational/vocational skills. We used principal components factor analysis to evaluate TIP-RFT responses and assessed differences in TIP-RFT scores in relation to age, gender, sickle cell diagnosis and site of care.

RESULTS

The original TIP-RFT, which had demonstrated face validity, was reduced from 56 to 22 items. The revised instrument consisting of four subscales demonstrated good internal consistency reliability and construct validity.

CONCLUSION

Our results support that the TIP-RFT is a valid and reliable tool for the assessment of transition readiness for youths with SCD. The TIP-RFT assessment can guide interventions to improve transition readiness and can provide a foundation for future research on other variables that might be associated with transition readiness.

Development of First-Graders' Word Reading Skills: For Whom Can Dynamic Assessment Tell Us More?

Dynamic assessment (DA) of word reading measures learning potential for early reading development by documenting the amount of assistance needed to learn how to read words with unfamiliar orthography. We examined the additive value of DA for predicting first-grade decoding and word recognition development while controlling for autoregressive effects. Additionally, we examined whether predictive validity of DA would be higher for students who have poor phonological awareness skills. First-grade students (n = 105) were assessed on measures of word reading, phonological awareness, rapid automatized naming, and DA in the fall and again assessed on word reading measures in the spring. A series of planned, moderated multiple regression analyses indicated that DA made a significant and unique contribution in predicting word recognition development above and beyond the autoregressor, particularly for students with poor phonological awareness skills. For these students, DA explained 3.5% of the unique variance in end-of-first-grade word recognition that was not attributable to autoregressive effect. Results suggest that DA provides an important source of individual differences in the development of word recognition skills that cannot be fully captured by merely assessing the present level of reading skills through traditional static assessment, particularly for students at risk for developing reading disabilities.

Progression paths in children's problem solving: The influence of dynamic testing, initial variability, and working memory

The current study investigated developmental trajectories of analogical reasoning performance of 104 7- and 8-year-old children. We employed a microgenetic research method and multilevel analysis to examine the influence of several background variables and experimental treatment on the children's developmental trajectories. Our participants were divided into two treatment groups: repeated practice alone and repeated practice with training. Each child received an initial working memory assessment and was subsequently asked to solve figural analogies on each of several sessions. We examined children's analogical problem-solving behavior and their subsequent verbal accounts of their employed solving processes. We also investigated the influence of verbal and visual-spatial working memory capacity and initial variability in strategy use on analogical reasoning development. Results indicated that children in both treatment groups improved but that gains were greater for those who had received training. Training also reduced the influence of children's initial variability in the use of analogical strategies with the degree of improvement in reasoning largely unrelated to working memory capacity. Findings from this study demonstrate the value of a microgenetic research method and the use of multilevel analysis to examine inter- and intra-individual change in problem-solving processes.

Early Identification of Reading Comprehension Difficulties

Most research on early identification of reading disabilities has focused on word reading problems and little attention has been given to reading comprehension difficulties. In this study, we investigated whether measures of language ability and/or response to language intervention in kindergarten uniquely predicted reading comprehension difficulties in third grade. A total of 366 children were administered a battery of screening measures at the beginning of kindergarten and progress monitoring probes across the school year. A subset of children also received a 26-week Tier 2 language intervention. Participants' achievement in word reading was assessed at the end of second grade, and their performance in reading comprehension was measured as the end of third grade. Results showed that measures of language ability in kindergarten significantly added to the prediction of reading comprehension difficulties over and above kindergarten word reading predictors and direct measures of word reading in second grade. Response to language intervention also proved to be a unique predictor of reading comprehension outcomes. Findings are discussed in terms of their relevance for the early identification of reading disabilities.

Does a Dynamic Test of Phonological Awareness Predict Early Reading Difficulties?

A few studies have indicated that dynamic measures of phonological awareness may contribute uniquely to the prediction of early reading development. However, standard control measures have been few and limited by floor effects, thus limiting their predictive value. The purpose of the present study was to examine the predictive value of a dynamic test of phonological awareness while controlling for both letter knowledge and standard phonological awareness using measures with no floor effect. We administered a dynamic test of phonological awareness along with traditional tests of phonological awareness and letter knowledge to 160 children in the fall of kindergarten. Reading outcomes were studied at three test points: at the end of kindergarten, in the first half of Grade 1, and at the end of Grade 1. The results indicated that the dynamic test of phonological awareness contributed significantly to the prediction of children's reading development in kindergarten and the first half of Grade 1 after control for static phonological awareness and letter knowledge. However, the unique prediction value of the dynamic test of phonological awareness did not extend to the end of Grade 1.

Dynamic Testing of Analogical Reasoning in 5- to 6-Year-Olds

Multiple-choice (MC) analogy items are often used in cognitive assessment. However, in dynamic testing, where the aim is to provide insight into potential for learning and the learning process, constructed-response (CR) items may be of benefit. This study investigated whether training with CR or MC items leads to differences in the strategy progression and understanding of analogical reasoning in 5- to 6-year-olds ( N = 111). A pretest-training-posttest control group design with randomized blocking was utilized, where two experimental groups were trained according to the graduated prompts method. Results show that both training conditions improved more during dynamic testing compared with untrained controls. As expected, children in the CR condition required more prompting during training and showed different strategy-use patterns compared with the MC group. However, the quality of solution explanations was significantly better for children in the CR condition. It appears that possible performance advantages of training with CR items are most apparent when active processing is required. In the future, we advise including items such as CR or analogy construction in dynamic testing that allow for fine-grained analysis of strategy-use to further discern differences in children’s analogical reasoning understanding.

CATALISE: A Multinational and Multidisciplinary Delphi Consensus Study. Identifying Language Impairments in Children

Delayed or impaired language development is a common developmental concern, yet there is little agreement about the criteria used to identify and classify language impairments in children. Children's language difficulties are at the interface between education, medicine and the allied professions, who may all adopt different approaches to conceptualising them. Our goal in this study was to use an online Delphi technique to see whether it was possible to achieve consensus among professionals on appropriate criteria for identifying children who might benefit from specialist services. We recruited a panel of 59 experts representing ten disciplines (including education, psychology, speech-language therapy/pathology, paediatrics and child psychiatry) from English-speaking countries (Australia, Canada, Ireland, New Zealand, United Kingdom and USA). The starting point for round 1 was a set of 46 statements based on articles and commentaries in a special issue of a journal focusing on this topic. Panel members rated each statement for both relevance and validity on a seven-point scale, and added free text comments. These responses were synthesised by the first two authors, who then removed, combined or modified items with a view to improving consensus. The resulting set of statements was returned to the panel for a second evaluation (round 2). Consensus (percentage reporting 'agree' or 'strongly agree') was at least 80 percent for 24 of 27 round 2 statements, though many respondents qualified their response with written comments. These were again synthesised by the first two authors. The resulting consensus statement is reported here, with additional summary of relevant evidence, and a concluding commentary on residual disagreements and gaps in the evidence base.

CATALISE: A Multinational and Multidisciplinary Delphi Consensus Study. Identifying Language Impairments in Children

Delayed or impaired language development is a common developmental concern, yet there is little agreement about the criteria used to identify and classify language impairments in children. Children's language difficulties are at the interface between education, medicine and the allied professions, who may all adopt different approaches to conceptualising them. Our goal in this study was to use an online Delphi technique to see whether it was possible to achieve consensus among professionals on appropriate criteria for identifying children who might benefit from specialist services. We recruited a panel of 59 experts representing ten disciplines (including education, psychology, speech-language therapy/pathology, paediatrics and child psychiatry) from English-speaking countries (Australia, Canada, Ireland, New Zealand, United Kingdom and USA). The starting point for round 1 was a set of 46 statements based on articles and commentaries in a special issue of a journal focusing on this topic. Panel members rated each statement for both relevance and validity on a seven-point scale, and added free text comments. These responses were synthesised by the first two authors, who then removed, combined or modified items with a view to improving consensus. The resulting set of statements was returned to the panel for a second evaluation (round 2). Consensus (percentage reporting 'agree' or 'strongly agree') was at least 80 percent for 24 of 27 round 2 statements, though many respondents qualified their response with written comments. These were again synthesised by the first two authors. The resulting consensus statement is reported here, with additional summary of relevant evidence, and a concluding commentary on residual disagreements and gaps in the evidence base.

Role of learning potential in cognitive remediation: Construct and predictive validity

BACKGROUND

The construct, convergent, discriminant, and predictive validity of Learning Potential (LP) was evaluated in a trial of cognitive remediation for adults with schizophrenia-spectrum disorders. LP utilizes a dynamic assessment approach to prospectively estimate an individual's learning capacity if provided the opportunity for specific related learning.

METHODS

LP was assessed in 75 participants at study entry, of whom 41 completed an eight-week cognitive remediation (CR) intervention, and 22 received treatment-as-usual (TAU). LP was assessed in a "test-train-test" verbal learning paradigm. Incremental predictive validity was assessed as the degree to which LP predicted memory skill acquisition above and beyond prediction by static verbal learning ability.

RESULTS

Examination of construct validity confirmed that LP scores reflected use of trained semantic clustering strategy. LP scores correlated with executive functioning and education history, but not other demographics or symptom severity. Following the eight-week active phase, TAU evidenced little substantial change in skill acquisition outcomes, which related to static baseline verbal learning ability but not LP. For the CR group, LP significantly predicted skill acquisition in domains of verbal and visuospatial memory, but not auditory working memory. Furthermore, LP predicted skill acquisition incrementally beyond relevant background characteristics, symptoms, and neurocognitive abilities.

CONCLUSIONS

Results suggest that LP assessment can significantly improve prediction of specific skill acquisition with cognitive training, particularly for the domain assessed, and thereby may prove useful in individualization of treatment.

Gifted and Average-Ability Children’s Progression in Analogical Reasoning in a Dynamic Testing Setting

This study sought to provide more insight into potential differences in progression of analogical reasoning comparing gifted with average-ability children taking into account age, using a dynamic testing approach, using graduated prompting techniques, in combination with microgenetic methods. The participants were between the ages of 5 and 8 years old and were divided into 4 subgroups: gifted unguided control (n = 37), gifted dynamic training (n = 41), average-ability unguided control (n = 95), and average-ability dynamic training (n = 93). We predicted that gifted and average-ability children would show differential progression in analogical reasoning, benefit differentially from a dynamic training procedure, and would show differential instructional needs. The two “ability categories” (i.e., gifted vs. average-ability) were found to show similar, rather than differential, progression paths, and to benefit from a training procedure, whereas gifted children outperform their average-ability peers in accuracy at each session. Likewise, no differences in need for instruction were found among these two groups. In general, moreover, younger children seemed to have lower accuracy scores, progress less, and need more help than older children. Implications of these findings for the research field of giftedness as well as for education of the gifted and talented are considered in the discussion.

Tier 2 Language Intervention for Diverse Preschoolers: An Early-Stage Randomized Control Group Study Following an Analysis of Response to Intervention

PURPOSE

The first purpose of this study was to explore the use of a whole class, test-teach-test, dynamic assessment of narratives for identifying participants. The second purpose was to examine the efficacy of a Tier 2 narrative language intervention for culturally and linguistically diverse preschoolers.

METHOD

A dynamic assessment was conducted with students from 3 Head Start classrooms. On the basis of the results of the dynamic assessment, 22 children were randomly assigned to treatment (n = 12) and control (n = 10) groups for intervention. Participants received a small-group (4:1), differentiated, narrative intervention for 15-20 min, twice a week, for 9 weeks. Interventionists used weekly progress monitoring data to explicitly focus on individualized narrative and linguistic targets.

RESULTS

The treatment group showed significant improvement over the control group on proximal and distal measures of narrative retells, with large effect sizes. Group differences on a measure of children's language in the context of personal stories were not statistically significant.

CONCLUSIONS

This early-stage study provides evidence that narrative language intervention is an effective approach to improving the language skills of preschoolers with diverse language needs. Furthermore, the evidence supports the use of dynamic assessment for reducing overidentification and identifying candidates for small-group language intervention.

The Effect of Dynamic Testing With Electronic Prompts and Scaffolds on Children’s Inductive Reasoning: A Microgenetic Study

The study aimed to gain insight into children’s variability in inductive reasoning problem-solving strategies. Visual–spatial series completion tasks were employed that drew on the novel use of electronic tangibles. Two approaches were contrasted: repeated practice alone and repeated practice with the addition of dynamic training. Participants were 38 children aged 6–9 years, who were allocated to 1 of 2 treatment conditions. In condition one, children had opportunities for repeated practice on 4 sessions. The children in the second condition received the same repeated practice sessions but, in addition, were also provided with training. Transfer of learning was measured before and after the practice and training sessions. During the sessions, the children were presented with series completion tasks using tangible objects, each time with a 1–week interval. In comparison with the repeated practice alone condition, the children with additional training showed significantly greater gains in performance (accuracy and efficiency). Findings clearly showed inter- and intravariability in children’s use of problem-solving strategies, which decreased after training. There was evidence of transfer of inductive reasoning from the original series completion task (using concrete, discrete elements) to a series completion task with numbers and geometric forms. In summary, this study revealed individual differences and variability in the sorts of help required, (more) stable progression of these results, and the child’s ability to transfer learning to novel tasks and situations.