Assessing Consistency in Single-Case Data Features Using Modified Brinley Plots

Cognitive Orientation to daily Occupational Performance to improve occupational performance goals for children with executive function deficits after acquired brain injury

AIM

To determine the effectiveness of the Cognitive Orientation to daily Occupational Performance (CO-OP) approach in improving the occupational performance goals of children and young people with executive function deficits after acquired brain injury (ABI) (e.g. etiologies such as stroke, encephalitis, brain tumor, and traumatic brain injury).

METHOD

A replicated single-case experimental study using a randomized multiple baseline design across participants and goals was used. Three clusters of four participants (12 participants, nine males and three females, aged 8-16 years) were included. The intervention consisted of 14 individual CO-OP sessions. Each participant chose four goals; three goals were trained during the intervention sessions and a fourth goal served as the control. The Goal Attainment Scale (GAS) was used as a repeated measure to determine goal achievement while the Canadian Occupational Performance Measure (COPM) was used to identify the perceived goal achievement of children, young people, and their parents.

RESULTS

For 26 of the 35 trained goals, the intervention led to statistically significant improvements in the GAS. Perceived occupational performance and satisfaction improved significantly for the trained goals (30 out of 35 goals for the COPM performance and satisfaction of participants; 26 out 31 goals for the COPM performance of parents; 24 out of 31 goals for the COPM satisfaction of parents) and were maintained at the follow-up. Almost all COPM control goal results were significant, but these changes were not supported by the GAS measures or the statistical analysis.

INTERPRETATION

The generally positive results of this study provide evidence of the benefits of using the CO-OP approach with this population.

Defining and assessing immediacy in single-case experimental designs

Immediacy is one of six data aspects (alongside level, trend, variability, overlap, and consistency) that has to be accounted for when visually analyzing single-case data. Given that it is one of the aspects that has received considerably less attention than other data aspects, the current text offers a review of the proposed conceptual definitions of immediacy (i.e., what it refers to) and also of the suggested operational definitions (i.e., how exactly is it assessed and/or quantified). Provided that a variety of conceptual and operational definitions is identified, we propose following a sensitivity analysis using a randomization test for assessing immediate effects in single-case experimental designs, by identifying when changes were most clear. In such a sensitivity analysis, the immediate effects are tested for multiple possible intervention points and for different possible operational definitions. Robust immediate effects can be detected if the results for the different operational definitions converge.

Violin plots as visual tools in the meta-analysis of Single-Case Experimental Designs

Despite the existence of sophisticated statistical methods, systematic reviews regularly indicate that single-case experimental designs (SCEDs) are predominantly analyzed through visual tools. For the quantitative aggregation of results, different meta-analytical techniques are available, but specific visual tools for the meta-analysis of SCEDs are lacking. The present article therefore describes the use of violin plots as visual tools to represent the raw data. We first describe the underlying rationale of violin plots and their main characteristics. We then show how the violin plots can complement the statistics obtained in a quantitative meta-analysis. The main advantages of violin plots as visual tools in meta-analysis are (a) that they preserve information about the raw data from each study, (b) that they have the ability to visually represent data from different designs in one graph, and (c) that they enable the comparison of score distributions from different experimental phases from different studies.

A proposal for the assessment of replication of effects in single-case experimental designs

In science in general and in the context of single‐case experimental designs, replication of the effects of the intervention within and/or across participants or experiments is crucial for establishing causality and for assessing the generality of the intervention effect. Specific developments and proposals for assessing whether an effect has been replicated or not (or to what extent) are scarce, in the general context of behavioral sciences, and practically null in the single‐case experimental designs context. We propose an extension of the modified Brinley plot for assessing how many of the effects replicate. To make this assessment possible, a definition of replication is suggested, on the basis of expert judgment, rather than on statistical criteria. The definition of replication and its graphical representation are justified, presenting their strengths and limitations, and illustrated with real data. A user‐friendly software is made available for obtaining automatically the graphical representation.