Assessing Intervention Effects in the Presence of Missing Scores

A Description of Missing Data in Single-Case Experimental Designs Studies and an Evaluation of Single Imputation Methods

Missing data is inevitable in single-case experimental designs (SCEDs) studies due to repeated measures over a period of time. Despite this fact, SCEDs implementers such as researchers, teachers, clinicians, and school psychologists usually ignore missing data in their studies. Performing analyses without considering missing data in an intervention study using SCEDs or a meta-analysis study including SCEDs studies in a topic can lead to biased results and affect the validity of individual or overall results. In addition, missingness can undermine the generalizability of SCEDs studies. Considering these drawbacks, this study aims to give descriptive and advisory information to SCEDs practitioners and researchers about missing data in single-case data. To accomplish this task, the study presents information about missing data mechanisms, item level and unit level missing data, planned missing data designs, drawbacks of ignoring missing data in SCEDs, and missing data handling methods. Since single imputation methods among missing data handling methods do not require complicated statistical knowledge, are easy to use, and hence are more likely to be used by practitioners and researchers, the present study evaluates single imputation methods in terms of intervention effect sizes and missing data rates by using a real and hypothetical data sample. This study encourages SCEDs implementers, and also meta-analysts to use some of the single imputation methods to increase the generalizability and validity of the study results in case they encounter missing data in their studies.

How to assess and take into account trend in single-case experimental design data

One of the data features that are expected to be assessed when analyzing single-case experimental designs (SCED) data is trend. The current text deals with four different questions that applied researchers can ask themselves when assessing trend and especially when dealing with improving baseline trend: (a) What options exist for assessing the presence of trend?; (b) Once assessed, what criterion can be followed for deciding whether it is necessary to control for baseline trend?; (c) What strategy can be followed for controlling for baseline trend?; and (d) How to proceed in case there is baseline trend only in some A-B comparisons? Several options are reviewed for each of these questions in the context of real data, and tentative recommendations are provided. A new user-friendly website is developed to implement the options for fitting a trend line and a criterion for selecting a specific technique for that purpose. Trend-related and more general data analytical recommendations are provided for applied researchers.Trial registration: ClinicalTrials.gov identifier: NCT04560777.

Cognitive Orientation to daily Occupational Performance to improve occupational performance goals for children with executive function deficits after acquired brain injury

AIM

To determine the effectiveness of the Cognitive Orientation to daily Occupational Performance (CO-OP) approach in improving the occupational performance goals of children and young people with executive function deficits after acquired brain injury (ABI) (e.g. etiologies such as stroke, encephalitis, brain tumor, and traumatic brain injury).

METHOD

A replicated single-case experimental study using a randomized multiple baseline design across participants and goals was used. Three clusters of four participants (12 participants, nine males and three females, aged 8-16 years) were included. The intervention consisted of 14 individual CO-OP sessions. Each participant chose four goals; three goals were trained during the intervention sessions and a fourth goal served as the control. The Goal Attainment Scale (GAS) was used as a repeated measure to determine goal achievement while the Canadian Occupational Performance Measure (COPM) was used to identify the perceived goal achievement of children, young people, and their parents.

RESULTS

For 26 of the 35 trained goals, the intervention led to statistically significant improvements in the GAS. Perceived occupational performance and satisfaction improved significantly for the trained goals (30 out of 35 goals for the COPM performance and satisfaction of participants; 26 out 31 goals for the COPM performance of parents; 24 out of 31 goals for the COPM satisfaction of parents) and were maintained at the follow-up. Almost all COPM control goal results were significant, but these changes were not supported by the GAS measures or the statistical analysis.

INTERPRETATION

The generally positive results of this study provide evidence of the benefits of using the CO-OP approach with this population.

Characteristics of Missing Data in Single-Case Experimental Designs: An Investigation of Published Data

Single-case experimental designs (SCEDs) have grown in popularity in the fields such as education, psychology, medicine, and rehabilitation. Although SCEDs are valid experimental designs for determining evidence-based practices, they encounter some challenges in analyses of data. One of these challenges, missing data, is likely to be occurred frequently in SCEDs research due to repeated measurements over time. Since missing data is a critical factor that can weaken the validity and generalizability of a study, it is important to determine the characteristics of missing data in SCEDs, which are especially conducted with a small number of participants. In this regard, this study aimed to describe missing data features in SCEDs studies in detail. To accomplish this goal, 465 published SCEDs studies within the recent 5 years in six journals were included in the investigation. The overall results showed that the prevalence of missing data among SCEDs articles in at least one phase, as at least one data point, was approximately 30%. In addition, the results indicated that the missing data rates were above 10% within most studies where missing data occurred. Although missing data is so common in SCEDs research, only a handful of studies (5%) have handled missing data; however, their methods are traditional. In analyzing SCEDs data, several methods are proposed considering missing data ratios in the literature. Therefore, missing data rates determined in this study results can shed light on the analyses of SCEDs data with proper methods by improving the validity and generalizability of study results.

The unified protocol for transdiagnostic treatment of emotional disorders for misophonia: a pilot trial exploring acceptability and efficacy

Introduction

Misophonia is a recently defined disorder characterized by distressing responses to everyday sounds, such as chewing or sniffling. Individuals with misophonia experience significant functional impairment but have limited options for evidenced-based behavioral treatment. To address this gap in the literature, the current pilot trial explored the acceptability and efficacy of a transdiagnostic cognitive-behavioral approach to treating symptoms of misophonia.

Methods

This trial was conducted in two studies: In Study 1, the Unified Protocol for Transdiagnostic Treatment of Emotional Disorders (UP) was delivered to eight patients in order to receive feedback to guide revisions to the treatment to suit this population. In Study 2, ten patients received the revised UP treatment to explore its acceptability and preliminary efficacy. This study used a single-case experimental design with multiple baselines, randomizing patients to either a 2-week baseline or 4-week baseline prior to the 16 weeks of treatment, followed by four weeks of follow-up.

Results

The findings from these studies suggested that patients found both the original and adapted versions of the UP to be acceptable and taught them skills for how to manage their misophonia symptoms. Importantly, the findings also suggested that the UP can help remediate symptoms of misophonia, particularly the emotional and behavioral responses.

Discussion

These findings provide preliminary evidence that this transdiagnostic treatment for emotional disorders can improve symptoms of misophonia in adults.

Brief and Telehealth Acceptance and Commitment Therapy (ACT) Interventions for Stress in Inflammatory Bowel Disease (IBD): A Series of Single Case Experimental Design (SCED) Studies

Psychological intervention targeting distress is now considered an integral component of inflammatory bowel disease (IBD) management. However, significant barriers to access exist which necessitate the development of effective, economic, and accessible brief and remote interventions. Acceptance and commitment therapy (ACT) is a therapy with demonstrated acceptability and a growing evidence base for the treatment of distress in IBD populations. The present paper trialled two brief ACT interventions via randomized multiple baseline designs. Study 1 trialled a single-session ACT intervention (delivered face-to-face and lasting approximately two hours) targeting stress and experiential avoidance, respectively. Participants were seven people with an IBD diagnosis who presented with moderate to extremely severe stress (five females, two males; M age = 39.57, SD = 5.74). The findings of study 1 indicate that a single-session ACT intervention represented an insufficient dosage to reduce stress and experiential avoidance. Study 2 investigated a brief telehealth ACT intervention (delivered via a video conferencing platform and lasting approximately four hours) targeting stress and increased psychological flexibility. Participants (N = 12 people with an IBD diagnosis and mild to extremely severe stress) completed baselines lasting from 21 to 66 days before receiving a two-session ACT telehealth intervention supplemented by a workbook and phone consultation. Approximately half of participants experienced reduced stress, increased engagement in valued action, and increased functioning. Despite shortcomings such as missing data and the context of COVID-19, the present findings suggest that brief ACT interventions in this population may be effective and economic, though further research and replications are necessary.

A practitioner's guide to conducting and analysing embedded randomized single-case experimental designs

Single-case experimental designs (SCEDs) are a class of experimental designs suited for answering research questions at an individual level. The main designs available in SCED research are phase designs, multiple baseline designs, alternation designs, and changing criterion designs. Embedded designs, also referred to as combination or hybrid designs, consist of one of these basic designs forms embedded in another design (e.g., a changing criterion design embedded in a multiple baseline design). Systematic reviews of SCEDs have repeatedly indicated that embedded designs are frequently used in applied SCED research. In spite of their popularity, specific recommendations on the conduct and analysis of embedded SCED designs are lacking to date. The purpose of the present article is therefore to provide guidance to applied researchers wishing to conduct embedded SCED designs in terms of design options, design requirements, randomization, and data analysis.

Parents matter: Parent acceptance of school-based executive functions interventions relates to improved child outcomes

OBJECTIVES

School-based interventions with parent-training components might improve access among lower-income families to effective help for children with neurodevelopmental disorders. This potential might be realized, however, only if parents perceive the interventions as acceptable and therefore engage with treatment.

METHODS

Parents (N = 124) of 3rd-5th grade students diagnosed with Autism Spectrum Disorder or Attention-Deficit/Hyperactivity Disorder rated the acceptability of their child's treatment (one of two culturally responsive behavioral interventions). Parent engagement was measured through attendance at parent training sessions and the extent to which they read a corresponding workbook.

RESULTS

Education and income correlated inversely with parent perceptions of treatment acceptability. Acceptability correlated positively with engagement, more strongly among lower-income families. Acceptability had an indirect effect on treatment outcome, mediated by parent engagement.

CONCLUSIONS

Treatment providers should focus on strategies to increase parent acceptability, with particular attention to improving access for lower-income families.

Pre-pandemic sleep behavior and adolescents' stress during Covid-19: a prospective longitudinal study

OBJECTIVE

To prospectively document changes in adolescents' sleep before versus during the COVID-19 pandemic, and to examine their impact on adolescents' perceived stress.

METHODS

Sixty-two typically developing adolescents participated in the study before (Time 1: January 15 to March 13, 2020) and during (Time 2: May 15 to June 30, 2020) the COVID-19 pandemic in Canada. At Time 1, each participant's sleep pattern was assessed in the home environment using actigraphy and sleep logs for seven consecutive nights. Adolescents completed a battery of questionnaires in which they reported on their sleep schedule, duration, and quality, as well as their activities at bedtime, their daytime sleepiness, and their social/emotional behavior. The participants' parents provided demographic information. At Time 2, each participant completed a sleep log, the same battery of questionnaires regarding sleep, and the Perceived Stress Scale.

RESULTS

(1) Adolescents' reported sleep was of longer duration and on a delayed schedule during the COVID-19 pandemic compared to pre-pandemic. (2) A larger proportion of adolescents reported meeting or exceeding the recommended amount of sleep during the COVID-19 pandemic compared to pre-pandemic sleep. (3) "Social jet lag" disappeared during the COVID-19 pandemic. (4) A shorter reported sleep duration and higher level of arousal at bedtime at Time 1 were significant predictors of adolescents' perceived stress at Time 2-during the COVID-19 pandemic. (5) A higher levels of arousal at bedtime and lower reported sleep quality at Time 2 were concurrently associated with higher levels of perceived stress among adolescents, even when we controlled for the levels of pre-pandemic emotional or behavioral issues, sleep duration, or sleep quality.

CONCLUSION

Sleep duration and cognitive-emotional arousal, which are both modifiable behaviors, were associated with adolescents' perceived stress during the COVID-19 pandemic. These behaviors could be useful targets for preventive interventions aiming to reduce adolescents' stress in the face of stressogenic situations, such as the COVID-19 pandemic.

Differential Effects of Ethical Education, Physical Hatha Yoga, and Mantra Meditation on Well-Being and Stress in Healthy Participants-An Experimental Single-Case Study

Traditionally, yoga is a multicomponent practice consisting of postures, breathing techniques, meditation, mantras, and ethics. To date, only a few studies have tried to dismantle the effects of each of these components and their combinations. To fill this gap, we examined the incremental effects of ethical education and physical Hatha yoga on mantra meditation using a single-case multiple-baseline design. This study was part of a project evaluating the new mind-body program Meditation-Based Lifestyle Modification. Fifty-seven healthy participants with no regular yoga or meditation practice were randomly assigned to three baselines (7, 14, and 21 days) and four conditions using a random number generator. The conditions were mantra meditation alone (MA), meditation plus physical yoga (MY), meditation plus ethical education (ME), and meditation plus yoga and ethical education (MYE). All the interventions lasted for 8 weeks and were run consecutively according to baseline length. During the baseline and treatment phases, participants received daily questionnaires measuring their well-being (WHO-5 Well-Being Index), stress (Perceived Stress Scale), and subjective experiences. Forty-two participants completed the treatment and were entered in the analyses. We analyzed our data using visual inspection, effect size estimation (Tau-U), and multilevel modeling. Almost all participants showed a longitudinal increase in well-being. Regarding between-group differences, participants who received ethical education exhibited the largest increases in well-being (Tau-U = 0.30/0.23 for ME/MYE), followed by participants in the MY condition (Tau-U = 0.12). Conversely, participants in the MA condition showed no change (Tau-U = 0.07). There was a tendency for the combined treatments to decrease stress. This tendency was strongest in the MY condition (Tau-U = -0.40) and reversed in the MA condition (Tau-U = 0.17). These results emphasize the incremental and differential effects of practicing meditation in combination with other practices from the eight-fold yoga path. This approach is valuable for better understanding the multifaceted practice of yoga. Clinical Trial Registration:www.ClinicalTrials.gov, identifier: NCT04252976.