Dimensionality, hierarchical structure, age generalizability, and criterion validity of the GAIN's Behavioral Complexity Scale

Cross-Cultural Adaptation and Psychometric Properties of the Traditional Chinese Version of the Italian Spine Youth Quality of Life (ISYQOL) Questionnaire

The Italian Spine Youth Quality of Life (ISYQOL) is a validated health-related quality of life (HRQOL) questionnaire for teenagers with adolescent idiopathic scoliosis (AIS). We culturally-adapted ISYQOL to traditional Chinese (ISYQOL-TC) and then recruited 133 conservatively treated teenagers with AIS to complete the ISYQOL-TC and the Chinese version of the Scoliosis Research Society-22 revised (SRS-22r) questionnaire, nine-item Patient Health Questionnaire (PHQ-9), seven-item Generalized Anxiety Disorder scale (GAD-7), and numeric pain rating scale (NPRS). They repeated ISYQOL-TC two weeks later. The internal consistency, unidimensionality, and test-retest reliability were measured using the Cronbach's alpha, Rasch measurement models, and intra-class correlation coefficients (ICC3,1), respectively. The concurrent validity of the ISYQOL-TC with SRS-22r, and its construct validity with other questionnaires were evaluated using Spearman correlation coefficients. The ISYQOL-TC demonstrated good internal consistency (Cronbach's alpha 0.90 and 0.89 for items 1-13 and items 1-20), and excellent test-retest reliability (ICC3,1 = 0.95-0.96). The Rasch analysis supported the unidimensionality of all 20 items in ISYQOL-TC. The ISYQOL-TC percentage scores were positively correlated with SRS-22r total scores (r = 0.65; p < 0.05), but were negatively related to PHQ-9, GAD-7, and NPRS scores (r = -0.46 to -0.39; p < 0.01). Collectively, the ISYQOL-TC is a reliable and valid instrument for evaluating HRQOL in Chinese teenagers with AIS.

Utility of the Global Appraisal of Individual Needs Recommendation and Referral Report for Substance Use Diagnosis, Treatment Planning, and Placement

OBJECTIVES

This study aims to evaluate the utility of the Global Appraisal of Individual Needs Recommendation and Referral Report (GRRS) as guided by American Psychiatric Association diagnosis criteria and American Society of Addiction Medicine guidelines for treatment planning and placement.

METHODS

Global Appraisal of Individual Needs data were gathered between March 2018 and June 2020 from a total of 82 agencies and 245 clinicians as part of a program evaluation of agencies receiving public funding through the Mid-State Health Network under contract with the Michigan Department of Health and Human Services and the Office of Recovery Oriented Systems of Care. Of the 1395 patients 18 years or older, 1027 GRRS reports were produced by clinical staff. κ And ρ analyses were used to measure rates of clinician agreement with the recommendations produced by the GRRS report based on patient interviews.

RESULTS

Clinicians agreed with the GRRS preliminary diagnostic recommendations 88% to 100% of the time, with κ scores indicating excellent agreement by ranging from 0.6 to 0.9. For an average patient, 41 of 46 treatment planning statements generated by the GRRS were used by clinicians, with moderate to high correlation indicated by ρ scores ranging from 0.62 to 0.82. The percent agreement for all American Society of Addiction Medicine dimension ratings was greater than 99%, with κ scores of 0.98 and higher.

CONCLUSIONS

This study demonstrates the utility and efficiency of the GRRS as a clinical decision support system to support diagnosis, treatment, and placement in routine practice.

The impact of Juvenile Drug Treatment Courts (JDTC) implementing Federal Evidence-Based Guidelines on recidivism and substance use: multisite Randomized Controlled Trial (RCT) and Regression Discontinuity (RDD) Designs

BACKGROUND

Juvenile drug treatment courts (JDTC) have struggled to define themselves since their inception in 1995. Early courts followed a format similar to adult drug courts, but these did not address the unique needs of juveniles, which led to the creation of 16 Strategies by a consensus panel of practitioners and researchers. But, like the first JDTCs, research with courts following these strategies failed to provide convincing evidence that this "model" was associated with significant reductions in recidivism or drug use. More recently, a new set of evidence-based guidelines were developed through meta-analyses commissioned by the Office of Juvenile Justice and Delinquency Prevention (OJJDP, 2016).

METHOD

OJJDP provided funding for a rigorous multi-site evaluation of the guidelines. This study protocol paper for the Juvenile Drug Treatment Court (JDTC) Guidelines Cross-Site Evaluation presents research designs for the comparison of youth outcomes from 10 JDTCs compared with 10 Traditional Juvenile Courts (TJCs) in the same jurisdictions. Two sites opted into a randomized controlled trial (RCT) and eight sites chose to follow a regression discontinuity design (RDD). Youth data are captured at baseline, and at 6- and 12-month follow-ups using an interview comprised of several standardized assessments. The youths' official records also are abstracted for recidivism and substance use information. The degree to which the evidence-based guidelines are implemented at each site is assessed via an in-depth court self-assessment collected at baseline and again 2 years later and via structured site visits conducted once during implementation.

DISCUSSION

As a field-based trial, using both RCT and RDD designs, findings will provide important, policy-relevant information regarding the implementation of the OJJDP evidence-based guidelines, including the degree to which JDTCs adopted and/or modified these practices, their relative impact on recidivism and substance use, as well as the degree to which JDTCs differ from TJCs. Specific inferences may be drawn about whether following or not following specific guidelines differentially impact youth outcomes, yielding recommendations about the translation of this information from research-to-practice for potentiating the broader adoption of these guidelines by JDTCs nationwide.

CLINICAL TRIALS REGISTRATION

This was not an NIH supported trial. The funder, OJJDP/NIJ, instead required publishing the design with even more information at https://www.ojp.gov/ncjrs/virtual-library/abstracts/juvenile-drug-treatment-court-jdtc-guidelines-cross-site-evaluation .

Home Learning Environments: A Cross-Cultural Study Between Germany and Iran

The home learning environment (HLE) index is composed of seven questions regarding educational parent–child interactions. To compare the psychometric characteristics of the six items of HLE index between the two different contexts of Germany and Iran, a sample including 468 preschool children from the National Educational Panel Study (NEPS), Germany, and 465 preschool children from the Longitudinal Study of Iranian Children (LSIC; Growing Up in Iran) were examined. Rasch analysis supports the fitness of the five items of HLE into the model in both countries. However, differential item functioning (DIF) results revealed significant differences between items functioning across the two samples. According to the item difficulty maps, reading to children was the most reported item in the German families, while Iranian parents tended to paint and draw with their children more. While findings support the construct validity and reliability of five of the six items in both samples, different Rasch results may reveal the effects of the cultural dimensions of each country on HLE items.

Validation of the MedUseQ: A Self-Administered Screener for Older Adults to Assess Medication Use Problems

Background:

Older adults taking multiple prescription and nonprescription drugs are at risk for medication use problems, yet there are few brief, self-administered screening tools designed specifically for them.

Objective:

The study objective was to develop and validate a patient-centered screener for community-dwelling older adults.

Methods:

In phase 1, a convenience sample of 57 stakeholders (older adults, pharmacists, nurses, and physicians) participated in concept mapping, using Concept System® Global MAXTM, to identify items for a questionnaire. In phase 2, a 40-item questionnaire was tested with a convenience sample of 377 adults and a 24-item version was tested with 306 older adults, aged 55 and older, using Rasch methodology. In phase 3, stakeholder focus groups provided feedback on the format of questionnaire materials and recommended strategies for addressing problems.

Results:

The concept map contained 72 statements organized into 6 conceptual clusters or domains. The 24-item screener was unidimensional. Cronbach's alpha was .87, person reliability was acceptable (.74), and item reliability was high (.96).

Conclusion:

The MedUseQ is a validated, patient-centered tool targeting older adults that can be used to assess a wide range of medication use problems in clinical and community settings and to identify areas for education, intervention, or further assessment.

Translation and cross language validation of Passionate Love Scale among adults in Lahore, Pakistan

Objective of the present study was to translate and cross language validate the Passionate Love Scale (PLS) from English language to Urdu language using forward-back translation (Brislin, 1976) procedure. It is developed by Hatfield and Sprecher (1986). It has 15 self-reported and uni-dimensional items, with 9 points rating scale ranges from 1 = not at all true to 9 = definitely true. Results showed high level of Cronbach’s alpha reliability coefficient α = 0.90, test retest reliability ranged from r = .73 to r = .96 (ps < .01), item total correlation varying from r = .50 to r = .74 (ps < .01) and factor loading ranged from .39 to .73. Item difficulty was determined through the Rasch scaling analysis and construct validity of the Urdu PLS secured the same one-dimensional factor structure of the English PLS by retaining 15 items. It showed that the Urdu PLS is reliable and valid tool to measure the cognitive, emotional and behavioral components of passionate love in Pakistani cultural context. Implications of the study were also discussed.

Mental health problems in college freshmen: Prevalence and academic functioning

BACKGROUND

Mental health problems in college and their associations with academic performance are not well understood. The main aim of this study was to investigate to what extent mental health problems are associated with academic functioning.

METHODS

As part of the World Mental Health Surveys International College Student project, 12-month mental health problems among freshmen (N = 4921) was assessed in an e-survey of students at KU Leuven University in Leuven, Belgium. The associations of mental health problems with academic functioning (expressed in terms of academic year percentage [or AYP] and grade point average [GPA]) were examined across academic departments.

RESULTS

Approximately one in three freshman reports mental health problems in the past year, with internalizing and externalizing problems both associated with reduced academic functioning (2.9-4.7% AYP reduction, corresponding to 0.2-0.3 GPA reduction). The association of externalizing problems with individual-level academic functioning was significantly higher in academic departments with comparatively low average academic functioning.

LIMITATIONS

Limited sample size precluded further investigation of interactions between department-level and student-level variables. No information was available on freshman secondary school academic performance.

CONCLUSIONS

Mental health problems are common in college freshman, and clearly associated with lower academic functioning. Additional research is needed to examine the potentially causal nature of this association, and, if so, whether interventions aimed at treating mental health problems might improve academic performance.

Gender differences in the association between conduct disorder and risky sexual behavior

Despite suggestions that there are gender differences in the association between conduct disorder (CD) and risky sexual behavior, limited empirical research has examined this question. Youth (N = 616) were recruited from four primary care clinics and completed questions related to risky sexual behavior, alcohol and marijuana use, and CD. Results of stratified multivariate models indicated that the association between CD and having four or more lifetime partners, having two or more partners in the last 3 months, and engaging in condomless sex was stronger among female youth. However, the association between CD and alcohol and other drug use before sex was stronger in male youth. This is an important contribution to our understanding of gender-specific manifestations of conduct disorder, and has the potential to inform screening and brief intervention efforts for this population.

Validation of the Full and Short-Form Self-Help Involvement Scale Against the Rasch Measurement Model

BACKGROUND

Substance use disorders (SUDs) are one of the nation's most costly problems in terms of dollars, disability, and death. Self-help programs are among the varied recovery support options available to address SUD, and evaluation of these programs depends on good measurement. There exists an unmet need for a psychometrically sound, brief, efficient measure of self-help involvement for individuals with SUD that is valid across different substances and age-groups.

METHODS

Using data from 2,101 persons presenting for SUD treatment, the full 21-item Global Appraisal of Individual Needs Self-Help Involvement Scale (SHIS) and a newly developed 11-item short-form version were validated against the Rasch measurement model and each other. Differential item functioning (DIF) was assessed by primary substance and age.

RESULTS

Both versions met Rasch psychometric criteria. The full scale had minor misfit with no DIF for alcohol, marijuana, or opioids but a few instances of DIF for amphetamine and cocaine users as well as for age, in that youth tended to endorse several easier items more frequently than did adults. The 11-item short form had neither misfit nor DIF by substance and only minor DIF by age was highly correlated with the full version and was relatively more efficient. Criterion-related validity was supported for both.

CONCLUSIONS

Both the long and short versions of SHIS are psychometrically sound measures of a more comprehensive conceptualization of self-help involvement for SUDs that can be used as part of an in-depth assessment or as a short measure that lessens respondent burden.

Measuring Constructs in Family Science: How Can Item Response Theory Improve Precision and Validity?

This article provides family scientists with an understanding of contemporary measurement perspectives and the ways in which item response theory (IRT) can be used to develop measures with desired evidence of precision and validity for research uses. The article offers a nontechnical introduction to some key features of IRT, including its orientation toward locating items along an underlying dimension and toward estimating precision of measurement for persons with different levels of that same construct. It also offers a didactic example of how the approach can be used to refine conceptualization and operationalization of constructs in the family sciences, using data from the National Longitudinal Survey of Youth 1979 (n = 2,732). Three basic models are considered: (a) the Rasch and (b) two-parameter logistic models for dichotomous items and (c) the Rating Scale Model for multicategory items. Throughout, the author highlights the potential for researchers to elevate measurement to a level on par with theorizing and testing about relationships among constructs.

A comparison of treatment outcomes for adolescent community reinforcement approach participants with and without co-occurring problems

This study examined the relationship between Adolescent Community Reinforcement Approach (A-CRA) participation with treatment engagement, retention, and satisfaction, and with substance use and emotional problem outcomes. Participants had substance use disorders (SUD) only or co-occurring substance use and psychiatric problems. Those with co-occurring problems reported more days of substance use and emotional problems at intake to treatment than those with SUD only. All groups received equivalent exposure to A-CRA during treatment implementation. At the 12-month follow-up, adolescents classified as externalizers (n = 468) or those with both externalizing and internalizing problems (n = 674) had significantly greater improvement in their days of abstinence and substance problems relative to adolescents with substance use disorders only (n = 666). Additionally, adolescents reporting symptoms of internalizing (n = 154), externalizing, or both externalizing and internalizing disorders had significantly greater improvements in days of emotional problems relative to adolescents with SUD only.

A psychometric assessment of the GAIN individual severity scale (GAIN-GISS) and short screeners (GAIN-SS) among adolescents in outpatient treatment programs

The global appraisal of individual needs (GAIN)-general individual severity scale (GAIN-GISS), and GAIN-short screener (GAIN-SS) are widely used diagnostic measures of internalizing disorders, externalizing disorders, substance abuse, and criminal and violent behavior. Although prevalent in clinical and research settings, there is only limited psychometric evidence of the dimensional structure of these scales. Our investigation used intake data from 6,909 adolescents presenting to outpatient substance abuse treatment facilities in the United States. Our analytic approach used exploratory and item factor analyses to evaluate the underlying factor structure. Multi- and unidimensional item response theory models were employed to evaluate the utility of the scales at providing precise score estimates at various locations of severity. Most scales were confirmed as unidimensional; scales with evidence of multidimensionality, identified as having a weak general dimension and strong specific dimensions using a bifactor IRT model, include the Crime and Violence Scale and the GAIN-SS.

Using the Rasch measurement model in psychometric analysis of the Family Effectiveness Measure

BACKGROUND

Valid assessment of family functioning can play a vital role in optimizing client outcomes. Because family functioning is influenced by family structure, socioeconomic context, and culture, existing measures of family functioning-primarily developed with nuclear, middle-class European American families-may not be valid assessments of families in diverse populations. The Family Effectiveness Measure was developed to address this limitation.

OBJECTIVES

The aim of this study was to test the Family Effectiveness Measure with data from a primarily low-income African American convenience sample using the Rasch measurement model.

METHODS

A sample of 607 adult women completed the measure. Rasch analysis was used to assess unidimensionality, response category functioning, item fit, person reliability, differential item functioning by race and parental status, and item hierarchy. Criterion-related validity was tested using correlations with five other variables related to family functioning.

RESULTS

The Family Effectiveness Measure measures two separate constructs: The Effective Family Functioning construct was a psychometrically sound measure of the target construct that was more efficient because of the deletion of 22 items. The Ineffective Family Functioning construct consisted of 16 of those deleted items but was not as strong psychometrically. Items in both constructs evidenced no differential item functioning by race. Criterion-related validity was supported for both.

DISCUSSION

In contrast to the prevailing conceptualization that family functioning is a single construct, assessed by positively and negatively worded items, use of the Rasch analysis suggested the existence of two constructs. Whereas the Effective Family Functioning scale is a strong and efficient measure of family functioning, the Ineffective Family Functioning scale will require additional item development and psychometric testing.

Male adolescent substance use disorder and attention-deficit hyperactivity disorder: a review of the literature

Approximately, one-third of male adolescents in treatment for a substance use disorder (SUD) also have an Attention-Deficit Hyperactivity Disorder (ADHD). This strongly suggests that ADHD is a major risk factor for the development of SUD which practitioners must address if they are to provide adequate treatment for adolescents with SUD/ADHD. This paper supports a causal role for ADHD in the development of SUD and examines the developmental mechanisms whereby ADHD increases risk for SUD. These mechanisms include increased risk for conduct disorder, academic failure, deviant peer affiliation, engaging in risk behaviors, and self-medication. Assessment and treatment recommendations for those comorbid for SUD/ADHD are provided.