1
|
De Los Reyes A, Augenstein TM, Wang M, Thomas SA, Drabick DA, Burgers DE, Rabinowitz J. The validity of the multi-informant approach to assessing child and adolescent mental health. Psychol Bull 2015; 141:858-900. [PMID: 25915035 PMCID: PMC4486608 DOI: 10.1037/a0038498] [Citation(s) in RCA: 904] [Impact Index Per Article: 90.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Child and adolescent patients may display mental health concerns within some contexts and not others (e.g., home vs. school). Thus, understanding the specific contexts in which patients display concerns may assist mental health professionals in tailoring treatments to patients' needs. Consequently, clinical assessments often include reports from multiple informants who vary in the contexts in which they observe patients' behavior (e.g., patients, parents, teachers). Previous meta-analyses indicate that informants' reports correlate at low-to-moderate magnitudes. However, is it valid to interpret low correspondence among reports as indicating that patients display concerns in some contexts and not others? We meta-analyzed 341 studies published between 1989 and 2014 that reported cross-informant correspondence estimates, and observed low-to-moderate correspondence (mean internalizing: r = .25; mean externalizing: r = .30; mean overall: r = .28). Informant pair, mental health domain, and measurement method moderated magnitudes of correspondence. These robust findings have informed the development of concepts for interpreting multi-informant assessments, allowing researchers to draw specific predictions about the incremental and construct validity of these assessments. In turn, we critically evaluated research on the incremental and construct validity of the multi-informant approach to clinical child and adolescent assessment. In so doing, we identify crucial gaps in knowledge for future research, and provide recommendations for "best practices" in using and interpreting multi-informant assessments in clinical work and research. This article has important implications for developing personalized approaches to clinical assessment, with the goal of informing techniques for tailoring treatments to target the specific contexts where patients display concerns. (PsycINFO Database Record
Collapse
|
Meta-Analysis |
10 |
904 |
2
|
Epstein DH, Preston KL, Stewart J, Shaham Y. Toward a model of drug relapse: an assessment of the validity of the reinstatement procedure. Psychopharmacology (Berl) 2006; 189:1-16. [PMID: 17019567 PMCID: PMC1618790 DOI: 10.1007/s00213-006-0529-6] [Citation(s) in RCA: 465] [Impact Index Per Article: 24.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/03/2006] [Accepted: 07/27/2006] [Indexed: 12/11/2022]
Abstract
BACKGROUND AND RATIONALE The reinstatement model is widely used to study relapse to drug addiction. However, the model's validity is open to question. OBJECTIVE We assess the reinstatement model in terms of criterion and construct validity. RESEARCH HIGHLIGHTS AND CONCLUSIONS We find that the reinstatement model has adequate criterion validity in the broad sense of the term, as evidenced by the fact that reinstatement in laboratory animals is induced by conditions reported to provoke relapse in humans. The model's criterion validity in the narrower sense, as a medication screen, seems promising for relapse to heroin, nicotine, and alcohol. For relapse to cocaine, criterion validity has not yet been established primarily because clinical studies have examined medication's effects on reductions in cocaine intake rather than relapse during abstinence. The model's construct validity faces more substantial challenges and is yet to be established, but we argue that some of the criticisms of the model in this regard may have been overstated.
Collapse
|
research-article |
19 |
465 |
3
|
Borsboom D. The attack of the psychometricians. PSYCHOMETRIKA 2006; 71:425-440. [PMID: 19946599 PMCID: PMC2779444 DOI: 10.1007/s11336-006-1447-6] [Citation(s) in RCA: 202] [Impact Index Per Article: 10.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/06/2006] [Accepted: 04/20/2006] [Indexed: 05/05/2023]
Abstract
This paper analyzes the theoretical, pragmatic, and substantive factors that have hampered the integration between psychology and psychometrics. Theoretical factors include the operationalist mode of thinking which is common throughout psychology, the dominance of classical test theory, and the use of "construct validity" as a catch-all category for a range of challenging psychometric problems. Pragmatic factors include the lack of interest in mathematically precise thinking in psychology, inadequate representation of psychometric modeling in major statistics programs, and insufficient mathematical training in the psychological curriculum. Substantive factors relate to the absence of psychological theories that are sufficiently strong to motivate the structure of psychometric models. Following the identification of these problems, a number of promising recent developments are discussed, and suggestions are made to further the integration of psychology and psychometrics.
Collapse
|
research-article |
19 |
202 |
4
|
Benning SD, Patrick CJ, Blonigen DM, Hicks BM, Iacono WG. Estimating facets of psychopathy from normal personality traits: a step toward community epidemiological investigations. Assessment 2005; 12:3-18. [PMID: 15695739 PMCID: PMC2242356 DOI: 10.1177/1073191104271223] [Citation(s) in RCA: 179] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
In three samples consisting of community and undergraduate men and women and incarcerated men, we examined the criterion validity of two distinct factors of psychopathy embodied in the Psychopathic Personality Inventory (PPI) as indexed by primary trait scales from the Multidimensional Personality Questionnaire (MPQ). Consistent with the PPI factors themselves, MPQ-estimated PPI-I related negatively with internalizing disorder symptoms and fearfulness and positively with thrill and adventure seeking, sociability, activity, and narcissism. MPQ-estimated PPI-II was associated negatively with socialization and positively with externalizing disorder symptoms, impulsivity, disinhibition and boredom susceptibility, and trait anxiety and negative emotionality. Additionally, PPI-I was selectively related to the interpersonal facet of Factor 1 of the Psychopathy Checklist-Revised (PCL-R), whereas PPI-II was related preferentially to Factor 2 of the PCL-R.
Collapse
|
Research Support, N.I.H., Extramural |
20 |
179 |
5
|
Mabunga DFN, Gonzales ELT, Kim JW, Kim KC, Shin CY. Exploring the Validity of Valproic Acid Animal Model of Autism. Exp Neurobiol 2015; 24:285-300. [PMID: 26713077 PMCID: PMC4688329 DOI: 10.5607/en.2015.24.4.285] [Citation(s) in RCA: 168] [Impact Index Per Article: 16.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2015] [Revised: 12/01/2015] [Accepted: 12/02/2015] [Indexed: 02/06/2023] Open
Abstract
The valproic acid (VPA) animal model of autism spectrum disorder (ASD) is one of the most widely used animal model in the field. Like any other disease models, it can't model the totality of the features seen in autism. Then, is it valid to model autism? This model demonstrates many of the structural and behavioral features that can be observed in individuals with autism. These similarities enable the model to define relevant pathways of developmental dysregulation resulting from environmental manipulation. The uncovering of these complex pathways resulted to the growing pool of potential therapeutic candidates addressing the core symptoms of ASD. Here, we summarize the validity points of VPA that may or may not qualify it as a valid animal model of ASD.
Collapse
|
Review |
10 |
168 |
6
|
Tavakol M, Wetzel A. Factor Analysis: a means for theory and instrument development in support of construct validity. INTERNATIONAL JOURNAL OF MEDICAL EDUCATION 2020; 11:245-247. [PMID: 33170146 PMCID: PMC7883798 DOI: 10.5116/ijme.5f96.0f4a] [Citation(s) in RCA: 166] [Impact Index Per Article: 33.2] [Reference Citation Analysis] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 10/13/2020] [Accepted: 10/25/2020] [Indexed: 06/11/2023]
|
Editorial |
5 |
166 |
7
|
Abstract
New findings from neuroscience, genetics, and experimental psychology have emerged that provide alternative explanations of many negative symptoms. We review the continuing limitations in treatment and discuss possible sources of heterogeneity among negative symptoms. We also anticipate conceptual uncertainties that may arise with forthcoming treatment developments.
Collapse
|
review-article |
19 |
142 |
8
|
Abstract
In this article, we conceptualised fatalism as a set of health beliefs that encompass the dimensions of predetermination, luck and pessimism. A 20-item scale was developed as a measurement instrument. Confirmatory factor analyses were performed to test the dimensionality of the scale. Three external variables (i.e. genetic determinism, perceived benefits of lifestyle change and intention to engage in healthy behaviour) were used as reference variables to test the construct validity of the scale. Data from a web-based national survey (N = 1218) showed that the scale was unidimensional on the second order, and with good reliability (alpha = 0.88). The relationships between the external variables and the first- and second-order factors provided evidence of the scale's external consistency and construct validity.
Collapse
|
research-article |
16 |
114 |
9
|
Siedlecki KL, Stern Y, Reuben A, Sacco RL, Elkind MS, Wright CB. Construct validity of cognitive reserve in a multiethnic cohort: The Northern Manhattan Study. J Int Neuropsychol Soc 2009; 15:558-69. [PMID: 19573274 PMCID: PMC2803322 DOI: 10.1017/s1355617709090857] [Citation(s) in RCA: 107] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Cognitive reserve is a hypothetical construct that has been used to inform models of cognitive aging and is presumed to be indicative of life experiences that may mitigate the effects of brain pathology. The purpose of this study was to evaluate the construct validity of cognitive reserve by examining both its convergent and its discriminant validity across three different samples of participants using structural equation modeling. The cognitive reserve variables were found to correlate highly with one another (thereby providing evidence of convergent validity), but demanding tests of discriminant validity indicated that, in two of the samples, the cognitive reserve construct was highly related to an executive functioning construct.
Collapse
|
Research Support, N.I.H., Extramural |
16 |
107 |
10
|
Kuriyama A, Urushidani S, Nakayama T. Five-level emergency triage systems: variation in assessment of validity. Emerg Med J 2017; 34:703-710. [PMID: 28751363 DOI: 10.1136/emermed-2016-206295] [Citation(s) in RCA: 104] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2016] [Revised: 04/19/2017] [Accepted: 05/05/2017] [Indexed: 11/03/2022]
Abstract
INTRODUCTION Triage systems are scales developed to rate the degree of urgency among patients who arrive at EDs. A number of different scales are in use; however, the way in which they have been validated is inconsistent. Also, it is difficult to define a surrogate that accurately predicts urgency. This systematic review described reference standards and measures used in previous validation studies of five-level triage systems. METHODS We searched PubMed, EMBASE and CINAHL to identify studies that had assessed the validity of five-level triage systems and described the reference standards and measures applied in these studies. Studies were divided into those using criterion validity (reference standards developed by expert panels or triage systems already in use) and those using construct validity (prognosis, costs and resource use). RESULTS A total of 57 studies examined criterion and construct validity of 14 five-level triage systems. Criterion validity was examined by evaluating (1) agreement between the assigned degree of urgency with objective standard criteria (12 studies), (2) overtriage and undertriage (9 studies) and (3) sensitivity and specificity of triage systems (7 studies). Construct validity was examined by looking at (4) the associations between the assigned degree of urgency and measures gauged in EDs (48 studies) and (5) the associations between the assigned degree of urgency and measures gauged after hospitalisation (13 studies). Particularly, among 46 validation studies of the most commonly used triages (Canadian Triage and Acuity Scale, Emergency Severity Index and Manchester Triage System), 13 and 39 studies examined criterion and construct validity, respectively. CONCLUSION Previous studies applied various reference standards and measures to validate five-level triage systems. They either created their own reference standard or used a combination of severity/resource measures.
Collapse
|
Systematic Review |
8 |
104 |
11
|
Duckworth AL, Tsukayama E, Kirby TA. Is it really self-control? Examining the predictive power of the delay of gratification task. PERSONALITY AND SOCIAL PSYCHOLOGY BULLETIN 2013; 39:843-55. [PMID: 23813422 PMCID: PMC3794428 DOI: 10.1177/0146167213482589] [Citation(s) in RCA: 100] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
This investigation tests whether the predictive power of the delay of gratification task (colloquially known as the "marshmallow test") derives from its assessment of self-control or of theoretically unrelated traits. Among 56 school-age children in Study 1, delay time was associated with concurrent teacher ratings of self-control and Big Five conscientiousness-but not with other personality traits, intelligence, or reward-related impulses. Likewise, among 966 preschool children in Study 2, delay time was consistently associated with concurrent parent and caregiver ratings of self-control but not with reward-related impulses. While delay time in Study 2 was also related to concurrently measured intelligence, predictive relations with academic, health, and social outcomes in adolescence were more consistently explained by ratings of effortful control. Collectively, these findings suggest that delay task performance may be influenced by extraneous traits, but its predictive power derives primarily from its assessment of self-control.
Collapse
|
Research Support, N.I.H., Extramural |
12 |
100 |
12
|
Herrenkohl RC, Herrenkohl TI. Assessing a child's experience of multiple maltreatment types: Some unfinished business. JOURNAL OF FAMILY VIOLENCE 2009; 24:485. [PMID: 20161642 PMCID: PMC2818150 DOI: 10.1007/s10896-009-9247-2] [Citation(s) in RCA: 97] [Impact Index Per Article: 6.1] [Reference Citation Analysis] [Key Words] [Grants] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 05/18/2023]
|
research-article |
16 |
97 |
13
|
Hall JR, Drislane LE, Patrick CJ, Morano M, Lilienfeld SO, Poythress NG. Development and validation of Triarchic construct scales from the psychopathic personality inventory. Psychol Assess 2014; 26:447-461. [PMID: 24447280 PMCID: PMC4147944 DOI: 10.1037/a0035665] [Citation(s) in RCA: 79] [Impact Index Per Article: 7.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
The Triarchic model of psychopathy describes this complex condition in terms of distinct phenotypic components of boldness, meanness, and disinhibition. Brief self-report scales designed specifically to index these psychopathy facets have thus far demonstrated promising construct validity. The present study sought to develop and validate scales for assessing facets of the Triarchic model using items from a well-validated existing measure of psychopathy-the Psychopathic Personality Inventory (PPI). A consensus-rating approach was used to identify PPI items relevant to each Triarchic facet, and the convergent and discriminant validity of the resulting PPI-based Triarchic scales were evaluated in relation to multiple criterion variables (i.e., other psychopathy inventories, antisocial personality disorder features, personality traits, psychosocial functioning) in offender and nonoffender samples. The PPI-based Triarchic scales showed good internal consistency and related to criterion variables in ways consistent with predictions based on the Triarchic model. Findings are discussed in terms of implications for conceptualization and assessment of psychopathy.
Collapse
|
Research Support, N.I.H., Extramural |
11 |
79 |
14
|
Lindquist KA, Siegel EH, Quigley KS, Barrett LF. The hundred-year emotion war: are emotions natural kinds or psychological constructions? Comment on Lench, Flores, and Bench (2011). Psychol Bull 2013; 139:255-263. [PMID: 23294094 PMCID: PMC3556454 DOI: 10.1037/a0029038] [Citation(s) in RCA: 74] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/30/2022]
Abstract
For the last century, there has been a continuing debate about the nature of emotion. In the most recent offering in this scientific dialogue, Lench, Flores, and Bench (2011) reported a meta-analysis of emotion induction research and claimed support for the natural kind hypothesis that discrete emotions (e.g., happiness, sadness, anger, and anxiety) elicit specific changes in cognition, judgment, behavior, experience, and physiology. In this article, we point out that Lench et al. (2011) is not the final word on the emotion debate. First, we point out that Lench et al.'s findings do not support their claim that discrete emotions organize cognition, judgment, experience, and physiology because they did not demonstrate emotion-consistent and emotion-specific directional changes in these measurement domains. Second, we point out that Lench et al.'s findings are in fact consistent with the alternative (a psychological constructionist approach to emotion). We close by appealing for a construct validity approach to emotion research, which we hope will lead to greater consensus on the operationalization of the natural kind and psychological construction approaches, as well as the criteria required to finally resolve the emotion debate.
Collapse
|
Research Support, N.I.H., Extramural |
12 |
74 |
15
|
Viktrup L, Hayes RP, Wang P, Shen W. Construct validation of patient global impression of severity (PGI-S) and improvement (PGI-I) questionnaires in the treatment of men with lower urinary tract symptoms secondary to benign prostatic hyperplasia. BMC Urol 2012; 12:30. [PMID: 23134716 PMCID: PMC3503561 DOI: 10.1186/1471-2490-12-30] [Citation(s) in RCA: 71] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2012] [Accepted: 10/29/2012] [Indexed: 01/21/2023] Open
Abstract
BACKGROUND Lower urinary tract symptoms (LUTS) in aging men are often associated with benign prostatic hyperplasia (BPH). While regulatory evaluations of treatment benefit require an assessment of specific symptoms, a simpler approach to measuring patients' perceptions of severity and symptom change may be particularly useful for clinical practice. The aim of this study was to provide evidence of the validity of the 1-item Patient Global Impression of Severity (PGI-S) and Improvement (PGI-I) questionnaires for use as outcome measures in the treatment of BPH-LUTS. METHODS This was a secondary analysis of data from 4 randomized placebo-controlled 12-week trials evaluating tadalafil for the treatment of BPH-LUTS (N=1694). Visit 2 (V2 [beginning of a 4-week placebo lead-in period]) and endpoint assessments included International Prostate Symptom Score (IPSS), IPSS Quality of Life Index (IPSS-QoL), BPH Impact Index (BII), and peak urine flow (Qmax). PGI-S was only administered at V2 and PGI-I only at endpoint. Associations between the PGI-S or the PGI-I and the other assessments were analyzed by calculating Spearman rank correlation coefficients and performing analysis of variance (ANOVA). RESULTS Spearman correlation coefficients were 0.43, 0.43, 0.53, and -0.09, between the PGI-S and IPSS, IPSS-QoL, BII, and Qmax baseline results (all P<0.001). Similar results were seen across race, ethnicity, and baseline severity (moderate LUTS versus severe LUTS). IPSS, IPSS-QoL, BII baseline scores (P <0.001) and Qmax values (P=0.003) were significantly different among the 4 PGI-S severity levels. Spearman correlation coefficients were 0.56, 0.53, 0.47 and -0.15 between the PGI-I and change in IPSS, IPSS-QoL, BII scores, and Qmax values from baseline to endpoint (all P<0.001). Similar results were seen across race, ethnicity, and baseline severity. Change in IPSS, IPSS-QoL, BII scores, and Qmax values (P<0.001) were significantly different among the PGI-I levels (i.e., patient perception of change in urinary symptoms). CONCLUSIONS This study demonstrated patients' overall perceptions of their severity and change in BPH-LUTS can be captured in a way that is simple, valid, and easily administered in a research setting or clinical practice. Clinical parameters are weakly associated with patients' perception of urinary symptoms, emphasizing the importance of a patient-reported assessment in the evaluation of BPH-LUTS treatment benefit.
Collapse
|
Validation Study |
13 |
71 |
16
|
Robinson S, Kissane DW, Brooker J, Hempton C, Michael N, Fischer J, Franco M, Sulistio M, Clarke DM, Ozmen M, Burney S. Refinement and revalidation of the demoralization scale: The DS-II-external validity. Cancer 2016; 122:2260-7. [PMID: 27171544 DOI: 10.1002/cncr.30012] [Citation(s) in RCA: 70] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2015] [Revised: 02/02/2016] [Accepted: 02/10/2016] [Indexed: 11/05/2022]
Abstract
BACKGROUND The recently refined Demoralization Scale-II (DS-II) is a 16-item, self-report measure of demoralization. Its 2 factors-Meaning and Purpose and Distress and Coping Ability-demonstrate sound internal validity, including item fit, unidimensionality, internal consistency, and test-retest reliability. The convergent and discriminant validity of the DS-II with various measures is reported here. METHODS Patients who had cancer or other progressive diseases and were receiving palliative care (n = 211) completed a battery of questionnaires, including the DS-II and measures of symptom burden, quality of life, depression, and attitudes toward the end of life. Spearman ρ correlations were determined to assess convergent validity. Mann-Whitney U tests with calculated effect sizes were used to examine discriminant validity and establish the minimal clinically important difference (MCID). Cross-tabulation frequencies with chi-square analyses were used to examine discriminant validity with major depression. RESULTS The DS-II demonstrated convergent validity with measures of psychological distress, quality of life, and attitudes toward the end of life. It also demonstrated discriminant validity, as the DS-II differentiated patients who had different functional performance levels and high/low symptoms, with a difference of 2 points between groups on the DS-II considered clinically meaningful. Furthermore, discriminant validity was demonstrated, as comorbidity with depression was not observed at moderate levels of demoralization. CONCLUSIONS The DS-II has sound psychometric properties and is an appropriate measure of demoralization. Given its structural simplicity and brevity, it is likely to be a useful tool in meaning-centered therapies. Cancer 2016;122:2260-7. © 2016 American Cancer Society.
Collapse
|
Multicenter Study |
9 |
70 |
17
|
Factor structure, convergent validity, and discriminant validity of the NIH Toolbox Cognitive Health Battery (NIHTB-CHB) in adults. J Int Neuropsychol Soc 2014; 20:579-87. [PMID: 24960474 PMCID: PMC4103956 DOI: 10.1017/s1355617714000307] [Citation(s) in RCA: 65] [Impact Index Per Article: 5.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
The objective of this study is to evaluate the construct validity of the NIH Neurobehavioral Toolbox Cognitive Health Battery (NIHTB-CHB) in adults. Confirmatory factor analysis was used to evaluate the dimensional structure underlying the NIHTB-CHB and Gold Standard tests chosen to serve as concurrent validity criteria for the NIHTB-CHB. These results were used to evaluate the convergent and discriminant validity of the NIHTB-CHB in adults ranging from 20 to 85 years of age. Five dimensions were found to explain the correlations among NIHTB-CHB and Gold Standard tests: Vocabulary, Reading, Episodic Memory, Working Memory and Executive Function/Processing Speed. NIHTB-CHB measures and their Gold Standard analogues defined factors in a pattern that broadly supported the convergent and discriminant validity of the NIHTB-CHB tests. This 5-factor structure was found to be invariant across 20-60 year old (N=159) and 65-85 year old (N=109) age groups that were included in the current validity study. Second order Crystallized Abilities (Vocabulary and Reading) and Fluid Abilities (Episodic Memory, Working Memory, Executive/Speed) factors parsimoniously explained correlations among the five first order factors. These results suggest that the NIHTB-CHB will provide both fine-grained and broad characterization of cognition across the adult age span.
Collapse
|
research-article |
11 |
65 |
18
|
Khanna D, Maranian P, Rothrock N, Cella D, Gershon R, Khanna PP, Spiegel B, Furst DE, Clements PJ, Bechtel A, Hays RD. Feasibility and construct validity of PROMIS and "legacy" instruments in an academic scleroderma clinic. VALUE IN HEALTH : THE JOURNAL OF THE INTERNATIONAL SOCIETY FOR PHARMACOECONOMICS AND OUTCOMES RESEARCH 2012; 15:128-134. [PMID: 22264980 PMCID: PMC3457915 DOI: 10.1016/j.jval.2011.08.006] [Citation(s) in RCA: 60] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/13/2011] [Revised: 07/17/2011] [Accepted: 08/08/2011] [Indexed: 05/31/2023]
Abstract
OBJECTIVE The National Institutes of Health Patient-Reported Outcomes Measurement Information System (PROMIS) roadmap initiative is a cooperative group program of research designed to develop, evaluate, and standardize item banks to measure patient-reported outcomes relevant across medical conditions. The objective of the current study was to assess feasibility and evaluation of the construct validity of PROMIS item banks versus legacy measures in an observational study in systemic sclerosis (SSc). We hypothesized that the PROMIS item banks can be administered in a clinical setting if there is adequate staff support without disrupting the flow of clinic. METHODS Patients with SSc in a single academic center completed computerized adaptive test (CAT) administered PROMIS item banks during the clinic visit and legacy measures (using paper and pencil). The construct validity of PROMIS items was evaluated by examining correlations with corresponding legacy measures using multitrait-multimethod analysis. RESULTS Participants consisted of 143 SSc patients with an average age of 51.5 years; 71% were female and 68% were white. The average number of items completed for each CAT-administered item bank ranged from 5 to 8 (69 CAT items per patient), and the average time to complete each CAT-administered item bank ranged from 48 seconds to 1.9 minutes per patient (average time = 11.9 minutes/per patient for 11 banks). All correlations between PROMIS domains and respective legacy measures were large and in the hypothesized direction (ranged from 0.61 to 0.82). CONCLUSION Our study supports the construct validity of the CAT-administered PROMIS item banks and shows that they can be administered successfully in a clinic with support staff. Future studies should assess the feasibility of PROMIS item banks in a busy clinical practice.
Collapse
|
Research Support, N.I.H., Extramural |
13 |
60 |
19
|
Morrice JR, Gregory-Evans CY, Shaw CA. Animal models of amyotrophic lateral sclerosis: A comparison of model validity. Neural Regen Res 2018; 13:2050-2054. [PMID: 30323119 PMCID: PMC6199948 DOI: 10.4103/1673-5374.241445] [Citation(s) in RCA: 59] [Impact Index Per Article: 8.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022] Open
Abstract
Animal models are necessary to investigate the pathogenic features underlying motor neuron degeneration and for therapeutic development in amyotrophic lateral sclerosis (ALS). Measures of model validity allow for a critical interpretation of results from each model and caution from over-interpretation of experimental models. Face and construct validity refer to the similarity in phenotype and the proposed causal factor to the human disease, respectively. More recently developed models are restricted by limited phenotype characterization, yet new models hold promise for novel disease insights, thus highlighting their importance. In this article, we evaluate the features of face and construct validity of our new zebrafish model of environmentally-induced motor neuron degeneration and discuss this in the context of current environmental and genetic ALS models, including C9orf72, mutant Cu/Zn superoxide dismutase 1 and TAR DNA-binding protein 43 mouse and zebrafish models. In this mini-review, we discuss the pros and cons to validity criteria in each model. Our zebrafish model of environmentally-induced motor neuron degeneration displays convincing features of face validity with many hallmarks of ALS-like features, and weakness in construct validity. However, the value of this model may lie in its potential to be more representative of the pathogenic features underlying sporadic ALS cases, where environmental factors may be more likely to be involved in disease etiology than single dominant gene mutations. It may be necessary to compare findings between different strains and species modeling specific genes or environmental factors to confirm findings from ALS animal models and tease out arbitrary strain- and overexpression-specific effects.
Collapse
|
Review |
7 |
59 |
20
|
Renno P, Wood JJ. Discriminant and convergent validity of the anxiety construct in children with autism spectrum disorders. J Autism Dev Disord 2013; 43:2135-46. [PMID: 23354538 PMCID: PMC3676461 DOI: 10.1007/s10803-013-1767-1] [Citation(s) in RCA: 57] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
Abstract
Despite reports of high anxiety in children with autism spectrum disorders (ASD), there is controversy regarding differential diagnosis of ASD symptoms and anxiety symptoms. This study examined 88 children, aged 7-11 years, with ASD referred for concerns about anxiety. A multitrait-(social anxiety, separation anxiety, overall anxiety severity, and overall ASD severity), multimethod-(diagnostic interviews, parent-, and child-based measures) analysis was conducted. Results from structural equation modeling suggest statistical discrimination between anxiety and ASD severity and convergence among differing reports of two of the anxiety subdomains (separation anxiety and overall anxiety). These findings suggest that anxiety symptoms experienced by children with ASD are separate from ASD symptom severity and may instead reflect anxiety syndromes (e.g., separation anxiety) similar to those that occur in typically developing children.
Collapse
|
Research Support, N.I.H., Extramural |
12 |
57 |
21
|
Mercer-Lynn KB, Flora DB, Fahlman SA, Eastwood JD. The measurement of boredom: differences between existing self-report scales. Assessment 2011; 20:585-96. [PMID: 21571736 DOI: 10.1177/1073191111408229] [Citation(s) in RCA: 55] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
There are two commonly used measures of boredom: the Boredom Proneness Scale (BPS) and the Boredom Susceptibility Scale (ZBS). Although both were designed to measure the propensity to experience boredom (i.e., trait boredom), there are reasons to think they may not measure the same construct. The present research sought to evaluate this proposition in several stages. Specifically, relationships between the BPS, ZBS, and important causal (Study 1, N = 837), correlational (Study 2, N = 233), and outcome variables (Study 3, N = 137) were examined in university students. Taken together, results support the notion that the BPS and ZBS do not measure the same construct. Specifically, higher BPS scores were associated with higher levels of neuroticism, experiential avoidance, attentional and nonplanning impulsivity, anxiety, depression, dysphoria, and emotional eating. Conversely, higher ZBS scores were associated with higher levels of motor impulsivity, sensitivity to reward, gambling, and alcohol use and lower levels of neuroticism, experiential avoidance, and sensitivity to punishment.
Collapse
|
Research Support, Non-U.S. Gov't |
14 |
55 |
22
|
Morf CC, Schürch E, Küfner A, Siegrist P, Vater A, Back M, Mestel R, Schröder-Abé M. Expanding the Nomological Net of the Pathological Narcissism Inventory: German Validation and Extension in a Clinical Inpatient Sample. Assessment 2016; 24:419-443. [PMID: 26874362 DOI: 10.1177/1073191115627010] [Citation(s) in RCA: 50] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/21/2023]
Abstract
The Pathological Narcissism Inventory (PNI) is a multidimensional measure for assessing grandiose and vulnerable features in narcissistic pathology. The aim of the present research was to construct and validate a German translation of the PNI and to provide further information on the PNI's nomological net. Findings from a first study confirm the psychometric soundness of the PNI and replicate its seven-factor first-order structure. A second-order structure was also supported but with several equivalent models. A second study investigating associations with a broad range of measures ( DSM Axis I and II constructs, emotions, personality traits, interpersonal and dysfunctional behaviors, and well-being) supported the concurrent validity of the PNI. Discriminant validity with the Narcissistic Personality Inventory was also shown. Finally, in a third study an extension in a clinical inpatient sample provided further evidence that the PNI is a useful tool to assess the more pathological end of narcissism.
Collapse
|
Validation Study |
9 |
50 |
23
|
Hedsköld M, Pukk-Härenstam K, Berg E, Lindh M, Soop M, Øvretveit J, Andreen Sachs M. Psychometric properties of the Hospital Survey on Patient Safety Culture, HSOPSC, applied on a large Swedish health care sample. BMC Health Serv Res 2013; 13:332. [PMID: 23964867 PMCID: PMC3765335 DOI: 10.1186/1472-6963-13-332] [Citation(s) in RCA: 50] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2013] [Accepted: 08/17/2013] [Indexed: 11/28/2022] Open
Abstract
BACKGROUND A Swedish version of the USA Agency for Healthcare Research and Quality "Hospital Survey on Patient Safety Culture" (S-HSOPSC) was developed to be used in both hospitals and primary care. Two new dimensions with two and four questions each were added as well as one outcome measure. This paper describes this Swedish version and an assessment of its psychometric properties which were tested on a large sample of responses from personnel in both hospital and primary care. METHODS The questionnaire was mainly administered in web form and 84215 forms were returned (response rate 60%) between 2009 and 2011. Eleven per cent of the responses came from primary care workers and 46% from hospital care workers. The psychometric properties were analyzed using both the total sample and the hospital and primary care subsamples by assessment of construct validity and internal consistency. Construct validity was assessed by confirmatory (CFA) and exploratory factor (EFA) analyses and internal consistency was established by Cronbachs's α. RESULTS CFA of the total, hospital and primary care samples generally showed a good fit while the EFA pointed towards a 9-factor model in all samples instead of the 14-dimension S-HSOPSC instrument. Internal consistency was acceptable with Cronbach's α values above 0.7 in a major part of the dimensions. CONCLUSIONS The S-HSOPSC, consisting of 14 dimensions, 48 items and 3 single-item outcome measures, is used both in hospitals and in primary care settings in Sweden for different purposes. This version of the original American instrument has acceptable construct validity and internal consistency when tested on large datasets of first-time responders from both hospitals and primary care centres. One common instrument for measurements of patient safety culture in both hospitals and primary care settings is an advantage since it enables comparisons between sectors and assessments of national patient safety improvement programs. Future research into this version of the instrument includes comparing results from patient safety culture measurements with other outcomes in relation to safety improvement strategies.
Collapse
|
research-article |
12 |
50 |
24
|
Rohrmann S, Bechtoldt MN, Leonhardt M. Validation of the Impostor Phenomenon among Managers. Front Psychol 2016; 7:821. [PMID: 27313554 PMCID: PMC4890534 DOI: 10.3389/fpsyg.2016.00821] [Citation(s) in RCA: 49] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2016] [Accepted: 05/17/2016] [Indexed: 12/20/2022] Open
Abstract
Following up on earlier investigations, the present research aims at validating the construct impostor phenomenon by taking other personality correlates into account and to examine whether the impostor phenomenon is a construct in its own right. In addition, gender effects as well as associations with dispositional working styles and strain are examined. In an online study we surveyed a sample of N = 242 individuals occupying leadership positions in different sectors. Confirmatory factor analyses provide empirical evidence for the discriminant validity of the impostor phenomenon. In accord with earlier studies we show that the impostor phenomenon is accompanied by higher levels of anxiety, dysphoric moods, emotional instability, a generally negative self-evaluation, and perfectionism. The study does not reveal any gender differences concerning the impostor phenomenon. With respect to working styles, persons with an impostor self-concept tend to show perfectionist as well as procrastinating behaviors. Moreover, they report being more stressed and strained by their work. In sum, the findings show that the impostor phenomenon constitutes a dysfunctional personality style. Practical implications are discussed.
Collapse
|
Journal Article |
9 |
49 |
25
|
Völter CJ, Tinklenberg B, Call J, Seed AM. Comparative psychometrics: establishing what differs is central to understanding what evolves. Philos Trans R Soc Lond B Biol Sci 2018; 373:20170283. [PMID: 30104428 PMCID: PMC6107573 DOI: 10.1098/rstb.2017.0283] [Citation(s) in RCA: 48] [Impact Index Per Article: 6.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/15/2018] [Indexed: 02/03/2023] Open
Abstract
Cognitive abilities cannot be measured directly. What we can measure is individual variation in task performance. In this paper, we first make the case for why we should be interested in mapping individual differences in task performance onto particular cognitive abilities: we suggest that it is crucial for examining the causes and consequences of variation both within and between species. As a case study, we examine whether multiple measures of inhibitory control for non-human animals do indeed produce correlated task performance; however, no clear pattern emerges that would support the notion of a common cognitive ability underpinning individual differences in performance. We advocate a psychometric approach involving a three-step programme to make theoretical and empirical progress: first, we need tasks that reveal signature limits in performance. Second, we need to assess the reliability of individual differences in task performance. Third, multi-trait multi-method test batteries will be instrumental in validating cognitive abilities. Together, these steps will help us to establish what varies between individuals that could impact their fitness and ultimately shape the course of the evolution of animal minds. Finally, we propose executive functions, including working memory, inhibitory control and attentional shifting, as a sensible starting point for this endeavour.This article is part of the theme issue 'Causes and consequences of individual differences in cognitive abilities'.
Collapse
|
Comparative Study |
7 |
48 |