1
|
Bäcklund C, Sörman DE, Gavelin HM, Király O, Demetrovics Z, Ljungberg JK. Comparing psychopathological symptoms, life satisfaction, and personality traits between the WHO and APA frameworks of gaming disorder symptoms: A psychometric investigation. Scand J Psychol 2024; 65:665-682. [PMID: 38475668 DOI: 10.1111/sjop.13010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2023] [Revised: 12/07/2023] [Accepted: 01/27/2024] [Indexed: 03/14/2024]
Abstract
INTRODUCTION The inclusion of Internet Gaming Disorder (IGD) in the fifth revision of the Diagnostic and Statistical Manual of Mental Disorders (DSM-5) by the American Psychiatric Association and Gaming Disorder in the 11th revision of the International Classification of Diseases (ICD-11) by the World Health Organization requires consistent psychological measures for reliable estimates. The current study aimed to investigate the psychometric properties of the Gaming Disorder Test (GDT), the Ten-Item Internet Gaming Disorder Test (IGDT-10), and the Five-Item Gaming Disorder Test (GDT-5) and to compare the WHO and the APA frameworks of gaming disorder symptoms in terms of psychopathological symptoms, life satisfaction, and personality traits. METHODS A sample of 723 Swedish gamers was recruited (29.8% women, 68.3% men, 1.9% other, Mage = 29.50 years, SD = 8.91). RESULTS The results indicated notable differences regarding the estimated possible risk groups between the two frameworks. However, the association between gaming disorder symptoms and personality traits, life satisfaction, and psychopathological symptoms appeared consistent across the two frameworks. The results showed excellent psychometric properties in support of the one-factor model of the GDT, IGDT-10, and GDT-5, including good reliability estimates (McDonald's omega) and evidence of construct validity. Additionally, the results demonstrated full gender and age measurement invariance of the GDT, IGDT-10, and GDT-5, indicating that gaming disorder symptoms are measured equally across the subgroups. CONCLUSION These findings demonstrate that the IGDT-10, GDT-5, and GDT are appropriate measures for assessing gaming disorder symptoms and facilitating future research in Sweden.
Collapse
Affiliation(s)
- Christian Bäcklund
- Department of Health, Education and Technology, Luleå University of Technology, Luleå, Sweden
| | - Daniel Eriksson Sörman
- Department of Health, Education and Technology, Luleå University of Technology, Luleå, Sweden
| | | | - Orsolya Király
- Institute of Psychology, ELTE Eötvös Loránd University, Budapest, Hungary
| | - Zsolt Demetrovics
- Institute of Psychology, ELTE Eötvös Loránd University, Budapest, Hungary
- Centre of Excellence in Responsible Gaming, University of Gibraltar, Gibraltar
| | - Jessica K Ljungberg
- Department of Health, Education and Technology, Luleå University of Technology, Luleå, Sweden
| |
Collapse
|
2
|
Price M, Hidalgo JE, Kim JN, Legrand AC, Brier ZM, van Stolk-Cooke K, Lansing AH, Contractor AA. The Cyborg Method: A Method to Identify Fraudulent Responses from Crowdsourced Data. COMPUTERS IN HUMAN BEHAVIOR 2024; 157:108253. [PMID: 38799787 PMCID: PMC11113431 DOI: 10.1016/j.chb.2024.108253] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/29/2024]
Abstract
Crowdsourcing is an essential data collection method for psychological research. Concerns about the validity and quality of crowdsourced data persist, however. A recent documented increase in the number of invalid responses within crowdsourced data has highlighted the need for quality control measures. Although a number of approaches are recommended, few have been empirically evaluated. The present study evaluated a Cyborg Method that used automated evaluation of participant meta-data and a review of short answer responses. Two samples were recruited - in the first, the Cyborg Method was applied after data collection to gauge the extent to which invalid responses were collected when a priori quality controls were absent. In the second, the Cyborg Method was applied during data collection to determine if the method would proactively screen invalid responses. Results suggested that Cyborg Method identified a substantial portion of invalid responses and both automated and human evaluation components was necessary. Furthermore, the Cyborg Method could be applied proactively to screen invalid responses and substantially reduced the per participant cost of data collection. These results suggest that the Cyborg Method is a promising means by which to collect high quality crowdsourced data.
Collapse
Affiliation(s)
- Matthew Price
- Department of Psychological Science, University of Vermont, 2 Colchester Avenue, Burlington, Vermont, 05405, USA
| | - Johanna E. Hidalgo
- Department of Psychological Science, University of Vermont, 2 Colchester Avenue, Burlington, Vermont, 05405, USA
| | - Julia N. Kim
- Department of Psychological Science, University of Vermont, 2 Colchester Avenue, Burlington, Vermont, 05405, USA
| | - Alison C. Legrand
- Department of Psychological Science, University of Vermont, 2 Colchester Avenue, Burlington, Vermont, 05405, USA
| | - Zoe M.F. Brier
- Department of Psychological Science, University of Vermont, 2 Colchester Avenue, Burlington, Vermont, 05405, USA
| | | | - Amy Hughes Lansing
- Department of Psychological Science, University of Vermont, 2 Colchester Avenue, Burlington, Vermont, 05405, USA
| | | |
Collapse
|
3
|
Kendrick D, Lindley R, Blackburn L, Roadevin C, Thompson E, Andrews I, Anwar F, Brooks A, Carlton E, Crouch R, Day F, Fallon S, Farrin A, Graham L, Hoffman K, Howell R, Holmes J, James M, Jones T, Kellezi B, Kettlewell J, Morriss R, das Nair R, Richardson D, Smith M, Timmons S, Wright-Hughes A, Radford K. Early vocational rehabilitation and psychological support for trauma patients to improve return to work (the ROWTATE trial): study protocol for an individually randomised controlled multicentre pragmatic trial. Trials 2024; 25:439. [PMID: 38956682 PMCID: PMC11221047 DOI: 10.1186/s13063-024-08183-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2023] [Accepted: 05/17/2024] [Indexed: 07/04/2024] Open
Abstract
BACKGROUND Moderately severe or major trauma (injury severity score (ISS) > 8) is common, often resulting in physical and psychological problems and leading to difficulties in returning to work. Vocational rehabilitation (VR) can improve return to work/education in some injuries (e.g. traumatic brain and spinal cord injury), but evidence is lacking for other moderately severe or major trauma. METHODS ROWTATE is an individually randomised controlled multicentre pragmatic trial of early VR and psychological support in trauma patients. It includes an internal pilot, economic evaluation, a process evaluation and an implementation study. Participants will be screened for eligibility and recruited within 12 weeks of admission to eight major trauma centres in England. A total of 722 participants with ISS > 8 will be randomised 1:1 to VR and psychological support (where needed, following psychological screening) plus usual care or to usual care alone. The ROWTATE VR intervention will be provided within 2 weeks of study recruitment by occupational therapists and where needed, by clinical psychologists. It will be individually tailored and provided for ≤ 12 months, dependent on participant need. Baseline assessment will collect data on demographics, injury details, work/education status, cognitive impairment, anxiety, depression, post-traumatic distress, disability, recovery expectations, financial stress and health-related quality of life. Participants will be followed up by postal/telephone/online questionnaires at 3, 6 and 12 months post-randomisation. The primary objective is to establish whether the ROWTATE VR intervention plus usual care is more effective than usual care alone for improving participants' self-reported return to work/education for at least 80% of pre-injury hours at 12 months post-randomisation. Secondary outcomes include other work outcomes (e.g. hours of work/education, time to return to work/education, sickness absence), depression, anxiety, post-traumatic distress, work self-efficacy, financial stress, purpose in life, health-related quality of life and healthcare/personal resource use. The process evaluation and implementation study will be described elsewhere. DISCUSSION This trial will provide robust evidence regarding a VR intervention for a major trauma population. Evidence of a clinically and cost-effective VR intervention will be important for commissioners and providers to enable adoption of VR services for this large and important group of patients within the NHS. TRIAL REGISTRATION ISRCTN: 43115471. Registered 27/07/2021.
Collapse
Affiliation(s)
- Denise Kendrick
- Centre for Academic Primary Care, Lifespan and Population Health, School of Medicine, University Park, Nottingham, NG7 2RD, UK.
| | - Rebecca Lindley
- Centre for Academic Primary Care, Lifespan and Population Health, School of Medicine, University Park, Nottingham, NG7 2RD, UK
| | - Lauren Blackburn
- East Midlands Major Trauma Centre, Nottingham University Hospitals NHS Trust, Nottingham, NG7 2UH, UK
| | - Cristina Roadevin
- Nottingham Clinical Trials Unit, University Park, Nottingham, NG7 2RD, UK
| | - Ellen Thompson
- Leeds Institute of Clinical Trials Research, University of Leeds, Leeds, LS2 9JT, UK
| | - Isabel Andrews
- Centre for Academic Primary Care, Lifespan and Population Health, School of Medicine, University Park, Nottingham, NG7 2RD, UK
| | - Fahim Anwar
- Cambridge University Hospital NHS Foundation Trust, Addenbrooke's Hospital, Cambridge, UK
| | - Adam Brooks
- East Midlands Major Trauma Centre, Nottingham University Hospitals NHS Trust, Nottingham, NG7 2UH, UK
| | - Edd Carlton
- North Bristol NHS Trust Southmead Hospital, Southmead Road, Westbury-On-Trym, Bristol, BS10 5NB, UK
| | - Robert Crouch
- University Hospital Southampton NHS Foundation Trust, Tremona Road, Southampton, S016 6YD, UK
| | - Florence Day
- Leeds Institute of Clinical Trials Research, University of Leeds, Leeds, LS2 9JT, UK
| | - Steve Fallon
- Centre for Academic Primary Care, Lifespan and Population Health, School of Medicine, University Park, Nottingham, NG7 2RD, UK
| | - Amanda Farrin
- Leeds Institute of Clinical Trials Research, University of Leeds, Leeds, LS2 9JT, UK
| | - Laura Graham
- Royal Victoria Infirmary, Queen Victoria Road, Newcastle Upon Tyne, NE1 4LP, UK
| | - Karen Hoffman
- Centre for Trauma Sciences, Barts Health NHS Trust and Queen Mary University London, Blizard Institute, 4 Newark St, London, E1 2AT, UK
| | - Rebekah Howell
- Leeds Institute of Clinical Trials Research, University of Leeds, Leeds, LS2 9JT, UK
| | - Jain Holmes
- Centre for Rehabilitation & Ageing Research (CRAR), Injury, Recovery Sciences and Inflammation (IRIS), School of Medicine, Medical School, University of Nottingham, Nottingham, NG7 2UH, UK
| | - Marilyn James
- Nottingham Clinical Trials Unit, University Park, Nottingham, NG7 2RD, UK
| | - Trevor Jones
- Centre for Academic Primary Care, Lifespan and Population Health, School of Medicine, University Park, Nottingham, NG7 2RD, UK
| | - Blerina Kellezi
- Department of Psychology, Nottingham Trent University, 50 Shakespeare Street, Nottingham, NG1 4FQ, UK
| | - Jade Kettlewell
- Centre for Academic Primary Care, Lifespan and Population Health, School of Medicine, University Park, Nottingham, NG7 2RD, UK
| | - Richard Morriss
- Institute of Mental Health, Innovation Park, Triumph Road, Nottingham, NG7 2TU, UK
| | | | - Davina Richardson
- Imperial College Healthcare NHS Trust, The Bays, South Wharf Road, London, W2 1NY, UK
| | - Matthew Smith
- Academic Department of Rehabilitation Medicine, Leeds General Infirmary, Leeds, LS1 3EX, UK
| | - Stephen Timmons
- Centre for Health Innovation, Leadership and Learning, Nottingham University Business School, Nottingham, NG8 1BB, UK
| | | | - Kathryn Radford
- Centre for Rehabilitation & Ageing Research (CRAR), Injury, Recovery Sciences and Inflammation (IRIS), School of Medicine, Medical School, University of Nottingham, Nottingham, NG7 2UH, UK
| |
Collapse
|
4
|
Hodgson CG, Bonifay W, Yang W, Herman KC. Establishing the measurement precision of the patient health questionnaire in an adolescent sample. J Affect Disord 2023; 342:76-84. [PMID: 37708980 DOI: 10.1016/j.jad.2023.09.013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/18/2023] [Revised: 08/30/2023] [Accepted: 09/08/2023] [Indexed: 09/16/2023]
Abstract
BACKGROUND Technically sound measures are necessary for accurately identifying youth at risk for depression, but many studies rely on classical test theory metrics or adult samples to evaluate measures. This study examined the use of the PHQ-8, a common and freely available pediatric depression screener, in an adolescent sample using item response theory (IRT). METHODS Secondary analyses were conducted on data from a study conducted in Midwestern middle schools in which 1224 youth completed the PHQ-8 as part of a battery of surveys. Polytomous IRT analyses (a Graded Response Model) were used to evaluate the PHQ-8. Items were examined for their ability to distinguish between respondents of different latent depression severity and for differential item functioning (DIF) across demographic categories. RESULTS All PHQ-8 items had adequate discriminative abilities. Items measuring anhedonia and psychomotor disturbances performed relatively poorly, and items measuring somatic symptoms (appetite and sleep) were most informative when respondents endorsed extreme response options ("not at all" or "nearly every day"). No DIF was found across grade level or race, but several items were flagged for DIF by gender and student income level. LIMITATIONS These results might not be generalizable to a broader youth population due to administration setting and the unique demographic characteristics of this sample (76.0 % African American). CONCLUSIONS Tools such as the PHQ-8 are appropriate to quickly screen for depression in adolescents, but further scrutiny of adolescent response patterns is warranted. Future research should examine items measuring anhedonia and psychomotor and somatic disturbances in adolescents.
Collapse
Affiliation(s)
| | - Wes Bonifay
- University of Missouri, Department of Educational, School and Counseling Psychology, Columbia, MO, USA
| | - Wenxi Yang
- University of Missouri, Department of Educational, School and Counseling Psychology, Columbia, MO, USA.
| | - Keith C Herman
- University of Missouri, Department of Educational, School and Counseling Psychology, Columbia, MO, USA
| |
Collapse
|
5
|
Cho LL, Jones AA, Gao C, Leonova O, Vila-Rodriguez F, Buchanan T, Lang DJ, MacEwan GW, Procyshyn RM, Panenka WJ, Barr AM, Thornton AE, Gicas KM, Honer WG, Barbic SP. Rasch analysis of the beck depression inventory in a homeless and precariously housed sample. Psychiatry Res 2023; 326:115331. [PMID: 37437487 DOI: 10.1016/j.psychres.2023.115331] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/26/2023] [Revised: 07/01/2023] [Accepted: 07/02/2023] [Indexed: 07/14/2023]
Abstract
The approach to analysis of and interpretation of findings from the Beck Depression Inventory (BDI), a self-report questionnaire, depends on sample characteristics. To extend work using conventional BDI scoring, the BDI's suitability in assessing symptom severity in a homeless and precariously housed sample was examined using Rasch analysis. Participants (n=478) recruited from an impoverished neighbourhood in Vancouver, Canada, completed the BDI. Rasch analysis using the partial credit model was done, and the structural validity, unidimensionality, and reliability of the BDI were studied. A receiver operating characteristic curve determined a Rasch cut-off score consistent with clinical depression, and Rasch scores were correlated with raw scores. Good fit to the Rasch model was observed after rescoring all items and removing Item 19 (Weight Loss), and unidimensionality and reliability were satisfactory. Item 9 (Suicidal Wishes) represented the most severe symptom. Rasch-based scores detected clinical depression with moderate sensitivity and specificity, and were positively correlated with conventional scores. The BDI in a community-based sample of homeless and precariously housed adults satisfied Rasch model expectations in a 20-item format, and is suitable for assessing symptom severity. Future research on depression in similar samples may reveal more information on using specific symptoms to determine clinical significance.
Collapse
Affiliation(s)
- Lianne L Cho
- Department of Psychiatry, University of British Columbia, Vancouver, British Columbia, Canada; BC Mental Health and Substance Use Services Research Institute, Vancouver, British Columbia, Canada
| | - Andrea A Jones
- Department of Psychiatry, University of British Columbia, Vancouver, British Columbia, Canada; Division of Neurology, Department of Medicine, University of British Columbia, Vancouver, British Columbia, Canada
| | - Chloe Gao
- Department of Occupational Science and Occupational Therapy, University of British Columbia, T325 - 2211 Wesbrook Mall, Vancouver, British Columbia, Canada
| | - Olga Leonova
- Department of Psychiatry, University of British Columbia, Vancouver, British Columbia, Canada
| | - Fidel Vila-Rodriguez
- Department of Psychiatry, University of British Columbia, Vancouver, British Columbia, Canada
| | - Tari Buchanan
- Department of Psychiatry, University of British Columbia, Vancouver, British Columbia, Canada
| | - Donna J Lang
- BC Mental Health and Substance Use Services Research Institute, Vancouver, British Columbia, Canada; Department of Radiology, University of British Columbia, Vancouver, British Columbia, Canada
| | - G William MacEwan
- Department of Psychiatry, University of British Columbia, Vancouver, British Columbia, Canada
| | - Ric M Procyshyn
- Department of Psychiatry, University of British Columbia, Vancouver, British Columbia, Canada; BC Mental Health and Substance Use Services Research Institute, Vancouver, British Columbia, Canada
| | - William J Panenka
- BC Mental Health and Substance Use Services Research Institute, Vancouver, British Columbia, Canada; Division of Neurology, Department of Medicine, University of British Columbia, Vancouver, British Columbia, Canada
| | - Alasdair M Barr
- BC Mental Health and Substance Use Services Research Institute, Vancouver, British Columbia, Canada; Department of Anesthesia, Pharmacology & Therapeutics, University of British Columbia, Vancouver, British Columbia, Canada
| | - Allen E Thornton
- Department of Psychology, Simon Fraser University, Burnaby, British Columbia, Canada
| | - Kristina M Gicas
- Department of Psychology, York University, Toronto, Ontario, Canada
| | - William G Honer
- Department of Psychiatry, University of British Columbia, Vancouver, British Columbia, Canada; BC Mental Health and Substance Use Services Research Institute, Vancouver, British Columbia, Canada
| | - Skye P Barbic
- Department of Occupational Science and Occupational Therapy, University of British Columbia, T325 - 2211 Wesbrook Mall, Vancouver, British Columbia, Canada.
| |
Collapse
|
6
|
Christensen KS, Sparle-Christensen M. Comparing the construct validity of the Patient Health Questionnaire (PHQ-9) and the Major Depression Inventory (MDI) using Rasch analysis. J Affect Disord 2023; 333:44-50. [PMID: 37084961 DOI: 10.1016/j.jad.2023.04.053] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/16/2022] [Revised: 04/01/2023] [Accepted: 04/14/2023] [Indexed: 04/23/2023]
Abstract
OBJECTIVE The Patient Health Questionnaire (PHQ-9) and the Major Depression Inventory (MDI) are psychometric instruments frequently used for depression diagnosis and monitoring in primary care settings. The goal of this study was to assess and compare the construct validity of the PHQ-9 and the MDI using Rasch analysis. METHODS The PHQ-9 and the MDI were distributed in random ordering (first or last) to a waiting room sample of Danish primary care patients. Analysis of fit to the Rasch model, ordering of response categories, dimensionality-testing, test for differential item functioning, test for local dependency, and calculation of reliability indices were used to evaluate the psychometric characteristics of the instruments. RESULTS A sample of 281 persons (18-87 years, 72 % females) responded to both instruments. Reliability was acceptable for PHQ-9 (PSI 0.80) and excellent for MDI (PSI 0.88). Both instruments demonstrated fit to the Rasch model after rescoring of all items. Dimensionality testing supports that both instruments are unidimensional. Indication of local dependency was observed for PHQ-9 item 2&6 and MDI item 1&4. No indication of differential item functioning regarding age, gender or ordering of instruments was found. CONCLUSION The PHQ-9 and the MDI both demonstrate measurement problems. Modifying individual items and reducing the number of response categories in both instruments could potentially improve their measurement capabilities. Study findings do not provide a conclusive indication of which instrument has superior operating characteristics.
Collapse
Affiliation(s)
- Kaj Sparle Christensen
- Research Unit for General Practice, Aarhus, Denmark; Department of Public Health, Aarhus University, Denmark.
| | | |
Collapse
|
7
|
Carrozzino D, Christensen KS, Patierno C, Siri C, Zecchinelli A, Pezzoli G, Cosci F. The Hopkins Symptom Checklist (SCL-90-R): A Patient-Reported Outcome Measure in Parkinson's Disease. J Geriatr Psychiatry Neurol 2022; 35:689-697. [PMID: 34971324 DOI: 10.1177/08919887211060020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Objective: This is the first study applying Clinimetric Patient-Reported Outcome Measures (CLIPROM) criteria to evaluate the construct validity, sensitivity, and clinical utility of the SCL-90-R in patients with Parkinson's disease (PD). Methods: A Rasch analysis was conducted using a sample of 488 PD outpatients. Results: Testing for dimensionality revealed that less than 5% of t-tests were significant, indicating that the SCL-90-R subscales entailed the property of construct validity. As to the total score, a Person Separation Reliability Index of .96 was found. Conclusions: The SCL-90-R total score is a sensitive screening measure that can be used not only to differentiate healthy stress reactions from symptoms of psychological distress but also to detect PD patients with an increased risk for psychiatric complications. As to the subscales, the brief versions that did not include misfitting items should be used to assess the severity of specific symptoms of psychological distress affecting PD patients.
Collapse
Affiliation(s)
- Danilo Carrozzino
- Department of Psychology "Renzo Canestrari", 9296University of Bologna, Bologna, Italy
| | - Kaj Sparle Christensen
- Research Unit for General Practice and Section for General Medical Practice, Department of Public Health, 1006Aarhus University, Aarhus, Denmark
| | - Chiara Patierno
- Department of Psychology "Renzo Canestrari", 9296University of Bologna, Bologna, Italy
| | - Chiara Siri
- Rehabilitation Unit, 89497Moriggia Pelascini Hospital, Como, Italy
| | | | - Gianni Pezzoli
- 18605Parkinson Institute, Pini-CTO, Milan, Italy.,Fondazione Grigioni per Il Morbo di Parkinson, Milan, Italy
| | - Fiammetta Cosci
- Department of Health Sciences, 9300University of Florence, Florence, Italy.,Department of Psychiatry & Neuropsychology, Maastricht University, Maastricht, The Netherlands
| |
Collapse
|
8
|
Carrozzino D, Christensen KS, Patierno C, Woźniewicz A, Møller SB, Arendt IMTP, Zhang Y, Yuan Y, Sasaki N, Nishi D, Berrocal Montiel C, Ceccatelli S, Mansueto G, Cosci F. Cross-cultural validity of the WHO-5 Well-Being Index and Euthymia Scale: A clinimetric analysis. J Affect Disord 2022; 311:276-283. [PMID: 35609763 DOI: 10.1016/j.jad.2022.05.111] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/04/2022] [Revised: 05/16/2022] [Accepted: 05/18/2022] [Indexed: 12/15/2022]
Abstract
BACKGROUND The assessment of psychological well-being and euthymia represents an emerging issue in clinical psychology and psychiatry. Rating scales and indices such as the 5-item version of the World Health Organization Well-Being Index (WHO-5) and the Euthymia Scale (ES) were developed but insufficient attention has been devoted to the evaluation of their cross-cultural validity. This is the first study using Clinimetric Patient-Reported Outcome Measures (CLIPROM) criteria to assess cross-cultural validity and sensitivity of five different versions of the WHO-5 and ES. METHODS A multicenter cross-sectional study involving a total of 3762 adult participants from different European (i.e., Italy, Poland, Denmark) and non-European (i.e., China, Japan) countries was conducted. Item Response Theory models (Mokken and Rasch analyses) were applied. RESULTS Mokken coefficients of scalability were found to range from 0.42 to 0.84. The majority of the versions of the WHO-5 fitted the Rasch model expectations. Paired t-tests revealed that the Italian and Danish WHO-5 versions were unidimensional. Person Separation Reliability indices showed that the Polish, Danish, and Japanese ES versions could reliably discriminate between subjects with different levels of euthymia. LIMITATIONS A convenience sampling was used, thus limiting the generalizability of study findings. In addition, no measures of negative mental health were administered. CONCLUSIONS WHO-5 can be used in international studies for cross-cultural comparisons since it covers transcultural components of subjective well-being. Findings also suggest that the ES can be used as a cross-cultural screening tool since it entailed the clinimetric property of sensitivity.
Collapse
Affiliation(s)
- Danilo Carrozzino
- Department of Psychology "Renzo Canestrari", Alma Mater Studiorum University of Bologna, Bologna, Italy
| | - Kaj Sparle Christensen
- Research Unit for General Practice and Section for General Medical Practice, Department of Public Health, Aarhus University, Aarhus, Denmark
| | - Chiara Patierno
- Department of Psychology "Renzo Canestrari", Alma Mater Studiorum University of Bologna, Bologna, Italy
| | - Agnieszka Woźniewicz
- Department of Geriatrics, Faculty of Health Sciences, Collegium Medicum in Bydgoszcz, Nicolaus Copernicus University in Toruń, Poland
| | | | | | - Yuqun Zhang
- School of Nursing, Nanjing University of Chinese Medicine, Nanjing, China; Department of Psychosomatics and Psychiatry, Zhongda Hospital, Southeast University, Nanjing, China
| | - Yonggui Yuan
- Department of Psychosomatics and Psychiatry, Zhongda Hospital, Southeast University, Nanjing, China
| | - Natsu Sasaki
- Department of Mental Health, Graduate School of Medicine, University of Tokyo, Tokyo, Japan
| | - Daisuke Nishi
- Department of Mental Health, Graduate School of Medicine, University of Tokyo, Tokyo, Japan
| | - Carmen Berrocal Montiel
- Department of Surgical, Medical and Molecular Pathology, and Critical Care Medicine, University of Pisa, Pisa, Italy
| | - Sara Ceccatelli
- Department of Health Sciences, University of Florence, via di San Salvi 12, 50135 Florence, Italy
| | - Giovanni Mansueto
- Department of Health Sciences, University of Florence, via di San Salvi 12, 50135 Florence, Italy; Department of Psychology, Sigmund Freud University, Ripa di Porta Ticinese, 77, 20143 Milan, Italy
| | - Fiammetta Cosci
- Department of Health Sciences, University of Florence, via di San Salvi 12, 50135 Florence, Italy; Department of Psychiatry & Neuropsychology, Maastricht University, PO Box 616, Maastricht, the Netherlands.
| |
Collapse
|
9
|
Chinnarasri P, Wongpakaran N, Wongpakaran T. Developing and Validating the Narcissistic Personality Scale (NPS) among Older Thai Adults Using Rasch Analysis. Healthcare (Basel) 2021; 9:healthcare9121717. [PMID: 34946443 PMCID: PMC8701268 DOI: 10.3390/healthcare9121717] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2021] [Revised: 12/02/2021] [Accepted: 12/09/2021] [Indexed: 11/21/2022] Open
Abstract
Background: Being older could be stressful, especially among people with narcissistic personality disorders. Nevertheless, the tool is yet to be available among older Thai individuals. The study aimed to develop a tool to detect symptoms of narcissistic personality, and to validate its psychometric properties among older Thai adults. Methods: The Narcissistic Personality Scale (NPS) was developed based on nine domain symptoms of narcissistic personality disorder from the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5), consisting of 80 items. The original scale was field-tested using Rasch analysis for item reduction, rendering a final 43 items. NPS was further investigated among 296 seniors aged 60 years old. Rasch analysis was used to assess its construct validity. Result: Of 43 items, 17 were further removed as infit or outfit mean square >1.5. The final 26-item NPS met all necessary criteria of unidimensionality and local independence without differential item functioning due to age and sex, and good targeting with subjects. Person and item reliability were 0.88 and 0.95, respectively. No disordered threshold or category was found. Conclusions: The NPS is a promising tool with a proven construct validity based on the Rasch measurement model among Thai seniors. This new questionnaire can be used as outcome measures in clinical practice.
Collapse
|
10
|
Mansueto G, Carrozzino D, Sparle Christensen K, Cardellicchio S, Pezzuto A, Abrams K, Zvolensky M, Cosci F. Clinimetric properties of the Smoking Abstinence Expectancies Questionnaire. Addict Behav 2021; 123:107061. [PMID: 34359015 DOI: 10.1016/j.addbeh.2021.107061] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2021] [Revised: 07/16/2021] [Accepted: 07/23/2021] [Indexed: 10/20/2022]
Abstract
Smoking abstinence expectancies are beliefs about negative and positive short-term psychological and physiological consequences of not smoking. The Smoking Abstinence Expectancies Questionnaire (SAEQ) is a widely used Patient-Reported Outcome Measure (PROM) to assess smoking abstinence expectancies. It has four subscales: negative mood, somatic symptoms, harmful consequences, positive consequences. Although studied from a psychometric perspective, the SAEQ needs further evaluation. Clinimetrics, and its Clinimetric Criteria for Patient-Reported Outcome Measures (CLIPROM), offers a robust method to evaluate the SAEQ. We verified construct validity and sensitivity of the Italian version of the SAEQ applying CLIPROM criteria. A total of 293 adult Italian smokers were consecutively enrolled at two smoking cessation clinics and assessed via the SAEQ. Item Response Theory models (i.e., combining Rasch and Mokken analyses) were used to test construct validity and sensitivity. The total score of the SAEQ was not found to be unidimensional but each SAEQ subscale score was. PSI (0.90) indicated that the total score of the SAEQ could reliably discriminate between respondents with different levels of the trait under assessment, whereas SAEQ subscales on negative mood and harmful consequences could reliably distinguish between different groups but not between different subjects (PSI ranging from 0.77 and 0.78). Overall, the total score of the SAEQ is a sensitive screening PROM and can be used at smoking cessation clinics to discriminate between subjects with different levels of smoking abstinence expectancies. SAEQ subscales should be used to detect severity and subjective burden of a wide range of expected effects of nicotine abstinence.
Collapse
|
11
|
Mordeno IG, Nalipay MJN, Luzano JGC, Galela DS, Ferolino MAL. Development and validation of a DSM-5-based generalized anxiety disorder self-report Scale: Investigating frequency and intensity rating differences. CURRENT PSYCHOLOGY 2021. [DOI: 10.1007/s12144-019-00475-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
|
12
|
Carrozzino D, Sparle Christensen K, Mansueto G, Cosci F. Construct validity of the Smoker Complaint Scale: A clinimetric analysis using Item Response Theory (IRT) models. Addict Behav 2021; 117:106849. [PMID: 33610959 DOI: 10.1016/j.addbeh.2021.106849] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2020] [Revised: 01/20/2021] [Accepted: 01/24/2021] [Indexed: 11/26/2022]
Abstract
A number of rating scales evaluating symptoms of nicotine withdrawal have been developed over the years but insufficient attention has been devoted to the assessment of their clinimetric properties. Clinimetrics, the science of clinical measurements, is an innovative approach, particularly useful for assessing the validity of rating scales. This is the first study using clinimetric principles to test the construct validity of the Smoker Complaint Scale (SCS), a self-rating scale specifically developed to assess acute symptoms of nicotine withdrawal. Construct validity was evaluated via Item Response Theory (IRT) models (i.e., combining Rasch and Mokken analyses). A total of 366 subjects (mean age = 34.0, SD = 11.3 years) participated in the study. IRT analyses showed that SCS was a multidimensional measure of symptoms of nicotine withdrawal, including unidimensional subscales, particularly a four-item subscale (the SCS4), which was found to entail the clinimetric property of construct validity. IRT analyses also revealed that affective symptoms of nicotine withdrawal preceded cognitive ones. The SCS should be considered as an item bank, including a particularly valid subscale, the SCS4 that can be used as a screening or outcome measure to evaluate the severity of cognitive and affective symptoms of nicotine withdrawal. SCS4 is a sensitive clinimetric index which differentiates "ceiling symptoms" of nicotine withdrawal (e.g., "feeling slowed down") from "floor symptoms" of nicotine withdrawal (e.g., "feeling lightheaded") that emerge in the severe form of nicotine withdrawal.
Collapse
|
13
|
Jiraniramai S, Wongpakaran T, Angkurawaranon C, Jiraporncharoen W, Wongpakaran N. Construct Validity and Differential Item Functioning of the PHQ-9 Among Health Care Workers: Rasch Analysis Approach. Neuropsychiatr Dis Treat 2021; 17:1035-1045. [PMID: 33854319 PMCID: PMC8041649 DOI: 10.2147/ndt.s271987] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/05/2021] [Accepted: 03/22/2021] [Indexed: 11/28/2022] Open
Abstract
PURPOSE The Patient Health Questionnaire (PHQ-9) is a widely used self-report questionnaire to screen depression. Its psychometric property has been tested in many populations including health care workers. We used Rasch measurement theory to examine the psychometric properties of PHQ-9 regarding item difficulty, item fit and the differences between subgroups of respondents classified by sex, age, education and alcohol user status, based on the same overall location of participants. PATIENTS AND METHODS In total, 3204 health care workers of Maharaj Nakorn Chiang Mai Hospital participated and were administered the PHQ-9. Rating scale Rasch measurement modeling was used to examine the psychometric properties of the PHQ-9. RESULTS The data fitted well to the Rasch model and no violations of the assumption of unidimensionality were observed. All 9 items could form a unidimensional construct of overall depressive severity. Suicidal ideation was the least endorsed while sleep problem was the most. No disordered category and threshold of the rating response were observed. No locally dependent items were observed. No items were found to show differential item functioning across age, sex, education and alcohol consumption. The item-person Wright map showed that the PHQ-9 did not target well with the sample, and a wide gap suggesting few or no items exist to differentiate participants at a certain ability level among the PHQ-9 items. CONCLUSION The PHQ-9 can be used as a screening questionnaire for major depressive disorder as its psychometric property was verified based on Rasch measurement model. The findings are generally consistent with related studies in other populations. However, the PHQ-9 may be unsuitable for assessing depressive symptoms among health care workers who have low levels of depression.
Collapse
Affiliation(s)
- Surin Jiraniramai
- Department of Family Medicine, Faculty of Medicine, Chiang Mai University, Chiang Mai, Kingdom of Thailand
| | - Tinakon Wongpakaran
- Department of Psychiatry, Faculty of Medicine, Chiang Mai University, Chiang Mai, Kingdom of Thailand
| | - Chaisiri Angkurawaranon
- Department of Family Medicine, Faculty of Medicine, Chiang Mai University, Chiang Mai, Kingdom of Thailand
| | - Wichuda Jiraporncharoen
- Department of Family Medicine, Faculty of Medicine, Chiang Mai University, Chiang Mai, Kingdom of Thailand
| | - Nahathai Wongpakaran
- Department of Psychiatry, Faculty of Medicine, Chiang Mai University, Chiang Mai, Kingdom of Thailand
| |
Collapse
|
14
|
Carlozzi NE, Goodnight S, Kratz AL, Stout JC, McCormack MK, Paulsen JS, Boileau NR, Cella D, Ready RE. Validation of Neuro-QoL and PROMIS Mental Health Patient Reported Outcome Measures in Persons with Huntington Disease. J Huntingtons Dis 2020; 8:467-482. [PMID: 31424415 DOI: 10.3233/jhd-190364] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/24/2023]
Abstract
BACKGROUND Patient-reported outcomes (PROs) for mental health are important for persons with Huntington disease (HD) who commonly experience symptoms of depression, anxiety, irritability, anger, aggression, and apathy. Given this, there is a need for reliable and valid patient-reported outcomes measures of mental health for use as patient-centered outcomes in clinical trials. OBJECTIVE Thus, the purpose of this study was to establish the psychometric properties (i.e., reliability and validity) of six Neuro-QoL and PROMIS mental health measures to support their clinical utility in persons with HD. METHODS 294 individuals with premanifest (n = 102) or manifest HD (n = 131 early HD; n = 61 late HD) completed Neuro-QoL/PROMIS measures of Emotional and Behavioral Dyscontrol, Positive Affect and Well-Being, Stigma, Anger, Anxiety, and Depression, legacy measures of self-reported mental health, and clinician-rated assessments of functioning. RESULTS Convergent validity and discriminant validity for the Neuro-QoL and PROMIS measures of Emotional and Behavioral Dyscontrol, Positive Affect and Well-Being, Stigma, Anger, Anxiety, and Depression, were supported in persons with HD. Neuro-QoL measures of Anxiety and Depression also demonstrated moderate sensitivity and specificity (i.e., they were able to distinguish between individuals with and without clinically significant anxiety and depression). CONCLUSIONS Findings provide psychometric support for the clinical utility of the Neuro-QoL/PROMIS measures of mental health measures in persons with HD. As such, these measures should be considered for the standardized assessment of health-related quality of life in persons with HD.
Collapse
Affiliation(s)
- Noelle E Carlozzi
- Department of Physical Medicine and Rehabilitation, University of Michigan, Ann Arbor, MI, USA
| | - Siera Goodnight
- Department of Physical Medicine and Rehabilitation, University of Michigan, Ann Arbor, MI, USA
| | - Anna L Kratz
- Department of Physical Medicine and Rehabilitation, University of Michigan, Ann Arbor, MI, USA
| | - Julie C Stout
- Institute of Cognitive and Clinical Neurosciences, School of Psychological Sciences, Monash University, Clayton, Victoria, Australia
| | - Michael K McCormack
- Department of Psychiatry, Rutgers-Robert Wood Johnson Medical School, Piscataway, NJ, USA.,Department of Pathology, Rowan-School of Medicine, Stratford, NJ, USA
| | - Jane S Paulsen
- Departments of Psychiatry, Neurology, and Psychology, Carver College of Medicine, The University of Iowa, Iowa City, IA, USA
| | - Nicholas R Boileau
- Department of Physical Medicine and Rehabilitation, University of Michigan, Ann Arbor, MI, USA
| | - David Cella
- Departments of Medical Social Sciences and Preventative Medicine, Northwestern University, Chicago, IL, USA
| | - Rebecca E Ready
- Department of Psychological and Brain Sciences, University of Massachusetts, Amherst, MA, USA
| |
Collapse
|
15
|
Lentz L, Silverstone PH, Krameddine YI. High Rates of Mental Health Disorders in Civilian Employees Working in Police Organizations. Front Psychol 2020; 11:1031. [PMID: 32547453 PMCID: PMC7270335 DOI: 10.3389/fpsyg.2020.01031] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2020] [Accepted: 04/24/2020] [Indexed: 11/13/2022] Open
Abstract
Working in a police organization often involves being exposed to potentially traumatic events and stressful circumstances regardless of occupation or rank. Police mental health is a public health concern, but the mental health of civilian employees working in police organizations has been much less studied. The current study aims to compare the frequency of mental health conditions in both police officers and civilians. This was evaluated by measuring mean scores on several mental health screening tools including scales to determine symptom severity for posttraumatic stress disorder (PTSD) with the PTSD Checklist - PCL-5, depression with the Patient Health Questionnaire-9 (PHQ), general anxiety with the Generalized Anxiety Disorder 7-item scale (GAD-7), and alcohol use with the Alcohol Use Disorders Identification Test (AUDIT). The total potential population was 1,225 civilian employees and 3,714 police officers, of which 513 (10%) participated. Of these, 201 (16%) were civilians, and 312 (8%) were police officers (p<0.001). In the study population, 26% screened positive for any mental health disorder. Somewhat surprisingly, we found significantly more civilians (32.8%) than police officers (22.7%) met diagnostic criteria. We also found that civilian participants had higher mean scores in measures of PTSD, anxiety, and depression, although only for depression did this reach statistical significance. Civilians were 1.7 times more likely to screen positive for depression compared to police officers, a statistically significant difference. In contrast, police officers demonstrated statistically higher scores for alcohol use than civilians. One limitation of this study is that the data reflects responses from only a minority of the overall population and, therefore, may not accurately reflect the frequency of mental health issues in the total police organization including civilian employees. Nonetheless, the results strongly suggest that the mental health of all employees can be negatively impacted by working in a police environment, and this is important given the growing number of civilians employed within police organizations. These findings support initiatives aimed at destigmatizing mental health disorders, improving stress management, and increasing access to mental health care on an organization-wide basis, and not just limited to front-line police officers.
Collapse
Affiliation(s)
- Liana Lentz
- Department of Psychiatry, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, AB, Canada
| | - Peter H Silverstone
- Department of Psychiatry, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, AB, Canada
| | - Yasmeen I Krameddine
- Department of Psychiatry, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, AB, Canada
| |
Collapse
|
16
|
He C, Levis B, Riehm KE, Saadat N, Levis AW, Azar M, Rice DB, Krishnan A, Wu Y, Sun Y, Imran M, Boruff J, Cuijpers P, Gilbody S, Ioannidis JP, Kloda LA, McMillan D, Patten SB, Shrier I, Ziegelstein RC, Akena DH, Arroll B, Ayalon L, Baradaran HR, Baron M, Beraldi A, Bombardier CH, Butterworth P, Carter G, Chagas MH, Chan JCN, Cholera R, Clover K, Conwell Y, de Man-van Ginkel JM, Fann JR, Fischer FH, Fung D, Gelaye B, Goodyear-Smith F, Greeno CG, Hall BJ, Harrison PA, Härter M, Hegerl U, Hides L, Hobfoll SE, Hudson M, Hyphantis T, Inagaki M, Ismail K, Jetté N, Khamseh ME, Kiely KM, Kwan Y, Lamers F, Liu SI, Lotrakul M, Loureiro SR, Löwe B, Marsh L, McGuire A, Mohd-Sidik S, Munhoz TN, Muramatsu K, Osório FL, Patel V, Pence BW, Persoons P, Picardi A, Reuter K, Rooney AG, Santos IS, Shaaban J, Sidebottom A, Simning A, Stafford L, Sung S, Tan PLL, Turner A, van Weert HC, White J, Whooley MA, Winkley K, Yamada M, Thombs BD, Benedetti A. The Accuracy of the Patient Health Questionnaire-9 Algorithm for Screening to Detect Major Depression: An Individual Participant Data Meta-Analysis. PSYCHOTHERAPY AND PSYCHOSOMATICS 2019; 89:25-37. [PMID: 31593971 PMCID: PMC6960351 DOI: 10.1159/000502294] [Citation(s) in RCA: 56] [Impact Index Per Article: 11.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/02/2019] [Accepted: 07/19/2019] [Indexed: 12/15/2022]
Abstract
BACKGROUND Screening for major depression with the Patient Health Questionnaire-9 (PHQ-9) can be done using a cutoff or the PHQ-9 diagnostic algorithm. Many primary studies publish results for only one approach, and previous meta-analyses of the algorithm approach included only a subset of primary studies that collected data and could have published results. OBJECTIVE To use an individual participant data meta-analysis to evaluate the accuracy of two PHQ-9 diagnostic algorithms for detecting major depression and compare accuracy between the algorithms and the standard PHQ-9 cutoff score of ≥10. METHODS Medline, Medline In-Process and Other Non-Indexed Citations, PsycINFO, Web of Science (January 1, 2000, to February 7, 2015). Eligible studies that classified current major depression status using a validated diagnostic interview. RESULTS Data were included for 54 of 72 identified eligible studies (n participants = 16,688, n cases = 2,091). Among studies that used a semi-structured interview, pooled sensitivity and specificity (95% confidence interval) were 0.57 (0.49, 0.64) and 0.95 (0.94, 0.97) for the original algorithm and 0.61 (0.54, 0.68) and 0.95 (0.93, 0.96) for a modified algorithm. Algorithm sensitivity was 0.22-0.24 lower compared to fully structured interviews and 0.06-0.07 lower compared to the Mini International Neuropsychiatric Interview. Specificity was similar across reference standards. For PHQ-9 cutoff of ≥10 compared to semi-structured interviews, sensitivity and specificity (95% confidence interval) were 0.88 (0.82-0.92) and 0.86 (0.82-0.88). CONCLUSIONS The cutoff score approach appears to be a better option than a PHQ-9 algorithm for detecting major depression.
Collapse
Affiliation(s)
- Chen He
- Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada
- Department of Epidemiology, Biostatistics and Occupational Health, McGill University, Montréal, Québec, Canada
| | - Brooke Levis
- Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada
- Department of Epidemiology, Biostatistics and Occupational Health, McGill University, Montréal, Québec, Canada
| | - Kira E. Riehm
- Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada
| | - Nazanin Saadat
- Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada
| | - Alexander W. Levis
- Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada
- Department of Epidemiology, Biostatistics and Occupational Health, McGill University, Montréal, Québec, Canada
| | - Marleine Azar
- Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada
- Department of Epidemiology, Biostatistics and Occupational Health, McGill University, Montréal, Québec, Canada
| | - Danielle B. Rice
- Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada
- Department of Psychology, McGill University, Montréal, Québec, Canada
| | - Ankur Krishnan
- Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada
| | - Yin Wu
- Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada
- Department of Epidemiology, Biostatistics and Occupational Health, McGill University, Montréal, Québec, Canada
- Department of Psychiatry, McGill University, Montréal, Québec, Canada
| | - Ying Sun
- Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada
| | - Mahrukh Imran
- Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada
| | - Jill Boruff
- Schulich Library of Physical Sciences, Life Sciences, and Engineering, McGill University, Montreal, Quebec, Canada
| | - Pim Cuijpers
- Department of Clinical, Neuro and Developmental Psychology, Amsterdam Public Health Research Institute, Vrije Universiteit, Amsterdam, the Netherlands
| | - Simon Gilbody
- Hull York Medical School and the Department of Health Sciences, University of York, Heslington, York, UK
| | - John P.A. Ioannidis
- Department of Medicine, Department of Health Research and Policy, Department of Biomedical Data Science, Department of Statistics, Stanford University, Stanford, California, USA
| | | | - Dean McMillan
- Hull York Medical School and the Department of Health Sciences, University of York, Heslington, York, UK
| | - Scott B. Patten
- Department of Community Health Sciences, University of Calgary, Calgary, Alberta, Canada
- Hotchkiss Brain Institute and O'Brien Institute for Public Health, University of Calgary, Calgary, Alberta, Canada
| | - Ian Shrier
- Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada
- Department of Epidemiology, Biostatistics and Occupational Health, McGill University, Montréal, Québec, Canada
| | - Roy C. Ziegelstein
- Department of Medicine, Johns Hopkins University School of Medicine, Baltimore, Maryland, USA
| | - Dickens H. Akena
- Department of Psychiatry, Makerere University College of Health Sciences, Kampala, Uganda
| | - Bruce Arroll
- Department of General Practice and Primary Health Care, University of Auckland, New Zealand
| | - Liat Ayalon
- Louis and Gabi Weisfeld School of Social Work, Bar Ilan University, Ramat Gan, Israel
| | - Hamid R. Baradaran
- Endocrine Research Center, Institute of Endocrinology and Metabolism, Iran University of Medical Sciences, Tehran, Iran
- Ageing Clinical & Experimental Research Team, Institute of Applied Health Sciences, School of Medicine, Medical Sciences and Nutrition, University of Aberdeen, Aberdeen, Scotland, UK
| | - Murray Baron
- Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada
- Department of Medicine, McGill University, Montréal, Québec, Canada
| | - Anna Beraldi
- Kbo-Lech-Mangfall-Klinik Garmisch-Partenkirchen, Klinik für Psychiatrie, Psychotherapie & Psychosomatik, Lehrkrankenhaus der Technischen Universität München, Munich, Germany
| | - Charles H. Bombardier
- Department of Rehabilitation Medicine, University of Washington, Seattle, Washington, USA
| | - Peter Butterworth
- Centre for Research on Ageing, Health and Wellbeing, Research School of Population Health, The Australian National University, Canberra, Australia
- Melbourne Institute of Applied Economic and Social Research, University of Melbourne, Melbourne, Australia
| | - Gregory Carter
- Centre for Brain and Mental Health Research, University of Newcastle, New South Wales, Australia
| | - Marcos H. Chagas
- Department of Neurosciences and Behavior, Ribeirão Preto Medical School, University of São Paulo, Ribeirão Preto, Brazil
| | - Juliana C. N. Chan
- Department of Medicine and Therapeutics, Prince of Wales Hospital, The Chinese University of Hong Kong, Hong Kong Special Administrative Region, China
- Asia Diabetes Foundation, Prince of Wales Hospital, Hong Kong Special Administrative Region, China
- Hong Kong Institute of Diabetes and Obesity, Hong Kong Special Administrative Region, China
| | - Rushina Cholera
- Department of Pediatrics, University of North Carolina at Chapel Hill School of Medicine, Chapel Hill, North Carolina, USA
| | - Kerrie Clover
- Centre for Brain and Mental Health Research, University of Newcastle, New South Wales, Australia
- Psycho-Oncology Service, Calvary Mater Newcastle, New South Wales, Australia
| | - Yeates Conwell
- Department of Psychiatry, University of Rochester Medical Center, Rochester, New York, USA
| | | | - Jesse R. Fann
- Department of Psychiatry and Behavioral Sciences, University of Washington, Seattle, Washington, USA
| | - Felix H. Fischer
- Department of Psychosomatic Medicine, Center for Internal Medicine and Dermatology, Charité - Universitätsmedizin Berlin, Germany
| | - Daniel Fung
- Department of Child & Adolescent Psychiatry, Institute of Mental Health, Singapore
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore
- Programme in Health Services & Systems Research, Duke-NUS Medical School, Singapore
| | - Bizu Gelaye
- Department of Epidemiology, Harvard T. H. Chan School of Public Health, Boston, Massachusetts, USA
| | | | - Catherine G. Greeno
- School of Social Work, University of Pittsburgh, Pittsburgh, Pennsylvania, USA
| | - Brian J. Hall
- Global and Community Mental Health Research Group, Department of Psychology, Faculty of Social Sciences, University of Macau, Macau Special Administrative Region, China
- Department of Health, Behavior, and Society, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland, USA
| | | | - Martin Härter
- Department of Medical Psychology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Ulrich Hegerl
- Department of Psychiatry, Psychosomatics and Psychotherapy, Goethe-Universität Frankfurt, German Depression Foundation, Frankfurt, Germany
| | - Leanne Hides
- School of Psychology, University of Queensland, Brisbane, Queensland, Australia
| | - Stevan E. Hobfoll
- STAR-Stress, Anxiety, and Resilience Consultants, Chicago, Illinois, USA
| | - Marie Hudson
- Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada
- Department of Medicine, McGill University, Montréal, Québec, Canada
| | - Thomas Hyphantis
- Faculty of Medicine, School of Health Sciences, University of Ioannina, Ioannina, Greece
| | - Masatoshi Inagaki
- Department of Psychiatry, Faculty of Medicine, Shimane University, Shimane, Japan
| | - Khalida Ismail
- Department of Psychological Medicine, Institute of Psychiatry, Psychology and Neurosciences, King's College London Weston Education Centre, London, UK
| | - Nathalie Jetté
- Department of Community Health Sciences, University of Calgary, Calgary, Alberta, Canada
- Hotchkiss Brain Institute and O'Brien Institute for Public Health, University of Calgary, Calgary, Alberta, Canada
- Department of Neurology, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Mohammad E. Khamseh
- Endocrine Research Center, Institute of Endocrinology and Metabolism, Iran University of Medical Sciences, Tehran, Iran
| | - Kim M. Kiely
- School of Psychology, University of New South Wales, Sydney, Australia
- Neuroscience Research Australia, Sydney, Australia
| | - Yunxin Kwan
- Department of Psychological Medicine, Tan Tock Seng Hospital, Singapore
| | - Femke Lamers
- Department of Psychiatry, Amsterdam Public Health Research Institute, Amsterdam UMC, Vrije Universiteit, Amsterdam, the Netherlands
| | - Shen-Ing Liu
- Programme in Health Services & Systems Research, Duke-NUS Medical School, Singapore
- Department of Psychiatry, Mackay Memorial Hospital, Taipei, Taiwan
- Department of Medical Research, Mackay Memorial Hospital, Taipei, Taiwan
- Department of Medicine, Mackay Medical College, Taipei, Taiwan
| | - Manote Lotrakul
- Department of Psychiatry, Faculty of Medicine, Ramathibodi Hospital, Mahidol University, Bangkok, Thailand
| | - Sonia R. Loureiro
- Department of Neurosciences and Behavior, Ribeirão Preto Medical School, University of São Paulo, Ribeirão Preto, Brazil
| | - Bernd Löwe
- Department of Psychosomatic Medicine and Psychotherapy, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Laura Marsh
- Baylor College of Medicine, Houston and Michael E. DeBakey Veterans Affairs Medical Center, Houston, Texas, USA
| | - Anthony McGuire
- Department of Nursing, St. Joseph's College, Standish, Maine, USA
| | - Sherina Mohd-Sidik
- Cancer Resource & Education Centre, and Department of Psychiatry, Faculty of Medicine and Health Sciences, Universiti Putra Malaysia, Serdang, Selangor, Malaysia
| | - Tiago N. Munhoz
- Post-graduate Program in Epidemiology, Federal University of Pelotas, Pelotas, RS, Brazil
| | - Kumiko Muramatsu
- Department of Clinical Psychology, Graduate School of Niigata Seiryo University, Niigata, Japan
| | - Flávia L. Osório
- Department of Neurosciences and Behavior, Ribeirão Preto Medical School, University of São Paulo, Ribeirão Preto, Brazil
- National Institute of Science and Technology, Translational Medicine, Ribeirão Preto, Brazil
| | - Vikram Patel
- Department of Global Health and Social Medicine, Harvard Medical School, Boston, Massachusetts, USA
- Department of Global Health and Population, Harvard T.H. Chan School of Public Health, Boston, Massachusetts, USA
| | - Brian W. Pence
- Department of Epidemiology, Gillings School of Global Public Health, The University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA
| | - Philippe Persoons
- Department of Adult Psychiatry, University Hospitals Leuven, Leuven, Belgium
- Department of Neurosciences, Katholieke Universiteit Leuven, Leuven, Belgium
| | - Angelo Picardi
- Centre for Behavioural Sciences and Mental Health, Italian National Institute of Health, Rome, Italy
| | - Katrin Reuter
- Practice for Psychotherapy and Psycho-oncology, Freiburg, Germany
| | - Alasdair G. Rooney
- Division of Psychiatry, Royal Edinburgh Hospital, University of Edinburg, Edinburgh, Scotland, UK
| | - Iná S. Santos
- Post-graduate Program in Epidemiology, Federal University of Pelotas, Pelotas, RS, Brazil
| | - Juwita Shaaban
- Department of Family Medicine, School of Medical Sciences, Universiti Sains Malaysia, Kelantan, Malaysia
| | | | - Adam Simning
- Department of Psychiatry, University of Rochester Medical Center, Rochester, New York, USA
| | - Lesley Stafford
- Centre for Women's Mental Health, Royal Women's Hospital, Parkville, Australia
- Melbourne School of Psychological Sciences, University of Melbourne, Australia
| | - Sharon Sung
- Department of Child & Adolescent Psychiatry, Institute of Mental Health, Singapore
- Programme in Health Services & Systems Research, Duke-NUS Medical School, Singapore
| | | | - Alyna Turner
- School of Medicine and Public Health, University of Newcastle, New South Wales, Newcastle, Australia
- IMPACT Strategic Research Centre, School of Medicine, Deakin University, Geelong, Victoria, Australia
| | - Henk C. van Weert
- Department of General Practice, Amsterdam Institute for General Practice and Public Health, Amsterdam University Medical Centers, Amsterdam, the Netherlands
| | | | - Mary A. Whooley
- Department of Epidemiology and Biostatistics, University of California San Francisco, San Francisco, California, USA
- Department of Medicine, Veterans Affairs Medical Center, San Francisco, California, USA
- Department of Medicine, University of California San Francisco, San Francisco, California, USA
| | - Kirsty Winkley
- Florence Nightingale Faculty of Nursing, Midwifery & Palliative Care, King's College London, London, UK
| | - Mitsuhiko Yamada
- Department of Neuropsychopharmacology, National Institute of Mental Health, National Center of Neurology and Psychiatry, Ogawa-Higashi, Kodaira, Tokyo, Japan
| | - Brett D. Thombs
- Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada
- Department of Epidemiology, Biostatistics and Occupational Health, McGill University, Montréal, Québec, Canada
- Department of Psychology, McGill University, Montréal, Québec, Canada
- Department of Psychiatry, McGill University, Montréal, Québec, Canada
- Department of Medicine, McGill University, Montréal, Québec, Canada
- Department of Educational and Counselling Psychology, McGill University, Montréal, Québec, Canada
| | - Andrea Benedetti
- Department of Epidemiology, Biostatistics and Occupational Health, McGill University, Montréal, Québec, Canada
- Department of Medicine, McGill University, Montréal, Québec, Canada
- Respiratory Epidemiology and Clinical Research Unit, McGill University Health Centre, Montréal, Québec, Canada
| |
Collapse
|
17
|
Schupp JC, Fichtner UA, Frye BC, Heyduck-Weides K, Birring SS, Windisch W, Criée CP, Müller-Quernheim J, Farin E. Psychometric properties of the German version of the Leicester Cough Questionnaire in sarcoidosis. PLoS One 2018; 13:e0205308. [PMID: 30286204 PMCID: PMC6171952 DOI: 10.1371/journal.pone.0205308] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2018] [Accepted: 09/21/2018] [Indexed: 12/19/2022] Open
Abstract
Background Cough is one of the most common symptoms in general and pulmonary medicine with profound negative impact on health-related quality of life (HRQL). The Leicester Cough Questionnaire (LCQ) is a validated HRQL questionnaire, yet a validated German version of the LCQ is not available and it has never been tested in a cohort with sarcoidosis. Objectives To translate the LCQ into German and determine its psychometric properties. Methods The LCQ was translated in a forward-backward approach. Structured interviews in sarcoidosis patients were performed. Subsequently, sarcoidosis patients were asked to answer the German LCQ and comparative questionnaires. Distribution properties, item difficulty, concurrent validity, Rasch model fit and internal consistency of the German LCQ were determined. Results 200 patients with sarcoidosis were included. We provide evidence for reliability, unidimensionality and internal consistency. However, only a moderate correlation with general and respiratory-specific HRQL questionnaires, no Rasch model fit could be shown. Skewed responses caused by floor effects were detected. Conclusion We demonstrate that the German LCQ is valid and reliable and its psychometric properties fulfil the standards required for its use in clinical settings as well as in interventional trials.
Collapse
Affiliation(s)
- Jonas Christian Schupp
- Department of Pneumology, Faculty of Medicine, University Medical Centre, Freiburg, Germany
- Section of Pulmonary, Critical Care and Sleep Medicine, Yale University School of Medicine, New Haven, Connecticut, United States of America
| | - Urs Alexander Fichtner
- Institute for Quality Management and Social Medicine, Faculty of Medicine, University Medical Centre, Freiburg, Germany
| | - Björn Christian Frye
- Department of Pneumology, Faculty of Medicine, University Medical Centre, Freiburg, Germany
| | - Katja Heyduck-Weides
- Institute for Quality Management and Social Medicine, Faculty of Medicine, University Medical Centre, Freiburg, Germany
| | - Surinder S. Birring
- Division of Asthma, Allergy and Lung Biology, King’s College London, London, United Kingdom
| | - Wolfram Windisch
- Department of Pneumology, Cologne-Merheim Hospital, Kliniken der Stadt Köln gGmbH, Witten/Herdecke University Hospital, Cologne, Germany
| | - Carl-Peter Criée
- Department of Sleep and Respiratory Medicine, Evangelical Hospital Göttingen-Weende, Bovenden, Germany
| | | | - Erik Farin
- Institute for Quality Management and Social Medicine, Faculty of Medicine, University Medical Centre, Freiburg, Germany
- * E-mail:
| |
Collapse
|
18
|
Felt JM, Castaneda R, Tiemensma J, Depaoli S. Using Person Fit Statistics to Detect Outliers in Survey Research. Front Psychol 2017; 8:863. [PMID: 28603512 PMCID: PMC5445123 DOI: 10.3389/fpsyg.2017.00863] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2017] [Accepted: 05/11/2017] [Indexed: 11/13/2022] Open
Abstract
Context: When working with health-related questionnaires, outlier detection is important. However, traditional methods of outlier detection (e.g., boxplots) can miss participants with “atypical” responses to the questions that otherwise have similar total (subscale) scores. In addition to detecting outliers, it can be of clinical importance to determine the reason for the outlier status or “atypical” response. Objective: The aim of the current study was to illustrate how to derive person fit statistics for outlier detection through a statistical method examining person fit with a health-based questionnaire. Design and Participants: Patients treated for Cushing's syndrome (n = 394) were recruited from the Cushing's Support and Research Foundation's (CSRF) listserv and Facebook page. Main Outcome Measure: Patients were directed to an online survey containing the CushingQoL (English version). A two-dimensional graded response model was estimated, and person fit statistics were generated using the Zh statistic. Results: Conventional outlier detections methods revealed no outliers reflecting extreme scores on the subscales of the CushingQoL. However, person fit statistics identified 18 patients with “atypical” response patterns, which would have been otherwise missed (Zh > |±2.00|). Conclusion: While the conventional methods of outlier detection indicated no outliers, person fit statistics identified several patients with “atypical” response patterns who otherwise appeared average. Person fit statistics allow researchers to delve further into the underlying problems experienced by these “atypical” patients treated for Cushing's syndrome. Annotated code is provided to aid other researchers in using this method.
Collapse
Affiliation(s)
- John M Felt
- Psychological Sciences, University of California, MercedMerced, CA, United States
| | - Ruben Castaneda
- Psychological Sciences, University of California, MercedMerced, CA, United States
| | - Jitske Tiemensma
- Psychological Sciences, University of California, MercedMerced, CA, United States
| | - Sarah Depaoli
- Psychological Sciences, University of California, MercedMerced, CA, United States
| |
Collapse
|