101
|
Cheng L, Kong J, Xie X, Zhang F. A psychometric assessment of a novel scale for evaluating vaccination attitudes amidst a major public health crisis. Sci Rep 2024; 14:10250. [PMID: 38704420 PMCID: PMC11069544 DOI: 10.1038/s41598-024-61028-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2023] [Accepted: 04/30/2024] [Indexed: 05/06/2024] Open
Abstract
Despite abundant scientific evidence supporting immunization benefits, vaccine hesitancy remains a significant global health concern, particularly during public health crises. Exploring public attitudes towards vaccination is crucial. This study aimed to develop and validate a tailored Public Vaccination Attitudes Scale specifically under the unique circumstances of a public health crisis. A psychometric evaluation was conducted using a cross-sectional study during the peak of a major public health crisis. The scale was developed and its psychometric properties validated using three approaches: (1) generating the item pool through literature research and focus group discussions; (2) assessing the items through expert consultation; and (3) evaluating construct validity, content validity, and internal consistency reliability through exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). Data from a total of 3921 respondents were randomly divided into two subsets, one for EFA (n = 1935) and the other for CFA (n = 1986). A 22-item draft scale with five factors was created after literature research and focus group discussion. The content validity of this scale ranged between 0.88 and 1.00. EFA showed a 17-item scale with four factors (Cronbach's α > 0.7) accounting for 68.044% of the total variance. CFA showed that the values of the fit indices, including convergent validity and discriminant validity, were excellent or acceptable. The overall Cronbach's α was 0.874, and each factor ranged from 0.726 to 0.885. This study introduces a valuable tool for assessing vaccination attitudes during public health crises, aiding researchers, policymakers, and nurses in combating vaccine hesitancy. Emphasizing the importance of fostering vaccine acceptance, it enhances disease control during emergencies, contributing to the knowledge needed for more effective public health strategies and crisis responses.
Collapse
|
102
|
Bezerra M, Domenico EBLD. Cancer patient satisfaction regarding the quality of information received: psychometric validity of EORTC QLQ-INFO25. Rev Bras Enferm 2024; 77:e20230358. [PMID: 38716910 PMCID: PMC11067937 DOI: 10.1590/0034-7167-2023-0358] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2023] [Accepted: 11/25/2023] [Indexed: 05/12/2024] Open
Abstract
OBJECTIVES to psychometrically validate the European Organization for Research and Treatment of Cancer Core Quality of Life Questionnaire EORTC QLQ-INFO25 instrument and identify the domains that influence patients' perception of the information received. METHODS a cross-sectional methodology with cancer patients in a Brazilian philanthropic hospital institution. Sociodemographic and clinical instruments, EORTC QLQ-C30, EORTC QLQ-INFO25 and Supportive Care Needs Survey - Short Form 34 were used. Analysis occurred using Cronbach's alpha coefficients, intraclass correlation, test-retest and exploratory factor analysis. RESULTS 128 respondents participated. Cronbach's alpha coefficient was 0.85. The test-retest obtained p-value=0.21. In the factor analysis, one item was excluded. Satisfaction with the information received was 74%, with three areas with averages below 70%. In open-ended questions, there was a greater desire for information. CONCLUSIONS validity evidence was obtained with instrument reliability, consistency and stability. Respondents expressed satisfaction with the information received.
Collapse
|
103
|
Lorca LA, Sacomori C, Peña C, Barrera C, Salazar M, Leão I, Valladares X, Rojas C. Psychometric properties of the Chilean version of the quality of life questionnaire for multiple myeloma. Rev Bras Enferm 2024; 77:e20230100. [PMID: 38716906 PMCID: PMC11067932 DOI: 10.1590/0034-7167-2023-0100] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2023] [Accepted: 11/25/2023] [Indexed: 05/12/2024] Open
Abstract
OBJECTIVES To evaluate the internal consistency and construct validity of the QLQ-MY20 for assessing the quality of life in multiple myeloma survivors in Chile. METHODS This was a cross-sectional study conducted between March 2020 and December 2022. It involved 118 individuals from two public hospitals. The QLQ-C30 and QLQ-MY20 questionnaires were used. Internal consistency was assessed using Cronbach's alpha(α), and construct validity was evaluated through hypothesis testing (Mann-Whitney and Spearman correlation). RESULTS The average age of participants was 67.2 years (SD=9.2). Internal consistency for the complete scale was α=0.779, for the "disease symptoms" dimension α=0.671, for the "side effects of treatments" dimension α=0.538, and for the "future perspective" dimension α=0.670. Four of the five construct validity hypotheses were confirmed: women, individuals with worse performance status, those with pain, and those with worse fatigue showed more symptoms. CONCLUSIONS The Chilean version of the QLQ-MY20 demonstrates adequate internal consistency and construct validity.
Collapse
|
104
|
Hsieh JH, Chow JC. Development of mobile CAT for patient feedback on pediatric consultations based on Rasch analysis of online techniques. Medicine (Baltimore) 2024; 103:e37993. [PMID: 38701246 PMCID: PMC11062675 DOI: 10.1097/md.0000000000037993] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/31/2023] [Accepted: 04/02/2024] [Indexed: 05/05/2024] Open
Abstract
The Rasch Rating Scale Model (RSM) is widely used in questionnaire analysis, providing insights into how individuals respond to item-level stimuli. Existing software for Rasch RSM parameter estimation, while powerful, often presents a steep learning curve. An accessible online tool can greatly benefit novice users, particularly students and clinicians, by simplifying the analytical process. This study introduces an online tool, an intuitive online RSM analysis tool designed to facilitate questionnaire data analysis for applied researchers, students, and clinicians. The online tool employs the joint maximum likelihood method for estimation, yielding estimates, standard errors (SE), and fit statistics iteratively. A unique feature of the tool is its ability to visualize estimates on Google Maps with an opacity setting of 0, enhancing data interpretation through a user-friendly interface. This study outlines the estimation process and key features, employing data from 200 proxy participants who answered 20 5-point questions regarding doctor-patient and doctor-family interactions in pediatric consultations. Mobile computerized adaptive testing (CAT) was employed. The online tool offers 5 essential visual displays often utilized in Rasch analyses, including the Wright Map, KIDMAP, category probability curve, performance plot, and differential item functioning (DIF) graph. DIF analysis revealed that 2 items, concerning the doctor attentiveness and empathy toward the child illness, exhibited differences in female proxy participants' responses, indicating lower satisfaction with pediatricians. The online tool emerges as a user-friendly and efficient RSM analysis tool with notable advantages for newcomers, improving data visualization and comprehension. Its capacity to pinpoint key areas of concern, such as gender-related satisfaction disparities among proxy participants, enhances its utility in questionnaire analysis. The online tool holds promise as a valuable resource for researchers, students, and clinicians seeking accessible Rasch analysis solutions.
Collapse
|
105
|
Afolalu EF, Salzberger T, Abetz-Webb L, Cano S, Weitkunat R, Rose JE, Chrea C. Development and initial validation of a new self-report measure to assess perceived dependence on tobacco and nicotine products. Sci Rep 2024; 14:10098. [PMID: 38698227 PMCID: PMC11066063 DOI: 10.1038/s41598-024-60790-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2024] [Accepted: 04/26/2024] [Indexed: 05/05/2024] Open
Abstract
How nicotine is administered has evolved from cigarettes to various delivery systems. Assessing perceived dependence on nicotine-containing products now requires accounting for product specificity while allowing comparisons across products and users. This study aims to develop a new self-report measure to assess perceived dependence on tobacco and nicotine products (TNPs) among exclusive and poly-TNP users. A draft version of the new measure, the ABOUT-Dependence, was constructed based on literature review, qualitative research, and expert opinion. Data for scale formation and psychometric assessment was obtained through a US-based web survey (n = 2334) that included additional dependence measures for convergent validity assessment. Qualitative research confirmed a preliminary conceptual framework with seven sub-concepts. Following a cognitive debriefing, 19 items were considered to best represent the different sub-concepts. Psychometric findings supported a three-domain structure [i.e., behavioral impact (five items), signs and symptoms (five items), and extent/timing of use (two items)] and an overall total composite score. The data confirmed convergent and known-group validity, as well as test-retest reliability. The ABOUT-Dependence is a 12-item, psychometrically sound, self-report measure that may be used as a tool for research and further understanding of perceived dependence across the spectrum of TNP and TNP users.
Collapse
|
106
|
Amin S, Ly M, Misener K, Brown N, Libben M. Validation of the translated Negative Physical Self Scale in a sample of Asian women living in Canada. PLoS One 2024; 19:e0301184. [PMID: 38696442 PMCID: PMC11065207 DOI: 10.1371/journal.pone.0301184] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2023] [Accepted: 03/12/2024] [Indexed: 05/04/2024] Open
Abstract
OBJECTIVES Body dissatisfaction is often linked to the internalization of Western beauty standards. Existing measures of body dissatisfaction, developed in Western societies, may fail to capture complex variations across ethnicities and cultures. The Negative Physical Self Scale (NPSS) assesses cognitive, affective, perceptual, and behavioural facets of body dissatisfaction. While unique in its consideration of Chinese ideals of body image, the NPSS has recently been translated and validated in a North American sample. The English-translated version of the NPSS has the potential to be an appropriate body dissatisfaction assessment tool for Asian women living in North America. The current study aims to validate the NPSS in an Asian female population living in Canada. METHODS A sample of 899 undergraduate women residing in Canada with self-identified Asian ethnicity completed an online survey consisting of the NPSS and other measures of body dissatisfaction. RESULTS An initial confirmatory factor analysis indicated that the four-factor structure of the NPSS, previously suggested in a primarily non-Asian North American sample, was a poor fit for the data. A second-order multidimensional model, based on a model proposed during the original development of the NPSS in a Chinese sample, indicated good fit once items were removed due to loadings < .60. High internal consistency between subscales and strong convergent validity with other measures were demonstrated. Notably, the NPSS Body Concern subscale demonstrated high convergence with other popular measures of body dissatisfaction and has the potential for use as a brief measure of body dissatisfaction among North American Asian females in clinical and research settings. CONCLUSIONS The NPSS provides a valid assessment of body dissatisfaction among a sample of Asian women living in Canada, a specific subpopulation that has not been previously investigated. The findings highlight the importance of developing culturally sensitive measures of body dissatisfaction for differing ethnic and cultural groups.
Collapse
|
107
|
Denovan A, Dagnall N, Drinkwater K. The Chronic Time Pressure Inventory: further assessment of factorial structure and validity. PeerJ 2024; 12:e17373. [PMID: 38708348 PMCID: PMC11069352 DOI: 10.7717/peerj.17373] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2023] [Accepted: 04/18/2024] [Indexed: 05/07/2024] Open
Abstract
Background Chronic time pressure represents a prevalent concern within modern society, and effective measurement is crucial for research advancement. The Chronic Time Pressure Inventory (CTPI) has thus far demonstrated adequate psychometric properties. However, only two studies have examined the measure and evidence of its validity is limited. Accordingly, the current investigation, via two independent studies, assessed the factorial composition and validity (convergent/discriminant) of the CTPI. Methods Study 1 (N = 398) examined competing factorial models and validity in relation to the Big Five personality traits (Extraversion, Agreeableness, Conscientiousness, Neuroticism, Openness). Study 2 (N = 358) replicated the analysis of factor structure and assessed validity in comparison with five time perspectives (Past Negative, Present Fatalistic, Future, Past Positive, Present Hedonistic). Participants across both studies completed standardized self-report measures capturing the variables. Results Comparison of confirmatory factor analysis (CFA) and exploratory structural equation modelling (ESEM) factor solutions indicated that an ESEM bifactor model provided the strongest data-model fit. This included a general chronic time pressure component alongside specific subfactors of Feeling Harried and Cognitive Awareness of Time Shortage. All scale items reflected the general factor; however, some items loaded weakly on the intended specific factor. The CTPI is thus a robust indicator of chronic time pressure but needs refinement as a measure of the specific factors. Convergent/discriminant validity analyses inferred that the CTPI captured chronic time pressure as a related, but distinct, construct to perceived stress, and evidenced a relationship with theoretically associated constructs (Big Five personality traits and time perspective). Overall, the CTPI is a sound measure of chronic time pressure and has the potential to further cohesive research efforts on the contribution of this construct to various life domains.
Collapse
|
108
|
Chua YL, Sheri S, Yeo BSQ, Lee NKL, Ng SH, Lim KBL. Can the Lower Extremity Functional Scale Be Used in Children and Adolescents? A Validation Study. J Pediatr Orthop 2024; 44:322-326. [PMID: 38389197 DOI: 10.1097/bpo.0000000000002647] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/24/2024]
Abstract
BACKGROUND The lower extremity functional scale (LEFS) is a patient-reported outcome measure for assessment of lower extremity function. It has been validated in adults but not in children or adolescents. METHODS Patients 8 to 18 years of age who were treated for a lower limb fracture, injury, or other conditions were invited to join the study. LEFS and Pediatric Quality of Life Inventory 4.0 Generic Core Scales (PedsQL) were administered. Reliability and validity of the LEFS were determined for the entire cohort and for 2 age groups (children: 8 to 12 years; adolescents 13 to 18 years) using PedsQL as comparison. RESULTS A total of 178 patients were recruited into this study. In the entire cohort, internal consistency of LEFS was excellent (0. 972) with acceptable floor (0%) and ceiling (12%) effects. Correlation between LEFS and PedsQL physical functioning component was high ( r =0.859). Construct validity was acceptable, with all 8 hypotheses demonstrating statistical significance. Factor analysis showed that item 15 (sitting for 1 hour) may contribute to measurement error in the pediatric population. Results remained similar when comparing the 2 age groups. CONCLUSIONS The LEFS is overall an acceptable patient-reported outcome assessment of children and adolescents with various lower limbs disorders. LEVEL OF EVIDENCE Level II.
Collapse
|
109
|
Ozcalik HB, Aksoy YE. The relationship between maternal functioning and birth memory and trauma. Midwifery 2024; 132:103974. [PMID: 38503117 DOI: 10.1016/j.midw.2024.103974] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2023] [Revised: 03/01/2024] [Accepted: 03/05/2024] [Indexed: 03/21/2024]
Abstract
AIM This study aimed to determine the relationship between birth memory and trauma and maternal functioning in the postpartum period. METHODS This cross-sectional study included 584 mothers in the postpartum period between 1 January 2022 and 1 April 2022. Data were collected using a personal information form, the Barkin Index of Maternal Functioning (BIMF), the Birth Memories and Recall Questionnaire (BirthMARQ) and the City Birth Trauma Scale (CityBiTS). RESULTS The participants' mean scores for the overall BIMF, BirthMARQ and CityBiTS were 81.41 ± 9.28, 80.30 ± 21.21 and 15.85 ± 11.30, respectively. Their sociodemographic characteristics did not affect their maternal functioning; however, maternal functioning improved with the number of pregnancies. While emotional memory (BirthMARQ subscale) negatively affected maternal functioning (p < 0.001), the centrality of memory (BirthMARQ subscale) positively affected maternal functioning (p < 0.001). The hyperarousal (CityBiTS subscale) score significantly and negatively affected the total maternal functioning score, explaining 6 % of its variance (F = 9.176, p = 0.001). CONCLUSION This study demonstrated that birth memory and trauma affected maternal functioning. The mother's functional status in the postpartum period reflects the physical and psychosocial changes associated with pregnancy and birth. Therefore, for women to have positive birth memories and emotions when recalling the birth, their emotional health and physical care should be supported during labour and the postpartum period.
Collapse
|
110
|
Lundell S, Isaksson U, Coe AB, Harrison SL, Hajdarevic S. Swedish translation and psychometric testing of the Self-Conscious Emotions in COPD Questionnaire. Respir Med 2024; 226:107624. [PMID: 38570143 DOI: 10.1016/j.rmed.2024.107624] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/20/2023] [Revised: 03/25/2024] [Accepted: 03/30/2024] [Indexed: 04/05/2024]
Abstract
Assessment of self-conscious emotions is important to develop tailored interventions for people with chronic obstructive pulmonary disease (COPD). Previous instruments have largely been developed for mental health populations. The Self-Conscious Emotions in COPD Questionnaire was the first instrument to assess self-conscious emotions in people with COPD, but it was only available in English. The aim was to translate the Self-Conscious Emotions in COPD Questionnaire into Swedish and to evaluate its psychometric properties and internal structure in a Swedish context. The translation process included forward and backward translation, a multidisciplinary meeting, assessment of content validity, and cognitive interviews. The translated instrument was tested in a sample of 173 people with COPD between September 2021 and September 2022. Parallel analysis (PA), exploratory factor analysis (EFA), and test-retest reliability was performed. The content validity index (CVI) for the instrument was 0.88. Based on the PA, an EFA with a two-factor solution was conducted, with a high Cronbach's alpha (0.786-0.821), and one item about self-blame was excluded. The two factors were labelled: The burden of living with a disability and The desire to hide vulnerability. Test-retest reliability showed no difference between scale scores on factor or item level, except for one item. The Swedish Self-Conscious Emotions in COPD showed good validity and reliability. One item was excluded from the two subscales, indicating that the instrument needs to be further developed to cover the concept of self-blame. The instrument is expected to be a valuable tool for assessing self-conscious emotions in people with COPD.
Collapse
|
111
|
Jorge KB, Viana GS, Jost RT, Rabolini EB, de Oliveira RT, Gorgen ARH, Tavares PM, Rosito TE. Brazilian portuguese validation of the patient-reported outcome measure for urethral stricture surgery (USS-PROM) questionnaire. Int Braz J Urol 2024; 50:261-276. [PMID: 38598829 DOI: 10.1590/s1677-5538.ibju.2023.0602] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2023] [Accepted: 03/04/2024] [Indexed: 04/12/2024] Open
Abstract
INTRODUCTION Urethral stricture is a common, albeit complex, condition that predominantly affects men. The aim of this study was to translate, culturally adapt, and validate the Patient-Reported Outcome Measure questionnaire for patients undergoing urethroplasty (USS-PROM) into Brazilian Portuguese using validated psychometric criteria. MATERIALS AND METHODS The process involved translating and culturally adapting the original USS-PROM into Brazilian Portuguese (USS-PROMbr), synthesizing, back-translating, cross-culturally adapting, and analyzing the pre-final version with experts from our committee. This pre-version was administered to 10 patients who had undergone urethroplasty by the Reconstructive Urology team at the Hospital de Clínicas de Porto Alegre for face validation, linguistic, and semantic adjustments, resulting in the final USS-PROMbr version. Subsequently, well-established psychometric criteria, including content validity, internal consistency, and test-retest reproducibility, were assessed after administering the questionnaire to a total of 56 patients, with 50 of them responding to the test and retest. RESULTS Evaluation of the pre-final version identified 15 questions as clear, and only one question was considered somewhat unclear necessitating modifications based on patient suggestions and subsequent reassessment by the research team. Psychometric criteria demonstrated good content validity, with a content validity index exceeding 0.80 for all questions; good internal consistency, Cronbach's alpha of 0.77, ranging from 0.70 to 0.78 with the exclusion of any item, and item-total correlations ranging from 0.33 to 0.67. The test-retest intraclass correlation coefficient was 0.74 for the lower urinary tract symptoms construct (Q1-Q6). CONCLUSION The USS-PROMbr demonstrated acceptable cross-cultural adaptation and psychometric properties, making it a valid and useful tool for evaluating patients undergoing urethroplasty.
Collapse
|
112
|
Barnett NP, Haikalis M, Meisel MK, Merrill JE, Jones RN, Rosen RK, Carey KB, Orchowski LM, Bradley K. Measuring Exposure to the Hazardous Drinking of Others and Perceived Opportunity to Intervene as a Bystander. J Stud Alcohol Drugs 2024; 85:395-403. [PMID: 38147112 PMCID: PMC11095495 DOI: 10.15288/jsad.23-00042] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2023] [Accepted: 11/30/2023] [Indexed: 12/27/2023] Open
Abstract
OBJECTIVE Excessive alcohol use is very prevalent among young adults, and consequences of drinking are often observed by witnesses. Understanding the circumstances under which witnesses of risky alcohol use help others and whether they perceive these circumstances as an opportunity to engage in bystander intervention are important, but valid measures of these constructs are needed. The current study is a psychometric evaluation of the Exposure to Hazardous Drinking in Others (EHDO) scale and a single-item indicator of Perceived Alcohol-Related Bystander Opportunity (PARBO). METHOD Young adults (N = 1,011; 46.0% women) who reported being around someone who showed signs of alcohol intoxication in the past 3 months were recruited via Qualtrics Panels. The initial item set for the EHDO was developed through qualitative methods and reflected observed or reported risks or consequences. Factor analyses and Item Response Theory analyses were used to reduce and categorize EHDO items, and construct validity was assessed for the EHDO and the PARBO item. RESULTS An initial set of 33 EHDO items was reduced to 21, representing two factors: Situational Risk Signs and Problematic Pattern. Both factors demonstrated good model fit, internal consistency, and evidence of convergent validity. The PARBO item showed good construct validity but was distinct from the EHDO. CONCLUSIONS These instruments are useful for measuring secondhand alcohol risks in a community and are particularly applicable for evaluating bystander intervention for alcohol risk.
Collapse
|
113
|
Riva V, Villa L, Fulceri F, Arduino GM, Leonti G, Valeri G, Casula L, Zoccante L, Puttini E, Sogos C, Presicce M, Bentenuto A, Apicella F, Molteni M, Scattoni ML. The teleNIDA: Early Screening of Autism Spectrum Disorder Through a Novel Telehealth Approach. J Autism Dev Disord 2024; 54:1680-1690. [PMID: 36814040 PMCID: PMC9946866 DOI: 10.1007/s10803-023-05927-6] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/08/2023] [Indexed: 02/24/2023]
Abstract
The COVID-19 pandemic has fast-tracked interest in telehealth methods to guarantee the continuity of care of children with Autism Spectrum Disorder (ASD). Store-and-forward telehealth approaches offer the opportunity to facilitate timely screening of ASD, allowing parents to record videos of their child's behaviors, subsequently shared with clinicians that provide an assessment remotely. This study aimed to examine the psychometric properties of a new telehealth screening tool, the teleNIDA, administered in home settings for remote observation of early signs of ASD in toddlers aged 18-30 months. Results showed good psychometric properties of the teleNIDA, as compared to the gold standard in-person assessment, and the predictive validity on the diagnosis of ASD at 36 months was demonstrated. This study supports the teleNIDA as a promising level 2 screening tool for ASD able to speed up diagnostic and intervention processes.
Collapse
|
114
|
Hardouin JB, Coste J, Leplège A, Rouquette A. Equating and linking Patient-Reported Outcomes Measurement Information System 29-item questionnaire and 36-item Short-Form Health Survey domains using Rasch modeling. J Clin Epidemiol 2024; 169:111326. [PMID: 38479449 DOI: 10.1016/j.jclinepi.2024.111326] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2023] [Revised: 03/02/2024] [Accepted: 03/05/2024] [Indexed: 04/06/2024]
Abstract
OBJECTIVES To develop a simple, practical methodology to equate or link equivalent domains of the 36-item Short-Form Health Survey (SF-36) and the Patient-Reported Outcomes Measurement Information System 29-item questionnaire (PROMIS-29) using the Rasch framework. STUDY DESIGN AND SETTING In April 2016, the PROMIS-29 and SF-36 were completed by 1501 individuals selected to be representative of the French population. For each domain common to the two questionnaires, a Partial Credit Model was fitted to the items related to that dimension in the two questionnaires. These items were then calibrated on the same metric, which enabled the scores from one questionnaire to be associated with the scores from the other. RESULTS Six of the seven PROMIS-29 scales and five of the six SF-36 subscales (physical, pain, social, vitality, depression and anxiety domains) were equated or linked. Correspondence tables between scores, with a 95% confidence interval, were established for each domain. A freely available Stata macro program was developed to automatize the equating or linking process. CONCLUSION These results should facilitate comparisons across studies using the SF-36 and the PROMIS-29 in France. The equating or linking process developed is simple to implement and can be used in other countries and for other instruments.
Collapse
|
115
|
Nguyen TG, Tran BT, Nguyen MT, Le DD. Validation of the Disaster Adaptation and Resilience Scale for Vulnerable Communities in Vietnam's Coastal Regions. J Prev Med Public Health 2024; 57:279-287. [PMID: 38697916 PMCID: PMC11164608 DOI: 10.3961/jpmph.24.110] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2024] [Revised: 04/03/2024] [Accepted: 04/12/2024] [Indexed: 05/05/2024] Open
Abstract
OBJECTIVES This study validated the Vietnamese version of the Disaster Adaptation and Resilience Scale (DARS) for use in vulnerable communities in Vietnam. METHODS This was a cross-sectional study involving 595 adults from 2 identified communities. The original DARS assessment tool was translated, and the validity and reliability of the Vietnamese version of DARS (V-DARS) were assessed. The internal consistency of the overall scale and its subscales was evaluated using Cronbach's alpha and McDonald's omega reliability coefficients. Confirmatory factor analysis (CFA) was employed to evaluate its construct validity, building upon the factor structure identified in exploratory factor analysis (EFA). Construct validity was assessed based on convergent and discriminant validity. RESULTS Following the established criteria for EFA, 8 items were removed, resulting in a refined V-DARS structure comprising 35 items distributed across 5 distinct factors. Both alpha and omega reliability coefficients indicated strong internal consistency for the overall scale (α=0.963, ω=0.963) and for each of the 5 sub-scales (all>0.80). The CFA model also retained the 5-factor structure with 35 items. The model fit indices showed acceptable values (RMSEA: 0.072; CFI: 0.912; TLI: 0.904; chi-square test: <0.01). Additionally, the convergent and discriminant validity of the V-DARS were deemed appropriate and satisfactory for explaining the measurement structure. CONCLUSIONS Our findings suggest that the V-DARS is a valid and reliable scale for use within vulnerable communities in Vietnam to assess adaptive responses to natural disasters. It may also be considered for use in other populations.
Collapse
|
116
|
Meisel MK, Merrill JE, Rosen RK, Jones RN, Haikalis M, Carey KB, Orchowski LM, Bradley K, Doucette H, Barnett NP. How Do Bystanders Help in Drinking Situations: The Bystanders to Alcohol Risk Scale--Strategies. J Stud Alcohol Drugs 2024; 85:404-415. [PMID: 38270912 PMCID: PMC11095492 DOI: 10.15288/jsad.23-00040] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2023] [Accepted: 01/09/2024] [Indexed: 01/26/2024] Open
Abstract
OBJECTIVE Bystander intervention (BI) is a promising approach for promoting collective behavior change that has been applied to several domains, including sexual assault, bullying, and more recently, problematic alcohol use. Accurately measuring the strategies that bystanders use to reduce others' alcohol-related risk is an essential step toward improving bystanders' ability to reduce alcohol-related harm in their communities, but current measures of BI are not easily modifiable and applicable for alcohol-related BI. The current study aimed to develop a valid and reliable measure of the bystander construct most proximal to the reduction of risk: bystander strategies. METHOD Young adults (N = 1,011) who reported being around someone who showed signs of alcohol intoxication in the past 3 months were recruited via Qualtrics Panels to participate in an online survey; a subsample (n = 345) completed a 2-week follow-up. Psychometric evaluation included exploratory and confirmatory factor analyses, item response theory analyses, convergent validity, and test-retest reliability. RESULTS An initial set of 52 items was reduced to 17 items, representing two different factors. The first factor, Level 1, reflected strategies used during circumstances of acute risk. The second factor, Level 2, reflected strategies used to reduce risk for more longstanding problems with alcohol. Both factors demonstrated good model fit, strong internal consistency, evidence of convergent validity, and moderate test-retest reliability. CONCLUSIONS This novel measure can contribute to the production of knowledge about the use and efficacy of peer-focused strategies and the value of BI training for alcohol use.
Collapse
|
117
|
Hang Y, Wang Z, Roets A, Zong M, Bu R, Feng Y, Qiao Z. Psychometric properties of the Chinese version of the 15-item Need for Closure Scale: Scale validation and associations with mental health. J Clin Psychol 2024; 80:1130-1146. [PMID: 38348922 DOI: 10.1002/jclp.23658] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2023] [Revised: 11/27/2023] [Accepted: 01/25/2024] [Indexed: 04/07/2024]
Abstract
BACKGROUND Need for closure (NFC) has been found to be implicated in different forms of psychopathology. The 15-item Need for Closure Scale (NFCS) is an efficient and easy tool for assessing individuals' NFC in Western contexts. However, the psychometric properties of the 15-item NFCS have not yet been validated in Chinese populations. METHODS Two different samples of university students from China were recruited in this study. The first sample (N = 5080, 49.9% females) was used to conduct exploratory factor analysis and reliability analysis. The second sample (N = 3968, 64.2% females) was used to perform confirmatory factor analysis, exploratory structural equation modeling (ESEM), and bifactor models, followed by tests of measurement invariance and criterion validity. RESULTS The full scale showed good internal consistency. The bifactor-ESEM result with a general factor and four specific factors was chosen as our final model. Strong measurement invariance across sex and ethnicity groups was supported. Evidence was obtained for the criterion validity of NFCS scores with respect to depression, anxiety, and psychological distress. CONCLUSION The Chinese NFCS appears to be a valid and reliable instrument for measuring the NFC, which could promote both the assessment and research of the NFC in Chinese populations.
Collapse
|
118
|
Abrán H, Kovács K, Horvát Z, Erőss E, Hollins Martin CJ, Martin CR. Translation and validation of the Hungarian version of the Birth Satisfaction Scale-Revised (BSS-R). Midwifery 2024; 132:103983. [PMID: 38581970 DOI: 10.1016/j.midw.2024.103983] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2023] [Revised: 02/27/2024] [Accepted: 03/25/2024] [Indexed: 04/08/2024]
Abstract
BACKGROUND Evidence relating maternal birth experience to a range of maternal and neonatal outcomes is increasingly compelling. Consequently valid and reliable self-report of birth experience from the mothers perspective is critical. AIM The current study sought to translate and validate a Hungarian-language version of the Birth Satisfaction Scale-Revised (BSS-R). METHOD Following forward and backwards translation into Hungarian, the Hungarian BSS-R (HU-BSS-R) was administered to women in a major Transylvanian hospital maternity unit within 72 h postpartum. Key psychometric characteristics were then examined in relation to factor structure, divergent and convergent validity, internal consistency, and known-groups discriminant validity. RESULTS Two-hundred and thirty-two women completed the HU-BSS-R. Confirmatory factor analysis revealed the HU-BSS-R to offer an excellent fit to data for the established tri-dimensional measurement model. The HU-BSS-R was also found to offer excellent convergent and divergent validity and known-groups discriminant validity. No significant differences were observed between internal consistency observations between the current study and the original UK validation study. CONCLUSIONS The HU-BSS-R is a valid and reliable translation of the original BSS-R, it has proved itself to have excellent psychometric properties and is suitable for use in the Hungarian maternity context.
Collapse
|
119
|
Magalhães E. Dual-factor Models of Mental Health: A Systematic Review of Empirical Evidence. PSYCHOSOCIAL INTERVENTION 2024; 33:89-102. [PMID: 38706709 PMCID: PMC11066810 DOI: 10.5093/pi2024a6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/08/2023] [Accepted: 01/23/2024] [Indexed: 05/07/2024]
Abstract
Objective: Dual-factor models of mental health propose that mental health includes two interrelated yet distinct dimensions - psychopathology and well-being. However, there is no systematization of the evidence following these models. This review aims to address the following research question: what evidence exists using dual-factor models? Method: The current systematic review was conducted using PRISMA guidelines on the following databases: Web-of-science, Scopus, Academic Search Complete, APA PsycArticles, APA PsycInfo, Psychology and Behavioral Sciences Collection, ERIC, and MEDLINE. The screening process resulted in 85 manuscripts that tested the assumptions of dual-factor models. Results: Evidence revealed psychometric substantiation on the two-dimensionality of the dual-factor model, and 85% of the manuscripts provided evidence related to classifying participants into different mental health groups. Most studies showed that the Complete Mental Health or Positive Mental Health group is the most prevalent status group, and longitudinal evidence suggests that most participants (around 50%-64%) remain in the same group across time. Regarding the factors associated with mental health status groups, studies reviewed in this manuscript focus mainly on school-related outcomes, followed by supportive relationships, sociodemographic characteristics, psychological assets, individual attributes, physical health, and stressful events. Conclusions: This review highlights the importance of considering the two dimensions of mental health when conceptualizing, operationalizing, and measuring mental health. Fostering mental health must go beyond reducing symptoms, and practitioners would be able to include well-being-related interventions in their regular practice to improve individuals' mental health outcomes.
Collapse
|
120
|
Bergamin J, Hoven M, van Holst RJ, Bockting CL, Denys D, Nevicka B, Luigjes J. Development and validation of the Autonomy Scale Amsterdam. Compr Psychiatry 2024; 131:152466. [PMID: 38479235 DOI: 10.1016/j.comppsych.2024.152466] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/18/2023] [Revised: 02/13/2024] [Accepted: 02/29/2024] [Indexed: 03/25/2024] Open
Abstract
This paper describes the development and validation of the Autonomy Scale Amsterdam (ASA). We propose that a new measure of autonomy is needed and, as such, we developed and validated an autonomy scale relevant for psychiatry. Based on literature, an expert meeting and three samples of the general population (N = 298, N = 207, N = 309) we provide evidence (a) that supports a 6-factor structure model as a better fit than alternative models with a high reliability to capture the concept of autonomy consisting of: Self-integration, Engagement with life, Goal-directedness, Self-control, External constraints and Social support, (b) for the scale's convergent and discriminant validity with constructs in autonomy's nomological network and (c) for the scale's criterion validity with well-established well-being outcomes, and (d) that the measure is not redundant with a prior measure of autonomy, the autonomy-connectedness scale, and demonstrates incremental validity in the prediction of mental health over and above an existing measure of autonomy. Taken together, the results suggest that the ASA is a useful scale that shows positive evidence of psychometric quality to measure autonomy in a sample of the general population (total N = 856), accounting for a unique predictive value over and above an existing measure of autonomy concerning several mental health outcomes. The ASA can further help our understanding of the role of autonomy in mental disorders.
Collapse
|
121
|
Song Z, Zhang D, Yang L, Zhu P, Liu Y, Wang S, Zheng R. Factor structure and longitudinal invariance for the Chinese Mainland version of the Edinburgh postnatal depression scale during pregnancy. Midwifery 2024; 132:103963. [PMID: 38457994 DOI: 10.1016/j.midw.2024.103963] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2023] [Revised: 02/21/2024] [Accepted: 02/27/2024] [Indexed: 03/10/2024]
Abstract
BACKGROUND There are inconsistent results on the Edinburgh Postnatal Depression Scale's (EPDS) factor structure and longitudinal invariance among different cultures. Furthermore, limited relevant studies in Chinese pregnant women exist. PURPOSE To test the factor structure of the Chinese Mainland EPDS during pregnancy and conduct longitudinal invariance analyses. METHODS A national multi-centre cohort study was conducted among 1207 pregnant women selected consecutively by convenience sampling from five hospitals in Zhuhai, Taiyuan, Haidian, Changchun, and Shenzhen in China between August 2015 and October 2016. Depression was measured by the EPDS during gestational weeks 10-13, 15-18, 23-25, 30-32 and 36-37, respectively.s RESULTS: Three factors with eigenvalues nearly larger than 1.0 were optimal for the Chinese Mainland EPDS, labelled "anxiety," "anhedonia," and "depression," and contained items 3-5, 1-2, and 6-10, respectively. The confirmatory factor analysis results of standardized root mean square residual (SRMR) = 0.034, root mean square error of approximation (RMSEA) = 0.049, comparative fit index (CFI) = 0.968, Tucker-Lewis index (TLI) = 0.954, and χ2, p < 0.05 indicated good fit. For the longitudinal invariance tests, the configural invariance was met, with the CFI and TLI both higher than 0.90 and the RMSEA lower than 0.08 (CFI = 0.919, TLI = 0.908, and RMSEA = 0.034). The metric-, scalar-, and strict invariances were met. CONCLUSIONS The three-factor model of the Chinese Mainland EPDS is invariant in pregnancy, suggesting stability and comparability in identifying the women screened positive at different points during pregnancy and making the scale feasible to screen prenatal depression and anxiety simultaneously.
Collapse
|
122
|
Baggio S, Nsingi N, Iglesias K, Sapin M. Validation of a 9-item Perceived Suicide Awareness Scale (PSAS-9) for adolescents. J Affect Disord 2024; 352:306-311. [PMID: 38387669 DOI: 10.1016/j.jad.2024.02.062] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/02/2023] [Revised: 02/02/2024] [Accepted: 02/16/2024] [Indexed: 02/24/2024]
Abstract
BACKGROUND Robust empirical data on suicide awareness are needed, to better plan and evaluate suicide prevention interventions. However, there is a lack of validated measures of suicide awareness. This is especially true for perceived suicide awareness, which focuses on perceived knowledge about suicide, willingness, and confidence to talk about suicide and get help. Using the theoretical framework of Social Cognitive Theory, this study aimed to validate a measure of perceived suicide awareness. METHODS We re-used data from a suicide prevention trial conducted in Swiss secondary schools (n = 366). Baseline and one-month follow-up data were used to validate the scale. The main measure was an initial 14-item Perceived Suicide Awareness Scale (PSAS). Perceived knowledge of help-seeking resources, suicide-related knowledge, and support networks were used to assess convergent validity. RESULTS A nine-item version, the PSAS-9, showed satisfactory psychometric properties, including high internal consistency (α = 0.78), acceptable test-retest (r = 0.68), and a one-factor structure explaining 95 % of the variance. The convergent validity was acceptable (0.19 ≤ r ≤ 0.40). The PSAS-9 was not correlated with suicide-related knowledge (r = 0.02). LIMITATIONS The study missed a similar construct to properly assess convergent validity and had a modest sample size. In addition, it only included secondary school adolescents, so further research in other samples of youths is needed to robustly validate the PSAS-9. CONCLUSIONS This study was an important step towards validating a perceived suicide awareness scale, which appears as a new dimension of suicidality, distinct from suicide-related knowledge. The PSAS-9 could be used to develop, evaluate, and improve suicide prevention efforts.
Collapse
|
123
|
Safari K, Fadilah N, McKenna L, Hariati S. Quality and measurement properties of sexual health knowledge tools for adolescents: A rapid review. PATIENT EDUCATION AND COUNSELING 2024; 122:108173. [PMID: 38335768 DOI: 10.1016/j.pec.2024.108173] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/29/2023] [Revised: 01/21/2024] [Accepted: 01/23/2024] [Indexed: 02/12/2024]
Abstract
OBJECTIVE To evaluate the effectiveness of instruments designed for assessing sexual and reproductive health knowledge among adolescents. METHODS Rapid review using the 2018 version of the COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN) checklist. RESULTS This review included fourteen studies from 1983-2022, identifying sixteen Patient-Reported Outcome Measures (PROMs), mainly using Likert scales and self-administration. The overall methodological quality was deemed "Inadequate" per COSMIN standards. Although studies often addressed reliability and structural validity, only five covered hypothesis testing. Responsiveness and interpretability were addressed in one study each, while criterion validity was neglected. Among the instruments, the Sexual Health Questionnaire (SHQ) was distinguished for its robustness in several areas including notable construct validity, explaining 68.25% of the variance, high internal consistency (Cronbach's alpha: 0.90), and reliable test-retest results over 7 weeks, confirmed by Wilcoxon nonparametric test. CONCLUSION The study underscores the urgent need for standardised, comprehensive development and validation of the PROMs on sexual health in adolescents. PRACTICE IMPLICATIONS This review highlights the urgent need for research to refine existing PROMs and develop new ones for assessing adolescent sexual and reproductive health knowledge, aligning with global educational commitments and advancing the field.
Collapse
|
124
|
Morawej Z, Misra S, Ametaj AA, Stevenson A, Kyebuzibwa J, Gelaye B, Akena D. Experiences of trauma and psychometric properties of the Life Events Checklist among adults in Uganda. PLoS One 2024; 19:e0298385. [PMID: 38687810 PMCID: PMC11060541 DOI: 10.1371/journal.pone.0298385] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2023] [Accepted: 01/23/2024] [Indexed: 05/02/2024] Open
Abstract
Exposure to potentially traumatic events (PTE) is common and increases an individual's risk of developing post-traumatic stress disorder (PTSD) and other psychiatric disorders. PTEs can be screened with the Life Events Checklist for DSM 5 (LEC-5). However, the psychometric properties of the LEC-5 have never been assessed in Uganda. We aimed to estimate the prevalence of PTEs and evaluate the factor structure of the LEC-5 in a sample of N = 4,479 Ugandan adults between February 2018 -March 2020. We used the phenotyping data from a case-control study (NeuroGAP-Psychosis) in Uganda investigating the genetic and environmental risk factors for psychosis spectrum disorders with 4,479 participants (2,375 cases and 2,104 controls). Prevalence for PTEs was determined for all participants and by case-control status. The factor structure of the LEC-5 was assessed using an exploratory factor analysis (EFA) and a confirmatory factor analysis (CFA). The overall prevalence of exposure to one or more types of PTEs was 60.5%. Cases reported more frequency of exposure to PTEs than controls (64.2% vs 55.4%; p<0.001). The most frequently endorsed traumatic event was physical assault (22.8%), while exposure to toxic substances was the least endorsed (1.7%). There were several differences among the types of events experienced between cases and controls, including cases reporting more experiences of physical (28.6% vs. 16.2%, p<0.001) and sexual assault (11.5% vs. 5.0%, p<0.001) than controls. The EFA yielded a six-factor model that explained 49.8% of the total variance. The CFA showed that a theoretical seven-factor model based on the South African Stress and Health survey was a better fitting model (CFI = 0.935; TLI = 0.908; RMSEA = 0.026) than the EFA. This study revealed a high prevalence of PTEs among cases and controls, and the LEC-5 was found to have good psychometric properties among Ugandan adults.
Collapse
|
125
|
Jones SMW, Weiner BJ. Reliability and validity of intervention characteristic measures for assessing barriers to evidence-based practice use. Transl Behav Med 2024; 14:304-309. [PMID: 38518799 PMCID: PMC11056881 DOI: 10.1093/tbm/ibae013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/24/2024] Open
Abstract
Assessing barriers before implementing an evidence-based practice can increase the chances of successful implementation. This project evaluated measures of intervention characteristics that could affect implementation: evidence strength and quality; relative advantage; adaptability; trialability; complexity; design quality and packaging; perceived cost; compatibility; observability; risk; and burden. Measures (109 items total) for each intervention characteristic were developed in a previous study, using prior measures, and expert feedback. Measures were scored such that higher scores meant a more positive view. Healthcare personnel implementing a new practice (n = 175) completed two surveys, 1 month apart. Participants completed the intervention characteristic item banks and questions on the use of the evidence-based practice. Reliability and validity were assessed for each item bank. All measures had Cronbach's alphas over 0.7 (range: 0.700-0.932) indicating good reliability. Frequent users of the practice reported better levels of each determinant at the first (Cohen's d range: -0.239 to -0.687) and second surveys (Cohen's d range: -0.043 to -1.081) except for costs (0.096) with use on the second survey. This preliminary test of measures to assess determinants of implementing evidence-based practice supports the validity and reliability of these tools. Additional studies are needed to further test the psychometric properties of the measures and develop short forms of each intervention characteristic measure.
Collapse
|