An introduction to Item Response Theory and Rasch Analysis of the Eating Assessment Tool (EAT-10)

Generalisability of the Barthel Index and the Functional Independence Measure: robustness of disability measures to Differential Item Functioning

PURPOSE

Differential Item Functioning (DIF), an item malfunctioning, causes Differential Test Functioning (DTF), thus biasing questionnaire measures. The current study evaluates the relationship between DIF and DTF for the Barthel Index and the Functional Independence Measure, likely the most used disability measures. The aim is to understand under which conditions DIF can be ignored as its DTF is negligible.

METHODS

A simulation study was run. Disability measures were obtained for the Barthel Index and FIM motor domain using Rasch analysis with previously published item calibrations. Several DIF scenarios have been assessed. DTF was tolerable if ≤0.50 logits.

RESULTS

Simulations showed that the larger the DIF, the larger the DTF and that, keeping the overall DIF constant, the total number of items with DIF does not affect DTF. DIF of the items with the lowest or highest calibrations is the most dangerous. The DIF of central items should be so massive to matter in DTF terms that it is unlikely to happen in practice. The FIM robustness to DIF is better than that of the Barthel Index.

CONCLUSIONS

The FIM and the Barthel Index show remarkable robustness to DIF. Thanks to this feature, sample invariant, generalisable disability measures are available.

Characterizing social communication among minimally verbal children with autism: An application of item response theory

Minimally verbal children constitute a portion of the autism spectrum. The paucity of proper measurement tools that sensitively and accurately assess behaviors has been one limiting factor in the improved knowledge of these children. Short of creating and validating a new measurement tool for this subpopulation, this study took an alternative and more immediate approach: conduct a secondary data analysis and examine an existing social communication measure, the Early Social Communication Scales (ESCS), with item response theory. The final sample consisted of 453 minimally verbal children culled from four different completed studies. The IRT models analyzed the frequency of social communication gestures from the ESCS and returned an objective difficulty hierarchy regarding initiations of joint attention and behavior regulation gestures. The best-fitting and final model was a zero-inflated negative binomial model (ZINBM), which determined that joint attention gestures were, on average, more difficult than behavior regulation gestures. Joint attentional shows and gives were essentially absent in the children's repertoire, and behavior regulation reaches were the easiest gestures for this sample. The ZINBM separately modeled children with some gestures and children who did not present with any gestures and determined that behavior regulation reaches and gives were likely the first gestures a child will eventually exhibit among children with no gestures. Methodological contributions and potential future applications of IRT are discussed.

Patient-Reported Outcome Measures for Swallowing: A Proposed Checklist

PURPOSE

Patient-reported outcome measures (PROMs) are an important tool both in clinical practice and research involving patients with swallowing disorders. There are several challenges to be overcome and methodological details to be adequately reported to ensure rigor and transparency in studies utilizing PROMs in dysphagia research. For this reason, the Framework for RigOr aNd Transparency In REseaRch on Swallowing (FRONTIERS), a critical appraisal tool developed to ensure rigor and transparency in dysphagia research, has devoted a domain to PROMs. The aim of this current article, as part of a larger forum of articles, is to present the PROM section of FRONTIERS and describe its development.

METHOD

A literature review was carried out on PROMs in the field of dysphagia by three members of the FRONTIERS collaborative to identify items that were necessary for the rigorous application and transparent reporting of PROMs utilized in research of swallowing disorders in human subjects. Framework items were then subjected to an iterative process of feedback and consensus among the three members of the working group as well as all members of the FRONTIERS collaborative. Items were flagged for review and revised as needed until consensus was achieved on the final list. The final item list was compared to existing critical appraisal tools for PROMs.

RESULTS

The final checklist for the PROMs domain included 20 "Yes/No" questions that can be broadly divided into three categories: (a) development and validation, (b) patient population, and (c) PROM administration method. Each item is presented with a rationale for its inclusion.

CONCLUSIONS

The use of the FRONTIERS Framework will serve researchers and those appraising quality of research involving PROMs. More broadly, the FRONTIERS Framework will facilitate improved rigor and transparency across dysphagia research. Special considerations and future goals are discussed.

Evaluation of the Open-Ended Green Chemistry Generic Comparison (GC)2 Prompt for Probing Student Conceptions about the Greenness of a Chemical Reaction

One key limitation for assessing student knowledge of green chemistry is the lack of readily available assessments capable of eliciting reliable and valid data. Therefore, in this study we sought to evaluate the ability of a previously reported open-ended prompt [J. Chem. Educ.2019, 96 ( (11), ), 2410-2419. DOI: 10.1021/acs.jchemed.9b00277] to probe student conceptions about the greenness of chemical reactions. Responses to this prompt, which we titled the Green Chemistry Generic Comparison (GC)2 prompt, were collected from students enrolled in organic chemistry I and II lecture and laboratory courses (N = 642) and from students enrolled in general chemistry II lecture courses (N = 272). This prompt was found to be sensitive for detecting gains in green chemistry knowledge in pre- and post- conditions. Furthermore, psychometric analysis revealed that, while addressing certain green chemistry principles was well within the students' ability range, other principles exceeded that range. These findings indicate that this prompt provides a rapid and effective method for both measuring student knowledge and eliciting student conceptions of the green chemistry principles.

V, Sinha SP, Singh A, Karmakar S. Development and validation of a structured questionnaire to assess the Knowledge, Attitude and Practice (KAP) regarding the effect of yoga on periodontal health among Indian adults

Background

Periodontal disease is a chronic inflammatory disease of structures surrounding the teeth. Its etiology is multifactorial. The primary etiological factor is the microbial component; the other factors are systemic, behavioral, environmental, and psychological. Conventional management includes routine periodontal therapy involving prophylactic and surgical management. In developing countries like India, complementary medicine and alternative medicines like yoga are gaining popularity for improving systemic health. Hence this pilot study was designed to assess the psychometric properties of a structured questionnaire that can assess knowledge, attitude, and practice (KAP) regarding the impact of yoga on oral and periodontal health in Indian population.

Methods

The KAP questionnaire was developed (Stage One) using a deductive approach, and a psychometric evaluation of the questionnaire was performed to evaluate it's reliability and validity (Stage Two). Initial content validation and test re-test reliability were assessed using kappa statistics with binary responses. An intraclass correlation coefficient (ICC) was used to assess the questions in the practice and attitude category with categorical variables. Further assessment of psychometric properties of the questionnaire was done using item response theory. The developed questionnaire had four principal sections: demography of participants; knowledge regarding yoga and oral health; attitude towards yoga and oral health; and practice towards implementing yoga for oral health.

Results

The ICC for all the assessed questions was greater than 0.60 suggesting satisfactory stability. Internal consistency measured using Cronbach's alpha for knowledge, attitude, and practice items were reported to be 0.632, 0.923, and 0.591 respectively and that of the KAP total was 0.632.

Conclusions

The findings of this study showed that the questionnaire had an acceptable psychometric property for measuring KAP regarding yoga and it's role in oral and periodontal health among Indian adults. The analysis of participant responses revealed that they had a medium level of knowledge regarding yoga and periodontal disease.

A Psychometric Evaluation of the Dysphagia Handicap Index Using Rasch Analysis

Background/Objectives: The Dysphagia Handicap Index (DHI) is commonly used in oropharyngeal dysphagia (OD) research as a self-report measure of functional health status and health-related quality of life. The DHI was developed and validated using classic test theory. The aim of this study was to use item response theory (Rasch analysis) to evaluate the psychometric properties of the DHI. Methods: Prospective, consecutive patient data were collected at dysphagia or otorhinolaryngology clinics. The sample included 256 adults (53.1% male; mean age 65.2) at risk of OD. The measure's response scale, person and item fit characteristics, differential item functioning, and dimensionality were evaluated. Results: The rating scale was ordered but showed a potential gap in the rating category labels for the overall measure. The overall person (0.91) and item (0.97) reliability was excellent. The overall measure reliably separated persons into at least three distinct groups (person separation index = 3.23) based on swallowing abilities, but the subscales showed inadequate separation. All infit mean squares were in the acceptable range except for the underfitting for item 22 (F). More misfitting was evident in the Z-Standard statistics. Differential item functioning results indicated good performance at an item level for the overall measure; however, contrary to expectation, an OD diagnosis presented only with marginal DIF. The dimensionality of the DHI showed two dimensions in contrast to the three dimensions suggested by the original authors. Conclusions: The DHI failed to reproduce the original three subscales. Caution is needed using the DHI subscales; only the DHI total score should be used. A redevelopment of the DHI is needed; however, given the complexities involved in addressing these issues, the development of a new measure that ensures good content validity may be preferred.

Comparing ability and norm-referenced scores as clinical trial outcomes for neurodevelopmental disabilities: a simulation study

BACKGROUND

For genetic conditions associated with neurodevelopmental disorder (GCAND), developmental domains such as motor ability, thinking and learning, social abilities, and communication are potential intervention targets. Performance on measures of developmental concepts can be expressed using several types of scores. Norm-referenced scores are intended for the diagnostic context, allowing for the identification of impairment relative to age-based expectations, and can exhibit dramatic floor effects when used in individuals with more significant limitations. Person ability scores, which are derived via Rasch analysis or item response theory, are available on many standardized tests and are intended to measure within-person change. However, they have not been used or evaluated as primary endpoints in GCAND clinical trials. In this study, we simulated a series of parallel-arm clinical trials under several chronological age and impairment conditions, to compare empirically the power and type I error rate of operationalizing test performance using ability scores rather than norm-referenced scores.

RESULTS

Using the Vineland Adaptive Behavior Scales as the example, we demonstrated an advantage in statistical power of ability scores over norm-referenced scores at extreme levels of impairment. This advantage was at least partially driven by floor effects in norm-referenced scores. For simulated conditions where impairment was less severe, ability scores outperformed norm-referenced scores, but they were more similar. The type I error rate closely approximated the nominal type I error rate of 5% for both scores.

CONCLUSION

The results of this simulation demonstrate a substantial power and interpretative advantage of ability scores over norm-referenced scores for studies of GCAND that will enroll participants with high levels of impairment. These results are expected to generalize to studies of developmental concepts, regardless of the etiology or specific test. However, the relative advantage of ability scores is expected to be even greater for tests with a higher floor than the Vineland.

Access and Use of Health Services by People with Diabetes from the Item Response Theory

The objective of this study was to analyze the indicators of access and use of health services in people with diabetes mellitus. This study used data from the National Health Survey, conducted in Brazil in 2013. The National Health Survey was carried out with adults aged 18 years or older residing in permanent private households in Brazil. Indicators from 492 individuals with self-reported diabetes mellitus living in the Central-West region of the country were analyzed. Item response theory was used to estimate the score for access to and use of health services. Multiple linear regression was used to analyze factors associated with scores of access and use of health services by people with diabetes mellitus. The mean score of access estimated by the item response theory and use estimated was 51.4, with the lowest score of zero (lowest access and use) and the highest 100 (highest access and use). Among the indicators analyzed, 74.6% reported having received medical care in the last 12 months and 46.4% reported that the last visit occurred in primary care. Only 18.9% had their feet examined and 29.3% underwent eye examinations. Individuals of mixed-race/skin color and those residing outside capital and metropolitan regions had lower access and use scores when compared to white individuals and residents of state capitals, respectively. The study shows several gaps in the indicators of access and use of health services by people with diabetes. People of mixed race/skin color and residents outside the capitals and metropolitan regions had lower scores for access and use, suggesting the need to increase health care in these groups.

Analyses of the TCU Drug Screen 5: Using an Item Response Theory Model with a Sample of Juvenile Justice Youth

It is important to identify substance use disorders among youth who enter the juvenile justice system using a validated screener, such as the Texas Christian University Drug Screen 5 (TCU DS 5), so that necessary services can be provided to youth in need of treatment. While the TCU DS 5 is a valid, evidence-based screener, the use of an Item Response Theory model may better differentiate between mild, moderate, and severe forms of substance use disorders. The current study analyzed the feasibility and incremental value gained in using an Item Response Theory model to compute drug use severity scores as compared to its current scoring methodology. Results showed that while Item Response Theory may not be worthwhile as the standard method of scoring, item level analyses revealed there are benefits to using Item Response Theory to determine which items on a screener are most suggestive of severe substance use problems.

A psychometric reevaluation of the TCU criminal thinking scales (CTS)

In the United States, approximately 9 million people cycle in and out of jail and more than 600,000 people are released from prison each year. Unfortunately, the reentry process includes several barriers people must overcome (e.g., criminal thinking) to achieve adequate psychosocial functioning. As such, valid and reliable assessments that allow correctional staff to monitor clients' progress in treatment and test program effectiveness are paramount to reducing this major public safety concern. The TCU Criminal Thinking Scales (CTS) are a widely used assessment of criminal thinking in correctional settings. This study reevaluated the psychometric properties of the TCU CTS using Item Response Theory. Results showed the TCU CTS had good internal reliability and each scale loaded onto one factor. Item level analysis revealed most items adequately fit the model, generally measuring moderate levels of criminal thinking. Furthermore, several TCU CTS scales were negatively correlated with motivation for treatment and psychosocial functioning.

Measuring the Sexual Acceptability of Contraception: Psychometric Examination and Development of a Valid and Reliable Prospective Instrument

BACKGROUND

People's sexual experiences have a strong association with contraceptive satisfaction and continuation, but no measures exist to specifically assess contraceptive-related sexual acceptability.

AIM

This study developed and examined the psychometric properties of reliability, separation, and item fit of a new Contraceptive Sexual Acceptability (CSA) instrument.

METHODS

Enrolled participants initiating a new contraceptive method from the HER Salt Lake longitudinal cohort study contributed baseline survey responses for scale development. The study included the Female Sexual Function Index, the New Sexual Satisfaction Scale, measures of physical and mood-related side effects, and self-reported perceptions of contraception's sexual impacts. Items from these measures' served as the basis for analyses. We analyzed responses using descriptive techniques and modeled using exploratory factor (EFA) and bifactor analyses (BFA). The Masters' Partial Credit Rasch method modeled reliability, separation, and item fit statistics. Here we evaluate (i) the reproducibility of relative measure location on the modeled linear latent variable, (ii) the number of statistically unique performance levels that can be distinguished by the measure, and (iii) the discrepancy between item responses and expectations of the model. Psychometric findings and theoretical models informed item reduction and final scale development.

OUTCOMES

We developed a 10-item Contraceptive Sexual Acceptability scale that exceeded the thresholds and sufficiently covered domains for use in contraceptive research and clinical settings.

RESULTS

Starting with data on 39-items from 4,387 individuals, we identified 10-items that best measured the CSA latent construct. The Rasch model included a total of 5 calibrations. We reduced items based on bifactor analysis and surpassed unidimensionality thresholds (OH = 0.84, ECV = 0.74) set a priori. The final items included questions with scaled responses about pleasure and orgasm (orgasm quality, orgasm frequency, giving partner pleasure), physical (arousal and function) and psychological (emotional connection, surrender) components, general questions of satisfaction and frequency, and a measure of perceived impact of contraception on sexual experiences in the previous 4 weeks.

CLINICAL IMPLICATIONS

The 10-item CSA instrument covers physical and psychological aspects of contraceptive sexual acceptability and can be used in clinical settings.

STRENGTHS & LIMITATIONS

The unidimensional CSA instrument offers a brief, yet comprehensive assessment of sexual acceptability. Given the limited diversity of the sample, implementation of this scale in contraceptive research and clinical interactions should be evaluated and validated in more diverse settings.

CONCLUSION

Attuning to sexual acceptability could ultimately help contraceptive clients find methods that better meet their needs and preferences. Sanders JN, Kean J, Zhang C, et al. Measuring the Sexual Acceptability of Contraception: Psychometric Examination and Development of a Valid and Reliable Prospective Instrument. J Sex Med 2022;19:507-520.

Application of the Rasch measurement framework to mammography positioning data

The purpose of this article is to provide raw data and measure-validation data pertaining to a co-submission published in European Journal of Radiology and entitled: Development and validation of a novel measure of adverse patient positioning in mammography. This Data in Brief article serves not only to provide greater detail than its companion article but also as an educational worked example of the Rasch measurement framework. Rasch measurement is a form of modern psychometric technique and our articles provide the first known example of its use in the evaluation of clinical radiological image quality. The data consist of observations of mammographic images, plus limited participant parameters relevant to the measure validation process. Also provided are validation indices produced by subjecting the primary data to Rasch analysis. An expert observer generated the primary data by reviewing mammographic images to judge the presence or absence of a set of features developed through theory and consultation with other experts. The validation data were generated through Rasch analysis, performed using Winsteps® software, which mathematically models the probability of having a correct response (or a present feature in this dataset) to an item in a given measurement instrument (e.g. questionnaire), as a function of the participant's ability/position on the underlying construct under study. The data can be reused by anyone wishing to learn and practice psychometric validation techniques. They can also form a basis for researchers wishing to build on our preliminary measure for the assessment of mammographic clinical image quality.

Rasch Validation of the LVQOL Scale

AIM

This study proceeds to rigorously examine and validate the Low Vision Quality-of-Life Questionnaire (LVQOL) on a Greek population of ophthalmic patients employing Rasch measurement techniques.

METHODS

It is a prospective observational study of 150 cataract patients and 150 patients with other ophthalmic diseases, all followed longitudinally for a period of two months pending surgical or other corrective therapy, after which they were administered the LVQOL for a second time.

RESULTS

The original 25-item LVQOL demonstrated high reliability and validity, excellent measurement precision and ordered response category thresholds. A small number of items carry an acceptable level of measurement error while three items had some differential functioning for gender, Age and underlying disorder that did not exceed the established thresholds.

CONCLUSIONS

This validation study is the first to employ Rasch measurement to examine the validity of the LVQOL and it supports its use with no changes to the original structure. The LVQOL can be employed in a large range of ophthalmic diseases and reliably assess improvements in quality-of-life following phacoemulsification surgery or any other intervention.

Rasch Analysis of the Proactive Personality Scale

The Proactive Personality Scale (PPS) is used widely to measure proactive personality. Previous research has evaluated the psychometric properties of the 6-item PPS (hereafter called PPS-6) using classical test theory. There is a need to provide further validity evidence for the PPS-6 using modern test theory. This study evaluated the psychometric properties of the PPS-6 using Rasch analysis. A total of 429 participants completed the PPS-6. Rasch rating scale model (RSM) was used to analyse the data. RSM showed that the PPS-6 fitted the Rasch model well. RSM demonstrated that the PPS-6 functioned as a unidimensional measure with good internal consistency reliability. Items on the PPS-6 did not show any noticeable differential item functioning across gender. RSM showed that the response rating scale of the PPS-6 is suitable. Results suggest that the PPS-6 is a reliable measure for the assessment of proactive personality.

Development and validation of a novel measure of adverse patient positioning in mammography

PURPOSE

The primary aim was to develop and validate a novel mammography positioning measure, specifically incorporating parameters which might relate to mammography pain. We then explored relationships between the new adverse positioning score and (1) pain; (2) patient and technique factors.

METHODS

A 15-item instrument incorporating positioning features with potential to relate to mammography pain was developed. Participants' mammograms (n = 310) were reviewed for presence of these features. Validity was investigated using the Rasch model. Scores produced by the resultant measure were investigated for associations with patients' pain scores and relevant patient and technique factors, using Pearson correlation, analysis of variance, and multiple linear regression.

RESULTS

Statistical indices within the Rasch measurement framework provided good evidence that the measure reflected a coherent construct of adverse positioning. Thus, the scores produced with the measurement instrument were valid for use in further statistical analysis. There is, however, scope for improvement of the measure's discriminatory properties. Adverse positioning scores were higher for greater breast volumes (r = 0.12, p=.0391) and body mass index (BMI) (r = 0.13, p=.0349), and varied by mammographer (F(11,298) 2.38, p = .0078). The relationships with BMI and mammographer persisted in regression modelling. No relationship was found between adverse positioning and pain.

CONCLUSIONS

Evidence from Rasch analysis suggests that this novel measure is valid for quantifying a coherent "adverse positioning" construct in mammography. Adverse positioning scores varied by mammographer and were related to higher patient BMI but not to mammography pain. The measure warrants expansion, further refinement, and testing in larger studies.

White Paper by the European Society for Swallowing Disorders: Screening and Non-instrumental Assessment for Dysphagia in Adults

This White Paper by the European Society for Swallowing Disorders (ESSD) reports on the current state of screening and non-instrumental assessment for dysphagia in adults. An overview is provided on the measures that are available, and how to select screening tools and assessments. Emphasis is placed on different types of screening, patient-reported measures, assessment of anatomy and physiology of the swallowing act, and clinical swallowing evaluation. Many screening and non-instrumental assessments are available for evaluating dysphagia in adults; however, their use may not be warranted due to poor diagnostic performance or lacking robust psychometric properties. This white paper provides recommendations on how to select best evidence-based screening tools and non-instrumental assessments for use in clinical practice targeting different constructs, target populations and respondents, based on criteria for diagnostic performance, psychometric properties (reliability, validity, and responsiveness), and feasibility. In addition, gaps in research that need to be addressed in future studies are discussed. The following recommendations are made: (1) discontinue the use of non-validated dysphagia screening tools and assessments; (2) implement screening using tools that have optimal diagnostic performance in selected populations that are at risk of dysphagia, such as stroke patients, frail older persons, patients with progressive neurological diseases, persons with cerebral palsy, and patients with head and neck cancer; (3) implement measures that demonstrate robust psychometric properties; and (4) provide quality training in dysphagia screening and assessment to all clinicians involved in the care and management of persons with dysphagia.

European white paper: oropharyngeal dysphagia in head and neck cancer

PURPOSE

To develop a European White Paper document on oropharyngeal dysphagia (OD) in head and neck cancer (HNC). There are wide variations in the management of OD associated with HNC across Europe.

METHODS

Experts in the management of specific aspects of OD in HNC across Europe were delegated by their professional medical and multidisciplinary societies to contribute to this document. Evidence is based on systematic reviews, consensus-based position statements, and expert opinion.

RESULTS

Twenty-four sections on HNC-specific OD topics.

CONCLUSION

This European White Paper summarizes current best practice on management of OD in HNC, providing recommendations to support patients and health professionals. The body of literature and its level of evidence on diagnostics and treatment for OD in HNC remain poor. This is in the context of an expected increase in the prevalence of OD due to HNC in the near future. Contributing factors to increased prevalence include aging of our European population (including HNC patients) and an increase in human papillomavirus (HPV) related cancer, despite the introduction of HPV vaccination in various countries. We recommend timely implementation of OD screening in HNC patients while emphasizing the need for robust scientific research on the treatment of OD in HNC. Meanwhile, its management remains a challenge for European professional associations and policymakers.

Using Classical Test Theory to Determine the Psychometric Properties of the Deglutition Handicap Index

The Deglutition Handicap Index (DHI) is a self-report measure for patients at risk of oropharyngeal dysphagia on deglutition-related aspects of functional health status (FHS) and health-related quality of life (HR-QoL). The DHI consists of 30 items which are subsumed within the Symptom, Functional and Emotional subscales. The purpose of this study was to evaluate the psychometric properties of the DHI using Classic Test Theory according to the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) criteria. A total of 453 patients with dysphagia with different aetiologies were recruited concurrently at two academic hospitals. Dysphagia was confirmed by fiberoptic endoscopic and/or videofluoroscopic evaluation of swallowing. In addition, a healthy control group of 132 participants were recruited. Structural validity was determined using exploratory and confirmatory factor analyses and internal consistency by calculating Cronbach’s alpha coefficients. Hypothesis testing was evaluated using Mann–Whitney U-tests, linear regression analysis and correlations analysis. Diagnostic performance and receiver operating characteristic curves analysis were calculated. Factor analyses indicated that the DHI is a unidimensional measure. The DHI has good internal consistency with some indication of item redundancy, weak to moderate structural validity and strong hypothesis testing for construct validity. The DHI shows high diagnostic performance as part of criterion validity. These findings support that the DHI is an appropriate choice as a patient self-report measure to evaluate FHS and HR-QoL in dysphagia. Ongoing validation to assess the measure for possible item redundancy and to examine the dimensionality of the DHI using item response theory is recommended.

Is Dysphagia Under Diagnosed or is Normal Swallowing More Variable than We Think? Reported Swallowing Problems in People Aged 18-65 Years

Purpose

Dysphagia prevalence in younger community dwelling adults and across nations is sparse. We investigated the prevalence of swallowing problems in an unselected cohort of people aged 18–65 years.

Methods

The EAT-10 Assessment Tool was converted into an anonymized online survey. Invitations were e-mailed to author contacts and onwards dispersal encouraged. Analysis was performed using non-parametric test for group comparison (Mann–Whitney U) and Spearman’s rho correlation.

Results

From March 2014 to October 2017: 2054 responses (32 reported ages outside of 18–65 or undeclared) from Africa, Asia, Australasia/Oceania, Europe, and North and South America. Responses: 1,648 female, 364 male, (10 reported as both), median age 34, (range 18–65, mean 37.12, SD 12.40) years. Total EAT-10 scores: median 0 (range 0–36, mean 1.57, SD 3.49). EAT-10 score ≥ 3 (337) median 5 (range 3–36, mean 7.02 SD 5.91). Median age 36 (range 19–65, mean 37.81, SD 13.21) years. Declared sex was not statistically significantly associated with non-pathological vs. pathological EAT-10 score (p = 0.665). Female scores (median 0.00, mean 1.56, SD 3.338) were significantly higher than for males (median 0.00, mean 1.62, SD 4.161): U (Nfemale = 1648, Nmale = 364) = 275,420.000, z = − 2.677, p = 0.007. Age and EAT-10 score were not associated: females r_s = − 0.043, p = 0.079, N = 1648, males r_s = − 0.003, p = 0.952, N = 364. Considerable impact on people: “I take ages to eat a main course … This is embarrassing and I often leave food even though I am still hungry.” (no diagnosis, EAT-10 = 17).

Conclusion

Concerns regarding swallowing exist in people undiagnosed with dysphagia, who may feel uncomfortable seeking professional help. Dysphagia may be under reported resulting in a hidden population. Subtle changes are currently seen as subtle markers of COVID-19. Further work is required to ensure that what is an essentially normal swallow does not become medicalized.

Improving Measurement in Couple and Family Therapy: An Item Response Theory Primer

The valid and reliable assessment of individual and relational functioning relies on high-quality assessment tools. Most assessments used in the field of couple and family therapy were developed using Classical Test Theory (CTT). An alternate theory for guiding the creation, evaluation, and scoring of assessments is Item Response Theory (IRT). IRT has several advantages over CTT and can be used to improve measurement in the field. For example, the IRT approach creates measures that are significantly more precise, yet uses fewer items, than scales created using CTT. This manuscript provides an overview of how IRT differs from CTT and describes the fundamental concepts and assumptions of IRT. Following this summary, we provide a step-by-step example of how IRT can be used to reduce the length of the Marital Disaffection Scale from 21 to 6 items without losing a significant amount of information about the construct.

The ability of the eating assessment tool-10 to detect penetration and aspiration in Parkinson's disease

PURPOSE

Dysphagia is common in patients with Parkinson's disease (PD) and often leads to pneumonia, malnutrition, and reduced quality of life. This study investigates the ability of the Eating Assessment Tool-10 (EAT-10), an established, easy self-administered screening tool, to detect aspiration in PD patients. This study aims to validate the ability of the EAT-10 to detect FEES-proven aspiration in patients with PD.

METHODS

In a controlled prospective cross-sectional study, a total of 50 PD patients completed the EAT-10 and, subsequently, were examined by Flexible Endoscopic Evaluation of Swallowing (FEES) to determine the swallowing status. The results were rated through the Penetration-Aspiration Scale (PAS) and data were analyzed retrospectively.

RESULTS

PAS and EAT-10 did not correlate significantly. Selected items of the EAT-10 could not predict aspiration or residues. 19 (38%) out of 50 patients with either penetration or aspiration were not detected by the EAT-10. The diagnostic accuracy was established at only a sufficient level (AUC 0.65). An optimal cut-off value of ≥ 6 presented a sensitivity of 58% and specificity of 82%.

CONCLUSIONS

The EAT-10 is not suited for the detection of penetration and aspiration in PD patients. Therefore, it cannot be used as a screening method in this patient population. There is still a need for a valid, simple, and efficient screening tool to assist physicians in their daily diagnostics and to avoid clinical complications.

Item analysis of the Eating Assessment Tool (EAT-10) by the Rasch model: a secondary analysis of cross-sectional survey data obtained among community-dwelling elders

Background

The Eating Assessment Tool (EAT-10) is increasingly used to screen for self-perceived oropharyngeal dysphagia (OD) in community-dwelling elders. A summated EAT-10 total score ranges from 0 to 40, with a score ≥ 3 indicative of OD. When using cut-points of a summated score, important requirements for the measurements are specific objectivity, validity, and reliability. Analysis by the Rasch model allows investigation of whether scales like EAT-10 satisfy these requirements. Currently, a few studies have found that EAT-10 responses from clinical populations with OD do not adequately fit the Rasch model.

Purpose

The aim of this study was to determine whether measurements by EAT-10 fit the Rasch model when applied in screening self-perceived OD in non-clinical populations.

Methods

Secondary analysis was conducted on data from a cross-sectional survey of community-dwelling elders living in a municipal district of Tokyo, Japan, in which 1875 respondents completed the Japanese version of EAT-10 (J-EAT-10). Data were cleaned and recoded for the purpose of the analysis in this study, which resulted in inclusion of J-EAT-10 responses from 1144 respondents. Data were analyzed using RUMM2030 and included overall model fit, reliability, unidimensionality, threshold ordering, individual item and person fits, differential item functioning, local item dependency, and targeting.

Results

The analysis identified that the response categories from zero to four were not used as intended and did not display monotonicity, which necessitated reducing the five categories to three. Considerable floor effect was demonstrated and there was an inappropriate match between items’ and respondents’ estimates. The person separation reliability (PSI = 0.65) was inadequate, indicating that it is not possible to differentiate between different levels of OD. Several items displayed misfit with the Rasch model, and there were local item dependency and several redundant items.

Conclusions

J-EAT-10 performed less than optimally and exhibited substantial floor effect, low reliability, a rating scale not working as intended, and several redundant items. Different improvement strategies failed to resolve the identified problems. Use of J-EAT-10 in population-based surveys cannot therefore be recommended. For such purpose, alternative screening tools of self-perceived OD should be chosen or a new one should be developed and validated.

Validation of the Toronto Empathy Questionnaire (TEQ) Among Medical Students in China: Analyses Using Three Psychometric Methods

This study aimed to validate the simplified Chinese version of the Toronto Empathy Questionnaire (cTEQ) for use with the Chinese population. The original English version of the TEQ was translated into simplified Chinese based on international criteria. Psychometric analyses were performed based on three psychometric methods: classical test theory (CTT), item response theory (IRT), and Rasch model theory (RMT). Differential item functioning analysis was adopted to check possible item bias caused by responses from different subgroups based on sex and ethnicity. A total of 1296 medical students successfully completed the TEQ through an online survey; 75.2% of respondents were female and the average age was 19 years old. Forty students completed the questionnaire 2 weeks later to assess the test–retest reliability of the questionnaire. Confirmatory factor analysis supported a 3-factor structure of the cTEQ. The CTT analyses confirmed that the cTEQ has sound psychometric properties. However, IRT and RMT analyses suggested some items might need further modifications and revisions.

Quantitative Data Analysis for Single-Case Methods, Between-Groups Designs, and Instrument Development

We are pleased to bring you this special issue ofBrain Impairmenton quantitative data analysis, an area of increasing complexity and sophistication. In planning the special issue, our intention was to bring together a set of articles covering diverse and topical areas in the field, with the idea of having the volume serve as a ‘go-to’ resource. The special issue is aimed at researchers, clinicians engaged in research, and advanced students all of whom may have passing familiarity with a particular data analytic technique, but wish to know more about it and how to apply it. Accordingly, our aim is to equip the reader with concrete, hands-on information that can be applied in the day-to-day world of research. The authors of the articles comprising the special issue, each of whom is an expert in his/her field, were charged with the task of writing a practical guide and providing worked examples to illustrate the application of their selected technique/s. The papers in the special issue cover three domains: the single-case method, between-groups design, and psychometric aspects of instrument development.