The development and validation of a psychological questionnaire for patients undergoing orthognathic treatment

A COnsensus-based Standards for the selection of health Measurement INstruments systematic review of orthognathic patient-reported outcome measures

INTRODUCTION

This systematic review aimed to identify and appraise the validity studies of patient-reported outcome measures (PROMs) reporting the outcomes of combined orthodontic-orthognathic surgery in treating dentofacial deformity.

METHODS

The search strategy was conducted using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) Systematic Review methodology. The following databases were searched for original studies outlining the development and/or validation of PROMs produced to measure the outcomes of combined orthognathic-orthodontic treatment: EMBASE, MEDLINE, PsycInfo and Scopus. Publications were limited to the English language. Eligibility criteria were applied when considering the studies. Primarily, the psychometric properties and quality of orthognathic-specific PROMs were investigated. Screening of eligible studies was conducted independently by 2 reviewers. Assessment of the methodological quality of the studies and data extraction was conducted by 1 reviewer and assisted by a second reviewer. The COSMIN methodology guided data extraction and analysis, which were divided into 3 stages-a synopsis of studies, evaluation of methodological quality, and summary of evidence.

RESULTS

A total of 8695 papers were found; 12 studies met the criteria for inclusion. Regarding the COSMIN Checklist for Assessing Study Qualities, there was evidence that the Orthognathic Quality of Life Questionnaire was the most extensively tested orthognathic-specific PROM in the current literature. The reported evidence was incomplete, as not all psychometric properties had been reliably tested.

CONCLUSIONS

Clinicians must use validated PROMs when analyzing patient-reported outcomes. The Orthognathic Quality of Life Questionnaire was shown to be the highest quality orthognathic-specific PROM in the literature but requires contemporary evaluation to suitably reflect the COSMIN guidance.

Development of the Orthodontic Treatment Impact Questionnaire: Cross-sectional validation

INTRODUCTION

The need to involve patients in developing and evaluating health care interventions is now well-recognized. This study assesses and refines the Orthodontic Treatment Impact Questionnaire for use as a patient-reported outcome in an interventional clinical trial to evaluate and compare any orthodontic interventions.

METHODS

The face and content validity of a previously developed questionnaire were tested in 2 focus groups involving adolescents aged 11-17 years. They were wearing a range of orthodontic appliances and at different treatment stages. A similar cross-sectional convenience sample completed the questionnaire during routine appliance adjustment appointments. A Rasch model, using item response theory, was used for item reduction, assessment of the response format, and differential item functioning. Spearman's rank correlation was used to assess construct validity, Cronbach α for internal consistency and reliability, and intraclass correlation coefficient for test-retest reliability.

RESULTS

Seven adolescents (4 females, 3 males) were involved in the initial testing; 181 (117 females, 64 males; mean age, 14.7 ± 1.5 years) completed the questionnaire once and 41 twice. The initial measure demonstrated a misfit to the Rasch model. Ten of the original 31 items had disordered thresholds and were removed. The 5-point scale was changed to a 3-point scale. None of the participants demonstrated a misfit to the model. Construct validity (P = 0.480), internal consistency (Cronbach α = 0.827) and test-retest reliability (intraclass correlation coefficient = 0.85; 95% confidence interval, 0.73-0.92) were good.

CONCLUSIONS

The initial Orthodontic Treatment Impact Questionnaire was tested and modified using item response theory. The modified questionnaire demonstrated good construct validity, reliability, and internal consistency. Further testing to assess generalizability and longitudinal responsiveness is required.

The Malocclusion Impact Questionnaire (MIQ): Cross-Sectional Validation in a Group of Young People Seeking Orthodontic Treatment in New Zealand

The aim of the study was to test the validity of the Malocclusion Impact Questionnaire (MIQ) in a NZ sample and to evaluate possible cross-cultural differences in MIQ data between a NZ and a UK sample. A cross-sectional, non-random sample of young people, aged 10–16 years, attending their first appointment at the orthodontic clinic of New Zealand’s National Centre for Dentistry were asked to complete a questionnaire. This consisted of the 17 item MIQ, the short form CPQ_11-14-ISF16 and two global questions. Some basic demographic and clinical data were collected. Sixty-six participants completed the questionnaire; however, the data for 2 were excluded due to the number of incomplete responses. MIQ was found to have excellent internal consistency (Cronbach’s alpha 0.924), good construct validity (Spearman’s rho, 0.661 global Q1 ‘Overall, how much do your teeth bother you?’; 0.583 global Q2 ‘Overall, how much do your teeth affect your life?’). MIQ also demonstrated good criterion validity with CPQ_11-14-ISF16 (Pearson rho, 0.625). The Rasch analysis confirmed that the questionnaire performed similarly and there was no differential item functioning between the two populations. The main differences between the samples were that the young people in NZ were less concerned about their malocclusion and reported lower item-impact scores compared with the young people in the UK.

Evidence in Orthodontics related to qualitative research

Introduction:

Research in Orthodontics has historically followed the positivist model based on the direct relationship of cause and effect between diseases and their specific etiological factors. Despite the objectivity and the great potential of statistical procedures, quantitative methods have progressively been sharing space with other models that can encompass the multiplicity of factors that affect the health-disease process, which until such time was reduced to its biological dimension.

Objectives:

This study aims, through an integrative review, to identify orthodontics articles published over a 10-year period that have used, exclusively or not, some method of qualitative research, and analyze the main aspects of their content.

Methods:

A survey was performed on Pubmed, Medline, Scopus, and Lilacs databases from 2007 to 2016 with a focus on the applicability of the qualitative methodology in orthodontic research.

Results:

The 27 articles selected showed a trend to increase in publications, with the most recent four years concentrating almost 60% of them. Most studies were from Europe, particularly the UK, and the more frequent study objectives were related to the perception of people about the reasons for orthodontic treatment, about the aesthetic and psychosocial impact of malocclusion or orthodontic treatment, and the implications of these factors for their quality of life.

Conclusions:

Because of its potential to explore behaviours and socio-cultural attitudes sustained in subjectivity, qualitative research offers new possibilities for orthodontic studies and can be used in an exclusive or complementary way in relation to quantitative methods.

Development and evaluation of the children's experiences of dental anxiety measure

BACKGROUND

Existing measures of children's dental anxiety have not been developed with children or based on a theoretical framework of dental anxiety.

AIM

To develop the children's experiences of dental anxiety measure (CEDAM) and evaluate the measure's properties.

DESIGN

The measure was developed from interviews with dentally anxious children. Children recruited from a dental hospital and secondary school completed the CEDAM and Modified Child Dental Anxiety Scale (MCDAS). A subgroup of children completed the CEDAM before and after receiving an intervention to reduce dental anxiety to examine the measure's responsiveness. Rasch and Classical test analyses were undertaken.

RESULTS

Children were aged between 9 and 16 years (N = 88 recruited from a dental hospital and N = 159 recruited from a school). Rasch analysis confirmed the measure's unidimensionality. The CEDAM correlated well with the MCDAS (rho = 0.67, P < 0.01) and had excellent internal consistency (Cronbach's alpha = 0.88) and test-retest reliability (ICC = 0.98). The CEDAM was also able to detect changes in dental anxiety following the intervention (baseline mean = 22.36, SD = 2.57 and follow-up mean = 18.88, SD = 2.42, t(df = 37) = 9.54, P < 0.01, Cohen's d = 1.39).

CONCLUSIONS

The results support the reliability, validity and responsiveness of the CEDAM. Initial findings indicate it has potential for use in future intervention trials or in clinical practice to monitor children's dental anxiety.

Development of the Malocclusion Impact Questionnaire (MIQ) to measure the oral health-related quality of life of young people with malocclusion: part 2 - cross-sectional validation

Objective: To test the items, identified through qualitative inquiry that might form the basis of a new Malocclusion Impact Questionnaire (MIQ) to measure the oral health-related quality of life (OHQoL) of young people with malocclusion. Methods: Piloting with 13 young people reduced the number of items from 37 to 28. Cross-sectional testing involved a convenience sample aged 10–16 years, attending the Orthodontic Department of the Charles Clifford Dental Hospital, Sheffield. The fit and function of the initial MIQ questions were examined using item response theory. Results: 184 participants (113 females; 71 males) completed a questionnaire (response 85%), seven participants were excluded due to missing responses. The mean age of participants was 12·9 years (SD 1·4) and they had a wide range of malocclusions. The majority were White British (67·4%). Data from 47 participants were used to analyse test–retest reliability. Rasch analysis was undertaken, which further reduced the number of items in the questionnaire from 28 to 17. Unidimensionality of the scale was confirmed. The analysis also identified that the original 5-point response scale could be reduced to three points. The new measure demonstrated good criterion validity (r = 0·751; P < 0·001) and construct validity with the two global questions (‘Overall bother’ ρ = 0·733 and ‘Life overall’ ρ = 0·701). Internal consistency (Cronbach's alpha = 0·906) and test–retest reliability Intraclass correlation coefficient (ICC = 0·78; 95% CI 0·61–0·88) were also good. Conclusion: Cross-sectional testing has shown the new MIQ to be both valid and reliable. Further evaluation is required to confirm the generalisability as well as the ability of the new measure to detect change over time (responsiveness).

Dry Eye-Related Visual Blurring and Irritative Symptoms and Their Association with Depression and Anxiety in Eye Clinic Patients

PURPOSE

Dry eye is a common condition known to have many systemic co-morbidities. We aim to report the frequency of depression and anxiety suspects in eye clinic patients and explore the association between dry eye signs and symptoms with depression and anxiety.

MATERIALS AND METHODS

Adult outpatients were recruited from dry a public tertiary ophthalmology specialist center. Participants underwent socio-demographic and dry eye symptoms questionnaires, fluorescein dye tear break-up time (TBUT), fluorescein dye corneal staining and Schirmer's test. Rasch analysis was used to internally validate the Hospital Anxiety and Depression Scale (HADS) and the Center for Epidemiologic Studies Depression Scale (CES-D) and determine its psychometric properties.

RESULTS

A total of 96 participants (mean age 54.5 ± 10.8; 64.1% women) were recruited. The mean score for the CES-D was 12.1 ± 9.8 with 28 participants (31.5%) having a score of above 16 (published threshold). The mean score for depression-associated questions in the HADS was 3.6 ± 3.6 with 13 participants (14.1%) having a score ≥8. The mean score for the anxiety-associated questions in the HADS was 5.3 ± 3.6 with 24 participants (26.1%) having score ≥8. There was a weak inverse correlation between Schirmer's test and CES-D scores. Elevated depression scores from the CES-D were significantly associated with visual blurring but not irritation, in dry eye patients with low TBUT.

CONCLUSIONS

In conclusion, specific types of dry eye symptoms, particularly those with increased frequency of visual blurring were associated with symptoms of depression. The optical aberrations induced by dry eye, associated with tear instability, may predispose to depressive tendency.