Most-Cited Patient-Reported Outcome Measures Within Otolaryngology-Revisiting the Minimal Clinically Important Difference: A Review

Importance

Patient-reported outcome measures (PROMs) allow clinicians and researchers to assess health-related information from a patient's perspective. These measures have been used more frequently over the last several decades, but an associated minimal clinically important difference (MCID) is needed to optimize their utility. This narrative review identified the top 100 most-cited otolaryngology-related PROM development and validation publications and assessed the presence and characteristics of the PROMs' associated MCID.

Observations

In this narrative review, a literature search in Scopus and Web of Science was conducted on June 29, 2022, using keywords related to PROM development and validation studies in otolaryngology and reference lists. Studies that met the definition of a PROM and assessed an otolaryngologic disorder or study population were included for full-text review. After full-text review of 188 articles, the top 100 most-cited PROM development and validation publications, resulting in 106 total PROMs, were chosen for review. A total of 39 (37%) of the identified PROMs had an associated MCID. Of those reporting an MCID, 14 (35.9%) used an anchor-based method, 12 (30.8%) used a distribution-based method, 10 (25.6%) used both, and 3 (7.7%) did not specify or used neither method. Rhinology had the greatest number of PROMs with an associated MCID (16 of 24, 66%), and pediatrics had the fewest (1 of 13, 7.7%). The median number of citations of PROMs with an MCID was higher than those without an MCID.

Conclusions and Relevance

The majority of the most-cited PROMs in otolaryngology lack an associated MCID. These data indicated that there are a multitude of PROMs that have been cited hundreds of times and used for decades without the ability to identify whether a particular change in score on the instrument is clinically meaningful. There is a need to determine and validate MCIDs for commonly used PROMs to aid clinical research and trial interpretation.

Validation of Patient-Reported Outcomes for Clinical Trials in Allergic Rhinitis: A Systematic Review

Although regulatory authorities have recently recommended the use of a combined symptom-medication score as a primary efficacy end point, none has been psychometrically validated. Here, we sought to determine to what extent allergic rhinitis (AR)-related patient-reported outcomes (symptom scores, medication scores, disease control scores, and satisfaction or quality-of-life scales) have been assessed for construct, content, and/or criterion validity, reliability, responsiveness, and the minimal clinically important difference. We searched the PubMed database from January 1997 to June 2018 with logical combinations of key words related to validation, AR, and patient-rated outcomes and scales. From a total of 1705 potentially relevant publications, 55 were reviewed. Despite the current emphasis on a combined symptom-medication score for evaluating the efficacy of allergen immunotherapy in AR, symptom scores have not been extensively validated, and we did not find any publications describing the validation of a medication score. Disease control scales (mainly the Rhinitis Control Assessment Test, the Control of Allergic Rhinitis and Asthma Test, and the Allergic Rhinitis Control Test) and health-related quality-of-life scales (mainly the Rhinoconjunctivitis Quality of Life Questionnaire [RQLQ] and the mini-RQLQ) have been extensively validated in AR but have some practical disadvantages as primary efficacy criteria in clinical trials.

RCAT reflects symptom control and quality of life in allergic rhinoconjunctivitis patients

BACKGROUND

The Global Allergy and Asthma European Network (GA² LEN) Taskforce has requested more data on correlations between various patient-reported outcomes (PROs) in clinical trials on allergy. We compared three tools-the Rhinitis Control Assessment Test (RCAT), Rhinoconjunctivitis Quality of Life Questionnaire (RQLQ) and Rhinitis Total Symptom Score (RTSS)-to determine whether the RCAT alone is a sufficient primary outcome parameter in clinical trials on allergic rhinoconjunctivitis.

METHODS

In two double-blind, placebo-controlled immunotherapy studies, 33 patients allergic to grass pollen and 94 to birch pollen completed two questionnaires (RCAT and RQLQ) and kept their own symptom diary from which the RTSS was calculated.

RESULTS

Upon comparing RCAT and RQLQ results, we found strong correlations of r = -0.871 for grass pollen-allergic patients and r = -0.795 for birch pollen-allergic patients. The comparison between RCAT and RTSS results showed a strong correlation of r = -0.811 (grass pollen-allergic patients) and a moderate correlation of r = -0.539 (birch pollen-allergic patients). In the RCAT, 69.7% of grass pollen-allergic patients and 45.7% of birch pollen-allergic patients receiving guideline-concordant therapy were regarded as having insufficiently controlled symptoms.

CONCLUSION

The strong correlations suggest that the RCAT alone is equivalent to the RQLQ with respect to patients' symptom control and quality of life. Patients with uncontrolled symptoms can be identified using the RCAT. Hence, the physician can decide whether symptomatic therapy can be intensified or allergy immunotherapy should be administered.

Severity of Nasal Inflammatory Disease Questionnaire for Canine Idiopathic Rhinitis Control: Instrument Development and Initial Validity Evidence

BACKGROUND

Effective treatments are needed for idiopathic chronic rhinitis in dogs, but assessment of efficacy requires a practical, quantifiable method for assessing severity of disease.

OBJECTIVES

To develop and perform initial validity and reliability testing of an owner-completed questionnaire for assessing clinical signs and dog and owner quality of life (QOL) in canine chronic rhinitis.

ANIMALS

Twenty-two dogs with histopathologically confirmed chronic rhinitis and 72 healthy dogs.

METHODS

In this prospective study, an online questionnaire was created based on literature review and feedback from veterinarians, veterinary internists with respiratory expertise, and owners of dogs with rhinitis. Owners of affected dogs completed the questionnaire twice, 1 week apart, to test reliability. Healthy dogs were assessed once. Data were analyzed using the Rasch Rating Scale Model, and results were interpreted using Messick's framework for evaluating construct validity evidence.

RESULTS

Initial item generation resulted in 5 domains: nasal signs, paranasal signs, global rhinitis severity, and dog's and owner's QOL. A 25-item questionnaire was developed using 5-point Likert-type scales. No respondent found the questionnaire difficult to complete. Strong psychometric evidence was available to support the substantive, generalizability, content, and structural aspects of construct validity. Statistical differences were found between responses for affected and control dogs for all but 2 items. These items were eliminated, resulting in the 23-item Severity of Nasal Inflammatory Disease (SNIFLD) questionnaire.

CONCLUSIONS AND CLINICAL IMPORTANCE

The SNIFLD questionnaire provides a mechanism for repeated assessments of disease severity in dogs with chronic rhinitis.

Chapter 15: Allergic rhinitis

Allergic rhinitis affects 60 million of the U.S. population, 1.4 billion of the global population, and its prevalence appears to be increasing. The duration and severity of allergic rhinitis symptoms place a substantial burden on patient's quality of life, sleep, work productivity, and activity. The health impact of allergic rhinitis is compounded by associated complications and comorbidities including asthma, otitis media, sinusitis, and nasal polyps. Allergic rhinitis symptoms result from a complex, allergen-driven mucosal inflammatory process, modulated by immunoglobulin E (IgE), and caused by interplay between resident and infiltrating inflammatory cells and a number of vasoactive and proinflammatory mediators, including cytokines. This allergic response may be characterized as three phases: IgE sensitization, allergen challenge, and elicitation of symptoms. A thorough allergic history is the best tool for the diagnosis of allergic rhinitis, the establishment of which is achieved by correlating the patient's history and physical exam with an assessment for the presence of specific IgE antibodies to relevant aeroallergens determined by skin testing or by in vitro assay. Management of allergic rhinitis includes modifying environmental exposures, implementing pharmacotherapy, and, in select cases, administering allergen-specific immunotherapy. Intranasal therapeutic options include antihistamines, anticholinergic agents, corticosteroids (aqueous or aerosol), mast cell stabilizers, saline, and brief courses of decongestants. Selection of pharmacotherapy is based on the severity and chronicity of symptoms with the most effective medications being intranasal corticosteroids and intranasal antihistamines, which can be used in combination (separately or in fixed dose) for more difficult to control allergic rhinitis.