1
|
Peterson AM, Miller B, Ioerger P, Hentati F, Doering MM, Kallogjeri D, Piccirillo JF. Most-Cited Patient-Reported Outcome Measures Within Otolaryngology-Revisiting the Minimal Clinically Important Difference: A Review. JAMA Otolaryngol Head Neck Surg 2023; 149:261-276. [PMID: 36729451 PMCID: PMC10729312 DOI: 10.1001/jamaoto.2022.4703] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/03/2023]
Abstract
Importance Patient-reported outcome measures (PROMs) allow clinicians and researchers to assess health-related information from a patient's perspective. These measures have been used more frequently over the last several decades, but an associated minimal clinically important difference (MCID) is needed to optimize their utility. This narrative review identified the top 100 most-cited otolaryngology-related PROM development and validation publications and assessed the presence and characteristics of the PROMs' associated MCID. Observations In this narrative review, a literature search in Scopus and Web of Science was conducted on June 29, 2022, using keywords related to PROM development and validation studies in otolaryngology and reference lists. Studies that met the definition of a PROM and assessed an otolaryngologic disorder or study population were included for full-text review. After full-text review of 188 articles, the top 100 most-cited PROM development and validation publications, resulting in 106 total PROMs, were chosen for review. A total of 39 (37%) of the identified PROMs had an associated MCID. Of those reporting an MCID, 14 (35.9%) used an anchor-based method, 12 (30.8%) used a distribution-based method, 10 (25.6%) used both, and 3 (7.7%) did not specify or used neither method. Rhinology had the greatest number of PROMs with an associated MCID (16 of 24, 66%), and pediatrics had the fewest (1 of 13, 7.7%). The median number of citations of PROMs with an MCID was higher than those without an MCID. Conclusions and Relevance The majority of the most-cited PROMs in otolaryngology lack an associated MCID. These data indicated that there are a multitude of PROMs that have been cited hundreds of times and used for decades without the ability to identify whether a particular change in score on the instrument is clinically meaningful. There is a need to determine and validate MCIDs for commonly used PROMs to aid clinical research and trial interpretation.
Collapse
Affiliation(s)
- Andrew M. Peterson
- Clinical Outcomes Research Office, Department of Otolaryngology-Head and Neck Surgery, Washington University School of Medicine in St. Louis, St. Louis, Missouri
- Department of Otolaryngology-Head and Neck Surgery, Washington University School of Medicine in St. Louis, St. Louis, Missouri
| | - Brevin Miller
- Clinical Outcomes Research Office, Department of Otolaryngology-Head and Neck Surgery, Washington University School of Medicine in St. Louis, St. Louis, Missouri
- University of Missouri Kansas City School of Medicine, Kansas City, Missouri
| | - Patrick Ioerger
- Clinical Outcomes Research Office, Department of Otolaryngology-Head and Neck Surgery, Washington University School of Medicine in St. Louis, St. Louis, Missouri
- University of Kansas Medical Center, Kansas City, Kansas
| | - Firas Hentati
- Clinical Outcomes Research Office, Department of Otolaryngology-Head and Neck Surgery, Washington University School of Medicine in St. Louis, St. Louis, Missouri
- Case Western Reserve University, Cleveland, Ohio
| | - Michelle M. Doering
- Becker Medical Library, Washington University School of Medicine in St Louis, St Louis, Missouri
| | - Dorina Kallogjeri
- Clinical Outcomes Research Office, Department of Otolaryngology-Head and Neck Surgery, Washington University School of Medicine in St. Louis, St. Louis, Missouri
- Department of Otolaryngology-Head and Neck Surgery, Washington University School of Medicine in St. Louis, St. Louis, Missouri
| | - Jay F. Piccirillo
- Clinical Outcomes Research Office, Department of Otolaryngology-Head and Neck Surgery, Washington University School of Medicine in St. Louis, St. Louis, Missouri
- Department of Otolaryngology-Head and Neck Surgery, Washington University School of Medicine in St. Louis, St. Louis, Missouri
| |
Collapse
|
2
|
Calderón MA, Casale TB, Demoly P. Validation of Patient-Reported Outcomes for Clinical Trials in Allergic Rhinitis: A Systematic Review. THE JOURNAL OF ALLERGY AND CLINICAL IMMUNOLOGY-IN PRACTICE 2019; 7:1450-1461.e6. [PMID: 30797777 DOI: 10.1016/j.jaip.2019.01.015] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Subscribe] [Scholar Register] [Received: 10/27/2018] [Revised: 01/05/2019] [Accepted: 01/07/2019] [Indexed: 01/07/2023]
Abstract
Although regulatory authorities have recently recommended the use of a combined symptom-medication score as a primary efficacy end point, none has been psychometrically validated. Here, we sought to determine to what extent allergic rhinitis (AR)-related patient-reported outcomes (symptom scores, medication scores, disease control scores, and satisfaction or quality-of-life scales) have been assessed for construct, content, and/or criterion validity, reliability, responsiveness, and the minimal clinically important difference. We searched the PubMed database from January 1997 to June 2018 with logical combinations of key words related to validation, AR, and patient-rated outcomes and scales. From a total of 1705 potentially relevant publications, 55 were reviewed. Despite the current emphasis on a combined symptom-medication score for evaluating the efficacy of allergen immunotherapy in AR, symptom scores have not been extensively validated, and we did not find any publications describing the validation of a medication score. Disease control scales (mainly the Rhinitis Control Assessment Test, the Control of Allergic Rhinitis and Asthma Test, and the Allergic Rhinitis Control Test) and health-related quality-of-life scales (mainly the Rhinoconjunctivitis Quality of Life Questionnaire [RQLQ] and the mini-RQLQ) have been extensively validated in AR but have some practical disadvantages as primary efficacy criteria in clinical trials.
Collapse
Affiliation(s)
- Moises A Calderón
- National Heart & Lung Institute, Imperial College London, Royal Brompton Hospital NHS, London, United Kingdom
| | - Thomas B Casale
- Division of Allergy and Immunology, University of South Florida, Tampa, Fla
| | - Pascal Demoly
- Division of Allergy, Department of Pulmonology, Hôpital Arnaud de Villeneuve, University Hospital of Montpellier, Montpellier, France; Sorbonne Universités, UMR-S 1136, IPLESP, Equipe EPAR, Paris, France.
| |
Collapse
|
3
|
Liedtke JP, Mandl A, Köther J, Chwieralski J, Shah-Hosseini K, Raskopf E, Pieper-Fürst U, Allekotte S, Mösges R. RCAT reflects symptom control and quality of life in allergic rhinoconjunctivitis patients. Allergy 2018; 73:1101-1109. [PMID: 29159975 DOI: 10.1111/all.13362] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/14/2017] [Indexed: 11/29/2022]
Abstract
BACKGROUND The Global Allergy and Asthma European Network (GA2 LEN) Taskforce has requested more data on correlations between various patient-reported outcomes (PROs) in clinical trials on allergy. We compared three tools-the Rhinitis Control Assessment Test (RCAT), Rhinoconjunctivitis Quality of Life Questionnaire (RQLQ) and Rhinitis Total Symptom Score (RTSS)-to determine whether the RCAT alone is a sufficient primary outcome parameter in clinical trials on allergic rhinoconjunctivitis. METHODS In two double-blind, placebo-controlled immunotherapy studies, 33 patients allergic to grass pollen and 94 to birch pollen completed two questionnaires (RCAT and RQLQ) and kept their own symptom diary from which the RTSS was calculated. RESULTS Upon comparing RCAT and RQLQ results, we found strong correlations of r = -0.871 for grass pollen-allergic patients and r = -0.795 for birch pollen-allergic patients. The comparison between RCAT and RTSS results showed a strong correlation of r = -0.811 (grass pollen-allergic patients) and a moderate correlation of r = -0.539 (birch pollen-allergic patients). In the RCAT, 69.7% of grass pollen-allergic patients and 45.7% of birch pollen-allergic patients receiving guideline-concordant therapy were regarded as having insufficiently controlled symptoms. CONCLUSION The strong correlations suggest that the RCAT alone is equivalent to the RQLQ with respect to patients' symptom control and quality of life. Patients with uncontrolled symptoms can be identified using the RCAT. Hence, the physician can decide whether symptomatic therapy can be intensified or allergy immunotherapy should be administered.
Collapse
Affiliation(s)
- J.-P. Liedtke
- Institute of Medical Statistics, Informatics and Epidemiology; Faculty of Medicine; University of Cologne; Cologne Germany
| | - A. Mandl
- Institute of Medical Statistics, Informatics and Epidemiology; Faculty of Medicine; University of Cologne; Cologne Germany
| | - J. Köther
- Institute of Medical Statistics, Informatics and Epidemiology; Faculty of Medicine; University of Cologne; Cologne Germany
| | - J. Chwieralski
- Institute of Medical Statistics, Informatics and Epidemiology; Faculty of Medicine; University of Cologne; Cologne Germany
| | - K. Shah-Hosseini
- Institute of Medical Statistics, Informatics and Epidemiology; Faculty of Medicine; University of Cologne; Cologne Germany
| | - E. Raskopf
- Institute of Medical Statistics, Informatics and Epidemiology; Faculty of Medicine; University of Cologne; Cologne Germany
| | - U. Pieper-Fürst
- Institute of Medical Statistics, Informatics and Epidemiology; Faculty of Medicine; University of Cologne; Cologne Germany
| | - S. Allekotte
- Institute of Medical Statistics, Informatics and Epidemiology; Faculty of Medicine; University of Cologne; Cologne Germany
| | - R. Mösges
- Institute of Medical Statistics, Informatics and Epidemiology; Faculty of Medicine; University of Cologne; Cologne Germany
- CRI - Clinical Research International Limited; Hamburg Germany
| |
Collapse
|
4
|
Chen ML, Zhao H, Huang QP, Xie ZF. Single nucleotide polymorphisms of IL-13 and CD14 genes in allergic rhinitis: a meta-analysis. Eur Arch Otorhinolaryngol 2018; 275:1491-1500. [DOI: 10.1007/s00405-018-4975-7] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2018] [Accepted: 04/13/2018] [Indexed: 10/17/2022]
|
5
|
Greene LM, Royal KD, Bradley JM, Lascelles BDX, Johnson LR, Hawkins EC. Severity of Nasal Inflammatory Disease Questionnaire for Canine Idiopathic Rhinitis Control: Instrument Development and Initial Validity Evidence. J Vet Intern Med 2016; 31:134-141. [PMID: 28019044 PMCID: PMC5259640 DOI: 10.1111/jvim.14629] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2016] [Revised: 10/04/2016] [Accepted: 11/08/2016] [Indexed: 11/29/2022] Open
Abstract
BACKGROUND Effective treatments are needed for idiopathic chronic rhinitis in dogs, but assessment of efficacy requires a practical, quantifiable method for assessing severity of disease. OBJECTIVES To develop and perform initial validity and reliability testing of an owner-completed questionnaire for assessing clinical signs and dog and owner quality of life (QOL) in canine chronic rhinitis. ANIMALS Twenty-two dogs with histopathologically confirmed chronic rhinitis and 72 healthy dogs. METHODS In this prospective study, an online questionnaire was created based on literature review and feedback from veterinarians, veterinary internists with respiratory expertise, and owners of dogs with rhinitis. Owners of affected dogs completed the questionnaire twice, 1 week apart, to test reliability. Healthy dogs were assessed once. Data were analyzed using the Rasch Rating Scale Model, and results were interpreted using Messick's framework for evaluating construct validity evidence. RESULTS Initial item generation resulted in 5 domains: nasal signs, paranasal signs, global rhinitis severity, and dog's and owner's QOL. A 25-item questionnaire was developed using 5-point Likert-type scales. No respondent found the questionnaire difficult to complete. Strong psychometric evidence was available to support the substantive, generalizability, content, and structural aspects of construct validity. Statistical differences were found between responses for affected and control dogs for all but 2 items. These items were eliminated, resulting in the 23-item Severity of Nasal Inflammatory Disease (SNIFLD) questionnaire. CONCLUSIONS AND CLINICAL IMPORTANCE The SNIFLD questionnaire provides a mechanism for repeated assessments of disease severity in dogs with chronic rhinitis.
Collapse
Affiliation(s)
- L M Greene
- Department of Clinical Sciences, College of Veterinary Medicine, North Carolina State University, Raleigh, NC
| | - K D Royal
- Department of Clinical Sciences, College of Veterinary Medicine, North Carolina State University, Raleigh, NC
| | - J M Bradley
- Department of Clinical Sciences, College of Veterinary Medicine, North Carolina State University, Raleigh, NC
| | - B D X Lascelles
- Department of Clinical Sciences, College of Veterinary Medicine, North Carolina State University, Raleigh, NC
| | - L R Johnson
- Department of Medicine and Epidemiology, School of Veterinary Medicine, University of California, Davis, CA
| | - E C Hawkins
- Department of Clinical Sciences, College of Veterinary Medicine, North Carolina State University, Raleigh, NC
| |
Collapse
|
6
|
Health-Related Quality of Life and Rhinitis Control Measures in Allergic Rhinitis. CURRENT TREATMENT OPTIONS IN ALLERGY 2014. [DOI: 10.1007/s40521-013-0007-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
|
7
|
Abstract
Allergic rhinitis affects 60 million of the U.S. population, 1.4 billion of the global population, and its prevalence appears to be increasing. The duration and severity of allergic rhinitis symptoms place a substantial burden on patient's quality of life, sleep, work productivity, and activity. The health impact of allergic rhinitis is compounded by associated complications and comorbidities including asthma, otitis media, sinusitis, and nasal polyps. Allergic rhinitis symptoms result from a complex, allergen-driven mucosal inflammatory process, modulated by immunoglobulin E (IgE), and caused by interplay between resident and infiltrating inflammatory cells and a number of vasoactive and proinflammatory mediators, including cytokines. This allergic response may be characterized as three phases: IgE sensitization, allergen challenge, and elicitation of symptoms. A thorough allergic history is the best tool for the diagnosis of allergic rhinitis, the establishment of which is achieved by correlating the patient's history and physical exam with an assessment for the presence of specific IgE antibodies to relevant aeroallergens determined by skin testing or by in vitro assay. Management of allergic rhinitis includes modifying environmental exposures, implementing pharmacotherapy, and, in select cases, administering allergen-specific immunotherapy. Intranasal therapeutic options include antihistamines, anticholinergic agents, corticosteroids (aqueous or aerosol), mast cell stabilizers, saline, and brief courses of decongestants. Selection of pharmacotherapy is based on the severity and chronicity of symptoms with the most effective medications being intranasal corticosteroids and intranasal antihistamines, which can be used in combination (separately or in fixed dose) for more difficult to control allergic rhinitis.
Collapse
Affiliation(s)
- Russell A Settipane
- Department of Medicine, Warren Alpert Medical School of Brown University, Providence, Rhode Island, USA.
| | | |
Collapse
|