1
|
Vieira RJ, Sousa‐Pinto B, Cardoso‐Fernandes A, Jácome C, Portela D, Amaral R, Sá‐Sousa A, Pereira AM, Bousquet J, Fonseca JA. Control of Allergic Rhinitis and Asthma Test: A systematic review of measurement properties and COSMIN analysis. Clin Transl Allergy 2022; 12:e12194. [PMID: 36178185 PMCID: PMC9510765 DOI: 10.1002/clt2.12194] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2022] [Revised: 08/17/2022] [Accepted: 08/29/2022] [Indexed: 11/09/2022] Open
Abstract
The Control of Allergic Rhinitis and Asthma Test (CARAT) is a patient-reported outcome measurement (PROM) assessing the control of asthma and allergic rhinitis (AR) at a 4 week interval. This systematic review aimed to evaluate the measurement properties of CARAT. Following PRISMA and COSMIN guidelines, we searched five bibliographic databases and retrieved studies concerning the development, assessment of properties, validation, and/or cultural adaption of CARAT. The studies' methodological quality, the quality of measurement properties, and the overall quality of evidence were assessed. We performed meta-analysis of CARAT measurement properties. We included 16 studies. Control of Allergic Rhinitis and Asthma Test displayed sufficient content validity and very good consistency (meta-analytical Cronbach alpha = 0.83; 95% CI = 0.80-0.86;I2 = 62.6%). Control of allergic rhinitis and Asthma Test meta-analytical intraclass correlation coefficient was 0.91 (95% CI = 0.64-0.98;I2 = 93.7%). It presented good construct validity, especially for correlations with Patient-reported outcome measures assessing asthma (absolute Spearman correlation coefficients range = 0.67-0.73; moderate quality of evidence), and good responsiveness. Its minimal important difference is 3.5. Overall, CARAT has good internal consistency, reliability, construct validity and responsiveness, despite the heterogeneous quality of evidence. Control of Allergic Rhinitis and Asthma Test can be used to assess the control of asthma and AR. As first of its kind, this meta-analysis of CARAT measurement properties sets a stronger level of evidence for asthma and/or AR control questionnaires.
Collapse
Affiliation(s)
- Rafael José Vieira
- Department of Community Medicine, Information and Health Decision Sciences (MEDCIDS)Faculty of Medicine of the University of PortoPortoPortugal
- Centre for Health Technology and Services ResearchHealth Research Network (CINTESIS@RISE)Faculty of Medicine of the University of PortoPortoPortugal
| | - Bernardo Sousa‐Pinto
- Department of Community Medicine, Information and Health Decision Sciences (MEDCIDS)Faculty of Medicine of the University of PortoPortoPortugal
- Centre for Health Technology and Services ResearchHealth Research Network (CINTESIS@RISE)Faculty of Medicine of the University of PortoPortoPortugal
| | - António Cardoso‐Fernandes
- Department of Community Medicine, Information and Health Decision Sciences (MEDCIDS)Faculty of Medicine of the University of PortoPortoPortugal
- Centre for Health Technology and Services ResearchHealth Research Network (CINTESIS@RISE)Faculty of Medicine of the University of PortoPortoPortugal
| | - Cristina Jácome
- Department of Community Medicine, Information and Health Decision Sciences (MEDCIDS)Faculty of Medicine of the University of PortoPortoPortugal
- Centre for Health Technology and Services ResearchHealth Research Network (CINTESIS@RISE)Faculty of Medicine of the University of PortoPortoPortugal
| | - Diana Portela
- Department of Community Medicine, Information and Health Decision Sciences (MEDCIDS)Faculty of Medicine of the University of PortoPortoPortugal
- Centre for Health Technology and Services ResearchHealth Research Network (CINTESIS@RISE)Faculty of Medicine of the University of PortoPortoPortugal
| | - Rita Amaral
- Department of Community Medicine, Information and Health Decision Sciences (MEDCIDS)Faculty of Medicine of the University of PortoPortoPortugal
- Centre for Health Technology and Services ResearchHealth Research Network (CINTESIS@RISE)Faculty of Medicine of the University of PortoPortoPortugal
- School of HealthPolytechnic of PortoPortoPortugal
- Department of Women's and Children's HealthUppsala UniversityUppsalaSweden
| | - Ana Sá‐Sousa
- Department of Community Medicine, Information and Health Decision Sciences (MEDCIDS)Faculty of Medicine of the University of PortoPortoPortugal
- Centre for Health Technology and Services ResearchHealth Research Network (CINTESIS@RISE)Faculty of Medicine of the University of PortoPortoPortugal
| | - Ana Margarida Pereira
- Department of Community Medicine, Information and Health Decision Sciences (MEDCIDS)Faculty of Medicine of the University of PortoPortoPortugal
- Allergy UnitCUF Porto Hospital & InstitutePortoPortugal
| | - Jean Bousquet
- Institute for AllergologyCharité—Universitätsmedizin BerlinCorporate Member of Freie Universität Berlin and Humboldt‐Universität zu BerlinBerlinGermany
- Fraunhofer Institute for Translational Medicine and Pharmacology ITMPAllergology and ImmunologyBerlinGermany
- University HospitalMontpellierFrance
- ARIAMontpellierFrance
| | - João Almeida Fonseca
- Department of Community Medicine, Information and Health Decision Sciences (MEDCIDS)Faculty of Medicine of the University of PortoPortoPortugal
- Centre for Health Technology and Services ResearchHealth Research Network (CINTESIS@RISE)Faculty of Medicine of the University of PortoPortoPortugal
- Allergy UnitCUF Porto Hospital & InstitutePortoPortugal
| |
Collapse
|
2
|
Sousa‐Pinto B, Azevedo LF, Jutel M, Agache I, Canonica GW, Czarlewski W, Papadopoulos NG, Bergmann K, Devillier P, Laune D, Klimek L, Anto A, Anto JM, Eklund P, Almeida R, Bedbrook A, Bosnic‐Anticevich S, Brough HA, Brussino L, Cardona V, Casale T, Cecchi L, Charpin D, Chivato T, Costa EM, Cruz AA, Dramburg S, Durham SR, De Feo G, Gerth van Wijk R, Fokkens WJ, Gemicioglu B, Haahtela T, Illario M, Ivancevich JC, Kvedariene V, Kuna P, Larenas‐Linnemann DE, Makris M, Mathieu‐Dupas E, Melén E, Morais‐Almeida M, Mösges R, Mullol J, Nadeau KC, Pham‐Thi N, O’Hehir R, Regateiro FS, Reitsma S, Samolinski B, Sheikh A, Stellato C, Todo‐Bom A, Tomazic PV, Toppila‐Salmi S, Valero A, Valiulis A, Ventura MT, Wallace D, Waserman S, Yorgancioglu A, Vries G, Eerd M, Zieglmayer P, Zuberbier T, Pfaar O, Almeida Fonseca J, Bousquet J. Development and validation of combined symptom-medication scores for allergic rhinitis. Allergy 2021; 77:2147-2162. [PMID: 34932829 DOI: 10.1111/all.15199] [Citation(s) in RCA: 30] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2021] [Revised: 11/22/2021] [Accepted: 12/04/2021] [Indexed: 01/11/2023]
Abstract
BACKGROUND Validated combined symptom-medication scores (CSMSs) are needed to investigate the effects of allergic rhinitis treatments. This study aimed to use real-life data from the MASK-air® app to generate and validate hypothesis- and data-driven CSMSs. METHODS We used MASK-air® data to assess the concurrent validity, test-retest reliability and responsiveness of one hypothesis-driven CSMS (modified CSMS: mCSMS), one mixed hypothesis- and data-driven score (mixed score), and several data-driven CSMSs. The latter were generated with MASK-air® data following cluster analysis and regression models or factor analysis. These CSMSs were compared with scales measuring (i) the impact of rhinitis on work productivity (visual analogue scale [VAS] of work of MASK-air® , and Work Productivity and Activity Impairment: Allergy Specific [WPAI-AS]), (ii) quality-of-life (EQ-5D VAS) and (iii) control of allergic diseases (Control of Allergic Rhinitis and Asthma Test [CARAT]). RESULTS We assessed 317,176 days of MASK-air® use from 17,780 users aged 16-90 years, in 25 countries. The mCSMS and the factor analyses-based CSMSs displayed poorer validity and responsiveness compared to the remaining CSMSs. The latter displayed moderate-to-strong correlations with the tested comparators, high test-retest reliability and moderate-to-large responsiveness. Among data-driven CSMSs, a better performance was observed for cluster analyses-based CSMSs. High accuracy (capacity of discriminating different levels of rhinitis control) was observed for the latter (AUC-ROC = 0.904) and for the mixed CSMS (AUC-ROC = 0.820). CONCLUSION The mixed CSMS and the cluster-based CSMSs presented medium-high validity, reliability and accuracy, rendering them as candidates for primary endpoints in future rhinitis trials.
Collapse
Affiliation(s)
- Bernardo Sousa‐Pinto
- MEDCIDS ‐ Department of Community Medicine, Information and Health Decision Sciences Faculty of Medicine University of Porto Porto Portugal
- CINTESIS ‐ Center for Health Technology and Services Research University of Porto Porto Portugal
| | - Luís Filipe Azevedo
- MEDCIDS ‐ Department of Community Medicine, Information and Health Decision Sciences Faculty of Medicine University of Porto Porto Portugal
- CINTESIS ‐ Center for Health Technology and Services Research University of Porto Porto Portugal
| | - Marek Jutel
- Department of Clinical Immunology Wrocław Medical University Wroclaw Poland
- ALL‐MED Medical Research Institute Wroclaw Poland
| | - Ioana Agache
- Faculty of Medicine Transylvania University Brasov Romania
| | - G. Walter Canonica
- Department of Biomedical Sciences Humanitas University Milan Italy
- Personalized Medicine Asthma & Allergy ‐Humanitas Clinical & Research Centre IRCCS Rozzano Italy
| | | | - Nikolaos G. Papadopoulos
- Allergy Department 2nd Pediatric Clinic Athens General Children's Hospital “P&A Kyriakou” University of Athens Athens Greece
| | - Karl‐Christian Bergmann
- Fraunhofer Institute for Translational Medicine and Pharmacology ITMP, Allergology and Immunology Berlin Germany
- Institute for Allergology, Charité – Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt‐Universität zu Berlin Berlin Germany
| | - Philippe Devillier
- UPRES EA220 Pôle des Maladies des Voies Respiratoires Hôpital Foch Université Paris‐Saclay Suresnes France
| | | | - Ludger Klimek
- Department of Otolaryngology, Head and Neck Surgery Universitätsmedizin Mainz Mainz Germany
- Center for Rhinology and Allergology Wiesbaden Germany
| | | | - Josep M. Anto
- ISGlobAL Barcelona Institute for Global Health Barcelona Spain
- IMIM (Hospital del Mar Medical Research Institute) Barcelona Spain
- Universitat Pompeu Fabra (UPF) Barcelona Spain
- CIBER Epidemiología y Salud Pública (CIBERESP) Barcelona Spain
| | - Patrik Eklund
- Computing Science Department Umeå University Umeå Finland
| | - Rute Almeida
- MEDCIDS ‐ Department of Community Medicine, Information and Health Decision Sciences Faculty of Medicine University of Porto Porto Portugal
- CINTESIS ‐ Center for Health Technology and Services Research University of Porto Porto Portugal
| | | | - Sinthia Bosnic‐Anticevich
- Quality Use of Respiratory Medicine Group Woolcock Institute of Medical Research The University of Sydney Sydney New South Wales Australia
- Sydney Local Health District Sydney New South Wales Australia
| | - Helen A. Brough
- Division of Allergy/Immunology University of South Florida Tampa Florida USA
| | - Luisa Brussino
- Department of Medical Sciences Allergy and Clinical Immunology Unit University of Torino & Mauriziano Hospital Torino Italy
| | - Victoria Cardona
- Allergy Section Department of Internal Medicine Hospital Vall d'Hebron & ARADyAL Research Network Barcelona Spain
| | - Thomas Casale
- Division of Allergy/Immunology University of South Florida Tampa Florida USA
| | - Lorenzo Cecchi
- SOS Allergology and Clinical Immunology USL Toscana Centro Prato Italy
| | - Denis Charpin
- Clinique des Bronches Allergie et Sommeil Hôpital Nord Marseille France
| | - Tomás Chivato
- School of Medicine University CEU San Pablo Madrid Spain
| | - Elisio M. Costa
- Faculty of Pharmacy and Competence Center on Active and Healthy Ageing University of Porto (Porto4Ageing) UCIBIOREQUINTE Porto Portugal
| | - Alvaro A. Cruz
- Fundaçao ProAR Federal University of Bahia and GARD/WHO Planning Group Salvador Brazil
| | - Stephanie Dramburg
- Department of Pediatric Pneumology, Immunology and Intensive Care Medicine Charité Medical University Berlin Germany
| | - Stephen R. Durham
- Allergy and Clinical Immunology National Heart and Lung Institute Imperial College London London UK
| | - Giulia De Feo
- Department of Medicine, Surgery and Dentistry “Scuola Medica Salernitana” University of Salerno Salerno Italy
| | - Roy Gerth van Wijk
- Section of Allergology Department of Internal Medicine Erasmus MC Rotterdam The Netherlands
| | - Wystke J. Fokkens
- Department of Otorhinolaryngology Amsterdam University Medical Centres Amsterdam The Netherlands
| | - Bilun Gemicioglu
- Department of Pulmonary Diseases Cerrahpasa Faculty of Medicine Istanbul University‐Cerrahpasa Istanbul Turkey
| | - Tari Haahtela
- Skin and Allergy Hospital Helsinki University Hospital University of Helsinki Helsinki Finland
| | - Maddalena Illario
- Department of Public Health and Research and Development Unit Federico II University and Hospital Naples Italy
| | | | - Violeta Kvedariene
- Department of Pathology Faculty of Medicine Institute of Biomedical Sciences Vilnius University Vilnius Lithuania
- Faculty of Medicine Institute of Clinical Medicine Clinic of Chest Diseases and Allergology Vilnius University Vilnius Lithuania
| | - Piotr Kuna
- Division of Internal Medicine, Asthma and Allergy Barlicki University Hospital Medical University of Lodz Poland
| | | | - Michael Makris
- Allergy Unit “D Kalogeromitros” 2nd Department of Dermatology and Venereology National & Kapodistrian University of Athens, “Attikon” University Hospital Athens Greece
| | | | - Erik Melén
- Sachs’ Children and Youth Hospital Södersjukhuset Stockholm Sweden
- Institute of Environmental Medicine Karolinska Institutet Stockholm Sweden
| | | | - Ralph Mösges
- CRI‐Clinical Research International‐Ltd Hamburg Germany
| | - Joaquim Mullol
- Rhinology Unit & Smell Clinic ENT Department Hospital Clínic Barcelona Spain
- Clinical & Experimental Respiratory Immunoallergy IDIBAPSCIBERESUniversity of Barcelona Barcelona Spain
| | - Kari C. Nadeau
- Sean N. Parker Center for Allergy and Asthma Research Stanford University School of Medicine Stanford California USA
| | - Nhân Pham‐Thi
- IRBA (Institut de Recherche bio‐Médicale des Armées) Ecole Polytechnique Palaiseau Bretigny France
| | - Robyn O’Hehir
- Department of Allergy, Immunology and Respiratory Medicine Central Clinical School Monash University and Alfred Health Melbourne Victoria Australia
| | - Frederico S. Regateiro
- Allergy and Clinical Immunology Unit Centro Hospitalar e Universitário de Coimbra Coimbra Portugal
- Institute of Immunology Faculty of Medicine University of Coimbra Portugal
- ICBR ‐ Coimbra Institute for Clinical and Biomedical Research CIBB Coimbra Portugal
| | - Sietze Reitsma
- Department of Otorhinolaryngology Amsterdam University Medical CentresAMC Amsterdam The Netherlands
| | - Boleslaw Samolinski
- Department of Prevention of Environmental Hazards, Allergology and Immunology Medical University of Warsaw Warsaw Poland
| | - Aziz Sheikh
- Usher Institute The University of Edinburgh Edinburgh UK
| | - Cristiana Stellato
- Department of Medicine, Surgery and Dentistry “Scuola Medica Salernitana” University of Salerno Salerno Italy
| | - Ana Todo‐Bom
- Imunoalergologia Centro Hospitalar Universitário de Coimbra and Faculty of Medicine University of Coimbra Coimbra Portugal
| | - Peter Valentin Tomazic
- Department of General ORL, H&NS Medical University of GrazENT‐University Hospital Graz Austria
| | - Sanna Toppila‐Salmi
- Skin and Allergy Hospital Helsinki University Hospital and University of Helsinki Helsinki Finland
| | - Antonio Valero
- Pneumology and Allergy Department CIBERES and Clinical & Experimental Respiratory Immunoallergy IDIBAPSUniversity of Barcelona Spain
| | - Arunas Valiulis
- Faculty of Medicine Institute of Clinical Medicine & Institute of Health Sciences Vilnius University Vilnius Lithuania
- European Academy of Paediatrics (EAP/UEMS‐SP) Brussels Belgium
| | - Maria Teresa Ventura
- Unit of Geriatric Immunoallergology University of Bari Medical School Bari Italy
| | - Dana Wallace
- Nova Southeastern University Fort Lauderdale Florida USA
| | - Susan Waserman
- Department of Medicine Clinical Immunology and Allergy McMaster University Hamilton Ontario Canada
| | - Arzu Yorgancioglu
- Department of Pulmonary Diseases Faculty of Medicine Celal Bayar University Manisa Turkey
| | | | | | - Petra Zieglmayer
- Vienna Challenge Chamber Vienna Austria
- Competence Center for Allergology and Immunology Karl Landsteiner University Krems Austria
| | - Torsten Zuberbier
- Fraunhofer Institute for Translational Medicine and Pharmacology ITMP, Allergology and Immunology Berlin Germany
- Institute for Allergology, Charité – Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt‐Universität zu Berlin Berlin Germany
| | - Oliver Pfaar
- Section of Rhinology and Allergy Department of Otorhinolaryngology, Head and Neck Surgery University Hospital MarburgPhilipps‐Universität Marburg Marburg Germany
| | - João Almeida Fonseca
- Departamento Medicina da Comunidade Informaçao e Decisao em Saude (MEDCIDS) Faculdada de Medicina da Universidade do Porto Porto Portugal
- Medicina, EDucaçao, I&D e Avaliaçao Lda (MEDIDA) Porto Portugal
- Imunoalergologia CUF Porto Portugal
| | - Jean Bousquet
- Fraunhofer Institute for Translational Medicine and Pharmacology ITMP, Allergology and Immunology Berlin Germany
- Institute for Allergology, Charité – Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt‐Universität zu Berlin Berlin Germany
- MACVIA‐France Montpellier France
- University Hospital Montpellier Montpellier France
| |
Collapse
|