Diagnostic accuracy of nasal nitric oxide for establishing diagnosis of primary ciliary dyskinesia: a meta-analysis

Nasal Nitric Oxide as a Biomarker in the Diagnosis and Treatment of Sinonasal Inflammatory Diseases: A Review of the Literature

OBJECTIVE

To critically review the literature on nasal nitric oxide (nNO) and its current clinical and research applicability in the diagnosis and treatment of different sinonasal inflammatory diseases, including acute bacterial rhinosinusitis (ABRS), allergic rhinitis (AR), and chronic rhinosinusitis (CRS).

METHODS

A search of the PubMed database was conducted to include articles on nNO and sinonasal diseases from January 2003 to January 2020. All article titles and abstracts were reviewed to assess their relevance to nNO and ABRS, AR, or CRS. After selection of the manuscripts, full-text reviews were performed to synthesize current understandings of nNO and its applications to the various sinonasal inflammatory diseases.

RESULTS

A total of 79 relevant studies from an initial 559 articles were identified using our focused search and review criteria. nNO has been consistently shown to be decreased in ABRS and CRS, especially in cases with nasal polyps. While AR is associated with elevations in nNO, nNO levels have also been found to be lower in AR cases with higher symptom severity. The obstruction of the paranasal sinuses is speculated to be an important variable in the relationship between nNO and the sinonasal diseases. Treatment of these diseases appears to affect nNO through the reduction of inflammatory disease burden and also mitigation of sinus obstruction.

CONCLUSION

nNO has been of increasing interest to researchers and clinicians over the last decade. The most compelling data for nNO as a clinical tool involve CRS. nNO can be used as a marker of ostiomeatal complex patency. Variations in measurement techniques and technology continue to impede standardized interpretation and implementation of nNO as a biomarker for sinonasal inflammatory diseases.

Limitations of Nasal Nitric Oxide Measurement for Diagnosis of Primary Ciliary Dyskinesia with Normal Ultrastructure

Rationale Primary ciliary dyskinesia (PCD) is a heterogeneous, multisystem disorder characterized by defective ciliary beating. Diagnostic guidelines of the American Thoracic Society (ATS) and European Respiratory Society (ERS) recommend measurement of nasal nitric oxide (nNO) for PCD diagnosis. Several studies demonstrated low nNO-production rates in PCD individuals but underlying causes remain elusive. Objective To determine nNO-production rates in a well-characterized PCD cohort including subgroup analyses with regard to ultrastructural and ciliary beating phenotypes. Methods This study included 301 individuals assessed according to ERS guidelines. Diagnostic cutoffs for nNO-production rates for this study cohort and subgroups with normal and abnormal ultrastructure were determined. Diagnostic accuracy was also tested for the widely used 77 nl/min-cutoff in this study cohort. The relationship between nNO-production rates and ciliary beat frequencies (CBFs) was evaluated. Results The study cohort comprised 180 individuals with definite PCD diagnosis including 160 individuals with genetic diagnosis, 16 individuals with probable PCD diagnosis and 105 disease controls. The 77 nl/min nNO-cutoff showed a test sensitivity of 0.92 and specificity of 0.86. Test sensitivity was lower (0.85) in the subgroup of 47 PCD individuals with normal ultrastructure compared to 133 PCD individuals with abnormal ultrastructure (0.95). The optimal diagnostic cutoff for the nNO-production rate for the whole study cohort was 69.8 nl/min (sensitivity 0.92, specificity 0.89), however it was 107.8 nl/min (sensitivity 0.89, specificity 0.78) for the subgroup of PCD with normal ultrastructure. PCD individuals with normal ultrastructure compared to abnormal ultrastructure showed higher ciliary motility. Consistently, PCD individuals with higher CBFs showed higher nNO-production rates. In addition, laterality defects occurred less frequently in PCD with normal ultrastructure. Conclusion Measurements of nNO below the widely used 77 nL/min cutoff are less sensitive in detecting PCD individuals with normal ultrastructure. Our findings indicate, that higher nNO-production in this subgroup with a higher cutoff for the nNO-production rate (107.8 nl/min) and higher residual ciliary motility are dependent on the underlying molecular PCD defect. Higher nNO-production rates, higher residual CBFs and the lower prevalence of laterality defects hamper diagnosis of PCD with normal ultrastructure. Adjusting the cutoff of nNO-production rate to 107.8 nl/min might promote diagnosing PCD with normal ultrastructure.

Breath-holding and tidal breathing nasal NO to screen children for Primary Ciliary Dyskinesia

Nasal nitric oxide (nNO) measurement is recommended to screen for Primary Ciliary Dyskinesia (PCD) in subjects with suggestive history and symptoms. Clinical use of alternative methods (i.e., breath-hold [BH], tidal breathing [TB]) in children unable to perform the gold standard slow Exhalation against a Resistance (ER) method has not been sufficiently evaluated. We extracted retrospectively (2013-2019) 454 files (374 subjects) containing nNO results. Median [IQR] age at inclusion was 7.0 [4.7-11.0] years, 105 (28.1%) children were younger than 5 years. ER or BH methods were more frequently mastered by children older than 5 years compared to younger children (69.4% and 52.7% vs. 21% and 5.6%, respectively; p < .0001), the latter succeeding only in TB measurement in 77.4% of cases. In 130 files with both ER and BH measurements (nNO-ER and nNO-BH), nNO-BH was 102 [96.2; 108.3]% that of nNO-ER. In 175 files including nNO-ER and nNO-TB measurements, nNO-TB was 64.4 [IQR: 53.7; 80.4]% that of nNO-ER with an excellent correlation between nNO values (r = .94 [95% CI 0.91; 0.95]; p < .0001) and discordance in the interpretation of nNO results in 16 (10.2%) cases. Final PCD diagnosis was similar in patients included before or after 5 years of age (confirmed 16 (15.2%) and 48 (17.8%); excluded 81 (77.1%) and 192 (71.4%), respectively; p = .32). In conclusion, reliable nNO-BH and nNO-ER results are interchangeable. Children tested with ER or with TB method have similar final PCD diagnosis. Alternative methods to measure nNO might be studied further for use in clinical practice.

Understanding Primary Ciliary Dyskinesia and Other Ciliopathies

Ciliopathies are a collection of disorders related to cilia dysfunction. Cilia are specialized organelles that project from the surface of most cells. Motile and primary (sensory) cilia are essential structures and have wide ranging functions. Our understanding of the genetics, pathophysiology, and clinical manifestations of motile ciliopathies, including primary ciliary dyskinesia (PCD), has rapidly advanced since the disease was linked to ciliary ultrastructural defects nearly five decades ago. We will provide an overview of different types of cilia, their role in child health and disease, focusing on motile ciliopathies, and describe recent advances that have led to improved diagnostics and may yield therapeutic targets to restore ciliary structure and function.

Nasal Nitric Oxide Measurement in Primary Ciliary Dyskinesia. A Technical Paper on Standardized Testing Protocols

Nasal nitric oxide concentrations are extremely low in primary ciliary dyskinesia (PCD), and measurement of this nasal gas is recommended as a PCD diagnostic test in cooperative patients aged 5 years and older. However, nasal nitric oxide measurements must be performed with chemiluminescence analyzers using a standardized protocol to ensure proper results, because nasal nitric oxide values can be influenced by various internal and external factors. Repeat nasal nitric oxide testing on separate visits is required to ensure that low diagnostic values are persistent and consistent with PCD. This technical paper presents the standard operating procedures for nasal nitric oxide measurement used by the PCD Foundation Clinical and Research Centers Network at various specialty centers across North America. Adherence to this document ensures reliable nasal nitric oxide testing and high diagnostic accuracy when employed in a population with appropriate clinical phenotypes for PCD.

Motile ciliopathies

Motile cilia are highly complex hair-like organelles of epithelial cells lining the surface of various organ systems. Genetic mutations (usually with autosomal recessive inheritance) that impair ciliary beating cause a variety of motile ciliopathies, a heterogeneous group of rare disorders. The pathogenetic mechanisms, clinical symptoms and severity of the disease depend on the specific affected genes and the tissues in which they are expressed. Defects in the ependymal cilia can result in hydrocephalus, defects in the cilia in the fallopian tubes or in sperm flagella can cause female and male subfertility, respectively, and malfunctional motile monocilia of the left-right organizer during early embryonic development can lead to laterality defects such as situs inversus and heterotaxy. If mucociliary clearance in the respiratory epithelium is severely impaired, the disorder is referred to as primary ciliary dyskinesia, the most common motile ciliopathy. No single test can confirm a diagnosis of motile ciliopathy, which is based on a combination of tests including nasal nitric oxide measurement, transmission electron microscopy, immunofluorescence and genetic analyses, and high-speed video microscopy. With the exception of azithromycin, there is no evidence-based treatment for primary ciliary dyskinesia; therapies aim at relieving symptoms and reducing the effects of reduced ciliary motility.

The value of nasal nitric oxide measurement in the diagnosis of primary ciliary dyskinesia

IMPORTANCE

Nasal nitric oxide (nNO) testing is a method used in the diagnosis of primary ciliary dyskinesia (PCD). It has not been evaluated in Chinese population.

OBJECTIVE

To establish a reference nNO value to assist in the diagnosis of PCD in Chinese children.

METHODS

nNO values were measured in children with PCD (n = 36), cystic fibrosis (CF) (n = 20), asthma (n = 45), post-infectious bronchiolitis obliterans (BO) (n = 41) and non-PCD/non-CF bronchiectasis (n = 32). The receiver operating characteristic nNO value for the diagnosis of PCD was plotted and the area under the curve was calculated.

RESULTS

nNO values were significantly lower in children with PCD (median 25.66 nL/min) than in children with asthma (186.26 ± 58.95 nL/ min), BO (143.47 ± 49.71 nL/min) and non-PCD/non-CF bronchiectasis (173.13 ± 63.80 nL/min), but not in children with CF (90.90 ± 43.20 nL/min). Notably however, no CF patient had an nNO value < 45 nL/min. A cut-off of 76 nL/min yielded the best sensitivity of 86.1%, and specificity of 91.4%, with an area under the curve of 0.920 (95% confidence interval 0.859-0.981) for the diagnosis of PCD. If CF was ruled out the specificity increased to nearly 100%.

INTERPRETATION

nNO testing is able to discriminate between patients with PCD and those with CF, asthma, post-infectious BO and non-PCD/non-CF bronchiectasis. A cut-off of 76 nL/min could be further examined in patients suspected of PCD, to establish an nNO reference value for PCD screening in Chinese children.

Diagnosis of Primary Ciliary Dyskinesia. An Official American Thoracic Society Clinical Practice Guideline

BACKGROUND

This document presents the American Thoracic Society clinical practice guidelines for the diagnosis of primary ciliary dyskinesia (PCD).

TARGET AUDIENCE

Clinicians investigating adult and pediatric patients for possible PCD.

METHODS

Systematic reviews and, when appropriate, meta-analyses were conducted to summarize all available evidence pertinent to our clinical questions. Evidence was assessed using the GRADE (Grading of Recommendations, Assessment, Development and Evaluation) approach for diagnosis and discussed by a multidisciplinary panel with expertise in PCD. Predetermined conflict-of-interest management strategies were applied, and recommendations were formulated, written, and graded exclusively by the nonconflicted panelists. Three conflicted individuals were also prohibited from writing, editing, or providing feedback on the relevant sections of the manuscript.

RESULTS

After considering diagnostic test accuracy, confidence in the estimates for each diagnostic test, relative importance of test results studied, desirable and undesirable direct consequences of each diagnostic test, downstream consequences of each diagnostic test result, patient values and preferences, costs, feasibility, acceptability, and implications for health equity, the panel made recommendations for or against the use of specific diagnostic tests as compared with using the current reference standard (transmission electron microscopy and/or genetic testing) for the diagnosis of PCD.

CONCLUSIONS

The panel formulated and provided a rationale for the direction as well as for the strength of each recommendation to establish the diagnosis of PCD.

Cost-effectiveness analysis of three algorithms for diagnosing primary ciliary dyskinesia: a simulation study

Background

Primary Ciliary Dyskinesia (PCD) diagnosis relies on a combination of tests which may include (a) nasal Nitric Oxide (nNO), (b) High Speed Video Microscopy (HSVM) and (c) Transmission Electron Microscopy (TEM). There is variability in the availability of these tests and lack of universal agreement whether diagnostic tests should be performed in sequence or in parallel. We assessed three combinations of tests for PCD diagnosis and estimated net sensitivity and specificity as well as cost-effectiveness (CE) and incremental cost-effectiveness (ICE) ratios.

Methods and results

A hypothetical initial population of 1000 referrals (expected 320 PCD patients) was followed through a probabilistic decision analysis model which was created to assess the CE of three diagnostic algorithms (a) nNO + TEM in sequence, (b) nNO + HSVM in sequence and (c) nNO/HSVM in parallel followed, in cases with conflicting results, by confirmatory TEM (nNO/HSVM+TEM). Number of PCD patients identified, CE and ICE ratios were calculated using Monte Carlo simulations. Out of 320 expected PCD patients, 313 were identified by nNO/HSVM+TEM, 274 with nNO + HSVM and 198 with nNO + TEM. The nNO/HSVM+TEM had the highest mean annual cost (€209 K) followed by nNO + TEM (€150 K) and nNO + HSVM (€136 K). The nNO + HSVM algorithm dominated the nNO + TEM algorithm (less costly and more effective). The ICE ratio for nNO/HSVM+TEM was €2.1 K per additional PCD patient identified.

Conclusions

The diagnostic algorithm (nNO/HSVM+TEM) with parallel testing outperforms algorithms with tests in sequence. These findings, can inform the dialogue on the development of evidence-based guidelines for PCD diagnostic testing. Future research in understudied aspects of the disease, such as PCD-related quality of life and PCD-associated costs, is needed to help the better implementation of these guidelines across various healthcare systems.

Electronic supplementary material

The online version of this article (10.1186/s13023-019-1116-3) contains supplementary material, which is available to authorized users.

Proceedings of the 3rd BEAT-PCD Conference and 4th PCD Training School

Primary ciliary dyskinesia (PCD) is a chronic suppurative airways disease that is usually recessively inherited and has marked clinical phenotypic heterogeneity. Classic symptoms include neonatal respiratory distress, chronic rhinitis since early childhood, chronic otitis media, recurrent airway infections leading to bronchiectasis, chronic sinusitis, laterality defects with and without congenital heart disease including abnormal situs in approximately 50% of the cases, and male infertility. Lung function deteriorates progressively from childhood throughout life. 'Better Experimental Approaches to Treat Primary Ciliary Dyskinesia' (BEAT-PCD) is a network of scientists and clinicians coordinating research from basic science through to clinical care with the intention of developing treatments and diagnostics that lead to improved long-term outcomes for patients. BEAT-PCD activities are supported by EU funded COST Action (BM1407). The third BEAT-PCD conference and fourth PCD training school were held jointly in February 2018 in Lisbon, Portugal. Presentations and workshops focussed on advancing the knowledge and skills relating to PCD in: basic science, epidemiology, diagnostic testing, clinical management and clinical trials. The multidisciplinary conference provided an interactive platform for exchanging ideas through a program of lectures, poster presentations, breakout sessions and workshops. Three working groups met to plan consensus statements. Progress with BEAT-PCD projects was shared and new collaborations were fostered. In this report, we summarize the meeting, highlighting developments made during the meeting.

Accuracy of Nasal Nitric Oxide Measurement as a Diagnostic Test for Primary Ciliary Dyskinesia. A Systematic Review and Meta-analysis

RATIONALE

Primary ciliary dyskinesia (PCD) is a rare disorder causing chronic otosinopulmonary disease, generally diagnosed through evaluation of respiratory ciliary ultrastructure and/or genetic testing. Nasal nitric oxide (nNO) measurement is used as a PCD screening test because patients with PCD have low nNO levels, but its value as a diagnostic test remains unknown.

OBJECTIVES

To perform a systematic review to assess the utility of nNO measurement (index test) as a diagnostic tool compared with the reference standard of electron microscopy (EM) evaluation of ciliary defects and/or detection of biallelic mutations in PCD genes.

DATA SOURCES

Ten databases were searched for reference sources from database inception through July 29, 2016.

DATA EXTRACTION

Study inclusion was limited to publications with rigorous nNO index testing, reference standard diagnostic testing with EM and/or genetics, and calculable diagnostic accuracy information for cooperative patients (generally >5 yr old) with high suspicion of PCD.

SYNTHESIS

Meta-analysis provided a summary estimate for sensitivity and specificity and a hierarchical summary receiver operating characteristic curve. The Quality Assessment of Diagnostic Accuracy Studies-2 tool was used to assess study quality, and Grading of Recommendations Assessment, Development, and Evaluation was used to assess the certainty of evidence. In 12 study populations (1,344 patients comprising 514 with PCD and 830 without PCD), using a reference standard of EM alone or EM and/or genetic testing, summary sensitivity was 97.6% (92.7-99.2) and specificity was 96.0% (87.9-98.7), with a positive likelihood ratio of 24.3 (7.6-76.9), a negative likelihood ratio of 0.03 (0.01-0.08), and a diagnostic odds ratio of 956.8 (141.2-6481.5) for nNO measurements. After studies using EM alone as the reference standard were excluded, the seven studies using an extended reference standard of EM and/or genetic testing showed a summary sensitivity of nNO measurements of 96.3% (88.7-98.9) and specificity of 96.4% (85.1-99.2), with a positive likelihood ratio of 26.5 (5.9-119.1), a negative likelihood ratio of 0.04 (0.01-0.12), and a diagnostic odds ratio of 699.3 (67.4-7256.0). Certainty of the evidence was graded as moderate.

CONCLUSIONS

nNO is a sensitive and specific test for PCD in cooperative patients (generally >5 yr old) with high clinical suspicion for this disease. With a moderate level of evidence, this meta-analysis confirms that nNO testing using velum closure maneuvers has diagnostic accuracy similar to EM and/or genetic testing for PCD when cystic fibrosis is ruled out. Thus, low nNO values accompanied by an appropriate clinical phenotype could be used as a diagnostic PCD test, though EM and/or genetics will continue to provide confirmatory information.

The effect of l-Arginine on Ciliary Beat Frequency in PCD patients, non-PCD respiratory patients and healthy controls

OBJECTIVES

Few studies have examined the potentially therapeutic effect of increasing the production of endogenous nitric oxide (NO) in Primary Ciliary Dyskinesia (PCD) and other chronic respiratory conditions. Nasal NO is low in PCD and has been found to correlate with compromised Ciliary Beat Frequency (CBF). In this study we assessed the effect of increasing l-Arginine, as the substrate of NO synthases, on CBF in biopsies of human respiratory ciliated epithelium.

METHODOLOGY

A total of 28 suspect cases with chronic respiratory manifestations referred for PCD diagnostic testing and 8 healthy controls underwent nasal brushing. Obtained epithelial cells were divided between three culture medium 199 solutions, containing different levels of l-Arginine (0.33 mM as baseline, 1 mM and 10 Mm as increased levels). CBF measurements were obtained at 37 °C and 25 °C at 1, 3 and 24 h after sample acquisition.

RESULTS

Among a total of 36 recruited subjects, 8 had PCD confirmed (PCD n = 8), 20 had PCD excluded (non-PCD n = 20) and 8 were healthy controls (Healthy Controls = 8). Among PCD subjects, ciliary motility was characterized by rotational (n = 5) or dyskinetic (n = 3) beating. At 37 °C, compared to baseline, higher levels of l-Arginine resulted in up to 9% CBF increase at 1 h (p = 0.007), up to 9% CBF increase at 3 h (p < 0.001) and up to 12% CBF increase at 24 h (p = 0.002). Similar although smaller scale increases were recorded at 25 °C. The effect of l-Arginine was time dependent (interaction p = 0.002) and was similar in PCD patients, non-PCD chronic respiratory patients and healthy controls (interaction p = 0.800).

CONCLUSIONS

l-Arginine increases CBF and merits to be evaluated as a potential stimulator of mucociliary clearance in chronic respiratory conditions and congenital ciliary disorders with residual motility. Larger human studies are needed to confirm these findings.

Prevalence of primary ciliary dyskinesia in consecutive referrals of suspect cases and the transmission electron microscopy detection rate: a systematic review and meta-analysis

Diagnostic testing for primary ciliary dyskinesia (PCD) usually includes transmission electron microscopy (TEM), nasal nitric oxide, high-speed video microscopy, and genetics. Diagnostic performance of each test should be assessed toward the development of PCD diagnostic algorithms. We systematically reviewed the literature and quantified PCD prevalence among referrals and TEM detection rate in confirmed PCD patients. Major electronic databases were searched until December 2015 using appropriate terms. Included studies described cohorts of consecutive PCD referrals in which PCD was confirmed by at least TEM and one additional test, in order to compare the index test performance with other test(s). Meta-analyses of pooled PCD prevalence and TEM detection rate across studies were performed. PCD prevalence among referrals was 32% (95% CI: 25-39%, I² = 92%). TEM detection rate among PCD patients was 83% (95% CI: 75-90%, I² = 90%). Exclusion of studies reporting isolated inner dynein arm defects as PCD, reduced TEM detection rate and explained an important fraction of observed heterogeneity (74%, 95% CI: 66-83%, I² = 66%). Approximately, one third of referrals, are diagnosed with PCD. Among PCD patients, a significant percentage, at least as high as 26%, is missed by TEM, a limitation that should be accounted toward the development of an efficacious PCD diagnostic algorithm.

Primary Ciliary Dyskinesia

Primary ciliary dyskinesia (PCD) is a recessive genetically heterogeneous disorder of motile cilia with chronic otosinopulmonary disease and organ laterality defects in ∼50% of cases. The prevalence of PCD is difficult to determine. Recent diagnostic advances through measurement of nasal nitric oxide and genetic testing has allowed rigorous diagnoses and determination of a robust clinical phenotype, which includes neonatal respiratory distress, daily nasal congestion, and wet cough starting early in life, along with organ laterality defects. There is early onset of lung disease in PCD with abnormal airflow mechanics and radiographic abnormalities detected in infancy and early childhood.

Primary ciliary dyskinesia and associated sensory ciliopathies

Primary ciliary dyskinesia (PCD) is a genetic disease of motile cilia, which belongs to a group of disorders resulting from dysfunction of cilia, collectively known as ciliopathies. Insights into the genetics and phenotypes of PCD have grown over the last decade, in part propagated by the discovery of a number of novel cilia-related genes. These genes encode proteins that segregate into structural axonemal, regulatory, as well as cytoplasmic assembly proteins. Our understanding of primary (sensory) cilia has also expanded, and an ever-growing list of diverse conditions has been linked to defective function and signaling of the sensory cilium. Recent multicenter clinical and genetic studies have uncovered the heterogeneity of motile and sensory ciliopathies, and in some cases, the overlap between these conditions. Here, we will describe the genetics and pathophysiology of ciliopathies in children, focusing on PCD, review emerging genotype-phenotype relationships, and diagnostic tools available for the clinician.