Deep learning for spirometry quality assurance with spirometric indices and curves

Development and evaluation of a computerized algorithm for the interpretation of pulmonary function tests

Pulmonary function tests (PFTs) are usually interpreted by clinicians using rule-based strategies and pattern recognition. The interpretation, however, has variabilities due to patient and interpreter errors. Most PFTs have recognizable patterns that can be categorized into specific physiological defects. In this study, we developed a computerized algorithm using the python package (pdfplumber) and validated against clinicians' interpretation. We downloaded PFT reports in the electronic medical record system that were in PDF format. We digitized the flow volume loop (FVL) and extracted numeric values from the reports. The algorithm used FEV1/FVC<0.7 for obstruction, TLC<80%pred for restriction and <80% or >120%pred for abnormal DLCO. The algorithm also used a small airway disease index (SADI) to quantify late expiratory flattening of the FVL to assess small airway dysfunction. We devised keywords for the python Natural Language Processing (NLP) package (spaCy) to identify obstruction, restriction, abnormal DLCO and small airway dysfunction in the reports. The algorithm was compared to clinicians' interpretation in 6,889 PFTs done between March 1st, 2018, and September 30th, 2020. The agreement rates (Cohen's kappa) for obstruction, restriction and abnormal DLCO were 94.4% (0.868), 99.0% (0.979) and 87.9% (0.750) respectively. In 4,711 PFTs with FEV1/FVC≥0.7, the algorithm identified 190 tests with SADI < lower limit of normal (LLN), suggesting small airway dysfunction. Of these, the clinicians (67.9%) also flagged 129 tests. When SADI was ≥ LLN, no clinician's reports indicated small airway dysfunction. Our results showed the computerized algorithm agreed with clinicians' interpretation in approximately 90% of the tests and provided a sensitive objective measure for assessing small airway dysfunction. The algorithm can improve efficiency and consistency and decrease human errors in PFT interpretation. The computerized algorithm works directly on PFT reports in PDF format and can be adapted to incorporate a different interpretation strategy and platform.

Deep learning algorithm for visual quality assessment of the spirograms

Objective. The quality of spirometry manoeuvres is crucial for correctly interpreting the values of spirometry parameters. A fundamental guideline for proper quality assessment is the American Thoracic Society and European Respiratory Society (ATS/ERS) Standards for spirometry, updated in 2019, which describe several start-of-test and end-of-test criteria which can be assessed automatically. However, the spirometry standards also require a visual evaluation of the spirometry curve to determine the spirograms' acceptability or usability. In this study, we present an automatic algorithm based on a convolutional neural network (CNN) for quality assessment of the spirometry curves as an alternative to manual verification performed by specialists.Approach. The algorithm for automatic assessment of spirometry measurements was created using a set of randomly selected 1998 spirograms which met all quantitative criteria defined by ATS/ERS Standards. Each spirogram was annotated as 'confirm' (remaining acceptable or usable status) or 'reject' (change the status to unacceptable) by four pulmonologists, separately for FEV1 and FVC parameters. The database was split into a training (80%) and test set (20%) for developing the CNN classification algorithm. The algorithm was optimised using a cross-validation method.Main results. The accuracy, sensitivity and specificity obtained for the algorithm were 92.6%, 93.1% and 90.0% for FEV1 and 94.1%, 95.6% and 88.3% for FVC, respectively.Significance.The algorithm provides an opportunity to significantly improve the quality of spirometry tests, especially during unsupervised spirometry. It can also serve as an additional tool in clinical trials to quickly assess the quality of a large group of tests.

Deep Learning Utilizing Suboptimal Spirometry Data to Improve Lung Function and Mortality Prediction in the UK Biobank

Background

Spirometry measures lung function by selecting the best of multiple efforts meeting pre-specified quality control (QC), and reporting two key metrics: forced expiratory volume in 1 second (FEV1) and forced vital capacity (FVC). We hypothesize that discarded submaximal and QC-failing data meaningfully contribute to the prediction of airflow obstruction and all-cause mortality.

Methods

We evaluated volume-time spirometry data from the UK Biobank. We identified "best" spirometry efforts as those passing QC with the maximum FVC. "Discarded" efforts were either submaximal or failed QC. To create a combined representation of lung function we implemented a contrastive learning approach, Spirogram-based Contrastive Learning Framework (Spiro-CLF), which utilized all recorded volume-time curves per participant and applied different transformations (e.g. flow-volume, flow-time). In a held-out 20% testing subset we applied the Spiro-CLF representation of a participant's overall lung function to 1) binary predictions of FEV1/FVC < 0.7 and FEV1 Percent Predicted (FEV1PP) < 80%, indicative of airflow obstruction, and 2) Cox regression for all-cause mortality.

Findings

We included 940,705 volume-time curves from 352,684 UK Biobank participants with 2-3 spirometry efforts per individual (66.7% with 3 efforts) and at least one QC-passing spirometry effort. Of all spirometry efforts, 24.1% failed QC and 37.5% were submaximal. Spiro-CLF prediction of FEV1/FVC < 0.7 utilizing discarded spirometry efforts had an Area under the Receiver Operating Characteristics (AUROC) of 0.981 (0.863 for FEV1PP prediction). Incorporating discarded spirometry efforts in all-cause mortality prediction was associated with a concordance index (c-index) of 0.654, which exceeded the c-indices from FEV1 (0.590), FVC (0.559), or FEV1/FVC (0.599) from each participant's single best effort.

Interpretation

A contrastive learning model using raw spirometry curves can accurately predict lung function using submaximal and QC-failing efforts. This model also has superior prediction of all-cause mortality compared to standard lung function measurements.

Funding

MHC is supported by NIH R01HL137927, R01HL135142, HL147148, and HL089856.BDH is supported by NIH K08HL136928, U01 HL089856, and an Alpha-1 Foundation Research Grant.DH is supported by NIH 2T32HL007427-41EKS is supported by NIH R01 HL152728, R01 HL147148, U01 HL089856, R01 HL133135, P01 HL132825, and P01 HL114501.PJC is supported by NIH R01HL124233 and R01HL147326.SPB is supported by NIH R01HL151421 and UH3HL155806.TY, FH, and CYM are employees of Google LLC.

Sex-specific non-linear associations between body mass index and impaired pulmonary ventilation function in a community-based population: Longgang COPD study

Aim: To investigate the prevalence of pulmonary airflow limitation and its association with body mass index (BMI) in a community-based population in Shenzhen, China.

Methods: Study participants were recruited from Nanlian Community in Shenzhen, China, and spirometry was performed to assess lung function including forced vital capacity (FVC), forced expiratory volume in 1 s (FEV1), FEV1/FVC ratio, and FEV1 divided by predicted value. Pulmonary airflow limitation was determined by the Chinese Guideline of Pulmonary Function Examination. Multivariable logistic regression models were used to examine the association between BMI and pulmonary airflow limitation. Age, sex, educational attainment, occupation, and current cigarette smoking were used as potential confounders.

Results: Of the 1206 participants, 612 (50.7%) were men and 594 (49.3%) were women with the average age being 53.7 years old. After adjusting for age, sex, educational attainment, occupation, and current cigarette smoking, higher BMI was associated with lower odds (odds ratio: 0.98, 95% confidence interval: 0.97, 0.99) of pulmonary airflow limitation by assuming a linear relationship. Further investigation of the interaction terms, we found that the magnitudes of the associations differed in men and women. A U-shaped relationship was observed in women, while the association was almost linear in men.

Conclusion: The relationship between BMI and pulmonary airflow limitation was U-shaped in women and linear in men.