Chronic Obstructive Pulmonary Disease (COPD) is a respiratory condition that causes persistent airflow obstruction, due to alterations in the airways and/or in the alveoli, which result in chronic respiratory symptoms such as cough and dyspnoea.1 Even though COPD is a preventable and treatable disease, it is the third leading cause of death worldwide, with a higher burden on low- and medium-income countries.2 For example, in Latin America, the PLATINO Study found a 14.3% COPD prevalence, ranging from 7.8% in Mexico City to 19.7% in Montevideo, Uruguay.3 Globally, more than 3 million deaths were attributed to COPD in 2019 alone,4 and the disease prevalence is only expected to increase in the following years, because of the world’s population aging and continuous exposure to noxious particles or gases, like tobacco smoking and air pollution.5 Due to its progressive nature, timely diagnosis of COPD is key to manage disease development by taking protective measures and treating symptoms, improving the prognosis for the patient.6
Current international guidelines indicate that any subject exposed to at least one risk factor should be tested for COPD with spirometry, and the ratio between the Forced Expiratory Volume in the first second (FEV1) and the Forced Vital Capacity (FVC), after applying a bronchodilator, is evaluated. If this ratio results to be under 0.7 (70%), the patient is diagnosed with COPD.1 However, authorities like the American Thoracic Society (ATS) and the European Respiratory Society (ERS) advise considering the statistically derived lower limit of normal (LLN) as well.7 Even though there has been a global effort in improving its diagnosis, COPD still has high underdiagnosis and misdiagnosis rates. For instance, the PUMA Study, which was conducted in Argentina, Colombia, Uruguay, and Venezuela in 2016, found an underdiagnosis prevalence of 77% and a misdiagnosis rate of 30.4%.8
The FEV1/FVC ratio only considers two instantaneous measures of the spirometry, but more information can be gathered from the flow-volume curve shape. Previous studies have been conducted to quantify and analyse the curvature of this trace with promising results in COPD diagnosis.9–14 Meanwhile, other researchers have leveraged the increase in computational power and the development of new tools in artificial intelligence. These tools have an outstanding performance in recognizing multidimensional patterns, so they have been proved to be useful in diagnosing respiratory diseases.15–20 We developed a new COPD diagnostic system that combines these two approaches by modelling the curvature of the expiratory flow-volume trace and feeding the resulting coefficients to different machine-learning techniques to classify patients between those with COPD and those without it. This paper presents the results of the diagnostic accuracy of the proposed system, when tested in patients who are >40 years old and have respiratory symptoms and/or risk factors, in comparison to the classification made by an expert pneumologist.
Methods Study DesignThis was an observational analytical single-centre study that followed the Declaration of Helsinki and was approved by the Ethics Committee of Clínica Universidad de la Sabana. These patients had signed an Informed Consent, in which they authorized the use of their personal data for research purposes. Their records were collected between August 2017 and August 2019.
Eligibility CriteriaThe inclusion criteria were patients included in the spirometer database, with signed informed consent and under study due to suspicion of respiratory disease. The exclusion criteria were patients younger than 40 years, having less than 3 post-bronchodilator spirometric trials, incomplete clinical information, or illegible spirometry according to the expert pneumologist. In particular, the record needed to have all the clinical variables that were deemed relevant for COPD diagnosis in a previously conducted expert consensus Supplementary Table 1.
VariablesAll included patients had raw spirometry data stored in the same spirometer (Vmax Encore 22, CareFusion, Yorba Linda, California), and demographic information and answers regarding risk factors and respiratory symptoms were collected through questionnaires validated for COPD diagnosis. Spirometry raw data were stored in .fvl format, and each file included the patient’s name and ID, date of test, as well as the registration of flow and volume in time for up to 8 pre-bronchodilator and 8 post-bronchodilator forced-manoeuvre spirometry trials. Each file also had the selection of the best pre-bronchodilator trial and the best post-bronchodilator trial, according to a professional in respiratory therapy, who chose the best traces according to the ATS/ERS criteria (the curve with the largest sum of FVC + FEV1 that fulfilled the Acceptability, Usability, and Repeatability ATS/ERS Criteria for FEV1 and FVC).21 An expert pneumologist evaluated each patient’s record and determined which patients had COPD and which did not. This classification was used as a reference test to evaluate diagnostic accuracy.
Study Sample SizeSince this is a study that compares two diagnostic tests, the sample size calculation was performed as indicated by Machin et al.22 With a significance level of 5%, a power of 20%, an increase in sensitivity from 80% in the imperfect gold-standard to 90% in the new test, and a proportion of diseased patients of 30%, we obtained a minimal sample size of 657.
Test MethodsWe extracted the raw signals from the spirometer for all the patients, verified the fulfilment of all inclusion/exclusion criteria, selected the best prebronchodilator and postbronchodilator trial traces as tagged by the respiratory therapist and modelled the expiratory phase from the peak expiratory flow to the forced vital capacity, by means of four techniques:
- quadratic polynomial: F = C2V2+C1V+C0 - cubic polynomial: F = C3V3+C2V2+C1V+C0 - one-term exponential: F = aebV - two-term exponential: F = aebV+cedVThe goodness of fit for the obtained models was calculated separately for prebronchodilator and postbronchodilator traces by four metrics: Sum Squared Error (SSE), Coefficient of Determination (R2), adjusted Coefficient of Determination (adjR2) and Root Mean Square Error (RMSE).
Then, the subjects were randomly assigned to training or testing, in a 90/10 ratio.23 This was done to set aside a group of samples (testing) that will not be used to train the machine learning techniques. This allows the evaluation of the performance of the system in the samples used for training and in samples the system has not seen before, to emulate what would occur in a real-life setting. The coefficients of training samples were fed in three groups (prebronchodilator coefficients, postbronchodilator coefficients and all coefficients) to 5 different machine learning techniques: two unsupervised techniques (k-means clustering and hierarchical clustering) and three supervised techniques (Decision Trees – DT, Support Vector Machines – SVM and artificial neural networks – ANN). The artificial neural networks to be tested were fully connected feedforward networks, and the input layer changed depending on the number of coefficients chosen to feed it. The training of all 5 techniques was performed using 10-fold cross-validation.24
Next, the classification made by these techniques on both training and testing groups was compared to the classification made by the expert. The diagnostic performance of each of the machine learning methods was determined based on the accuracy, sensitivity, specificity, positive predictive value, and negative predictive value calculated from the confusion matrix.25
Statistical MethodsCategorical Variables were characterized by absolute and relative frequencies. Quantitative variables were described by medians and interquartile ranges if they were not normal according to the One-sample Kolmogorov–Smirnov test. To compare the groups of patients with COPD and without COPD, we used Chi-Squared Pooled Estimate of Proportion for categorical variables and Wilcoxon Rank Sum Test in quantitative variables.
Data Analysis and Modelling SoftwareData were processed using MATLAB Release 2022a (The MathWorks, Inc., Natick, Massachusetts, United States).
ResultsThe available database had spirometric records and questionnaire answers of 765 patients. After reviewing inclusion/exclusion criteria, 695 patient records were included in the analysis Figure 1.
Figure 1 Patient selection process.
The 695 subjects were divided into two groups (COPD and No COPD), according to the diagnosis made by the expert, and 34% (237/695) had COPD Table 1. The COPD group was significantly older than the No COPD group, and women were the majority in the No COPD group. Most of the subjects (595/695) reported having respiratory symptoms. Out of the whole sample, 27% of the subjects informed having a previous COPD diagnosis, 14% stated they had been diagnosed with asthma, but less than half (46%) claimed they had gone through a spirometry study before. The COPD group had a higher proportion of smokers or ex-smokers (52% vs 42% in the No COPD group), and dyspnoea was the most frequently reported symptom (62%). Also, in the COPD group, the most common risk factor was exposure to wood smoke (68%), followed by tobacco smoking (52%), with a median pack-year of 29, without considering non-smokers.
Table 1 Patient Demographic Data
Figure 2 shows an example of each of the techniques used for curve fitting. The spirometric curve was modelled from the Peak Expiratory Flow (PEF), or maximum flow, to the Forced Vital Capacity (FVC), or maximum volume.
Figure 2 Example of curve fitting by quadratic polynomial, cubic polynomial, one-term and two term exponentials when applied to the spirometric curve.
Table 2 displays the summary of the goodness-of-fit evaluation for each of the modelling techniques, discriminated on prebronchodilator (PreBD) and postbronchodilator (PostBD) traces. The cubic polynomial had the highest goodness-of-fit metrics, while the 1-term exponential had the worse fit performance. Since both SSE and RMSE are measures of error, the smaller they are, the better the fit. On the other hand, R2 and adjR2 are unity bound and a measure of one means perfect fit.
Table 2 Curve Modelling Goodness of Fit
Table 3 compares, in terms of median and interquartile range, the behaviour of the coefficients between the COPD and No COPD groups, and it shows that most of the proposed coefficients have statistically significant differences between both groups.
Table 3 Coefficient Statistical Description
The methods that displayed the highest accuracy (<85%) when evaluated in the test samples are summarized in Table 4. The highest accuracy was obtained by the Artificial Neural Network, fed by the coefficients of the quadratic polynomial model applied to the postbronchodilator traces, with an accuracy of 92.9%.
Table 4 Best Diagnostic Performance Results in Test Samples
Out of this selection of well-performing methods, this neural network configuration also displayed the highest sensitivity (88.2%) and highest specificity (94.3%). The architecture of this ANN is a 3-neuron input layer and three hidden layers (18, 272 and 1 neurons, respectively), both with hyperbolic tangent as activation function. The output layer has two neurons, one for each class, and the activation function is softmax. Full Results regarding diagnostic accuracy are in the Supplementary Tables 2.1–2.10
For comparison, we analysed the classification made by the current gold standard (FEV1/FVC <0.7) on the 70 patients that were chosen for testing the artificial neural network. Table 5 displays the confusion matrix for the gold standard classification for the testing samples, using the best PostBD curve. Table 6 displays the classification made by the artificial neural network trained with the coefficients from the quadratic polynomial in the same curve and in the same samples.
Table 5 Confusion Matrix for the Gold Standard FEV1/FVC <0.7 on the Same 70 Patients That Were Used to Test the Machine-Learning Algorithm
Table 6 Confusion Matrix for the Testing Samples of the Artificial Neural Network Trained with the Coefficients from the Quadratic Polynomial After Applying Bronchodilator
These two classifications yield the diagnostic accuracy metrics that are summarized in Table 7.
Table 7 Diagnostic Accuracy Comparison Between FEV1/FVC <0.7 and the Artificial Neural Network Trained with the Coefficients from the Quadratic Polynomial After Applying Bronchodilator
DiscussionThe goal of this study was to develop an automated tool that leverages the information contained in the curvature of the spirometry traces to assist the process of diagnosing COPD, particularly in primary care settings, where medical professionals might not be as familiarized with spirometric patterns as specialists. We proposed a new COPD diagnostic system that models the curvature of the expiratory flow-volume trace through a mathematical model and feeds the coefficients of the model to a machine-learning technique to classify patients between those with COPD and those without it. We evaluated the combination of four mathematical models and five machine learning techniques. Out of the different combinations, the best diagnostic performance was obtained with a quadratic polynomial and an artificial neural network.
From the goodness-of-fit scores, we found that cubic polynomial model had the best fit to the spirometric traces, while the 1-term exponential model had the worst. Nonetheless, we chose to use the coefficients from all four models because they all had an acceptable fit to the curves. Then, to get an idea of the proposed variables’ capabilities to distinguish between the two groups, we compared the behaviour of the coefficients between the COPD and No COPD groups, and we found that most of the coefficients had a low p-value, when evaluated individually. This result indicated that these features had the potential to correctly classify our subjects. Regardless of this result, we used all of them to feed the machine-learning techniques.
We chose five machine learning techniques to cover a wide range of possibilities. We used clustering techniques to explore the behaviour of our variables, but their diagnostic performance was not as good as that for supervised methods. Regarding the supervised techniques, we tried the simple decision tree because this algorithm could be easily understood and used in the clinical practice. Support Vector Machines were in the mid-range complexity, and we used it because it usually performs well in separating data in multi-dimensional spaces. Finally, the artificial neural network, the most complex technique, is difficult to interpret but it is the most used in the available literature, and it is the most powerful.23 As expected, the artificial neural network had the best performance. Surprisingly, the best artificial network was the one fed by the coefficients of the quadratic polynomial, when the modelling is applied to the postbronchodilator curves.
As shown in Table 7, our proposed system displays better diagnostic accuracy metrics than the current gold standard FEV1/FVC <0.7. Particularly, the specificity and the NPV show outstanding performance, which would make our classification system very valuable in a screening stage of the diagnostic process, such as in primary care.26
In a previous study, we proposed seven new measures of spirometry and evaluated their diagnostic accuracy.27 Three of these measurements (slope at 50% of FVC, slope at PEF and slope at 75% of FVC) had an outstanding 95% accuracy when compared to the FEV1/FVC ratio. Other studies have also proposed new metrics for the curvature of the spirometry trace. For example, Das et al9 found in a cohort of patients with COPD that the area under the forced expiratory flow-volume loop had good accuracy to detect severe hyperinflation. Mochizuki et al10 proposed the obstruction index and found that it is very well correlated with emphysema in Computed Tomography (CT). In 2018, Bhatt et al11 explored mathematical modelling using exponentials in the volume–time curve and found that Parameter D had a higher sensitivity than FEV1/FVC for light obstruction when CT is used as reference.
On the other hand, machine learning techniques have been used for over a decade to facilitate the detection of respiratory diseases. Tang et al15 evaluated the diagnostic performance of deep residual networks to automate COPD detection in low-dose CT and found that this technique can obtain very good accuracy and positive predictive values. Bodduluri et al16 compared a deep neural network and a random forest classifier against traditional spirometric measures in their capabilities to differentiate among COPD structural phenotypes, showing the great potential of artificial intelligence for this diagnostic task. Finally, Ioachimescu et al17 proposed the squared root of the area under the curve to feed an artificial neural network and it had a misclassification rate under 9% in patients with COPD diagnosis obtained through spirometry, plethysmography, and Helium dilution.
The main strength of this study is that we had access to raw spirometry data, which allowed us to work with actual spirometric data. Another of our strengths is that all studies were conducted in the same pulmonary lab, so all the records were acquired by professionals in respiratory therapy who had the same training and applied the same protocols.
One of the limitations of this study is that it was conducted with the data from a single centre, which may limit the extrapolation of the results. Finally, we did not have other more conclusive tests to diagnose COPD in the patients (such as Computed Tomography or Carbon monoxide diffusing capacity), which would guarantee a more certain diagnosis by the pneumologist.
ConclusionThis study explored the diagnostic performance of a combination of several curve modelling techniques and machine-learning techniques to diagnose COPD, based on spirometry alone. We found that an Artificial Neural Network fed with coefficients obtained from quadratic polynomial coefficients had 92.9% accuracy, 88.2% sensitivity and 94.3% specificity to detect COPD. The proposed system had better diagnostic accuracy performance than the current gold standard FEV1/FVC <0.7 in a sample of 70 patients. Hence, Artificial Neural Networks fed with quadratic and cubic polynomial coefficients have interesting potential for assisting the clinical diagnostic process, becoming an important aid in primary care to diagnose COPD in an early stage.
Patient and Public InvolvementPatients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.
Data Sharing StatementData are available upon reasonable request. The data that support the findings of this study are available on request.
Ethics ApprovalThis study involves human participants and was conducted according to the declaration of Helsinki, approved by the institutional ethics committee of the Clínica Universidad de La Sabana.
AcknowledgmentsThe study was carried out at the Universidad de La Sabana.
Author ContributionsAll authors contributed to the study concept and design. Data acquisition was performed by AMF, ARBG, and DABR, and data analysis was performed by AMF, LFGC, MC, and ARBG. All authors contributed to the interpretation of the data. AMF, ETQ, and DABR drafted the work. LFGC, MC and ARBG critically revised every version of the article. All authors took part in drafting, revising or critically reviewing the article; gave final approval of the version to be published; have agreed on the journal to which the article has been submitted; and agree to be accountable for all aspects of the work. All authors have approved all changes and have accepted the final version for publication.
FundingThis work was supported by Universidad de La Sabana grant number MED-294-2020.
DisclosureThe authors report no conflicts of interest in this work.
References1. Global Initiative for Chronic Obstructive Lung Disease. POCKET GUIDE TO COPD DIAGNOSIS, MANAGEMENT, AND PREVENTION A guide for Health Care Professionals; 2023. Available from: https://goldcopd.org/wp-content/uploads/2023/03/POCKET-GUIDE-GOLD-2023-ver-1.2-17Feb2023_WMV.pdf. Accessed June5, 2024.
2. Organización Mundial de la Salud. Enfermedad Pulmonar Obstructiva Crónica. 2023. Available from: https://www.who.int/es/news-room/fact-sheets/detail/chronic-obstructive-pulmonary-disease-(copd). Accessed June5, 2024.
3. Menezes AMB, Perez-Padilla R, Jardim JRB, et al. Chronic obstructive pulmonary disease in five Latin American cities (the PLATINO study): a prevalence study. Lancet. 2005;366(9500):1875–1881. doi:10.1016/S0140-6736(05)67632-5
4. Zou J, Sun T, Song X, et al. Distributions and trends of the global burden of COPD attributable to risk factors by SDI, age, and sex from 1990 to 2019: a systematic analysis of GBD 2019 data. Respir Res. 2022;23(1). doi:10.1186/s12931-022-02011-y
5. Global Initiative for Chronic Obstructive Disease. Global strategy for the diagnosis, management, and prevention of chronic obstructive pulmonary disease - 2023 report; 2023; Available from: https://goldcopd.org/2023-gold-report-2/. Accessed June5, 2024.
6. Celli BR. Update on the Management of COPD. Chest. 2008;133(6):1451–1462. doi:10.1378/chest.07-2061
7. Stanojevic S, Kaminsky DA, Miller MR, et al. ERS/ATS technical standard on interpretive strategies for routine lung function tests. Eur Respir J. 2022;60(1):1.
8. Casas Herrera A, De Oca MM, López Varela MV, Aguirre C, Schiavi E, Jardim JR. COPD underdiagnosis and misdiagnosis in a high-risk primary care population in four Latin American countries. A key to enhance disease diagnosis: the PUMA Study. PLoS One. 2016;11(4):e0152266. doi:10.1371/journal.pone.0152266
9. Das N, Topalovic M, Aerts JM, Janssens W. Area under the forced expiratory flow-volume loop in spirometry indicates severe hyperinflation in COPD patients. Int J COPD. 2019;14:409–418. doi:10.2147/COPD.S185931
10. Mochizuki F, Iijima H, Watanabe A, et al. The concavity of the maximal expiratory flow–volume curve reflects the extent of emphysema in obstructive lung diseases. Sci Rep. 2019;9(1):1–10. doi:10.1038/s41598-019-49591-2
11. Bhatt SP, Bhakta NR, Wilson CG, et al. New spirometry indices for detecting mild airflow obstruction. Sci Rep. 2018;8(1):1–8. doi:10.1038/s41598-018-35930-2
12. Oh A, Morris TA, Yoshii IT, Morris TA. Flow decay: a novel spirometric index to quantify dynamic airway resistance. Respir Care. 2017;62(7):928–935. doi:10.4187/respcare.04850
13. Li H, Liu C, Zhang Y, Xiao W. The concave shape of the forced expiratory flow-volume curve in 3 seconds is a practical surrogate of FEV1/FVC for the diagnosis of airway limitation in inadequate spirometry. Respir Care. 2017;62(3):363–369. doi:10.4187/respcare.05016
14. Johns DP, Das A, Toelle BG, et al. Improved spirometric detection of small airway narrowing: concavity in the expiratory flow–volume curve in people aged over 40 years. Int J Chron Obstruct Pulmon Dis. 2017;12:3567. doi:10.2147/COPD.S150280
15. Tang LYW, Coxson HO, Lam S, Leipsic J, Tam RC, Sin DD. Towards large-scale case-finding: training and validation of residual networks for detection of chronic obstructive pulmonary disease using low-dose CT. Lancet Digit Health. 2020;2(5):e259–67. doi:10.1016/S2589-7500(20)30064-9
16. Bodduluri S, Nakhmani A, Reinhardt JM, et al. Deep neural network analyses of spirometry for structural phenotyping of chronic obstructive pulmonary disease. JCI Insight. 2020;5(13). doi:10.1172/jci.insight.132781
17. Ioachimescu OC, Stoller JK. An alternative spirometric measurement: area under the expiratory flow–volume curve. Ann Am Thorac Soc. 2020;17(5):582–588. doi:10.1513/AnnalsATS.201908-613OC
18. Swaminathan S, Qirko K, Smith T, et al. A machine learning approach to triaging patients with chronic obstructive pulmonary disease. PLoS One. 2017;12(11):e0188532. doi:10.1371/journal.pone.0188532
19. Jafari S, Arabalibeik H, Agin K. Classification of Normal and Abnormal Respiration Pattern Using Flow Volume Curve and Neural Network. In: 5th International Symposium on Health Informatics and Bioinformatics IEEE. 2010:110–113.
20. Baemani J, Baemani MJ, Monadjemi A, Moallem P. Detection of respiratory abnormalities using artificial neural networks. J Comput Sci. 2008;4(8):663–667. doi:10.3844/jcssp.2008.663.667
21. Graham BL, Steenbruggen I, Barjaktarevic IZ, et al. Standardization of spirometry 2019 update an official American Thoracic Society and European Respiratory Society technical statement. Am J Respir Crit Care Med. 2019;200(8):E70–88. doi:10.1164/rccm.201908-1590ST
22. Machin D, Campbell MJ, Tan SB, Tan SH. Sample Sizes for Clinical, Laboratory and Epidemiology Studies. Wiley Online Library; 2018.
23. Hudson DL, Cohen ME. Neural Networks and Artificial Intelligence for Biomedical Engineering. New York, NY, USA: IEEE; 2000.
24. Berrar D. Cross-validation. In: Encyclopedia of Bioinformatics and Computational Biology: ABC of Bioinformatics. Elsevier; 2018:542–545.
25. Šimundić AM. Measures of diagnostic accuracy: basic definitions. EJIFCC. 2009;19(4):203–211.
26. Maxim LD, Niebo R, Utell MJ. Screening tests: a review with examples. In: Inhalation Toxicology. Vol. 26. Informa Healthcare; 2014:811–828.
27. Moreno Giraldo AMM, Giraldo Cadavid LF, Botero Rosas D, et al. Comparison of new spirometry measures to diagnose COPD. Respir Care. 2022;2022:10191.
留言 (0)