Journal Logo

Research Article: Diagnostic Accuracy Study

Active case finding strategy for chronic obstructive pulmonary disease with handheld spirometry

Kim, Joo Kyung MDa; Lee, Chang Min MDa; Park, Ji Young MDa; Kim, Joo Hee MDa; Park, Sung-hoon MDa; Jang, Seung Hun MDa; Jung, Ki-Suck MDa; Yoo, Kwang Ha MDb; Park, Yong Bum MDc; Rhee, Chin Kook MDd; Kim, Deog Kyeom MDe; Hwang, Yong Il MDa,*

Editor(s): Adamek., Mariusz

Author Information
doi: 10.1097/MD.0000000000005683

Abstract

1 Introduction

Chronic obstructive pulmonary disease (COPD) is characterized by persistent and progressive airflow limitation.[1] COPD has emerged as a serious public health concern in recent years, and is predicted to become the fourth leading cause of death worldwide by 2030.[1,2] However, public awareness of COPD is limited.[3–5] Moreover, some studies have demonstrated that a significant number of individuals have undiagnosed airflow limitation.[6,7] COPD is not usually diagnosed until lung function has deteriorated by at least 50%.[8] Thus, there have been recent efforts to improve the detection and diagnosis of COPD. Early diagnosis and treatment of COPD can prevent the progressive deterioration of lung function and improve outcomes. This can be done through pharmacological intervention, or targeted interventions to help patients quit smoking, which is a major cause of COPD.[9,10] However, the routine screening of COPD is not recommended for the general population.[11,12] Therefore, the Global Initiative for Obstructive Lung Disease (GOLD) advocates active case finding.[1]

Spirometry is required for the diagnosis of COPD. A ratio of postbronchodilator forced expiratory volume in 1 second (FEV1) to forced vital capacity (FVC) less than 0.7 is the standard diagnostic measure for the presence of airflow limitation.[1] Recently, measuring the forced expiratory volume in 6 seconds (FEV6) has been suggested as an alternative to measuring FVC, because FVC is difficult to measure, can cause patients discomfort, and has poor reproducibility.[13] Handheld spirometry, which is small, inexpensive, and portable, measures both FEV1 and FEV6, instead of FVC. For active case finding, recent studies suggested the application of combined handheld spirometry and a COPD questionnaire.[14,15] Studies identifying the cut-off value for FEV1/FEV6 to diagnose airflow limitation have produced variable results, with values between 0.7 and 0.8.[16,17] Therefore, the purpose of this study was to determine the applicability of handheld spirometry as an active case-finding tool for the patients with risk factors for development of COPD in a primary clinical setting. We also explored the efficacy of the “Could it be COPD?” questionnaire developed by GOLD, in conjunction with measurement of FEV1/FEV6.

2 Methods

2.1 Study participants

This study was a prospective cohort study, which aimed to identify undiagnosed COPD patients using handheld spirometry. We enrolled subjects who visited a primary clinic complaining of respiratory symptoms from April to August of 2015. All participants were aged 40 years or older, had a history of smoking of more than 10 pack-years irrespective of their current smoking state, and had no previous diagnosis of COPD. We excluded patients with a history of disease that might have influenced spirometry results, such as tuberculosis-destroyed lungs, bronchiectasis, asthma, or lung cancer. All subjects provided informed written consent before inclusion in this study.

2.2 Procedure

Information such as symptoms, age, and smoking history was gathered from history taking and physical examination by primary care physicians. Subjects were then asked to perform handheld spirometry without a bronchodilator under supervision by their primary care physicians. The handheld spirometry used in this study was a COPD-6 device (Vitalograph, UK).

Upon completion of initial evaluation at the primary care clinics, subjects were referred to tertiary referral hospitals to conduct handheld spirometry for a second time, in addition to conventional spirometry with and without a bronchodilator according to standard procedure.[18] We selected tertiary referral hospitals that had more than 3 pulmonary specialists on staff. In addition, subjects were also asked to complete the “Could it be COPD?” questionnaire, which was developed by GOLD to assess the possibility of a COPD diagnosis (Table S1, https://links.lww.com/MD/B471),[19] as well as questionnaires on the severity of their dyspnea and comorbidities (Table S2, https://links.lww.com/MD/B471). Conventional spirometry was conducted by well-trained technicians, and interpreted by pulmonologists. Airflow limitation was defined by a postbronchodilator FEV1/FVC ratio lower than 0.7.[1] The results of conventional spirometry were compared with those of the handheld spirometry performed both at the primary clinics and tertiary referral hospitals. We also explored the predictive value of the “Could it be COPD?” questionnaire in conjunction with FEV1/FEV6.measurement.

2.3 Statistical analysis

In determining the number of subjects required, we referred to previously the reported sensitivity (89%), specificity (98%) of the COPD-6, and the known prevalence of COPD in Korea (13.4%).[20] We attempted to obtain more than 90% specificity using handheld spirometry and a desired confidence level of 0.05, and determined that at least 161 patients were required for this study. All data are presented as mean ± standard deviation (SD) where appropriate, and were analyzed using IBM SPSS Statistics for Windows, Version 22.0 (IBM Corp., Armonk, NY) and MedCalc Statistical Software version 16.4.3 (MedCalc Software bvba, Ostend, Belgium; https://www.medcalc.org; 2016). Descriptive analyses were performed to assess baseline patient characteristics. The relationship between FEV1/FEV6 and FEV1/FVC was evaluated using a Pearson correlation analysis. Receiver-operator characteristic (ROC) curves were used to determine a cut-off value for handheld spirometry that corresponded to the optimal combination of sensitivity and specificity for a diagnosis of airflow limitation, defined by a postbronchodilator FEV1/FVC <0.7.[1] The area under the ROC curve for each respiratory symptom was used to evaluate its efficacy as active case-finding tool. Sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) were calculated for the questionnaire using 2 × 2 tables. To compare the efficacy of the combination of handheld spirometry and the questionnaire with that of its components, we determined a regression equation through a binomial logistic regression test. After creating a new variable, we evaluated whether the combination could be better than its components alone by determining the area under the ROC curve. A P value of <0.05 was considered statistically significant.

2.4 Ethical statement

This study was approved by the board of each participating institution. IRB number of Hallym Sacred Heart Hospital was 2015-I027. All subjects provided written informed consent before conducting handheld spirometry at primary clinic.

3 Results

3.1 Study population

A total of 190 subjects from 9 primary clinics were enrolled in the present study (Figure S1, https://links.lww.com/MD/B471). The mean age was 60.3 ± 10.6 years and the mean smoking history was 28.5 ± 14.6 pack-years. In the primary clinic setting, the proportion of subjects who complained of cough, phlegm, and dyspnea were 66.8%, 85.3%, and 36.5%, respectively. Conversely, the proportion of subjects who complained of cough, phlegm, and dyspnea on the “Could it be COPD?” questionnaire administered at tertiary referral hospitals were 33.2%, 43.7%, and 38.4%, respectively. The mean values for FEV1/FEV6 obtained using handheld spirometry at primary clinics was 79.6 ± 10.9% of the predicted value, whereas that obtained at tertiary referral hospitals was 77.3 ± 7.6% of the predicted value. For conventional spirometry, the mean FEV1 and FEV1/FVC with a bronchodilator were 92.8 ± 14.7% of the predicted value and 74.5 ± 8.8%, respectively (Table 1). The FEV1/FEV6 for handheld spirometry and postbronchodilator FEV1/FVC for conventional spirometry were well correlated (r = 0.504, P < 0.001) (Fig. 1).

T1-51
Table 1:
Baseline characteristics of participants.
F1-51
Figure 1:
Relationship between handheld spirometric FEV1/FEV6 and postbronchodilator conventional spirometric FEV1/FVC values. FEV1 = forced expiratory volume in 1second, FEV6 = forced expiratory volume in 6 seconds, FVC = forced vital capacity.

3.2 Prevalence and distribution of severity of airflow limitation

A total of 45 (23.7%) subjects had airflow limitation confirmed by conventional spirometry, indicative of COPD. Among these newly diagnosed COPD patients, 95.6% had mild-to-moderate airflow limitation according to the GOLD guideline.[1] About 57.8% were classified as having GOLD 1, 37.8% as GOLD 2, and 4.4% as GOLD 3. No patient was classified as having GOLD 4 airflow limitation (Fig. 2).

F2-51
Figure 2:
The distribution of patients according to GOLD spirometric classification and mMRC in newly diagnosed COPD patients. COPD = chronic obstructive pulmonary disease, GOLD = Global Initiative for Obstructive Lung Disease, mMRC = modified Medical Research Council.

3.3 Receiver-operating characteristic (ROC) curve for handheld spirometry

Using FEV1/FVC <0.7 as a definition of airflow limitation by conventional spirometry, FEV1/FEV6 ≤77% by handheld spirometry had the best sum of sensitivity (72.7%), specificity (77.1%), PPV (50%), and NPV (90%), according to the ROC curve analysis. The area under the curve (AUC) was 0.759 (Fig. 3).

F3-51
Figure 3:
Determination of a cut-off FEV1/FEV6 value to predict COPD using handheld spirometry in a primary clinical setting. COPD = chronic obstructive pulmonary disease, FEV1 = forced expiratory volume in 1 second, FEV6 = forced expiratory volume in 6 seconds.

3.4 Comparison of characteristics according to the result of handheld spirometry in patients with airflow limitation

Among the newly diagnosed COPD patients, 12 patients demonstrated FEV1/FEV6 ≤77%. Patients with abnormal handheld spirometry results also had lower pre and postbronchodilator FEV1values determined by conventional spirometry. According to the GOLD spirometric classification, the number of GOLD 1 patients was 12 (100.0%) and 14 (43.8%) for patients with normal and abnormal handheld spirometry results, respectively. All GOLD2 and GOLD3 patients had abnormal handheld spirormetry results (P = 0.003). Conversely, there were no significant differences in mean age, smoking history, respiratory symptoms, modified Medical Research Council dyspnea scale, and comorbidities between patients with normal and abnormal handheld spirometry results (Table 2, Fig. 2).

T2-51
Table 2:
Characteristics of patients with newly diagnosed COPD according to the results of handheld spirometry using cut-off value of FEV1/FEV6 ≤77% after ROC curve analysis.

3.5 Analysis from the “Could it be COPD?” questionnaire and its combination with handheld spirometry

We analyzed the sensitivity, specificity, PPV, and NPV of the “Could it be COPD?” questionnaire completed by subjects at tertiary referral hospitals. Complaint of cough had a sensitivity of 35.6%, specificity of 67.6%, PPV of 25.4%, and NPV of 77.2%, respectively. Complaint of the 3 respiratory symptoms of cough, phlegm, and dyspnea had a sensitivity of 20.0%, specificity of 91.0%, PPV of 40.9%, and NPV of 78.6%, respectively. The area under the ROC curve for each of these 3 respiratory symptoms and their combination ranged from 0.5 to 0.65 (Table 3).

T3-51
Table 3:
Sensitivity, specificity, positive predictive value, negative predictive value, and area under the ROC curve for each symptom listed on the “Could it be COPD?” questionnaire.

We created a new variable combining and held spirometry performed at primary clinics and respiratory symptoms from the “Could it be COPD?” questionnaire using a binomial logistic regression. Cough and phlegm were excluded variables from the estimation of the regression equation, because they were not statistically significant. When dyspnea was combined with the results from handheld spirometry, the regression equation was 1.003 × Dyspnea – 0.073 × FEV1/FEV6 + 4.077. The area under the ROC curve for this combination was 0.77 and did not differ significantly from the AUC of the ROC curve for handheld spirometry alone (P = 0.71) (Figure S2, https://links.lww.com/MD/B471).

4 Discussion

At present, few studies have addressed the application of handheld spirometry and a questionnaire for COPD active case finding in a primary clinical setting. The aim of this study was to evaluate the efficacy of handheld spirometry as an active case-finding tool in people at risk of developing of COPD. We found that 23.7% of the participants were newly diagnosed with COPD using conventional spirometry at tertiary referral hospitals. Of note, this prevalence was higher than that reported in previous studies evaluating the prevalence of COPD.[20,21] Because we recruited subjects aged over 40 years with at least 10 pack-years smoking history, the prevalence of COPD for these individuals would be expected to be higher than for the general population. This finding is consistent with reports indicating a higher prevalence of COPD among people with known risk factors.[3] Furthermore, we observed that most newly diagnosed COPD patients had mild-to-moderate airflow limitation according to the GOLD guideline. This distribution is consistent with previous prevalence studies, which demonstrated that mild-to-moderate COPD is more prevalent than severe or very severe COPD.[20,21]

According to ROC curve analysis, we identified that a cut-off FEV1/FEV6 value of ≤77% is an effective indicator of airflow limitation using handheld spirometry. This value could be used when referring patients to tertiary hospitals for confirmation of COPD diagnoses using conventional spirometry with a bronchodilator. The area under the ROC curve was 0.759, and therefore, this handheld spirometry method is classified as a moderately accurate test.[22] It is acceptable for use as an active case-finding test in primary clinics. We also tested the validity of a suggested FEV1/FEV6 <0.72 cut-off for airway limitation reported in studies conducted in Japan and China.[23,24] We chose this value among others because of the similar ethnicity between these and our study population, which is an important consideration for evaluating pulmonary function.[25] Using this cut-off for our study population, sensitivity was 45.5%, specificity was 89.3%, PPV was 57.1%, and NPV was 83.9%. This difference probably arose from difference in methodology. The previously mentioned studies used conventional spirometry to assess airway function, whereas we used handheld spirometry. Furthermore, the differences in study populations could also contribute to the differences in results. They enrolled community-dwelling adults, regardless of smoking status, and respiratory symptoms, whereas we recruited individuals with known risk factors for COPD.

Although we enrolled subjects on the basis of subjective complaints of respiratory symptoms, the “Could it be COPD?” questionnaire in tertiary referral hospitals served as an objective measure of COPD-related respiratory symptoms. The results of the ROC curve analysis for the “Could it be COPD?” questionnaire suggest that respiratory symptom reporting is not appropriate as an active case-finding tool in subjects aged over 40 years with a smoking history of at least 10 pack-years.

When estimating a regression equation via a binominal logistic regression test, cough and phlegm were excluded because there was no statistical significance. Although dyspnea was the only respiratory symptom with which we could estimate a regression equation combined with the handheld spirometry results, the area under the ROC curve was not significantly different from the AUC of the ROC curve for handheld spirometry alone. Therefore, we propose that physicians should recommend handheld spirometry to individuals aged more than 40 years with a smoking history of at least 10 pack-years, regardless of respiratory symptoms.

We evaluated the correlation between FEV1/FEV6 determined by handheld spirometry at primary clinics and FEV1/FVC determined by conventional spirometry. The Pearson correlation coefficient was 0.504, which is considered a moderate correlation.[26] This correlation was the basis of our study, and suggests that further evaluations of the methods described here would be of value. To evaluate the accuracy of handheld spirometry, we compared the results of handheld and conventional spirometry. The mean FEV1 of conventional spirometry was 8.0 ± 12.4% higher than that of handheld spirometry performed at primary clinics (P < 0.001). Interestingly, there was also a difference in the results of handheld spirometry performed at primary clinics and tertiary referral hospitals; the mean FEV1 obtained with the handheld spirometry from tertiary referral hospitals was 7.7 ± 11.1% higher than that of primary clinics (P < 0.001). There was no difference between FEV1 from conventional and handheld spirometry performed at tertiary referral hospitals (P = 0.903). These trends may be due to the order in which tests were conducted; subjects always performed handheld spirometry at tertiary referral hospitals after first attempting it at primary clinics. There could be a bias caused by the order of examination, a so-called learning effect.[27] If handheld spirometry from tertiary referral hospitals had been performed better than from primary clinics, the correlation coefficient would be higher between the FEV1/FEV6 from handheld spirometry performed at tertiary referral hospitals and FEV1/FVC by conventional spirometry; in fact, the Pearson correlation coefficient increased to 0.845.

Among patients with newly diagnosed COPD following conventional spirometry, the patients with abnormal handheld spirometry results in primary clinics had lower FEV1 values determined by conventional spirometry, than those with normal handheld spirometry results. Applying the GOLD spirometric classification, GOLD 1 was more significantly prevalent in patients with abnormal handheld spirometry results. Furthermore, GOLD 2 and GOLD 3 were only present in patients with abnormal handheld spirometry results. We interpreted this as an indication that handheld spirometry has a higher potential for misdiagnosis in patients with better pulmonary function. In previous studies, subjects classified as false negatives had either mild or moderate COPD, rather than severe or very severe COPD in screening using handheld spirometry devices.[28,29] Although the reason for this observation is unclear, it is acceptable that handheld devices are unable to clearly discriminate mild cases of disease. In a practical setting, if individuals with risk factors for COPD were misjudged as normal determined by handheld spirometry, they would expected to have a lower probability of COPD or if this were not identified, they would mild COPD.

For diagnosis of COPD, spirometry with a bronchodilator is required. However, handheld spirometry was not performed in conjunction with the administration of a bronchodilator. Due to safety concerns, it is not appropriate to administer a bronchodilator in a primary clinic in which monitoring and emergency procedures are insufficient. Alternatively, we suggest a novel strategy in which conventional spirometry with bronchodilator is recommended only for patients with abnormal findings using handheld spirometry, which can be performed in a primary clinical setting. This strategy could therefore decrease the unnecessary use of bronchodilator for COPD diagnosis.

This study had some limitations. We recruited the participants in summer, so a concern might arise that we could not recruit participants appropriate for the purpose of the study. Nevertheless, although COPD symptoms may be aggravated by cold weather, the airflow limitation required to diagnose COPD is persistent.[1] Not only that, the participants were asked again to make sure about their symptoms using “Could it be COPD” questionnaire released by GOLD, which does not include the questions about the symptoms affected by the weather. We thought that the participants were able to provide us with appropriate results. Furthermore, the exact number of subjects screened in the primary care clinic was not assessed. We only used the data of the participants who were referred to the tertiary referral hospitals, which might cause some skewness in the collected data. To overcome these limitations, a larger study to validate our suggested strategy with carefully handing the excluded subjects is needed.

5 Conclusion

We evaluated a new case finding strategy using handheld spirometry in a primary clinical setting. Implementation of handheld spirometry has the potential to improve early detection and diagnosis of COPD. This study suggested that physicians should recommend handheld spirometry for people over the age of forty, who have a smoking history of more than 10 pack-years, regardless of respiratory symptoms. Furthermore, people who have abnormal results, determined using the FEV1/FEV6 ≤0.77 cut-off, should be referred for conventional spirometry to confirm the diagnosis of COPD. However, further studies within the general population are necessary to establish efficacy in public.

Acknowledgment

We thank Kyeong Min Kwak, MD (Department of Occupational and Environmental Medicine, Hallym University Sacred Heart Hospital) for assistance with statistical analyses.

References

[1]. Global Initiative for Chronic Obstructive Lung Disease. Global Strategy for the Diagnosis, Management, and Prevention of Chronic Obstructive Pulmonary Disease. Updated 2016. Available at: http://www.goldcopd.org. Accessed April 01, 2016.
[2]. Mathers CD, Loncar D. Projections of global mortality and burden of disease from 2002 to 2030. PLoS Med 2006;3:e442.
[3]. Hill K, Goldstein RS, Guyatt GH, et al Prevalence and underdiagnosis of chronic obstructive pulmonary disease among patients at risk in primary care. CMAJ 2010;182:673–8.
[4]. Hwang YI, Kwon OJ, Kim YW, et al Awareness and impact of COPD in Korea: an epidemiologic insight survey. Tuberc Respir Dis 2011;71:400–7.
[5]. Mun SY, Hwang YI, Kim JH, et al Awareness of chronic obstructive pulmonary disease in current smokers: a nationwide survey. Korean J Intern Med 2015;30:191–7.
[6]. Shin C, Lee S, Abbott RD, et al Respiratory symptoms and undiagnosed airflow obstruction in middle-aged adults: the Korean health and genome study. Chest 2004;126:1234–40.
[7]. Coultas DB, Mapel D, Gagnon R, et al The health impact of undiagnosed airflow obstruction in a national sample of United States adults. Am J Respir Crit Care Med 2001;164:372–7.
[8]. Freeman D, Price D. ABC of chronic obstructive pulmonary disease: primary care and palliative care. BMJ 2006;333:188–90.
[9]. Decramer M, Celli B, Kesten S, et al Effect of tiotropium on outcomes in patients with moderate chronic obstructive pulmonary disease (UPLIFT): a prespecified subgroup analysis of a randomized controlled trial. Lancet 2009;374:1171–8.
[10]. Jenkins CR, Jones PW, Calverley PMA, et al Efficacy of salmeterol/fluticasone propionate by GOLD stage of chronic obstructive pulmonary disease: analysis from the randomised, placebo-controlled TORCH study. Respir Res 2009;10:59.
[11]. Preventive Services Task Force U.S. (USPSTF)Screening for Chronic Obstructive Pulmonary Disease: US Preventive Services Task Force Recommendation Statement. JAMA 2016;315:1372–7.
[12]. Guirguis-Blake JM, Senger CA, Webber EM, et al Screening for chronic obstructive pulmonary disease: evidence report and systematic review for the US Preventive Services Task Force. JAMA 2016;315:1378–93.
[13]. Jensen RL, Crapo RO, Enright P. A statistical rationale for the use of forced expired volume in 6 s. Chest 2006;130:1650–6.
[14]. Nelson SB, LaVange LM, Nie Y, et al Questionnaires and pocket spirometers provide an alternative approach for COPD screening in the general population. Chest 2012;142:358–66.
[15]. Sichletidis L, Spyratos D, Papaioannou M, et al A combination of the IPAG questionnaire and Piko-6® flow meter is a valuable screening tool for COPD in the primary care setting. Prim Care Respir J 2011;20:184–9.
[16]. Vandevoorde J, Verbanck S, Schuermans D, et al Eur Respir J 2006;27:378–83.
[17]. Bhatt SP, Kim YI, Wells JM, et al FEV1/FEV6to diagnose airflow obstruction. Comparisons with computed tomography and morbidity indices. Ann Am Thorac Soc 2014;11:335–41.
[18]. Miller MR, Hankinson J, Brusasco V, et al Standardisation of spirometry. Eur Respir J 2005;26:319–38.
[19]. Global Initiative for Chronic Obstructive Lung Disease. “Could it be COPD?” Questionnaire. Available at: http://www.goldcopd.org/could-it-be-copd.html. Accessed April 01, 2016.
[20]. Yoo KH, Kim YS, Sheen SS, et al Prevalence of chronic obstructive pulmonary disease in Korea: the fourth Korean National Health and Nutrition Examination Survey, 2008. Respirology 2011;16:659–65.
[21]. Buist AS, McBurnie MA, Vollmer WM, et al International variation in the prevalence of COPD (the BOLD study): a population-based prevalence study. Lancet 2007;370:741–50.
[22]. Greiner M, Pfeiffer D, Smith RD. Principles and practical application of the receiver-operating characteristic analysis for diagnostic tests. Prev Vet Med 2000;45:23–41.
[23]. Wang S, Gong W, Tian Y, et al FEV1/FEV6in primary care is a reliable and easy method for the diagnosis of COPD. Respir Care 2016;61:349–53.
[24]. Kishi H, Shibata Y, Osaka D, et al FEV6 and FEV1/FEV6 in Japanese participants of the community-based annual health check: the Takahata study. Intern Med 2011;50:87–93.
[25]. Korotzer B, Ong S, Hansen JE. Ethnic differences in pulmonary function in healthy nonsmoking Asian-Americans and European-Americans. Am J Respir Crit Care Med 2000;161:1101–8.
[26]. Hinkle DE, Wiersma W, Jurs SG. Applied Statistics for the Behavioral Sciences, 5th ed. Boston, MA:Houghton Mifflin; 2003.
[27]. Koyama H, Nishimura K, Ikeda A, et al A comparison of different methods of spirometric measurement selection. Respir Med 1998;92:498–504.
[28]. Frith P, Crockett A, Beilby J, et al Simplified COPD screening: validation of the Piko-6® in primary care. Prim Care Respir J 2011;20:190–8.
[29]. Represas-Represas C, Fernandez-Villar A, Ruano-Ravina A, et al Screening for chronic obstructive pulmonary disease: validity and reliability of a portable device in non-specialized healthcare settings. PLoS One 2016;11:e0145571.
Keywords:

active case finding; COPD-6; efficacy; handheld spirometry

Supplemental Digital Content

Copyright © 2016 The Authors. Published by Wolters Kluwer Health, Inc. All rights reserved.