Secondary Logo

Journal Logo

Original Article

Interferon-Gamma Release Assay is Not Appropriate for the Diagnosis of Active Tuberculosis in High-Burden Tuberculosis Settings

A Retrospective Multicenter Investigation

Kang, Wan-Li1; Wang, Gui-Rong2; Wu, Mei-Ying3; Yang, Kun-Yun4; Er-Tai, A5; Wu, Shu-Cai6; Geng, Shu-Jun6; Li, Zhi-Hui6; Li, Ming-Wu7; Li, Liang8; Tang, Shen-Jie8,

Author Information
doi: 10.4103/0366-6999.223860
  • Free

Abstract

INTRODUCTION

Tuberculosis (TB) is a major health problem throughout the world, especially in developing countries. According to the World Health Organization (WHO), worldwide, 10.4 million people are estimated to have fallen ill with TB in 2015, and TB killed 1.8 million people (1.4 million human immunodeficiency virus [HIV]-negative and 0.4 million HIV-positive people).[1] TB is also a serious problem in China. The WHO has estimated an incidence of 66/100,000 TB cases in China in 2015.[1]

The rapid detection of mycobacteria and successful treatment of infectious patients is important for controlling and preventing TB. Chest X-rays are often used in pulmonary TB (PTB) screening and have the advantages of being simple and inexpensive. However, in smear-negative PTB, many cases show atypical or nonspecific patterns and are difficult to differentiate from other pulmonary diseases.[2] Smear microscopy has low sensitivity. Culture of mycobacteria requires several weeks to obtain the results and has low sensitivity.

A recent breakthrough in the diagnosis of TB and latent TB infection is the introduction of interferon-gamma release assays (IGRAs), in which the production of interferon-gamma (IFN-γ) in response to Mycobacterium tuberculosis (MTB)-specific antigens is measured. There are currently two types of commercial IGRAs available: the QuantiFERON-TB Gold In-Tube test and the T-SPOT.TB blood test. The sensitivities of the IGRAs were reported to be high in detecting active TB patients in low TB-endemic countries in previous studies.[34] However, a recent study conducted in Poland did not show that a combination of IGRA and TST might be a step forward in the diagnosis of culture-negative TB cases.[5] The results from high TB-endemic countries were also different. Some studies indicated that the T-SPOT.TB assay is a promising diagnostic test for active PTB,[678] but other studies showed that IGRA was insufficient for the diagnosis of PTB.[910] In this study, we conducted a large retrospective multicenter investigation in China to further evaluate the use of IGRA in the diagnosis of active PTB in high TB-epidemic populations and the factors affecting the performance of the assay.

METHODS

Ethics approval

This was an observational retrospective study and the three diagnostic tests were already used in clinical practice. Given that the medical information of patients was recorded anonymously by case history, which would not bring any risk to the participants, the Ethics Committee of Beijing Chest Hospital, Capital Medical University approved this retrospective study, with a waiver of informed consent from the patients.

Study subjects

China is a high TB-burden country. In 2012, the incidence of TB in the study hospital situated provinces were between 40/100,000 and 181/100,000.[11] All patients who underwent valid T-SPOT.TB assays from December 2012 to November 2015 in six large-scale specialized TB hospitals in China and met the study criteria were retrospectively evaluated. The six hospitals with a capacity of 3000 beds are situated in the south, north, east, and center of China. At each study hospital, trained health workers extracted data from the computer database of medical records of inpatients. Records were collected in terms of age, gender, contact with TB, vaccination with Bacillus Calmette–Guérin (BCG), albumin, body mass index (BMI), smoking and alcohol intake, presenting complaints, sputum smear and culture, range of TB disease, lung cavity and its range, course of TB, history of TB treatment, comorbidity, etc. Only patients with complete information were included in the investigation. The prevalence of HIV infection is very low in China, and all cases had negative results on serological tests for HIV. All patients had not had immune diseases or received immunosuppressant before. All patients had not extrapulmonary TB. Patients were divided into the following three groups: Group 1, sputum culture-positive PTB patients, confirmed by positive MTB sputum culture; Group 2, sputum culture-negative PTB patients diagnosed on the basis of typical clinical symptoms, typical features on radiographs, and proper responses to anti-TB treatment (sputum smear-positive and smear-negative cases were included); and Group 3, non-TB respiratory diseases, including pneumonia, lung cancer, pulmonary interstitial fibrosis, chronic obstructive pulmonary disease, and bronchiectasis. In China, PTB has generally been diagnosed by traditional methods that rely on clinical symptoms together with the results of bacteriology methods (including sputum smear microscopy and bacterial culture) and X-ray examination (diagnostic criteria for TB WS-288-2008).

T-SPOT.TB assay

The T-SPOT.TB test is an in vitro diagnostic test that detects the effector T-cells in human whole blood by capturing IFN-γ in the vicinity of the T-cells that are responding to stimulation with MTB-specific antigens such as 6 kDa early secretory antigenic target (ESAT-6) and 10 kDa culture filtrate protein (CFP-10). The T-SPOT.TB test (Oxford Immunotec Ltd., UK) was performed using peripheral blood mononuclear cells (PBMCs) separated from heparinized blood samples according to the manufacturer's instructions. Briefly, PBMCs were isolated and incubated with two antigens (ESAT-6 and CFP-10). The procedure was performed in plates precoated with anti-IFN-γ antibodies at 37°C for 16–20 h. After application of alkaline phosphatase-conjugated secondary antibody and chromogenic substrate, the number of spot-forming cells (million PBMCs) in each well was automatically counted with a CTL ELISPOT system. The results were interpreted as recommended by the test kit manufacturer.[12]

Statistical analysis

Frequencies and percentages were used to describe the categorical data, and continuous variables were presented as the mean or median. Chi-square tests and Fisher's exact test were used to compare categorical data. Sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and analytic accuracy (Acc) were calculated for each TB patient group. The analysis was performed on data from patients with culture-positive or culture-negative active TB and cases with nonmycobacterial lung diseases. Confidence intervals (95% CIs) were estimated according to the binomial distribution. Multivariable logistic analyses were performed to evaluate the relationship between the results of T-SPOT in TB patients and other factors. Odds ratios (ORs) and 95% CIs for risk were calculated. P < 0.05 was considered statistically significant. Logistic regression models should be used with a minimum of 10 events per predictor variable by a Monte Carlo study.[13] All statistical analyses were performed with SPSS software (version 13.0, SPSS Inc., Chicago, USA).

RESULTS

Demographic characteristics of the three groups

A total of 3082 patients for whom there was complete information were included in the investigation. The sample population included 905 sputum culture-positive PTB cases, 914 sputum culture-negative PTB cases, and 1263 non-TB respiratory disease cases. Demographic characteristics of the three groups are presented in Table 1.

Table 1
Table 1:
Demographic characteristics of the three groups

Clinical characteristics of the tuberculosis patients

Clinical characteristics of the TB patients are summarized in Table 2. The rates of cough, productive cough, fever, sweat, and weight-loss in the culture-positive PTB group were higher than those in the culture-negative PTB group (P < 0.05). The ranges of TB disease and cavity were more extensive in the culture-positive PTB group than that in the culture-negative PTB group (P < 0.01). The frequency of diabetes in the culture-positive PTB group was higher than that in the culture-negative PTB group (P < 0.01).

Table 2
Table 2:
Clinical characteristics of the TB patients

Diagnostic performance of T-SPOT.TB

The positive rates of TSPOT.TB were 93.3% (95% CI: 91.7–94.9%), 86.1% (95% CI: 83.7–88.5%), 43.6% (95% CI: 40.9–46.3%) in the culture-positive PTB group, culture-negative PTB group, and non-TB group, respectively. The positive rate of T-SPOT.TB in the culture-positive PTB group was higher than that in the culture-negative PTB group or in the non-TB group (P < 0.01). The positive rate of T-SPOT.TB in the culture-negative PTB group was higher than that in the non-TB group (P < 0.01). The overall sensitivity, specificity, PPV, NPV, and Acc were 89.7% (95% CI: 88.2–91.0%), 56.4% (53.6–59.1%), 74.8% (95% CI: 72.9–76.6%), 79.1% (95% CI: 76.3–81.7%), and 76.0% (74.5–77.5%), respectively.

Risk factors associated with positive T-SPOT.TB results

Risk factors associated with positive T-SPOT.TB results are presented in Table 3. The sensitivity in the older patients was lower than that in nonolder patients (P < 0.01). The sensitivity in patients with a BMI <18.5 kg/m2 was higher than that in patients with a BMI ≥18.5 kg/m2 (P = 0.02). The sensitivity in the smear-positive patients was higher than that in the smear-negative patients (P < 0.01). The sensitivity in the patients with comorbidity was higher than that in noncomorbidity patients (P = 0.017). The sensitivity in the patients with a record of contact with TB was higher than that in noncontact with TB patients (P = 0.049). The sensitivity of T-SPOT.TB in the patients with a record of vaccination with BCG was higher than that in noncontact with TB patients (P = 0.040).

Table 3
Table 3:
Risk factors associated with positive T-SPOT.TB results, n = 1819

Association between T-SPOT.TB result and other factors in tuberculosis patients

In multivariate logistic regression analysis, the affecting factors of T-SPOT.TB results in TB patients included gender (OR, 0.714; 95% CI, 0.515–0.989; P = 0.043), age (OR, 0.691; 95% CI, 0.556–0.859, P < 0.01), BMI (OR, 0.942; 95% CI, 0.900–0.987, P = 0.012), sputum culture (OR, 1.929; 95% CI, 1.271–2.927, P = 0.002), and contact with TB (OR, 2.635; 95% CI, 1.037–6.695, P = 0.042) [Table 4]. Females, age of >65 years, a BMI ≥18.5 kg/m2, sputum culture-negative, and noncontact of TB were demonstrated to be independent factors associated with negative test results.

Table 4
Table 4:
Multivariable logistic regression analysis of the association of T-SPOT.TB and clinical characteristics

DISCUSSION

IGRAs were developed for the indirect or immunologic diagnosis of MTB infection. With their relatively high sensitivity and specificity, IGRAs have been widely used to diagnose the infection under national guidelines in many developed countries, such as the USA, UK, and Japan.[14] In most developing countries, including China, the clinical utilization of IGRAs for diagnosing active TB is not recommended, due to insufficient evidence of their performance in high TB-burden settings. Nevertheless, many private health-care providers in high-burden countries are using IGRAs for the diagnosis of active TB,[14] and many investigators continue to recommend their use for active TB.[151617] Thus, there is a growing concern about the inappropriate use of IGRAs for the diagnosis of active TB in high-burden settings, particularly when used to “rule-in” disease.[18] The aim of this study, performed in a country with a high prevalence of TB, was to determine the performance of the T-SPOT.TB test for diagnosing TB in routine clinical practice.

To our knowledge, this multicenter study that included 1819 TB patients and 1263 non-TB patients is the largest to date evaluating the performance of the T-SPOT.TB test for diagnosing TB in high-burden settings. The diagnosis of TB is problematic for the clinician as only 50% of patients with active disease have microbiologically confirmed TB disease. A negative IGRA may be a convenient “rule-out” test for TB if the diagnostic sensitivity of the assay is sufficiently high, for example, nearly 95%.[19] In our study, the sensitivity (89.66%) and NPV (79.11%) of the T-SPOT.TB test suggest that T-SPOT.TB does not have good rule-out value for active TB in high TB-burden settings, like China. Furthermore, the low specificity (56.37%) and PPV (74.75%) limit its usefulness to rule-in active TB in these settings, where the prevalence of latent tuberculosis infection (LTBI) is considerable. In China, IGRA is currently being used for diagnosis of active TB and for differentiating between TB and other diseases. However, the positive rate of T-SPOT.TB found that here was 43.6% in the non-TB group. Such a high false-positive rate makes it necessary to reconsider the value and scope of T-SPOT.TB in clinical practice.

The overall sensitivity of the T-SPOT.TB test in our study was 89.66% in all the PTB patients, which increased to 93.26% in culture-positive TB patients. Similar sensitivities for the diagnosis of active TB were demonstrated in the studies performed in China by Zhang et al. (94.7%),[20] Feng et al. (94.7%),[7] and Liu et al. (93.2%),[21] and in one study from India (90.6%).[9] From the ten reported studies evaluating T-SPOT.TB in China, the combined sensitivity was 88%.[22] However, the sensitivity in our study was higher than the reported range in the earlier studies from other highly endemic countries, for example, 76% in South Africa,[23] 78.7% in Gambia,[24] and 74% in Zambia.[25] Previous investigations identified several factors that may affect the sensitivity of IGRA. HIV is one of the factors,[26] and in most of the studies conducted in other high-burden countries, HIV-positive patients were included.[2425] Exclusion of HIV patients in our study may be one of the reasons for obtaining higher sensitivity. Furthermore, the sensitivity of IGRA reportedly decreased significantly with the age of patients[5] and gradually decreased with the treatment duration.[6] In our study, only 15.02% (245/1631) patients were older TB patients (≥65 years) and 20.72% (338/1631) of patients were retreated ones, which may be another reason for obtaining higher sensitivity.

As T-SPOT.TB tests are unable to distinguish between LTBI and active TB, the specificity of the T-SPOT.TB test depends on the prevalence of LTBI. The specificity of the T-SPOT.TB test in diagnosing active TB is known to be high (≥93%) in low TB incidence settings,[27] and as low as 61% in low- and middle-income countries[28] The poor specificity (56.44%) of T-SPOT.TB test obtained in this study was expected and several factors should be considered. First, the high prevalence of LTBI, as high as 44.5% in China,[29] inevitably decreases the specificity of T-SPOT.TB test. Second, this study was designed to evaluate the diagnostic validity of T-SPOT.TB test in routine clinical practice and thus focused on unselected patients with suspected active TB. In this setting, the diagnostic validity tends to be lower than in studies in which healthy people are enrolled as negative controls.

IGRAs are designed to detect MTB infections, whether latent or active. However, in our study, 6.74% (61/905) of the persons with culture-confirmed TB had a negative T-SPOT.TB result, comparable to 8.7% (46/528) described by Pan et al.[30] and 14.4% (182/1264) described by Kwon et al.[31] There are a multitude of factors that may modulate the sensitivity of IGRA including HIV coinfection, immune suppression, young or advanced age, advanced disease, malnutrition, extrapulmonary TB, disseminated TB, concomitant TB treatment, bacteria strain differences, and smoking.[3032] In our multivariate logistic regression analysis, gender, age, BMI, sputum culture, and contact with TB were affecting factors for the false-negative results of the T-SPOT.TB test. In addition, this study showed that the sensitivity of T-SPOT.TB for the diagnosis of TB in the culture/smear-positive group was significantly higher than that in the culture/smear-negative group, which implied that the T-SPOT.TB result may be affected by the bacterial load. There were several limitations to our study. First, T-SPOT.TB results were analyzed in retrospect and quantitative test results were not acquired. Second, this study was performed in an area where the prevalence of LTBI is considerable. Third, this study did not include extrapulmonary TB and immunodeficient patients. Fourth, external validity is a concern, because this was a hospital-based study and may have overestimated the sensitivity of IGRA. Fifth, the retrospective study design limited us to describing the association between IGRA and affecting factors. Sixth, sputum culture-negative PTB patients were included according to clinical diagnosis, which may influence the diagnostic Acc. Additional longitudinal studies are needed to prove any causality in the associations found.

Despite these limitations, to our knowledge, this might be the multicenter large-scale investigation to evaluate the role of T-SPOT.TB in diagnosis of PTB in China. Our study demonstrated that gender, age, BMI, sputum culture, and contact of TB are factors affecting the false-negative results of T-SPOT.TB test. Inadequate sensitivity and high false-positive rates of this test limit its usefulness as a single test to rule-in or rule-out active TB in China. We highly recommend that IGRAs not be used for the diagnosis of active TB in high-burden TB settings.

Financial support and sponsorship

Nil.

Conflicts of interest

There are no conflicts of interest.

Acknowledgments

We thank Douglas Lowrie of Shanghai Public Health Clinical Center for his invaluable help editing the manuscript.

REFERENCES

1. World Health Organization. Global Tuberculosis Report 2016. WHO/HTM/TB/2016.13. 2016 Geneva World Health Organization
2. Kanaya AM, Glidden DV, Chambers HF. Identifying pulmonary tuberculosis in patients with negative sputum smear results Chest. 2001;120:349–55
3. Detjen AK, Keil T, Roll S, Hauer B, Mauch H, Wahn U, et al Interferon-gamma release assays improve the diagnosis of tuberculosis and nontuberculous mycobacterial disease in children in a country with a low incidence of tuberculosis Clin Infect Dis. 2007;45:322–8 doi: 10.1086/519266
4. Chee CB, Gan SH, Khinmar KW, Barkham TM, Koh CK, Liang S, et al Comparison of sensitivities of two commercial gamma interferon release assays for pulmonary tuberculosis J Clin Microbiol. 2008;46:1935–40 doi: 10.1128/JCM.02403-07
5. Wlodarczyk M, Rudnicka W, Janiszewska-Drobinska B, Kielnierowski G, Kowalewicz-Kulbat M, Fol M, et al Interferon-gamma assay in combination with tuberculin skin test are insufficient for the diagnosis of culture-negative pulmonary tuberculosis PLoS One. 2014;9:e107208 doi: 10.1371/journal.pone.0107208
6. Yan L, Xiao H, Han M, Zhang Q. Diagnostic value of T-SPOT.TB interferon-γ release assays for active tuberculosis Exp Ther Med. 2015;10:345–51 doi: 10.3892/etm.2015.2463
7. Feng Y, Diao N, Shao L, Wu J, Zhang S, Jin J, et al Interferon-gamma release assay performance in pulmonary and extrapulmonary tuberculosis PLoS One. 2012;7:e32652 doi: 10.1371/journal.pone.0032652
8. Khalil KF, Ambreen A, Butt T. Comparison of sensitivity of quantiFERON-TB gold test and tuberculin skin test in active pulmonary tuberculosis J Coll Physicians Surg Pak. 2013;23:633–6 doi: 09.2013/JCPSP.633636
9. Syed Ahamed Kabeer B, Raman B, Thomas A, Perumal V, Raja A. Role of QuantiFERON-TB gold, interferon gamma inducible protein-10 and tuberculin skin test in active tuberculosis diagnosis PLoS One. 2010;5:e9051 doi: 10.1371/journal.pone.0009051
10. Park H, Shin JA, Kim HJ, Ahn CM, Chang YS. Whole blood interferon-γ release assay is insufficient for the diagnosis of sputum smear negative pulmonary tuberculosis Yonsei Med J. 2014;55:725–31 doi: 10.3349/ymj.2014.55.3.725
11. Last accessed on 2017 Sep 10 Available from: http://www.nhfpc.gov.cn/htmlfiles/zwgkzt/ptjnj/year2013/index2013.html
12. T-SPOT Package Insert. Last accessed on 2017 Sep 10 Available from: http://www.tspot.com/wp-content/uploads/2012/01/PI-TB-US-v4.pdf
13. Peduzzi P, Concato J, Kemper E, Holford TR, Feinstein AR. A simulation study of the number of events per variable in logistic regression analysis J Clin Epidemiol. 1996;49:1373–9
14. Denkinger CM, Dheda K, Pai M. Guidelines on interferon-γ release assays for tuberculosis infection: Concordance, discordance or confusion? Clin Microbiol Infect. 2011;17:806–14 doi: 10.1111/j.1469-0691.2011.03555.x
15. Diel R, Loddenkemper R, Nienhaus A. Evidence-based comparison of commercial interferon-gamma release assays for detecting active TB: A metaanalysis Chest. 2010;137:952–68 doi: 10.1378/chest.09-2350
16. Jiang W, Shao L, Zhang Y, Zhang S, Meng C, Xu Y, et al High-sensitive and rapid detection of Mycobacterium tuberculosis infection by IFN-gamma release assay among HIV-infected individuals in BCG-vaccinated area BMC Immunol. 2009;10:31 doi: 10.1186/1471-2172-10-
17. Kanunfre KA, Leite OH, Lopes MI, Litvoc M, Ferreira AW. Enhancement of diagnostic efficiency by a gamma interferon release assay for pulmonary tuberculosis Clin Vaccine Immunol. 2008;15:1028–30 doi: 10.1128/CVI.00026-08
18. Rangaka MX, Gideon HP, Wilkinson KA, Pai M, Mwansa-Kambafwile J, Maartens G, et al Interferon release does not add discriminatory value to smear-negative HIV-tuberculosis algorithms Eur Respir J. 2012;39:163–71 doi: 10.1183/09031936.00058911
19. Dheda K, van Zyl Smit R, Badri M, Pai M. T-cell interferon-gamma release assays for the rapid immunodiagnosis of tuberculosis: Clinical utility in high-burden vs.Low-burden settings Curr Opin Pulm Med. 2009;15:188–200 doi: 10.1097/MCP.0b013e32832a0adc
20. Zhang S, Shao L, Mo L, Chen J, Wang F, Meng C, et al Evaluation of gamma interferon release assays using Mycobacterium tuberculosis antigens for diagnosis of latent and active tuberculosis in Mycobacterium bovis BCG-vaccinated populations Clin Vaccine Immunol. 2010;17:1985–90 doi: 10.1128/CVI.00294-10
21. Liu F, Du FJ, Jia HY, Pan LP, Zhang X, Xing AY, et al Inadequate values from an interferon-gamma release assay for smear-negative tuberculosis in a high-burden setting Int J Tuberc Lung Dis. 2014;18:1496–501 doi: 10.5588/ijtld.14.0233
22. Dai Y, Feng Y, Xu R, Xu W, Lu W, Wang J, et al Evaluation of interferon-gamma release assays for the diagnosis of tuberculosis: An updated meta-analysis Eur J Clin Microbiol Infect Dis. 2012;31:3127–37 doi: 10.1007/s10096-012-1674-y
23. Tsiouris SJ, Coetzee D, Toro PL, Austin J, Stein Z, El-Sadr W, et al Sensitivity analysis and potential uses of a novel gamma interferon release assay for diagnosis of tuberculosis J Clin Microbiol. 2006;44:2844–50 doi: 10.1128/JCM.02411-05
24. Adetifa IM, Lugos MD, Hammond A, Jeffries D, Donkor S, Adegbola RA, et al Comparison of two interferon gamma release assays in the diagnosis of Mycobacterium tuberculosis infection and disease in the Gambia BMC Infect Dis. 2007;7:122 doi: 10.1186/1471-2334-7-
25. Raby E, Moyo M, Devendra A, Banda J, De Haas P, Ayles H, et al The effects of HIV on the sensitivity of a whole blood IFN-gamma release assay in Zambian adults with active tuberculosis PLoS One. 2008;3:e2489 doi: 10.1371/journal.pone.0002489
26. Syed Ahamed Kabeer B, Sikhamani R, Swaminathan S, Perumal V, Paramasivam P, Raja A, et al Role of interferon gamma release assay in active TB diagnosis among HIV infected individuals PLoS One. 2009;4:e5718 doi: 10.1371/journal.pone.0005718
27. Pai M, Zwerling A, Menzies D. Systematic review: T-cell-based assays for the diagnosis of latent tuberculosis infection: An update Ann Intern Med. 2008;149:177–84
28. Metcalfe JZ, Everett CK, Steingart KR, Cattamanchi A, Huang L, Hopewell PC, et al Interferon-γ release assays for active pulmonary tuberculosis diagnosis in adults in low- and middle-income countries: Systematic review and meta-analysis J Infect Dis. 2011;204(Suppl 4):S1120–9 doi: 10.1093/infdis/jir410
29. China Tuberculosis Control Collaboration. . The effect of tuberculosis control in China Lancet. 2004;364:417–22 doi: 10.1016/S0140-6736(04)16764-0
30. Pan L, Jia H, Liu F, Sun H, Gao M, Du F, et al Risk factors for false-negative T-SPOT.TB assay results in patients with pulmonary and extra-pulmonary TB J Infect. 2015;70:367–80 doi: 10.1016/j.jinf.2014.12.018
31. Kwon YS, Kim YH, Jeon K, Jeong BH, Ryu YJ, Choi JC, et al Factors that predict negative results of QuantiFERON-TB gold in-tube test in patients with culture-confirmed tuberculosis: A Multicenter retrospective cohort study PLoS One. 2015;10:e0129792 doi: 10.1371/journal.pone.0129792
32. de Visser V, Sotgiu G, Lange C, Aabye MG, Bakker M, Bartalesi F, et al False-negative interferon-γ release assay results in active tuberculosis: A TBNET study Eur Respir J. 2015;45:279–83 doi: 10.1183/09031936.00120214

Edited by: Li-Shao Guo

Keywords:

Active Tuberculosis; Diagnosis; Interferon-Gamma Release Assay

© 2018 Chinese Medical Association