Secondary Logo

Comparison of value of biomarkers in diagnosing lung cancer

An overview of systematic reviews protocol

Wu, Fanqi, MDa; Wang, Hong, MDa; Tao, Hongyan, MDa; Huang, Huirong, MDa; Zhang, Longguo, BSb; Wu, Di, BSb; Wan, Yixin, MDa,* on behalf of Cancer Biomarker Assessment Working Group

doi: 10.1097/MD.0000000000015525
Research Article: Study Protocol Systematic Review
Open
SDC

Background: In both sexes combined, lung cancer is the most commonly diagnosed cancer and the leading cause of cancer death. Furthermore, the incidence rate is increasing in many countries. Many lung cancer patients have a poor prognosis because they are usually diagnosed at an advanced stage. Therefore, there is an urgent need to develop effective methods for early diagnosis of lung cancer. Some systematic reviews have evaluated the value of biomarkers for diagnosing lung cancer. However, it remains unclear which biomarker has superior performance for early and accurate detection of lung cancer. This overview aims to assess the methodological and reporting quality of available systematic reviews and to find an optimal biomarker for diagnosing lung cancer.

Methods: We searched PubMed, Embase.com, the Cochrane Library of Systematic Reviews, and Web of Science to identify relevant systematic reviews including randomized controlled trials, cross-sectional studies, case-control studies, or cohort studies that reported the value of biomarkers for diagnosing lung cancer. The methodological quality will be assessed using AMASAR-2 checklist, and the reporting quality will be assessed using PRISMA-DTA checklist. Bubble plot will be generated to map the biomarkers, methodological and reporting quality. The pairwise meta-analysis and indirect comparisons will be performed using STATA 13.0.

Results: The results of this study will be published in a peer-reviewed journal

Conclusion: This overview will provide comprehensive evidence of different biomarkers for the diagnosis of lung cancer.

Ethics and dissemination: Ethics approval and patient consent are not required as this study is an overview based on published systematic reviews.

aDepartment of Respiratory, Lanzhou University Second Hospital

bThe Second Clinical Medical School of Lanzhou University, Lanzhou, China.

Correspondence: Yixin Wan, Department Respiratory, Lanzhou University Second Hospital, No.82, Cuiyingmen, Lanzhou City, 730000, Gansu Province, China (e-mail: lzshwanyixin@163.com).

Abbreviations: AMSTAR = Assessment of Multiple Systematic Reviews, CI = confidence interval, DOR = diagnostic odds ratio, PRISMA-DTA = Preferred Reporting Items for Systematic Reviews and Meta-analysis diagnostic test accuracy, RCT = randomized controlled trials, SRs = systematic reviews.

This work was supported by the “CuiYing Technology Innovation” Program of Lanzhou University Second Hospital (CY2017-BJ11).

The funders had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.

The authors have no conflicts of interest to disclose.

Supplemental Digital Content is available for this article.

Supplemental digital content is available for this article. Direct URL citations appear in the printed text and are provided in the HTML and PDF versions of this article on the journal's Website (www.md-journal.com).

This is an open access article distributed under the Creative Commons Attribution License 4.0 (CCBY), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. http://creativecommons.org/licenses/by/4.0

Received April 11, 2019

Accepted April 12, 2019

Back to Top | Article Outline

1 Introduction

Lung cancer is the most commonly diagnosed cancer and the leading cause of cancer death in men. Among women, lung cancer is the third commonly diagnosed cancer and the second cause of cancer death.[1] In 2018, there are an estimated 2.1 million new cases of lung cancer and 1.8 million deaths worldwide, accounting for nearly one-fifth of cancer deaths.[1] Furthermore, the incidence rate is increasing in many countries.[2,3] The 5-year survival rates for patients with advanced lung cancer and metastatic lung cancer were 16.8% and <5%, respectively, while the 5-year survival rate for small intrapulmonary cancer was 80%.[4–6] One of the important reasons for poor prognosis in advanced lung cancer is the lack of effective screening or early diagnostic methods, resulting in many cases missing the best treatment opportunity in clinical diagnosis.[7–9] Therefore, there is an urgent need to develop effective methods for early diagnosis of lung cancer to improve the survival rate of lung cancer patients.[10,11]

Traditional pathological biopsy can improve the accuracy of diagnosis, but this invasive surgery can cause great inconvenience and pain to patients.[12] Previous studies have explored imaging methods for the diagnosis of lung cancer, however, these methods either have low sensitivity or low specificity and are therefore not ideal methods for early diagnosis of lung cancer.[13–16] Therefore, many scholars have begun to search for biomarkers with high sensitivity and specificity to diagnose lung cancer, and some biomarkers have shown potential diagnostic value.[17,18]

Well-conducted systematic reviews (SRs) and meta-analyses of randomized controlled trials (RCTs) often provide the best evidence for clinical practice and healthcare decisions.[19–21] Recently, some SRs have evaluated the value of biomarkers for diagnosing lung cancer.[22–24] However, the results of these studies are heterogeneous, and it is not clear which biomarker has superior performance for early and accurate detection of lung cancer. The objectives of this overview are to explore the methodological and reporting quality of available SRs, assess diagnostic accuracy of biomarkers for lung cancer, and to compare the diagnostic value of different biomarkers with adjusted indirect comparisons.

Back to Top | Article Outline

2 Methods

2.1 Design and registration

This protocol will be reported according to preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P).[25] As a part of our project, this protocol has been registered on international prospective register of systematic review (PROSPERO) (CRD42019125880).

Back to Top | Article Outline

2.2 Search strategy

The search strategy has been developed and tested through an iterative process by an experienced medical information specialist in consultation with the review team.[26] A combination of subject terms and keywords was used and make appropriate adjustments of vocabulary and grammar between different databases. We searched PubMed, Embase.com, the Cochrane Library of Systematic Reviews, and Web of Science to identify relevant SRs from inception to February 2019. The search was not restricted by language or publication status. Reference lists of relevant SRs will be searched for potentially eligible studies. Study authors will be contacted for methodological clarifications and provision of missing data. The search strategy of EMBASE was presented in Supplementary 1, http://links.lww.com/MD/C973.

Back to Top | Article Outline

2.3 Eligibility criteria

Studies will be included in this overview if meet the following eligibility criteria: participants: any patient with lung cancer will be included regardless of the treatment plan and tumor stage. Lung cancer can be non-small cell lung cancer, small cell lung cancer, or other types. There are no restrictions on age, race or nationality. Interventions: All biomarkers used to diagnose lung cancer, including some common tumor biomarkers and some tumor-specific biomarkers. The diagnostic test can be one biomarker or one biomarker combines with other biomarkers. Type of studies: systematic reviews including randomized controlled trials, cross-sectional studies, case-control studies, or cohort studies will be included, as well as the SRs evaluating the value of biomarkers for diagnosing lung cancer. The SRs should report adequate search strategy, inclusion/exclusion criteria, sufficient details about the included studies, the diagnostic value of at least one biomarker. Outcomes: we will consider sensitivity, specificity, positive likelihood ratio, negative likelihood ratio, diagnostic odds ratio, area under the curve, and their respective 95% confidence intervals as the primary outcomes. The relative diagnostic estimates of different biomarkers and the methodological and reporting quality of each SR will be the second outcomes.

Back to Top | Article Outline

2.4 Study selection

We will use the EndNote X8 (Thomson Reuters [Scientific] LLC Philadelphia, PA) to manage the retrieved records. The titles and abstracts of the identified studies from the electronic database search will be read by 2 independent reviewers to determine if they meet the inclusion criteria. Then, the same 2 reviewers will retrieve the full text of all possibly relevant studies and assess the eligibility of each study according to the eligibility criteria. To avoid overlapping SRs, we will first map the research questions and characteristics of all eligible SRs. If we identify multiple reviews addressing the same research question that are eligible for inclusion but share the same primary study, we will include the review with the larger number of studies.[27] Different opinions on eligibility for inclusion will be resolved through discussion and consensus. Arbitration will be conducted by a third examiner.

Back to Top | Article Outline

2.5 Data extraction and management

Two reviewers will independently extract data, including study characteristics and test results, by using a pre-designed data extraction form. The detailed extracted data will include author, country of corresponding author, number of authors, publication year, journal name, country of journal, funding, disease, number and name of biomarkers, number and name of reference test, types of included studies, number of included studies, samples, pooled sensitivity, specificity, likelihood ratio, diagnostic odds ratio, area under curve, and their 95% confidence interval (95% CI). If there is no specific data in the published SRs, the author will be contacted to provide the missing information. Disagreements will be resolved by consensus or by discussion with a third reviewer.

Back to Top | Article Outline

2.6 Assessment of methodological and reporting quality

Assessment of Multiple Systematic Reviews (AMSTAR), a reliable methodological quality assessment tool for SRs of randomized trials, has a good agreement, construct validity, and feasibility.[28–30] AMSTAR-2 is a revised revision of the original AMSTAR instrument and can be used to evaluate the quality of SRs based on non-RCTs.[31,32] The Preferred Reporting Items for Systematic Reviews and Meta-analysis diagnostic test accuracy (PRISMA-DTA) is an expanded checklist of original PRISMA, which aims to improve the completeness and transparency of reporting of SRs of diagnostic test accuracy studies.[33] Thus, the AMSTAR-2 will be used to assess the methodological quality and the PRISMA-DTA for reporting quality of included SRs. Two review authors will independently assess the quality in each study according to predefined criteria. Disagreements will be resolved by consensus or third-party adjudication if consensus cannot be reached.

Back to Top | Article Outline

2.7 Data synthesis

2.7.1 Evidence map

We will create a bubble plot according to the biomarkers, methodological and the reporting quality for all included SRs using R 3.4.1 software (version 3.4.1; R Foundation for Statistical Computing, Vienna, Austria). Each bubble plot will display information in 3 dimensions. The bubble size represents the total number of reviews or the number of primary studies included in the SRs. The x-axis will represent the total number of participants included in each SR or the methodological quality. The y-axis will represent the biomarkers or the reporting quality of each SR.

Back to Top | Article Outline

2.7.2 Pairwise meta-analysis

Pairwise meta-analysis will be performed for pooled sensitivity, specificity, DOR, positive likelihood ratio, negative likelihood ratio using the Mantel-Haenszel statistical method with the random-effects model with STATA (13.0; Stata Corporation, College Station, TX). The heterogeneity between each study will be estimated using the P value and the I2 statistic. The values of 25%, 50%, and 75% for the I2 will be indicative of low, moderate, and high statistical heterogeneity, respectively.[34]

Back to Top | Article Outline

2.7.3 Adjusted indirect comparisons

We will calculate relative diagnostic outcomes between index tests including relative sensitivity, relative specificity, and relative DOR. Then, we will conduct indirect comparisons using relative diagnostic outcomes.

Back to Top | Article Outline

2.7.4 Assessment of reporting bias

The Begg test will be used to evaluate the potential publication bias where there are >10 SRs available for a biomarker.

Back to Top | Article Outline

2.7.5 Subgroup analysis

Subgroup analysis will be performed according to the types of lung cancer, the country in which the study was conducted, and the cutoff and time period of biomarkers if sufficient data are available.

Back to Top | Article Outline

Author contributions

Fanqi Wu and Yixin Wan planned and designed the research; Hongyan Tao, Huirong Huang, Longguo Zhang, and Di Wu tested the feasibility of the study; Fanqi Wu and Yixin Wan wrote the manuscript; all authors approved the final version of the manuscript.

Conceptualization: Fanqi Wu, Yixin Wan.

Data curation: Fanqi Wu, Hong Wang, Huirong Huang, Longguo Zhang, Di Wu.

Funding acquisition: Fanqi Wu.

Investigation: Hong Wang, Hongyan Tao, Huirong Huang, Longguo Zhang, Di Wu.

Methodology: Yixin Wan.

Project administration: Fanqi Wu.

Resources: Hong Wang, Hongyan Tao, Huirong Huang.

Software: Longguo Zhang, Di Wu.

Supervision: Yixin Wan.

Validation: Yixin Wan.

Visualization: Hongyan Tao.

Writing – original draft: Fanqi Wu, Yixin Wan.

Writing – review & editing: Fanqi Wu, Yixin Wan.

Back to Top | Article Outline

References

[1]. Bray F, Ferlay J, Soerjomataram I, et al. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin 2018;68:394–424.
[2]. Lortet-Tieulent J, Renteria E, Sharp L, et al. Convergence of decreasing male and increasing female incidence rates in major tobacco-related cancers in Europe in 1988-2010. Eur J Cancer 2015;51:1144–63.
[3]. Parkin DM, Bray F, Ferlay J, et al. Cancer in Africa 2012. Cancer Epidemiol Biomarkers Prev 2014;23:953–66.
[4]. Kanodra NM, Silvestri GA, Tanner NT. Screening and early detection efforts in lung cancer. Cancer 2015;121:1347–56.
[5]. Sozzi G, Boeri M. Potential biomarkers for lung cancer screening. Transl Lung Cancer Res 2014;3:139–48.
[6]. Chu GCW, Lazare K, Sullivan F. Serum and blood based biomarkers for lung cancer screening: a systematic review. BMC Cancer 2018;18:181.
[7]. Woodard GA, Jones KD, Jablons DM. Lung cancer staging and prognosis. Cancer Treat Res 2016;170:47–75.
[8]. Tuo L, Sha S, Huayu Z, et al. P16INK4a gene promoter methylation as a biomarker for the diagnosis of non-small cell lung cancer: an updated meta-analysis. Thorac Cancer 2018;9:1032–40.
[9]. Huang Y, Hu Q, Deng Z, et al. MicroRNAs in body fluids as biomarkers for non-small cell lung cancer: a systematic review. Technol Cancer Res Treat 2014;13:277–87.
[10]. Kathuria H, Gesthalter Y, Spira A, et al. Updates and controversies in the rapidly evolving field of lung cancer screening, early detection, and chemoprevention. Cancers (Basel) 2014;6:1157–79.
[11]. Hasan N, Kumar R, Kavuru MS. Lung cancer screening beyond low-dose computed tomography: the role of novel biomarkers. Lung 2014;192:639–48.
[12]. Qin J, Zeng N, Yang T, et al. Diagnostic value of autoantibodies in lung cancer: a systematic review and meta-analysis. Cell Physiol Biochem 2018;51:2631–46.
[13]. Pertile P, Poli A, Dominioni L, et al. Is chest X-ray screening for lung cancer in smokers cost-effective? Evidence from a population-based study in Italy. Cost Eff Resour Alloc 2015;13:15.
[14]. Strauss GM, Dominioni L. Chest X-ray screening for lung cancer: overdiagnosis, endpoints, and randomized population trials. J Surg Oncol 2013;108:294–300.
[15]. Hoffman RM, Sanchez R. Lung cancer screening. Med Clin North Am 2017;101:769–85.
[16]. Bradley SH, Kennedy MPT, Neal RD. Recognising lung cancer in primary care. Adv Ther 2019;36:19–30.
[17]. Jin X, Chen Y, Chen H, et al. Evaluation of tumor-derived exosomal miRNA as potential diagnostic biomarkers for early-stage non-small cell lung cancer using next-generation sequencing. Clin Cancer Res 2017;23:5311–9.
[18]. Najjar F, Alammar M, Al-Massarani G, et al. Circulating endothelial cells and microparticles as diagnostic and prognostic biomarkers in small-cell lung cancer. Lung Cancer 2018;124:23–30.
[19]. Tian JH, Zhang J, Ge L, et al. The methodological and reporting quality of systematic reviews from China and the USA are similar. J Clin Epidemiol 2017;85:50–8.
[20]. Ge L, Tian JH, Li YN, et al. Association between prospective registration and overall reporting and methodological quality of systematic reviews: a meta-epidemiological study. J Clin Epidemiol 2018;93:45–55.
[21]. Yao L, Sun R, Chen YL, et al. The quality of evidence in Chinese meta-analyses needs to be improved. J Clin Epidemiol 2016;74:73–9.
[22]. Wu Y, Liu H, Shi X, et al. Can EGFR mutations in plasma or serum be predictive markers of non-small-cell lung cancer? A meta-analysis. Lung Cancer 2015;88:246–53.
[23]. Yu H, Guan Z, Cuk K, et al. Circulating microRNA biomarkers for lung cancer detection in Western populations. Cancer Med 2018;7:4849–62.
[24]. Huang H, Shi Y, Huang J, et al. Circulating tumor cells as a potential biomarker in diagnosis of lung cancer: a systematic review and meta-analysis. Clin Respir J 2018;12:639–45.
[25]. Shamseer L, Moher D, Clarke M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P): 2015 elaboration and explanation. BMJ 2015;349:g7647.
[26]. Li L, Tian J, Tian H, et al. Network meta-analyses could be improved by searching more sources and by involving a librarian. J Clin Epidemiol 2014;67:1001–7.
[27]. Fordham B, Sugavanam T, Hopewell S, et al. Effectiveness of cognitive-behavioural therapy: a protocol for an overview of systematic reviews and meta-analyses. BMJ Open 2018;8:e025761.
[28]. Shea BJ, Grimshaw JM, Wells GA, et al. Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol 2007;7:10.
[29]. Shea BJ, Hamel C, Wells GA, et al. AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviews. J Clin Epidemiol 2009;62:1013–20.
[30]. Li XX, Zheng Y, Chen YL, et al. The reporting characteristics and methodological quality of Cochrane reviews about health policy research. Health Policy 2015;119:503–10.
[31]. Yan P, Yao L, Li H, et al. The methodological quality of robotic surgical meta-analyses needed to be improved: a cross-sectional study. J Clin Epidemiol 2019;109:20–9.
[32]. Shea BJ, Reeves BC, Wells G, et al. AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ 2017;358:j4008.
[33]. McInnes MDF, Moher D, Thombs BD, et al. Preferred reporting items for a systematic review and meta-analysis of Diagnostic Test Accuracy Studies: The PRISMA-DTA Statement. JAMA 2018;319:388–96.
[34]. Ge L, Pan B, Song F, et al. Comparing the diagnostic accuracy of five common tumour biomarkers and CA19-9 for pancreatic cancer: a protocol for a network meta-analysis of diagnostic test accuracy. BMJ Open 2017;7:e018175.
Keywords:

adjusted indirect comparison; biomarker; diagnostic test accuracy; evidence mapping; lung cancer; overview

Supplemental Digital Content

Back to Top | Article Outline
Copyright © 2019 The Authors. Published by Wolters Kluwer Health, Inc. All rights reserved.