Secondary Logo

Journal Logo

Review Articles

The Regimen of Computed Tomography Screening for Lung Cancer

Lessons Learned Over 25 Years From the International Early Lung Cancer Action Program

Henschke, Claudia I. PhD, MD*,†; Yip, Rowena MPH*; Shaham, Dorith MD; Zulueta, Javier J. MD§; Aguayo, Samuel M. MD; Reeves, Anthony P. PhD; Jirapatnakul, Artit PhD*; Avila, Ricardo MS; Moghanaki, Drew MD, MPH#; Yankelevitz, David F. MD*; for the I-ELCAP Investigators

Author Information
Journal of Thoracic Imaging: January 2021 - Volume 36 - Issue 1 - p 6-23
doi: 10.1097/RTI.0000000000000538
  • Open



The Early Lung Cancer Action Project (ELCAP) of low-dose computed tomography (LDCT) screening lung cancer was stimulated by several research retreats in 1991 and 1992.1,2 The ELCAP study used an innovative design for the first comparison of LDCT with chest radiographic (CXR) screening to assess the stage distribution resulting from each imaging test within 2 years, separately for baseline and annual repeat rounds and the resulting lung cancer cure rates after treatment and long-term follow-up (Fig. 1). The study design also allows for random assignment of patients diagnosed with lung cancer to alternative treatments.3–10

The ELCAP design allows for direct comparison of different screening tests (eg, imaging tests or biomarkers) by providing the baseline round followed by as many repeat rounds of screening as needed to assess the particular comparison.

The baseline round showed that 85.1% of the LDCT-detected lung cancer patients had clinical stage I disease, and CXR missed 82% of them.8 These results gave renewed hope to people at risk of lung cancer throughout the world.11

The annual repeat screenings were completed, submitted for publication in 1999, and published in 2001.9,10 Annual rounds are important, as they are repeated year after year, while the baseline round is performed only once. Annual rounds are pooled, as each round is a repeat occurrence of prior annual rounds, and thus are critical for evaluation of long-term screening performance. Compared with the baseline round of ELCAP, annual screening identified far fewer new noncalcified nodules (NCNs) (2.5% vs. 23%, P<0.0001) and a lower percentage of screen-diagnosed lung cancers (0.59% vs. 2.7%, P<0.0001); the median tumor size was smaller (8 vs. 10 mm, P=0.45), and the percentage of screen-diagnosed Stage I disease was slightly lower (85.7% vs. 85.1%, P=1.00). When interim, symptom-prompted diagnosed cases between rounds of screening were included, the percentage of Stage I diagnoses under screening, was lower (77.8% vs. 85.1%, P=0.63). This was anticipated, as more aggressive cancers are identified in repeated rounds of screening than in the baseline round due to a phenomenon called “length bias.” Length bias affects all screening programs for cancer and chronic diseases.1,12–14 A later publication provided the extent of length bias.15

The success of ELCAP was due to its design, which provided screening to a cohort of people at risk for lung cancer in a clinical program, to the ELCAP Management System16 for management and quality assurance, and to the advanced registry, which stored both radiologic images and data. Since 2000, the ELCAP paradigm allowed for continued expansion of LDCT screening to New York State (NY)-ELCAP,17 and to over 80 institutions in 10 countries (International [I]-ELCAP),18 all using a common protocol.19 The common protocol and management system allowed for the emerging data to be pooled and analyzed in an efficient manner, as widespread interest in screening soon became apparent.20–23

By 2006, the expanded I-ELCAP collaboration provided sufficient long-term follow-up of annual LDCT screening to estimate the cure rate without lead-time bias.1,12–14 On the basis of 10-year Kaplan-Meier survival analysis, the estimated cure rate was 80% (95% confidence interval [CI]: 74%-85%) for all lung cancers diagnosed under screening (ie, both screen-diagnosed and interim-diagnosed), and, for those in clinical Stage I and whose cancer was resected within 2 months of diagnosis, the rate was 92% (95% CI: 88%-95%).18

These rates have been updated at each of the 41 International Conference on Screening for Lung Cancer meetings, held every 6 months since 1999, and they have remained at the same level.24 The cure rate of 80% had already been suggested by Drs Flehinger and Kimmel,25,26 as the ELCAP Investigators had asked them to estimate the potential cure rate of computed tomography (CT) screening using their mathematical model. The same rate has also been estimated on the basis of the stage distribution achieved in ELCAP.8

The low-cost, efficient, prospective ELCAP cohort design provided pertinent information after 2 rounds of screening on the tumor size at detection, the stage shift,8,10 and, after appropriate follow-up, the cure rates.18 The ELCAP results were discussed in detail at the National Cancer Institute Board of Scientific Advisors meetings in 1999,27 and some experts thought that the 1999 ELCAP report provided sufficient evidence to start LDCT screening, while others thought that randomized trials were needed, and different possible future studies were discussed. Thus, stimulated by the ELCAP results, planning for several large national screening randomized controlled trials was quickly started, and, in November 2001, the Board approved the Request for Proposal, which led to the National Lung Screening Trial (NLST). The NLST provided 3 rounds of screening and reported its results 9 years later in 2011.28 In the Netherlands, the NELSON Trial started in 200429,30; it provided 4 rounds of screening, and it reported its preliminary results 14 years later in 2018,31 and its final results in 2020.32 In Italy, the MILD Trial started in 2005, and it reported its interim results in 2012,33 and its final results in 2019, 14 years later.34 These randomized trials confirmed the benefit originally reported by ELCAP.

Comparisons of the ELCAP study design and randomized trials and their respective outcome measures are given in several publications.35–37 These combined results have led to the increasing worldwide acceptance, as was fully evident at the 20th World Conference on Lung Cancer (WCLC) in Barcelona in September 2019.38

Concerns, other than those about the screening regimen, were addressed by the I-ELCAP investigators. As to who would benefit from LDCT screening, they provided the methodology to calculate the individualized benefit for an individual enrolling in an LDCT screening program, given the person’s particular age, smoking history, and competing causes of death.39–42 The 2007 article showed how the same approach is used to calculate the survival gain of each subsequent annual round of screening.40 To address the concern that screening would provide a smoker the license to continue or to resume smoking, the ELCAP Investigators showed that smoking cessation increased when integrated in a program of LDCT screening and that it did not lead to resumption of smoking among former smokers.43,44 The investigators also developed recommendations for the many additional findings that could be identified on the LDCT of the chest and showed how these provided an added benefit of screening. These recommendations were added to the I-ELCAP protocol.45 In particular, they recognized that screening allowed for early detection of cardiovascular46,47 and chronic obstructive pulmonary disease,48 the 2 leading causes of death in the United States. To address the concerns about the costs of screening and follow-up, cost-effectiveness of screening was also addressed.49–52 Unfortunately, these cost-effectiveness analyses do not incorporate the benefit of identifying early and unsuspected cardiovascular and pulmonary disease, which can be diagnosed on the same LDCT.

The I-ELCAP database includes over 82,000 participants with long-term follow-up at 82 institutions in 10 countries in the world.53–57 To address the concerns about the identification of many NCNs and unnecessary workup, stimulated in part by the advances in CT scanners and large computer monitors that allowed for identification of many tiny NCNs, the I-ELCAP investigators provided a detailed analysis of screening results using the accumulating screening results obtained with the latest scanners. Initially, they demonstrated that these advances in scanner technology were useful in decreasing the frequency of symptom-prompted, interim diagnoses between rounds of screening.17

This review focuses on the lessons learned about the regimen of screening and how important it is to continually update regimen in light of continually advancing technology and knowledge to remain state-of-the-art. We address the need for assessment of the LDCT measurement accuracy, as this increases the accuracy of the recommendations and thus the benefit and efficiency of the regimen. We also show how we used the I-ELCAP data and image repository to address the concerns of overdiagnosis and overtreatment. To maximize the benefit of screening, updates in early lung cancer staging and treatment are critical, particularly in the context of the earlier diagnoses provided by effective screening. This was addressed by setting up a treatment cohort of Stage I lung cancer patients to compare treatment alternatives in the context of clinical care58; this had been recommended by the Institute of Medicine.59 The concerns raised and the lessons learned in addressing the concerns in order to maximize the benefit of screening and minimize its potential harms24 are provided in the following sections.


As early as 1992, new helical CT scanners enabled acquisition of multiple LDCT images with slice thickness of 10 mm, allowing the entire chest to be scanned in a single breath-hold. Previously, CT images had been acquired one slice at a time using “stop and shoot” approach, so that several breath-holds were required to cover the lungs. Because of the different inspiratory effort for each breath-hold, entire sections of the lungs could be missed. The new CT technology also provided adequate images at low-radiation exposures.60 The 30 LDCT images of each of the initial 1,000 ELCAP participants, however, were still displayed on a single radiographic film. The focus, based on previous CXR experience, was to identify a “solitary” NCN.61–66

Once LDCT screening started, the ELCAP investigators quickly learned that they frequently detected multiple small NCNs in a single screening participant, but only a few of them turned out to be lung cancers. Thus, multiple NCNs were documented, instead of a single one, and the protocol focused on the largest NCN.8,10 Upon retrospective reflection in writing this article, the high proportion of Stage I lung cancers, both on the baseline and annual repeat rounds,8,10 is surprising, given the small CT images that were displayed on a single radiographic film.

Subsequent advances in CT scanners provided submillimeter images, and the single CT images could be viewed on high-resolution computer monitors. This led to a marked increase in nodules being detected, but a decrease in symptom-prompted lung cancer diagnoses between screenings.17 Thus, the ELCAP Investigators used the ELCAP database of the original 1000 participants to update the threshold values for the regimen of screening. Starting in 2000, the updated I-ELCAP protocol recommended a threshold of 5.0 mm for the workup of NCNs identified at baseline and 3.0 mm for new or growing NCNs on annual repeat screenings.67 This protocol was used for NY-ELCAP17 and I-ELCAP studies.18 The ELCAP Investigators also provided the requested empiric evidence for the Fleischner Society guidelines.68,69

By 2012, with continued CT scanner advances that provided CT images with thinner slice thickness, the threshold values for the I-ELCAP protocol were again reviewed. This time, both the I-ELCAP70 and NLST databases71 were used to examine how to reduce unnecessary workup while still diagnosing lung cancers early. A threshold of 6.0 mm for the workup of baseline NCNs was chosen by the I-ELCAP Investigators,24,45 6 mm by the American College of Radiology (ACR)72,73 and also by the National Comprehensive Cancer Network (NCCN) Investigators.74 The threshold for workup on new or growing NCNs on annual repeat screening in I-ELCAP remained the same, at 3.0 mm for the I-ELCAP Investigators and 4 mm for the ACR and NCCN Investigators. The implications of rounding by using a threshold of 6 mm instead of 6.0 mm were subsequently examined and the use of 6 mm led to an increase of 28.9% in the frequency of positive findings.75 Subsequently in 2019, the ACR changed its threshold from 6 to 6.0 mm.76


Radiologists in Japan had been performing radiographic screening for pulmonary tuberculosis since 1935. In the 1950s, when effective tuberculosis drugs emerged, radiographic screening for tuberculosis in Japan was changed to screening for lung cancer. When lung cancer became the leading cause of cancer death in Japan in 1993, the Anti-Lung Cancer Association, a for-profit organization, added CT to the already existing program of chest radiography and sputum cytology screening provided to its due-paying members.77 In 1996, the Anti-Lung Cancer Association reported that 1369 members had undergone chest radiography, CT, and sputum cytology between September 1993 and April 1995, with a resulting diagnosis of lung cancer in 15, all of them by CT alone.

Japanese investigators published on a newly recognized subtype of nodules on CT, called “ground-glass” opacities, starting in 1995.78–80 I-ELCAP Investigators also identified “ground-glass” opacities on LDCT screening when they started in 1992.81 After much reflection, including discussion with Japanese investigators, the I-ELCAP Investigators thought it was important to differentiate these nodule subtypes from other ground-glass opacities that were due to pulmonary edema, diffuse infections, end-stage adult respiratory distress, and other entities and developed a new terminology for these NCNs based on their consistency—solid, part-solid, and nonsolid NCNs.82 After discussion with Dr Sone an I-ELCAP Investigator who headed the Nagano screening program,83 the I-ELCAP protocol set the threshold for workup of nonsolid NCNs at 8.0 mm, as this size implied that the NCN was no longer contained within a single pulmonary acinus.

To better understand these different subtypes of NCNs and lung cancers manifesting in these NCNs, starting in 2000, the I-ELCAP Investigators studied them,84,85 developed a pathology protocol,86,87 and held multiple expert pathology panel reviews, funded in part by the American Cancer Society.88 This led to multiple publications of the I-ELCAP Investigators with the expert lung pathologists, Drs William Travis, Darryl Carter, Masayuki Noguchi, Elisabeth Brambilla, and Adi Gazdar.89–91Figure 2 provides the Kaplan-Meier survival rates for adenocarcinomas by the percentage of the lepidic (previously called bronchoalveolar carcinoma or BAC) component91 for patients with nonsolid NCNs or part-solid NCNs on CT images. As previously shown by Noguchi et al,78 survival of patients was 100% for patients who had 90% to 100% lepidic (BAC) component. Lepidic growth on pathology manifested radiologically as an area of “ground-glass” or nonsolid NCNs on CT.92 The radiologic-pathologic panel reviews ultimately led to the new pathologic classification of adenocarcinoma and revised World Health Organization classifications.92–95 The pathology guidelines also recommended that CT images be reviewed when making pathologic diagnoses of these subsolid (ie, nonsolid and part-solid) NCNs.

Kaplan-Meier survival rates for patients with adenocarcinoma (n=279) by the percentage of the lepidic (formerly BAC component) component.91

By 2013, the I-ELCAP Investigators thought that further updating of the regimen was needed for the workup of these NCN subtypes. For this purpose, they reviewed the I-ELCAP96,97 and NLST98,99 databases, and the world’s English publications.100,101 These detailed reviews found that nonsolid of any size and part-solid cancers with solid component <10 mm had lung cancer survival rates of essentially 100% and could be safely followed-up with annual CT until the solid component either develops within a nonsolid NCN or the solid component of the part-solid grows.91 These findings resulted in updated recommendations for work-up of nonsolid, part-solid, and solid NCNs given in the latest I-ELCAP protocol.45

Our systematic review found that there is a lack of consensus as to the definition of part-solid NCNs.101 I-ELCAP investigators decided that a standardized size definition of the upper limit of solid component of a part-solid nodule was needed to avoid misclassification of solid NCNs as part-solid NCNs. In the NLST image database,98,99 solid lung cancers and benign nonmalignant lesions had or developed a surrounding ground-glass or nonsolid halo, but these were still solid NCNs. Similarly, solid NCNs with central cavitation were misclassified as part-solid NCNs. As a result, the I-ELCAP protocol set an upper size limit of 80% for the solid component of part-solid NCNs.45 The I-ELCAP investigators also found that cell types and survival rates were different for lung cancer patients who had part-solid cancers with 1% to 79% solid component and those with ≥80% solid component. After a detailed review of CT and pathology images, both pathologists and the I-ELCAP investigators recognized that the threshold values should be based on the solid component of subsolid NCNs rather than the entire size of the NCN.

The updated I-ELCAP protocol was the first to recommend “watchful waiting” for all nonsolid NCNs by 12-month follow-up, as these had no solid component other than blood vessels within the NCN. Follow-up of part-solid and solid NCNs was based on the size of the solid component.45 This recommendation was supported by both the pathology results91 and the evidence of the long lead-time of these cancers when identified by screening.15

The ELCAP investigators also found that many new solid, but particularly nonsolid and part-solid NCNs, resolved after short-term follow-up.102,103 The frequency of resolution was found to be higher for new NCNs on annual repeat screening than on baseline screening, as on annual repeat screening, up to 70% resolved or decreased within a month.102,103 Thus, follow-up imaging after baseline and annual repeat screening is useful, as it prevents unnecessary invasive procedures.


The workup of NCNs was also guided by understanding “length-bias,” a phenomenon found in all cancer screening programs,12–14 and determining the extent of this bias for LDCT screening, as the more sensitive the screening test, the greater the bias. Length-bias exists because cancers identified in the baseline rounds are usually slower growing and less aggressive than cancers identified in annual rounds. This is because more slow-growing cancers are detected in the first, baseline round.12–14 However, on repeated screening rounds, the distribution of slower-growing and faster-growing cancers is the same, as found in usual care in the absence of screening. The difference in frequency of baseline and annual repeat screening of cancers by cell-type and consistency in I-ELCAP provides the information on the extent of length-bias.15

Figure 3 illustrates the differences in cancers found in baseline and annual rounds of screening. The higher frequency of lung cancer diagnosed in solid NCNs in annual rounds (85%) (Fig. 3B) compared with the baseline round (66%) (Fig. 3A) demonstrates that solid cancers, on average, have faster growth rates. The frequency of cancers in nonsolid NCNs decreased from 15% in baseline (Fig. 3A) to 10% in annual rounds (Fig. 3B), and, for cancers in part-solid NCNs, the frequency decreased from 21% to 8%, reflecting their slower growth rates, respectively. Lung cancers in part-solid and nonsolid NCNs are all adenocarcinomas, but have different percentages of the lepidic component within the cancer on pathology. The consequence of length-bias is that an optimal regimen of screening should use different threshold values for workup of NCNs in the baseline round from those of repeat rounds of screening.45

A and B, The increasing frequency of lung cancers diagnosed in solid NCNs in (B) annual rounds (85%) compared with those in the (A) baseline round (66%) demonstrates that cancers in solid nodules are on average more aggressive. Cancers in nonsolid and part-solid NCNs decreased in annual rounds (B) comparing with the baseline round (A), indicating that these were less aggressive cancers.

A precise definition of each screen-diagnosed cancer is needed to correctly assess the extent of the “length-bias.”15 A baseline cancer is a cancer diagnosed in an NCN that was documented on the baseline CT, regardless of whether the diagnosis was made in that first year after the baseline round or later years. An annual cancer is a cancer diagnosed in a new NCN that is first identified and documented on an annual round of screening, even if, in retrospect, it can be identified in the baseline LDCT.


Concern about overdiagnosis bias was raised for lung cancers, particularly for those diagnosed in nonsolid NCNs that had 100% survival, when resected, as reported by Noguchi and his colleagues in 1995.78 These cancers in nonsolid NCNs are diagnosed in 15% of the all the cancers diagnosed as a result of baseline screening and in 10% of all cancers diagnosed as a result of annual rounds (Fig. 3).

The National Cancer Institute addressed the issue of overdiagnosis and suggested that the word “cancer” be restricted to “lesions that had a reasonable likelihood of lethal progression if left untreated.”104 The panel suggested “indolent lesions of epithelial origin (IDLE)” for such lesions. Separately, the NLST investigators estimated that 18.5% of all lung cancers detected by LDCT screening in the NLST to be overdiagnosed (95% CI: 5.4%-30.6%).105 After longer follow-up, however, the NLST reported that the frequency of cancers detected in the control group reached those in the screened group.106 The NELSON investigators estimated that overdiagnosis was <8.9%.32 Recognition that adenocarcinoma-in-situ and minimally invasive adenocarcinoma are very slow-growing cancers emerged from careful investigations of radiologic-pathologic correlations of lung cancers in the context of clinical care.78–90

The I-ELCAP Investigators also studied overdiagnosis.107–117 They suggested that the concept of overdiagnosis is a malformed concept, as it is not based on clinically based manifestations of the cancer, but rather death from the cancer, as its definition uses the cause of death.117 In other words, this definition implies that a cancer is genuine only if it causes death, otherwise the cancer is an overdiagnosed one.

We suggest an alternative definition that is based on the aggressiveness of the cancer. A slow-growing cancer is overdiagnosed when it is considered to be an aggressive cancer, and an aggressive cancer is underdiagnosed when it is considered to be a slow-growing cancer. Only 10% of lung cancers diagnosed on annual repeat screenings occurred in nonsolid NCNs (Fig. 3B). In the I-ELCAP experience, these nonsolid NCNs have been followed-up for up to 28 years, and, among them, some develop solid components that grow and ultimately require treatment. We are currently studying growth rates of lung cancers to further address this issue.118

The main problem of overdiagnosis, however, is not early diagnosis but overtreatment of these indolent, slow-growing cancers, particularly when found early by screening. The goal is to avoid overtreatment. For this reason, the I-ELCAP protocol started to recommend “watchful waiting” by annual screening of nonsolid NCNs until a solid component emerges.45,82 For part-solid nodules with solid components, follow-up diagnostics are recommended according to the size of the solid component.45,96–103 If follow-up CT showed growth of the solid component of the NCN at a malignant rate, biopsy was recommended. Current surgical recommendations for nonsolid NCNs also consider watchful waiting as an alternative approach, which is also recommended by the LungRADs72,76 and National Comprehensive Center Network guidelines.74


Figure 4 provides the probability of diagnosing lung cancer by the average diameter and consistency of the largest NCN in the I-ELCAP database of 76,411 participants, separately (a) baseline cancers and (b) annual repeat cancers.45 Comparison of Figures 4A and B clearly shows the differences between the baseline and all subsequent rounds. For example, for solid NCNs <6.0 mm, the probability of malignancy is >6 times higher on annual repeat rounds than on the baseline round (2.0% vs. 0.3%), while the probability of malignancy for the larger size solid nodules on annual repeat screening is about half that on baseline.

Provides the probability of diagnosing lung cancer by the largest NCN average diameter (mm) and consistency in the I-ELCAP database, separately on the (A) baseline round and (B) annual repeat rounds.45


In the 1990s, when an NCN≥10 mm was identified on the CT screening, the standard of care called for an immediate biopsy,8,61–66 based on CXR images. PET scans had not yet been widely introduced at that time. The first 1000 ELCAP participants whose largest NCNs were <10 mm were re-imaged 3 months later using single-slice, axial mode targeted CT acquisition rather than helical mode acquisition, as this provided higher resolution images, which allowed for more accurate assessment of growth,8,10 but, if the NCN was 10 mm or larger, biopsy was recommended.

D.F.Y., an ELCAP investigator, thought that volumetric measurement was a better tumor size assessment tool than the conventional 1-dimensional or 2-dimensional measurements and studied this in the early 1990s.119–133 In 1996, Dr Anthony Reeves, an electrical and computer engineer at Cornell University in Ithaca, and his doctoral students joined the ELCAP research efforts and introduced 3-dimensional volumetric growth assessment. Volume-doubling time (VDT) was found to be a useful measure of growth for distinguishing between malignant and nonmalignant NCNs and also to distinguish minimally aggressive from aggressive adenocarcinomas,118,133,134 which had already been recognized earlier using CXR images.135–137 The ELCAP Investigators presented these volumetric analyses at many conferences, as well as at their International Conferences,24 and its usefulness was quickly recognized by others and integrated into emerging regimens of screening. Future investigators of the NELSON Trial,30 for example, attended multiple I-ELCAP24 and other conferences at which the ELCAP Investigators presented their volumetric results, and they incorporated volumetric analysis in the regimen of their randomized trial. The ELCAP investigators continued to work with the NELSON Investigators and assisted them in developing a management system, as they were doing with many other investigators throughout the world.20–23

As LDCT screening expanded in I-ELCAP, the investigators found that only 18% of the baseline solid NCNs between 10 and 15 mm were malignant NCNs (eg, mostly hamartomas, granulomas, fibrosis), as shown in Figure 4A, and that, often, the nonmalignant solid NCNs had spiculated and other irregular features, typically associated with malignant NCNs. Thus, the biopsy recommendation for solid NCNs>10 mm changed to a 3-month follow-up LDCT for all solid NCNs <15.0 mm in diameter.45 If, on follow-up LDCT, the solid NCN had grown at a malignant rate, biopsy was recommended. We found that none of the participants ultimately diagnosed with lung cancer had disease stage progression by waiting 3 months for another LDCT.45 A further lesson learned was that the fine-needle aspiration biopsy was useful in diagnosing small benign NCNs, thus reducing unnecessary surgery.138

For solid larger NCNs (≥15 mm), the standard recommendation called for biopsy or PET scans. But only 50% of solid NCNs ≥15 mm on the baseline LDCT (Fig. 4A), and only 26% on annual repeat screening (Fig. 4B), are malignant. As volumetric accuracy increases in the future, many unnecessary surgical biopsies may be averted, as growth will be more rapidly and accurately assessed, perhaps in weeks rather than months. Such advances will also allow for a more personalized treatment of diagnosed lung cancers.

We are continuing to study growth rates of lung cancers118 and have confirmed that lung cancer VDTs typically range between 30 and 400 days.30,64–66,118,133–137,139–141 We have used this information to determine the minimum follow-up time to assess growth at a malignant rate, ideal time between repeated rounds of screening, and also for extent of treatment decisions.


The I-ELCAP Investigators recognized the considerable variability of CT scanners for growth assessment142,143 when they started in the mid 1990s122–126 and have continued to refine growth assessment since that time.127–133 The variability is due to many factors: the scanner itself, both inherent and adjustable CT acquisition parameters and characteristics of the person being scanned and the nodule itself, and both morphologic features and location.143 Unfortunately, the inherent variability of CT scanner acquisition protocols is not widely recognized.

To better illustrate the variability, R. Avila, together with the I-ELCAP Investigators, used a “pocket phantom” (a perfect sphere with a volume of 15.875±0.05 mm3) in an ongoing clinical trial.143 R. Avila is a computer scientist, formerly the head of CAD development at General Electric Global Research, and is now a member of the Quantitative Imaging Biomarkers Alliance (QIBA) of the Radiologic Society of North America. The pocket phantom, shown in Figure 5, was placed on the chest of the patient while the CT scans were obtained at different times during the trial. These repeated CT acquisitions of the pocket phantom showed up to 44% volume change of the unchanged sphere embedded in the pocket phantom. This level of volumetric change error can lead physicians to a mistaken conclusion that significant volumetric growth (false positive) or volumetric regression (false negative) has occurred.

Multiple “pocket phantoms” (left upper image). One pocket phantom was placed on the chest of a lung cancer patient (left lower image). The images on the right show the considerable increases in the volume of precision manufactured spheres embedded in the pocket phantom.143

The current I-ELCAP protocol specifies the necessary change in the nodule diameter to determine “real” growth (see Tables 3 and 4 in the protocol45) for tumors with a VDT of 180 days, separately for the baseline and annual repeat rounds. These tables are based on the assumption that 64-detector-row or higher CT scanners are used, that acquisition is at submillimeter slice thickness, slice spacing is equal or less than slice thickness, reconstruction field of view is <30 cm, and that identical acquisition parameters were used to acquire both scans, so that excellent CT images are obtained for accurate growth assessment. The ACR LungRADS recommendations are different, as they specify growth for a nodule, regardless of size, as “an increase of 1.5 mm or more.”72,76 The accuracy of VDT calculations, however, depends on nodule size, and thus the use of a fixed value (ie, 1.5 mm) to indicate nodule growth means that smaller tumors with faster doubling time will have delayed recognition. This size dependence is recognized in the I-ELCAP45 and the QIBA small nodule profile recommendations.144

Lessons learned include that when using any computer-assisted software for size or growth assessment, the radiologist must be satisfied with the CT image quality and the computer segmentation results in deciding whether growth has occurred. The computer scans and the segmentation need to be reviewed for image quality (eg, motion artifacts) and for the quality of the segmentation. The radiologist should visually inspect both nodule image sets side-by-side to verify the quality of the computer segmentation for each image that contains a portion of the nodule. The segmentations should also be examined for errors; for example, a small blood vessel may be included as part of a nodule in one segmentation but not in another segmentation. Scan slice thickness and slice spacing for the purpose of volumetric analysis should not exceed 1.25 mm but preferably be as low as possible. We currently use the thinnest slice thickness, typically 0.5 or 0.625 mm.

Spatial warping also complicates measurement accuracy. It occurs when CT images are obtained for LDCT screening, which uses the helical acquisition mode to obtain the images in a single breath-hold. Spatial warping distorts CT images, as illustrated in Figure 6, and the extent of the warping is highly dependent on the make and model of the CT scanner and on the distance from the isocenter.

A scan of 3 identical precision manufactured phantoms (CTLX1) shows the 3D spatial warping in helical acquisition. Spatial warping was observed to be dependent on the distance of the object from the iso-center of the scanner. It is not as marked when the object is close to the iso-center (image on the right) but increases with increasing distance (100 mm, 200 mm) from the iso-center (images on the left). Spatial warping also regularly alternates between compression (red arrow) and expansion (blue arrow) in the Z dimension depending on distance along this dimension.

To address accurate CT measurements, the Radiological Society of North America (RSNA) created the QIBA 144,145 and has worked with R. Avila to develop a phantom for conformance testing of different scanners and software products. It is far more rigorous for lung nodule measurement assessment than the usual ACR CT accreditation phantom. QIBA is in the final stages of releasing the QIBA CT Small Lung Nodule Profile, which will provide recommendations on assessing growth of small lung nodules ( While these estimates are meant only as boundaries to be confident that nodule change has actually occurred, they do not address the accuracy of volumetric assessment of growth rates themselves, that is, VDTs, which remains a topic of research.

R. Avila developed the QIBA lung nodule profile calculator (, which provides the 95% confidence interval for any diameter or volume measurement of small NCNs and provides a confidence interval for change over time. Currently, it is recommended that estimates of VDTs or changes in nodule size be interpreted with caution. Figure 7 illustrates a follow-up CT scan in 90 days of a 6.0 mm nodule, even when using acquisition parameters that provide the maximum resolution for small NCNs, a stable NCN cannot be distinguished from an NCN with a 400-day VDT, nor between a stable NCN and an NCN with a 180-day VDT. In other words, a 6.0 mm cancer with a VDT of 400 days or a cancer with a VDT of 100 days would have follow-up measurements in the overlapping solid orange and red bands, and a stable 6.0 mm diameter NCN with a diameter measurement error of 0.5 mm will have follow-up measurements within the solid green band only 67% of the time.

Precision follow-up time. The degree of overlap between the green, orange, and red bands shows the overlap of the different VDTs of nodule growth for given follow-up times. The width of the bands was set to illustrate a high level of image quality in terms of CT image resolution and distance between voxels. The solid bands indicate the 1 standard deviation of confidence regions that future nodule measurements will fall into for stable (green), 400-day (orange), and 180-day (red) VDTs. The outer dashed lines for each band indicate 2 standard deviation confidence intervals.

In the future, phantoms together with the methodology provided by the QIBA CT Small Lung Nodule Profile will establish the measurement error for different scanners, acquisition protocols, and nodule presentation subtypes. The phantoms, if embedded into or placed on the CT scanner table, will provide automated measurement of an NCN and its confidence interval. This confidence interval can then be used to generate the appropriate time interval within which an individual should return for the follow-up CT imaging to reliably assess change.


The latest I-ELCAP regimen of screening is available on the I-ELCAP website45 and is also summarized in this report (Table 1 for the baseline round and Tables 2 for all subsequent annual repeat rounds). The original I-ELCAP protocol45 predates the ACR LungRADS 72 by >20 years.

TABLE 3 - Summary of I-ELCAP Innovations, Initial Year, and Publications
Initial Year References
Development of the ELCAP Design 1992 3–6
 Baseline ELCAP Results 1998 6–8
 Annual Repeat Results 1999 9,10
 Survival benefit of LDCT screening 1999 8,18
Neural networks in LDCT screening 1994 203,206,207
Volume- doubling assessment of NCNs 1997 119–129
International Conferences on Screening for Lung Cancer 1999 20
Cost-effectiveness of Low-Dose CT Screening 2000 50–52
Web-based ELCAP Management System: data and images 2001 16
Screening bias: lead time, length bias, and over-diagnosis 2001 15,105–116
Smoking cessation integrated into screening 2001 43,44
I-ELCAP protocol development 2001 19,24
 Updates of positive result 2001 67,70,71
 Expansion to NY-ELCAP and I-ELCAP 2001 17,18
 Identification and terminology of nonsolid and part-solid NCNs 2002 81–85,96–101
 Watchful waiting for nonsolid and part-solid NCNs 2002 24,45
I-ELCAP pathology, protocol, and panel results 2002 84–91,141,142
Increased lung cancer risk ofor women 2004 173,174
Individualization of risk ofor lung cancer and competing causes of death 2005 39–42
Comparison of screening study designs 2005 35–37
CT findings of cardiac disease 2006 45–47
 Emphysema, and other findings 2007 45,47,48,55
Treatment of screen-diagnosed cancer patients and quality of life 2013 160–169
Initiative for Early Lung Cancer Research on Treatment (IELCART) 2018 58
Recommended updates of staging criteria 2019 8,100,153,154
Comparison of different screening protocols 2019 145

TABLE 1 - I-ELCAP Baseline Round of Low-Dose CT (LDCT) Screening
Before the participant receives the LDCT, ask the participant to cough vigorously. If there is a Solid Endobronchial Nodule, ask them to cough again and repeat LDCT immediately. If only recognized later, ask participant to return for repeat CT in 1 mo and, if still present, see pulmonologist
The result of baseline LDCT is classified into four IELCAP categories as follows:
Negative: Return for first annual screening in 12 mo (IELCAP=1)
 If there are NO noncalcified nodules (NCNs)
Semi-positive/indeterminate: Return for first annual screening in 12 mo (IELCAP=2)
 Only nonsolid nodules are present, they can be of any size Largest solid NCN <6.0 mm or largest solid component of a part-solid NCN<6.0 mm
Semipositive/indeterminate: Return for LDCT follow-up in 3 mo (IELCAP=3)
 Largest NCN is solid and 6.0-14.9 mm in average diameter Largest NCN is part-solid and the solid component ≥6.0-14.9 mm in average diameter.
If 3-month LDCT:
1. Does NOT show malignant growth: Return for first annual screening in 9 mo
2. Shows malignant growth, the result is positive (see below) (IELCAP=4)
*If possible infection, recommend pulmonology consultation and possible antibiotics
Positive: Biopsy or, if less suspicious, PET or 1 mo follow-up LDCT (IELCAP=4)
 Largest solid NCN ≥15.0 mm
If there is no diagnosis of malignancy after workup, recommend first annual screening, 12 months after the initial, baseline LDCT.
Use the Society of North America Quantitative Imaging Biomarker Alliance (QIBA) or I-ELCAP recommendations on
Alternatively, calculate VDT=volume doubling time for lung cancers. There is considerable error in VDT measurements: VDT of lung cancers range between 30 days and 400 days. A cancer with VDT of 30 days is a very fast growing cancer; VDT of 400 days is a very slow growing cancer.
VDT below 30 days usually indicates infections.

A comparison of 3 published protocols146 found that the I-ELCAP protocol45 required fewer additional diagnostic tests and biopsies for each resulting diagnosis of lung cancer than LungRADS72 and the European Consortium protocol.147 ACR-LungRADS has 2 scenarios for NCN≥8 mm but <15 mm, Scenario 1 recommending immediate PET scans and Scenario 2 recommending follow-up CT in 3 months. Defining the efficiency ratio (ER) as the number of participants requiring further tests per diagnosis of lung cancer, the overall ER was 13.9, 18.3, 18.3, and 31.9 for I-ELCAP, ACR-LungRADS (Scenario 1), ACR-LungRADS (Scenario 2), and the European Consortium, respectively. An ER closer to 1 indicates a more efficient protocol. A more critical ER value is the number of invasive biopsies recommended per diagnosis of lung cancer, and this was 2.2, 8.1, 3.2, and 4.4, respectively. Thus, I-ELCAP had a lower ER value for the overall workup and for invasive biopsies as well.

Despite the differences, the comparison showed that all 3 regimens have certain key elements in common.146 All recommend annual screening, and provide thresholds to recommend workup, separately for the baseline and annual repeat rounds of screening. Size threshold values for NCNs are based on either diameter or volume, but threshold values are different. All 3 protocols address the different subtypes of nodule consistency—solid, part-solid, and nonsolid—using terminology developed by I-ELCAP Investigators.82

As different regimens of screening are being used, lessons learned include that efficiency metrics need to be developed to provide quantitative methods to compare different protocols. Such metrics also provide insight on the impact of different thresholds and workup recommendations and allow identification for further improvements in the screening regimen that optimize the benefit of early detection. Since the publication of this comparison of these regimens,146 the ACR has updated LungRADS 1.176 and addressed some of the points that the comparison article146 had raised.


When ELCAP started in 1992, the Sixth Edition of the American Joint Committee on Cancer148 was being used. It classified lung cancers <30 mm as Stage IA (T1N0M0) into 2 size categories. From the beginning, ELCAP and I-ELCAP8,149,150 used 3 size categories: ≤10, 11 to 20, and 21 to 30 mm, and these 3 categories are now incorporated in the Eighth Edition of Lung Cancer Stage Classification introduced in 2018.151–153 The Eighth edition152 had only a limited number of small (<30 mm) lung cancer cases for analysis, with 781 cases being <1.0 cm, limiting the assessment.

The Eighth edition does not recognize nodule consistency (solid, nonsolid, part-solid) as a separate staging criterion, although it has been recognized in the pathologic staging.92–95 Nonsolid or part-solid cancers are all adenocarcinomas, but the extent of tumor invasion is important. It was recognized that the old terminology “BAC” was unclear whether tumor invasion was required. Therefore, pathologists replaced the old terminology with the following new terminology: adenocarcinoma-in-site, minimally invasive adenocarcinoma. New terminology was also introduced for subtypes of invasive adenocarcinoma depending on the predominant pattern (eg, lepidic, solid, acinar).92–95 It was also recommended that pathologists review the CT imaging features before making their diagnosis.

I-ELCAP Investigators have shown tumor consistency to be an important diagnostic and prognostic factor of lung cancer survival rates and think that tumor consistency should be included in both the clinical and pathologic staging classification, particularly for lung cancers 30 mm or less in maximum diameter.154,155 A review of PET and CT scans of lung cancer patients showed that the current FDG-PET criteria for mediastinal lymph node metastases have very low sensitivity, suggesting that mediastinal lymph nodes whose short axis is <20 mm be used as the criterion for clinical Stage IA.155 The need for updating the eighth edition has been recognized by the International Association for the Study of Lung Cancer, and it has already started.38

For multiple adenocarcinomas without lymph node (N0) or distant metastases (M0) <30 mm in maximum diameter, I-ELCAP staging remains different from the eighth classification. I-ELCAP classifies such cases as multiple primaries (T1N0M0), as they have the same survival rates as solitary T1N0M0 adenocarcinomas, if resected.91 The eighth edition, however, assigns multiple adenocarcinomas to higher stages depending on their respective lobe locations with chemotherapy recommended rather than surgery.151–153


Breast cancer treatment provides an excellent paradigm of the impact of screening on diagnosis, staging, and treatment of a cancer. Before screening, radical mastectomy with lymph node dissection was the standard-of-care, but, since then, many alternative and less radical treatments have been developed, resulting in better long-term outcomes.156 Concerns about overdiagnosis and overtreatment of certain subtypes of breast cancer were also raised, resulting in updates in diagnostic workup. Many of the discussions and controversies in breast cancer screening in the past have or will also arise for lung cancer screening.

The curative treatment of early lung cancer ultimately determines how beneficial the screening actually is, as illustrated in the ELCAP Design (Fig. 1). Similar to breast cancer screening, lung cancer screening has led to significant updates in staging and to more personalized treatment for lung cancer. LDCT screening has already led to significant changes in the pathologic classification92–95 and in the eighth Staging Classification.151–153 Treatment recommendation of lobar resection of Stage I lung cancers, however, has not changed in >50 years. Screening results stimulated 2 randomized surgical trials comparing lobectomy with sublobar resection, which started in 2007, one in the Japan and the other in the United States.157,158 Both anticipate publishing their final results around 2020, and their interim reports are encouraging, as both have shown extremely low rates of surgical deaths.159,160

New technologies have been introduced, such as robotic surgery, navigational bronchoscopy, and ablation approaches, and, in the future, there will be further innovations. None of these, however, have had critical assessment, and, often, there are only limited data for small lung cancers. Published cohort studies using the I-ELCAP database161–165 have already provided timely outcome results, and Quality of Life measures will become an increasingly important consideration in treatment determination given the high long-term cure rates of screen-diagnosed lung cancer.166–170

In the future there will no doubt be further assessment of new treatments in a timely manner, and the Initiative for Early Lung Cancer Research on Treatment (IELCART)58 was started using the same prospective cohort design used for I-ELCAP. The ELCAP Management System, used for both management and research purposes allowed for the accumulation of over 82,000 participants with clinical data, imaging, and biologic specimens, has been adapted for the multi-institutional, international IELCART database. The system also allows for randomization for future innovative randomized trials. The vision for IELCART is to become as productive as I-ELCAP has been in producing ongoing screening evidence.


Since the earliest days of I-ELCAP, and through each of its conferences24 and evolution of the management system, there has been an appreciation for the power of collaboration and open science.171 This same philosophical underpinning inspired the distribution of the I-ELCAP management system to >82 health care institutions in 10 countries. In 2017, I-ELCAP entered into an all-together new collaboration by partnering with the Veterans Health Administration (VHA). Through a generous grant from the Bristol-Myers Squibb Foundation, I-ELCAP contributed its code and forms to develop the Veterans Affairs Partnership to Increase Access to Lung Screening (VA-PALS) and allowed it to be translated into an open-source version for rapid deployment across VHA networks. Named the VAPALS-ELCAP management system, it adopted input from a multidisciplinary group of VA clinicians and software developers who are familiar with the VHA’s electronic health information management system. It was translated into MUMPS programming language and received the highest level of certification from the Open Source Electronic Health Record Alliance (OSEHRA) in May 2019. It is currently being deployed at the 10 VA medical centers that are a part of the VA-PALS initiative, and it offers a structured and reliable reporting and tracking system, which is currently recommended for VA medical centers that offer broad-based screening services.1,172,173 The VAPALS-ELCAP Management System provides a common terminology for characterization of all NCNs and other LDCT findings, which allows for improved quality assurance of screening, and for pooling of data. As a result, large VA data sets will be developed, which will provide further insights and opportunities for future artificial intelligence (AI) development. The VAPALS-ELCAP system is also freely available for distribution through an Apache v2.0 license, and can be evaluated through an on-line demo:

The ELCAP Management System will also become available as an open-source system. It is currently being used in hospital settings and provides the required Medicare and Medicaid Services (CMS) information on each radiology report and transmission to aCMS-approved registry as well.


In the 20 years since our initial ELCAP report in 1999,8 a vibrant community of LDCT investigators has emerged. The low-cost and efficient ELCAP design provided the fundamental clinically relevant information about the benefit of LDCT screening, which stimulated large national screening trials.28,31,33,34 I-ELCAP is providing the relevant data for consideration of expansion of the screening criteria, particularly to women, never smokers exposed to secondhand smoke, and to people of younger age.174–179

Given all the information and publications that have accumulated over the past 20 years (Tables 3), it was realized that LDCT screening provides a comprehensive “health check” of the lungs, heart, and other organs visualized on the LDCT. This vision is gaining increasing recognition throughout the world. An entire session at the 2019 20th WCLC in Barcelona, Spain, in September 2019, was devoted to these other findings.180 I-ELCAP protocol recommendations for these other findings were developed together with relevant medical specialties, with the recognition that these are findings in asymptomatic screening participants and not in patients presenting to physicians with symptoms. Initial focus was on the cardiac findings 46,47 and emphysema,48,55,57 which together with lung cancer are the 3 big killers of older smokers. This focus has now been expanded to consider the other findings on the LDCT of the chest, and the recommendations are provided in the I-ELCAP protocol.45

TABLE 2 - I-ELCAP Annual Repeat Rounds of Low-dose CT Screening
Before the participant receives the LDCT, ask the participant to cough vigorously. If there is a Solid Endobronchial Nodule, cough again and repeat LDCT immediately. If only recognized later, ask the participant to return for repeat CT in 1 mo and, if still present, see pulmonologist
The result of annual LDCT is:
Negative: Return for next annual screening in 12 mo (IELCAP=1)
 If there are no new noncalcified nodules (NCNs).
Semipositive/indeterminate: Return for next annual screening in 12 mo (IELCAP=2)
 Only new or growing nonsolid nodules, of any size
 Largest new or growing solid NCN <3.0 mm
 Largest solid component of a part-solid NCN<3.0
Semipositive/indeterminate: Return for LDCT follow-up in 6 mo (IELCAP=2)
 Largest new or growing solid NCN 3.0-5.9 mm
 Largest solid component of a new or growing part-solid NCN 3.0-5.9 mm
If 6-month LDCT does NOT show malignant growth: Return for next annual screening in 6 mo
Semipositive/indeterminate: Return for LDCT follow-up in 1 mo (IELCAP=3)
 Largest NCN is solid 6.0-14.9 mm in average diameter Largest NCN is part-solid and the solid component ≥6.0-14.9 mm in average diameter
If 1-mo LDCT:
1. Does NOT show malignant growth: Return for next annual screening in 11 mos
2. Shows malignant growth, the result is positive (see below) (IELCAP=4)
*If possible infection, recommend pulmonology consultation and possible antibiotics
Positive: Biopsy or if less suspicious, PET or 1 mo follow-up LDCT (IELCAP=4)
 Largest solid NCN ≥15.0 mm
If no diagnosis of malignancy after workup, recommend next annual screening (for IELCAP 3) in 6 months and (for IELCAP 4) in 11 months.
Any participant diagnosed with lung cancer in baseline or annual repeat screening and treated for curative intent should continue annual CT screening or more frequently if recommended by the treating physician. For the first 2 years after surgery, however, the American Society of Clinical Oncologists (ASCO) recommends that, for the first 2 years, LDCT screening should be performed at 6-month intervals.

Such a comprehensive “health check” optimal LDCT screening requires a carefully specified, validated regimen that provides for identification and interpretation of critical LDCT findings and the appropriate follow-up recommendations. The regimen should strive to maximize the likelihood of early diagnosis of lung cancer while minimizing unnecessary invasive workup. The importance of having a well-defined regimen was demonstrated by the comparison of I-ELCAP results with those of the NLST, which did not specify a regimen. I-ELCAP’s higher percentage of Stage I diagnoses and long-term survival rates compared with those of the NLST, after consideration of multiple alternative explanations, was due to the I-ELCAP regimen.181 Aside from a well-defined regimen, appropriate radiologic interpretation can minimize unnecessary workup and interventional procedures. It has also been shown that high-quality LDCT screening can be performed in academic or community settings as long as a quality assurance process is in place.182

LDCT radiation doses are currently below the dose of mammographic studies. Ultra LDCT, at radiation doses approaching those of CXR, is now being used for evaluation of chest diseases, including lung cancer and asbestos.183–186 New image analytics and statistical techniques have been developed, with even more innovations on the horizon. Future image interpretation will be increasingly assisted by computer-aided diagnostics,187–197 which already had started in the 1990s.120–125,198–204 Further developments will continue to improve 3-dimensional VDT, which was already introduced in the mid 1990s by ELCAP.119–125

AI techniques in the field of medicine are gaining more interest recently, but it should be recognized that initial efforts had started as early as the 1970s, including by ELCAP Investigators.205–214 Because of enhanced algorithms and computing power, AI is now rapidly expanding and has generated great enthusiasm for streamlining cancer screening to improve early detection and diagnosis of cancer and personalize treatment and outcome prediction.215–221

We are at the beginning of a remarkable transformation in radiologic interpretation that will lead to dramatic improvements in the regimen of screening and facilitate reporting. In making this transformation, it is important to understand the underpinnings of current protocols. Thus, this report focuses on the rationale of the regimen itself, importance of measurement accuracy for timely follow-up and accurate growth assessment of CT-detected NCNs, and the need to limit unnecessary invasive procedures. As already seen in the past 20 years since screening was introduced, understanding of the pathologic findings of small lung cancers has increased, and screening has stimulated advances in the treatment of early lung cancer, which in turn has led to updates in the staging criteria.


The authors express their deepest gratitude to the many physicians, nurses, patient coordinators, academicians, and technical and administrative staff whose dedicated and meticulous work over the past 3 decades has provided the platform on which I-ELCAP research is built. Very, very special thanks to the thousands of screening participants who have allowed the authors to follow their progress over the years so that others could benefit from the information gleaned from their experiences. They greatly appreciate their generosity of spirit. The multidisciplinary team of authors have participated in the development of LDCT screening, its key results, and its latest updates. The team consists of radiologists, pulmonologists, statisticians, and electrical and computer scientists. Key innovators in their respective countries were the following physicians. Dr Shaham, a radiologist, was the first ELCAP screening fellow in 1996, and she participated in the development of the initial protocol updates, set up screening in her country, and has been a key driver in implementation of screening in her country, Israel.53 Dr Zulueta, a pulmonologist, started the first I-ELCAP screening program in 1999 in Pamplona, Spain, and focused on the integration of pulmonary function and emphysema assessment into the screening regimen.48,55,57 This I-ELCAP group published the first report showing that the presence of emphysema on an LDCT in the context of lung cancer screening is independently associated with an increased risk for death from lung cancer and COPD,48 a finding confirmed by several studies thereafter. Dr Aguayo, a pulmonologist at the Phoenix Veterans Affairs Health Care System (VAHCS), was our latest member to join the I-ELCAP team when he introduced the I-ELCAP protocol in 2014 in a clinical trial of smoking cessation with LDCT screening and has provided screening ever since and participated in screening research.146 Subsequently, and leveraging the ongoing collaborative efforts between Phoenix VAHCS and I-ELCAP, Dr Moghanaki organized the Veterans Administration Partnership to Increase Access to Lung Screening (VA-PALS), obtaining funding from the Bristol-Myers-Squibb Foundation,172 and serving as Principal Investigator. The VA-PALS team recognized the importance of having a management system for the entire screening process and the need for continuous quality assurance and their collaboration resulted in the development of an open-source management process and software, called the VAPALS-ELCAP Management System, 173 which is freely available to the world. Dr Aguayo and his team at the Phoenix VAHCS are the alpha test team for the resulting VAPALS-ELCAP Management System, which is launching throughout the VA Health Care System.


1. Henschke CI, Yankelevitz DF, Reeves AP, et al. Evolution of lung cancer screening management. Oncology (Williston Park). 2019;33:629380.
2. Henschke C, Boffetta P, Yankelevitz D, et al. Computed tomography screening: the international early lung cancer action program experience. Thorac Surg Clin. 2015;25:129–143.
3. Henschke CI, Miettinen OS, Yankelevitz DF, et al. Radiographic screening for cancer proposed paradigm for requisite research. Clin Imaging. 1994;18:16–20.
4. Henschke C, Caro J, Libby D, et al. Radiographic screening for lung cancer: proposed paradigm for requisite research. Clin Imaging. 1994;18:16–20.
5. Henschke C, Smith J, Libby D, et al. New Concepts for Lung Cancer Screening: Paradigm For Outcomes Research. Seattle, WA: American Thoracic Society; 1995:21–24.
6. Henschke C, McCauley D, Yankelevitz D, et al. Early Lung Cancer Action Program (ELCAP): baseline results of low-dose screening CT for lung cancer. Radiological Society of North America (RSNA) 84th Scientific Assembly and Annual Meeting. Radiology. 1998;209(suppl):17–872.
7. Henschke C. CT Screening For Lung Cancer. Barcelona, Spain: European Thoracic Society Scientific Session; 1999.
8. Henschke C, McCauley D, Yankelevitz D, et al. Early Lung Cancer Action Project: overall design and findings from baseline screening. Lancet. 1999;354:99–105.
9. Henschke C, McCauley D, Yankelevitz D, et al. Early Lung Cancer Action Program (ELCAP): Annual Repeat Results of Low-Dose Screening CT For Lung Cancer. Chicago, IL: Radiological Society of North American (RSNA) Scientific Session; 1999.
10. Henschke C, Naidich D, Yankelevitz D, et al. Early lung cancer action project: initial findings on repeat screenings. Cancer. 2001;92:153–159.
11. Grady D. CAT scan process could cut deaths from lung cancer. Small tumors detected. New York Times. 1999.
12. Hutchinson G, Shapiro S. Lead time gained by diagnostic screening for breast cancer. J Natl Cancer Inst. 1968;41:665–681.
13. Prorok P, Chamberlain J, Day N, et al. UICC workshop on the evaluation of screening programmes for cancer: Meeting held in Venice, Italy, on November 14–16, 1983. Int J Cancer. 1984;34:1–4.
14. Morrison AS. Screening in Chronic Disease 2nd ed Monographs in Epidemiology and Biostatistics. New York, NY: Oxford University Press. xiv; 1992:254.
15. Henschke CI, Salvatore M, Cham M, et al. Baseline and annual repeat rounds of screening: implications for optimal regimens of screening. Eur Radiol. 2018;28:1085–1094.
16. Reeves A, Kostis W, Yankelevitz D, et al. A Web-based database system for multi-institutional research studies on lung cancer. Radiology. 2001;221:372.
17. NY-ELCAP Investigators. CT Screening for lung cancer: diagnoses resulting from the New York Early Lung Cancer Action Project. Radiology. 2007;243:239–249.
18. International Early Lung Cancer Action Program Investigators, Henschke CI, Yankelevitz DF, Libby DM, et al. Survival of patients with stage I lung cancer detected on CT screening. N Engl J Med. 2006;355:1763–1771.
19. Henschke C, Yankelevitz D, Smith J, et al. ELCAP Group. Screening for lung cancer: the early lung cancer action approach. Lung Cancer. 2002;35:143–148.
20. Field JK, Brambilla C, Caporaso N, et al. Consensus statements from the Second International Lung Cancer Molecular Biomarkers Workshop: a European strategy for developing lung cancer molecular diagnostics in high risk populations. Int J Oncol. 2002;21:369–373.
21. Hirsch FR, Bunn PA Jr, Dmitrovsky E, et al. IV international conference on prevention and early detection of lung cancer, Reykjavik, Iceland, August 9-12, 2001. Lung Cancer. 2002;37:325–344.
22. Shaham D, Goitein O, Yankelevitz D, et al. Screening for lung cancer using low-radiation dose computed tomography. Imaging Decis MRI. 2002;6:4–13.
23. Henschke CI, Yankelevitz DF, McCauley DI, et al. Guidelines for the use of spiral computed tomography in screening for lung cancer. Eur Respir J Suppl. 2003;39:45s–51s.
24. International Early Lung Cancer Action Program Investigators. Program and Consensus statements. International Conferences on Screening for Lung Cancer. Available at: Accessed April 20, 2020.
25. Flehinger BJ, Kimmel M, Melamed MR. The effect of surgical treatment on survival from early lung cancer. Implications for screening. Chest. 1992;101:1013–1018.
26. Flehinger BJ, Kimmel M, Polyak T, et al. Screening for lung cancer. The Mayo Lung Project revisited. Cancer. 1993;72:1573–1580.
27. National Cancer Advisory Board. National Cancer Institute. Spiral Computed Tomography (CT) Scanning for Detection of Lung Cancer. National Cancer Advisory Board 111st Regular Meeting Minutes. September 23–24, 1999. Available at: Accessed April 20, 2020.
28. Aberle D, Adams A, Berg C, et al. Reduced lung-cancer mortality with low-dose computed tomographic screening. N Engl J Med. 2011;365:395–409.
29. van Iersel CA, de Koning HJ, Draisma G, et al. Risk-based selection from the general population in a screening trial: selection criteria, recruitment and power for the Dutch-Belgian randomised lung cancer multi-slice CT screening trial (NELSON). Int J Cancer. 2007;120:868–874.
30. van Klaveren RJ, Oudkerk M, Prokop M, et al. Management of lung nodules detected by volume CT scanning. N Engl J Med. 2009;361:2221–2229.
31. De Koning H, Van der Aalst C, Ten Haaf K, et al. Effects of volume CT lung cancer screening: mortality results of the NELSON randomised-controlled population based trial. J Thorac Oncol. 2018;13:S185–S185.
32. de Koning HJ, van der Aalst CM, de Jong PA, et al. Reduced lung-cancer mortality with volume CT screening in a randomized trial. N Engl J Med. 2020;382:503–513.
33. Pastorino U, Rossi M, Rosato V, et al. Annual or biennial CT screening versus observation in heavy smokers: 5-year results of the MILD trial. Eur J Cancer Prev. 2012;21:308–315.
34. Pastorino U, Silva M, Sestini S, et al. Prolonged lung cancer screening reduced 10-year mortality in the MILD trial: new confirmation of lung cancer screening efficacy. Ann Oncol. 2019;30:1162–1169.
35. Henschke CI, Altorki N, Farooqi A, et al. An update of CT screening for lung cancer. Semin Ultrasound CT MRI. 2005;26:348–356.
36. Henschke CI, Boffetta P, Gorlova O, et al. Assessment of lung-cancer mortality reduction from CT screening. Lung Cancer. 2011;71:328–332.
37. Foy M, Yip R, Chen X, et al. Modeling the mortality reduction due to computed tomography screening for lung cancer. Cancer. 2011;117:2703–2708.
38. International Association for the Study of Lung Cancer (IASLC). IASLC 2019 WCLC World Conference on Lung Cancer Barcelona, Spain, September 7–10, 2019.
39. I-ELCAP Investigators. Screening for lung cancer: individualized benefit by risk indicators for the first round of screening. American Society of Clinical Oncology Scientific Session, 2005.
40. International Early Lung Cancer Action Program Investigators. Computed tomographic screening for lung cancer: individualising the benefit of the screening. Eur Respir J. 2007;30:843–847.
41. Henschke C, Yip R, Yankelevitz D, et al. CT Screening For Lung Cancer: Risk of Dying of Competing Causes of Death. Orlando, FL: American Society of Clinical Oncology Scientific Session; 2005.
42. Yip R, Henschke CI, Yankelevitz D. CT screening for lung cancer: risk of dying of “competing” causes of death. J Clin Oncol. 2005;23:666S–666S.
43. Ostroff J, Buckshee N, Mancuso C, et al. Smoking cessation following CT screening for early detection of lung cancer. Prev Med. 2001;33:613–621.
44. Anderson CM, Yip R, Henschke CI, et al. Smoking cessation and relapse during a lung cancer screening program. Cancer Epidemiol Biomarkers Prev. 2009;18:3476–3483.
45. International Early Lung Cancer Action Program Investigators. International Early Lung Cancer Action Program protocol. Available at: Accessed January 3, 2018.
46. Shemesh J, Henschke CI, Farooqi A, et al. Frequency of coronary artery calcification on low-dose computed tomography screening for lung cancer. Clin Imaging. 2006;30:181–185.
47. Shemesh J, Henschke C, Shaham D, et al. Ordinal scoring of coronary artery calcifications on low-dose CT scans of the chest is predictive of death from cardiovascular disease. Radiology. 2010;257:541–548.
48. Zulueta JJ, Wisnivesky JP, Henschke CI, et al. Emphysema scores predict death from COPD and lung cancer. Chest. 2012;141:1216–1223.
49. Henschke C. Cost analysis of competing strategies in evaluating and treating solitary pulmonary nodules. Radiological Society of North America (RSNA) 82nd Scientific Assembly and Annual Meeting. Radiology. 1996;201(suppl.):1–540.
50. Wisnivesky J, Braz-Parente D, Smith J, et al. Cost effectiveness evaluation of low dose computed tomography screening for non small cell lung cancer. Radiological Society of North America (RSNA) 86th Scientific Assembly and Annual Meeting. Radiology. 2000;217(suppl):101-608; 745–931.
51. Pyenson BS, Henschke CI, Yankelevitz DF, et al. Offering lung cancer screening to high-risk medicare beneficiaries saves lives and is cost-effective: an actuarial analysis. Am Health Drug Benefits. 2014;7:272–282.
52. Pyenson B, Henschke CI, Yankelevitz DF. Population health’s unanimity on lung cancer screening: far ahead of medical advice. Ann Transl Med. 2017;5:2.
53. Shaham D, Breuer R, Copel L, et al. Computed tomography screening for lung cancer: applicability of an international protocol in a single-institution environment. Clin Lung Cancer. 2006;7:262–267.
54. Henschke C, Sone S, Markowitz S, et al. Update on the International Early Lung Cancer Action Program (I-ELCAP). Chicago, IL: Radiological Society of North America Scientific Session; 2006.
55. de Torres JP, Bastarrika G, Wisnivesky JP, et al. Assessing the relationship between lung cancer risk and emphysema detected on low-dose ct of the chest. Chest. 2007;132:1932–1938.
56. Liu XG, Liang MZ, Wang Y, et al. The outcome differences of CT screening for lung cancer pre and post following an algorithm in Zhuhai, China. Lung Cancer. 2011;73:230–236.
57. Sanchez-Salcedo P, Wilson DO, De-Torres JP, et al. Improving selection criteria for lung cancer screening the potential role of emphysema. Am J Respir Crit Care Med. 2015;191:924–931.
58. Flores R, Taioli E, Yankelevitz DF, et al. Initiative for early lung cancer research on treatment: development of study design and pilot implementation. J Thorac Oncol. 2018;13:946–957.
59. Olsen L, Aisner D, McGinnis J. The Learning Healthcare System: Workshop Summary of the Institute of Medicine Roundtable on Evidence-based Medicine. Washington, DC: National Academy Press (US); 2007:4–10.
60. Naidich DP, Marshall CH, Gribbin C, et al. Low-dose CT of the lungs: preliminary observations. Radiology. 1990;175:729–731.
61. Geddes DM. The natural history of lung cancer: a review based on rates of tumour growth. Br J Dis Chest. 1979;73:1–17.
62. Cummings SR, Lillington GA, Richard RJ. Estimating the probability of malignancy in solitary pulmonary nodules. A Bayesian approach. Am Rev Respir Dis. 1986;134:449–452.
63. Lillington GA. Management of solitary pulmonary nodules. Dis Mon. 1991;37:271–318.
64. Gurney J. Determining the likelihood of malignancy in solitary pulmonary nodules with Bayesian analysis. Part I. Theory. Radiology. 1993;186:405–413.
65. Gurney JW, Lyddon DM, McKay JA. Determining the likelihood of malignancy in solitary pulmonary nodules with Bayesian analysis. Part II. Application. Radiology. 1993;186:415–422.
66. Gurney JW, Swensen SJ. Solitary pulmonary nodules: determining the likelihood of malignancy with neural network analysis. Radiology. 1995;196:823–829.
67. Henschke C, Yankelevitz D, Naidich D, et al. CT screening for lung cancer: suspiciousness of nodules according to size on baseline scans. Radiology. 2004;231:164–168.
68. MacMahon H, Austin JH, Gamsu G, et al. Guidelines for management of small pulmonary nodules detected on CT scans: a statement from the Fleischner Society. Radiology. 2005;237:395–400.
69. MacMahon H, Naidich DP, Goo JM, et al. Guidelines for management of incidental pulmonary nodules detected on CT Images: from the Fleischner Society 2017. Radiology. 2017;284:228–243.
70. Henschke C, Yip R, Yankelevitz DF, et al. Definition of a positive test result in computed tomography screening for lung cancer: a cohort study. Ann Intern Med. 2013;158:246–252.
71. Yip R, Henschke CI, Yankelevitz DF, et al. CT screening for lung cancer: alternative definitions of positive test result based on the national lung screening trial and international early lung cancer action program databases. Radiology. 2014;273:591–596.
72. American College of Radiology (ACR). Lung CT screening reporting & data system (Lung-RADS Version 1.0). Available at: Accessed September 11, 2019.
73. Pinsky PF, Gierada DS, Black W, et al. Performance of Lung-RADS in the National Lung Screening Trial: a retrospective assessment. Ann Intern Med. 2015;162:485–491.
74. Wood DE, Kazerooni EA, Baum SL, et al. Lung cancer screening, version 3.2018. J Natl Compr Cancer Net. 2018;16:412–441.
75. Li KW, Yip R, Avila R, et al. The effect of rounding on rate of positive results on CT screening for lung cancer. J Thorac Oncol. 2017;12:S575.
76. American College of Radiology (ACR). Lung-RADS v1.1 Assessment Categories. Available at: / Accessed September 11, 2019.
77. Kaneko M, Eguchi K, Ohmatsu H, et al. Peripheral lung cancer: screening and detection with low-dose spiral CT versus radiography. Radiology. 1996;201:798–802.
78. Noguchi M, Morikawa A, Kawasaki M, et al. Small adenocarcinoma of the lung. Histologic characteristics and prognosis. Cancer. 1995;75:2844–2852.
79. Kuriyama K, Seto M, Kasugai T, et al. Ground-glass opacity on thin-section CT: value in differentiating subtypes of adenocarcinoma of the lung. AJR Am J Roentgenol. 1999;173:465–469.
80. Yang ZG, Sone S, Takashima S, et al. Small peripheral carcinomas of the lung: thin-section CT and pathologic correlation. Eur Radiol. 1999;9:1819–1825.
81. Mirtcheva RM, Vazquez M, Yankelevitz DF, et al. Bronchioloalveolar carcinoma and adenocarcinoma with bronchioloalveolar features presenting as ground-glass opacities on CT. Clin Imaging. 2002;26:95–100.
82. Henschke C, Yankelevitz D, Mirtcheva R, et al. CT screening for lung cancer: frequency and significance of part-solid and nonsolid nodules. AJR Am J Roentgenol. 2002;178:1053–1057.
83. Sone S, Nakayama T, Honda T, et al. Long-term follow-up study of a population-based 1996-1998 mass screening programme for lung cancer using mobile low-dose spiral computed tomography. Lung Cancer. 2007;58:329–341.
84. Vazquez M, Flieder D, Yankelevitz D, et al. Undetected pathologic lesions in lobectomy specimens of CT detected bronchioloalveolar carcinoma (BAC). Mod Pathol. 2001;14:227A.
85. Goitein O, Reeves A, Kostis WJ, et al. Development of a Web-based Radiological-Pathologic Teaching File for Lung Cancer Screening. Chicago, IL: Radiological Society of North America (RSNA) Scientific Session; 2001.
86. Vazquez M, Flieder D, Travis W, et al. Early lung cancer action project pathology protocol. Lung Cancer. 2003;39:231–232.
87. International Early Lung Cancer Action Program Pathology Protocol. Available at: Accessed April 20, 2020.
88. Henschke CI. American Cancer Society Grant 2001-2006. NY-ELCAP Pathology Review.
89. Flieder DB, Vazquez M, Carter D, et al. Pathologic findings of lung tumors diagnosed on baseline CT screening. Am J Surg Pathol. 2006;30:606–613.
90. Carter D, Vazquez M, Flieder DB, et al. Comparison of pathologic findings of baseline and annual repeat cancers diagnosed on CT screening. Lung Cancer. 2007;56:193–199.
91. Vazquez M, Carter D, Brambilla E, et al. Solitary and multiple resected adenocarcinomas after CT screening for lung cancer: histopathologic features and their prognostic implications. Lung Cancer. 2009;64:148–154.
92. Travis W, Brambilla E, Noguchi M, et al. International Association for the Study of Lung Cancer/American Thoracic Society/European Respiratory Society international multidisciplinary classification of lung adenocarcinoma. J Thorac Oncol. 2011;6:244–285.
93. Travis WD, Brambilla E, Noguchi M, et al. International Association for the Study of Lung Cancer/American Thoracic Society/European Respiratory Society: international multidisciplinary classification of lung adenocarcinoma: executive summary. Proc Am Thorac Soc. 2011;8:381–385.
94. Travis W, Brambilla E, Burke A, et al. Introduction to the 2015 World Health Organization classification of tumors of the lung, pleura, thymus and heart. J Thorac Oncol. 2015;10:1240–1242.
95. Travis WD, Asamura H, Bankier AA, et al. The IASLC Lung Cancer Staging Project: Proposals for Coding T Categories for Subsolid Nodules and Assessment of Tumor Size in Part-Solid Tumors in the Forthcoming Eighth Edition of the TNM Classification of Lung Cancer. J Thorac Oncol. 2016;11:1204–1223.
96. Yankelevitz DF, Yip R, Smith JP, et al. CT screening for lung cancer: nonsolid nodules in baseline and annual repeat rounds. Radiology. 2015;277:555–564.
97. Henschke CI, Yip R, Smith JP, et al. CT screening for lung cancer: part-solid nodules in baseline and annual repeat rounds. AJR Am J Roentgenol. 2016;207:1176–1184.
98. Yip R, Yankelevitz DF, Hu M, et al. Lung cancer deaths in the National Lung Screening Trial attributed to nonsolid nodules. Radiology. 2016;281:589–596.
99. Yip R, Henschke CI, Xu DM, et al. Lung cancers manifesting as Part-Solid Nodules in the National Lung Screening Trial. AJR Am J Roentgenol. 2017;208:1011–1021.
100. Yip R, Wolf A, Tam K, et al. Outcomes of lung cancers manifesting as nonsolid nodules. Lung Cancer. 2016;97:35–42.
101. Yip R, Li K, Liu L, et al. Controversies on lung cancers manifesting as part-solid nodules. Eur Radiol. 2018;28:747–759.
102. Libby DM, Smith JP, Altorki NK, et al. Managing the small pulmonary nodule discovered by CT. Chest. 2004;125:1522–1529.
103. Libby DM, Wu N, Lee IJ, et al. CT screening for lung cancer: the value of short-term CT follow-up. Chest. 2006;129:1039–1042.
104. Esserman L, Thompson I, Reid B. Overdiagnosis and overtreatment in cancer: an opportunity for improvement. JAMA. 2013;310:797–798.
105. Patz EF Jr, Pinsky P, Gatsonis C, et al. Overdiagnosis in low-dose computed tomography screening for lung cancer. JAMA Intern Med. 2014;174:269–274.
106. National Lung Screening Trial Research Team. Lung cancer incidence and mortality with extended follow-up in the National Lung Screening Trial. J Thorac Oncol. 2019;14:1732–1742.
107. Miettinen OS. Screening for lung cancer. Radiol Clin North Am. 2000;38:479–486.
108. Miettinen OS, Henschke CI. CT screening for lung cancer: coping with nihilistic recommendations. Radiology. 2001;221:592–596.
109. Miettinen OS, Henschke CI. Commentary on Drs Patz, Black, and Goodman’s viewpoint. Radiology. 2001;221:598–599.
110. Miettinen OS, Henschke CI. Commentary on “CT screening for lung cancer: not ready for routine practice”. Radiology. 2001;221:598–599.
111. Miettinen OS, Henschke CI, Pasmantier MW, et al. Mammographic screening: no reliable supporting evidence? Lancet. 2002;359:404–405.
112. Henschke CI, Wisnivesky JP, Yankelevitz DF, et al. Small stage I cancers of the lung: genuineness and curability. Lung Cancer. 2003;39:327–330.
113. Miettinen OS, Yankelevitz DF, Henschke CI. Evaluation of screening for a cancer: annotated catechism of the Gold Standard creed. J Eval Clin Pract. 2003;9:145–150.
114. Altorki NK, Yankelevitz DF, Vazquez MF, et al. Bronchioloalveolar carcinoma in small pulmonary nodules: clinical relevance. Semin Thorac Cardiovasc Surg. 2005;17:123–127.
115. Henschke CI, Shaham D, Yankelevitz DF, et al. CT screening for lung cancer: significance of diagnoses in its baseline cycle. Clin Imaging. 2006;30:11–15.
116. Miettinen OS, Henschke CI, Smith JP, et al. Is ground glass descriptive of a type of pulmonary nodule? Radiology. 2014;270:311–312.
117. Yankelevitz DF, Chan C, Henschke CI. Overdiagnosis: “A Malformed Concept”. J Thorac Imaging. 2019;34:151–153.
118. Pagano A, Siddique M, Chung M, et al. Volume doubling time of primary lung cancers in interstitial lung disease. Radiological society of North America. Scientific Assembly and Annual Meeting, Chicago IL, December 1-6, 2019. Available at: Accessed May 27, 2020.
119. Yankelevitz DF. Early Repeat CT for Evaluation of Solitary Lung Nodules. R01-CA-78905. 1999, National Insitutes of Health. Available at: Accessed May 27, 2020.
120. Yankelevitz D, Peters E, Zhao B, et al. Can computer aided morphologic analysis of solitary pulmonary nodules predict pathology? Radiological Society of North America (RSNA) 83rd scientific assembly and annual meeting. Radiology. 1997;205(suppl):17–749.
121. Yankelevitz D, Henschke C. Quantitative techniques for evaluating pulmonary nodule morphology. European Congress of Radiology Scientific Session, Vienna, Austria. March 5, 1997.
122. Yankelevitz D, Gupta R, Henschke C. Is early repeat CT feasible for evaluation of pulmonary nodules: first order considerations? Radiological Society of North America (RSNA) 83rd Scientific Assembly and Annual Meeting. Radiology. 1997;205 (suppl):17–749.
123. Reeves A, Zhao B, Yankelevitz D, et al. Characterization of three-dimensional shape and size changes of pulmonary nodules over time from helical CT images. Radiological Society of North America (RSNA) 83rd Scientific Assembly and Annual Meeting. Radiology. 1997;205(suppl):17–749.
124. Yankelevitz D, Zhao B, Gupta R, et al. Early repeat CT for assessment of pulmonary nodules. American Roentgen Ray Scientific Session, April 27, 1998.
125. Yankelevitz D, Henschke C. Determination of malignancy in small pulmonary nodules based on volumetrically determined growth rates. Radiological Society of Noth America (RSNA) 84th Scientific Assembly and Annual Meeting. Radiology. 1998;209(suppl):17–872.
126. Yankelevitz DF, Gupta R, Zhao B, et al. Small pulmonary nodules: evaluation with repeat CT—preliminary experience. Radiology. 1999;212:561–566.
127. Yankelevitz DF, Reeves AP, Kostis WJ, et al. Small pulmonary nodules: volumetrically determined growth rates based on CT evaluation. Radiology. 2000;217:251–256.
128. Kostis W, Reeves A, Yankelevitz D, et al. Three-dimensional segmentation and growth-rate estimation of small pulmonary nodules in helical CT images. IEEE Trans Med Imaging. 2003;22:1259–1274.
129. Kostis W, Yankelevitz D, Reeves A, et al. Small pulmonary nodules: reproducibility of three-dimensional volumetric measurement and estimation of time to follow-up CT. Radiology. 2004;231:446–452.
130. Reeves A, Chan A, Yankelevitz D, et al. On measuring the change in size of pulmonary nodules. IEEE Trans Med Imaging. 2006;25:435–450.
131. Reeves AP, Biancardi AM, Apanasovich TV, et al. The Lung Image Database Consortium (LIDC): a comparison of different size metrics for pulmonary nodule measurements. Acad Radiol. 2007;14:1475–1485.
132. Browder WA, Reeves AP, Apananosovich TV, et al. Automated volumetric segmentation method for growth consistency of nonsolid pulmonary nodules in high-resolution CT. Med Imaging. 2007;6514:65140Y.
133. Henschke CI, Yankelevitz DF, Yip R, et al. Lung cancers diagnosed at annual CT screening: volume doubling times. Radiology. 2012;263:578–583.
134. Siddique M, Yip R, Henschke CI, et al. Lung cancer growth: impact of different assumptions. Presented at the IASLC 2019 WCLC World Conference on Lung Cancer. J Thorac Oncol. 2019;14:S524.
135. Collins VP. Observation on growth rates of human tumors. AJR Am J Roentgenol. 1956;76:988–1000.
136. Garland LH, Coulson W, Wollin E. The rate of growth and apparent duration of untreated primary bronchial carcinoma. Cancer. 1963;16:694–707.
137. Arai T, Kuroishi T, Saito Y, et al. Tumor doubling time and prognosis in lung cancer patients: evaluation from chest films and clinical follow-up study. Japanese Lung Cancer Screening Research Group. Jpn J Clin Oncol. 1994;24:199–204.
138. Barta JA, Henschke CI, Flores RM, et al. Lung cancer diagnosis by fine needle aspiration is associated with reduction in resection of nonmalignant lung nodules. Ann Thorac Surg. 2017;103:1795–1801.
139. Gurney JW. Missed lung cancer at CT: imaging findings in nine patients. Radiology. 1996;199:117–122.
140. Hasegawa M, Sone S, Takashima S, et al. Growth rate of small lung cancers detected on mass CT screening. Br J Radiol. 2000;73:1252–1259.
141. Detterbeck FC, Gibson CJ. Turning gray: the natural history of lung cancer over time. J Thorac Oncol. 2008;3:781–792.
142. Zhang L, Yankelevitz DF, Henschke CI, et al. Zone of transition: a potential source of error in tumor volume estimation. Radiology. 2010;256:633–639.
143. Henschke C, Yankelevitz D, Yip R, et al. Tumor volume measurement error using computed tomography (CT) imaging in a Phase II clinical trial in lung cancer. J Med Imaging. 2016;3:035505.
144. Quantitative Imaging Biomarkers Alliance (QIBA). QIBA profile: small lung nodule volume assessment and monitoring in low dose CT screening. Available at: Accessed September 4, 2019.
145. Radiological Society of North America Quantitative Imaging Biomarkers Alliance (QIBA) Nodule Profile Calculator. Available at: Accessed September 4, 2019.
146. Henschke CI, Yip R, Ma T, et al. CT screening for lung cancer: comparison of three baseline screening protocols. Eur Radiol. 2019;29:5217–5226.
147. Oudkerk M, Devaraj A, Vliegenthart R, et al. European position statement on lung cancer screening. Lancet Oncol. 2017;18:E754–E766.
148. Greene FL. American Joint Committee on Cancer and American Cancer Society, AJCC Cancer Staging Manual, 6th ed. New York, NY: Springer-Verlag. xiv; 2002:421.
149. Henschke CI, Yankelevitz DF, Shaham D, et al. Cancer staging with TNM: can we do better? Radiological Society of North America (RSNA) 83rd Scientific Assembly and Annual Meeting. Radiology. 1997;205(suppl):17–749.
150. I-ELCAP Investigators. CT screening for lung cancer: resulting challenges in staging in I-ELCAP. Radiological Society of North America (RSNA) Scientific Session. Chicago, IL, November 29, 2005.
151. Rami-Porta R, Bolejack V, Crowley J, et al. The IASLC Lung Cancer Staging Project: proposals for the revisions of the T descriptors in the forthcoming eighth edition of the TNM classification for lung cancer. J Thorac Oncol. 2015;10:990–1003.
152. Goldstraw P, Chansky K, Crowley J, et al. The IASLC lung cancer staging project: proposals for revision of the TNM stage groupings in the forthcoming (eighth) edition of the TNM classification for lung cancer. J Thorac Oncol. 2016;11:39–51.
153. Detterbeck FC, Boffa DJ, Kim AW, et al. The Eighth edition lung cancer stage classification. Chest. 2017;151:193–203.
154. Yip R, Ma T, Flores RM, et al. International Early Lung Cancer Action Program Investigators. Survival with parenchymal and pleural invasion of non-small cell lung cancers less than 30 mm. J Thorac Oncol. 2019;14:890–902.
155. Wang Y, Zhu Y, Yip R, et al. Pre-surgical assessment of mediastinal lymph node metastases in Stage IA non-small-cell lung cancers. Clin Imaging. 2020. In press.
156. DeVita V, Lawrence T, Rosenberg S. DeVita, Hellman, and Rosenberg’s Cancer: Principles and Practice of Oncology, 10th ed. Philadelphia, PA: Lippincott Williams & Wilkins.
157. Nakamura K, Saji H, Nakajima R, et al. A phase III randomized tiral of lobectomy versus limited resection for small-sized peripheral non-small cell lung cancer (JCOG0802/WJOG4607L). Jpn J Clin Oncol. 2010;40:271–274.
158. CALGB 140503: a phase III randomized trial of lobectomy versus sublobar resection for small (≤2cm) peripheral non-small cell lung cancer (NCT00499330). Available at: Accessed April 20, 2020.
159. Suzuki K, Saji H, Aokage K, et al. Comparison of pulmonary segmentectomy and lobectomy: safety results of a randomized trial. J Thorac Cardiovasc Surg. 2019;158:895–907.
160. Altorki NK, Wigle D, Wang X, et al. Mortality and Morbidity of Lobar versus Sub-lobar Resection in CALGB 140503 (ALLIANCE). American Association for Thoacic Surgery (AATS) 98th Annual Meeting San Diego, CA 2018.
161. Altorki NK, Yip R, Hanaoka T, et al. Sub-lobar resection is equivalent to lobectomy for clinical Stage IA lung cancer: an analysis of I-ELCAP resected cancers. American Association of Thoracic Surgeons Scientific Abstract, May 2013. Available at: Accessed May 27, 2020.
162. Flores R, Bauer T, Aye R, et al. Balancing curability and unnecessary surgery in the context of computed tomography screening for lung cancer. J Thorac Cardiovasc Surg. 2014;147:1619–1626.
163. Buckstein M, Yip R, Yankelevitz D, et al. International Early Lung Cancer Action Program Investigators. Radiation therapy for stage I lung cancer detected on computed tomography screening: results from the international early lung cancer action program. J Radiat Oncol. 2014;3:153–157.
164. Flores R, Nicastri D, Bauer T, et al. The role of surgical mediastinal resection in CT screen-detected lung cancer patients. J Thorac Oncol. 2015;10:S242–S243.
165. Berlin E, Buckstein M, Yip R, et al. Radiation therapy for stage I lung cancer detected on computed tomography screening: results from the international early lung cancer action program. Int J Radiat Oncol Biol Phys. 2018;101:E35–E35.
166. Schwartz RM, Yip R, Olkin I, et al. Impact of surgery for stage IA non-small-cell lung cancer on patient quality of life. J Commun Support Oncol. 2016;14:37–44.
167. Schwartz RM, Yip R, Flores RM, et al. The impact of resection method and patient factors on quality of life among stage IA non-small cell lung cancer surgical patients. J Surg Oncol. 2017;115:173–180.
168. Schwartz RM, Gorbenko K, Kerath SM, et al. Thoracic surgeon and patient focus groups on decision-making in early-stage lung cancer surgery. Future Oncol. 2018;14:151–163.
169. Yip R, Taioli E, Schwartz R, et al. A review of quality of life measures used in surgical outcomes for stage I lung cancers. Cancer Invest. 2018;36:296–308.
170. Schwartz RM, Alpert N, Rosenzweig K, et al. Changes in quality of life after surgery or radiotherapy in early-stage lung cancer. J Thorac Dis. 2019;11:154–161.
171. National Academies of Sciences Engineering and Medicine. Open Science by Design: Realizing a Vision For 21st Century Research. Washington, DC: National Academies Press; 2018.
172. Bristol-Meyers Squibb Foundation. Serving Those Who Served: Bristol-Myers Squibb Foundation has teamed up with the U.S. Department of Veterans Affairs to help improve lung cancer survival rates for veterans. 2017. Available at: Accessed September 4, 2019.
173. Henschke C. An Open Source Lung Screening Management System. Presented at the IASLC 2019 WCLC World Conference on Lung Cancer (vol 14). 2019:S220–S221.
174. Henschke CI, Miettinen OS. Women’s susceptibility to tobacco carcinogens. Lung Cancer. 2004;43:1–5.
175. International Early Lung Cancer Action Program Investigator, Henschke CI, Yip R, Miettinen OS. Women’s susceptibility to tobacco carcinogens and survival after diagnosis of lung cancer. JAMA. 2006;296:180–184.
176. Yankelevitz DF, Henschke CI, Yip R, et al. Second-hand tobacco smoke in never smokers is a significant risk factor for coronary artery calcification. JACC Cardiovasc Imaging. 2013;6:651–657.
177. Henschke CI, Yip R, Boffetta P, et al. CT screening for lung cancer: importance of emphysema for never smokers and smokers. Lung Cancer. 2015;88:42–47.
178. Yip R, Fevrier E, Wolf A, et al. I-ElCAP Investigators. Lung cancer: susceptibility and survival differences for women and men. Presented at the IASLC 2019 WCLC World Conference on Lung Cancer. Journal of Thoracic Oncol. 2019;14:S527.
179. Henschke CI, Yip R, Yankelevitz DF. FAMRI-IELCAP Investigators. CT screening of never smokers. Presented at the IASLC 2019 WCLC World Conference on Lung Cancer. J Thorac Oncol. 2019;14:S794–S795.
180. International Association for the Study of Lung Cancer. Mini Symposium on “Lung Cancer Screening, Opportunistic Evaluation of Findings”. IASLC 2019 WCLC World Conference on Lung Cancer Barcelona, Spain, September 9, 2019.
181. International Early Lung Cancer Investigators, Yip R, Henschke CI, Yankelevitz DF, et al. The impact of the regimen of screening on lung cancer cure: a comparison of I-ELCAP and NLST. Eur J Cancer Prev. 2015;24:201–208.
182. Xu DM, Lee IJ, Zhao SJ, et al. CT Screening for lung cancer: value of expert review of initial baseline screenings. AJR Am J Roentgenol. 2015;204:281–286.
183. Hanna WC, Paul NS, Darling GE, et al. Minimal-dose computed tomography is superior to chest x-ray for the follow-up and treatment of patients with resected lung cancer. J Thorac Cardiovasc Surg. 2014;147:30–35.
184. Schaal M, Severac F, Labani A, et al. Diagnostic performance of ultra-low-dose computed tomography for detecting asbestos-related pleuropulmonary diseases: prospective study in a screening setting. PLoS One. 2016;11:13.
185. van den Berk IA, Kanglie MM, van Engelen TS, et al. OPTimal IMAging strategy in patients suspected of non-traumatic pulmonary disease at the emergency department: chest X-ray or ultra-low-dose CT (OPTIMACT)—a randomised controlled trial chest X-ray or ultra-low-dose CT at the ED: design and rationale. Diagn Progn Res. 2018;2:20.
186. Kroft LJ, van der Velden L, Girón IH, et al. Added value of ultra–low-dose computed tomography, dose equivalent to chest x-ray radiography, for diagnosing chest pathology. J Thorac Imaging. 2019;34:179–186.
187. Xie Y, Liang M, Yankelevitz DF, et al. Automated segmentation of cardiac visceral fat in low-dose non-contrast chest CT images. Med Imaging. 2015;9414:94140G.
188. Xie Y, Liang M, Yankelevitz DF, et al. Automated measurement of pulmonary artery in low-dose non-contrast chest CT images. Med Imaging. 2015;9414:94141G.
189. Chun GB, Jirapatnakul AC, Reeves AP, et al. Quantitative analytics for emphysema in lung cancer screening CT scans. Am J Respir Crit Care Med. 2015;191:A4476.
190. Liu S, Xie Y, Reeves AP. Segmentation of the sternum from low-dose chest CT images. Med Imaging. 2015;9414:941403.
191. Reeves AP, Xie YT, Jirapatnakul A. Automated pulmonary nodule CT image characterization in lung cancer screening. Int J Comput Ass Rad Surg. 2016;11:73–88.
192. Liu S, Xie Y, Reeves AP. Automated 3D closed surface segmentation: application to vertebral body segmentation in CT images. Int J Comput Ass Rad Surg. 2016;11:789–801.
193. Reeves AP, Xie Y, Liu S. Large-scale image region documentation for fully automated image biomarker algorithm development and evaluation. J Med Imaging. 2017;4:024505.
194. Xie Y, Salvatore M, Liu S, et al. Identification of early-stage usual interstitial pneumonia from low-dose chest CT scans using fractional high-density lung distribution. Med Imaging. 2017;10134:1013408.
195. Xie Y, Liu S, Miller A, et al. Coronary artery calcification identification and labeling in low-dose chest CT images. Med Imaging. 2017;10134:1057524.
196. Liu S, Sonnenblick EB, Azour L, et al. Fully automated gynecomastia quantification from low-dose chest CT. Med Imaging. 2018;10575:1057524.
197. Liu S, Gonzalez J, Zulueta J, et al. Fully Automated Bone Mineral Density Assessment from Low-dose Chest CT. Med Imaging. 2018;10575:105750M.
198. Reeves A, Kostis W, Zhao B, et al. Three-dimensional feature characterization of small pulmonary nodules. Radiological Society of North America (RSNA) 85th annual meeting. Scientific session. Radiology. 1999;213(suppl):101–491.
199. Reeves A, Kostis W, Yankelevitz D, et al. Three-dimensional shape characterization of solitary pulmonary nodules from helical CT scans. CARS ‘99: Computer Assisted Radiology and Surgery: Proceedings of the 13th International Congress and Exhibition. Scientific Session (Vol. 1191), Paris, France. Excerpta Medica. June 23-26, 1999.
200. Reeves A, Kostis W, Yankelevitz D, et al. Analysis of small pulmonary nodules without explicit segmentation of CT images. Radiological Society of North America (RSNA) 86th annual meeting. Scientific session. Radiology. 2000;217 (suppl):101–608; 745–931.
201. Kostis W, Reeves A, Yankelevitz D, et al. Three dimensional Curvature Analysis of Small Pulmonary Nodules in Helical CT Scans. Radiological Society of North America (RSNA) 86th annual meeting. Scientific session. Radiology. 2000;217(suppl):101–608; 745–931.
202. Reeves A, Kostis W, Yankelevitz D, et al. Three-dimensional analysis of ground glass opacities from helical CT scans. Radiological Society of North America (RSNA) 86th annual meeting. Radiology. 2000;217(suppl):384–384.
203. Asmamaw A, Reeves A, Stein B, et al. Automated detection of pulmonary nodules from low dose helical CT scans: work in progress. Radiological Society of North America (RSNA) 88th Annual Meeting. Radiology. 2002;225(suppl):477–477.
204. Enquobahrie AA, Reeves AP, Yankelevitz DF, et al. Automated detection of small pulmonary nodules in whole lung CT scans. Acad Radiol. 2007;14:579–593.
205. Schwartz WB. Medicine and the computer. The promise and problems of change. N Engl J Med. 1970;283:1257–1264.
206. Szolovits P, Patil RS, Schwartz WB. Artificial intelligence in medical diagnosis. Ann Intern Med. 1988;108:80–87.
207. Wu Y, Giger ML, Doi K, et al. Artificial neural networks in mammography: application to decision making in the diagnosis of breast cancer. Radiology. 1993;187:81–87.
208. Rainey T, Brettle D, Weingard F, et al. Analysis of pulmonary nodules. The CADx Workshop Washington, DC, 1994.
209. Rainey T, Brettle D, Weingard F, et al. Analysis of pulmonary nodules. 23rd Annual AIPR Workshop Washington, DC, 1994.
210. Giger ML, Bae KT, MacMahon H. Computerized detection of pulmonary nodules in computed tomography images. Invest Radiol. 1994;29:459–465.
211. Henschke C, Yankelevitz D, Matseescu I, et al. Neural Networks for the Analysis of Small Pulmonary Nodules. San Diego, CA: American Roentgen Ray Society Scientific Session; 1996.
212. Henschke CI, Yankelevitz DF, Mateescu I, et al. Neural networks for the analysis of small pulmonary nodules. Clin Imaging. 1997;21:390–399.
213. Fuhrman J, Yip R, Henschke C, et al. Cascade of U-Nets in the detection and classification of coronary artery calcium in thoracic low-dose CT. SPIE: Medical Imaging. Houston, TX, February, 2020.
214. Agasthya G, Yip R, Jirapatnakul A, et al. Prediction of Baseline Lung Cancer From Structured, Imbalanced Dataset. Boston, MA: AI and Big Data in Cancer: From Innovation to Impact; 2020:29–31.
215. Liu S, Xie Y, Jirapatnakul A, et al. Pulmonary nodule classification in lung cancer screening with three-dimensional convolutional neural networks. J Med Imaging (Bellingham). 2017;4:041308.
216. Lee JH, Jirapatnakul AC, Yip R, et al. Using deep learning to predict emphysema in early lung cancer screening low-dose CT scan. 104th Scientific Assembly and Annual Meeting, Radiological Society of North America 2018 Chicago, IL, 2018.
217. Fuhrman JD, Crosby J, Yip R, et al. Detection and classification of coronary artery calcifications in low dose thoracic CT using deep learning. Med Imaging. 2019;10950:1095039.
218. Patel D, Tibrewala R, Vega A, et al. Circumventing the solution of inverse problems in mechanics through deep learning: Application to elasticity imaging. Comput Methods Appl Mech Eng. 2019;353:448–466.
219. Kann BH, Thompson R, Thomas CR Jr, et al. Artificial intelligence in oncology: current applications and future directions. Oncology. 2019;33:46–53.
220. Goldenberg SL, Nir G, Salcudean SE. A new era: artificial intelligence and machine learning in prostate cancer. Nat Rev Urol. 2019;16:391–403.
221. Bi WL, Hosny A, Schabath MB, et al. Artificial intelligence in cancer imaging: clinical challenges and applications. CA Cancer J Clin. 2019;69:127–157.

pulmonary nodules; screening; growth; nodule management; nodule measurement accuracy; subsolid nodules

Copyright © 2020 The Author(s). Published by Wolters Kluwer Health, Inc.