Medical Care

Skip Navigation LinksHome > February 2016 - Volume 54 - Issue 2 > Validation of Case Finding Algorithms for Hepatocellular Can...
Text sizing:
Medical Care:
doi: 10.1097/MLR.0b013e3182a30373
Applied Methods

Validation of Case Finding Algorithms for Hepatocellular Cancer From Administrative Data and Electronic Health Records Using Natural Language Processing

Sada, Yvonne MD, MPH*,†,‡; Hou, Jason MD*,†,§; Richardson, Peter PhD*,†; El-Serag, Hashem MD, MPH*,†,§; Davila, Jessica PhD*,†

Collapse Box


Background: Accurate identification of hepatocellular cancer (HCC) cases from automated data is needed for efficient and valid quality improvement initiatives and research. We validated HCC International Classification of Diseases, 9th Revision (ICD-9) codes, and evaluated whether natural language processing by the Automated Retrieval Console (ARC) for document classification improves HCC identification.

Methods: We identified a cohort of patients with ICD-9 codes for HCC during 2005–2010 from Veterans Affairs administrative data. Pathology and radiology reports were reviewed to confirm HCC. The positive predictive value (PPV), sensitivity, and specificity of ICD-9 codes were calculated. A split validation study of pathology and radiology reports was performed to develop and validate ARC algorithms. Reports were manually classified as diagnostic of HCC or not. ARC generated document classification algorithms using the Clinical Text Analysis and Knowledge Extraction System. ARC performance was compared with manual classification. PPV, sensitivity, and specificity of ARC were calculated.

Results: A total of 1138 patients with HCC were identified by ICD-9 codes. On the basis of manual review, 773 had HCC. The HCC ICD-9 code algorithm had a PPV of 0.67, sensitivity of 0.95, and specificity of 0.93. For a random subset of 619 patients, we identified 471 pathology reports for 323 patients and 943 radiology reports for 557 patients. The pathology ARC algorithm had PPV of 0.96, sensitivity of 0.96, and specificity of 0.97. The radiology ARC algorithm had PPV of 0.75, sensitivity of 0.94, and specificity of 0.68.

Conclusions: A combined approach of ICD-9 codes and natural language processing of pathology and radiology reports improves HCC case identification in automated data.

Copyright © 2016 Wolters Kluwer Health, Inc. All rights reserved.


Article Tools


Article Level Metrics

Search for Similar Articles
You may search for similar articles that contain these same keywords or you may modify the keyword list to augment your search.