Annals of Surgery

Skip Navigation LinksHome > December 2012 - Volume 256 - Issue 6 > A Comparison of Clinical Registry Versus Administrative Clai...
Annals of Surgery:
doi: 10.1097/SLA.0b013e31826b4c4f
Original Articles

A Comparison of Clinical Registry Versus Administrative Claims Data for Reporting of 30-Day Surgical Complications

Lawson, Elise H. MD, MSHS*; Louie, Rachel MS*; Zingmond, David S. MD, PhD*; Brook, Robert H. MD, ScD*,†,‡; Hall, Bruce L. MD, PhD, MBA§,‖; Han, Lein PhD; Rapp, Michael MD, JD¶,#; Ko, Clifford Y. MD, MSHS*,§,**

Collapse Box


Objectives: To compare the recording of 30-day postoperative complications between a national clinical registry and Medicare inpatient claims data and to determine whether the addition of outpatient claims data improves concordance with the clinical registry.

Background: Policymakers are increasingly discussing use of postoperative complication rates for value-based purchasing. There is debate regarding the optimal data source for such measures.

Methods: Patient records (2005–2008) from the American College of Surgeons National Surgical Quality Improvement Program (ACS-NSQIP) were linked to Medicare inpatient and outpatient claims data sets. We assessed the ability of (1) Medicare inpatient claims and (2) Medicare inpatient and outpatient claims to detect a core set of ACS-NSQIP 30-day postoperative complications: superficial surgical site infection (SSI), deep/organ-space SSI, any SSI (superficial and/or deep/organ-space), urinary tract infection, pneumonia, sepsis, deep venous thrombosis (DVT), pulmonary embolism, venous thromboembolism (DVT and/or pulmonary embolism), and myocardial infarction. Agreement of patient-level complications by ACS-NSQIP versus Medicare was assessed by κ statistics.

Results: A total of 117,752 patients from more than 200 hospitals were studied. The sensitivity of inpatient claims data for detecting ACS-NSQIP complications ranged from 0.27 to 0.78; the percentage of false-positives ranged from 48% to 84%. Addition of outpatient claims data improved sensitivity slightly but also greatly increased the percentage of false-positives. Agreement was routinely poor between clinical and claims data for patient-level complications.

Conclusions: This analysis demonstrates important differences between ACS-NSQIP and Medicare claims data sets for measuring surgical complications. Poor accuracy potentially makes claims data suboptimal for evaluating surgical complications. These findings have meaningful implications for performance measures currently being considered.

© 2012 Lippincott Williams & Wilkins, Inc.


Article Tools


Article Level Metrics

Search for Similar Articles
You may search for similar articles that contain these same keywords or you may modify the keyword list to augment your search.