Annals of Surgery

Skip Navigation LinksHome > May 2014 - Volume 259 - Issue 5 > Ranking and Rankability of Hospital Postoperative Mortality...
Annals of Surgery:
doi: 10.1097/SLA.0000000000000561

Ranking and Rankability of Hospital Postoperative Mortality Rates in Colorectal Cancer Surgery

Henneman, Daniel MD*; van Bommel, Annelotte C. M. MD*; Snijders, Alexander MSc; Snijders, Heleen S. MD*; Tollenaar, Rob A. E. M. MD, PhD*; Wouters, Michel W. J. M. MD, PhD; Fiocco, Marta PhD§

Supplemental Author Material
Collapse Box


Objectives: To examine to what extent random variation and variation in case-mix influence hospital rankings on the basis of mortality rates and to determine the suitability of mortality for ranking hospitals in colorectal surgery.

Background: Comparing and ranking postoperative mortality rates between hospitals becomes increasingly popular. Differences in hospital case-mix, and chance variation related to caseload, may influence rankings. The suitability of mortality for rankings remains unclear.

Methods: Data were derived from the Dutch Surgical Colorectal Audit. Hospital rankings based on fixed- and random-effects logistic regression models, unadjusted and adjusted for case-mix were compared with the percentile based on expected ranks (the chance that a hospital performs better than a random hospital). Rankability, measuring which part of variation between hospitals is not due to chance, was calculated.

Results: Some 25,591 patients undergoing colorectal resections in 92 hospitals were evaluated. Postoperative mortality rates ranged between 0% and 8.8%. Adjustment for case-mix with a fixed-effects model caused large changes in rankings. A smaller additional effect on changes in rankings occurred after adjusting with a random-effects model, with lower volume hospitals moving toward the mean. Percentile based on expected ranks ranged between 10% and 85%. Rankability was 38%, meaning that 62% of hospital variation in mortality was due to chance.

Conclusions: Hospital ranks changed after case-mix adjustment and random-effects models, compared with unadjusted analysis. A large proportion of hospital variation in mortality was due to chance. Caution should be warranted when interpreting hospital rankings on the basis of postoperative mortality. Percentiles of expected ranks may help identify hospitals with exceptional performance.

© 2014 by Lippincott Williams & Wilkins.


Article Tools


Article Level Metrics

Search for Similar Articles
You may search for similar articles that contain these same keywords or you may modify the keyword list to augment your search.