Secondary Logo

Journal Logo

Institutional members access full text with Ovid®

Severity Scores in Emergency Department Patients With Presumed Infection

A Prospective Validation Study*

Williams, Julian M. MBBS, FACEM; Greenslade, Jaimi H. PhD; Chu, Kevin MS, FACEM; Brown, Anthony F. T. MBChB, FACEM; Lipman, Jeffrey MD, FCICM

doi: 10.1097/CCM.0000000000001427
Clinical Investigations
Buy
SDC

Objectives: The objectives of this study were to 1) validate a number of severity of illness scores in a large cohort of emergency department patients admitted with presumed infection and 2) compare the performance of scores in patient subgroups with increasing mortality: infection without systemic inflammatory response syndrome, sepsis, severe sepsis, and septic shock.

Design: Prospective, observational study.

Setting: Adult emergency department in a metropolitan tertiary, university-affiliated hospital.

Patients: Emergency department patients admitted with presumed infection.

Interventions: None.

Methods: Consecutive emergency department patients admitted with presumed infection were identified over 160 weeks in two periods between 2007 and 2011. Clinical and laboratory data sufficient to calculate Mortality in Emergency Department Sepsis score, Acute Physiology and Chronic Health Evaluation II, Simplified Acute Physiology Score II, Sequential Organ Failure Assessment, and the Severe Sepsis Score were entered into a database. Model discrimination was quantified using area under the receiver operating curve. Calibration was assessed using visual plots, Hosmer-Lemeshow statistics, and linear regressions of observed and predicted values.

Measurements and Main Results: A total of 8,871 patients were enrolled with 30-day mortality of 3.7%. Area under the receiver operating curve values for the entire cohort were: Mortality in Emergency Department Sepsis score of 0.92, Simplified Acute Physiology Score II and Acute Physiology and Chronic Health Evaluation II scores of 0.90, Sequential Organ Failure Assessment score of 0.86, and Severe Sepsis Score of 0.82. Discrimination decreased in subgroups with greater mortality for each score. All scores overestimated mortality, but closest concordance between predicted and observed mortality was seen with Mortality in Emergency Department Sepsis score.

Conclusions: The decrease in area under the receiver operating curve seen in subgroups with increasing mortality may explain some variation in results seen in previous validation studies. Scores developed in intensive care settings overestimated mortality in the emergency department. Our results underscore the importance of employing predictive models developed in similar patient populations. The Mortality in Emergency Department Sepsis score outperformed more complex predictive models and would be the most appropriate scoring system for use in similar emergency department populations with a wide spectrum of mortality risk.

1Department of Emergency Medicine, Royal Brisbane and Women’s Hospital, Herston, QLD, Australia.

2School of Medicine, University of Queensland, Brisbane, QLD, Australia.

3School of Public Health, Queensland University of Technology, Brisbane, QLD, Australia.

*See also p. 639.

This study was conducted at the Royal Brisbane and Women’s Hospital, Brisbane, QLD, Australia.

Supplemental digital content is available for this article. Direct URL citations appear in the printed text and are provided in the HTML and PDF versions of this article on the journal’s website (http://journals.lww.com/ccmjournal).

Supported, in part, by the Queensland Emergency Medicine Research Foundation.

Drs. Williams, Greenslade, and Chu received support for this article research from Queensland Emergency Medicine Research Foundation. Their institutions received grant support from Queensland Emergency Medicine Research Foundation (Peer-reviewed, competitive research grant). Drs. Williams and Chu are employed by Queensland Health. Dr. Lipman’s institution served as a board member for Bayer ESICM Advisory Board; consulted for and received grant support from AstraZeneca; and lectured for AstraZeneca and Bayer. Dr. Brown disclosed that he does not have any potential conflicts of interest.

For information regarding this article, E-mail: Julian.williams@health.qld.gov.au

Copyright © by 2016 by the Society of Critical Care Medicine and Wolters Kluwer Health, Inc. All Rights Reserved.