Objective: Our institution, like many, is struggling to develop measures that answer the question, How do we know we are safer? Our objectives are to present a framework to evaluate performance in patient safety and describe how we applied this model in intensive care units.
Design: We focus on measures of safety rather than broader measures of quality. The measures will allow health care organizations to evaluate whether they are safer now than in the past by answering the following questions: How often do we harm patients? How often do patients receive the appropriate interventions? How do we know we learned from defects? How well have we created a culture of safety? The first two measures are rate based, whereas the latter two are qualitative. To improve care within institutions, caregivers must be engaged, must participate in the selection and development of measures, and must receive feedback regarding their performance. The following attributes should be considered when evaluating potential safety measures: Measures must be important to the organization, must be valid (represent what they intend to measure), must be reliable (produce similar results when used repeatedly), must be feasible (affordable to collect data), must be usable for the people expected to employ the data to improve safety, and must have universal applicability within the entire institution.
Setting: Health care institutions.
Results: Health care currently lacks a robust safety score card. We developed four aggregate measures of patient safety and present how we applied them to intensive care units in an academic medical center. The same measures are being applied to nearly 200 intensive care units as part of ongoing collaborative projects. The measures include how often do we harm patients, how often do we do what we should (i.e., use evidence-based medicine), how do we know we learned from mistakes, and how well do we improve culture. Measures collected by different departments can then be aggregated to provide a hospital level safety score card.
Conclusion: The science of measuring patient safety is immature. This article is a starting point for developing feasible and scientifically sound approaches to measure safety within an institution. Institutions will need to find a balance between measures that are scientifically sound, affordable, usable, and easily applied across the institution.