Secondary Logo

Journal Logo

Institutional members access full text with Ovid®

Retooling of Paper-based Outcome Measures to Electronic Format

Comparison of the NY State Public Risk Model and EHR-derived Risk Models for CABG Mortality

Hannan, Edward L., PhD, MS*; Barrett, Stacey C., MA; Samadashvili, Zaza, MD; Schmaltz, Stephen P., PhD§

doi: 10.1097/MLR.0000000000001104
Original Articles
Buy
SDC

Background: Risk adjustment is critical in the comparison of quality of care and health care outcomes for providers. Electronic health records (EHRs) have the potential to eliminate the need for costly and time-consuming manual data abstraction of patient outcomes and risk factors necessary for risk adjustment.

Methods: Leading EHR vendors and hospital focus groups were asked to review risk factors in the New York State (NYS) coronary artery bypass graft (CABG) surgery statistical models for mortality and readmission and assess feasibility of EHR data capture. Risk models based only on registry data elements that can be captured by EHRs (one for easily obtained data and one for data obtained with more difficulty) were developed and compared with the NYS models for different years.

Results: Only 6 data elements could be extracted from the EHR, and outlier hospitals differed substantially for readmission but not for mortality. At the patient level, measures of fit and predictive ability indicated that the EHR models are inferior to the NYS CABG surgery risk model [eg, c-statistics of 0.76 vs. 0.71 (P<0.001) and 0.76 vs. 0.74 (P=0.009) for mortality in 2010], although the correlation of the predicted probabilities between the NYS and EHR models was high, ranging from 0.96 to 0.98.

Conclusions: A simplified risk model using EHR data elements could not capture most of the risk factors in the NYS CABG surgery risk models, many outlier hospitals were different for readmissions, and patient-level measures of fit were inferior.

*Research Emeritus, School of Public Health, State University of New York, University at Albany, One University Place, Rensselaer, NY

Department of Health Services Research, The Joint Commission, Oakbrook Terrace, IL

State University of New York, University at Albany, One University Place, Rensselaer, NY

§Department of Quality Measurement, The Joint Commission, Oakbrook Terrace, IL

This project was funded by The Agency for Healthcare Research and Quality (AHRQ), Grant Number 5R18 HS022647-02.

The authors declare no conflict of interest.

Reprints: Edward L. Hannan, PhD, MS, Research Emeritus, School of Public Health, State University of New York, University at Albany, One University Place, Rensselaer, NY 12144-3456. E-mail: edward.hannan@health.ny.gov.

Copyright © 2019 Wolters Kluwer Health, Inc. All rights reserved.