ECMO risk prediction has three key goals. It should allow clinicians to prospectively stratify the outcome risk for ECMO candidate patients. It should also permit facilities and clinicians to retrospectively understand their risk-adjusted ECMO performance across all their patients. Finally, it should allow facilities and clinicians who wish to start an ECMO program to estimate future clinical performance from such a program.
Across these three objectives, the different indications for ECMO, modalities, and characteristics of the infrastructure and practice patterns all matter. Accordingly, the ideal model would be customized along those dimensions, be constructed in large datasets and successfully validated in external datasets.
To understand the extent that practical reality matches this ideal, we searched PubMed for all studies with all keywords “ECMO,” “risk,” “predict” published since January 1, 2010 through September 2, 2016. Of 48 studies meeting these inclusion criteria, 11 were focused on producing a risk model for adult populations.
Our analysis (Table 1) suggests several different conclusions. Some studies on the left side of the table are obviously not feasible for medical reasons such as veno-venous configuration in patients with cardiac function compromise. In other scenarios, it may not be sufficient to provide indirect cardiac support with veno-venous ECMO for some types of respiratory function compromise. Similarly, in cardiac arrest with aspiration pneumonia, a hybrid configuration with veno-arterial-venous configuration may be useful. Finally, in some patients with a purely respiratory support indication and with major double venous cannulation issues such as thrombosis or prior cannulation, but without indications for cannulation with bicaval dual lumen catheter, veno-arterial ECMO has been reported.
However, in much of the white space, our field has constructed relatively few risk models despite the many potential opportunities. We have only one model for witnessed cardiac arrest,1 despite nearly 3,000 patients in the ELSO registry who have had ECMO for this indication. We have several published models in which either the indication is mixed,2–4 or cannulation modes included both veno-arterial and veno-venous modes.5–8 Klinzing et al. did construct separate risk models for veno-venous and veno-arterially treated patients, but the small number of patients failed to allow acceptable model predictive ability.6
We do have two good recent models that exclusively consider cardiogenic shock,9,10 but three more that use older data including the important SAVE score.11–13 Indeed, of the 13 risk models that have been published since 2010, five have accrued at least some patients before 2005. Yet such older data fail to incorporate the improvements in ECMO technology, processes and therefore in survival in more recent years. This might make those studies relying on older data less applicable to current practices.
We claim these points matter. Clinicians seeking to predict survival in a patient with severe acute respiratory disease could see estimated risk that diverges greatly from some “true” value if that risk model was partially derived from cardiogenic shock patients. Facility retrospective risk adjustment that relied a model constructed from patients in respiratory failure but including some patients whose initial diagnosis was cardiac arrest,7 might similarly lead to biased estimates of facility performance.
Looking to the future, we believe these methodological issues can and should be dealt with. We see wider and systematic use of ELSO’ ECLS Registry as a key part of a recommended program to deal with the white space in Table 1. Ideally, researchers should favor more recent data, corresponding as closely as possible to the modern ECMO infrastructure in widespread use today. While some may argue that “year of ECMO” could satisfy the question of impact, this may not be a workable solution for a prospective risk score calculated by a clinician in a facility.
Apart from the Registry, and continuing to increase the number of reporting centers, we also argue that we need separate risk models, for example, for veno-venous and veno-arterially treated patients with respiratory failure. Especially for witnessed cardiac arrest in hospital, we need substantially more models to understand the mortality risk (and neurological deficit) inherent in such use.
Some may argue that parceling out low numbers of patients into even smaller sets of indications and modes of treatment reduces predictive ability. This is a correct criticism, but suggests we should be conducting fewer own-institution retrospectives and more Registry-based work where more than 20,000 adult patients currently speak to our potential to “slice and dice” the data very finely.
Moreover, the dynamics in indication should be considered. Cardiogenic shock leading to acute respiratory distress syndrome and respiratory failure must be considered differently from viral pneumonia leading to respiratory failure. Similarly, acute respiratory disease syndrome in patients with septic shock complicated by circulatory shock should be considered a different case than cardiac failure without respiratory illness.
We acknowledge that none of these modeling tasks is simple or uncontroversial. However, the patients we start on ECMO and their families, the hospital clinicians, technologists and nursing staff who care for our patients, the insurers, and the society that ultimately provides scarce resources to enable ECMO—they all deserve our best attempts to produce more, and more refined risk models.
1. Mégarbane B, Deye N, Aout M, et al. Usefulness of routine laboratory parameters in the decision to treat refractory cardiac arrest with extracorporeal life support. Resuscitation 2011.82: 1154–1161.
2. Kim KI, Lee HS, Kim HS, et al. The pre-ECMO simplified acute physiology score II as a predictor for mortality in patients with initiation ECMO support at the emergency department for acute circulatory and/or respiratory failure: a retrospective study. Scand J Trauma Resusc Emerg Med 2015.23: 59.
3. Schmidt M, Burrell A, Roberts L, et al. Predicting survival after ECMO for refractory cardiogenic shock: the survival after veno-arterial-ECMO (SAVE)-score. Eur Heart J 2015.36: 2246–2256.
4. Chen WC, Huang KY, Yao CW, et al. The modified SAVE score: predicting survival using urgent veno-arterial extracorporeal membrane oxygenation within 24 hours of arrival at the emergency department. Crit Care 2016.20: 336.
5. Huang L, Li T, Xu L, et al. Performance of multiple risk assessment tools to predict mortality for adult respiratory distress syndrome with extracorporeal membrane oxygenation therapy: an external validation study based on Chinese single-center data. Chin Med J (Engl) 2016.129: 1688–1695.
6. Klinzing S, Wenger U, Steiger P, et al. External validation of scores proposed for estimation of survival probability of patients with severe adult respiratory distress syndrome undergoing extracorporeal membrane oxygenation therapy: a retrospective study. Crit Care 2015.19: 142.
7. Schmidt M, Bailey M, Sheldrake J, et al. Predicting survival after extracorporeal membrane oxygenation for severe acute respiratory failure. The Respiratory Extracorporeal Membrane Oxygenation Survival Prediction (RESP) score. Am J Respir Crit Care Med 2014.189: 1374–1382.
8. Schmidt M, Zogheib E, Rozé H, et al. The PRESERVE mortality risk score and analysis of long-term outcomes after extracorporeal membrane oxygenation for severe acute respiratory distress syndrome. Intensive Care Med 2013.39: 1704–1713.
9. Burrell AJ, Pellegrino VA, Wolfe R, et al. Long-term survival of adults with cardiogenic shock after venoarterial extracorporeal membrane oxygenation. J Crit Care 2015.30: 949–956.
10. Li CL, Wang H, Jia M, Ma N, Meng X, Hou XT. The early dynamic behavior of lactate is linked to mortality in postcardiotomy patients with extracorporeal membrane oxygenation support: A retrospective observational study. J Thorac Cardiovasc Surg 2015.149: 1445–1450.
11. Muller G, Flecher E, Lebreton G, et al. The ENCOURAGE mortality risk score and analysis of long-term outcomes after VA-ECMO for acute myocardial infarction with cardiogenic shock. Intensive Care Med 2016.42: 370–378.
12. Formica F, Avalli L, Colagrande L, et al. Extracorporeal membrane oxygenation to support adult patients with cardiac failure: predictive factors of 30-day mortality. Interact Cardiovasc Thorac Surg 2010.10: 721–726.
13. Hsu PS, Chen JL, Hong GJ, et al. Extracorporeal membrane oxygenation for refractory cardiogenic shock after cardiac surgery: predictors of early mortality and outcome from 51 adult patients. Eur J Cardiothorac Surg 2010.37: 328–333.