Validation of the Kidney Disease Improving Global Outcomes Criteria for AKI and Comparison of Three Criteria in Hospitalized Patients : Clinical Journal of the American Society of Nephrology

Journal Logo

Original Articles

Validation of the Kidney Disease Improving Global Outcomes Criteria for AKI and Comparison of Three Criteria in Hospitalized Patients

Fujii, Tomoko*; Uchino, Shigehiko*; Takinami, Masanori*; Bellomo, Rinaldo

Author Information
Clinical Journal of the American Society of Nephrology 9(5):p 848-854, May 2014. | DOI: 10.2215/CJN.09530913
  • Free

Abstract

Introduction

AKI is a major clinical problem among hospitalized patients (14). In 2004, the Acute Dialysis Quality Initiative published the Risk, Injury, Failure, Loss of Kidney Function, and End-Stage Kidney Disease (RIFLE) AKI definition and classification system (5). The RIFLE criteria consider three classes of AKI (risk, injury, and failure) according to the variations in serum creatinine and urine output from baseline values and two outcome classes (loss of kidney function and end-stage kidney disease) (Table 1). The RIFLE criteria have been validated in various settings and more than 500,000 patients (4,613).

T1-6
Table 1:
A comparison of the RIFLE, AKIN, and KDIGO definitions and classifications for AKI using SCr

In 2007, the Acute Kidney Injury Network (AKIN) working group, which was composed of nephrologists and critical care physicians, published the AKIN criteria (14) (Table1). The AKIN criteria have two components: diagnosis and staging. To diagnose AKI, baseline serum creatinine is not required, but the AKIN system requires at least two values of serum creatinine obtained within a period of 48 hours. AKI is defined by an acute increase in absolute serum creatinine of at least 0.3 mg/dl, a percentage increase in 50%, or a decrease in the urine output (oliguria<0.5 ml/kg per hour for more than 6 hours). Stage 1 corresponds to the risk class in RIFLE, but it also considers an absolute increase in serum creatinine of 0.3 mg/dl. Stages 2 and 3 correspond to the injury and failure classes of RIFLE, respectively. Stage 3 incorporates patients requiring RRT. The AKI classification introduced modifications to capture the impact of small acute increments in serum creatinine in a short period and the effect of RRT (1416). Of importance, in the AKIN classification, AKI diagnosis was based on changes over the time course of 48 hours, which was unlike the 1-week timeframe used in RIFLE (14). The advantages of AKIN have not yet been proven in any comparative studies (1721).

Finally, in 2013, the Kidney Disease: Improving Global Outcomes (KDIGO) group published a third consensus definition and classification system for AKI (22). The new system was based on a combination of the RIFLE and AKIN criteria (5,14,22). The KDIGO classification keeps both the absolute increase in serum creatinine level of ≥0.3 mg/dl within 48 hours from the AKIN and the 7-day timeframe for the ≥50% increase from the RIFLE (Table 1). This newly published system has been recently assessed in several studies (2328). However, its application to in-hospital AKI and its prognostic accuracy compared with the two previous classifications have not been thoroughly evaluated.

Accordingly, we conducted a retrospective study to describe the epidemiology of in-hospital AKI with the new KDIGO classification and compare its predictive ability for hospital mortality with the RIFLE and AKIN classification systems.

Materials and Methods

We performed a retrospective observational study including all patients admitted to a 1074-bed academic hospital in Tokyo, Japan, between April 1, 2008, and October 31, 2011. We screened computerized hospital admission and discharge databases and retrieved variables, such as age, sex, all dates and results of serum creatinine measured during the study period, admission units, and hospital mortality. We excluded patients younger than 15 years of age, patients who received RRT during the admission with CKD stage 5 at admission or at baseline, and patients who stayed in the hospital for less than 2 days. The institutional ethics committee approved the study and waived the need for informed consent; this study did not require any intervention, and data for each patient were anonymous.

AKI was defined only by the serum creatinine criteria of RIFLE, AKIN, and KDIGO classification systems as shown in Table 1. Baseline serum creatinine was defined by the most recent value obtained in our outpatient clinic between 1 and 12 months before admission or if not available, calculated by the simplified Modification of Diet in Renal Disease (MDRD) formula for Japanese patients (assuming a GFR of 75 ml/min per 1.73 m2) as previously reported (29). For analysis, AKI stages were calculated using serum creatinine levels with reference to the preadmission baseline creatinine (or calculated from the MDRD equation) or the lowest creatinine within 7 days for the first 7 days after admission. After day 8, the reference value was the lowest creatinine within the last 7 days. The maximum category derived by each classification system during hospitalization was reported.

Categorical data were reported as proportions, and numerical data were reported as medians with interquartile ranges. The discrimination ability in predicting hospital mortality was assessed using the area under the receiver operating characteristic curve (AUC) by the bootstrap method. Receiver operating characteristic curve was produced to assess the association of each AKI stage by the three criteria with hospital mortality as a univariate analysis. AKI stages were included in the model. Because we used a large dataset, Bonferroni’s adjustment for multiple comparison to a P value <0.02 (0.05/3) was taken to indicate statistical significance. Comparison of the AUC was performed using R version 3.0.0 (The R Foundation for Statistical Computing, Vienna, Austria), and other analyses were performed by JMP Pro 9.0.3 (SAS Institute, Inc., Cary, NC).

Results

During the study period, we screened all 81,738 admissions. Of these admissions, 56,567 patients had laboratory data on renal function during hospital admission, and 49,518 patients fulfilled the criteria for inclusion (Figure 1). Patient characteristics are described in Table 2. Admissions to medical units represented 41.7% of all admissions. Overall, the hospital mortality rate was 3.0%. The median interval of creatinine measurements was 1.5 days (interquartile range=1.0–2.0), and the rate of measurements within a 48-hour interval was 48.9% (145,395/297,071 measurements).

F1-6
Figure 1:
Study flow chart. LOS, length of stay.
T2-6
Table 2:
Patient characteristics and outcomes

The number of patients, hospital mortality, and hospital length of stay according to AKI stages are shown in Figure 2. For all classification systems, hospital mortality increased in accordance with staging. AKIN classification diagnosed fewer patients as having AKI than the other two systems (RIFLE: 5451 [11.0%]; AKIN: 2386 [4.8%]; KDIGO: 5764 [11.6%]), whereas the mortality rate in each stage was highest with the AKIN criteria (Figure 2). By cross-tabulating, stages classified with each criteria shown in Tables 3, 4, and 5 revealed that 3507 (7.0%) admissions were diagnosed as AKI by RIFLE but not AKIN.

F2-6
Figure 2:
The incidence and hospital mortality for each definition of AKI. The column graph shows numbers of patients in each group, and the line chart shows the mortality rate and hospital length of stay (LOS). AKIN, Acute Kidney Injury Network; KDIGO, Kidney Disease: Improving Global Outcomes; Pts, patients; RIFLE, Risk, Injury, Failure, Loss of Kidney Function, and End-Stage Kidney Disease.
T3-6
Table 3:
Contingency analyses of patients classified by RIFLE versus AKIN
T4-6
Table 4:
Contingency analyses of patients classified by AKIN versus KDIGO
T5-6
Table 5:
Contingency analyses of patients classified by KDIGO versus RIFLE

The predictive ability for hospital mortality for each system as assessed with the AUC is shown in Table 6. When each set of criteria was applied to hospital patients, RIFLE and KDIGO showed adequate and similar discrimination and significantly greater discrimination than AKIN criteria. Patients with baseline creatinine data measured before admission were retrieved and analyzed separately, which showed coincident results with the whole cohort.

T6-6
Table 6:
AUC for the RIFLE, AKIN, and KDIGO definitions to predict hospital mortality

Discussion

Key Findings

We studied 49,518 admissions to a university hospital using a large clinical database and compared the predictive performance of the RIFLE (5), AKIN (14), and KDIGO (22) classification systems for AKI. We found that almost 11% of hospitalized patients were diagnosed as having AKI with the RIFLE and KDIGO criteria, whereas only approximately 5% of patients were classified as having AKI with the AKIN criteria. Staging and hospital mortality, however, were closely correlated for all classification systems. Discriminating ability for hospital mortality was adequate and similar for RIFLE and KDIGO criteria, whereas AKIN discrimination ability was inferior.

Relationship to Previous Studies

Three sets of criteria proposed by nephrology and intensive care expert groups have been validated for their prognostic ability in various populations so far (4,613,1721,2328). Their comparative performance has recently been evaluated in several studies (23,2628). The RIFLE classification has exhibited good prognostic accuracy in terms of mortality in many intensive care unit studies (79) and several studies of hospital patients (4,6), and this finding was again confirmed in our study.

The AKIN criteria aimed to improve the sensitivity of the RIFLE classification system by incorporating an acute rise in serum creatinine of as little as 0.3 mg/dl, a time constraint of 48 hours for the diagnosis of AKI, and the use of RRT in stage 3 (14). Compared with the RIFLE criteria, however, the AKIN criteria have failed to improve the predictive ability of the definition and classification of AKI, especially in critically ill patients (1719).

KDIGO, a combination of RIFLE and AKIN, is expected to benefit from the two sets of criteria. In the FINNAKI study, KDIGO has been reported to give identical diagnosis to AKIN (23), and for cardiac surgery patients, KDIGO was equal to AKIN and superior to RIFLE in predicting hospital mortality (28). There are two studies targeting cardiac critical patients to compare RIFLE and KDIGO classifications (26,27). One study showed AUCs for predicting 30-day adverse outcome (composed of readmission for heart failure, death, or requirement of RRT) of RIFLE=0.76, AKIN=0.74, and KDIGO=0.72 (P=0.02) (26). Another study, using multivariable Cox regression analysis, showed increased hazard ratio for 30-day mortality of 3.51 (95% confidence interval, 2.35 to 5.25) by RIFLE and 3.99 (95% confidence interval, 2.59 to 6.15) by KDIGO (27).

Recently, Zeng et al. (30) reported the epidemiology of AKI using the KDIGO definition and its comparison with the other definitions in a single center, retrospective, observational study. Here, we additionally report a study comparing the three sets of criteria in all hospitalized patients. In our population, AKI occurred in almost 11% of all hospitalized patients by RIFLE and KDIGO criteria, which was close to the value reported in the work by Zeng et al. (30). Also, we found AKIN classification to be inferior in its diagnostic ability, which was not observed in the previous report (30). In critical care settings, monitoring small increments of serum creatinine could bring out a higher sensitivity to diagnose AKI with a timeframe of 48 hours; however, in general wards, serum creatinine is not measured frequently. In our study, more than one half of measurements were performed with intervals over 48 hours (51.0%; 151,676/297,071 measurements). Diagnostic criteria with short timeframes are more likely to fail in such clinical practice in general wards. Another explanation for the underdiagnosis by AKIN is that AKIN could not diagnose those patients who have increased creatinine on admission and are treated in the hospital as AKI patients, because it does not use baseline measurements for diagnosis. Two cases are presented in Figure 3 as examples. Because AKIN classification does not use baseline creatinine for AKI diagnosis, in a case in which creatinine level was elevated on admission but did not increase after admission, AKIN fails to diagnose it as AKI (Figure 3A). Furthermore, AKIN has a 48-hour timeframe for AKI diagnosis, which excludes measurements with longer intervals from evaluation (Figure 3B).

F3-6
Figure 3:
Serum creatinine trend of the patients who were diagnosed as AKI by RIFLE but not AKIN. (A) Creatinine level at admission elevated to 1.5 times the baseline level (RIFLE-Risk) but not increased after admission (no AKI by AKIN). (B) Creatinine level increased to 5.2 by 0.5 mg/dl (RIFLE-Failure) from day 3 to day 6, but the interval was over 48 hours (no AKI by AKIN).

Implications for Clinicians and Researchers

Many clinical studies on AKI are being published using different criteria for the diagnosis and classification of AKI (KDIGO, RIFLE, and AKIN). The use of the three systems is an improvement from the previous use of >25 different classification systems (31), but it leaves investigators with uncertainty as to whether one is describing similar populations. Our study has shown that the RIFLE and KDIGO criteria showed good prognostic accuracy and were essentially equivalent in the hospital population and that they were superior to the AKIN system. Furthermore, as shown in Table 1, the RIFLE classification system is the simplest system. In hospital patients, we should be cautious about the use of AKIN criteria, because they might be vulnerable to practice patterns.

Strengths and Limitations

This study is the first report of a comparative validation study for the RIFLE, AKIN, and KDIGO criteria including all hospitalized patients, and it has important implications for AKI epidemiology. Exclusion criteria were children, short hospital stay, and CKD on maintenance hemodialysis. These limited criteria enabled us to minimize selection bias and give a whole picture of AKI in hospitalized patients.

However, this study was conducted in a single center, which may have limitations to its external validity. Because it was a retrospective study, data on causes of admissions, causes of kidney injury, or urine output were not available, which limited additional assessment of the characteristics and diagnosis of AKI. We used recorded creatinine values whenever possible to define baseline creatinine values, and the MDRD equation was used when recorded data were not available. Estimation of baseline serum creatinine by the MDRD equation has been reported to over- or underestimate some patients with AKI in the risk category of RIFLE (32). However, such errors would have applied to baseline renal functional estimation for all three systems and could not have created a bias in favor of any one system. In fact, results in our study showed the same tendency in the discrimination of the three criteria in the subgroup of those patients with measured baseline creatinine and the whole cohort.

In this study, which involved almost 50,000 hospital patients, we found that close to 11% developed AKI as defined by the RIFLE and KDIGO systems, whereas less than one half of this number were identified by the AKIN system. Furthermore, when we compared these three systems for their ability to predict mortality, the KDIGO and RIFLE systems were equivalent, but the AKIN system was clearly inferior. Our observations do not support the use of AKIN for the identification and/or prognostication of AKI in hospital patients.

Disclosures

None.

Published online ahead of print. Publication date available at www.cjasn.org.

References

1. Chertow GM, Burdick E, Honour M, Bonventre JV, Bates DW: Acute kidney injury, mortality, length of stay, and costs in hospitalized patients. J Am Soc Nephrol 16: 3365–3370, 2005
2. Uchino S, Kellum JA, Bellomo R, Doig GS, Morimatsu H, Morgera S, Schetz M, Tan I, Bouman C, Macedo E, Gibney N, Tolwani A, Ronco CBeginning and Ending Supportive Therapy for the Kidney (BEST Kidney) Investigators: Acute renal failure in critically ill patients: A multinational, multicenter study. JAMA 294: 813–818, 2005
    3. Liangos O, Wald R, O’Bell JW, Price L, Pereira BJ, Jaber BL: Epidemiology and outcomes of acute renal failure in hospitalized patients: A national survey. Clin J Am Soc Nephrol 1: 43–51, 2006
      4. Wang HE, Muntner P, Chertow GM, Warnock DG: Acute kidney injury and mortality in hospitalized patients. Am J Nephrol 35: 349–355, 2012
      5. Bellomo R, Ronco C, Kellum JA, Mehta RL, Palevsky PAcute Dialysis Quality Initiative workgroup: Acute renal failure—definition, outcome measures, animal models, fluid therapy and information technology needs: The Second International Consensus Conference of the Acute Dialysis Quality Initiative (ADQI) Group. Crit Care 8: R204–R212, 2004
      6. Uchino S, Bellomo R, Goldsmith D, Bates S, Ronco C: An assessment of the RIFLE criteria for acute renal failure in hospitalized patients. Crit Care Med 34: 1913–1917, 2006
      7. Hoste EA, Clermont G, Kersten A, Venkataraman R, Angus DC, De Bacquer D, Kellum JA: RIFLE criteria for acute kidney injury are associated with hospital mortality in critically ill patients: A cohort analysis. Crit Care 10: R73, 2006
      8. Cruz DN, Bolgan I, Perazella MA, Bonello M, de Cal M, Corradi V, Polanco N, Ocampo C, Nalesso F, Piccinni P, Ronco CNorth East Italian Prospective Hospital Renal Outcome Survey on Acute Kidney Injury (NEiPHROS-AKI) Investigators: North East Italian Prospective Hospital Renal Outcome Survey on Acute Kidney Injury (NEiPHROS-AKI): Targeting the problem with the RIFLE Criteria. Clin J Am Soc Nephrol 2: 418–425, 2007
        9. Ostermann M, Chang RW: Acute kidney injury in the intensive care unit according to RIFLE. Crit Care Med 35: 1837–1843, 2007
        10. Arnaoutakis GJ, Bihorac A, Martin TD, Hess PJ Jr., Klodell CT, Ejaz AA, Garvan C, Tribble CG, Beaver TM: RIFLE criteria for acute kidney injury in aortic arch surgery. J Thorac Cardiovasc Surg 134: 1554–1560, 2007
          11. Lopes JA, Jorge S, Resina C, Santos C, Pereira A, Neves J, Antunes F, Prata MM: Prognostic utility of RIFLE for acute renal failure in patients with sepsis. Crit Care 11: 408, 2007
            12. Lopes JA, Jorge S, Neves FC, Caneira M, da Costa AG, Ferreira AC, Prata MM: An assessment of the RIFLE criteria for acute renal failure in severely burned patients. Nephrol Dial Transplant 22: 285, 2007
              13. Chen YC, Jenq CC, Tian YC, Chang MY, Lin CY, Chang CC, Lin HC, Fang JT, Yang CW, Lin SM: Rifle classification for predicting in-hospital mortality in critically ill sepsis patients. Shock 31: 139–145, 2009
              14. Mehta RL, Kellum JA, Shah SV, Molitoris BA, Ronco C, Warnock DG, Levin AAcute Kidney Injury Network: Acute Kidney Injury Network: Report of an initiative to improve outcomes in acute kidney injury. Crit Care 11: R31, 2007
              15. Lassnigg A, Schmidlin D, Mouhieddine M, Bachmann LM, Druml W, Bauer P, Hiesmayr M: Minimal changes of serum creatinine predict prognosis in patients after cardiothoracic surgery: A prospective cohort study. J Am Soc Nephrol 15: 1597–1605, 2004
                16. Levy MM, Macias WL, Vincent JL, Russell JA, Silva E, Trzaskoma B, Williams MD: Early changes in organ function predict eventual survival in severe sepsis. Crit Care Med 33: 2194–2201, 2005
                17. Lopes JA, Fernandes P, Jorge S, Gonçalves S, Alvarez A, Costa e Silva Z, França C, Prata MM: Acute kidney injury in intensive care unit patients: A comparison between the RIFLE and the Acute Kidney Injury Network classifications. Crit Care 12: R110, 2008
                18. Bagshaw SM, George C, Bellomo RANZICS Database Management Committee: A comparison of the RIFLE and AKIN criteria for acute kidney injury in critically ill patients. Nephrol Dial Transplant 23: 1569–1574, 2008
                  19. Joannidis M, Metnitz B, Bauer P, Schusterschitz N, Moreno R, Druml W, Metnitz PG: Acute kidney injury in critically ill patients classified by AKIN versus RIFLE using the SAPS 3 database. Intensive Care Med 35: 1692–1702, 2009
                  20. Robert AM, Kramer RS, Dacey LJ, Charlesworth DC, Leavitt BJ, Helm RE, Hernandez F, Sardella GL, Frumiento C, Likosky DS, Brown JRNorthern New England Cardiovascular Disease Study Group: Cardiac surgery-associated acute kidney injury: A comparison of two consensus criteria. Ann Thorac Surg 90: 1939–1943, 2010
                    21. Englberger L, Suri RM, Li Z, Casey ET, Daly RC, Dearani JA, Schaff HV: Clinical accuracy of RIFLE and Acute Kidney Injury Network (AKIN) criteria for acute kidney injury in patients undergoing cardiac surgery. Crit Care 15: R16, 2011
                    22. Kidney Disease: Improving Global Outcomes (KDIGO) Acute Kidney Injury Work Group: KDIGO clinical practice guideline for acute kidney injury. Kidney Int Suppl 2: 1–138, 2012
                    23. Nisula S, Kaukonen KM, Vaara ST, Korhonen AM, Poukkanen M, Karlsson S, Haapio M, Inkinen O, Parviainen I, Suojaranta-Ylinen R, Laurila JJ, Tenhunen J, Reinikainen M, Ala-Kokko T, Ruokonen E, Kuitunen A, Pettilä VFINNAKI Study Group: Incidence, risk factors and 90-day mortality of patients with acute kidney injury in Finnish intensive care units: The FINNAKI study. Intensive Care Med 39: 420–428, 2013
                    24. Wang HE, Jain G, Glassock RJ, Warnock DG: Comparison of absolute serum creatinine changes versus Kidney Disease: Improving Global Outcomes consensus definitions for characterizing stages of acute kidney injury. Nephrol Dial Transplant 28: 1447–1454, 2013
                      25. Mizuno T, Sato W, Ishikawa K, Shinjo H, Miyagawa Y, Noda Y, Imai E, Yamada K: KDIGO (Kidney Disease: Improving Global Outcomes) criteria could be a useful outcome predictor of cisplatin-induced acute kidney injury. Oncology 82: 354–359, 2012
                        26. Roy AK, Mc Gorrian C, Treacy C, Kavanaugh E, Brennan A, Mahon NG, Murray PT: A comparison of traditional and novel definitions (RIFLE, AKIN, and KDIGO) of acute kidney injury for the prediction of outcomes in acute decompensated heart failure. Cardiorenal Med 3: 26–37, 2013
                        27. Rodrigues FB, Bruetto RG, Torres US, Otaviano AP, Zanetta DM, Burdmann EA: Incidence and mortality of acute kidney injury after myocardial infarction: A comparison between KDIGO and RIFLE criteria. PLoS One 8: e69998, 2013
                        28. Bastin AJ, Ostermann M, Slack AJ, Diller GP, Finney SJ, Evans TW: Acute kidney injury after cardiac surgery according to Risk/Injury/Failure/Loss/End-stage, Acute Kidney Injury Network, and Kidney Disease: Improving Global Outcomes classifications. J Crit Care 28: 389–396, 2013
                        29. Matsuo S, Imai E, Horio M, Yasuda Y, Tomita K, Nitta K, Yamagata K, Tomino Y, Yokoyama H, Hishida ACollaborators Developing the Japanese Equation for Estimated GFR: Revised equations for estimated GFR from serum creatinine in Japan. Am J Kidney Dis 53: 982–992, 2009
                        30. Zeng X, McMahon GM, Brunelli SM, Bates DW, Waikar SS: Incidence, outcomes, and comparisons across definitions of AKI in hospitalized individuals. Clin J Am Soc Nephrol 9: 12–20, 2014
                        31. Kellum JA, Levin N, Bouman C, Lameire N: Developing a consensus classification system for acute renal failure. Curr Opin Crit Care 8: 509–514, 2002
                        32. Závada J, Hoste E, Cartin-Ceba R, Calzavacca P, Gajic O, Clermont G, Bellomo R, Kellum JAAKI6 Investigators: A comparison of three methods to estimate baseline creatinine for RIFLE classification. Nephrol Dial Transplant 25: 3911–3918, 2010
                        Keywords:

                        acute renal failure; hospitalization; mortality

                        Copyright © 2014 The Authors. Published by Wolters Kluwer Health, Inc. All rights reserved.