Predictive Performance of Renal Function Equations for Patients with Chronic Kidney Disease and Normal Serum Creatinine Levels : Journal of the American Society of Nephrology

Journal Logo

Epidemiology and Outcomes

Predictive Performance of Renal Function Equations for Patients with Chronic Kidney Disease and Normal Serum Creatinine Levels

Bostom, Andrew G.*; Kronenberg, Florian; Ritz, Eberhard

Author Information
Journal of the American Society of Nephrology 13(8):p 2140-2144, August 2002. | DOI: 10.1097/01.ASN.0000022011.35035.F3
  • Free

Abstract

Identifying and stratifying patients at risk for renal disease are integral parts of clinical nephrology. These tasks are performed in part by measuring the GFR, which is generally considered to be the best marker of renal function in healthy and diseased states (1). The GFR can be precisely measured by using the filtration markers inulin, [125I]iothalamate, 51Cr-ethylenediaminetetraacetic acid, 99mTc-diethylenetriaminepentaacetic acid, and iohexol (2). However, because these markers are, to varying degrees, costly and cumbersome to use and may involve radioactivity, which necessitates special handling and disposal and limits use, these standard methods of measurement are not typically used in clinical practice.

A far more common method has been to estimate renal function by using specifically designed prediction equations based on demographic characteristics, such as age, gender, race, and weight, and biochemical indices, including serum creatinine, urea, and albumin levels. Of these, probably the most frequently applied formula is that proposed by Cockroft and Gault (3). Regardless of whether these equations were derived to predict creatinine clearance (38) or GFR (9,10), they all use and are influenced by the serum creatinine level. Serum creatinine levels are greatly dependent on dietary intake, total muscle mass, the use of certain medications that can interfere with renal creatinine handling, and renal and extrarenal excretion, all of which might be altered in chronic kidney disease (CKD) (11). In fact, serum creatinine levels can be insensitive markers of true renal function in CKD. One study assessing the reliability of filtration markers in CKD noted that a >50% reduction in glomerular ultrafiltration needed to occur before the serum creatinine level increased above normal levels (defined as serum creatinine levels of >1.4 mg/dl) (12). Therefore, many patients with CKD maintain serum creatinine levels in the normal range despite having significantly impaired renal function.

Although previous studies focused on validating these prediction equations among patients with elevated serum creatinine levels and in other subpopulations (9,1315), these equations have not been tested in a CKD population with normal-range serum creatinine levels. This study aimed to address this issue by comparing the results of renal function prediction equations with iohexol GFR measurements (16) for a population of subjects with documented CKD and serum creatinine levels of ≤1.5 mg/dl.

Materials and Methods

A detailed description of the CKD cohort used in this study was provided elsewhere (17). All recruited patients were examined at least once during 1997, in one of eight nephrology departments in Germany, Austria, or South Tyrol. Subjects were Caucasian patients between the ages of 19 and 65 yr who were examined for evaluation or treatment of manifestations of kidney disease, such as proteinuria, active urinary sediment, or anatomic kidney abnormalities. Of the 227 patients in the original study, here we included only 109 who exhibited serum creatinine levels of ≤1.5 mg/dl. These subjects demonstrated the following primary CKD diagnoses: glomerulonephritis, n = 64 (58.7%); polycystic kidney disease, n = 9 (8.3%); pyelonephritis, n = 6 (5.5%); other, n = 19 (17.4%); unknown, n = 11 (10.1%). The majority (93%) of the 227 patients who were originally diagnosed as having glomerulonephritis demonstrated biopsy-proven disease. Exclusion criteria included diabetes mellitus, malignancies, liver, thyroid, or infectious diseases at the time of recruitment, organ transplantation, allergies against ionic contrast media, and pregnancy.

Serum and ethylenediaminetetraacetic acid-treated plasma were promptly separated from whole blood that had been collected after an overnight (12-h) fast and were frozen at −80°C before analysis. Serum albumin levels were measured with the bromocresol green method, using a kit obtained from Boehringer Mannheim (Mannheim, Germany). Serum creatinine levels were determined with the Jaffe method adapted for autoanalyzers. All laboratories were subject to external quality control assessments, and results were well within the serum creatinine concentration limits dictated by regulatory agencies [i.e., precision coefficients of variation (CV) of <6% for repeated measurements and accuracies of <10%]. Depending on the serum creatinine level, two or three blood samples were collected for determination of the true GFR (expressed as milliliters per minute per 1.73 m2) with the plasma iohexol clearance method, as described by Gaspari et al. (16). Between- and within-run CV for the key analytes (i.e., iohexol and urinary protein levels) were consistent with data reported elsewhere (16,18,19). Specifically, CV for all assays were between 5 and 10%.

Predicted renal function was calculated by using eight previously published equations (310). All except the Modification of Diet in Renal Disease (MDRD) Study equations (9,10), which measure GFR, were originally designed to calculate creatinine clearance. The cutoff level for serum creatinine concentrations was defined a priori as ≤1.5 mg/dl, because this value is at or slightly above the upper limit for most clinical laboratories.

The accuracy of prediction equations includes components of bias and precision. Bias is any systematic nonrandom deviation causing a prediction error and was calculated as the mean prediction error (ME) (20), which was defined as

where pei is the predicted value − the true value.

The precision of equations is assessed on the basis of the degree of spread of the series of observations and is reflected by the amount of expected variation in the estimates. This is measured with the R2 statistic, which indicates the overall fit of the model (21). The accuracy of each equation, or how well it represents the true renal function, was assessed by comparing its results with those of the standard method (in this case, the iohexol GFR). This was performed by using the following equation: [predicted value − true value (i.e., iohexol measurement)]× 100/iohexol measurement. For each equation, the number of subjects with predicted GFR values within 30 or 50% of the iohexol GFR was then tallied.

Results

The eight renal function equations evaluated are listed in Table 1; all equations use serum creatinine levels to predict renal function. Most of the study subjects were male and all were Caucasian, between the ages of 18 and 64 yr, as indicated in Table 2. The geometric mean serum creatinine level was 1.2 mg/dl, with no values higher than 1.5 mg/dl. The majority of patients exhibited proteinuria (microproteinuria to nephrotic-range proteinuria). Twenty-seven of the 109 subjects (25%) exhibited iohexol GFR values of <80 ml/min per 1.73 m2, despite demonstrating normal-range serum creatinine levels.

T1-20
Table 1:
GFR prediction equationsa
T2-20
Table 2:
Patient characteristics

The predictive performance of the equations is presented in Table 3. Precision, as reflected by the statistic R2, was greatest for the MDRD 1, MDRD 2, Jelliffe 1, and Jelliffe 2 equations. Bias, as indicated by the mean prediction error, was greatest for the MDRD 1, MDRD 2, Jelliffe 1, Jelliffe 2, and Gates equations. The most accurate results were obtained with the Bjornsson and Cockroft-Gault equations; results were within 30% of the iohexol GFR in 62 and 59% of the cases and within 50% of the iohexol GFR in 89 and 88% of the cases, respectively.

T3-20
Table 3:
Bias, precision, and accuracy of renal function equations

Discussion

Accurate assessment of renal function among patients with CKD is important for diagnostic and interventional purposes, proper medication dosing, interpretation of symptoms that might be uremic in nature, and decision-making regarding when the initiation of dialysis might be appropriate. Because of the numerous disadvantages of using filtration markers, derived prediction equations are typically used, throughout the world, to estimate renal function (310). Although some of the equations have been validated in CKD populations with clearly elevated serum creatinine levels (9,14), this is the first attempt to estimate their predictive performance for subjects with CKD and serum creatinine levels within the normal range. Why is this important? A significant subset of patients are referred for evaluation simply on the basis of abnormal urinary sediments (e.g., cellular casts or hematuria), proteinuria, or anatomic disease (e.g., renal cysts or cortical thinning). It is not uncommon for these patients to exhibit serum creatinine levels in the normal range, simply because of the limited sensitivity of serum creatinine measurements in detecting GFR decreases (12). Clinicians then typically base their assessments of renal function on formulae that rely heavily on serum creatinine levels for their predictive capabilities and that have not been validated for this particular subpopulation. It was this practice that we wanted to assess.

The most accurate renal function estimates were derived by using the Cockroft-Gault and Bjornsson equations, with approximately 60% of their results being within 30% and 90% being within 50% of the true GFR (as measured with the iohexol clearance technique). In some respects, it is reassuring that the most commonly used equation (i.e., the Cockroft-Gault equation) is at least as good as the others in terms of its predictive capability. These data, however, are also disquieting. They suggest that, even with the most accurate predictions, four of 10 patients would demonstrate predicted renal function at least 30% higher or lower than actual renal function. What are the clinical implications of these results? Let us suppose that a patient exhibits a serum creatinine level of 1.2 mg/dl and CKD has been diagnosed on the basis of proteinuria and cellular casts. Let us also presume that the actual GFR is 80 ml/min per 1.73 m2. If any of these prediction equations are used to estimate renal function, then there is a ≥40% chance that the prediction would be <56 or >104 ml/min per 1.73 m2.

Of note, the accuracy of each equation must also be understood in the context of both its precision and its bias. Precision is based on the overall spread of the observations (the smaller the spread, the greater the precision). Bias is a systematic deviation that may cause typical predictions to be either too high or too low. Bias varies of course, depending on the circumstances under which the measurements are made. For example, one potential source of bias involves the well documented differences among laboratories in the calibration of assays used to measure serum creatinine levels (22). Because the creatinine level is a heavily weighted variable in most of these equations, these differences would affect prediction results. However, because bias is a systematic deviation, it can be corrected for with correction factors that are multiplied by the prediction formula results. Poor precision cannot be corrected for in this manner, however. The use of these correction factors can potentially improve the accuracy of the formulae, particularly if their precision is high (e.g., the MDRD Study equations). The issue of how to improve the overall accuracy of these prediction equations then arises. It is obviously not feasible to derive a specific correction factor for each equation in each laboratory. Standardization of the calibration of creatinine measurements in all laboratories can be considered, but this would require much time and effort. Furthermore, even this step would not remove other sources of bias.

An alternative strategy would be to use other, more accurate, renal function markers for these particular patients with CKD. Endogenous filtration markers, such as cystatin C (a protein that is produced by nucleated cells at a constant rate and is then filtered by glomeruli), do exist. Cystatin C measurements have been observed to be more closely correlated with GFR (2325) and better able to detect mild reductions in GFR, compared with serum creatinine levels (26,27). However, the superiority of cystatin C measurements has not been formally validated in a population with documented CKD and normal serum creatinine levels. Alternatively, the use of highly accurate, exogenous renal filtration markers, whose application has traditionally been limited by cumbersome technique, expense, and radioactivity (among other factors), can be considered (2). In the past decade, a renal filtration marker without many of these limitations has gained prominence. Iohexol is a contrast agent that has been very well correlated with standard GFR markers (28,29); it is relatively inexpensive, nonradioactive (28), and safe to use in special patient populations, including those with severe renal insufficiency (30,31). Its ease of use is notable, because no urine samples are needed and, for patients with GFR of >40 ml/min per 1.73 m2, only one plasma sample (obtained a few hours after the iohexol injection) is required (32). Determination of true GFR with iohexol measurements might thus be an accurate, inexpensive, safe, and relatively easy method to apply to the CKD population with normal serum creatinine levels.

The generalizability of our results is limited by the fact that no diabetic, black, or very elderly subjects were included in the study population. Additionally, the equations studied were meant to predict either GFR or creatinine clearance. Because of concerns that creatinine clearance assessments systematically overestimate GFR, some researchers comparing the two have adjusted the creatinine clearance equations to correct for bias (9). However, because the two types of equations are often used interchangeably in general clinical practice to assess “renal function,” we decided against this adjustment.

In conclusion, our analysis of the predictive performance of renal function equations for a CKD population with normal serum creatinine levels demonstrated that the most accurate results were obtained with the Cockroft-Gault equation, whereas the most precise formula was the MDRD Study equation. Unfortunately, the predictive capabilities of these formulae were suboptimal for ideal patient care. These results suggest that direct measurements of renal function, using either endogenous or exogenous filtration markers, might be the best way to consistently obtain accurate assessments of renal function for these patients. Further studies are needed to confirm the generalizability of our findings for this common subgroup of patients.

This material is based on work supported by the United States Department of Agriculture, under Agreement No. 581950-9-001. Any opinions, findings, conclusions, or recommendations expressed in this publication are those of the authors and do not necessarily reflect the view of the United States Department of Agriculture. Support also originated from grants from the Else Kröner-Fresenius Stiftung, the Knoll William Harvey Prize, and the Austrian Science Fund (Grant P14717-GEN) to Dr. Kronenberg and from the Forschungskommission Medizinische Fakultät Ruperto-Carola-Universität Heidelberg to Dr. Ritz. The following people collaborated with the authors in this project: Paul König and Karl Lhotta, Department of Clinical Nephrology, Innsbruck University Hospital (Innsbruck, Austria); Günter Kraatz, Department of Internal Medicine A, Ernst Moritz Arndt University (Greifswald, Germany); Johannes F. E. Mann, LMU, München Schwabing Hospital (Munich, Germany); Gerhard A. Müller, Department of Nephrology and Rheumatology, Georg August University (Göttingen, Germany); Ulrich Neyer, Department of Nephrology and Dialysis, Feldkirch Hospital (Feldkirch, Austria); Werner Riegel, Innere Medizin IV, Medizinische Universitätskliniken des Saarlandes (Homburg/Saar, Germany); Peter Riegler, Division of Nephrology and Hemodialysis, Bozen Hospital (Bozen, Italy); and Vedat Schwenger, Department of Internal Medicine, Division of Nephrology, Ruperto Carola University (Heidelberg, Germany).

1. Smith HW: Diseases of the kidney and urinary tract. In: The Kidney: Structure and Function in Health and Disease, edited by Smith HW, New York, Oxford University Press, 1951, pp 836–887
2. Gaspari F, Perico N, Remuzzi G: Application of newer clearance techniques for the determination of glomerular filtration rate. Curr Opin Nephrol Hypertens 7: 675–680, 1998
3. Cockroft DW, Gault MH: Prediction of creatinine clearance from serum creatinine. Nephron 16: 31–41, 1976
4. Jelliffe RW, Jelliffe SM: A computer program for estimation of creatinine clearance from unstable serum creatinine levels, age, sex, and weight. Math Biosci 14: 17–24, 1972
    5. Jelliffe RW: Creatinine clearance: Bedside estimate. Ann Intern Med 79: 604–605, 1973
      6. Mawer GE, Knowles BR, Lucas SB, Stirland RM, Tooth JA: Computer-assisted prescribing of kanamycin for patients with renal insufficiency. Lancet 1: 12–15, 1971
        7. Gates GF: Creatinine clearance estimation from serum creatinine values: An analysis of three mathematical models of glomerular function. Am J Kidney Dis 5: 199–205, 1985
          8. Bjornsson TD: Use of serum creatinine concentrations to determine renal function. Clin Pharm 4: 200–222, 1979
          9. Levey AS, Bosch JP, Lewis JB, Greene T, Rogers N, Roth D: A more accurate method to estimate glomerular filtration rate from serum creatinine: A new prediction equation. Ann Intern Med 130: 461–470, 1999
          10. Levey AS, Greene T, Kusek JW, Beck GJ, MDRD Study Group: A simplified equation to predict glomerular filtration rate from serum creatinine [Abstract]. J Am Soc Nephrol 11: A0828, 2000
          11. Perrone RD, Madias NE, Levey AS: Serum creatinine as an index of renal function: New insights into old concepts. Clin Chem 38: 1933–1953, 1992
          12. Shemesh O, Golbetz H, Kriss JP, Myers BD: Limitations of creatinine as a filtration marker in glomerulopathic patients. Kidney Int 28: 830–838, 1985
          13. Spinler SA, Nawarskas JJ, Boyce EG, Connors JE, Charland SL, Goldfarb S: Predictive performance of ten equations for estimating creatinine clearance in cardiac patients. Ann Pharmacother 32: 1275–1283, 1998
          14. Goerdt PJ, Heim-Duthoy KL, Macres M, Swan SK: Predictive performance of renal function estimate equations in renal allografts. Br J Clin Pharmacol 44: 261–265, 1997
          15. Orlando R, Floreani M, Padrini R, Palatini P: Evaluation of measured and calculated creatinine clearances as glomerular filtration markers in different stages of liver cirrhosis. Clin Nephrol 51: 341–347, 1999
          16. Gaspari F, Perico N, Matalone M, Signorini O, Azzollini N, Mister M, Remuzzi G: Precision of plasma clearance of iohexol for estimation of GFR in patients with renal disease. J Am Soc Nephrol 9: 310–313, 1998
          17. Kronenberg F, Kuen E, Ritz E, Junker R, Konig P, Kraatz G, Lhotta K, Mann JFE, Muller GA, Neyer U, Riegel W, Riegler P, Schwenger V, von Eckardstein A: Lipoprotein(a) serum concentrations and apolipoprotein(a) phenotypes in mild and moderate renal failure. J Am Soc Nephrol 11: 105–115, 2000
          18. Hofmann W, Guder WG: A diagnostic programme for quantitative analysis of proteinuria. J Clin Chem Biochem 27: 589–600, 1989
          19. Solerte SB, Severgnini S, Locatelli M, Certutti N, Rondanelli M, Netti M, Ferrari E, Fioravanti M: Nephelometry in the clinical assessment of glomerular proteinuria and tubular function in diabetic nephropathy. Clin Nephrol 48: 151–158, 1997
          20. Sheiner LB, Beal SL: Some suggestions for measuring predictive performance. J Pharmacokinet Biopharm 9: 503–513, 1981
          21. Manjunath G, Sarnak MJ, Levey AS: Prediction equations to estimate glomerular filtration rate: An update. Curr Opin Nephrol Hypertens 10: 785–792, 2001
          22. Ross JW, Miller WG, Myers GL, Praestgaard J: The accuracy of laboratory measurements in clinical chemistry: A study of 11 routine chemistry analytes in the College of American Pathologists Chemistry Survey with fresh frozen serum, definitive methods, and reference methods. Arch Pathol Lab Med 122: 587–608, 1998
          23. Harmoinen APT, Kouri TT, Wirta OR, Lehtimaki TJ, Rantalaiho V, Turjanmaa VMH, Pasternack AI: Evaluation of plasma cystatin C as a marker for glomerular filtration rate in patients with type 2 diabetes. Clin Nephrol 52: 363–370, 1999
          24. Hayashi T, Nitta K, Michiyasu H, Nakauchi M, Nihei H: The serum cystatin C concentration measured by particle-enhanced immunonephelometry is well correlated with inulin clearance in patients with various types of glomerulonephritis. Nephron 82: 90–92, 1999
            25. Herget-Rosenthal S, Trabold S, Pietruck F, Holtmann M, Philipp T, Kribben A: Cystatin C: Efficacy as screening test for reduced glomerular filtration rate. Am J Nephrol 20: 97–102, 2000
            26. Coll E, Botey A, Alvarez L, Poch E, Quinto L, Saurina A, Vera M, Piera C, Alejandro D: Serum cystatin C as a new marker for noninvasive estimation of glomerular filtration rate and as a marker for early renal impairment. Am J Kidney Dis 36: 29–34, 2000
            27. Fliser D, Ritz E: Serum cystatin C concentration as a marker of renal dysfunction in the elderly. Am J Kidney Dis 37: 79–83, 2000
            28. Gaspari F, Perico N, Ruggenenti P, Mosconi L, Amuchastegui CS, Guerini E, Daina E, Remuzzi G: Plasma clearance of nonradioactive iohexol as a measure of glomerular filtration rate. J Am Soc Nephrol 6: 257–263, 1995
            29. Brandstrom E, Grzegorczyk A, Jacobsson L, Friberg P, Lindahl A, Aurell M: GFR measurement with iohexol and 51Cr-EDTA: A comparison of the two favoured GFR markers in Europe. Nephrol Dial Transplant 13: 1176–1182, 1998
            30. Olofsson P, Krutzen E, Nilsson-Ehle P: Iohexol clearance for assessment of glomerular filtration rate in diabetic pregnancy. Eur J Obstet Gynecol Reprod Biol 64: 63–67, 1996
            31. Sterner G, Frennby B, Hultberg B, Almen T: Ioxehol clearance for GFR-determination in renal failure: Single or multiple plasma sampling? Nephrol Dial Transplant 11: 521–525, 1996
            32. Gaspari F, Guerini E, Perico N, Mosconi L, Ruggenenti P, Remuzzi G: Glomerular filtration rate determined from a single plasma sample after intravenous iohexol injection: Is it reliable? J Am Soc Nephrol 7: 2689–2693, 1996
            Copyright © 2002 The Authors. Published by Wolters Kluwer Health, Inc. All rights reserved.