Secondary Logo

Journal Logo

Original Article

Predictive Score Model for Delayed Graft Function Based on Hypothermic Machine Perfusion Variables in Kidney Transplantation

Ding, Chen-Guang1,2; Li, Yang1,2; Tian, Xiao-Hui1,2; Hu, Xiao-Jun1,2; Tian, Pu-Xun1,2; Ding, Xiao-Ming1,2; Xiang, He-Li1,2; Zheng, Jin1,2; Xue, Wu-Jun1,2,

Author Information
doi: 10.4103/0366-6999.245278
  • Free



Donation after cardiac death (DCD) is becoming the main source of organ transplantation in China.[12] The high incidence of delayed graft function (DGF) and the higher risk of early graft dysfunction and failure were the main concerns of DCD kidney transplantation.[345]

Hypothermic machine perfusion (HMP) is used to reduce the incidence of DGF and to ameliorate the transplantation of renal function by decreasing the ischemic damage of DCD kidneys that occurs in static cold storage.[678] In addition to possible therapeutic benefits, HMP provides a choice for assessing kidney viability that is essential for optimal organ allocation.[8910] An accurate assessment of the quality of the kidneys may reduce the number of kidneys discarded and the number of poor kidney transplants, resulting in an unacceptable survival rate. Kidney biopsy has been used as the gold standard for assessing kidney quality before transplantation until now.[1112] However, a kidney biopsy is a time-consuming and invasive process that requires experienced pathologists to assess the kidney quality. Therefore, several predictive models for DGF have been developed within the last few years.[41314151617]

However, many factors that are not included in these donor models may affect the kidney quality such as inflammatory lesions caused by brain death, hemodynamic instability during donor hospitalization, traumatic damage caused during organ procurement, and renal ischemic injury in the course of transport. Many transplant centers have assessed the quality of DCD kidneys through HMP parameters.[8910] One study further analyzed the Euro transplant trial that showed that terminal resistance was an independent risk factor for DGF; however, the ability to predict terminal resistance was low with a c-statistic score of 0.58.[9]

Although the authors of the trial oppose the use of HMP parameters as criteria for kidney rejection, high terminal resistance and low terminal flow rate have been associated with higher rates of rejection.[181920] In summary, it is still controversial whether a single HMP parameter can predict DGF and assess kidney viability and allograft outcomes after renal transplantation.[21] We believe that the combination of all HMP factors should be more predictive value of DGF than a single HMP factor. Therefore, we applied the method of Sullivan et al.[22] to convert the model of HMP variables to a simple point system. The risk score was derived from a competing risk model with DGF. To calculate the risk score, points for all factors were summed up.

The objectives of this study were to use a readily available HMP variable to design a scoring model that could identify the highest risk of DGF and provide guidance and advice for organ allocation and DCD kidney assessment.


Ethical approval

This retrospective, observational cohort study was approved by the Ethics Committee of the First Affiliated Hospital of Xi’an Jiaotong University. All patients provided informed consent. This was in compliance with the provisions of the current Declaration of Helsinki principles and good clinical practice guidelines. The kidney grafts were provided by the Coordination Group of Shaanxi Red Cross Organization and harvested from DCDs classified as controlled or uncontrolled DCDs according to the Maastricht classification. No touch time in donor patients after cardiac death was defined as 2–5 min before the heart stops beating, according to Chinese regulatory institutions. None of the organs in this study were obtained from a vulnerable population, and there were no ethical or legal conflicts.

Study design

The age of the recruited patients ranged from 16 to 65 years old. They underwent primary kidney transplantation with HMP-preserved DCD kidneys from September 1, 2012, to August 31, 2016. Patients were excluded from the study if (1) they had undergone retransplantation or had accepted organs other than the kidneys; (2) had a positive crossmatch or positive panel-reactive antibody (PRA); and (3) had hepatitis, active infection, or abnormal hepatic function. DCD donor inclusion criteria were as follows: (1) identity, (2) negative HIV antigen test, (3) 16 years ≤ aged <65 years, and (4) negative diagnosis for the conditions of malignant tumor, drug abuse, or renal diseases. Qualified kidneys were randomly assigned to the development and validation cohorts using a 2:1 distribution generated by a Web-based program ( The diagnostic criterion of DGF was dialysis needed in the 1st-week posttransplant.

Hypothermic machine perfusion

After being procured and trimmed, all kidneys used LifePort (Organ Recovery Systems, Chicago, IL, USA) for continuous perfusion preservation with an initial pump pressure of 30 mmHg (1 mmHg = 0.133 kPa). The machine continuously recorded the perfusion parameters (pressure, temperature, resistance, flow, and duration).

Immunosuppressive regimen

A triple immunosuppressive regimen consisting of mycophenolic acid (MPA), calcineurin inhibitor (CNI), and prednisone was used as the initial regimen in all patients. MPA is enteric-coated mycophenolate sodium or mycophenolate mofetil. CNI is tacrolimus or cyclosporin A. All recipients were induced with rabbit antithymocyte globulin (Thymoglobuline; Genzyme, Waterford, Ireland; 1.25 mg·kg−1·d−1 on days 0 and 2 up to day 4 after transplantation).

Statistical analysis

The HMP variables of the development cohort were used as candidate univariate predictors for DGF, and the independent predictors of DGF were identified using multivariate logistic regression analysis. Using the estimated odds ratios (ORs) from the multivariate logistic regression analysis model and the integer 1 was assigned to each OR value of 1. A total of 1000 bootstrap samples were selected from the development cohort to avoid overfitting the data. For each sample, the step-by-step selection procedure was used to select the independent predictor of DGF. The variables selected in ≥90% of the boot model were included in the final multivariate model.[23] The predictive ability of the risk score was assessed by a c-statistic of the receiver operator characteristic curve (ROC), and the calibration was evaluated by Hosmer-Lemeshow Chi-squared statistic.[24] A P < 0.05 was considered statistically significant. All calculations were performed using SPSS 19.0 (SPSS Inc., Chicago, IL, USA).


Demographic and clinical characteristics

A total of 366 qualified patients were randomly assigned to the development cohorts (n = 244) and the validation cohorts (n = 122), respectively. In the two groups, 117 donors were the same. Table 1 showed their demographic and clinical characteristics. There were no significant differences between the two groups with respect to donor and recipient ages, duration of dialysis pre-transplant, positivity for PRA, number of HLA mismatches, cold ischemic time, warm ischemic time, primary diseases of the recipients, causes of death of the donors, and donors’ serum creatinine levels and body mass index.

Table 1:
Demographic and clinical characteristics of donors and recipients in the development and validation cohorts

Graft and patient survival rates

By the one-year follow-up assessment, seven patients (including two cases of none recovery AMR, one case of primary nonfunctioning, two case of renal artery stenosis, and two case of ureteral obstruction in transplanted kidney) in the development cohorts and four patients (two cases of none-recovery AMR, one case of transplanted kidney rupture, and one case of renal allograft abscess) in the validation cohorts had developed allograft failure. In the same period, five patients in the development cohorts (including two patients died from cardiovascular disease and three from pulmonary infection) and three patients in the validation cohorts (including one patient died from cardiovascular disease, one from a traffic accident, and one from pulmonary infection) had died. Both the allograft survival (97.1% vs. 96.7%, χ2 = 0.020, P = 0.895) and the patient survival (98.0% vs. 97.5%, χ2 = 0, P = 0.902) rates at 1-year follow-up were similar between the two study groups.

Hypothermic machine perfusion parameters

The HMP variables of the following: terminal flow, terminal resistance, temperature, pump pressure, and HMP duration did not differ between the two groups [Table 2].

Table 2:
HMP variables for transplant kidneys in the development and validation cohorts

Univariate and multivariate analyses of hypothermic machine perfusion variables associated with delayed graft function

Univariate analysis clearly showed that the HMP variables, such as the terminal flow (OR = 0.863, 95%confidence interval [CI]: 0.729–0.969, P < 0.001) and the terminal resistance (OR = 7.262, 95% CI: 2.909–15.508, P < 0.001), were significantly related with DGF onset. Dichotomous cut-points for HMP duration showed statistically significant association as compared to the continuous variable: kidneys with HMP duration of <12 h had a significantly higher DGF rate as compared to kidneys with an HMP duration ≥12 h (OR = 1.342, 95% CI: 1.184–1.521, P = 0.001). Meanwhile, temperature, pump pressure, and left/right kidney were not associated with DGF onset [Table 3]. We used a multivariate logistic regression model that included all the variables that were statistically significantly related with DGF in the univariate analyses to better identify the predictors of DGF. The probability of correlation between the pump pressure and DGF was <0.1 (OR = 1.252, 95% CI: 1.127–1.390, P = 0.087) in the univariate logistic regression models. Therefore, the perfusion pressure was also included in the multivariate analysis of the model. The terminal flow (OR = 0.931, 95% CI: 0.894–0.967, P = 0.011), terminal resistance (OR = 2.190, 95% CI: 1.032–10.20, P = 0.000), and HMP duration (OR = 1.165, 95% CI: 1.008–1.360, P = 0.043) still remained statistically significantly related with DGF after multivariate analysis [Table 3]. According to the results of the univariate and multivariate logistic regression analyses, the terminal flow, terminal resistance, and HMP duration (Referent <12 h) were considered the independent predictors of DGF.

Table 3:
HMP variables in the univariate and multivariable logistic regression analysis for DGF

Hypothermic machine perfusion score development

The observed overall frequency of DGF posttransplant in the development cohort was 15.6% (n = 38). The methods of Sullivan et al.[24] were used to convert the model in Table 3 to a simple point system. Table 3 showed that the risk factors used to develop the scoring model based on whether DGF has occurred, and these variables were selected for the final HMP scoring mode. Table 3 also showed the logistic estimate ORs for all of the HMP variables. The Hosmer-Lemeshow test was 9.15 (P = 0.355) for the HMP risk-scoring mode, indicating that the logistic model was appropriate in the analyses. HMP scores according to the risk model for all predictors are summarized in Table 4. The sum of HMP scores ranged between a minimum of 0 to a maximum of 14 points [Table 4]. The number of recipients at each HMP score level and the corresponding frequency of DGF in the development and the validation cohorts are shown in Table 5. There was a clear increase in the incidence of DGF moving from the low-risk score group to the very high-risk score group. According to the acquired frequencies of DGF associated with different risk scores, we formed four increasingly serious risk categories (scores 0–3, 4–7, 8–11, and 12–14) to increase the number of recipients in each risk category and to heighten the clinical utility of scoring. The incidence of DGF in the four categories of severity in the development cohort set ranged from 4.6% to 66.7% [Table 5].

Table 4:
HMP scoring model in predicting DGF in patients after kidney transplantation
Table 5:
Predicted risk and risk categories of DGF in patients after kidney transplantation based on the HMP scoring model

Validations of hypothermic machine perfusion score

The observed overall rate of DGF posttransplant in the validation cohort was 16.4% (n = 20). The incidences of DGF in the validation cohort were close to those in the development cohort in each of the four risk categories [Table 5]. We performed c-statistic analysis of the two datasets to test and compare the diagnostic ability of the HMP scoring mode. The c-statistic of the HMP scores in the validation cohort was 0.706 (95% CI: 0.608–0.811), and it was 0.712 (95% CI: 0.615–0.804) in the development cohort. The c-statistic results were not statistically significantly different [Figure 1]. We also computed for the c-statistics for the terminal flow and the terminal resistance. The c-statistics for the terminal flow and the terminal resistance were 0.503 (95% CI: 0.405–0.613) and 0.597 (95% CI: 0.535–0.672), respectively [Figure 1]. The c-statistic results were statistically significantly less than the HMP scores in the development and the validation cohorts indicating that the HMP score model demonstrated good discriminative power in predicting DGF after kidney transplantation.

Figure 1:
Receiver operator characteristic curves showing the area under the curve for DGF after kidney transplant. (a) The flow rate c-statistic (or area under the ROC curve) was 0.503; (b) The resistance c-statistic (or area under the ROC curve) was 0.597; (c) The HMP score in development cohort c-statistic (or area under the ROC curve) was 0.712; (d) The HMP score in validation cohort c-statistic (or area under the ROC curve) was 0.706. The c-statistics for the terminal flow (P = 0.012) and resistance (P = 0.006) were statistically significantly less than the HMP score in the development and validation cohorts. DGF: Delayed graft function; HMP: Hypothermic machine perfusion; ROC: Receiver operator characteristic curve.


DGF has been recognized as one of the most crucial factors affecting graft function and survival in kidney transplantation.[52425] Donor organ quality is one of the most important factors of DGF. How to evaluate the quality of DCD kidneys has become a critical problem in the kidney transplantation field. Reducing this complication may not only have important clinical significance but may also bring huge economic benefits. HMP has been shown to be superior to static cold storage for kidney preservation[26] due to improved perfusion of the microvasculature, decreased aggregation of blood components, mitigated endothelial activation, and reduced inflammatory up-regulation.[6727]

In the current era of DCD, due to inadequate assessment of donors, many meaningful indicators cannot be collected. Therefore, the quality of the donor kidney cannot be well assessed by donor assessment. HMP solved this problem better; it can better evaluate the quality of kidney from the whole through various parameters. Furthermore, HMP enables the pretransplantation assessment of graft viability and quality and can predict DGF, drawing the attention of the majority of the physicians. It allows the study of perfusion characteristics such as resistance and flow. Current evidence suggests that resistance and flow rate during HMP correlate with kidney-graft function. Resistance at the end of HMP has been shown to be an independent risk factor for the development of DGF.[928] Our data support this connection. In the development cohort, resistance and flow rates were significantly associated with DGF on multivariate analysis. Therefore, parameters of HMP might be a good non-invasive method to replace kidney biopsy for evaluating the quality of DCD kidneys before transplant. A kidney biopsy and histologic scores remain as the gold standard for evaluating quality of kidneys before transplant.[111229] However, kidney biopsy is a time-consuming and invasive process that requires experienced pathologists to assess kidney quality. We have established an HMP scoring model to identify DGF at a high as well as a low-risk pretransplantation score group. Furthermore, we validated the HMP scoring model that was similar to that of the development cohort (0.706 vs. 0.712), suggesting high stability of the HMP predictive score model. We also conducted a sensitivity analysis to assess the ability of a single HMP variable to identify DGF. The final risk model had a higher c-statistic score in the development and validated cohorts as compared to the single HMP variables such as terminal resistance and flow rate. This indicates that using the HMP scoring model is superior as compared to using a single HMP parameter in evaluating DCD kidney quality and predicting DGF.

The present study derived and validated a potential clinical prediction tool rather than a decision rule. It is to aid the attending physician who will make the clinical decision. For instance, based on the low- and moderate-risk categories, we recommend that the DCD kidney can be used with minimal risk of DGF. However, at high-risk categories, we recommend being cautious in the application of the DCD kidney and should be used in specific clinical situations.

In summary, our findings suggest that the HMP scoring model may be a good noninvasive tool for evaluating the quality of DCD kidneys, and it is potentially useful for physicians in making optimal decisions regarding donor organ offers.

Financial support and sponsorship

This work was supported by grants from the Fundamental Research Funds for the Central Universities (No. xjj2018091), Major Clinical Research Projects of the First Affiliated Hospital of Xi’an Jiaotong University (No. XJTU1AF-CRF-2015-005), Scientific and Technological Breakthrough in Social Development of Shaanxi Province (No. 2016SF-246), and the National Natural Science Foundation of China (No. 81670681 and 81760137).

Conflicts of interest

There are no conflicts of interest.


1. Huang J, Millis JM, Mao Y, Millis MA, Sang X, Zhong S. Voluntary organ donation system adapted to Chinese cultural values and social reality Liver Transpl. 2015;21:419–22 doi: 10.1002/lt.24069
2. Zhang L, Zeng L, Gao X, Wang H, Zhu Y. Transformation of organ donation in China Transpl Int. 2015;28:410–5 doi: 10.1111/tri.12467
3. Ding CG, Tai QH, Han F, Li Y, Tian XH, Tian PX, et al Predictive score model for delayed graft function based on easily available variables before kidney donation after cardiac death Chin Med J. 2017;130:2429–34 doi: 10.4103/0366-6999.216409
4. Ding CG, Jiao LZ, Han F, Xiang HL, Tian PX, Ding XM, et al Early immunosuppressive exposure of enteric-coated-mycophenolate sodium plus tacrolimus associated with acute rejection in expanded criteria donor kidney transplantation Chin Med J. 2018;131:1302–7 doi: 10.4103/0366-6999.232797
5. Domínguez-Gil B, Duranteau J, Mateos A, Núñez JR, Cheisson G, Corral E, et al Uncontrolled donation after circulatory death: European practices and recommendations for the development and optimization of an effective programme Transpl Int. 2016;29:842–59 doi: 10.1111/tri.12734
6. Nyberg SL, Matas AJ, Rogers M, Harmsen WS, Velosa JA, Larson TS, et al Donor scoring system for cadaveric renal transplantation Am J Transplant. 2001;1:162–70 doi: 10.1034/j.1600-6143.2001.10211.x
7. Heilman RL, Mathur A, Smith ML, Kaplan B, Reddy KS. Increasing the use of kidneys from unconventional and high-risk deceased donors Am J Transplant. 2016;16:3086–92 doi: 10.1111/ajt.13867
8. Gill J, Dong J, Eng M, Landsberg D, Gill JS. Pulsatile perfusion reduces the risk of delayed graft function in deceased donor kidney transplants, irrespective of donor type and cold ischemic time Transplantation. 2014;97:668–74 doi: 10.1097/01.TP.0000438637.29214.10
9. Jochmans I, O’Callaghan JM, Pirenne J, Ploeg RJ. Hypothermic machine perfusion of kidneys retrieved from standard and high-risk donors Transpl Int. 2015;28:665–76 doi: 10.1111/tri.12530
10. Parikh CR, Hall IE, Bhangoo RS, Ficek J, Abt PL, Thiessen-Philbrook H, et al Associations of perfusate biomarkers and pump parameters with delayed graft function and deceased donor kidney allograft function Am J Transplant. 2016;16:1526–39 doi: 10.1111/ajt.13655
11. Jochmans I, Moers C, Smits JM, Leuvenink HG, Treckmann J, Paul A, et al The prognostic value of renal resistance during hypothermic machine perfusion of deceased donor kidneys Am J Transplant. 2011;11:2214–20 doi: 10.1111/j.1600-6143.2011.03685.x
12. Tedesco-Silva H Junior, Mello Offerni JC, Ayres Carneiro V, Ivani de Paula M, Neto ED, Brambate Carvalhinho Lemos F, et al Randomized trial of machine perfusion versus cold storage in recipients of deceased donor kidney transplants with high incidence of delayed graft function Transplant Direct. 2017;3:e155 doi: 10.1097/TXD.0000000000000672
13. Randhawa P. Role of donor kidney biopsies in renal transplantation Transplantation. 2001;71:1361–5 doi: 10.1097/00007890-200105270-00001
14. Saidi RF, Elias N, Kawai T, Hertl M, Farrell ML, Goes N, et al Outcome of kidney transplantation using expanded criteria donors and donation after cardiac death kidneys: Realities and costs Am J Transplant. 2007;7:2769–74 doi: 10.1111/j.1600-6143.2007.01993.x
15. Irish WD, Ilsley JN, Schnitzler MA, Feng S, Brennan DC. A risk prediction model for delayed graft function in the current era of deceased donor renal transplantation Am J Transplant. 2010;10:2279–86 doi: 10.1111/j.1600-6143.2010.03179.x
16. Rodrigo E, Miñambres E, Ruiz JC, Ballesteros A, Piñera C, Quintanar J, et al Prediction of delayed graft function by means of a novel web-based calculator: A single-center experience Am J Transplant. 2012;12:240–4 doi: 10.1111/j.1600-6143.2011.03810.x
17. Plata-Munoz JJ, Vazquez-Montes M, Friend PJ, Fuggle SV. The deceased donor score system in kidney transplants from deceased donors after cardiac death Transpl Int. 2010;23:131–9 doi: 10.1111/j.1432-2277.2009.00951.x
18. Zaza G, Ferraro PM, Tessari G, Sandrini S, Scolari MP, Capelli I, et al Predictive model for delayed graft function based on easily available pre-renal transplant variables Intern Emerg Med. 2015;10:135–41 doi: 10.1007/s11739-014-1119-y
19. Moore J, Tan K, Cockwell P, Krishnan H, McPake D, Ready A, et al Predicting early renal allograft function using clinical variables Nephrol Dial Transplant. 2007;22:2669–77 doi: 10.1093/ndt/gfm249
20. Lodhi SA, Lamb KE, Uddin I, Meier-Kriesche HU. Pulsatile pump decreases risk of delayed graft function in kidneys donated after cardiac death Am J Transplant. 2012;12:2774–80 doi: 10.1111/j.1600-6143.2012.04179.x
21. Sung RS, Christensen LL, Leichtman AB, Greenstein SM, Distant DA, Wynn JJ, et al Determinants of discard of expanded criteria donor kidneys: Impact of biopsy and machine perfusion Am J Transplant. 2008;8:783–92 doi: 10.1111/j.1600-6143.2008.02157.x
22. Sullivan LM, Massaro JM, D’Agostino RB Sr. Presentation of multivariate data for clinical use: The Framingham study risk score functions Stat Med. 2004;23:1631–60 doi: 10.1002/sim.1742
23. Matsuno N, Konno O, Mejit A, Jyojima Y, Akashi I, Nakamura Y, et al Application of machine perfusion preservation as a viability test for marginal kidney graft Transplantation. 2006;82:1425–8 doi: 10.1097/
24. van Smaalen TC, Hoogland ER, van Heurn LW. Machine perfusion viability testing Curr Opin Organ Transplant. 2013;18:168–73 doi: 10.1097/MOT.0b013e32835e2a1b
25. Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve Radiology. 1982;143:29–36 doi: 10.1148/radiology.143.1.7063747
26. Yarlagadda SG, Coca SG, Formica RN Jr, Poggio ED, Parikh CR. Association between delayed graft function and allograft and patient survival: A systematic review and meta-analysis Nephrol Dial Transplant. 2009;24:1039–47 doi: 10.1093/ndt/gfn667
27. Irish WD, McCollum DA, Tesi RJ, Owen AB, Brennan DC, Bailly JE, et al Nomogram for predicting the likelihood of delayed graft function in adult cadaveric renal transplant recipients J Am Soc Nephrol. 2003;14:2967–74 doi: 10.1097/01.ASN.0000093254.31868.85
28. Moers C, Smits JM, Maathuis MH, Treckmann J, van Gelder F, Napieralski BP, et al Machine perfusion or cold storage in deceased-donor kidney transplantation N Engl J Med. 2009;360:7–19 doi: 10.1056/NEJMoa0802289
29. Matsuoka L, Shah T, Aswad S, Bunnapradist S, Cho Y, Mendez RG, et al Pulsatile perfusion reduces the incidence of delayed graft function in expanded criteria donor kidney transplantation Am J Transplant. 2006;6:1473–8 doi: 10.1111/j.1600-6143.2006.01323.x

Edited by: Ning-Ning Wang


Delayed Graft Function; Donation after Cardiac Death; Hypothermic Machine Perfusion; Kidney Transplantation

© 2018 Chinese Medical Association