Journal Logo

Research Article: Diagnostic Accuracy Study

The establishment and evaluation of a new model for the prediction of prostate cancer

Wang, Qi MD; Li, Yan-Feng PhD*; Jiang, Jun PhD; Zhang, Yong PhD; Liu, Xu-Dong MD; Li, Ke MD

Editor(s): Palazón-Bru., Antonio

Author Information
doi: 10.1097/MD.0000000000006138
  • Open

Abstract

1 Introduction

PSA has played an important role in the early diagnosis, treatment strategy, and prognosis of prostate cancer (PCa).[1] The widespread use of PSA has increased the detection rate of PCa significantly. Some countries or regions routinely perform PCa screening using PSA testing and have achieved certain results.[2,3] However, PSA is a marker of prostate tissue and is not specific to PCa; therefore, the widespread application of PSA testing has inevitably resulted in a serious problem of over-diagnosis and over-treatment.[4] To remedy this, %fPSA was applied clinically and significantly enhanced the detection rate of PCa in patients with tPSA levels of 4 to 10 ng/mL.[5,6] Some studies also found that cPSA had a higher specificity than tPSA or %fPSA when the sensitivity for diagnosis of PCa was 95%,[7] and it could be substituted for tPSA as the screening index for PCa.[8]

However, the detection rate of PCa remains at a very limited level using cPSA or %f PSA, and so many patients with BPH unnecessary undergo prostate biopsies. The current study combined tPSA, fPSA, and cPSA to develop and validate a new predictive model (tPSA/fPSA × √cPSA) for the diagnosis of PCa (PCP). The differential diagnostic value of PCP for PCa was evaluated by comparing the clinical application of PCP, tPSA, cPSA, and %fPSA. The aim was to improve the diagnostic accuracy of PCa and decrease the incidence of unnecessary prostate biopsies by the application of PCP.

2 Materials and methods

2.1 Study population

The diagnosis of all the included Chinese patients was confirmed pathologically in Daping Hospital between December 1, 2011 and December 1, 2014. There were 54 cases of PCa and 579 cases of BPH with tPSA levels of 2 to 10 ng/mL, and 48 cases of PCa and 147 cases of BPH with tPSA levels of 10 to 20 ng/mL. The decision to perform prostate biopsy was based on an increased tPSA, a low %fPSA, a suspicious digital rectum examination (DRE), or a suspicious transrectal ultrasonography (TRUS) according to the guidelines of Chinese Urological Association. Before serum PSA levels were tested, all factors that may cause an abnormal increase in serum PSA were investigated according to medical history, including bacterial acute prostatitis, hemophilia, cystoscopy, and the use of drugs that affect PSA levels.[9] The research protocols and informed consents from patients were approved by the Ethics Committee of the Daping Hospital that belong to Third Military Medical University of Chongqing. All the research procedure was strictly executed in accordance with the Declaration of Helsinki.

2.2 Determining and calculating serum PSA levels

Before prostate biopsy or prostate surgery, blood samples were collected according to standard procedures.[10] Serum tPSA and fPSA levels were determined using chemiluminescence with a Beckman Coulter Unicel DXI 800 automatic immunity analyzer. tPSA includes fPSA and cPSA, cPSA mainly consists of PSA-ACT (serum fPSA complexed with α-antitrypsin), and other forms of PSA in serum are too low to detect[11,12]; therefore, cPSA plus fPSA is generally equivalent to tPSA.

2.3 Analysis of pathological specimens

Attending urologists performed ultrasound-guided prostate biopsies according to a standardized scheme. Briefly, at least 12 biopsy cores were evenly taken from the top, intermediate region, and base of the prostate gland, and additional cores were taken when obviously abnormal areas were detected. Prostate biopsy specimens were placed in specific single-core specimen containers. Specimens were processed and evaluated by an experienced genitourinary pathologist. Prostate surgeries, including (transurethral resection of prostate, TURP) or laparoscopic radical prostatectomy, were performed according to the diagnosis and general condition of the patient. The pathological diagnosis of all was achieved and confirmed by the pathologists in our hospital.

2.4 Construction of the PCP model

The critical objective of the PCP is to achieve the best diagnosis of PCa, or achieve an area under the ROC curve (area under the curve [AUC]) for PCP that is the largest compared with tPSA, fPSA, %fPSA, and cPSA. A nonlinear prediction model was constructed using the combination of tPSA, fPSA, and cPSA:

where α is the coefficient, X, Y, and Z represent tPSA, fPSA, and cPSA respectively, and a, b, and c are the power parameters of X, Y, and Z, respectively. Maximum likelihood estimates and iterative estimations were used to predict the unknown power parameter values of α, a, b, and c.[13,14] Parameter sensitivity analysis was used to ensure the stability of the power parameter values.[15] The power parameter values were added to the predicting model to obtain the PCP (PCP = tPSA/fPSA × √cPSA). Finally, logistic regressions were used to calculate the AUC of PCP for the diagnosis of PCa.

2.5 Statistical analysis

Student t tests were used to assess the normality of variables. Mann–Whitney U tests were used to compare not normally distributed continuous variables. Logistic regression was used to analyze the linear relationship between predictive variables and PCa. Hosmer–Lemeshow tests were used to assess the fitting goodness of the logistic models. Odds ratios (ORs) with 95% confidence intervals (CIs) were also calculated. ROC curves were used to quantify the predictive accuracy of the logistic models. To comprehensively demonstrate the predictive consequences of logistic models, bootstrapping analysis was used to calculate the distribution and CIs for AUCs, and Hosmer–Lemeshow tests were used to calculate P values.[16]

All data analyses were performed using SPSS version 13.0 (SPSS Inc, Chicago, IL), MedCalc Statistical Software version 15.2.2 (MedCalc Software, Ostend, Belgium), and R version 3.2.0 (The R Foundation for Statistical Computing). Higher P values in the Hosmer–Lemeshow test indicated that the tested models were more meaningful. The results of other analyses were considered significant with two-sided P value ≤0.05.

3 Results

3.1 The clinical characteristics of the study population

A total of 828 patients with tPSA levels of 2 to 20 ng/mL were included in this study. According to pathological reports, 102 (12.3%) patients had a final diagnosis of PCa. There was no obvious difference in the mean age of patients with PCa and BPH (71.7 vs 71.5 yr, respectively; P > 0.744). There was no significant difference in the median fPSA level between the 2 groups (1.0 vs 1.0 ng/mL, respectively; P > 0.572). Conversely, tPSA, cPSA, and PCP were significantly higher in the PCa group compared with the BPH group (9.2 vs 5.5 ng/mL, 8.0 vs 4.4 ng/mL, 22.1 vs 11.0, respectively; all P < 0.000). Conversely, %fPSA levels were significantly lower in the PCa group than in the BPH group (0.13 vs 0.19, P < 0.000) (Table 1).

T1-7
Table 1:
Descriptive characteristics of the study population.

3.2 The PSA indexes and PCP's abilities to predict PCa

When tPSA levels were 2 to 10 ng/mL, univariate logistic regression analysis showed that PCP (P = 0.000), cPSA (P = 0.002), %fPSA (P = 0.000), and tPSA (P = 0.024) were all significantly related to PCa (Table 2), and that the correlation between PCP and %fPSA with PCa were closer than the correlation between tPSA or cPSA and PCa. In contrast, fPSA (P = 0.079) had no obvious correlation with PCa. In ROC curve analysis, the AUC of PCP was 0.680, which was significantly higher than that of tPSA (0.588), fPSA (0.571), %fPSA (0.675), and cPSA (0.613) (Fig. 1A). Next, bootstrapping was used to reanalyze the data and demonstrate the distribution and CIs for the AUC, and Hosmer–Lemeshow tests were used to calculate P values (Table 3, Figs. 2A–E, 3A–E). The results indicated that PCP was the most accurate predictor of PCa, followed by %fPSA and cPSA.

T2-7
Table 2:
Logestic regression and ROC analysis predicting the probability of PCa was set at (I) 2≤tPSA <10 ng/mL, (II) 10≤tPSA <20 ng/mL.
F1-7
Figure 1:
Receiver operating characteristic curves show the accuracy of individual predictors for predicting prostate cancer. %fPSA = percentage of free PSA to total PSA, cPSA = complexed prostate-specific antigen, fPSA = free prostate-specific antigen, PCP = prostate cancer predictor, PSA = prostate-specific antigen, tPSA = total prostate-specific antigen.
T3-7
Table 3:
Bootstrapping analysis calculating the CIs for AUC and Hosmer–Lemeshow test with its P value was set at (I) 2≤tPSA <10 ng/mL, (II) 10≤tPSA <20 ng/mL.
F2-7
Figure 2:
Histograms showing the distribution of individual predictors with their AUC. %fPSA = percentage of free PSA to total PSA, cPSA = complexed prostate-specific antigen, fPSA = free prostate-specific antigen, PCP = prostate cancer predictor, PSA = prostate-specific antigen, tPSA = total prostate-specific antigen.
F3-7
Figure 3:
Histograms showing the distribution of Hosmer–Lemeshow tests with the resulting P values. %fPSA = percentage of free PSA to total PSA, cPSA = complexed prostate-specific antigen, fPSA = free prostate-specific antigen, PCP = prostate cancer predictor, PSA = prostate-specific antigen, tPSA = total prostate-specific antigen.

When tPSA levels were 10 to 20 ng/mL, univariate logistic regression analysis showed that PCP (P = 0.002), cPSA (P = 0.008), %fPSA (P = 0.012), and fPSA (P = 0.048) were significantly associated with PCa (Table 2). In contrast, tPSA (P = 0.078) was not significantly associated with PCa. There was a closer correlation between PCP and PCa than %fPSA or cPSA and PCa. In contrast, fPSA (P = 0.048) was only weakly correlated with PCa, and tPSA (P = 0.078) had no obvious correlation with PCa. In ROC curve analysis, the AUC of PCP was 0.686, which is significantly higher than that of tPSA (0.603), fPSA (0.643), %f PSA (0.679), and cPSA (0.647) (Fig. 1B). Next, bootstrapping was performed to reanalyze the data and determine the distribution and CIs for the AUC, and Hosmer–Lemeshow tests were used to calculate P values (Table 3, Figs. 2F–J, 3F–J). This univariate accuracy analysis indicated that PCP was the most accurate predictor of PCa, followed by %fPSA and cPSA.

3.3 The PSA indexes and PCP's sensitivities and specificities for prediction of PCa

When tPSA levels were 2 to 10 ng/mL and the sensitivity for the diagnosis of PCa was 90.7%, the specificity of PCP was 22.8%, which is significantly higher than that of tPSA (11.1%), fPSA (11.2%), %fPSA (17.4%), and cPSA (15.5%). If the specificity for the diagnosis of PCa was ∼90%, the sensitivity of PCP (33.3%) remained significantly higher than that of tPSA (22.2%), fPSA (20.4%), %fPSA (29.6%), and cPSA (20.4%) (Table 4).

T4-7
Table 4:
Three levels of predictive variables for prediction of prostate cancer: (I) high sensitivity, (II) best balance of sensitivity and specificity, (III) high specificity.

When tPSA levels were 10 to 20 ng/mL and the sensitivity for diagnosis of PCa was 91.7%, the specificity of PCP (29.3%) was significantly higher than that of tPSA (10.9%), fPSA (10.2%), %fPSA (23.1%), and cPSA (18.4%). If the specificity for the diagnosis of PCa was ∼91%, the sensitivity of PCP (27.1%) was significantly higher than that of tPSA (6.3%), fPSA (22.9%), %fPSA (22.9%), and cPSA (8.3%) (Table 4).

4 Discussions

PCa is one of the most common urogenital tumors in elderly men, particularly in Western countries.[17] Although tPSA and %fPSA, which have the advantages of being simple, efficient, and rapid, are currently the most important serum markers for the diagnosis of PCa, many patients without PCa still undergo unnecessary prostate biopsy. Therefore, more accurate predictive markers are urgently needed.[18] Novel predictive methods or tools for the early diagnosis of PCa are discovered regularly, but a variety of deficiencies have so far limited the promotion and application of these clinically. Larne et al[19] built a PCa predicting tool by detecting the levels of 4 different microRNAs, and demonstrated that the tool was more efficient than PSA. However, no single microRNA has been applied to the clinical diagnosis of PCa at present; thus, the efficiency of the tool for the diagnosis of PCa remains questionable. Finne et al[20] constructed a multivariate linear model and drew a nomogram using logistic regression analysis based on tPSA, %fPSA, prostate volume, and a digital rectal examination (DRE). The analysis showed that this model could decrease the false-positive rate more efficiently than %fPSA or prostate-specific antigen density (PSAD). However, prostate volume and DRE measurements were strongly associated with the physician's judgment and operating ability, which may affect the stability of the model for predicting PCa. Stephan et al[21] created an artificial neural network (ANN) by analyzing tPSA, fPSA, macrophage inhibitory cytokine 1 (MIC-1), human kallikrein 11 (hK11), and migration inhibitor factor (MIF). Unfortunately, the specificity of the tool for diagnosing PCa was only better than %fPSA when the sensitivity was 90% or 95%, which is far from satisfactory. Auprich et al[22] reported that prostate cancer antigen-3 had a greater ability to predict PCa than tPSA and %fPSA. Further, prostate cancer antigen-3 could be included in existing risk-stratifying tools or nomograms to help determine whether a patient should undergo prostate biopsy. However, measuring prostate cancer antigen-3 is more complex and incurs a higher cost, which limits its application in clinical practice. Stephan et al[23] found that an artificial neural network based on precursor PSA and %fPSA had the same effect as an artificial neural network composed of tPSA, %fPSA, age, prostate volume, and DRE. However, the specificity of these tools for predicting PCa was not improved significantly compared with %fPSA when the sensitivity was 95%. Lughezzani et al[24] developed a nomogram based on age, prostate volume, DRE, and prostate health index, and discovered that the nomogram was better than tPSA, %fPSA, and prostate health index for the prediction of PCa. Meanwhile, using only the prostate health index was better than tPSA or %fPSA. However, the prostate health index consisted of [-2]proPSA (a stable form of proenzyme PSA), tPSA, and fPSA; therefore, detecting [-2]proPSA requires an additional procedure to simple serum PSA tests, which undoubtedly increases the economic costs.

To search for a better predictive tool for the diagnosis of PCa, the current study successfully developed a new prostate cancer predictor (PCP) model based on the existing index of serum PSA through mathematical modeling, parameter calculations, and stability verifying. The current model has many advantages compared with previous studies. First, this is the first time that a nonlinear exponential function model has been constructed for the early diagnosis of PCa by combing tPSA, fPSA, and cPSA. Second, since the variables contained in the PCP are available from conventional serum PSA tests, the technology of detecting each variable was very mature and the PCP model did not need additional items to be tested. Third, nonobjective results caused by artificial judgment differences could be avoided because each variable was tested using automatic equipment.

tPSA and %fPSA still are the most widely used early clinical predictors of PCa and they provide the essential evidence to determine the need for prostate biopsy. The results of the present study suggest that PCP is significantly correlated with the incidence of PCa when tPSA levels are 2 to 10 ng/mL or 10 to 20 ng/mL, and could predict PCa more accurately than tPSA, fPSA, cPSA, or %fPSA. When tPSA levels were 2 to 10 ng/mL and the sensitivity for the diagnosis of PCa was 90.7% the specificity of PCP was 22.8%, which was 11.7%, 11.6%, 5.4%, and 7.3% higher than tPSA, fPSA, %fPSA, and cPSA, respectively. When tPSA levels were 10 to 20 ng/mL and the sensitivity for the diagnosis of PCa was 91.7%, the specificity of PCP for the diagnosis of PCa was 29.3%, which was 18.4%, 19.1%, 6.2%, and 10.9% higher than tPSA, fPSA, %fPSA, and cPSA, respectively. The results of this study confirm that PCP is the most accurate predictor of the presence of PCa compared with tPSA, fPSA, %fPSA, or cPSA in patients with tPSA levels of 2 to 20 ng/mL. The clinical application of PCP could avoid more unnecessary biopsies without missing significant cases of cancer.

In summary, PCP had more predictive value than tPSA, fPSA, %fPSA, and cPSA when tPSA levels were 2 to 20 ng/mL. This suggests that PCP could further reduce unnecessary prostate biopsies and the risk of over-diagnosis and over-treatment. Nevertheless, the value of PCP in combination with other indicators still requires further study. If the value of PCP for predicting PCa is accepted, this model is likely to replace tPSA or %fPSA as a novel clinical screening tool for PCa.

Acknowledgment

The authors deeply appreciate Dr Zhi-Bing Deng, the Director of Statistical Analysis at the Scientific Research Data Center in the West China College of Medicine, Sichuan University, who assisted with the completion of statistics and drawing of histograms.

References

[1]. Hudson MA, Bahnson RR, Catalona WJ. Clinical use of prostate specific antigen in patients with prostate cancer. J Urol 1989;142:1011–7.
[2]. Schröder FH, Hugosson J, Roobol MJ, et al. Screening and prostate-cancer mortality in a randomized European study. N Engl J Med 2009;360:1320–8.
[3]. Schröder FH, Hugosson J, Roobol MJ, et al. Prostate-cancer mortality at 11 years of follow-up. N Engl J Med 2012;366:981–90.
[4]. Zappa M, Ciatto S, Bonardi R, et al. Overdiagnosis of prostate carcinoma by screening: an estimate based on the results of the FlorenceScreening Pilot Study. Ann Oncol 1998;9:1297–300.
[5]. Partin AW, Catalona WJ, Southwick PC, et al. Analysis of percent free prostate-specific antigen (PSA) for prostate cancer detection: influence of total PSA, prostate volume, and age. Urology 1996;48(6A suppl):55–61.
[6]. Gann PH, Ma J, Catalona WJ, et al. Strategies combining total and percent free prostate specific antigen for detecting prostate cancer: a prospective evaluation. J Urol 2002;167:2427–34.
[7]. Brawer MK, Meyer GE, Letran JL, et al. Measurement of complexed PSA improves specificity for early detection of prostate cancer. Urology 1998;52:372–8.
[8]. Okihara K, Ukimura O, Nakamura T, et al. Complexed PSA improves prostate cancer detection: results from a multicenter Japanese clinical trial. Urology 2006;67:328–32.
[9]. Rodríguez-Rubio FI, Robles JE, González A, et al. Effect of digital rectal examination and flexible cystoscopy on free and total prostate-specific antigen, and the percentage of free prostate-specific antigen. Differences between two PSA assays. Eur Urol 1998;33:255–60.
[10]. Tuck MK, Chan DW, Chia D, et al. Standard operating procedures for serum and plasma collection: early detection research network consensus statement standard operating procedure integration working group. J Proteome Res 2009;8:113–7.
[11]. Christensson A, Laurell CB, Lilja H. Enzymatic activity of prostate-specific antigen and its reactions with extracellular serine proteinase inhibitors. Eur J Biochem 1990;194:755–63.
[12]. Stenman UH, Leinonen J, Alfthan H, et al. A complex between prostate-specific antigen and alpha 1-antichymotrypsin is the major form of prostate-specific antigen in serum of patients with prostatic cancer: assay of the complex improves clinical sensitivity for cancer. Cancer Res 1991;51:222–6.
[13]. Reed TE, Schull WJ. A general maximum likelihood estimation program. Am J Hum Genet 1968;20:579–80.
[14]. Eilenberg S, Elgot CC. Iteration and recursion. Proc Natl Acad Sci USA 1968;61:378–9.
[15]. Tarantola S, Saltelli A. Methodological advances and innovative applications of sensitivity analysis. Reliab Eng Syst Saf 2003;79:121–2.
[16]. Bertail P, Clémençon S, Vayatis N. On Bootstrapping the ROC Curve. Conference on Neural Information Processing Systems, Vancouver, British Columbia, Canada, December. 2008:137–144.
[17]. Siegel R, Naishadham D, Jemal A. Cancer statistics, 2012. CA Cancer JClin 2012;62:10–29.
[18]. Prostate cancer: send away the PSA [editorial] Lancet 2012;380:307.
[19]. Larne O, Martens-Uzunova E, Hagman Z, et al. miQ—a novel microRNA based diagnostic and prognostic tool for prostate cancer. Int J Cancer 2013;132:2867–75.
[20]. Finne P, Auvinen A, Aro J, et al. Estimation of prostate cancer risk on the basis of total and free prostate-specific antigen, prostate volume and digital rectal examination. Eur Urol 2002;41:619–26.
[21]. Stephan C, Xu C, Brown DA, et al. Three new serum markers for prostate cancer detection within a percent free PSA-based artificial neural network. Prostate 2006;66:651–9.
[22]. Auprich M, Bjartell A, Chun FK, et al. Contemporary role of prostate cancer antigen 3 in the management of prostate cancer. Eur Urol 2011;60:1045–54.
[23]. Stephan C, Meyer HA, Kwiatkowski M, et al. A (-5, -7) proPSA based artificial neural network to detect prostate cancer. Eur Urol 2006;50:1014–20.
[24]. Lughezzani G, Lazzeri M, Haese A, et al. Multicenter European external validation of a prostate health index-based nomogram for predicting prostate cancer at extended biopsy. Eur Urol 2014;66:906–12.
Keywords:

prostate cancer; prostate cancer predictor; prostate-specific antigen

Copyright © 2017 The Authors. Published by Wolters Kluwer Health, Inc. All rights reserved.