All patients in the ROVAR data set had undergone cytoreductive surgery aimed at removing all visible residual disease and for correct surgical staging. Adequate non–fertility-sparing cytoreductive surgery consisted of peritoneal washings, bilateral salpingo-oophorectomy, hysterectomy, multiple peritoneal biopsies of all abdominal fields, at least infracolic omentectomy, appendectomy in case of mucinous histology, and pelvic and para-aortic lymph nodes dissection up to the renal veins. Fertility-sparing surgery in patients with stage IA or stage IC was used only in case of unilateral ovarian involvement and favorable histology (ie, mucinous, serous, endometrioid, or mixed histology and grade 1 or 2); however, this was combined with complete surgical staging, which included a lymphadenectomy to exclude more advanced disease.
A total of 52 (15%) from the data set had undergone neoadjuvant chemotherapy and received chemotherapy prior to definitive surgical cytoreduction, whereas 302 (85%) had adjuvant chemotherapy after upfront surgery. Follow-up lasted more than 5 years (range, 1–120 months) for 275 patients (78%) in the data set. The relapse rate in the full data set was 71% at the time analysis was completed (October 31, 2013).
The final selected model included the following 4 variables: FIGO stage and grade at diagnosis, preoperative CA-125, and residual disease at the posttreatment CT scan. Elevated CA-125 at diagnosis and presence of measurable residual disease after posttreatment CT were no/yes variables. The sensitivity and specificity of the model to predict relapse as applied to the validation data set were 94% and 61%, respectively, and estimated on the full data set were 93% and 65%, respectively. Area under the receiver operating characteristic (ROC) curve for the validation data set was 0.91 (95% confidence interval, 0.85–0.96), and that for the full data set was 0.92 (95% confidence interval, 0.88–0.95). The area under the ROC curve for a model including FIGO stage alone was 0.80 (95% confidence interval, 0.75–0.85). The leave-one-out cross-validation technique gave an adjusted estimate of prediction error for the model of 10.7%. The positive predictive value, which is the proportion of predicted relapses that were true relapses, was 84% in the validation data set. The negative predictive value, which is the proportion of predicted no-relapse patients who were true nonrelapses, was 83% in the validation data set. The Hosmer-Lemeshow test resulted in P = 0.4074, indicating no evidence of lack of fit of the model.11 Comparison between the observed and expected responses suggests that the model was well calibrated. The boosting algorithm that we applied had overall mean sensitivity of 86% and mean specificity of 64%, and so performed comparably, but slightly less well than the final logistic regression model that was used to compute the ROVAR score. This is in line with previously reported experience of machine-learning algorithms in this setting.
The ROVAR score derived from the final model is the predicted probability of relapse at 5 years from completion of combined (surgery and chemotherapy) treatment and ranges from 0.052 to 0.992 in the full data set. Using this score, patients can be stratified by risk of relapse using the following cutoff values: 0 to 0.33 = low risk, between 0.34 and 0.67 = intermediate risk, and 0.68 or greater = high risk. The calculations to generate this score are shown in Table 2, with examples in Figure 1.
Knowledge of a patient’s likelihood of relapse from OC is important for the planning and implementation of follow-up care. Until now, the most reliable predictor of a patient’s relapse risk has been their FIGO stage at diagnosis. Although other scores (4 nomograms and 2 scores) have improved on the FIGO stage as predictors of 5-year survival, they mostly considered only advanced (stage III or IV) OC and were based around residual disease after surgery, rather than after completion of combination frontline (ie, surgery plus chemotherapy) treatment summarized in Table 3.13–16 For this reason, these scores cannot be applied to predict risk of relapse.
In light of the above, we developed the ROVAR score with the aim of designing a score that could be applicable across all FIGO stages of OC. We showed that 4 variables contributed most strongly to risk of relapse, and these were (1) tumor stage at diagnosis, (2) tumor grade at diagnosis, (3) CA-125 at diagnosis, and (4) presence of residual disease on CT scan after chemotherapy completion. When we applied the score in our data set to measure the risk of relapse, we obtained an area under the ROC curve of 0.91. When we applied the FIGO stage with the same aim and to the same data set, the ROC curve was 0.80.The ROVAR score was therefore a better predictor of relapse than FIGO stage alone. The sensitivity and specificity of the ROVAR score, estimated on the full data set, were 93% and 65%, respectively. It includes presence of residual disease on completion of first-line (surgery plus chemotherapy) treatment, which we found to be one of the best predictors of relapse. Using the ROVAR score, each patient’s risk of relapse can be stratified into low, intermediate, or high risk of relapse. This can be used to provide an estimate of risk of relapse from the end of treatment (surgery and first-line chemotherapy) onward.
We compared the ROVAR score to other scores and nomograms published (summarized in Table 3). Although specific to OC, all were designed using retrospective data to predict 5-year survival, not relapse-free survival. Most considered only advanced (stage II or IV) OC and were based around residual disease after surgery, without including the presence or absence of disease after chemotherapy treatment
Our database was representative, we compared patient characteristics with those described in other published data and found them to be similar.17,18 Furthermore, more than 70% of our data set had advanced stage (III or IV) OC consistent with recent statistics.19 In our population, FIGO stage and histological grade were 2 variables significantly associated with risk of relapse. We did not find histological subtype to be an independent prognostic factor. This contradicts published studies showing that clear cell tumor has a poorer prognosis than same-stage serous tumor.20 Perhaps the histological subtype of OC was not a statistically significant independent prognostic factor in our population as the majority had serous histology. Only 17% of our cohort had rarer histological subtypes, such as clear cell tumors, carcinosarcoma, and mucinous tumors. Moreover, we showed tumor grade had prognostic significance, whereas other authors have reported that grade has prognostic significance only for serous tumors (between high- and low-grade disease), but is not of prognostic significance for mucinous, endometrioid, and clear cell tumors.21 This may also be explained by the low percentage of cases in our data set with a diagnosis of nonserous OC.
We found a strong association between CA-125 at diagnosis and risk of relapse, and this was confirmed by logistic regression. Our findings are in accordance with several epidemiologic studies on the association between CA-125 at diagnosis and survival from OC.22,23 In a recent multinational collaborative study involving 940 patients, the authors concluded that, especially in the context of serous OC, the higher the CA-125 at diagnosis, the greater the likelihood of the biomarker being independently associated with impaired disease-free and overall survival.24 We used a similar strategy and defined only those with CA-125 marker levels of greater than 200 U/mL as being true CA-125 “expressors” in view of the high number of serous OC patients included in our analysis. Interestingly, in our cohort, the level of CA-125 after chemotherapy treatment was less significantly associated with risk of relapse. This contradicts 3 small retrospective studies, which reported strong association between the CA-125 level postchemotherapy and prediction of progression-free survival and overall survival.25,26
In our model, we analyzed the residual disease defined on completion of cytoreductive surgery as well as that observed radiologically at treatment completion. We found that the presence or absence of measurable disease seen on CT scan after treatment completion had greater prognostic significance than the amount of measurable disease present on completion of surgery. This result appears reasonable, particularly in advanced stages because, in patients with inoperable extraperitoneal disease, radiological remission can be obtained only after chemotherapy, and the majority of patients within our cohort had advanced disease. We did not include age or comorbidities in our score as these can be limiting factors to optimal surgery and chemotherapy, themselves significant independent prognostic factors when compared with age and comorbidities.27,28 We also did not include pretreatment or posttreatment performance status as it was not longitudinally documented in the patients’ records during their treatment and has been shown to be unreliable when objectively assessed.29
A limitation of our study is that, although accurate for the majority of patients, the ROVAR score has relatively low specificity, with a prediction error of 10.7%. Thus, a healthcare professional using this score has a 10% chance of incorrectly reassuring a patient that her risk of relapse is low or falsely concerning her by informing her that her risk of relapse is high. This is an important consideration when designing an intervention around risk of relapse. Another potential limitation is that patient treatment during 2000–2010 may have differed to our current standard of care. Generally, however, now as then, standard treatment for primary OC was a combination of surgical cytoreduction and platinum-based chemotherapy. Another limitation is that approximately 30% of our population was excluded from analysis because of missing data.
In summary, the ROVAR score is a four-variable algorithm designed to predict risk of relapse after first-line treatment for OC. Of the 4 variables, FIGO stage, tumor grade, and pretreatment CA-125 level have been previously shown to be prognostic for 5-year survival, and the fourth, the presence of measurable disease on posttreatment CT scan, has never before been included within a prognostic score. The ROVAR score will require careful prospective validation in a large sample of OC patients before it is fully implemented. However, by allowing the stratification of patients into low, intermediate, or high risk of relapse once they have completed first-line treatment, the ROVAR score is a useful tool for allocating tailored, risk-appropriate survivorship and follow-up support for patients with OC.
2. Siegel R, Naishadham D, Jemal A. Cancer statistics. Ca Cancer J Clin. 2013; 63: 11–30.
3. on behalf of the ESMO Guidelines Working Group. Newly diagnosed and relapsed epithelial ovarian carcinoma: ESMO Clinical Practice Guidelines for diagnosis, treatment and follow-up. Ann Oncol. 2013; 24 (suppl 6): vi24–vi32.
4. Nama V, Nordin A, Bryant A. Patient-reported outcome measures for follow-up after gynaecological cancer treatment. Cochrane Database Syst Rev. 2013;( 11): CD010299.
5. Gynecologic Oncology Group. Phase III trial of carboplatin and paclitaxel compared with cisplatin and paclitaxel in patients with optimally resected stage III ovarian cancer: a Gynecologic Oncology Group study. J Clin Oncol. 2003; 21: 3194–3200.
6. Jorgensen TL, Teiblum S, Paludan M, et al. Significance of age and comorbidity on treatment modality, treatment adherence and prognosis in elderly ovarian cancer patients. Gynecol Oncol. 2012; 127: 367–374.
7. Lee YY, Kim TJ, Kim MJ, et al. Prognosis of ovarian clear cell carcinoma compared to other histological subtypes: a meta-analysis. Gynecol Oncol. 2011; 122: 541–547.
8. Peiretti M, Zanagnolo V, Aletti GD, et al. Role of maximal primary cytoreductive surgery in patients with advanced epithelial ovarian and tubal cancer: surgical and oncological outcomes. Single institution experience. Gynecol Oncol. 2010; 119: 259–264.
9. Hofstetter G, Concin N, Braicu I, et al. The time interval from surgery to start of chemotherapy significantly impacts prognosis in patients with advanced serous ovarian carcinoma analysis of patient data in the prospective OVCAD study. Gynecol Oncol. 2013; 131: 15–20.
10. Meunier L, Puiffe ML, Le Page C, et al. Effect of ovarian cancer: ascites on cell migration and gene expression in an epithelial ovarian cancer in vitro model. Trans Oncol. 2010; 3: 230–238.
11. Hosmer DW, Lemeshow S. Applied logistic regression, New York: John Wiley & Sons, Inc, 1989.
12. Westreich D, Lessler J, Jonsson Funk M. Propensity score estimation: machine learning and classification methods as alternatives to logistic regression. J Clin Epidemiol. 2010; 63: 826–833.
13. Clark TG, Stewart ME, Altman DG, et al. A prognostic model for ovarian cancer. Br J Cancer. 2001; 85: 944–952.
14. Chi DS, Palayekar MJ, Sonoda Y, et al. Nomogram for serviva after primary surgery for bulky stage IIIC ovarian carcinoma. Gynecol Oncol. 2008; 108: 191–194.
15. Gerestein CG, Eijkemans MJ, de Jong D, et al. The prediction of progression-free and overall survival in women with advanced stage epithelial ovarian carcinoma. Br J Gynecol. 2009; 116: 372–380.
16. Barlin JN, Changhong YU, Hill EK, et al. Nomogram for predicting 5 year disease specific mortality after primary surgery for epithelial ovarian cancer. Gynecol Oncol. 2012; 125: 25–30.
17. Seidman JD, Yemelvanova A, Cosin JA, et al. Survival rates for International federation of gynecology and obstetrics stage III ovarian carcinoma by cell type: a study of 262 unselected patients with uniform pathologic review. Int J Gynecol Cancer. 2012; 22: 367–371.
18. Granstrom C, Sundquist J, Hemminki K. Population attributable fractions for ovarian cancer in Swedish women by morphological type. Br J Cancer. 2008; 98: 199–205.
19. de Angelis R, Sant M, Coleman MP, et al. Cancer survival in Europe 1999-2007 by country and age: results of EUROCARE-5 a population-based study. Lancet Oncol. 2013; 15: 931–942.
20. Miyamoto M, Takano M, Goto T, et al. Clear cell histology as a poor prognostic factor for advanced epithelial ovarian cancer: a single institutional case series through central pathologic review. J Gynecol Oncol. 2013; 24: 37–43.
21. Bamias A, Sotiropoulou M, Zagouiri F, et al. Prognostic evaluation of tumour type and other histological characteristics in advanced epithelial ovarian cancer, treated with surgery and paclitaxel/carboplatin chemotherapy: cell type is the most useful prognostic factor. Eur J Cancer. 2012; 48: 1476–1483.
22. Song MJ, Lee SH, Choi MR, et al. Diagnostic value of CA 125 as a predictor of recurrence in advanced ovarian cancer. Eur J Gynaecol Oncol. 2013; 34: 148–151.
23. Gupta D, Lis CG. Role of CA 125 in predicting ovarian survival a review of the epidemiological literature. J Ovarian Res. 2009; 2: 1–20.
24. Geisler JP, Miller GA, Lee TH, et al. Relationship of preoperative serum CA 125 to survival in epithelial ovarian cancer. J Reprod Med. 1996; 41: 140–142.
25. Tang A, Kondalsamy-Chennakesavan S, Ngan H, et al. Prognostic value of elevated preoperative serum CA 125 in ovarian tumours of low malignant potential: a multinational collaborative study (ANZGOG0801). Gynecol Oncol. 2012; 126: 36–40.
26. Ron IG, Inbar M, Gelernter I, et al. Use of CA 125 response to predict survival parameters of patients with advanced ovarian carcinoma. Acta Obstet Gynecol Scand. 1994; 73: 658–662.
27. Chan JK, Urban R, Cheung MK, et al. Ovarian cancer in younger vs older women: a population-based analysis. Br J Cancer. 2006; 95: 1314–1320.
28. Sperling C, Noer MC, Christensen IJ, et al. Comorbidity is an independent prognostic factor for the survival of ovarian cancer: a Danish register-based cohort study from a clinical database. Gynecol Oncol. 2013; 129: 97–102.
29. Blagden SP, Charman SC, Sharples LD, et al. Performance status score: do patients and their oncologists agree? Br J Cancer. 2003; 89: 1022–1027.
Keywords:© 2015 by the International Gynecologic Cancer Society and the European Society of Gynaecological Oncology.
CA-125; Ovarian cancer; Prognostic factors; Relapse; ROVAR