Journal of Pediatric Hematology/Oncology:
Clinical and Laboratory Observations
Decision Analysis of Treatment Strategies in Children With Severe Sickle Cell Disease
O'Brien, Sarah H. MD, MSc* †; Hankins, Jane S. MD, MS‡
*Center for Innovation in Pediatric Practice, The Research Institute at Nationwide Children's Hospital
†Division of Pediatric Hematology/Oncology, Nationwide Children's Hospital, Columbus, OH
‡Department of Hematology, St. Jude Children's Research Hospital, Memphis, TN
Reprints: Sarah O'Brien, MD, MSc, The Research Institute at Nationwide Children's Hospital, 700 Children's Drive, Columbus, OH 43205 (e-mail: firstname.lastname@example.org).
Received for publication January 20, 2009
accepted July 18, 2009
Supported in part by the American Lebanese Syrian Associated Charities.
We designed a decision analysis model comparing 4 treatment strategies for severe sickle cell disease: no intervention, hydroxyurea (HU), chronic transfusion, or stem cell transplant (SCT). The treatment strategy associated with the highest average utility (quality of life) was SCT (0.85). Average utilities for no treatment, chronic transfusion, and HU were 0.68, 0.71, and 0.80, respectively. Our model was quite sensitive to quality-of-life estimates, indicating that a true comparison of HU and transplantation cannot occur until investigators directly measure the health-related quality of life in children with sickle cell disease during HU therapy and after SCT.
Sickle cell disease (SCD) is a genetic disease in which the substitution of a single amino acid causes the production of the abnormal hemoglobin S. Despite a common genotype, there is a large degree of clinical variability in the pattern and severity of disease manifestations. Patients with a history of sickle cell-related complications, such as recurrent acute chest syndrome and 3 or more episodes of vaso-occlusive events within 12 months have been classified as having severe disease in previous clinical trials for adult and pediatric patients with SCD.1–3
To date, 3 interventional treatments have been separately tested and shown to be effective in decreasing the acute and long-term complications of SCD: hydroxyurea (HU) therapy, chronic transfusions (CTXs), and hematopoietic stem cell transplantation.1,3,4 These treatments have different efficacy and toxicity rates, but no randomized studies have been conducted to compare them directly. Because of the variation in risk-benefit profiles for each intervention, there is little consensus among sickle cell clinicians when recommending a therapy.
When definitive answers from randomized clinical trials are not available to answer a clinical question, decision analysis can be used as a tool in medical decision making. In this simulation model-based technique, an investigator combines information from a variety of sources to create a mathematical model representing a clinical decision.5 First, the investigator structures the clinical problem as a decision tree representing the temporal sequence of possible clinical events. Next, data are collected to estimate the probability of each event, as well as the expected risks, benefits, and sometimes costs of each strategy. The decision tree is then analyzed to identify which strategy has the highest expected value, and is therefore the preferred course of action. The probabilities for an outcome or health state should be estimated from the best available information source, such as a significant clinical trial published in the area.
Decision analysis can also consider the patient's individual preference for a health state (utility). Health state utilities are usually assessed relative to 2 extremes, referred to as anchor states. Commonly used anchor states are “death,” assigned value of 0, and “live in perfect health,” assigned value of 1. Utility can be estimated or measured. Estimation can be performed in 3 different ways: arbitrarily assigning values based on an expert's judgment, asking a group of experts to reach a consensus, or searching for relevant published utility values in the literature. Utility can be directly measured in subjects using reliable and valid techniques such as time-trade off, standard gambling, and visual analog scales.6 Utility can also be measured using preference-based quality-of-life inventories such as the Health Utility Index or the EuroQol-5D.
Few decision analysis studies have been published in SCD. Mazumdar et al7 explored the optimal frequency of transcranial Doppler screening. Nietert et al8 compared stem cell transplant (SCT) to periodic blood transfusions in patients with abnormal transcranial Dopplers. Our objective was to develop a preliminary decision analysis model for pediatric patients with severe SCD due to recurrent vaso-occlusive events to identify key variables of interest to guide future research. The model takes into account current knowledge of treatment risks and benefits for the 3 available treatments for SCD (HU, CTXs, and stem cell transplantation) and estimated patient preferences for health states.
MATERIALS AND METHODS
As reviewed by Burd and Sonnenberg,5 there are 4 basic steps to applying decision analysis to a given clinical dilemma. These steps include: (1) identify and define the scope of the problem, (2) structure the problem in the form of a decision tree, (3) collect data to estimate the probability of each event and quantify outcomes, and (4) analyze the decision tree to determine the preferred course of action.
Identify and define the scope of the problem: in decision analysis, it is critical to precisely define both the patient population under study, and the clinical strategies being compared. In our model, the study population was comprised of patients with clinically severe SCD followed over a 5-year time period. Although the appropriate definition of severe SCD remains debated within the field, we chose a definition used in previously published multicenter studies of HU and SCT.1–3,9 Therefore, severe disease was defined as patients with HbSS or HbSβ0-thalassemia and ≥2 acute chest syndrome events in a 2-year period, ≥3 pain episodes requiring emergency room visit or hospital admission in a 12-month period, or a combination of any of the 2 totaling 3 episodes in a 12-month period. The clinical decision in our model involves a choice between (1) no intervention, (2) HU, (3) CTX, and (4) SCT.
Constructing the decision tree: once the study population and problem are defined, the problem is structured in the form of a decision tree (Fig. 1). The square node represents the decision to choose one of 4 possible treatment strategies. Once the strategy has been chosen, subsequent events occur by chance, and are called “chance nodes” represented by circles, such as the chance of developing graft versus host disease after a SCT. At the end of each tree branch is a terminal node (represented by a triangle), which represents the health outcomes associated with the full sequence of events in that pathway. In this model, the health outcome of interest was quality-adjusted life-years (QALYs). We constructed and analyzed our model using Tree Age Pro Suite 2008 (TreeAge, Williamstown, MA).
Estimating probabilities and outcome measures: model estimation involves assigning estimates for clinical probabilities and quality-of-life measures to each branch of the decision tree. Usually the exact value cannot be estimated with certainty. Therefore, the value that is believed to be the best estimate is used in the base case analysis. We obtained probabilities for most health states from a literature search using PubMed and OVID search engines. The following key words were used: SCD, HU, CTX, SCT, mortality, side effects, pediatrics, children, iron overload, graft versus host disease (GVHD), and graft failure. Five-year probabilities for survival, treatment efficacies, and complications were extracted from published pediatric studies (Table 1). When more than 1 study was available for a particular clinical probability, the study with the largest sample size was used for the base case estimate. Utilities for various health states were estimated by a physician with experience in treating patients with SCD (J.S.H.), based on values used in a published decision analysis comparing SCT to CTX in SCD patients with abnormal transcranial Dopplers.8 Our utility estimates for SCD (0.7 for untreated severe SCD) were also comparable with those reported for more common chronic conditions in the Health and Activity Limitation Index (HALex), such as diabetes (mean HALex=0.62), and congenital heart disease (mean HALex=0.68).27 As death from iron overload due to heart dysfunction from myocardium iron accumulation is extremely low in SCD, particularly in our brief 5-year time period, mortality attributed to blood transfusions was estimated based on mortality rates from transfusion-associated lung injury.21,28 No deaths attributed to HU therapy have been found in the literature in the pediatric population, and an adult study of long-term use of HU did not find HU toxicity as the cause of death in a cohort of 152 treated adults.19,29
Choosing the preferred course of action (model analysis): decision trees are analyzed from right to left using a process called rolling back. In this model, each chance node was assigned a value equal to the sum of the utility for each branch weighted by their respective probabilities. The strategy associated with the highest utility was defined as the preferred course of action.
Sensitivity analysis is an important tool for handling the uncertainty inherent in any decision analysis model and evaluates the effect of alternative assumptions on the final result. If changing a variable over a reasonable range of values changes the preferred strategy, the model is considered sensitive to that variable. We performed 1-way sensitivity analysis, in which each model input is varied one at a time, for all probabilities and utilities in the model (Table 1). All probabilities from published pediatric studies, or in a few cases adult studies, were used as plausible ranges in sensitivity analysis for clinical probabilities. Finally, we performed an additional sensitivity analysis, in which we varied probabilities widely to identify any threshold values at which the preferred strategy changed. Due to the uncertainty in utility estimates, each estimate was widely ranged between +0.2 and −0.2 the baseline utility.
Analysis, of rolling back, or our decision tree revealed that the treatment strategy associated with the highest average utility (quality of life) over a 5-year period was SCT (0.85) (Fig. 2). Average utilities for no treatment, CTX, and HU were 0.68, 0.71, and 0.80, respectively. [To put these numbers into perspective, recall that utilities range from 0 (death) to 1 (perfect health)].
One-way sensitivity analysis of clinical parameters over plausible ranges based on variation seen in the published literature revealed that SCT was the preferred strategy in the large majority of scenarios. One exception was that if the estimated utility of a patient status-post-SCT was <0.89, then HU would be preferred over SCT (Table 2). When varying probability estimates over ranges beyond our original sensitivity analysis, we identified additional scenarios in which HU would be preferred over SCT; for example, if the mortality of SCT is ≥11%, or the probability of graft failure is ≥23%.
We found that our model was more sensitive to variation in quality-of-life measurements than the probability of clinical complications. When varying utility estimates, we found that our model was quite sensitive to the quality of life experienced by children on HU therapy (both those who continue to have severe disease and those who respond well to HU) and the quality of life experienced by children who undergo SCT not complicated by graft failure or chronic graft versus host disease.
This seems to be the first time decision analysis has been used to compare treatment strategies in children with clinically severe SCD. We found that SCT was associated with the highest average quality of life, followed by HU and CTXs. Unfortunately, all of the data available regarding SCD and SCT are on the basis of SCT performed using HLA-matched sibling donors, and <10% of patients with SCD have a matched sibling. Even in patients with matched siblings, however, recommending SCT over HU remains a difficult decision for clinicians, as transplant is associated with its own morbidity and low, but not negligible, mortality. The results of our model demonstrate that quality of life is also an important factor to consider in this decision.
Our decision analysis model has several limitations that should be noted. First, our model of SCD only follows patients for 5 years, and is simplistic given the heterogeneity and complexity of this patient population. Even the definition of “severe sickle cell disease” remains a hotly debated point within the field. Our definition was based on definitions used in the referenced clinical trials we extracted data from. However, this definition does not include patients with stroke or those with repetitive pain episodes which are managed at home but have substantial negative impacts on quality of life. The probability of adherence to therapy and the effects of poor adherence on health outcomes were also not considered. We view this model as a “place to start” in the consideration of the impact of clinical probabilities and quality of life in therapeutic decision making for patients with severe SCD. As more data accumulate on the use of HU and SCT in SCD, and in particular data on the long term outcome of these patients, we hope that future models will be able to handle additional complexity and a longer time frame. As there are few published pediatrics studies, our clinical probability estimates were dependent on small cohorts with limited follow-up periods. Larger studies with much longer longitudinal follow-up would allow for more accurate mortality rates. For example, we found that if the mortality of SCT is ≥11%, then transplant is no longer the preferred strategy, a number that is not much higher than published estimates.
Owing to the absence of direct reports of quality of life from patients with SCD, the most important limitation of our study is that health state utilities were estimated by a physician, with input from a previously published decision analysis and the HALex. However, this previously published model comparing SCT to CTX in SCD patients with abnormal transcranial Doppler was similarly limited.8 Ideally, utilities should be measured directly from patients experiencing the health state in question, which can be done in several different ways. An investigator can measure utilities directly by performing a choice-based valuation technique such as the standard gamble or time trade-off.30 However, these are time consuming and complex tasks. They are particularly challenging in pediatric research because they require a lengthy attention span and a minimum sixth-grade reading level.31
The sensitivity of our model to utility estimates, however, demonstrates the necessity of eliciting quality-of-life data from children with SCD who undergo SCT or HU therapy. An alternative, and more feasible, method of directly measuring utilities would be to use a prescored multiattribute health status classification system, such as the Health Utilities Index or the EuroQol-5D.6 Formulas have been developed to calculate utilities using patient responses to these generic quality-of-life instruments, which are easier and faster to administer and require less advanced reading levels. Panepinto et al recently showed the feasibility of directly measuring utilities by demonstrating that the Pediatric Quality of Life Inventory generic core scales (PedsQL) is a feasible, reliable, and valid tool to measure health-related quality of life in children with SCD, and that the parent proxy-report differentiates well between children with mild and severe disease.24,32
In summary, we performed an initial decision analysis model to identify variables of interest when comparing 4 clinical strategies for severe SCD—no treatment, HU therapy, CTXs, and stem cell transplantation. Our model reveals that a true comparison of HU and SCT, the 2 most attractive strategies, cannot occur until investigators directly measure the health-related quality of life in sickle cell patients after SCT and during HU therapy.
1. Charache S, Terrin ML, Moore RD, et al. Effect of hydroxyurea on the frequency of painful crises in sickle cell anemia. Investigators of the multicenter study of hydroxyurea in sickle cell anemia. N Engl J Med. 1995;332:1317–1322.
2. Ferster A, Tahriri P, Vermylen C, et al. Five years of experience with hydroxyurea in children and young adults with sickle cell disease. Blood. 2001;97:3628–3632.
3. Walters MC, Storb R, Patience M, et al. Impact of bone marrow transplantation for symptomatic sickle cell disease: an interim report. Multicenter investigation of bone marrow transplantation for sickle cell disease. Blood. 2000;95:1918–1924.
4. Miller ST, Wright E, Abboud M, et al. Impact of chronic transfusion on incidence of pain and acute chest syndrome during the Stroke Prevention Trial (STOP) in sickle-cell anemia. J Pediatr. 2001;139:785–789.
5. Burd RS, Sonnenberg FA. Decision analysis: a basic overview for the pediatric surgeon. Semin Pediatr Surg. 2002;11:46–54.
6. Drummond MF, Sculpher MJ, Torrance GW, et al. Methods for the Economic Evaluation of Health Care Programmes. 3rd ed. Oxford [England]; New York: Oxford University Press; 2005;147–154.
7. Mazumdar M, Heeney MM, Sox CM, et al. Preventing stroke among children with sickle cell anemia: an analysis of strategies that involve transcranial Doppler testing and chronic transfusion. Pediatrics. 2007;120:e1107–e1116.
8. Nietert PJ, Abboud MR, Silverstein MD, et al. Bone marrow transplantation versus periodic prophylactic blood transfusion in sickle cell patients at high risk of ischemic stroke: a decision analysis. Blood. 2000;95:3057–3064.
9. Scott JP, Hillery CA, Brown ER, et al. Hydroxyurea therapy in children severely affected with sickle cell disease. J Pediatr. 1996;128:820–828.
10. Ferster A, Vermylen C, Cornu G, et al. Hydroxyurea for treatment of severe sickle cell anemia: a pediatric clinical trial. Blood. 1996;88:1960–1964.
11. Hankins JS, Ware RE, Rogers ZR, et al. Long-term hydroxyurea therapy for infants with sickle cell anemia: the HUSOFT extension study. Blood. 2005;106:2269–2275.
12. Jayabose S, Tugal O, Sandoval C, et al. Clinical and hematologic effects of hydroxyurea in children with sickle cell anemia. J Pediatr. 1996;129:559–565.
13. Koren A, Segal-Kupershmit D, Zalman L, et al. Effect of hydroxyurea in sickle cell anemia: a clinical trial in children and teenagers with severe sickle cell anemia and sickle cell beta-thalassemia. Pediatr Hematol Oncol. 1999;16:221–232.
14. Rogers ZR. Hydroxyurea therapy for diverse pediatric populations with sickle cell disease. Semin Hematol. 1997;34:42–47.
15. Hankins J, Jeng M, Harris S, et al. Chronic transfusion therapy for children with sickle cell disease and recurrent acute chest syndrome. J Pediatr Hematol Oncol. 2005;27:158–161.
16. Styles LA, Vichinsky E. Effects of a long-term transfusion regimen on sickle cell-related illnesses. J Pediatr. 1994;125:909–911.
17. Leikin SL, Gallagher D, Kinney TR, et al. Mortality in children and adolescents with sickle cell disease. Cooperative Study of Sickle Cell Disease. Pediatrics. 1989;84:500–508.
18. Prasad R, Hasan S, Castro O, et al. Long-term outcomes in patients with sickle cell disease and frequent vaso-occlusive crises. Am J Med Sci. 2003;325:107–109.
19. Steinberg MH, Barton F, Castro O, et al. Effect of hydroxyurea on mortality and morbidity in adult sickle cell anemia: risks and benefits up to 9 years of treatment. JAMA. 2003;289:1645–1651.
20. Bakanay SM, Dainer E, Clair B, et al. Mortality in sickle cell patients on hydroxyurea therapy. Blood. 2005;105:545–547.
21. Zambon M, Vincent JL. Mortality rates for patients with acute lung injury/ARDS have decreased over time. Chest. 2008;133:1120–1127.
22. Bernaudin F, Souillet G, Vannier JP, et al. Report of the French experience concerning 26 children transplanted for severe sickle cell disease. Bone Marrow Transplant. 1997;19(suppl. 2):112–115.
23. Vermylen C, Cornu G, Ferster A, et al. Haematopoietic stem cell transplantation for sickle cell anaemia: the first 50 patients transplanted in Belgium. Bone Marrow Transplant. 1998;22:1–6.
24. Panepinto JA, Walters MC, Carreras J, et al. Matched-related donor transplantation for sickle cell disease: report from the Center for International Blood and Transplant Research. Br J Haematol. 2007;137:479–485.
25. Harmatz P, Butensky E, Quirolo K, et al. Severity of iron overload in patients with sickle cell disease receiving chronic red blood cell transfusion therapy. Blood. 2000;96:76–79.
26. Karam LB, Disco D, Jackson SM, et al. Liver biopsy results in patients with sickle cell disease on chronic transfusions: poor correlation with ferritin levels. Pediatr blood cancer. 2008;50:62–65.
27. Gold MR, Franks P, McCoy KI, et al. Toward consistency in cost-utility analyses: using national measures to create condition-specific values. Med Care. 1998;36:778–792.
28. Wood JC, Tyszka JM, Carson S, et al. Myocardial iron loading in transfusion-dependent thalassemia and sickle cell disease. Blood. 2004;103:1934–1936.
29. Brawley OW, Cornelius LJ, Edwards LR, et al. National institutes of health consensus development conference statement: hydroxyurea treatment for sickle cell disease. Ann Intern Med. 2008;148:932–938.
30. O'Brien SH. Decision analysis in pediatric hematology. Pediatr clin N Am. 2008;55:287–304, vii.
31. Griebsch I, Coast J, Brown J. Quality-adjusted life-years lack quality in pediatric care: a critical review of published cost-utility studies in child health. Pediatrics. 2005;115:e600–e614.
32. Panepinto JA, Pajewski NM, Foerster LM, et al. The performance of the PedsQL generic core scales in children with sickle cell disease. J Pediatr Hematol Oncol. 2008;30:666–673.
sickle cell disease; sickle cell anemia; decision analysis; decision making; quality of life
© 2009 Lippincott Williams & Wilkins, Inc.
Highlight selected keywords in the article text.