Secondary Logo

Share this article on:

Patient and Oncology Nurse Preferences for the Treatment Options in Advanced Melanoma

A Discrete Choice Experiment

Liu, Frank Xiaoqing, PhD; Witt, Edward A., PhD; Ebbinghaus, Scot, MD; DiBonaventura Beyer, Grace, MBA; Basurto, Enrique, MSc; Joseph, Richard W., MD

doi: 10.1097/NCC.0000000000000557

Background Understanding the perceptions of patients and oncology nurses about the relative importance of benefits and risks associated with newer treatments of advanced melanoma can help to inform clinical decision-making.

Objectives The aims of this study were to quantify and compare the views of patients and oncology nurses regarding the importance of attributes of treatments of advanced melanoma.

Methods A discrete choice experiment (DCE) was conducted in US-based oncology nurses and patients diagnosed with advanced melanoma. Patients and nurses were enlisted through online panels. In a series of scenarios, respondents had to choose between 2 hypothetical treatments, each with 7 attributes: mode of administration (MoA), dosing schedule (DS), median duration of therapy (DoT), objective response rate (ORR), progression-free survival (PFS), overall survival (OS), and grade 3 or 4 adverse events (AEs). Hierarchical Bayesian logistic regression models were used to estimate preference weights.

Results A total of 200 patients with advanced melanoma and 150 oncology nurses participated. The relative importance estimates of attributes by patients and nurses, respectively, were as follows: OS, 33% and 28%; AEs, 29% and 26%; ORR, 25% and 27%; PFS, 12% and 15%; DS, 2% and 3%; DoT, 0% and 0%; and MoA, 0% and 0%.

Conclusion Both patients and oncology nurses valued OS, ORR, and AEs as the most important treatment attributes for advanced melanoma, followed by PFS, whereas DS, DoT, and MoA were given less value in their treatment decisions.

Implications for Practice Oncology nurses and patients have similar views on important treatment considerations for advanced melanoma, which can help build trust in shared decision-making.

Author Affiliations: Merck & Co, Inc, Kenilworth, New Jersey (Drs Liu and Ebbinghaus); Kantar Health, New York, New York (Dr Witt, Ms Beyer, and Mr Basurto); and Mayo Clinic, Jacksonville, Florida (Dr Joseph).

F.X.L. and S.E. are employees of Merck & Co, Inc, Kenilworth, New Jersey, who provided funding for this study and is a manufacturer of medication therapy used to treat melanoma. G.D.B., E.B., and E.A.W. are employees of Kantar Health. Kantar Health received funding from Merck & Co, Inc, for conducting this study. R.W.J. served as a paid consultant for the study project for Merck & Co, Inc, to provide a clinical perspective but did not receive compensation related to the development of this article.

Correspondence: Frank Xiaoqing Liu, PhD, Center for Observational and Real World Evidence, MRL, 351 N Sumneytown Pike, North Wales, PA 19454-1099 (

Accepted for publication July 11, 2017.

This is an open-access article distributed under the terms of the Creative Commons Attribution-Non Commercial-No Derivatives License 4.0 (CCBY-NC-ND), where it is permissible to download and share the work provided it is properly cited. The work cannot be changed in any way or used commercially without permission from the journal.

According to the Surveillance, Epidemiology, and End Results Program of the National Cancer Institute, there will be an estimated 76 380 new cases of skin melanoma in the United States in 2016, and an estimated 10 130 people will die as a result of the disease.1 Patients with unresectable or metastatic (advanced) melanoma clinically have the most advanced form and are often difficult to cure because the cancer has spread to the lymph nodes or other locations in the body. The 5-year survival rates for skin melanoma dramatically differ depending on whether it is localized (98.4%), regional (62.9%), or distant (17.9%).1

After years of limited treatment options for advanced melanoma, newer forms of immunotherapy and targeted drugs have emerged as being more effective than chemotherapy.2 Immunotherapy drugs include pembrolizumab (Keytruda), nivolumab (Opdivo), and ipilimumab (Yervoy), whereas targeted therapy drugs include cobimetinib (Cotellic), vemurafenib (Zelboraf), dabrafenib (Tafinlar), and trametinib (Mekinist). These drugs can be prescribed as monotherapy or combination therapy, which offer potential benefits over monotherapy but may place patients at risk for more frequent or more severe adverse effects.3 In addition, there are other important characteristics associated with treatment regimens such as complexity of dosing schedule, mode of administration (ie, oral vs intravenous), and frequency of infusion.

As new treatment options become available, assessing the value patients and healthcare providers place on key attributes of treatment can ultimately lead to better clinical decisions and outcomes for advanced melanoma patients. The American Cancer Society emphasizes that it is “important to carefully consider the possible benefits and side effects of any recommended treatment before starting it.”2 Engagement of patients is consistent with the movement toward patient-centered care introduced by the 2010 Affordable Care Act that seeks to improve the evidence for patient care experience, treatment decisions, and health outcomes by engaging patients as key stakeholders in healthcare.4 With the emergence of the patient as a central focus in healthcare, investigations have begun to seek to understand aspects of treatment that the patient and, often, the physician and nurse consider important to patient care and outcomes.

Among healthcare stakeholders involved in cancer care, oncology nurses have a unique position, particularly with respect to treatment management. They help to coordinate patient care and spend much of their time in direct patient contact, including in the administration of therapy, and thus have a unique insight into a range of patient experiences. For these reasons, it is important to understand the extent to which oncology nurses and patients' perceptions of the benefits and risks of treatment are aligned. One established method for eliciting preferences is the discrete choice experiment (DCE), which has been used increasingly in health economics.5,6 The DCE uses a decomposed approach where 2 or more characteristics or “attributes” of a treatment such as adverse effect rate or survival time can be implicitly valued by presenting a respondent with pairs of hypothetical treatment profiles and asking them which profile they would prefer. Such information can also guide the development of a shared decision tool to assist these key audiences to identify the most appropriate treatment for the patient—taking into consideration both clinical and nonclinical aspects of treatment regimens.

Back to Top | Article Outline


The aims of this study were to quantify and compare the views of patients and oncology nurses in the United States regarding key attributes associated with treatments of advanced melanoma using a derived preference-based approach, the DCE. These aspects of medication treatment included positive and negative outcomes such as overall survival (OS) and severe, life-threatening, and/or disabling adverse effects, as well as the patient treatment experience, such as length of infusion time and dosing schedule.

Back to Top | Article Outline



Patients and nurses were enlisted through online panels. The database for patients was established by the Endeavour network through relationships with advocacy groups and direct relationships/previous work with advanced melanoma patients. Nurses were recruited from US-based nurses in the All Global commercial panel or All Global panel partners who are fellow Trust Alliance Members. The US-based panel of nurses is 10% male and 90% female, ages 29 to 39 years (20%), 40 to 55 years (65%), and 56 to 75 years (15%); regional representation is as follows: midwest, 19%; west, 21%; south, 31%; and northeast, 29%. To participate, advanced melanoma patients had to meet all of the following criteria: 18 years or older, diagnosed with advanced melanoma, had an Eastern Cooperative Oncology Group performance status rating between 0 and 3, were able to operate a computer with Internet access, were able to read and understand English, and provided informed consent to participate. For oncology nurses to participate, they had to meet all of the following criteria: practiced nursing between 3 and 30 years, worked in an oncology practice as a nurse practitioner/infusion nurse working with oncologists, involved in assisting physicians with advanced melanoma patients/prescribing treatment or in administering systemic treatments to advanced melanoma patients, spent at least 75% of their time on direct patient care, saw/treated a minimum number of cancer (~80 monthly) and advanced melanoma (~4 monthly) patients, had access to and knowledge of how to operate a computer with access to a Web site during the interview, were able to read and understand English, and provided informed consent to participate.

Back to Top | Article Outline

Study Design

In this study, respondents were asked to choose between 2 hypothetical treatment profiles for advanced melanoma (no real treatments or treatment names were mentioned), where each scenario is presented in the form of a paired comparison (as illustrated in Figure 1). A preference weight for each attribute level is derived by modeling, which quantifies the willingness to accept trade-offs related to outcomes (eg, survival), adverse effects, and other important nonclinical treatment characteristics (eg, dosing schedule). Discrete choice experiment has been applied in various disease areas, including oncology, and offers stakeholders a mechanism to participate in decision-making. Before the main study, qualitative pilot interviews were conducted to assess task comprehension, key attributes of treatment, and other elements in the survey. Pilot interviews were conducted in a total of 28 people (12 oncologists, 8 patients, and 8 nurses). Participants were asked about their experience with advanced melanoma and its treatment and to identify the aspects of treatment they felt were most important considerations for the patient. The interviews were conducted by an experienced moderator through telephone for approximately 60 minutes. All stimuli materials (questionnaire/DCE tasks) were shown via desktop sharing. All interviews were anonymous, and the respondents were not identifiable to the moderator.

Figure 1

Figure 1

Attribute levels were chosen to encompass a range salient to respondents, even if those levels were hypothetical or not feasible given currently available therapies. The DCE tasks were evaluated with each of the stakeholder groups to ensure that the stakeholders understand the preference decisions and would be able to make these choices with the information at hand. In addition to the DCE tasks, all other questions were also reviewed to ensure that these were clear and understood and that response categories encompassed the range of possible responses. The refined survey included 7 attributes: mode of administration, dosing schedule, median duration of therapy (3, 8, and 12 months), objective response rate (ORR) (15%, 33%, and 65% chance of response), progression-free survival (PFS) (3, 5, and 11.5 months), OS (45%, 55%, and 75% survival to 12 months), and grade 3 or 4 adverse events (AEs) (10%, 32%, and 55% likelihood of occurrence) (Table 1). Each attribute had 3 levels except dosing schedule (8 levels). Each hypothetical treatment profile was created by varying the levels of each of the 7 attribute, for example, OS being an attribute, and the level referring to the percentage of patients who survived to 12 months. Following guidelines issued by the International Society of Pharmacoeconomics and Outcomes Research,7–9 the experimental design (ie, the combination of attributes and levels presented to respondents) was developed using the D-efficiency algorithm available in SAS version 9.3. This method ensured that a sufficient number of respondents were presented with sufficient combinations of attributes and levels to estimate a preference function. Restrictions were imposed in the various designs to prevent respondents from seeing combinations that may be either unrealistic or illogical (eg, oral and infusion every 3 weeks). Each respondent was presented with 11 choice-based scenarios. Sample sizes were determined by 2 separate considerations: attaining an acceptable expected margin of error given the DCE design (88 scenarios, 8 blocks) and obtaining a large enough sample for each stakeholder group to reflect the likely diversity of responses within that group. An a priori power analysis suggested that a sample of 150 would be necessary to obtain an expected margin of error of ±5% to 9% given the DCE design. Because we expected preferences to vary more for patients than for nurses, a larger patient sample size was targeted (N =200).

Table 1

Table 1

The survey also included several non–DCE-related questions that asked the respondents directly about importance of the medication attributes by asking them to select the 3 most important attributes to them. All study materials and procedures were reviewed and approved before study execution by Pearl Institutional Review Board (Indianapolis, Indiana).

Back to Top | Article Outline


First, the levels of stability and consistency of responses were examined to identify those whose response patterns suggested a lack of attention in completing the task. Respondents were excluded from analysis if they failed basic validity checks, such as providing clearly inconsistent selections by choosing profiles containing less desirable characteristics, providing responses with little variability, completing the survey much faster than expected, and/or providing numeric values that were disproportionately higher compared with the average (outliers).

Relative preference weights for each attribute level were estimated using a hierarchical Bayesian logistic regression model with effect coding parameterization. The reference “level” in effect coding parameterization is the average across the levels tested in each attribute rather than a specific level itself (as in dummy coding). For any given respondent, all levels start by having an equal probability of being selected. The choices made by the individual during the DCE determine the departures from that assumed equilibrium (or reference) point. For example, equal probability in a 2-level attribute means a 50/50 split (ie, equal chance for both attributes of being selected, which equals “0” in log-likelihood scale). The hierarchical Bayesian logistic model estimates the departures from the assumed average (0) depending on the number of times that an individual selected a given alternative compared with the other alternatives presented.

The models were used to calculate an intercept, interpreted as the expected value taken over all predictor variables (ie, each of the 7 attributes), and the parameter estimates interpreted as deviations from the overall expected value. The coefficients are viewed as part-worth utilities, which also serve as inputs to the relative importance analysis. The relative importance estimates of the predictors were calculated through traditional analysis of variance methods where deviations of the part-worth utilities from the overall expected value are used to create sums of squares for each individual attribute. The resulting sums of squares were then divided by the attribute-specific degrees of freedom (number of levels minus 1) to account for the differences in the number of levels of the different attributes and then used in analysis of variance models to determine the importance of each attribute. Parametric hypothesis testing methods (ie, t tests) were used to determine whether 2 sets of parameters from independent samples (ie, patients and nurses) were statistically significantly different from each other.9 We also conducted exploratory subgroup analyses in the patient group based on age (<55 and 55 years and older), income, education (college degree or no college degree), and location (urban or rural) and in the nurses based on years in practice, type of nurse (nurse, nurse practitioner), and practice location (urban or rural). Because of the possibility for a type 1 error to multiple comparisons, a P value of .01 was considered statistically significant.

Back to Top | Article Outline



A total of 935 advanced melanoma patients were invited to participate, and 273 (29.2%) responded to the invitation. Of these, 11 (1.2%) had to be replaced for failing validity tests. The final sample consisted of a total of 200 patients (21.4%) who met screening criteria and completed the study. Most patients were female (60.5%), married (68.5%), and white (83.5%); had at least a college degree (73.0%); were employed (62.5%); and had an annual household income of equal to or greater than USD $50 000 (82.0%). The age distributions in years were 3% (≤30), 26% (31–40), 37% (41–50), 26% (51–60), and 8% (61 or older). Most patients had used or were currently using 1 to 2 different treatments (76.5%). Among patients currently receiving treatment, the most common medications were Opdivo (20.0%), Keytruda (18.5%), and Yervoy (13.5%). Medications used most commonly in the past included Yervoy (28.0%), followed by chemotherapy and Proleukin (both 11.0%).

A total of 13 544 nurses nonspecific to oncology were invited to participate with the proviso that we were interested in oncology nurses. Among them, 1546 (11.4%) responded to the invitation, and 4 initial participants (0.3%) had to be removed and replaced for failing validity tests. In total, 150 nurses (1.1%) met screening criteria and completed the study (78.7% nurses, 21.3% nurse practitioners). The vast majority spent most of their time in patient-related care tasks (95.5%) and had practiced for an average of 16.7 years (SD, 8.7). They saw an average of 192.7 cancer patients per month, with an average of 28.5 of those patients described as “advanced melanoma.”

Back to Top | Article Outline

Preferences for Treatment Attributes

The most important treatment attributes for patients were OS, AEs, ORR, and, to a lesser extent, PFS (Table 2 and Figures 2 and 3). Overall survival was the most important attribute, having the largest vertical distance between regression coefficients (Figure 2) and the longest bar (Figure 3). In terms of interpretation, similar levels of importance of levels of attributes can be determined from differences in β coefficients. For instance, in Table 2 under the patient column, increasing the ORR from 33% to 65% (a difference in coefficients of 2.49) is approximately similar in importance to decreasing the likelihood of experiencing a serious AE decreasing from 55% to 32%.

Table 2

Table 2

Figure 2

Figure 2

Figure 3

Figure 3

The most important attributes according to oncology nurses based on the DCE were OS, ORR, AEs, and, to a lesser extent, PFS (Table 2 and Figures 2 and 3). The preference weights of nurses, for example, suggest that increasing the ORR from 15% to 33% is similar in importance (ie, a difference in β coefficients of 3.3) to decreasing the likelihood of experiencing a serious AE from 32% to 10% (Table 3). Dosing schedule, mode of administration, and median duration of therapy were considered relatively unimportant compared with efficacy and safety.

Table 3

Table 3

The main difference in DCE results between patients and nurses was that nurses assigned greater importance to ORR than AEs, whereas patients assigned greater importance to risk of AEs than ORR (Table 3). However, these differences in the relative importance were not statistically significant (all p values > .05). Exploratory subgroup analyses in patients and nurses revealed no statistically significant differences based on age, income, education, and location for patients and years in practice, type of practitioner, and practice location for nurses (all p values > .01).

When patients were directly asked to select the 3 most important attributes from the full list of 7 attributes (non-DCE approach), OS was most often chosen (61.5%), followed by ORR (49.5%), PFS (43.0%), and AEs (32.5%); the remaining attributes ranged from 15 to 18% (Table 3). When oncology nurses were asked to choose the 3 most important of the 7 attributes, 74.7% selected OS, 58.0% selected PFS, 58.0% selected AEs, and 36.7% selected ORR, with less than 15% having selected the other attributes.

Back to Top | Article Outline


By using DCE-based approach, we found that both patients and oncology nurses considered OS, AEs, and ORR as the most important attributes of medication therapy of advanced melanoma. To a lesser extent, PFS was also an important attribute. Although the order of importance of AEs and ORRs was switched, the importance weights were not significantly different, indicating that the perceptions of oncology nurses and patients were well aligned. Similarly, DCE results revealed that both patients and oncology nurses considered dosing schedule, mode of administration, and median duration of therapy much less important compared with OS, AEs, and ORR.

In addition to the implicit DCE approach, a direct (non-DCE) approach was also used. It corroborated the DCE results in terms of the most important attributes but also indicated that a subset of patients (15%–18%) ranked dosing schedule, duration, and mode of administration among the 3 most important. This contrasted with DCE results, which marginalized the latter attributes, and suggests that it is still informative to directly ask patients about important medication therapy considerations using varying formats.

The DCE provides an implicit, structured approach that is more informative than other methods in terms of providing preference weights specific to each level defined within an attribute and its contribution to an overall preference function. However, by construction, the DCE juxtaposes attributes that relate to the experience of patient care, such as duration of therapy, with outcomes of care, such as survival. Perhaps not surprisingly, the results showed that much greater importance is placed on clinical outcomes of treatment relative to the patient experience with care, such as dosing schedule. The decision to prioritize health outcomes ahead of experience with care is generally observed in practice across many settings in healthcare. For example, patients with end-stage renal disease on dialysis are willing to undergo the unpleasant and inconvenient experience of dialysis several times a week to live longer. Although the DCE results showed that, compared with efficacy and safety, patient experience or convenience is less important, they should not be interpreted as implying that patients or nurses consider the experience of care as unimportant. The patient experience is one of the main goals in the provision of healthcare, which is a balance of cost, outcomes, and patient experience, referred to as the “triple aim” of the healthcare system.10 In that context, the patient experience might be separately considered and was revealed to be important by patients using an explicit approach, as shown by the non-DCE component of the study.

This study is among the first to use DCE to examine the treatment preferences of oncology-based nurses. Importantly, the views of nurses were similar to the views of patients. In contrast, a DCE-based study comparing the views of physicians with those of patients regarding treatments of melanoma found distinct differences between the perspectives.11 They examined judgments about the benefits of new treatments of melanoma among physicians, patients, and healthy controls and found that patients were most willing to accept adverse effects to extend survival, whereas physicians were the most unwilling.11 The finding that oncology nurses and patients' perspectives about treatment attributes are generally aligned is useful to families and patients seeking input on treatment selection in the shared decision-making process. Notably, studies applying DCE to melanoma are beginning to emerge, with several studies reporting study designs, but have yet to publish the results.12,13

This study had several limitations. Discrete choice experiment is a stated preference method where patients evaluate hypothetical medication choices, which simulate possible clinical decisions, but it may not resonate with the same clinical or emotional consequences as real-life decision-making. The patients who participated in this study were relatively younger and thus healthier and more likely to be employed than the patient population in the United States,2 likely because the survey was Web based so the results may not generalize to all advanced melanoma patients or patients outside the United States. Similarly, all nurses were from an online panel, so there may be limitations to the generalizability of results if they are systematically different from the broader national pool of oncology nurses. Future research could consider examining the values of patients and nurses in other countries, conduct qualitative interviews to further probe the reasons that respondents prefer certain choices, and examine the role of age, spirituality, and psychosocial constructs such as personality in choosing among treatment attributes.

In summary, DCE revealed that OS, AEs, and ORR were the most important considerations in selecting among advanced melanoma treatments for both patients and nurses, whereas dosing schedule, mode of administration, and median duration of therapy were relatively less important compared with efficacy and safety. Patients and oncology nurses' views on the importance of characteristics of drug treatments of advanced melanoma are well aligned, which can help to build trust in shared decision-making situations.

Back to Top | Article Outline


Reshma Shinde, Michelle Vichnin, Tarek Hammad, and Cathy Anne Pinto, employees of Merck & Co, Inc, Kenilworth, New Jersey, assisted with the implementation of the study. Salome Samant, an employee of Merck & Co, Inc, Kenilworth, New Jersey, and Simon Pickard of Second City Outcomes Research assisted with the preparation of the article.

Back to Top | Article Outline


1. National Cancer Institute. Surveillance, Epidemiology and End Results (SEER) Program. Accessed September 12, 2016.
2. American Cancer Society. SEER stat fact sheets: melanoma of the skin. Accessed December 2, 2016.
3. Atkins MB, Larkin J. Immunotherapy combined or sequenced with targeted therapy in the treatment of solid tumors: current perspectives. J Natl Cancer Inst. 2016;108(6):djv414.
4. Selby JV, Beal AC, Frank L. The Patient-Centered Outcomes Research Institute (PCORI) national priorities for research and initial research agenda. JAMA. 2012;307(15):1583–1584.
5. Clark MD, Determann D, Petrou S, Moro D, de Bekker-Grob EW. Discrete choice experiments in health economics: a review of the literature. Pharmacoeconomics. 2014;32(9):883–902.
6. de Bekker-Grob EW, Ryan M, Gerard K. Discrete choice experiments in health economics: a review of the literature. Health Econ. 2012;21(2):145–172.
7. Reed Johnson F, Lancsar E, Marshall D, et al. Constructing experimental designs for discrete-choice experiments: report of the ISPOR Conjoint Analysis Experimental Design Good Research Practices Task Force. Value Health. 2013;16(1):3–13.
8. Bridges JF, Hauber AB, Marshall D, et al. Conjoint analysis applications in health—a checklist: a report of the ISPOR Good Research Practices for Conjoint Analysis Task Force. Value Health. 2011;14(4):403–413.
9. Hauber AB, González JM, Groothuis-Oudshoorn CG, et al. Statistical methods for the analysis of discrete choice experiments: a report of the ISPOR Conjoint Analysis Good Research Practices Task Force. Value Health. 2016;19(4):300–315.
10. Berwick DM, Nolan TW, Whittington J. The triple aim: care, health, and cost. Health Aff (Millwood). 2008;27(3):759–769.
11. Krammer R, Heinzerling L. Therapy preferences in melanoma treatment—willingness to pay and preference of quality versus length of life of patients, physicians and healthy controls. PLoS One. 2014;9(11):e111237.
12. Stenehjem D, Korytowsky B, Oderda G, Wanishayakorn T, Bauer H, Brixner D. Understanding the impact of patient and physician preferences in personalized treatment for melanoma using a discrete choice experiment. Value Health. 2015;18(7):A469–A470.
13. Spinks J, Chaboyer W, Bucknall T, Tobiano G, Whitty JA. Patient and nurse preferences for nurse handover-using preferences to inform policy: a discrete choice experiment protocol. BMJ Open. 2015;5(11):e008941.

Advanced melanoma; Discrete choice experiments; Immunotherapy; Nurse preferences; Patient preferences

Copyright © 2019 Wolters Kluwer Health, Inc. All rights reserved