Journal Logo

Article

Identifying Educational Needs and Practice Gaps of European Hematologists and Hematology Nurses in the Treatment and Management of Multiple Myeloma

Murray, Suzanne1; Mohty, Mohamad2; Peloquin, Sophie1; Van de Donk, Niels W.3; Leitão, Sara4; Labbé, Sara1; West, Sharon5; Hofstädter-Thalmann, Eva6; Sonneveld, Pieter7

Author Information
doi: 10.1097/HS9.0000000000000033

Abstract

Introduction

Rapid advances in the last decade in the understanding of multiple myeloma (MM) and the identification of new therapeutic targets have led to drastic changes in the treatment and management of patients, even though MM remains an incurable disease and is considered a chronic condition with relapse being inevitable. MM is a very dynamic scientific area with the arrival of these new treatment options within known therapy classes—such as immunomodulatory drugs (IMiDs) and second-generation of proteasome inhibitors (PIs)—but also treatments with novel modes of action such as the monoclonal antibodies and histone-deacetylase (HDACs) inhibitors.1–3 The availability of new treatment options in first line and relapse setting has proved to be related to a significant improvement of the survival rate, especially for older patients, and of the early mortality rate.4–8 In addition, treatment related toxicity has now considerably decreased.6,9 These fast developments as well as a wealth of clinical data will likely have an impact on healthcare providers’ ability to select optimized treatment options, and individualize treatment according to each patient profile.

This study sought to assess and identify practice gaps and educational needs of hematologists and hematology nurses involved in the care of patients with MM, in 8 European countries (Belgium, France, Germany, Italy, the Netherlands, Russia, Spain, and the United Kingdom). The selection of Russia, France, UK, Germany, Italy, and Spain was based on the large population of those nations, and to ensure inclusion of a diversity of health systems. The Netherlands and Belgium were included in this study to reflect the realities of relatively smaller population countries. The authors’ goal was to collect evidence of educational gaps that will help tailor the development of medical education interventions to the actual needs of hematologists and hematology nurses, in order to have the greatest impact on optimizing patient care.

This article will present the mixed-methods study findings which pertain specifically to hematologists’ and hematology nurses’ educational needs and practice gaps in relation to new agents, and their integration into clinical practice in MM.

Materials and methods

This mixed-method study was deployed in 2 consecutive phases between February and June 2016. Mixed-methods studies benefit from both the depth of qualitative exploratory data collection, and the analytical power of quantitative data collection.10,11 The first phase (qualitative data collection) involved the recruitment and enrolment of participants in 45-minute semistructured interviews. Data collected from the first phase were analyzed and used to inform the design of Phase 2 (quantitative data collection), consisting of a 20-minute online survey deployed to a larger number of participants.

Ethics approval

An international independent review board (Veritas IRB) provided ethics approval for each country wherein participants were recruited. Participants in this study were offered a financial compensation which was deemed by the ethics board to be fair but not coercive, based on participant's role and country of clinical practice.

Recruitment and study inclusion criteria

This study targeted hematologists and hematology nurses practicing in one of the 8 targeted countries (Belgium, France, Germany, Italy, the Netherlands, Russia, Spain, and the United Kingdom). Recruitment was done using international online panels that comply with the ESOMAR code of conduct and ethical standards for market and social research.12 To be eligible to participate in the study, potential participants needed to self-report: (1) being a hematologist or a hematology nurse, (2) having a minimum of 5 years of practice, and (3) having a minimum caseload of 3 patients with MM per month for hematologists, and a minimum of 5 for nurses.

Qualitative design and data collection

A review of literature was conducted on articles written in English, published after 2013, using key words such as multiple myeloma, needs assessment, challenges, knowledge, and attitude, to identify practice gaps and potential educational needs in the diagnosis, treatment, and management of MM. The information retrieved was used to determine preliminary areas of exploration for the development of qualitative interview guides. These areas of exploration were reviewed and validated by all coauthors.

The semistructured interview guides were designed to explore and assess a diverse spectrum of issues faced by hematologists and nurses in their practice. The interview guides were developed in English, and then translated into the official languages of each of the targeted countries (Dutch, French, German, Italian, Russian, and Spanish).

Each 45-minute telephone interview was conducted by trained and experienced interviewers in the official language of the participant's country of practice. The interviewers used general open-ended questions along with probes on selected topics targeted for enhanced exploration. Interviews were audio-recorded with the participants’ informed consent, for transcription and analysis purposes.

Quantitative design and data collection

Findings from the analysis of the qualitative data were used by the coauthors to develop 2 20-minute online surveys, 1 for hematologists, and 1 for nurses, with common questions when appropriate. The goal of the surveys was to validate the challenges and practice gaps identified in the interviews with a larger sample, and to identify the educational needs of participants (i.e., knowledge, skills) with greater precision. The surveys used a combination of multiple nominal choices and Likert-type response formats, and were organized into 3 sections. In the first section, participants were asked to select barriers from a list of items that have the most impact on their ability to provide optimal care to MM patients.

In the second section, participants had to reflect and self-report on their level of knowledge and skills (“low,” “acceptable,” or “optimal”) in relation to specific statements. The nurses’ survey also included questions on the relevance of various clinical tasks given their role (”not at all relevant,” ”somewhat relevant,” or ”very relevant”), as nurses’ roles were expected to vary between countries.

The last section of the surveys included questions on specific educational topics that were reported to be relevant for health education in the qualitative interviews of the previous phase. Survey participants were then asked to select the topics they would find most relevant for their own professional development. Both online surveys were also translated from English into the other 6 languages.

Mixed-methods analysis plan

Interviews were transcribed and coded using NVivo qualitative data analysis software (QSR International, Cambridge, MA) until the coded data reached saturation. Data saturation is reached when no new information is found from additional interviews.13

The approach used for the qualitative analysis is derived from the principles of thematic analysis14 and directed content analysis,15 and involves the following steps: (1) identification of a coding tree (or coding logic) with predetermined codes based on crucial areas of exploration informed by a review of the pertinent literature and through consultation with clinical experts; (2) coding of data using coding tree; (3) analysis of data that could not be coded using the coding tree and the addition of new codes if needed; (4) identification of emerging themes from the codes with highest data frequency and sources (i.e., reported by multiple participants).

The quantitative data were analyzed using IBM SPSS Statistics for Windows 22.0 software (IBM Corp., Released 2013, Armonk, NY) using frequencies and cross-tabulations. Knowledge and skill answers were recoded into dichotomous variables, either as being a potential educational gap or not. For that purpose, a response from 1 to 3 (“low” to “acceptable”) on the 5-point scale was considered to be a potential educational gap. Differences between countries were calculated using analysis of variance (ANOVA) with a significance level of 0.05. The Netherlands and Belgium were excluded from cross-country analysis, due to small sample sizes. Finally, triangulation, which consists of combining different data collection methods (qualitative and quantitative) and data sources (hematologists and hematology nurses), was used to ensure robust and trustworthy findings.16 Findings presented in this manuscript are those that emerged substantively from both the qualitative and quantitative analyses.

Results

Sample size and demographics

This study included 364 participants. Thirty-nine interviews were conducted with 28 hematologists and 11 hematology nurses, and 325 participants (253 hematologists and 72 hematology nurses) completed the survey.

A large proportion of the study participants practiced in either an academic setting (49%) or in a specialized cancer centre (18%). The majority of participants also had more than 10 years of experience in their field of practice. Over a third of participants (38% of hematologists and 34% of hematology nurses) had a patient caseload consisting of 20% or more of MM patients. Samples by country, profession, and by study phase, as well as sample demographic characteristics, are presented in Table 1.

Table 1
Table 1:
Sample Distribution and Demographic Information

Findings related to treatment decision-making

Triangulation of qualitative (interviews) and quantitative (survey) findings, and data sources (hematologists and nurses) allowed for the identification of practice gaps and educational needs across the continuum of care in MM. Triangulation is used in mixed methods studies to increase validity and trustworthiness of findings.17 Given the purpose of this manuscript, solely key findings in relation to decision-making regarding new treatment options in the care of MM patients will be presented. Other findings identified by this needs-assessment have been presented elsewhere.18 No strict definition of new agents was provided during semistructured interviews since what is considered a new agent might differ according to the country of practice. Concrete examples taken from qualitative data were used to refer to new agents in the quantitative phase. Three main findings that hinder decision-making in relation to new treatments were identified: 2 related to educational needs, and 1 finding related to contextual barriers.

  • (1) Educational needs regarding the mechanisms of action and side effect profiles of new therapies.
  • (2) Educational needs regarding the sequencing of new agents and their combination with current available therapies (hematologists only).
  • (3) Contextual barriers to the integration of new agents in clinical practice.

The following subsections describe each of these findings, as reported by participants in the online survey (n = 325), and supported by qualitative data from the semistructured interviews (n = 39).

Educational needs regarding the mechanisms of action and side effect profiles of new therapies

When hematologists were asked in the online survey to rate their overall level of knowledge of the mechanisms of action of new agents, 34% identified their knowledge as “low” to “acceptable” (1–3, on the 5-point scale). Percentages by country are presented in Table 2. Country differences did not reach statistical significance.

Table 2
Table 2:
Self-Reported Gaps in Knowledge or Skills (% Selected 1 to 3 on a 5-Point Scale) Among Hematologists

For the same item, over two-thirds of nurse participants (69%) reported “low” to “acceptable” knowledge. In addition, 71% of nurses considered this knowledge to be “relevant” or “very relevant” to their practice (4–5 on a 5-point scale), given their role in the clinical practice. Differences between countries did not reach statistical significance (Table 3).

Table 3
Table 3:
Self-Reported Gaps in Knowledge (% Selected 1 to 3 on a 5-Point Scale) and High Level of Relevance of That Knowledge (% Selected 4 or 5 on a 5-Point Scale) Among Hematology Nurses

As reported in Table 2, 41% of hematologists and 68% of nurses reported a gap in their knowledge of the safety profile of new agents (1–3 on the 5-point scale). Over three-quarters (78%) of nurses reported this knowledge as “relevant” or “very relevant.” Nonsignificant trends between countries were observed regarding the relevance of this clinical knowledge (46% reporting relevance in Germany, vs 90% in France, Italy and the UK and Spain).

As shown in Table 4, of the 5 classes of agents included in the survey, that is, 3rd-generation immunomodulatory drugs (IMiDs), 2nd-generation PIs, HDACs inhibitors, monoclonal antibodies (anti-SLAMF7 (elotuzumab), or anti-CD38 [daratumumab, isatuximab, and MOR202]), the highest proportions of participants reporting gaps in knowledge (63%) of the mechanisms of action, adverse effects and safety profiles, were observed for elotuzumab and the HDACs inhibitors (panobinostat, vorinostat). A statistical difference was observed between countries for elotuzumab (p = 0.01) with the knowledge gap being higher among UK hematologists (80%).

Table 4
Table 4:
Percent of Hematologist Participants in Each Country Reporting a Gap in Knowledge for Each of the 5 Classes of New Agents and a Gap in Skills Using These New Agents

Knowledge of mechanism of action, efficacy, side effects, and safety profile of CD38-targeting monoclonal antibodies was reported to be low to acceptable by 59% of hematologist participants. A statistical difference between countries was observed for this item (p = 0.005), with a higher gap in the UK (73%), Russia (78%), and Spain (78%).

When asked to speak openly about their challenges in relation to treating patients with MM, interviewed hematologists and nurses (n = 39) explicitly reported desire to increase their knowledge of the mechanisms of action and side-effect profiles of new agents, as mentioned in the following illustrative quotes.

Concerning new drugs, we are a bit lost as we hear a lot of things and have high expectations. We like to be informed on these drugs, and especially on the adverse events and long term side effects. (Hematologist, France)

Well for me the treatment regimes are constantly changing, there are new drugs coming onto the market all the time. And often that is dealt with a quite a high level, the doctors and above and it would be good to be able to know what the new treatments are, what they entail. Just very basics about them really. (Hematology nurse, UK)

In addition, when hematologists and nurses were asked to select their 3 most important topics to be addressed in education activities among a list of 13 items, knowledge of the side effects, safety profile, and mechanisms of action of new agents was selected by 27% of hematologists (5th most selected topic; Fig. 1) and 38% of nurses (2nd most selected topic; Fig. 2) selected.

Figure 1
Figure 1:
Preferred educational topics of interest as selected by hematologists. Question asked to hematologists: Among the following potential educational program topics, please identify three that you believe would have the most impact on your clinical practice.
Figure 2
Figure 2:
Preferred educational topics of interest as selected by oncology nurses. Question asked to nurses: Among the following potential educational program topics, please identify three that you believe would have the most impact on your clinical practice.

Educational needs on the sequencing of new agents and their combination with current available therapies (hematologists only)

As illustrated in Graph 1, among a list of 15 different educational topics that could be covered in education activities, 3 out of 4 topics most selected by hematologists were linked to the sequencing and combination of new agents. Two of those items were related to the use of new agents in combination with current available therapies: in first line (29%) and in relapse setting (31%). In addition, integrating and sequencing of new agents with current standards of care in relapse/refractory MM was selected by 30% of hematologists.

Furthermore, 30% of hematologists reported a gap in their skills integrating new agents in combination with current treatment in the first line. No differences were observed between countries.

Among a list of 5 new agents (Table 4), the gaps in skills using novel agents reported by the highest proportion of hematologists were related to the use of HDACs inhibitors (70%), elotuzumab (67%), and CD38-targeting antibodies (64%). Significant differences between countries were observed for skills using monoclonal antibodies, both elotuzumab (p ≤ 0.001) and CD38 antibodies (p ≤ 0.001). The proportion of participants that reported a gap in skills was higher in the UK and in Russia for elotuzumab (90% and 83%, respectively) and CD38 antibodies (both 83%).

On average, participants tend to report higher levels of skills using the 2nd-generation PIs (carfilzomib, ixazomib) and the 3rd-generation IMiD (pomalidomide). No statistically significant differences were observed between countries (see Table 4).

Treating and managing refractory patients, most specifically when using and sequencing new agents in combination with current available therapies, were topics spontaneously cited as challenging by interview participants.

The most difficult thing is to manage refractory patients because we have tried all the standard treatments and have no more therapeutic options. Managing this type of patients is very complicated. How to use new drugs as well, in combination or monotherapy. Also, improving second line therapies with triple therapy or combinations of drugs so patients respond better and relapse less. (Hematologist, Spain)

I am sure that in the very near future we will be using them [monoclonal antibodies], I can’t tell you when and in which patients that it will be reasonable to use, but I think days are not very far when we actually start using them pretty commonly […] I would have thought that we will be using them in the relapsed refractory setting. (Hematologist, UK)

During the interviews, multiple hematologists mentioned the lack of experience using new agents as a causality for that challenge, as illustrated by the following quote:

You are always a bit hesitating to use new drugs if you haven’t made personal experiences with it so far […] The more options you have the more difficult it will be to make a choice, but the better will be the overall course, because I will still have something up my sleeve. (Hemato-oncologist, Germany)

Contextual barriers to the integration of new agents into clinical practice

Participants identified contextual barriers that were external to their own role, but did however impact their ability to optimally treat and manage patients with MM.

Among a list of nine different items (see Supplemental Digital Content, http://links.lww.com/HS/A2, for complete list), the lack of access to newly approved therapies was the barrier to providing optimal care in MM that was the most frequently selected by hematologists (48%). Statistical differences between countries (p ≤ 0.001) were observed. As illustrated in Table 5, this barrier was selected by 82% of hematologists from the UK, and 65% from Spain, compared to 30% in Germany, and 34% in France.

Table 5
Table 5:
Percent of Participants (Hematologists and Nurses) in Each Country That Selected the Item as a Barrier to Optimal Care

The cumbersome drug reimbursement process, a factor impacting access, was also selected by 26% of hematologists, with significant differences between countries (p = 0.016). This barrier was selected by 35% of hematologist participants from the UK, whereas 7% of participants from France selected this same barrier.

The barriers to optimal care reported by nurses differed from the ones reported by hematologists. The 2 most frequently reported barriers for nurses were the lack of trained nurses specialized in MM (38%), followed by the lack of resources in the day care unit (35%). There was no statistical difference between countries.

The lack of access to new agents due to lack of reimbursement was also mentioned by hematologists interviewed, as illustrated in the quote below.

I think accessibility is the main thing in the UK, it is not as easily available as you have got in the setting of United States, it's very hard to actually get these drugs freely available to us. (Hematologist, UK)

Discussion

Through this study, the authors conducted an assessment of the current practice gaps and educational needs for hematologists and hematology nurses, collecting evidence that will be used to inform the design of future educational activities. Three specific findings: (1) Educational needs regarding the mechanisms of action and side effect profiles of new therapies, (2) educational needs on the sequencing of new agents and their combination with current available therapies (hematologists only), and (3) contextual barriers to the integration of new agents into clinical practice, were found to hinder decision-making in relation to the use of new treatments, and were thus included within the scope of this manuscript.

Future medical education activities and programs should be developed for hematologists and hematology nurses, based on the first 2 findings of this study, which described 2 educational needs related to new treatments. Although educational activities can not compensate for a lack of access or a cumbersome reimbursement process, these contextual factors must be considered when designing medical education programs, otherwise participants may not perceive the education as applicable to their clinical reality. In addition, programs should consider that new medications represent only a portion of the global cost of a comprehensive management of patients with MM, and thus should favor a broader view of the issue.

Despite the higher proportion of hematologists who reported knowledge and skill gaps in relation to the 2 most challenging classes (monoclonal antibodies directed against SLAMF7 and CD38, and histone-deacetylase inhibitors), medical education activities should ideally include all the classes surveyed, as there were gaps regarding the integration of all 5 classes of new agents in the MM treatment landscape. Should prioritization be required due to time constraints, the focus of educational interventions should be determined by considering the 2 classes where the highest gaps were observed and the relative clinical utility of the agents.

The identified gaps regarding knowledge and skills of new agents, especially monoclonal antibodies and HDACs, indicate a clear educational need that should be addressed and prioritized by future medical education in MM. The relevance of this topic is supported by the literature, which suggests that the sequencing of agents in MM is crucial due to inevitable relapses.19

A trend was observed where gaps in knowledge and skills were found to be greater in the UK and Russia compared those found in Germany and France. An explanation of these differences is suggested in the literature, for example, where Germany is among the European nations most involved in clinical trials, due to strong government support, and an active collaboration with pharmaceutical companies.20

Given that a large proportion of the total sample was from academic and specialized cancer centers who often host clinical trials, it is possible that the higher knowledge and skill levels observed in Germany across different topics investigated is a reflection of better access to clinical trials and the dissemination of clinical trial data in that country. This hypothesis is further supported by research suggesting that gaps in skills and knowledge relating to new agents were especially high in the UK, a country where limited access to new cancer medications has been reported.21,22 Differences across countries may be further explained by inaccessible best practice guidelines and newly approved therapies caused by language barriers, and distinct national healthcare systems, approval models, and reimbursement schemes.

Gaps in knowledge of the mechanisms of action and safety profile of new agents were higher for nurses due to a presumption that this knowledge is outside their professional responsibilities. Additionally, it has been reported that educational activities offered to nurses generally do not target their specific day-to-day needs.23,24 Interestingly, a majority of nurses perceived the knowledge of mechanisms of action and the safety profiles of new agents to be highly relevant to their practice. This could be explained by the fact that supportive care in MM patients is highly complex due to the various lines of treatment, and the toxicity that may be generated by pharmaceutical treatments. Nurses working in MM require a highly specialized knowledge of the disease, and rely on a working understanding of mechanisms of action and new agent safety profiles. Is has been reported that specialized nurses in MM do indeed play a crucial role in managing and monitoring treatment toxicity, and therefore influencing the patient's experience and outcomes.25

Given the increasing availability of new agents and the highly evolving scientific area of MM, specialized nurses must continuously update their knowledge of the safety profile of new agents. The findings of this study highlight the importance of designing activities that are based on the specific educational needs of specialized nurses. In this study, nurses themselves reported that the second most often selected barrier to optimal care is a lack of trained nurses who specialize in MM, a finding that underscores the need for relevant nurse education.

To our knowledge, this is the first study using a mixed-method design to identify the needs of healthcare professionals working in MM across multiple countries in Europe, with the goal of informing educational interventions and enabling an in-depth understanding of the issues and their potential causalities. Narratives from interview participants are useful for the design of educational programs, as they provide examples of challenging situations or patient cases that can be used to ensure that the program accurately depicts the clinical reality of the targeted learners. The triangulation of sources also allowed for a better understanding of the clinical reality of each targeted professional role and country.

Other studies of the challenges in the field of oncology have reported similar issues facing professionals treating and managing patients with other neoplasms or cancers. As an example, in a previous needs assessment across 7 countries, including 5 of the European countries in this study (France, Germany, Italy, Spain, and the UK), oncologists caring for patients with colorectal cancer reported similar challenges in relation to optimal sequential use of treatment choices as well as challenges accessing emerging treatments.26

In the context of a highly dynamic therapeutic area, where several new agents are, or will soon be available, education offerings should target the evidence-based needs of hematologists and specialized nurses. The results of this study provide such evidence to inform medical/health education activities that could be offered by societies, industry, or any other organization aiming to improve the care of patients with MM across Europe. In addition, the findings illustrate differences between countries that should be taken into consideration when designing educational activities and programs at the national level, to ensure adaptation to a local context.

Limitations

Although purposive sampling was used to obtain participants with a mix of years of practice and different practice settings, the sample contained a large proportion of participants that practiced in academic centers and specialized centers. This may nevertheless adequately represent the breakdown of healthcare practitioners within the MM field, given most patients are being treated in highly specialized centers. It can be hypothesized that broader gaps would have been observed if a larger proportion of the sample would have come from nonacademic affiliated hospitals or community settings.

As with any international cross-cultural study where participants are invited to answer in the language of their choice, it is possible that interview and survey questions were interpreted slightly differently in different countries, due to the variance in language, meaning, or cultural norms. To reduce this risk, study materials were translated by expert medical scientific translators. In addition, all questions were kept simple to reduce the introduction of potential nuances in translation, and each question was formulated with the aim of ensuring understanding in different clinical and cultural contexts.

Conclusion

With the increasing numbers of new agents available, and constant advances in knowledge about MM pathophysiology, the treatment options for MM patients have become more complex and challenging. To maintain the highest quality of care possible, hematologists and hematology nurses must not only maintain up-to-date knowledge of most recent clinical advances, but most importantly, enhance their skills to integrate these advances rapidly in their clinical decision-making and clinical practice. The findings from this study, as reported by healthcare providers themselves, indicate how the shift in the current treatment paradigm due to the development of new classes of agents with different mechanisms of action in MM care has increased the perceived complexity of decision making surrounding treatment, and is potentially affecting the hematologists and hematology nurses capacity to provide optimal and personalized treatment to MM patients.

Despite some differences across countries and limitations inherent to any multicountry, multilanguage study, common educational priorities in relation to treatment decision-making with new agents in MM were identified. These findings highlight the key elements needed to support the design of future evidence-based medical education programs and activities, bearing in mind local realities in which they are deployed to ensure the contextual relevance to healthcare providers themselves.

Acknowledgments

This study was conducted by AXDEV Group. The authors would also like to acknowledge the support provided by Patrice Lazure (Director of Research, AXDEV Group, Canada), as well as Marie-Aimée Fournier (Project Manager, AXDEV Group, Canada) and Marc Distexhe (Project coordinator, AXDEV Group, Canada), who supported data collection, communications and other aspects of the research. The authors would like to thank all the participants, healthcare providers and other key stakeholders who took part in this study. This study was supported by education research funds from Janssen Pharmaceutica NV.

References

1. Helwick C. Therapeutic leap for multiple myeloma in 2015: unprecedented FDA Drug Approvals. Am Health Drug Benefits 2016; 9 (Spec Feature):36–39.
2. Kubiczkova L, Pour L, Sedlarikova L, et al. Proteasome inhibitors–molecular basis and current perspectives in multiple myeloma. J Cell Mol Med 2014; 18:947–961.
3. Schlafer D, Shah KS, Panjic EH, et al. Safety of proteasome inhibitors for treatment of multiple myeloma. Expert Opin Drug Saf 2017; 16:167–183.
4. Turesson I, Velez R, Kristinsson SY, et al. Patterns of improved survival in patients with multiple myeloma in the twenty-first century: a population-based study. J Clin Oncol 2010; 28:830–834.
5. Kumar SK, Rajkumar SV, Dispenzieri A, et al. Improved survival in multiple myeloma and the impact of novel therapies. Blood 2008; 111:2516–2520.
6. Kumar SK, Dispenzieri A, Lacy MQ, et al. Continued improvement in survival in multiple myeloma: changes in early mortality and outcomes in older patients. Leukemia 2014; 28:1122–1128.
7. Pulte D, Jansen L, Castro FA, et al. Trends in survival of multiple myeloma patients in Germany and the United States in the first decade of the 21st century. Br J Haematol 2015; 171:189–196.
8. Benboubker L, Dimopoulos MA, Dispenzieri A, et al. Lenalidomide and dexamethasone in transplant-ineligible patients with myeloma. N Engl J Med 2014; 371:906–917.
9. Naymagon L, Abdul-Hay M. Novel agents in the treatment of multiple myeloma: a review about the future. J Hematol Oncol 2016; 9:52.
10. Johnson RB, Onwuegbuzie AJ. Mixed methods research: a research paradigm whose time has come. Educ Res 2004; 33:14–26.
11. Tashakkori ACJ. The new era of mixed methods. J Mix Methods Res 2007; 1:3–7.
12. ICC/ESOMAR. ICC/ESOMAR International Code on Market and Social Research. https://www.esomar.org/uploads/public/knowledge-and-standards/codes-and-guidelines/ICCESOMAR-International-Code_English.pdf. Published 2016. Accessed October 2017.
13. Morse JM. The significance of saturation. Qual Health Res 1995; 5:147–149.
14. Boyatzis R. Thematic Analysis and Code Development: Transforming Qualitative Information. Thousand Oaks, London, New Delhi: Sage Publications; 1998.
15. Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res 2005; 15:1277–1288.
16. Creswell JW. Research Design: Qualitative, Quantitative, and Mixed Approaches. Thousand Oaks, London, New Delhi: Sage Publications; 2003.
17. Olsen WK. Triangulation in Social Research: Qualitative and Quantitative Methods Can Really Be Mixed. Haralambos HM. Developments in Sociology Ormskirk, United Kingdom: Causeway Press; 2004.
18. Murray S, Mohty M., Peloquin S., et al. Practice gaps and barriers to optimal management of multiple myeloma patients: results from a mixed-methods study in 8 European countries. 22nd Congress European Hematology Association; 2017; Madrid, Spain.
19. Moreau P, Touzeau C. Multiple myeloma: from front-line to relapsed therapies. Am Soc Clin Oncol Educ Book 2015; e504–e511.
20. Pottkämper J, Jäger I, Schiefer A. Fischer A. Exploring Germany's relationship with clinical research. Applied Clinical Trials. http://www.appliedclinicaltrialsonline.com/exploring-germanys-relationship-clinical-research. Published August 2012. Accessed October 2017.
21. Gallagher J. Cancer Drugs Fund To Be Restricted—Says NHS. BBC news online. http://www.bbc.com/news/health-30022025. Published November 2014. Accessed October 2017.
22. Wise J. UK drug appraisal process is restricting access to cancer drugs, say charities. BMJ 2016; 354:i4465.
23. Eslamian J, Moeini M, Soleimani M. Challenges in nursing continuing education: a qualitative study. Iran J Nurs Midwifery Res 2015; 20:378–386.
24. Fulmer T, Cathcart E, Glassman K, et al. The attending nurse: an evolving model for integrating nursing education and practice. Open Nurs J 2011; 5:9–13.
25. Lobban L, Perkins S. Role of the specialist nurse in caring for patients with myeloma. Nurs Stand 2013; 28:37–41.
26. Lazure P, Marshall JL, Hayes SM, et al. Challenges that hinder the translation of clinical advances into practice: results from an International Assessment in Colorectal Cancer. Clin Colorectal Cancer 2016; 15:54–66.

Supplemental Digital Content

Copyright © 2018 the Author(s). Published by Wolters Kluwer Health, Inc. on behalf of the European Hematology Association.