Secondary Logo

Journal Logo

Interpreting Neurologic Outcomes in a Changing Trial Design Landscape

An Analysis of HeartWare Left Ventricular Assist Device Using a Hybrid Intention to Treat Population

Mahr, Claudius*; Thinh Pham, Duc; Mokadam, Nahush A.*; Silvestry, Scott C.; Cowger, Jennifer§; Kiernan, Michael S.; D’alessandro, David A.; Coglianese, Erin E.; Faraz Masood, Muhammad#; Kormos, Robert L.**; Jacoski, Mary V.††; Teuteberg, Jeffrey J.‡‡

doi: 10.1097/MAT.0000000000000931
Brief Communication
Open
SDC

Randomized controlled trials can provide optimal clinical evidence to assess the benefits of new devices, and it is these data that often shape device usage in real-world practice. However, individual clinical trial results sometimes appear discordant for the same device, and alternative devices are sometimes not employed in similar patient populations. To make sound evidence-based decisions, clinicians routinely rely on cross-trial comparisons from different trials of similar but not identical patient populations to assess competing technology when head-to-head randomized comparisons are unavailable.

From the *University of Washington, Seattle, Washington

Northwestern Medical Center, Chicago, Illinois

Florida Hospital, Orlando, Florida

§Henry Ford Hospital, Detroit, Michigan

Tufts Medical Center, Boston, Massachusetts

Massachusetts General Hospital, Boston, Massachusetts

#Washington University School of Medicine, St. Louis, Missouri

**University of Pittsburgh Medical Center, Pittsburgh, Pennsylvania

††Medtronic (formerly HeartWare, Inc.), Framingham, Massachusetts

‡‡Stanford University Medical Center, Stanford, California.

Submitted for consideration October 2018; accepted for publication in revised form November 2018.

Disclosure: CM: Consultant / Investigator: Abbott, Abiomed, Medtronic. DTP: Consultant / Investigator Abbott, Medtronic. NAM: Consultant / Investigator: Abbott, Medtronic, Syncardia. SCS: Consultant / Investigator: Abbott, Medtronic. JC: Consultant / Investigator: Abbott. MSK: Consultant / Investigator: Medtronic. DAD: None. EEC: None. MFM: Consultant / Investigator: Medtronic. RLK: Consultant / Investigator: Abbott, Medtronic. MVJ: Employee: Medtronic. JJT: Consultant / Investigator: Abbott, Medtronic.

Correspondence: Claudius Mahr, University of Washington Medical Center 1959 NE Pacific St, AA121 Seattle, WA 98195. Email: cmahr@uw.edu.

This is an open-access article distributed under the terms of the Creative Commons Attribution-Non Commercial-No Derivatives License 4.0 (CCBY-NC-ND), where it is permissible to download and share the work provided it is properly cited. The work cannot be changed in any way or used commercially without permission from the journal.

Randomized clinical trials provide the best means to compare devices; however, there are no such trials with current left ventricular assist device (LVAD) technology. Comparing results across trials of LVADs becomes problematic owing to differences in trial inclusion and exclusion criteria, the evolution of trial design from discrete bridge to transplant (BTT) and destination therapy (DT) trials to a combined indication, evolving definitions of adverse events, and evolution of surgical and medical management over time. An improved understanding of the morbidity related to LVAD technology has resulted in increasing specificity of definitions, sometimes resulting in overly conservative definitions in the older trials when compared with newer trials.

Another limitation when comparing nonrandomized clinical trials involves potential differences in the methodology in the reporting of events. Evolving clinical trial designs have led to mixed populations with varying success criteria, which limit the use of the traditional incidence, or risk of an event over an entire population, as a reliable expression of adverse event probability. For example, HeartWare Left Ventricular Assist Device System (HVAD) BTT clinical trials reported neurologic event rates,1–3 while the MOMENTUM 3 clinical trial reported cumulative incidence (frequency) of neurologic events.4,5 In the MOMENTUM 3 trial, 40 of 189 HeartMate 3 (HM3) patients were transplanted before 2 years, with some as early as the first 30 days.5 Despite this, all 40 patients were included in the denominator as “at risk” for stroke at 2 years. This leads to an error in actual patients “at risk” and has the potential effect of artificially lowering the incidence of adverse events. Thus, direct cross-trial comparisons of neurologic events are not possible.

Given the lack of randomized trials and differences in the existing mechanical circulatory support trials, we undertook a novel approach to the comparison of LVAD trials via the generation of a “hybrid” intention to treat population, using existing clinical trial datasets. While such an approach is not a substitute for a randomized comparison, this analysis highlights the need for a more rigorous examination of clinical trial designs and data analyses.

To generate a “HYBRID-HVAD” population that would be comparable with the HeartMate 3 cohort of the MOMENTUM 3 trial, a mix of DT:BTT patients was needed.5 Thus, patients receiving an HVAD system from the DT ENDURANCE Supplemental7 and the continued access protocol (CAP) cohort of the ADVANCE BTT+CAP trials were combined to form the HYBRID-HVAD population for this analysis. Because the MOMENTUM 3 trial design specifically excluded all patients with fulminant cardiogenic shock,8 these patients were removed from the HYBRID-HVAD population.

Of the 550 patients in the combined ADVANCE+CAP and ENDURANCE SUPPLEMENTAL cohorts, 14 of 242 patients in the CAP dataset and 12 of 308 patients in the SUPPLEMENTAL dataset were excluded due to presence of cardiogenic shock at baseline (Figure 1). The final combined HYBRID-HVAD population included 228 ADVANCE+CAP and 296 ENDURANCE SUPPLEMENTAL patients for a total of 524 patients. Apart from more HYBRID-HVAD patients having ischemic cardiomyopathy, the HYBRID-HVAD cohort was clinically similar to HM3 patients in the MOMENTUM 3 clinical trial (Table 1). Importantly, the overall BTT:DT ratio was very similar, with 56.5% DT and 43.5% BTT, compared with 58% long-term (DT) and 42% short-term (BTT) patients in MOMENTUM 3.5 The proportion of patients transplanted within 2 years in the HYBRID-HVAD BTT cohort was 50.4% compared with 50% of BTT HM3 patients in MOMENTUM 3.5

Figure 1

Figure 1

Table 1

Table 1

The HVAD and MOMENTUM 3 trials used differing adverse event definitions. HVAD clinical trials used the neurologic event definitions from Interagency Registry of Mechanically Assisted Circulatory Support (INTERMACS) protocol 3.01,2,7 while MOMENTUM 3 applied the neurologic definitions used in INTERMACS protocol 5.4,5,8 These protocols were significantly different in the adjudication of what qualified as a stroke event. For example, a subdural hematoma after a fall was adjudicated as a stroke in the HVAD trials per the definitions in protocol 3.0,9 whereas these were appropriately classified as an “other neurologic event” in the MOMENTUM trial using the new INTERMACS adverse event protocols.4 To allow for a comparison of neurologic outcomes, the incidence of total neurologic events was compared. The “neurologic dysfunction” category included strokes (both ischemic and hemorrhagic events), transient ischemic attacks (TIAs), and other nonstroke events such as confusion, seizure, and encephalopathy; therefore, total neurologic events should be broadly and equally captured between trials. We found no significant difference in the incidence of overall neurologic events occurring at either 6 months or 2 years in the HYBRID-HVAD population (14.1% and 23.3%, respectively) relative to the MOMENTUM 3 HM3 population (13.9% and 21.7%, respectively) (Figure 2A).

Figure 2

Figure 2

This analysis might be criticized for a lack of discussion of the most severe of the neurologic events, disabling strokes. However, the ADVANCE BTT+CAP study was performed before understanding the need for analysis of mRS scores and stroke recovery. However, the freedom from disabling strokes (mRS>3) in the ENDURANCE Supplemental trial was presented by Teuteberg et al.4 at the 2018 ISHLT Congress in Nice, France. Despite the fact that the ENDURANCE Supplemental trial used a definition that pulled in more “other neurologic events” into the stroke category (e.g. an “other neurologic event” patient who died in the MOMENTUM 3 short-term cohort due to a subdural hematoma after a fall4 was not counted as a disabling stroke, but would have been in ENDURANCE Supplemental), and the excess by more than 10% of ischemic patients and inclusion of cardiogenic shock patients in the pure DT population in the HVAD trial,4 we find similar results when compared with MOMENTUM 3 (Figure 2B). The MOMENTUM 3 trial reported a 2-year freedom from disabling strokes of 92.5% in the HM3 cohort,5 compared with 90.7% in the HVAD cohort of ENDURANCE Supplemental.10

The goal of these comparisons is to assist the shared decision-making process in the absence of head-to-head clinical trial comparisons. In this analysis, with a focus on neurologic events as an example of difficulties encountered when comparing outcomes across trials of contemporary LVADs. Considerations of the manner in which event rates are determined can also limit comparisons. In the MOMENTUM 3 trial, 40 of 189 HM3 patients were transplanted before 2 years, with some as early as the first 30 days.5 Despite this, all 40 patients were included in the denominator as “at risk” for stroke at 2 years. This leads to an error in actual patients “at risk” and has the potential effect of artificially lowering the incidence of adverse events and severely limiting the appropriateness of cross-trial comparisons. The HM3 device was also evaluated in a Conformité Européene (CE) Mark trial, which also used the short-term/long-term design of MOMENTUM 3 but with a single HM3 study arm. The results of the long-term cohort of patients supported for 2 years was recently published.6 In that trial, 24% of patients were reported to have experienced a stroke through 2 years of support. The difference in the stroke rate reported in the CE Mark trial at 24% and the low 10% rate reported in MOMENTUM 3 can be partly attributed to the fact that they also reported a very low transplant rate of 10%, less than half that of the MOMENTUM 3 trial. Therefore, more patients in the denominator in that trial were actually on support and at risk of having a stroke, which lends to it likely being a more reliable report of stroke incidence with the HM3.

There are some inherent limitations to this analysis. The ADVANCE CAP and ENDURANCE Supplemental trials were not performed contemporaneously with the MOMENTUM 3 trial. Also, the sample size of the HM3 population was quite small compared with the HYBRID HVAD population. Also, HM3 outcomes in MOMENTUM 3 appear discordant with those observed in similar trials in Europe for CE Mark;11 therefore, more experience with the HM3 system could result in more refined outcomes not evident in a smaller population. The MOMENTUM 3 trial includes a large CAP experience which may address the concerns of limited experience in the future.9 Uncaptured differences in patient selection and patient management arising from knowledge gained between clinical trials may have led to unmeasured differences that could impact the incidence of neurologic events.

In summary, there is an urgent need in the medical community to make evidenced-based and informed decisions when it comes to device selection. However, until head-to-head randomized studies of contemporary devices are available, clinicians must resort to cross-trial comparisons, frequently from significantly discordant trials. In our analysis, neurologic event rates appear to be equivalent between the HVAD, HM3 and HMII, particularly fatal and disabling strokes. We have outlined a careful examination of the trial design, patient populations, and statistical analyses required to minimize biased conclusions. Future studies with uniform event definitions, careful consideration of statistical designs and analyses are required to further elucidate comparative contemporary device outcomes.

Back to Top | Article Outline

ACKNOWLEDGMENT

The authors gratefully acknowledge the thoughtful discussions and insights contributed by Thomas Vassiliades of Medtronic, as well as the statistical programming support of Jie Qin and Wei Xu, also of Medtronic.

Back to Top | Article Outline

REFERENCES

1. Aaronson KD, Slaughter MS, Miller LW, et al; HeartWare Ventricular Assist Device (HVAD) Bridge to Transplant ADVANCE Trial Investigators: Use of an intrapericardial, continuous-flow, centrifugal pump in patients awaiting heart transplantation. Circulation 2012.125: 3191–3200.
2. Slaughter MS, Pagani FD, McGee EC, et al; HeartWare Bridge to Transplant ADVANCE Trial Investigators: HeartWare ventricular assist system for bridge to transplant: combined results of the bridge to transplant and continued access protocol trial. J Heart Lung Transplant 2013.32: 675–683.
3. Aaronson KD, Silvestry SC, Maltais S, et al. Patients awaiting heart transplantation on HVAD support for greater than 2 years. ASAIO J 2016.62: 384–389.
4. Mehra MR, Naka Y, Uriel N, et al; MOMENTUM 3 Investigators: A fully magnetically levitated circulatory pump for advanced heart failure. N Engl J Med 2017.376: 440–450.
5. Mehra MR, Goldstein DJ, Uriel N, et al; MOMENTUM 3 Investigators: Two-year outcomes with a magnetically levitated cardiac pump in heart failure. N Engl J Med 2018.378: 1386–1395.
6. Scmitto JD, Pya Y, Zimpfer D, et al. Long-term evaluation of a fully magnetically levitated circulatory support device for advanced heart failure-two-year results from the HeartMate 3 CE Mark Study. Eur J Heart Fail 2018. doi: 10.1002/ejhf.1284. [Epub ahead of print]
7. Milano CA, Rogers JG, Tatooles AJ, et al; ENDURANCE Investigators: HVAD: The ENDURANCE supplemental trial. JACC Heart Fail 2018.6: 792–802.
8. Heatley G, Sood P, Goldstein D, et al; MOMENTUM 3 Investigators: Clinical trial design and rationale of the multicenter study of maglev technology in patients undergoing mechanical circulatory support therapy with heartmate 3 (MOMENTUM 3) investigational device exemption clinical study protocol. J Heart Lung Transplant 2016.35: 528–536.
9. Teuteberg JJ, Stewart GC, Jessup M, et al. Implant strategies change over time and impact outcomes: Insights from the INTERMACS (Interagency Registry for Mechanically Assisted Circulatory Support). JACC Heart Fail 2013.1: 369–378.
10. Teuteberg JJ, Rogers JG, Milano CA, et al. Blood pressure management ameliorates neurological events. J Heart Lung Transplant 2018.37:S11.
11. Krabatsch T, Netuka I, Schmitto JD, et al. Heartmate 3 fully magnetically levitated left ventricular assist device for the treatment of advanced heart failure -1 year results from the Ce mark trial. J Cardiothorac Surg 2017.12: 23.
Keywords:

left ventricular assist device; advanced heart failure; stroke

Copyright © 2019 by the American Society for Artificial Internal Organs