# Evaluating Health Outcomes in the Presence of Competing Risks: A Review of Statistical Methods and Clinical Applications

Background: An evaluation of the effect of a healthcare intervention (or an exposure) must consider multiple possible outcomes, including the primary outcome of interest and other outcomes such as adverse events or mortality. The determination of the likelihood of benefit from an intervention, in the presence of other competing outcomes, is a competing risks problem. Although statistical methods exist for quantifying the probability of benefit from an intervention while accounting for competing events, these methods have not been widely adopted by clinical researchers.

Objectives: (1) To demonstrate the importance of considering competing risks in the evaluation of treatment effectiveness, and (2) to review appropriate statistical methods, and recommend how they might be applied.

Research Design and Methods: We reviewed 3 statistical approaches for analyzing the competing risks problem: (*a*) cause-specific hazard (CSH), (*b*) cumulative incidence function (CIF), and (*c*) event-free survival (EFS). We compare these methods using a simulation study and a reanalysis of a randomized clinical trial.

Results: Simulation studies evaluating the statistical power to detect the effect of intervention under different scenarios showed that: (1) CSH approach is best for detecting the effect of an intervention if the intervention only affects either the primary outcome or the competing event; (2) EFS approach is best only when the intervention affects both primary and competing events in the same manner; and (3) CIF approach is best when the intervention affects both primary and competing events, but in opposite directions. Using data from a randomized controlled trial, we demonstrated that a comprehensive approach using all 3 approaches provided useful insights on the effect of an intervention on the relative and absolute risks of multiple competing outcomes.

Conclusions: CSH is the fundamental measure of outcome in competing risks problems. It is appropriate for evaluating treatment effects in the presence of competing events. Results of CSH analysis for primary and competing outcomes should always be reported even when EFS or CIF approaches are called for. EFS is appropriate for evaluating the composite effect of an intervention, only when combining different endpoints is clinically and biologically meaningful, and the treatment has similar effects on all event types. CIF is useful for evaluating the likelihood of benefit from an intervention over a meaningful period. CIF should be used for absolute risk calculations instead of the widely used complement of the Kaplan-Meier (1 − KM) estimator.

From the *Department of Medicine, Johns Hopkins University School of Medicine, Baltimore, MD; and Departments of †Health Policy and Management, and ‡Biostatistics, Johns Hopkins University Bloomberg School of Public Health, Baltimore, MD.

Supported by the Agency for Healthcare Research and Quality under task order HHSA290–2005–0034-I-TO2-WA4 (Project ID 20-EHC).

The authors of this manuscript are responsible for its content. No statement may be construed as the official position of the Agency for Healthcare Research and Quality of the US Department of Health and Human Services.

Reprints: Ravi Varadhan, PhD, The Center on Aging and Health, Suite 2–700, 2024 E. Monument St, Baltimore, MD 21205. E-mail: rvaradhan@jhmi.edu.

- Abstract
- SECTION 1: DEFINITION OF THE COMPETING RISKS PROB...
- SECTION 2: MAJOR ANALYTIC OPTIONS FOR ADDRESSING ...
- SECTION 3: A SIMULATION STUDY OF THE 3 ANALYTIC M...
- SECTION 4: REGRESSION MODELING OF COMPETING RISKS...
- SECTION 5: STATISTICAL APPROACHES BASED ON UNOBSE...
- SECTION 6: SUMMARY AND RECOMMENDATIONS
- ACKNOWLEDGMENTS
- REFERENCES
- Cited By

In evaluating the effectiveness of an intervention, clinicians need to consider the evidence on the effect of that intervention on the outcome of interest. This is straightforward when the outcome is all-cause mortality, but more challenging when the outcome is a specific event, such as myocardial infarction or cause-specific mortality. Patients with multiple conditions may experience outcomes due to other illnesses that reduce their likelihood of deriving benefit from the intervention being considered. Determining the likelihood of benefit from an intervention for a specific outcome, in the presence of competing outcomes, is referred to as the competing risks problem.

This article is divided into 6 sections: (1) definition of the competing risks problem, with illustrations; (2) description of 3 methods for analyzing competing risks: causes-specific hazards (CSH), cumulative incidence function (CIF), and event-free survival (EFS) modeling; (3) a simulation study to demonstrate that a treatment can have varying impact on CSH, CIF, and EFS, and evaluation of the statistical power for testing and detecting the treatment effect, under different scenarios of how the treatment affects the different outcomes; (4) demonstration using data from a randomized clinical trial of the potential dangers in ignoring competing risks by focusing on either the primary outcome or a composite outcome, and description of how to rigorously address competing risks by using all 3 methods; (5) brief discussion of statistical methods that attempt to draw inferences about the “true” biologic effect of interventions, highlighting the major challenges to doing this; (6) recommendations for appropriate methods according to study objectives. Throughout, we maintain that a rigorous evaluation of effectiveness should consider the effect of the intervention on the rates and probabilities of both primary and competing outcomes.

## SECTION 1: DEFINITION OF THE COMPETING RISKS PROBLEM

Biomedical studies often evaluate the effect of a variable (eg, an intervention, exposure, or risk-factor) on the time to occurrence of an event. The time to occurrence may not be observed in all participants due to censoring from withdrawal or the end of study. When there is only one type of event, eg, all-cause mortality, widely-used statistical methods such as Kaplan-Meier curves, log-rank tests, or Cox proportional hazard models are appropriate. However, if there are different types of outcomes, this is a competing risks problem.

A classic competing risks situation occurs when the event types are mutually exclusive, that is, the occurrence of any one type of event precludes that of all other types of events (Fig. 1A). The classic competing risks problem is of major interest to demographers who analyze the patterns and inter-relationships of different causes of mortality.

A semicompeting risks situation arises when a particular type of event can preclude other types of events, but not vice versa (Fig. 1B), such as when a specific disease-related outcome is the primary event of interest but death acts as a competing risk. For example, an individual can have a stroke and survive, but die later from an unrelated cause. For that individual we can observe both time to stroke and time to death. However, if an individual dies without having had a stroke, we can only observe the time to death. This makes it difficult to draw inferences about, for example, the impact of an intervention for preventing stroke, because death prevents us from observing the complete process. Most problems in medicine are semi-competing risks problems. The distinction between the classic and semi-competing risks problems becomes important when the goal is to make inferences about unobservable quantities, for example, the “true” biologic effect of an intervention on stroke in the absence of competing events. This is known as the “net” treatment effect; whereas the treatment effects obtained based on observable variables alone are known as “crude” treatment effects. The methods we present are applicable in both classic and semi-competing risks situations for the estimation of the crude treatment effects. More advanced methods are required for the estimation of net treatment effects (see Section 5).

### Illustrations of Competing Risks in the Literature

The competing risks problem dates to the 1760s when Daniel Bernoulli analyzed the effect of small-pox eradication on life-expectancy.^{1} Since the seminal articles of Fix and Neyman, Tsiatis, and Prentice et al, there have been numerous developments in statistical methodology for modeling competing risks.^{2–4} Standard methods of survival analysis appropriate for single failure-type problems, like the log-rank test, and the complement of the Kaplan-Meier survival estimate, cannot be used with competing risks, because their validity hinges on the unlikely assumption that the competing events are statistically independent.^{5–8} Their use assumes a world in which all competing risks are absent. Many clinical researchers have failed to appreciate this and related subtleties, and have not adopted appropriate competing risks methods.

We present 3 examples to illustrate the situations in which competing risks may pose analytic challenges.

### Example 1: An Evaluation of the Absolute Risk of an Outcome

A recent article by Lentine, et al aimed to identify predictors of cerebrovascular events associated with kidney transplantation.^{9} They reported the cumulative incidence of cerebrovascular events in each comparison group, using the Kaplan-Meier (KM) method. This method estimates the “net” incidence of cerebrovascular events in the absence of competing causes of mortality, and assumes independence of primary and competing events. Here death from noncerebrovascular causes is the competing event. It is biologically implausible that the primary and competing events are independent. Furthermore, it is problematic to imagine the absence of competing causes of mortality. If viewed as estimating the “crude” incidence of stroke, Lentine's estimates are inflated because individuals who died of noncerebrovascular causes are treated as being at risk for stroke even after their death (see Section 2).

### Example 2: An Evaluation of the Effect of an Intervention on Disease-Specific Outcomes

We consider the example of a trial of rosuvastatin in people with normal cholesterol levels and low-level inflammation.^{10} The primary outcome was a composite variable of myocardial infarction, stroke, arterial revascularization, hospitalization for unstable angina, or death from cardiovascular causes.^{11} The investigators reported EFS. As in all cases in which a disease-specific death is defined as the primary event, deaths from other causes create a classic competing risks problem. Competing risks were not addressed, although results of all-cause mortality analyses were reported.

Like most trial reports, this report conflates the relative risk reduction with evidence for a reduction in the absolute risk. When competing risks are present, a relative risk reduction for primary outcome does not necessarily translate into an absolute risk reduction, which also depends on the effect of the treatment on the competing outcome.

### Example 3: An Evaluation of the Benefit and Harms of Screening, Over a Long Period

Walter and Covinsky have addressed competing risks in screening evaluation.^{12} They present a framework for making individualized decisions based on the baseline risk of dying of a screen-detectable cancer, the length of time that must elapse for screening to yield a survival benefit, and the probability of dying from causes unrelated to the cancer before realizing the intended benefit of screening. An alternative framework has been proposed by Gail et al.^{13} This framework weighs the risks and benefits of an intervention, based on the probabilities of the primary and competing events occurring within a meaningful period. This example illustrates that decisions regarding appropriateness of interventions in older adults should also consider competing risks of mortality.

## SECTION 2: MAJOR ANALYTIC OPTIONS FOR ADDRESSING COMPETING RISKS PROBLEM

### Notation

The observed data, for individual i, in a competing risks problem has the form: (Y_{i}, Δ_{i}, Δ_{I} * ϵ_{i}, X_{i}), where Y_{i} denotes the observation time; (Δ_{i} is a binary variable indicating whether the individual was observed to have any one of the J competing events (Δ_{i} = 1) or was censored (Δ_{i} = 0); ϵ_{i} is a positive integer denoting which one of J competing events was experienced if Δ_{i} = 1, and is unobserved if Δ_{i} = 0; and X_{i} is a vector containing information on covariates (eg, age, gender, treatment indicator). We also note that Y_{i} = T_{i}, the event time, when Δ_{i} = 1, but Y_{i} = C_{i}, the censoring time, when Δ_{i} = 0.

There are several analytic options available for addressing competing risks. Each is associated with a different estimand. An estimand is a theoretical property of the underlying population that is the target of inference. It is estimated by taking a finite sample from the population and then applying an estimation procedure to the sample. Some well-known estimands are the mean difference in linear regression and the odds ratio in logistic regression. The survival function of event time T, S(t) = Pr(T > t), is an estimand, which is typically estimated using the KM product-limit estimator. We focus on 3 estimands that are most widely used in competing risks problems (1): CSH (2) EFS, and (3) CIF.

These estimands are applied in 2 types of situations: (*a*) K-sample testing and (*b*) regression estimation. In K-sample testing, we test whether the true values of the estimands are different between two (K = 2) or more groups, like randomized study participants. In regression modeling, we estimate how the estimands are influenced by covariates.

### Cause-Specific Hazard

CSH for type j is the instantaneous rate of experiencing the event of type j at time t, having not experienced any of the J competing events until time t (Table 1). This is denoted as λ_{j}(t). The unit of λ_{j} is number of events per person-time unit, and hence its value depends on the time scale. There are as many CSH functions as there are types of events. We can also define the conditional CSH, λ_{j}(t | X), as the CSH for the event of type j, at time t, for a covariate value X:

The CSH corresponds to the rate of type j event at time t, in the presence of all types of events. The presence of other events affects the “risk set,” that is, people who survive up to time t. For example, if a person dies from a type 2 event (eg, cancer-caused death), then that person is no more at risk for the type 1 event (eg, stroke). Thus, the estimation of the CSH for type j event involves removing people who have experienced other types of competing events before time t from the “risk set” and assumes that only those who are not censored prior to time t as being at risk for experiencing the type j event. When X is a single categorical variable (eg, treatment indicator), we may evaluate whether λ_{j}(t) differs across categories of X. When λ_{j} differs by a constant multiplicative factor across categories (the proportional hazards assumption), we can use the standard log-rank test to test for difference in hazards. When X is continuous or contains multiple covariates, we may use the Cox model to estimate how different variables affect the CSH.^{14}

CSH modeling is useful for estimating the average relative risk reduction due to treatment in trials. It is important to model the CSH for both the primary and competing outcomes to obtain a comprehensive assessment of the effects of the treatment.

### Event-Free Survival

The EFS, S(t), is defined as the probability of not experiencing any event until time t.

EFS can be written in terms of the overall hazard function, λ(t | X) :

where:

The overall hazard function is the sum of all the CSHs:

EFS is commonly used, because it simplifies the competing risks problem by transforming it into a univariate survival problem, where only the time to occurrence of the first event, whatever it may be, is considered. A well-known example is the composite outcome strategy in clinical trials. Frequently, endpoints such as the time to myocardial infarction, stroke, and all-cause mortality are combined as a single outcome. Therefore, standard techniques of univariate survival analysis including the log-rank test and Cox regression model can be used (when censoring is independent).

EFS may be used to estimate the average effect of the treatment on the overall survival in a trial. However, it should only be used when the treatment alters the risk of primary and competing outcomes in the same direction, in which case it has greater power to detect a treatment effect than the CSH approach.

### Cumulative Incidence Function

CIF of event of type j, F_{j}(t | X), is the probability of experiencing the event of type j in the time interval (0, t]. It is defined as:

It is related to the CSH of the various types of events as follows:

The CIF is also known as the absolute cause-specific risk^{16} and the crude incidence function.^{18} Although the CSH denotes the instantaneous rate of event occurrence, the CIF is the probability of the event's occurrence over a meaningfully long time interval. The CIF is a subdistribution function; it is a nondecreasing function of time with *Fj(t* = *∞)* =Pr*(ϵ* = *j)*≤1.

In Eq. 7, λ_{j}(u | X) is the CSH (Eq.1) and S(u | X) is the EFS (Eq. 3). Thus, Eq. 7 demonstrates the connection between the 3 estimands: CIF, CSH, and EFS. The CIF of type j event depends upon the CSH of all types of events through its dependence on the EFS, S(u | X). Importantly, even if an intervention has no direct impact on λ_{1}, it can still influence F_{1} by affecting the CSH of one of the competing outcomes. Conversely, it is possible for an intervention to have a significant impact on λ_{1}, but have no impact on F_{1}. This is an essential feature of the competing risks problem. Because of this dependence of F_{1}(t | X) on all λ_{j}(t | X), the testing for equality between K groups and regression estimation for F_{1} is not straightforward. The hypothesis of equality of λ_{1} between K groups is not equivalent to the hypothesis of equality of F_{1}. Consequently, the log-rank test is not applicable for testing the equality of CIFs. Gray proposed a test for testing the equality of the CIFs of a particular type of event for K different groups.^{19}

Regression modeling for estimating the association between the CIF and covariates, X, is complicated because F_{j}(t | X) depends on X in a complex manner via the individual CSH regression functions (Eq. 7). If the main goal is to estimate the CIF for a given set of covariates X, we can construct Cox models for each CSH and use the definition in Eq. (7). This is the “indirect” approach. It is valid provided the proportional hazards assumptions for the individual CSH models are reasonable.^{18} If, however, the goal is not estimation of F_{j}, but estimation of covariate effect on F_{j}, the indirect approach is not suitable. Fine and Gray proposed a direct regression model assuming a proportional hazard form for the “hazard rate” of the subdistribution function

The covariates are treated as linear on log(−log(1 − F_{j}(t | X))).^{19} This model also allows for time-varying effects of covariates on the CIF. Since Fine and Gray,^{19} several modeling techniques have been proposed for direct regression estimation of the CIF.^{20–22} These techniques can be implemented using R functions or SAS macros.

Because the CIF is a measure of the actual probability of events, it may be used to evaluate the effect of a treatment on the absolute risk of outcomes. It is better suited for risk-benefit calculations than the CSH. Fine and Gray's regression approach is useful for developing risk prediction models for the primary outcome (Table 1).

Now, we show why the 1 − KM estimator overestimates the CIF. The 1 − KM estimate of cumulative incidence of event type j is:

where:

Comparison of Eqns. (8) with (7) and (9) with (3) shows that the 1 − KM estimator sets the CSH of all event types, except that of type j, to zero. Consequently, S_{j}(t | X) > S(t | X), and G_{j}(t | X) > F_{j}(t | X). Thus, the 1 − KM estimator overestimates the cumulative incidence of event type j. This estimator treats those who die of causes other than j as being at risk for type j event, or equivalently, it means that 1 − KM estimates cumulative incidence for cause j in the hypothetical scenario where other causes of failure are absent.

## SECTION 3: A SIMULATION STUDY OF THE 3 ANALYTIC METHODS FOR Two-SAMPLE TESTING

Three different measures of outcome were defined in Section 2: CSH, EFS, and CIF. We illustrate the use of these estimands for detecting the effect of intervention on the outcomes, under different scenarios of how the intervention affects the different outcomes. Of the 3, CSH is fundamental. EFS and CIF are nonlinear functions of CSH (Eqs.1, 3, 5, and 7). The implication of this is that an intervention can have different effect on the 3 estimands. For example, an intervention may have a significant reduction in the CSH of primary outcome, but it may not affect the EFS or the CIF of primary outcome to a comparable extent.

We consider 2 types of events (J = 2): the primary event of clinical interest (ϵ = 1) and the competing event (ϵ = 2). We test whether there is a difference between 2 treatment groups (A = new treatment and B = control) in terms of the EFS, the CSH for the primary event, and the CIF for the primary event.

We use the log-rank test for testing equality of the CSH for the primary event between the groups A and B:

We use Gray's K-sample test for testing the equality of CIF for the primary event between the groups A and B:

We use the log-rank test for testing equality of EFS. This is equivalent to testing the overall hazard rate between the groups A and B:

For our simulation, we generated 4 sets of uncorrelated random numbers from exponential distributions, representing failure times for the primary, and the competing events and the 2 treatment groups, A (treatment) and B (placebo). The rates for the 4 exponential distributions were chosen to reflect 9 possible effects that an intervention might have on the 2 events. (Table 2). The sample size was 100 in each group. For log-rank tests of H_{o} and S_{0}, we used the survdiff function in the R package, survival.^{24} For Gray's K-sample test of I_{0}, we used the cuminc function in the R package, cmprsk.^{24} All the tests were set up to have a nominal type-I error rate of 0.05.

Table 2 (a) shows scenarios under which there is no treatment effect on the primary event. In scenario 1, where treatment has no effect on both the primary and competing events, all 3 tests reject the null hypothesis at the correct probability of 0.05. In scenarios 2 and 3, where only the competing events rate is affected by the treatment, hypothesis of equality of CSH (H_{0}) is rejected at the correct probability level of 0.05. Hypothesis of equality of CIF of primary event (test I_{0}) in the 2 groups is rejected at a probability greater than 0.05. This is because the treatment does affect F_{1} by affecting λ_{2}, but not λ_{1}. We can, in fact, detect this treatment effect on the competing event rate λ_{2},with greater statistical power, by performing the log-rank test: *λ*_{2}^{A}(t) = *λ*_{2}^{B}(t) , for all t. This underscores the need to perform testing on CSH for all causes.

Table 2 (b) shows scenarios (4 and 5) where the treatment only affects the primary event. These scenarios illustrate that the test of equality of CSH of primary event (test H_{0}) has the greatest power to detect a treatment effect. In Table 2 (c) the treatment affects both primary and competing events. When the treatment affects both event types in the same direction (scenarios 6 and 7), testing the equality of EFS (test S_{0}) is most powerful for detecting a treatment effect. However, there are many examples of treatments whose effects on competing events were not anticipated before large trials of sufficient duration were performed.^{25} Therefore, results of EFS analysis should be reported along with the effects of treatment on the CSH of primary and competing events. When treatment affects both event types, but in the opposite directions (scenarios 8 and 9), the EFS based test has the least power to detect treatment impact. In this case, the test for equality of CIF of the primary event (test of I_{0}) has most power for detecting a treatment effect. This includes instances where the treatment reduces primary events (such a beneficial reduction in the incidence of bad outcomes) but increases competing events (such as a harmful increase in the incidence of competing events), a situation that is of paramount relevance to clinical trials. Results of CIF analysis should not be reported without also reporting the effects of treatment on the CSH of primary and competing events.

## SECTION 4: REGRESSION MODELING OF COMPETING RISKS—APPLICATION TO AN RCT

We now use an example of a randomized controlled trial of the effect of diethylstilbestrol for treating prostate cancer to demonstrate a comprehensive approach to the evaluation of treatment effectiveness in the presence of competing risks.^{28} The trial outcomes were published in 1980; the data were reanalyzed using CSH in 1986.^{27} Participants were allocated to 1 of 4 regimens: placebo, 0.2, 1.0, and 5.0 mg of diethylstilbestrol daily. Following Green and Byar, we dichotomized the treatments and designated placebo and 0.2 mg as the placebo group, and 1.0 and 5.0 mg as the treated group. Death from prostate cancer was the primary outcome; deaths from cardiovascular events and other causes were competing events. We report results for the 483 patients with complete information on all relevant variables. Of these, 344 died, with 149 from prostate cancer, 139 from cardiovascular causes, and 56 from other causes.

Kay reported the results of separate Cox proportional hazards models for each cause of failure, where failures from the other causes were treated as censored observations^{27}; we analyze these data by modeling the CIF, using the direct regression approach of Fine and Gray^{19} (Table 3).

An analysis of only the primary outcome, prostate cancer, without also examining the treatment effect on competing risks, cardiovascular, and other deaths, would overestimate the benefits of the treatment. From a CSH analysis of all outcome types it is evident that the treatment is protective against prostate cancer and death from “other causes,” but raises the risk of cardiovascular deaths (Table 3, first row). A CIF analysis leads to a similar inference. Figure 2 compares the CIFs. Gray's 2-sample test was conducted to determine whether the treatment affected the CIFs (*P* values are reported in figure caption).^{17} The cumulative incidence plots reveal that the probability of cardiovascular death is high initially in the treatment group, so that the treatment has increased cardiovascular death within 1 year of initiating the treatment.

An EFS analysis using all-cause mortality suggests that the treatment is beneficial since it reduced the rate of overall death. This is a dangerously misleading inference, because the data also show that the treatment is related to excess cardiovascular mortality. Furthermore, there can be no good justification for combining cancer and cardiovascular mortality. It is worth noting the lack of power to detect a significant treatment difference on all-cause mortality, because the treatment effect on overall death is diluted by the contrasting treatment effects on cancer plus other mortality and cardiovascular mortality. This is consistent with scenarios 8 and 9 in Table 2 (c), where the EFS based test S_{0} had the least power for detecting a treatment effect (Figure 2).

To demonstrate the potential for bias when estimating treatment induced absolute risk reduction (ARR) without accounting for competing events, we evaluated the effectiveness of DES in reducing the absolute risk of prostate cancer. A popular but flawed approach is to estimate this as the difference between the 1 − KM estimates of the cumulative incidences of prostate cancer in the treatment and control groups. The correct approach is to estimate the ARR as the difference between the CIFs of the 2 groups. We compare these 2 approaches in Figure 3, which shows that the 1 − KM overestimates the ARR due to DES treatment. The positive bias of 1 − KM is especially pronounced when the treatment has a protective effect on the competing risks. In this example, DES increased the risk of cardiovascular death, during the initial 1-year period, but it was also modestly protective against the other competing event, “other” causes of death, during the later study period. Therefore, in the initial 1-year period we do not see any significant bias of 1 − KM estimate of ARR for prostate cancer, but we see a positive bias after 1 year.

## SECTION 5: STATISTICAL APPROACHES BASED ON UNOBSERVABLE VARIABLES

The 3 approaches discussed so far are aimed at estimating the effect of interventions on observable quantities: the CSH itself, and CIF and EFS, which are functions of CSH. These are called “crude” estimates of treatment effect (Section 1). The crude estimands are observable in the sense that they can be estimated using only observable information such as time-to-event and the type of event (under the assumption that censoring due to drop-out is completely at random). Furthermore, the modeling assumptions can be checked using observed data. It may be argued that the crude treatment effects do not represent the “true” biologic impacts of the intervention on outcomes, and that such evaluations should be based on the unobservable marginal distributions of the times to outcomes.^{23,28,29} Treatment effects on the marginal failure time distributions are called “net” treatment effects. Although it seems attractive, estimation of net effects is fraught with conceptual and methodological difficulties: (*a*) in what sense does the time to stroke exist for an individual who has died of breast cancer? and (*b*) how do we check assumptions about the dependency between the multivariate failure times when only one of them is observable on each person? Prentice et al provides a cogent critique of this approach.^{4} Some recent advances have attempted to address these conceptual issues. Rubin, who called this problem “truncation by death,” proposed that a valid comparison of 2 interventions, in terms of their effects on the primary outcome, can only be carried out in such persons who would not experience failure from any of the other competing outcomes under either intervention.^{30} However, we cannot know who such people are from observed data. Further assumptions, which are usually untestable, are required to identify such people and to estimate the differences in survival times for the 2 interventions in that group. In summary, assessing the “true” biologic impact of interventions in a competing risks problem is challenging.

## SECTION 6: SUMMARY AND RECOMMENDATIONS

We have illustrated the appropriateness of different estimands for addressing different study objectives (Table 1). CSH is the fundamental and most commonly used estimand in competing risks problems. It is appropriate for investigating the effect of an intervention on the rate of occurrence of an event, allowing for the presence of all types of outcome events. For example, the CSH approach might be useful to evaluate the average treatment effect of aspirin to prevent stroke in a population with hypertension, where mortality from other causes can occur. Results of CSH analysis for primary and competing outcomes should always be reported in a competing risks problem.

EFS analysis, frequently used for evaluating the composite effect of an intervention in randomized trials, is appropriate only when combining different endpoints is clinically and biologically meaningful, and when the treatment has similar effects (both in magnitude and sign) on the individual event types. For example, EFS might appropriately be used to study the effectiveness of antiretroviral therapy in patients with HIV/AIDS. The therapy is effective at both reducing opportunistic infections and mortality, which may be combined appropriately in a composite outcome. Results of EFS analysis should always be accompanied by the effects of treatment on the CSH of primary and competing events.

CIF is useful for evaluating the effect of an intervention on the probability of occurrence of an event of a particular type over a meaningful period of time. This is best for absolute risk calculations, risk prediction, risk/benefit analyses of a treatment, and identification of subgroups most likely to benefit from a treatment. CIF might be appropriate for investigating an intervention with both substantial benefits and risks like warfarin for the management of atrial fibrillation. Warfarin reduces the risk of stroke but also raises the risk of hemorrhage. Results of CIF analysis should always be reported alongside the effects of treatment on the CSH of primary and competing events.

The 1 − KM estimator should not be used for estimating the absolute risk when competing risks are present, because (*a*) its validity is problematic, (*b*) it overestimates the absolute risk, and (*c*) it likely overestimates the ARR due to an intervention.

The relevance and usefulness of the evidence derived from the use of different estimands may depend on the stakeholder. The needs of the clinician may differ from those of a payor or a policymaker, and this may guide the investigator choosing an estimand. It may be informative for the investigator to explore all 3 estimands (CSH, CIF, and EFS) when analyzing data, although it may not be necessary to report all the results, especially if the study objectives clearly dictate the use of a particular estimand.

The technical challenges of implementing the competing risks methodology are diminishing. This methodology is becoming increasingly available in popular software so that investigators can readily implement the methodology for evaluating health outcomes in the presence of competing risks.

This discussion is also relevant to comparative effectiveness research where the goal is identifying effective interventions for use in usual care settings. In these settings, the patients are heterogeneous in their physiological and functional characteristics. This heterogeneity can impact treatment effectiveness by affecting the baseline risk of the primary outcome, treatment responsiveness, treatment induced harm, and the rate of competing events. Application of the methods described in this article may contribute to an improved understanding of risks and benefits of interventions under different settings.

## ACKNOWLEDGMENTS

The authors thank the project manager Dr. Christine Weston for her assistance with the project and our technical expert panelists Drs. Mitch Gail, Bob Wallace, and Louise Walter for their valuable input. The authors also thank Ms. Pamela Shepherd for assistance with manuscript preparation. The first author (R.V.) would also like to thank Ms. Laura Podewils for introducing him to the competing risks problem.

## REFERENCES

*Biometrika*. 1977;64:429–439.

*Hum Biol*. 1951;23:205–241.

*Proc Natl Acad Sci USA*. 1975;72:20–22.

*Biometrics*. 1978;34:541–554.

*Stat Med*. 1999;18:695–706.

*J Am Stat Assoc*. 1993;88:400.

*J Am Stat Assoc*. 1991;86:770.

*Stat Med*. 1983;2:41–58.

*Clin J Am Soc Nephrol*. 2008;3:1090–1101.

*N Engl J Med*. 2008;359:2195–2207.

*JAMA*. 2003;289:2554–2559.

*JAMA*. 2001;285:2750–2756.

*J Natl Cancer Inst*. 1999;91:1829–1846.

*The Statistical Analysis of Failure Time Data.*New York, NY: Wiley; 1980.

*Biometrics*. 1990;46:813–826.

*Stat Med*. 1992;11:813–829.

*Ann Stat.*1988;16:1141.

*Biometrics*. 1998;54:219–228.

*J Am Stat Assoc*. 1999;94:496.

*Biostatistics*. 2001;2:85–97.

*Scand J Stat*. 2007;34:17.

*Biometrics*. 2005;61:223–229.

*Lifetime Data Anal*. 1995;1:241–254.

*JAMA*. 2003;289:2575–2577.

*Bull Cancer*. 1980;67:477–490.

*Biometrics*. 1986;42:203–211.

*Biometrika*. 1996;83:381–393.

*Biometrics*. 2007;63:96–108.

*J Am Stat Assoc*. 2000;95:435–438.

*J R Stat Soc*. 1972;135:185–206.

## Cited By:

This article has been cited
**1** time(s).

Comparative Effectiveness Research Methods: Symposium Overview and Summary

Medical Care, 48(6): S3-S6.

10.1097/MLR.0b013e3181e10434

PDF (160) | CrossRef

**Keywords:**

cause-specific hazards; event-free survival; cumulative incidence function; semicompeting; risks; comparative effectiveness