Share this article on:

A Method for Detection of Residual Confounding in Time-series and Other Observational Studies

Flanders, W. Danaa,b; Klein, Mitchelc; Darrow, Lyndsey A.c; Strickland, Matthew J.c; Sarnat, Stefanie E.c; Sarnat, Jeremy A.c; Waller, Lance A.b; Winquist, Andreac; Tolbert, Paige E.c

doi: 10.1097/EDE.0b013e3181fdcabe
Methods: Original Article

Background: A difficult issue in observational studies is assessment of whether important confounders are omitted or misspecified. In this study, we present a method for assessing whether residual confounding is present. Our method depends on availability of an indicator with 2 key characteristics: first, it is conditionally independent (given measured exposures and covariates) of the outcome in the absence of confounding, misspecification, and measurement errors; second, it is associated with the exposure and, like the exposure, with any unmeasured confounders.

Methods: We demonstrate the method using a time-series study of the effects of ozone on emergency department visits for asthma in Atlanta. We argue that future air pollution may have the characteristics appropriate for an indicator, in part because future ozone cannot have caused yesterday's health events. Using directed acyclic graphs and specific causal relationships, we show that one can identify residual confounding using an indicator with the stated characteristics. We use simulations to assess the discriminatory ability of future ozone as an indicator of residual confounding in the association of ozone with asthma-related emergency department visits. Parameter choices are informed by observed data for ozone, meteorologic factors, and asthma.

Results: In simulations, we found that ozone concentrations 1 day after the emergency department visits had excellent discriminatory ability to detect residual confounding by some factors that were intentionally omitted from the model, but weaker ability for others. Although not the primary goal, the indicator can also signal other forms of modeling errors, including substantial measurement error, and does not distinguish between them.

Conclusions: The simulations illustrate that the indicator based on future air pollution levels can have excellent discriminatory ability for residual confounding, although performance varied by situation. Application of the method should be evaluated by considering causal relationships for the intended application, and should be accompanied by other approaches, including evaluation of a priori knowledge.

From the Departments of aEpidemiology, bBiostatistics and Bioinformatics, and cEnvironmental and Occupational Health, Rollins School of Public Health, Emory University, Atlanta, GA.

Submitted 1 April 2010; accepted 17 August 2010; posted 10 November 2010.

Supported by the following grants: EPA STAR RD83479901 and RD833626, NIEHS R01ES11294, and EPRI EP-P277231/C13172.

Correspondence: W. Dana Flanders, Department of Epidemiology, Rollins School of Public Health, Emory University, 1518 Clifton Rd NE, Atlanta, GA 30322. E-mail:

© 2011 Lippincott Williams & Wilkins, Inc.