To systematically evaluate the methodological quality of randomized clinical trials and to determine whether randomized clinical trials of sepsis improved in methodological quality over time.
Computerized MEDLINE search of articles published in any language from 1966 to 1998 combined with a manual search of bibliographies of published articles and communication with known experts in the field.
All randomized clinical trials of sepsis, severe sepsis, and septic shock performed in adults and published as full articles.
Abstracts of all retrieved records were reviewed and the inclusion criteria were applied. All selected articles were classified into (a) trials designed to detect differences in mortality as the primary end point, or (b) trials focusing on surrogate outcome measures (i.e., physiological or biochemical parameters). All retrieved trials were then graded for methodological quality using an objective grading scheme developed specifically for this study. The data selection and extraction process was carried out independently by two of the authors; any disagreement was resolved by discussion.
Seventy-four randomized clinical trials involving septic patients qualified for inclusion in this study (40 reporting mortality outcomes, 34 reporting other surrogate outcomes). Trials reporting mortality as the primary outcome had significantly higher quality scores compared with trials reporting surrogate outcome measures (29.6 ± 1.0 vs. 24.3 ± 0.8, p = .0006). From 1976 to 1998, trial methodology improved significantly over time (an average of 0.36 points per year, p = .021). Mortality outcome trials improved an average of 0.58 points per year (p = .0011) whereas surrogate outcome trials did not demonstrate an improvement in methodological quality over time (p = .249).
The methodological limitations identified in this article can help to target further improvement in trial design to enhance the validity of findings from future randomized clinical trials of sepsis.
From the Medical Clinic I, Department of Cardiology, University Hospital Aachen, Aachen, Germany (JG); the London Health and Sciences Centre, London, Ontario, Canada (JG); the Division of Critical Care Medicine, Department of Medicine, University of Sydney, Sydney, Australia (GSD); the Departments of Medicine and Clinical Epidemiology & Biostatistics, McMaster University, Hamilton, Ontario, Canada (DJC); the Department of Intensive Care, Erasme Hospital, Free University of Brussels, Brussels, Belgium (J-LV); and the Department of Medicine, Sunnybrook and Women’s College Health Sciences Centre, University of Toronto, Toronto, Ontario, Canada (WJS).
Address requests for reprints to: Jürgen Graf, MD, Medical Clinic I, University of Aachen, Pauwelsstr. 30, 52074 Aachen, Germany. E-mail: email@example.com