Objective: The aim of this study was to determine whether exposure to data from a risk calculator influences surgeons’ assessments of risk and in turn, their decisions to operate.
Background: Little is known about how risk calculators inform clinical judgment and decision-making.
Methods: We asked a national sample of surgeons to assess the risks (probability of serious complications or death) and benefits (recovery) of operative and nonoperative management and to rate their likelihood of recommending an operation (5-point scale) for 4 detailed clinical vignettes wherein the best treatment strategy was uncertain. Surgeons were randomized to the clinical vignettes alone (control group; n = 384) or supplemented by data from a risk calculator (risk calculator group; n = 395). We compared surgeons’ judgments and decisions between the groups.
Results: Surgeons exposed to the risk calculator judged levels of operative risk that more closely approximated the risk calculator value (RCV) compared with surgeons in the control group [mesenteric ischemia: 43.7% vs 64.6%, P < 0.001 (RCV = 25%); gastrointestinal bleed: 47.7% vs 53.4%, P < 0.001 (RCV = 38%); small bowel obstruction: 13.6% vs 17.5%, P < 0.001 (RCV = 14%); appendicitis: 13.4% vs 24.4%, P < 0.001 (RCV = 5%)]. Surgeons exposed to the risk calculator also varied less in their assessment of operative risk (standard deviations: mesenteric ischemia 20.2% vs 23.2%, P = 0.01; gastrointestinal bleed 17.4% vs 24.1%, P < 0.001; small bowel obstruction 10.6% vs 14.9%, P < 0.001; appendicitis 15.2% vs 21.8%, P < 0.001). However, averaged across the 4 vignettes, the 2 groups did not differ in their reported likelihood of recommending an operation (mean 3.7 vs 3.7, P = 0.76).
Conclusions: Exposure to risk calculator data leads to less varied and more accurate judgments of operative risk among surgeons, and thus may help inform discussions of treatment options between surgeons and patients. Interestingly, it did not alter their reported likelihood of recommending an operation.
*Department of Surgery, UCLA David Geffen School of Medicine, Los Angeles, CA
†VA Greater Los Angeles Healthcare System, Los Angeles, CA
‡Department of Health Policy and Management, UCLA Fielding School of Public Health, Los Angeles, CA
§Department of Medicine, UCLA David Geffen School of Medicine, Los Angeles, CA
||RAND Corporation, Los Angeles, CA
¶UCLA Anderson School of Management, Los Angeles, CA
#Department of Psychology, UCLA College of Letters and Sciences, Los Angeles, CA.
Reprints: Greg D. Sacks, MD, MPH, Surgery resident, UCLA Department of Surgery, 10833 Le Conte Ave. 72-227 CHS, Los Angeles, CA 90095. E-mail: firstname.lastname@example.org.
C.Y.K. is employed by the American College of Surgeons. The other authors report no conflicts of interest.
G.D.S. and A.J.D. received support from the Robert Wood Johnson/Veterans Affairs Clinical Scholars program.
Funding sources: Two of the authors (G.D.S. and A.J.D.) received support from the Robert Wood Johnson/Veterans Affairs Clinical Scholars program.
Supplemental digital content is available for this article. Direct URL citations appear in the printed text and are provided in the HTML and PDF versions of this article on the journal's Web site (www.annalsofsurgery.com).