Randomized Trial of $5 Versus $10 Monetary Incentives, Envelope Size, and Candy to Increase Physician Response Rates to Mailed Questionnaires

Abstract

Background.  

The validity of the results of mailed surveys is often threatened by nonresponse bias, which is made more likely when response rates are low. However, the effectiveness and cost-effectiveness of several strategies to increase response rates are uncertain.

Objectives.  

To assess three strategies to increase response rates to mailed physician surveys: including a $10 versus a $5 cash incentive in the initial mailing, including a mint candy or not, and using a large versus small outgoing envelope.

Research Design and subjects.  

Using a 2 × 2 × 2 factorial design, a randomized trial of these strategies was conducted in a survey of 1200 physicians randomly selected from the American Medical Association’s Master File.

Results.  

Including a $10 incentive yielded a significantly higher response rate (60.5% vs. 52.8%) (P = 0.009). The mailing and incentive costs per completed response were $12.24 (95% CI, $11.75, $13.64) in the $5 group and $18.48 (95% CI, $17.77, $20.69) in the $10 group. Each additional response obtained in the $10 group came at an incremental cost of $61.26 (95% CI, $36.98, $200.80). Neither inclusion of a mint nor use of a large envelope influenced the response rate.

Conclusions.  

Investigators may increase response rates by including more money in the initial questionnaire packet, but there may be diminishing returns to serial increments in incentives greater than $5. Including smaller incentives in more questionnaires may maximize total responses.