Being surveyed can change later behavior and related parameter estimates

• Published in: Proceedings of the National academy of sciences of the United States of America
• Main Authors: Peterson Zwane, Alix, Zinman, Jonathan, Van Dusen, Eric, Parienté, William, Null, Clair, Miguel, Edward, Kremer, Michael, Karlan, Dean S, Hornbeck, Richard, Duflo, Esther
• Format: Journal Article
• Language: English
• Published: (United States) [S.l.] National academy of sciences 2011
• Subjects: Hawthorne effects; measurement effects; Models of attention; Question–behavior effects; Survey methodology
• ISSN: 0027-8424; 1091-6490
• DOI: 10.1073/pnas.1000776108

Does completing a household survey change the later behavior of those surveyed? In three field studies of health and two of microlending, we randomly assigned subjects to be surveyed about health and/or household finances and then measured subsequent use of a related product with data that does not rely on subjects' self-reports. In the three health experiments, we find that being surveyed increases use of water treatment products and take-up of medical insurance. Frequent surveys on reported diarrhea also led to biased estimates of the impact of improved source water quality. In two microlending studies, we do not find an effect of being surveyed on borrowing behavior. The results suggest that limited attention could play an important but context-dependent role in consumer choice, with the implication that researchers should reconsider whether, how, and how much to survey their subjects.