Cultural Variability in the Effects of Question Design Features on Respondent Comprehension of Health Surveys

• Published in: Annals of epidemiology Vol. 16; no. 9; pp. 661 - 668
• Main Authors: Johnson, Timothy P., Cho, Young IK, Holbrook, Allyson L., O'Rourke, Diane, Warnecke, Richard B., Chavez, Noel
• Format: Journal Article
• Language: English
• Published: United States Elsevier Inc 01.09.2006
• Subjects: Behavior Coding; Cognitive Science - methods; Continental Population Groups; Cross-Cultural Comparison; Cross-Cultural Methodology; Cultural Diversity; Data Collection; Ethnic Groups; Health Behavior; Humans; Interview, Psychological - methods; Multicultural Instruments; Multicultural Survey Design; Research Design; Surveys and Questionnaires; HLM; Multicultural Survey Design; Multicultural Instruments; Cross-Cultural Methodology; Behavior Coding
• ISSN: 1047-2797; 1873-2585
• DOI: 10.1016/j.annepidem.2005.11.011

The aim is to identify the characteristics of common health survey questions that may be associated with cross-cultural variability in question comprehension. Interviews with respondents representing four cultural subgroups in the United States were analyzed through behavior coding to identify survey question characteristics that may be associated with cross-cultural variability in comprehension. Using survey responses as the unit of analysis, nested within survey respondents and survey questions, hierarchical linear modeling was used to examine the effects of four questionnaire design features on cultural variations in comprehension difficulties. Respondent culture was found to moderate the effects of response format, question length, and reading levels. Several question design strategies that reduce overall comprehension difficulty appear to also increase cross-cultural disparities.