Development and Reliability Testing of a Fast-Food Restaurant Observation Form

• Published in: American journal of health promotion Vol. 30; no. 1; pp. 9 - 18
• Main Authors: Rimkus, Leah, Ohri-Vachaspati, Punam, Powell, Lisa M., Zenk, Shannon N., Quinn, Christopher M., Barker, Dianne C., Pugach, Oksana, Resnick, Elissa A., Chaloupka, Frank J.
• Format: Journal Article
• Language: English
• Published: Los Angeles, CA SAGE Publications 01.09.2015
• Subjects: Advertising as Topic; Chicago; Chicago, Illinois; Consumers; Data Collection - methods; Fast food service industry; Fast Foods - classification; Fast Foods - economics; Fast Foods - statistics & numerical data; Food; Nutrition; Observer Variation; Prices; Reproducibility of Results; Restaurants; Restaurants - economics; Restaurants - statistics & numerical data; Testing; Target population age: youth, adults, seniors; Research purpose: instrument development; Health focus: nutrition, weight control; Target population circumstances: Chicago Metropolitan Statistical Area, all education levels, all income levels, all races/ethnicities; Manuscript format: research; Study design: observational research; Prevention Research; Marketing; Outcome measure: other environmental; Fast-Food Restaurants; Environment; Reliability; Strategy: policy, built environment; Setting: local community
• ISSN: 0890-1171; 2168-6602; 2168-6602
• DOI: 10.4278/ajhp.130731-QUAN-389

Purpose. To develop a reliable observational data collection instrument to measure characteristics of the fast-food restaurant environment likely to influence consumer behaviors, including product availability, pricing, and promotion. Design. The study used observational data collection. Setting. Restaurants were in the Chicago Metropolitan Statistical Area. Subjects. A total of 131 chain fast-food restaurant outlets were included. Measures. Interrater reliability was measured for product availability, pricing, and promotion measures on a fast-food restaurant observational data collection instrument. Analysis. Analysis was done with Cohen's κ coefficient and proportion of overall agreement for categorical variables and intraclass correlation coefficient (ICC) for continuous variables. Results. Interrater reliability, as measured by average κ coefficient, was .79 for menu characteristics, .84 for kids' menu characteristics, .92 for food availability and sizes, .85 for beverage availability and sizes, .78 for measures on the availability of nutrition information, .75 for characteristics of exterior advertisements, and .62 and .90 for exterior and interior characteristics measures, respectively. For continuous measures, average ICC was .88 for food pricing measures, .83 for beverage prices, and .65 for counts of exterior advertisements. Conclusion. Over 85% of measures demonstrated substantial or almost perfect agreement. Although some measures required revision or protocol clarification, results from this study suggest that the instrument may be used to reliably measure the fast-food restaurant environment.