Spillover Effects in the Presence of Unobserved Networks

• Published in: Political analysis Vol. 29; no. 3; pp. 287 - 316
• Main Author: Egami, Naoki
• Format: Journal Article
• Language: English
• Published: New York, USA Cambridge University Press 01.07.2021
• Subjects: Bias; Experiments; Information communication; Information sharing; Internet; Networks; Research subjects; Researchers; Sensitivity analysis; Simulation; Social networks; Social sciences; China; potential outcomes; interference; SUTVA; causal inference; network experiments
• ISSN: 1047-1987; 1476-4989
• DOI: 10.1017/pan.2020.28

When experimental subjects can interact with each other, the outcome of one individual may be affected by the treatment status of others. In many social science experiments, such spillover effects may occur through multiple networks, for example, through both online and offline face-to-face networks in a Twitter experiment. Thus, to understand how people use different networks, it is essential to estimate the spillover effect in each specific network separately. However, the unbiased estimation of these network-specific spillover effects requires an often-violated assumption that researchers observe all relevant networks. We show that, unlike conventional omitted variable bias, bias due to unobserved networks remains even when treatment assignment is randomized and when unobserved networks and a network of interest are independently generated. We then develop parametric and nonparametric sensitivity analysis methods, with which researchers can assess the potential influence of unobserved networks on causal findings. We illustrate the proposed methods with a simulation study based on a real-world Twitter network and an empirical application based on a network field experiment in China.