The Generalizability of Online Experiments Conducted During the COVID-19 Pandemic
The COVID-19 pandemic imposed new constraints on empirical research, and online data collection by social scientists increased. Generalizing from experiments conducted during this period of persistent crisis may be challenging due to changes in how participants respond to treatments or the compositi...
Saved in:
| Published in | Journal of experimental political science Vol. 9; no. 3; pp. 379 - 394 |
|---|---|
| Main Authors | , , |
| Format | Journal Article |
| Language | English |
| Published |
New York, USA
Cambridge University Press
01.01.2022
|
| Subjects | |
| Online Access | Get full text |
Cover
Loading…
| Abstract | The COVID-19 pandemic imposed new constraints on empirical research, and online data collection by social scientists increased. Generalizing from experiments conducted during this period of persistent crisis may be challenging due to changes in how participants respond to treatments or the composition of online samples. We investigate the generalizability of COVID era survey experiments with 33 replications of 12 pre-pandemic designs, fielded across 13 quota samples of Americans between March and July 2020. We find strong evidence that pre-pandemic experiments replicate in terms of sign and significance, but at somewhat reduced magnitudes. Indirect evidence suggests an increased share of inattentive subjects on online platforms during this period, which may have contributed to smaller estimated treatment effects. Overall, we conclude that the pandemic does not pose a fundamental threat to the generalizability of online experiments to other time periods. |
|---|---|
| AbstractList | The COVID-19 pandemic imposed new constraints on empirical research, and online data collection by social scientists increased. Generalizing from experiments conducted during this period of persistent crisis may be challenging due to changes in how participants respond to treatments or the composition of online samples. We investigate the generalizability of COVID era survey experiments with 33 replications of 12 pre-pandemic designs, fielded across 13 quota samples of Americans between March and July 2020. We find strong evidence that pre-pandemic experiments replicate in terms of sign and significance, but at somewhat reduced magnitudes. Indirect evidence suggests an increased share of inattentive subjects on online platforms during this period, which may have contributed to smaller estimated treatment effects. Overall, we conclude that the pandemic does not pose a fundamental threat to the generalizability of online experiments to other time periods. |
| Author | Peyton, Kyle Huber, Gregory A. Coppock, Alexander |
| Author_xml | – sequence: 1 givenname: Kyle orcidid: 0000-0003-4845-5760 surname: Peyton fullname: Peyton, Kyle email: kyle.peyton@acu.edu.au organization: 1Institute for Humanities and Social Sciences, Australian Catholic University, Melbourne, Australia – sequence: 2 givenname: Gregory A. surname: Huber fullname: Huber, Gregory A. organization: 2Yale University, New Haven, CT, USA – sequence: 3 givenname: Alexander surname: Coppock fullname: Coppock, Alexander organization: 2Yale University, New Haven, CT, USA |
| BookMark | eNp1kN9LwzAQx4MoOOee_AcKPkpnLmn641G6OQeDTZziW0jSdGZ06UxTcP71dmwoiD7dcXy-d8fnAp3a2mqErgAPAUNy-7p4GhJMYAjJCeoRzEhI4ig7_e4pPkeDplljjCFOuiHtocflmw4m2monKvMppKmM3wV1GcxtZawOxh9b7cxGW98EeW2LVnldBKPWGbsKfJfN5y_TUQhZsBC20BujLtFZKapGD461j57vx8v8IZzNJ9P8bhYqkmU-ZGVJqJQiiySkIFURyzSFMi5JQXCUFjRiWkWSyYziTKmEpbQkQAoMmFJgjPbR9WHv1tXvrW48X9ets91JThKSRhADIx0FB0q5ummcLrkyXnhTW--EqThgvpfHO3l8L49D0mVufmW2nQLhdv_Q4ZEWG-lMsdI_j_zFfwFgpn47 |
| CitedBy_id | crossref_primary_10_1007_s11002_024_09718_6 crossref_primary_10_1177_1532673X241236196 crossref_primary_10_3389_fspor_2022_971677 crossref_primary_10_1016_j_jcrimjus_2024_102186 crossref_primary_10_1111_ssqu_13178 crossref_primary_10_1093_poq_nfae004 crossref_primary_10_1177_00220027241246539 crossref_primary_10_1017_bap_2023_20 crossref_primary_10_1111_1745_9133_12641 crossref_primary_10_1093_bjc_azae025 crossref_primary_10_3389_fpsyg_2024_1330483 crossref_primary_10_1111_ajps_12786 crossref_primary_10_1177_25152459221140388 crossref_primary_10_1016_j_chb_2023_107758 crossref_primary_10_1177_00111287231189718 crossref_primary_10_1080_13523260_2023_2216112 crossref_primary_10_1086_719402 crossref_primary_10_2139_ssrn_4440111 crossref_primary_10_1016_j_jbef_2023_100790 crossref_primary_10_1177_00220027221120374 crossref_primary_10_1086_726932 crossref_primary_10_1080_07418825_2024_2406535 crossref_primary_10_1371_journal_pone_0263097 crossref_primary_10_1177_1532673X231172905 crossref_primary_10_1002_smi_3272 crossref_primary_10_1093_poq_nfad049 crossref_primary_10_1093_pnasnexus_pgae469 crossref_primary_10_1215_03616878_11066312 crossref_primary_10_1080_25751654_2024_2358596 crossref_primary_10_1111_pops_12978 crossref_primary_10_1215_03616878_10852592 crossref_primary_10_1073_pnas_2311825121 crossref_primary_10_1371_journal_pone_0278496 crossref_primary_10_1017_psrm_2024_2 crossref_primary_10_1080_13501763_2024_2306226 crossref_primary_10_1080_1068316X_2024_2364286 crossref_primary_10_1177_00472875231209983 crossref_primary_10_1057_s41269_022_00279_y crossref_primary_10_1017_pls_2023_7 crossref_primary_10_1111_ssqu_13390 crossref_primary_10_1016_j_jbef_2024_100986 crossref_primary_10_1093_poq_nfad059 crossref_primary_10_1017_S1537592724000240 crossref_primary_10_1016_j_jcrimjus_2024_102172 crossref_primary_10_1016_j_psychsport_2024_102773 crossref_primary_10_1017_S0003055424000327 crossref_primary_10_1177_10659129241280248 crossref_primary_10_2139_ssrn_4129550 crossref_primary_10_1007_s11109_022_09796_0 crossref_primary_10_1093_esr_jcad012 crossref_primary_10_1371_journal_pone_0281449 crossref_primary_10_1007_s12103_024_09790_8 crossref_primary_10_1177_20531680231206611 crossref_primary_10_1017_S1049096522000932 crossref_primary_10_3389_fpubh_2022_852214 crossref_primary_10_1177_00224278221121622 crossref_primary_10_3102_00028312231208956 crossref_primary_10_1177_1532673X211070819 crossref_primary_10_15869_itobiad_1606146 crossref_primary_10_1016_j_ssresearch_2021_102692 crossref_primary_10_1073_pnas_2114388118 crossref_primary_10_1093_poq_nfac053 crossref_primary_10_1017_S1744133124000306 crossref_primary_10_1016_j_electstud_2023_102656 crossref_primary_10_1108_CI_03_2023_0057 crossref_primary_10_1109_TEM_2024_3404882 crossref_primary_10_1111_1745_9133_12572 crossref_primary_10_1080_13691066_2024_2360914 crossref_primary_10_1177_1532673X231168354 crossref_primary_10_1371_journal_pone_0306261 crossref_primary_10_1017_XPS_2022_23 crossref_primary_10_3390_vaccines10111791 crossref_primary_10_1007_s11292_024_09610_3 crossref_primary_10_1145_3715116 crossref_primary_10_1080_09644016_2023_2178351 crossref_primary_10_2139_ssrn_4853963 crossref_primary_10_1080_21565503_2024_2304316 crossref_primary_10_1177_23326492241254072 |
| Cites_doi | 10.1111/ajps.12357 10.1017/S1930297500002205 10.1126/science.7455683 10.1093/jleo/17.1.62 10.31235/osf.io/8sbe4 10.31234/osf.io/vktqu 10.1038/s41562-020-00990-w 10.1016/j.jesp.2015.09.010 10.7910/DVN/38UTBF 10.1027/1864-9335/a000178 10.1017/psrm.2018.10 10.1177/2515245919838479 10.1086/269015 10.1017/pan.2019.5 10.1073/pnas.1808083115 10.1016/j.jesp.2009.03.009 10.1111/j.1467-9221.2009.00716.x 10.1017/XPS.2017.32 10.1017/XPS.2018.2 10.1111/ajps.12138 10.1177/2515245918810225 10.1017/S0003055401002222 10.1111/ajps.12081 10.1017/XPS.2015.19 10.1111/pops.12034 10.1126/science.aaf0918 10.1017/S0003055420000076 10.1017/S000305541800076X 10.1093/pan/mpr057 10.1093/poq/nfs054 10.33774/apsa-2020-96t72 10.3102/0013189X005010003 10.1017/S0003055412000597 10.1093/analys/63.3.190 10.1177/2053168018822174 |
| ContentType | Journal Article |
| Copyright | The Author(s), 2021. Published by Cambridge University Press on behalf of The Experimental Research Section of the American Political Science Association |
| Copyright_xml | – notice: The Author(s), 2021. Published by Cambridge University Press on behalf of The Experimental Research Section of the American Political Science Association |
| DBID | AAYXX CITATION 0-V 3V. 7UB 7XB 88J 8FK ABUWG AFKRA ALSLI AZQEC BENPR CCPQU DPSOV DWQXO GNUQQ KC- M2L M2R PHGZM PHGZT PKEHL POGQB PQEST PQQKQ PQUKI PRINS PRQQA Q9U |
| DOI | 10.1017/XPS.2021.17 |
| DatabaseName | CrossRef ProQuest Social Sciences Premium Collection【Remote access available】 ProQuest Central (Corporate) Worldwide Political Science Abstracts ProQuest Central (purchase pre-March 2016) Social Science Database (Alumni Edition) ProQuest Central (Alumni) (purchase pre-March 2016) ProQuest Central (Alumni) ProQuest Central UK/Ireland Social Science Premium Collection ProQuest Central Essentials - QC ProQuest Central ProQuest One Politics Collection ProQuest Central Korea ProQuest Central Student ProQuest Politics Collection Political Science Database Social Science Database ProQuest Central Premium ProQuest One Academic (New) ProQuest One Academic Middle East (New) ProQuest Sociology & Social Sciences Collection ProQuest One Academic Eastern Edition (DO NOT USE) ProQuest One Academic ProQuest One Academic UKI Edition ProQuest Central China ProQuest One Social Sciences ProQuest Central Basic |
| DatabaseTitle | CrossRef ProQuest Sociology & Social Sciences Collection ProQuest Central Student ProQuest One Academic Middle East (New) ProQuest Central Essentials ProQuest Social Science Journals (Alumni Edition) ProQuest Central (Alumni Edition) ProQuest One Community College Politics Collection Sociology & Social Sciences Collection ProQuest Central China ProQuest Central ProQuest Central Korea Worldwide Political Science Abstracts ProQuest Central (New) Social Science Premium Collection ProQuest Political Science ProQuest One Social Sciences ProQuest Central Basic ProQuest One Academic Eastern Edition ProQuest Social Science Journals ProQuest Social Sciences Premium Collection ProQuest One Academic UKI Edition ProQuest Politics Collection ProQuest One Academic ProQuest One Academic (New) ProQuest Central (Alumni) |
| DatabaseTitleList | ProQuest Sociology & Social Sciences Collection CrossRef |
| Database_xml | – sequence: 1 dbid: BENPR name: ProQuest Central url: https://www.proquest.com/central sourceTypes: Aggregation Database |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Political Science |
| EISSN | 2052-2649 |
| EndPage | 394 |
| ExternalDocumentID | 10_1017_XPS_2021_17 |
| GeographicLocations | United States--US |
| GeographicLocations_xml | – name: United States--US |
| GroupedDBID | 0-V 09C 09D 0R~ 3V. AABWE AACJH AAEED AAGFV AAKTX AALKF AAPYI AARAB AASVR AAUKB ABBXD ABROB ABTND ABUWG ABYPY ABZCX ACABY ACCHT ACFCP ACGFS ACIMK ACQFJ ACREK ACUIJ ACUYZ ACWGA ACYZP ACZBM ACZBN ADBZK ADFEC ADGEJ ADKIL ADOCW ADOVH ADTCA ADVJH AEBAK AEHGV AEYYC AFFUJ AFKQG AFKRA AFKRZ AFLVW AGABE AGHGI AGJUD AGOOT AHQXX AHRGI AIGNW AIHIV AISIE AJPFC AJQAS ALMA_UNASSIGNED_HOLDINGS ALSLI ANFVQ AOWSX ARALO ATUCA AUXHV AVDNQ AWRMI AZQEC BBLKV BENPR BMAJL BPHCQ CCPQU CCQAD CFAFE CGMFO CHEAL CJCSC DOHLZ DPSOV DWQXO EBS EJD GNUQQ HG- HOVLH HZ~ I.5 IH6 IOEEP IPYYG IS6 JHPGK JOSPZ JPPIE JQKCU JRMXA KC- M2L M2R NIKVX O9- PQQKQ PROAC RCA ROL S6- S6U T9M TKY UT1 WFFJZ ZYDXJ AAYXX ABGDZ ABJNI ABXHF ACAJB ACDLN AFZFC AGTDA AKMAY CITATION PHGZM PHGZT 7UB 7XB 8FK PKEHL POGQB PQEST PQUKI PRINS PRQQA Q9U |
| ID | FETCH-LOGICAL-c299t-5ff23bba94b181bcd6b881f6f2d2048d345ec4b5b9309cc7583f212d010331553 |
| IEDL.DBID | BENPR |
| ISSN | 2052-2630 |
| IngestDate | Fri Jul 25 21:56:12 EDT 2025 Tue Jul 01 02:03:49 EDT 2025 Thu Apr 24 23:03:31 EDT 2025 Wed Mar 13 05:55:22 EDT 2024 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 3 |
| Keywords | generalizability replication COVID-19 experiment attentiveness survey research pandemic online research |
| Language | English |
| License | https://www.cambridge.org/core/terms |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c299t-5ff23bba94b181bcd6b881f6f2d2048d345ec4b5b9309cc7583f212d010331553 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 |
| ORCID | 0000-0003-4845-5760 |
| PQID | 2728416152 |
| PQPubID | 2035931 |
| PageCount | 16 |
| ParticipantIDs | proquest_journals_2728416152 crossref_citationtrail_10_1017_XPS_2021_17 crossref_primary_10_1017_XPS_2021_17 cambridge_journals_10_1017_XPS_2021_17 |
| ProviderPackageCode | CITATION AAYXX |
| PublicationCentury | 2000 |
| PublicationDate | 2022-01-01 |
| PublicationDateYYYYMMDD | 2022-01-01 |
| PublicationDate_xml | – month: 01 year: 2022 text: 2022-01-01 day: 01 |
| PublicationDecade | 2020 |
| PublicationPlace | New York, USA |
| PublicationPlace_xml | – name: New York, USA – name: Washington |
| PublicationTitle | Journal of experimental political science |
| PublicationTitleAlternate | J Exp Polit Sci |
| PublicationYear | 2022 |
| Publisher | Cambridge University Press |
| Publisher_xml | – name: Cambridge University Press |
| References | 2015; 2 2009; 45 2019; 7 2015; 59 2019; 6 1987; 51 2019; 2 2013; 107 2018; 62 2015; 349 1976; 5 2020; 4 2009; 30 2018; 5 2013; 77 1981; 211 2018; 1 2020 2018; 115 2019; 27 2019 2014; 58 2019; 113 2014; 35 2001; 17 2020; 114 2010; 5 2003; 63 2016; 351 2001; 95 2012; 20 forthcoming 2016; 66 Hainmueller (S2052263021000178_ref40) 2015; 59 Cronbach (S2052263021000178_ref12) 1982 S2052263021000178_ref5 Mullinix (S2052263021000178_ref22) 2015; 2 Hyman (S2052263021000178_ref34) 1950 S2052263021000178_ref4 S2052263021000178_ref6 S2052263021000178_ref9 Glass (S2052263021000178_ref15) 1976; 5 S2052263021000178_ref8 Young (S2052263021000178_ref33) 2019; 113 S2052263021000178_ref11 Berinsky (S2052263021000178_ref7) 2019 S2052263021000178_ref35 Findley (S2052263021000178_ref13) 2020 S2052263021000178_ref14 S2052263021000178_ref36 S2052263021000178_ref1 S2052263021000178_ref3 S2052263021000178_ref31 S2052263021000178_ref32 S2052263021000178_ref2 S2052263021000178_ref10 S2052263021000178_ref19 S2052263021000178_ref37 S2052263021000178_ref38 S2052263021000178_ref16 S2052263021000178_ref17 S2052263021000178_ref39 Paolacci (S2052263021000178_ref26) 2010; 5 S2052263021000178_ref18 Rosenfeld (S2052263021000178_ref30) forthcoming (S2052263021000178_ref24) 2015; 349 Trump (S2052263021000178_ref42) 2018; 5 Oppenheimer (S2052263021000178_ref25) 2009; 45 S2052263021000178_ref23 S2052263021000178_ref41 S2052263021000178_ref20 S2052263021000178_ref21 S2052263021000178_ref27 S2052263021000178_ref28 S2052263021000178_ref29 |
| References_xml | – volume: 20 start-page: 351 issue: 3 year: 2012 article-title: Evaluating online labor markets for experimental research: Amazon.com’s Mechanical Turk publication-title: Political Analysis – volume: 30 start-page: 591 issue: 4 year: 2009 end-page: 613 article-title: Selective Exposure in the Internet Age: The Interaction between Anxiety and Information Utility. publication-title: Political Psychology – volume: 45 start-page: 867 issue: 4 year: 2009 article-title: Instructional manipulation checks: Detecting satisficing to increase statistical power. publication-title: Journal of Experimental Social psychology – volume: 5 start-page: 159 issue: 2 year: 2018 end-page: 164 article-title: Sex trafficking, Russian infiltration, birth certificates, and pedophilia: A survey experiment correcting fake news publication-title: Journal of Experimental Political Science – volume: 113 start-page: 140 issue: 1 year: 2019 article-title: The Psychology of State Repression: Fear and Dissent Decisions in Zimbabwe. publication-title: American Political Science Review – volume: 58 start-page: 739 issue: 3 year: 2014 article-title: Separating the shirkers from the workers? Making sure respondents pay attention on self-administered surveys. publication-title: American Journal of Political Science – volume: 1 start-page: 443 issue: 4 year: 2018 article-title: Many Labs 2: Investigating variation in replicability across samples and settings. publication-title: Advances in Methods and Practices in Psychological Science – year: 2020 article-title: External Validity. publication-title: Annual Review of Political Science – volume: 351 start-page: 1433 issue: 6280 year: 2016 article-title: Evaluating replicability of laboratory experiments in economics. publication-title: Science – volume: 107 start-page: 188 issue: 1 year: 2013 end-page: 206 article-title: Atomic aversion: Experimental evidence on taboos, traditions, and the non-use of nuclear weapons publication-title: American Political Science Review – volume: 114 start-page: 596 issue: 2 year: 2020 end-page: 602 article-title: Does Trust in Government Increase Support for Redistribution? Evidence from Randomized Survey Experiments. publication-title: American Political Science Review – volume: 62 start-page: 760 issue: 3 year: 2018 article-title: How conditioning on posttreatment variables can ruin your experiment and what to do about it. publication-title: American Journal of Political Science – volume: 5 start-page: 3 issue: 10 year: 1976 end-page: 8 article-title: Primary, secondary, and meta-analysis of research. publication-title: Educational Researcher – volume: 63 start-page: 190 issue: 3 year: 2003 end-page: 194 article-title: Intentional action and side effects in ordinary language publication-title: Analysis – volume: 51 start-page: 75 year: 1987 end-page: 83 article-title: That Which We Call Welfare by Any Other Name Would Smell Sweeter: An Analysis of the Impact of Question Wording on Response Patterns. publication-title: Public Opinion Quarterly – volume: 7 start-page: 613 issue: 3 year: 2019 article-title: Generalizing from Survey Experiments Conducted on Mechanical Turk: A Replication Approach. publication-title: Political Science Research and Methods – volume: 77 start-page: 385 issue: 1 year: 2013 article-title: Assessing the programmatic equivalence assumption in question wording experiments: Understanding why Americans like assistance to the poor more than welfare. publication-title: Public Opinion Quarterly – volume: 59 start-page: 529 issue: 3 year: 2015 end-page: 548 article-title: The hidden American immigration consensus: A conjoint analysis of attitudes toward immigrants publication-title: American Journal of Political Science – volume: 66 start-page: 20 year: 2016 article-title: Can we turn shirkers into workers? publication-title: Journal of Experimental Social Psychology – start-page: 1 year: 2019 end-page: 8 article-title: Using screeners to measure respondent attention on self-administered surveys: Which items and how many? publication-title: Political Science Research and Methods – volume: 35 start-page: 133 issue: 2 year: 2014 article-title: Anxiety, Immigration, and the Search for Information. publication-title: Political Psychology – volume: 211 start-page: 453 issue: 4481 year: 1981 article-title: The framing of decisions and the psychology of choice. publication-title: Science – volume: 6 start-page: 2053168018822174 issue: 1 year: 2019 article-title: Validating the demographic, political, psychological, and experimental results obtained from a new source of online survey respondents. publication-title: Research & Politics – volume: 17 start-page: 62 issue: 1 year: 2001 end-page: 82 article-title: Using credible advice to overcome framing effects publication-title: Journal of Law, Economics, and Organization – volume: 5 start-page: 206 issue: 3 year: 2018 end-page: 216 article-title: Does inequality beget inequality? Experimental tests of the prediction that inequality increases system justification motivation publication-title: Journal of Experimental Political Science – volume: 95 start-page: 379 issue: 2 year: 2001 end-page: 396 article-title: Political Ignorance and Collective Policy Preferences publication-title: American Political Science Review – volume: 27 start-page: 572 issue: 4 year: 2019 article-title: A note on dropping experimental subjects who fail a manipulation check. publication-title: Political Analysis – volume: 5 start-page: 411 issue: 5 year: 2010 article-title: Running experiments on Amazon Mechanical Turk. publication-title: Judgment and Decision Making – volume: 4 start-page: 1092 issue: 11 year: 2020 article-title: Use caution when applying behavioural science to policy. publication-title: Nature Human Behaviour – volume: 2 start-page: 109 year: 2015 article-title: The Generalizability of Survey Experiments. publication-title: Journal of Experimental Political Science – volume: 349 issue: 6251 year: 2015 article-title: Estimating the reproducibility of psychological science. publication-title: Science – year: forthcoming article-title: Conducting Social Psychological Research in the Wake of COVID-19. publication-title: Perspectives on Psychological Science – volume: 115 start-page: 12441 issue: 49 year: 2018 article-title: Generalizability of heterogeneous treatment effect estimates across samples. publication-title: Proceedings of the National Academy of Sciences – volume: 2 start-page: 188 issue: 2 year: 2019 article-title: Taskmaster: A tool for determining when subjects are on task. publication-title: Advances in Methods and Practices in Psychological Science – ident: S2052263021000178_ref21 doi: 10.1111/ajps.12357 – volume: 5 start-page: 411 year: 2010 ident: S2052263021000178_ref26 article-title: Running experiments on Amazon Mechanical Turk. publication-title: Judgment and Decision Making doi: 10.1017/S1930297500002205 – ident: S2052263021000178_ref31 doi: 10.1126/science.7455683 – ident: S2052263021000178_ref36 doi: 10.1093/jleo/17.1.62 – ident: S2052263021000178_ref3 doi: 10.31235/osf.io/8sbe4 – ident: S2052263021000178_ref1 doi: 10.31234/osf.io/vktqu – ident: S2052263021000178_ref17 doi: 10.1038/s41562-020-00990-w – ident: S2052263021000178_ref6 doi: 10.1016/j.jesp.2015.09.010 – ident: S2052263021000178_ref28 doi: 10.7910/DVN/38UTBF – year: forthcoming ident: S2052263021000178_ref30 article-title: Conducting Social Psychological Research in the Wake of COVID-19. publication-title: Perspectives on Psychological Science – ident: S2052263021000178_ref19 doi: 10.1027/1864-9335/a000178 – start-page: 11 volume-title: The Teaching of Contemporary Affairs year: 1950 ident: S2052263021000178_ref34 – volume: 349 year: 2015 ident: S2052263021000178_ref24 article-title: Estimating the reproducibility of psychological science. publication-title: Science – ident: S2052263021000178_ref11 doi: 10.1017/psrm.2018.10 – ident: S2052263021000178_ref27 doi: 10.1177/2515245919838479 – ident: S2052263021000178_ref35 doi: 10.1086/269015 – ident: S2052263021000178_ref2 doi: 10.1017/pan.2019.5 – ident: S2052263021000178_ref10 doi: 10.1073/pnas.1808083115 – volume: 45 start-page: 867 year: 2009 ident: S2052263021000178_ref25 article-title: Instructional manipulation checks: Detecting satisficing to increase statistical power. publication-title: Journal of Experimental Social psychology doi: 10.1016/j.jesp.2009.03.009 – ident: S2052263021000178_ref32 doi: 10.1111/j.1467-9221.2009.00716.x – ident: S2052263021000178_ref23 – ident: S2052263021000178_ref41 doi: 10.1017/XPS.2017.32 – volume: 5 start-page: 206 year: 2018 ident: S2052263021000178_ref42 article-title: Does inequality beget inequality? Experimental tests of the prediction that inequality increases system justification motivation publication-title: Journal of Experimental Political Science doi: 10.1017/XPS.2018.2 – volume: 59 start-page: 529 year: 2015 ident: S2052263021000178_ref40 article-title: The hidden American immigration consensus: A conjoint analysis of attitudes toward immigrants publication-title: American Journal of Political Science doi: 10.1111/ajps.12138 – ident: S2052263021000178_ref20 doi: 10.1177/2515245918810225 – ident: S2052263021000178_ref37 doi: 10.1017/S0003055401002222 – ident: S2052263021000178_ref5 doi: 10.1111/ajps.12081 – volume: 2 start-page: 109 year: 2015 ident: S2052263021000178_ref22 article-title: The Generalizability of Survey Experiments. publication-title: Journal of Experimental Political Science doi: 10.1017/XPS.2015.19 – year: 2020 ident: S2052263021000178_ref13 article-title: External Validity. publication-title: Annual Review of Political Science – ident: S2052263021000178_ref14 doi: 10.1111/pops.12034 – ident: S2052263021000178_ref8 doi: 10.1126/science.aaf0918 – ident: S2052263021000178_ref29 doi: 10.1017/S0003055420000076 – volume: 113 start-page: 140 year: 2019 ident: S2052263021000178_ref33 article-title: The Psychology of State Repression: Fear and Dissent Decisions in Zimbabwe. publication-title: American Political Science Review doi: 10.1017/S000305541800076X – ident: S2052263021000178_ref4 doi: 10.1093/pan/mpr057 – ident: S2052263021000178_ref16 doi: 10.1093/poq/nfs054 – ident: S2052263021000178_ref18 doi: 10.33774/apsa-2020-96t72 – volume: 5 start-page: 3 year: 1976 ident: S2052263021000178_ref15 article-title: Primary, secondary, and meta-analysis of research. publication-title: Educational Researcher doi: 10.3102/0013189X005010003 – ident: S2052263021000178_ref39 doi: 10.1017/S0003055412000597 – volume-title: Designing evaluations of educational and social programs year: 1982 ident: S2052263021000178_ref12 – ident: S2052263021000178_ref38 doi: 10.1093/analys/63.3.190 – ident: S2052263021000178_ref9 doi: 10.1177/2053168018822174 – start-page: 1 year: 2019 ident: S2052263021000178_ref7 article-title: Using screeners to measure respondent attention on self-administered surveys: Which items and how many? publication-title: Political Science Research and Methods |
| SSID | ssj0001672053 |
| Score | 2.5060174 |
| Snippet | The COVID-19 pandemic imposed new constraints on empirical research, and online data collection by social scientists increased. Generalizing from experiments... |
| SourceID | proquest crossref cambridge |
| SourceType | Aggregation Database Enrichment Source Index Database Publisher |
| StartPage | 379 |
| SubjectTerms | Coronaviruses COVID-19 Estimates Experiments Internet Pandemics Political science Polls & surveys Research Article Research methodology Social scientists Time periods Validity |
| Title | The Generalizability of Online Experiments Conducted During the COVID-19 Pandemic |
| URI | https://www.cambridge.org/core/product/identifier/S2052263021000178/type/journal_article https://www.proquest.com/docview/2728416152 |
| Volume | 9 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV3NS8MwFA-6XbzI_MKPKTkMD0J0TdK0PYnugyk458dkt9IkDQjaTjcP_vfmtdnKYEgPPSRQeC99X3nv90Oo5TGRFOCDgY44gYs3khhfEaXB-3uJVAwGnB-GYjDm9xN_4gpuM9dWubCJhaHWuYIa-RUNKNyQWXdzPf0iwBoFt6uOQmMT1a0JDm3yVb_tDUfPVZVFBLRdQFHaFyVUsLYb0gPc6MnoxWaI1LsEurIKWmHVRa1a6MLt9Bto28WL-KZU8A7aSLNd1HBda3bB_Zt76MkqHDsQaejUgp7XX5wbXIKJ4t4Syn-GO3kGMK-pxt1iShHbKBB3Ht_uusSL8Ajqyp_vah-N-73XzoA4vgSirFOZE98YyqRMIi6t35ZKCxmGnhGGaoDn1Yz7qeLSlxFrR0rZTIEZKzYNVA8M-IMOUC3Ls_QQYW51lSZMeTJIOE1lGIXaiEgr-0Qi4EfofCmu2J36WVx2jAWxlWsMco294AhdLGQZK4c6DuQXH-s3t5abpyXYxvptzYVSqm9X5-P4_-UTtEVhhKEoozRRbf79k57awGIuz9zp-QPV-MoU |
| linkProvider | ProQuest |
| linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1LT-MwEB5BOcAF8VgELA8fgMNKhsZ2kuaAELRFLY_SXR7qLcR2Iq202wItQvwpfiMzidMKCXFDOeRgK5HG45nxeOb7AHY8GSQ5-GBoI8Xp4o0nmW-4seT9vUQbSQ3Ol52gdavOen5vCt7KXhgqqyxtYm6o7cBQjvxAhIJuyNDdHD08cmKNotvVkkKjUIvz9PUFj2zDw3YD13dXiNPmTb3FHasAN2h6R9zPMiG1TiKl0btpYwNdq3lZkAlLILZWKj81Svs6ktXIGIynZYb23RIhgiSWHfzuNMwoiUeZCsycNDvdP5OsThCKag59iS_BRSCrrimQcKp73Ws8kQpvn-jRJlAOH13iR4-Qu7nTBZh38Sk7LhRqEabS_hIsuCo5HHC2YBl-o4IxB1pNlWFUY_vKBhkrwEtZc0wdMGT1QZ9gZVPLGnlXJMOok9Wv7toN7kWsS3ns_3_ND7j9FkmuQKU_6KerwBTqRppI4-kwUSLVtahmsyCyBp8oCNUa7I3FFbtdNoyLCrUwRrnGJNfYC9fgVynL2DiUcyLb-Pf55J3x5IcC3OPzaRvlokz-PdHH9a-Ht2G2dXN5EV-0O-c_YU5Q-0SewtmAyujpOd3EoGakt5wmMbj_buV9B9fDBfQ |
| linkToPdf | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1LT-MwEB5BkVZcEI9dLSwPH4DDSt42dh7NYYWgD1Ee3e6jq95CbMcSEtsC7Qrx1_h1zCROq0qIW5VDDrESafxlZmzPfB_AoSfDNCcfjEzsczp446kNNNeGor-XKi2pwfm6G573_YtBMFiCl7IXhsoqS5-YO2oz0rRHXhWRoBMyDDdV68oies32yf0DJwUpOmkt5TQKiFxmz0-4fBt_7zRxro-EaLf-NM65UxjgGt3whAfWCqlUGvsKI53SJlT1umdDKwwR2hrpB5n2VaBiWYu1xtxaWvT1hsQRJCnu4HuXYSXCVVGtAitnrW7v12yHJ4xELafBxJvgIpQ11yBInNWD3m9cnQrvG0mlzWgd5sPjfHTIQ157HdZcrspOC3BtwFI23IR1VzGHD5xf2IKfCDbmCKypSozqbZ_ZyLKCyJS1pjICY9YYDYliNjOsmXdIMsxAWePH306TezHr0Z72v1v9EfoLseQnqAxHw-wzMB9xkqVSeypKfZGpelw3NoyNxisOI38bjqfmStwfN06KarUoQbsmZNfEi7bha2nLRDvGcxLeuHt78OF08H1B9PH2sN1yUmbfnmFz5_3HB_ABQZtcdbqXX2BVUCdFvpuzC5XJ4_9sD_Obidp3QGJws2jsvgL-SAop |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+Generalizability+of+Online+Experiments+Conducted+During+the+COVID-19+Pandemic&rft.jtitle=Journal+of+experimental+political+science&rft.au=Peyton%2C+Kyle&rft.au=Huber%2C+Gregory+A.&rft.au=Coppock%2C+Alexander&rft.date=2022-01-01&rft.pub=Cambridge+University+Press&rft.issn=2052-2630&rft.eissn=2052-2649&rft.volume=9&rft.issue=3&rft.spage=379&rft.epage=394&rft_id=info:doi/10.1017%2FXPS.2021.17&rft.externalDocID=10_1017_XPS_2021_17 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2052-2630&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2052-2630&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2052-2630&client=summon |