Incentivizing Responses in International Organization Elite Surveys: Evidence from the World Bank
Scholars of International Organizations (IOs) increasingly use elite surveys to study the preferences and decisions of policymakers. When designing these surveys, one central concern is low statistical power, because respondents are typically recruited from a small and inaccessible population. Howev...
Saved in:
| Published in | Journal of experimental political science Vol. 12; no. 1; pp. 17 - 26 |
|---|---|
| Main Authors | , , |
| Format | Journal Article |
| Language | English |
| Published |
01.03.2025
|
| Online Access | Get full text |
Cover
Loading…
| Abstract | Scholars of International Organizations (IOs) increasingly use elite surveys to study the preferences and decisions of policymakers. When designing these surveys, one central concern is low statistical power, because respondents are typically recruited from a small and inaccessible population. However, much of what we know about how to incentivize elites to participate in surveys is based on anecdotal reflections, rather than systematic evidence on which incentives work best. In this article, we study the efficacy of three incentives in a preregistered experiment with World Bank staff. These incentives were the chance to win an Amazon voucher, a donation made to a relevant charity, and a promise to provide a detailed report on the findings. We find that no incentive outperformed the control group, and the monetary incentive decreased the number of respondents on average by one-third compared to the control group (from around 8% to around 5%). |
|---|---|
| AbstractList | Scholars of International Organizations (IOs) increasingly use elite surveys to study the preferences and decisions of policymakers. When designing these surveys, one central concern is low statistical power, because respondents are typically recruited from a small and inaccessible population. However, much of what we know about how to incentivize elites to participate in surveys is based on anecdotal reflections, rather than systematic evidence on which incentives work best. In this article, we study the efficacy of three incentives in a preregistered experiment with World Bank staff. These incentives were the chance to win an Amazon voucher, a donation made to a relevant charity, and a promise to provide a detailed report on the findings. We find that no incentive outperformed the control group, and the monetary incentive decreased the number of respondents on average by one-third compared to the control group (from around 8% to around 5%). |
| Author | Weaver, Catherine Heinzel, Mirko Briggs, Ryan |
| Author_xml | – sequence: 1 givenname: Mirko orcidid: 0000-0001-8801-8237 surname: Heinzel fullname: Heinzel, Mirko – sequence: 2 givenname: Catherine surname: Weaver fullname: Weaver, Catherine – sequence: 3 givenname: Ryan surname: Briggs fullname: Briggs, Ryan |
| BookMark | eNptUE1LAzEUDFLBWnvyD-QuW5NsdrPrTUvVQqFiFb0tafalRrfZksSF9tebVvEgXt4X84aZOUU921pA6JySESVUXL4-LEaMsHSUlkeoz0jGEpbzsvc7p-QEDb1_J4TQXMRj2kdyahXYYDqzM3aFH8FvWuvBY2Px1AZwVgbTWtnguVtJa3aHFU8aEwAvPl0HW3-FJ52pIRJh7do1Dm-AX1rX1PhG2o8zdKxl42H40wfo-XbyNL5PZvO76fh6ligmSEi44qXgWpQCBFnKqK9Qsl5qDrXOeBRfKJXFAjLTdV5kUlJOiGC0KPMiGkoH6OKbV7nWewe62jizlm5bUVLtA6piQNU-oCotI5r-QSsTDt6Ck6b59-cLTs9rjQ |
| CitedBy_id | crossref_primary_10_1111_ejed_12918 crossref_primary_10_1177_20531680241263705 crossref_primary_10_1017_S0003055424000376 |
| Cites_doi | 10.1177/20531680221125723 10.1093/isq/sqab044 10.1177/1354066120987891 10.1007/s11558-021-09414-4 10.1177/13540661221098218 10.1017/S0020818315000107 10.1017/S0020818321000229 10.1146/annurev-polisci-051120-013649 10.1017/S0003055421000824 10.1017/9781009007290 10.1017/S0020818305050307 10.1093/isq/sqab035 |
| ContentType | Journal Article |
| DBID | AAYXX CITATION |
| DOI | 10.1017/XPS.2023.39 |
| DatabaseName | CrossRef |
| DatabaseTitle | CrossRef |
| DatabaseTitleList | CrossRef |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Political Science |
| EISSN | 2052-2649 |
| EndPage | 26 |
| ExternalDocumentID | 10_1017_XPS_2023_39 |
| GroupedDBID | 0-V 09C 09D 0R~ AABWE AACJH AAGFV AAKTX AALKF AAPYI AARAB AASVR AAUKB AAYXX ABBXD ABGDZ ABJNI ABROB ABTND ABUWG ABXHF ABYPY ABZCX ACABY ACAJB ACDLN ACFCP ACGFS ACIMK ACUIJ ACYZP ACZBM ACZBN ADFEC ADKIL ADOVH ADTCA ADVJH AEBAK AEHGV AFFUJ AFKQG AFKRA AFKRZ AFLVW AFZFC AGABE AGHGI AGJUD AGTDA AHQXX AHRGI AIGNW AIHIV AISIE AJPFC AJQAS AKMAY ALMA_UNASSIGNED_HOLDINGS ALSLI ANFVQ AOWSX ARALO ATUCA AUXHV AVDNQ AZQEC BBLKV BENPR BMAJL BPHCQ CCPQU CCQAD CFAFE CGMFO CHEAL CITATION CJCSC DOHLZ DPSOV DWQXO EBS EJD GNUQQ HG- HOVLH HZ~ I.5 IH6 IOEEP IPYYG IS6 JHPGK JOSPZ JPPIE JQKCU JRMXA KC- M2L M2R NIKVX O9- PHGZM PHGZT PQQKQ PROAC RCA ROL S6- S6U T9M TKY UT1 WFFJZ ZYDXJ |
| ID | FETCH-LOGICAL-c270t-4c4974f797e70ba6728cadbf4edf542638cc538cea5fd685aa140072189680013 |
| ISSN | 2052-2630 |
| IngestDate | Thu Apr 24 23:00:23 EDT 2025 Tue Jul 01 02:03:49 EDT 2025 |
| IsDoiOpenAccess | false |
| IsOpenAccess | true |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 1 |
| Language | English |
| License | http://creativecommons.org/licenses/by/4.0 |
| LinkModel | OpenURL |
| MergedId | FETCHMERGED-LOGICAL-c270t-4c4974f797e70ba6728cadbf4edf542638cc538cea5fd685aa140072189680013 |
| ORCID | 0000-0001-8801-8237 |
| OpenAccessLink | https://www.cambridge.org/core/services/aop-cambridge-core/content/view/9C4DC0CDDB74DA324B11FA1AACA8547F/S2052263023000398a.pdf/div-class-title-incentivizing-responses-in-international-organization-elite-surveys-evidence-from-the-world-bank-div.pdf |
| PageCount | 10 |
| ParticipantIDs | crossref_primary_10_1017_XPS_2023_39 crossref_citationtrail_10_1017_XPS_2023_39 |
| ProviderPackageCode | CITATION AAYXX |
| PublicationCentury | 2000 |
| PublicationDate | 2025-03-01 |
| PublicationDateYYYYMMDD | 2025-03-01 |
| PublicationDate_xml | – month: 03 year: 2025 text: 2025-03-01 day: 01 |
| PublicationDecade | 2020 |
| PublicationTitle | Journal of experimental political science |
| PublicationYear | 2025 |
| References | Jongen (S2052263023000398_ref10) 2022; 28 Dietrich (S2052263023000398_ref5) 2021; 27 Heinzel (S2052263023000398_ref6) 2021; 16 Hooghe (S2052263023000398_ref9) 2005; 59 S2052263023000398_ref14 Dellmuth (S2052263023000398_ref3) 2022; 116 Clark (S2052263023000398_ref2) 2021; 75 Safarpour (S2052263023000398_ref13) 2022; 9 Kertzer (S2052263023000398_ref11) 2022; 25 Herold (S2052263023000398_ref8) 2021; 65 Dietrich (S2052263023000398_ref4) 2021 S2052263023000398_ref7 Renshon (S2052263023000398_ref12) 2015; 69 Briggs (S2052263023000398_ref1) 2021; 65 |
| References_xml | – volume: 9 start-page: 1 year: 2022 ident: S2052263023000398_ref13 article-title: Participation Incentives in a Survey of International Non-Profit Professionals publication-title: Research and Politics doi: 10.1177/20531680221125723 – volume: 65 start-page: 669 year: 2021 ident: S2052263023000398_ref8 article-title: Why National Ministries Consider the Policy Advice of International Bureaucracies: Survey Evidence from 106 Countries publication-title: International Studies Quarterly doi: 10.1093/isq/sqab044 – ident: S2052263023000398_ref7 – volume: 27 start-page: 596 year: 2021 ident: S2052263023000398_ref5 article-title: How to Make Elite Experiments Work in International Relations publication-title: European Journal of International Relations First View doi: 10.1177/1354066120987891 – volume: 16 start-page: 625 year: 2021 ident: S2052263023000398_ref6 article-title: Managing Performance and Winning Trust: How World Bank Staff Shape Recipient Performance publication-title: Review of International Organizations doi: 10.1007/s11558-021-09414-4 – volume: 28 start-page: 667 year: 2022 ident: S2052263023000398_ref10 article-title: Inequality and Legitimacy in Global Governance: An Empirical Study publication-title: European Journal of International Relations doi: 10.1177/13540661221098218 – volume: 69 start-page: 659 year: 2015 ident: S2052263023000398_ref12 article-title: Losing Face and Sinking Costs: Experimental Evidence on the Judgment of Political and Military Leaders publication-title: International Organization doi: 10.1017/S0020818315000107 – volume: 75 start-page: 1133 year: 2021 ident: S2052263023000398_ref2 article-title: Pool or Duel? Cooperation and Competition among International Organizations publication-title: International Organization doi: 10.1017/S0020818321000229 – volume: 25 start-page: 1 year: 2022 ident: S2052263023000398_ref11 article-title: Experiments and Surveys on Political Elites publication-title: Annual Review of Political Science doi: 10.1146/annurev-polisci-051120-013649 – ident: S2052263023000398_ref14 – volume: 116 start-page: 283 year: 2022 ident: S2052263023000398_ref3 article-title: The Elite-Citizen Gap in International Organization Legitimacy publication-title: American Political Science Review doi: 10.1017/S0003055421000824 – volume-title: States, Markets, and Foreign Aid year: 2021 ident: S2052263023000398_ref4 doi: 10.1017/9781009007290 – volume: 59 start-page: 861 year: 2005 ident: S2052263023000398_ref9 article-title: Several Roads Lead to International Norms, but Few via International Socialization: A Case Study of the European Commission publication-title: International Organization doi: 10.1017/S0020818305050307 – volume: 65 start-page: 739 year: 2021 ident: S2052263023000398_ref1 article-title: Why Does Aid Not Target the Poorest? publication-title: International Studies Quarterly doi: 10.1093/isq/sqab035 |
| SSID | ssj0001672053 |
| Score | 2.317014 |
| Snippet | Scholars of International Organizations (IOs) increasingly use elite surveys to study the preferences and decisions of policymakers. When designing these... |
| SourceID | crossref |
| SourceType | Enrichment Source Index Database |
| StartPage | 17 |
| Title | Incentivizing Responses in International Organization Elite Surveys: Evidence from the World Bank |
| Volume | 12 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1bS8MwFA5zvvgi84Z38uCT0tFla5r6NsUrKEMdbE8lTRMYSpVRB-7RX-7Jkl52EaYvpYR0W_d9Pck5_c45CJ0Q6YET4McOp4o4uj67wxuSOSwQ4BLFUcAnGd4Pj_S227rveb1K5bukWvpMo7oYL8wr-Q-qMAa46izZPyCbfygMwDngC0dAGI5LYQwPtxb7jAZjK6LTcteJwmom0lfOuNRKrlSCxRiONIrN9lnWWbTINTESmwuevP6yeZ1qDPBhNHRZemWJK3KQjI0M4GEwfH0vXgPx0UwCYhEWyKL1T1-WuDYmQbxClGVMF3E94hBq37jI8pgpUJrbXjLHMWNITUKnXZJNTv2csTcVonqd57ruAV83RZGmS2rPLHW5ANFo2_wQLg71xWEzWEGrBFwNUkWrd51-_6aI1FEffruWKuS3ZRM9de3x0teXtjalPcpLDa1bfHDbMGUDVWSyiWqdDB5sDfkW4lPMwTlz8CDBU8zBZebgCXOwZc45zniDNW8wAIknvMGaN9uoe331cnnr2GYbjiC-mzot0QLXUvmBL3034nDPTPA4Ui0ZK09X9WdCwOIoJPdUTJnHObjmurgeCyjTjsQOqibvidxFuBGruMldFbkUnHvps4bijSbzoohyRqnaQ6fZ_xQKW4leN0R5CxfAsodO8skfpgDLomn7y007QGsFXw9RNR1-yiPYVabRsYX9B9E7e3M |
| linkProvider | Cambridge University Press |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Incentivizing+Responses+in+International+Organization+Elite+Surveys%3A+Evidence+from+the+World+Bank&rft.jtitle=Journal+of+experimental+political+science&rft.au=Heinzel%2C+Mirko&rft.au=Weaver%2C+Catherine&rft.au=Briggs%2C+Ryan&rft.date=2025-03-01&rft.issn=2052-2630&rft.eissn=2052-2649&rft.volume=12&rft.issue=1&rft.spage=17&rft.epage=26&rft_id=info:doi/10.1017%2FXPS.2023.39&rft.externalDBID=n%2Fa&rft.externalDocID=10_1017_XPS_2023_39 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2052-2630&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2052-2630&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2052-2630&client=summon |