Data and Code for: "Stability of Experimental Results: Forecasts and Evidence"

Principal Investigator(s):  View help for Principal Investigator(s) Stefano DellaVigna, UC Berkeley; Devin Pope, University of Chicago

Version:  View help for Version V1

Name File Type Size Last Modified
  code 08/09/2021 10:32:AM
  data 08/09/2021 10:34:AM
  environment 08/09/2021 10:00:AM
  metadata 08/09/2021 10:35:AM
.gitignore text/plain 18 bytes 08/09/2021 05:58:AM
README.pdf application/pdf 248.1 KB 08/16/2021 11:06:PM
REPRODUCING.md text/x-web-markdown 2.2 KB 08/09/2021 06:16:AM

Project Citation: 

DellaVigna, Stefano, and Pope, Devin. Data and Code for: “Stability of Experimental Results: Forecasts and Evidence.” Nashville, TN: American Economic Association [publisher], 2021. Ann Arbor, MI: Inter-university Consortium for Political and Social Research [distributor], 2021-08-24. https://doi.org/10.3886/E135221V1

Project Description

Summary:  View help for Summary This deposit contains code and data for "Stability of Experimental Results: Forecasts and Evidence"
Abstract: "How robust are experimental results to changes in design? And can researchers anticipate which changes matter most? We consider a real-effort task with multiple behavioral treatments, and examine the stability along six dimensions: (i) pure replication; (ii) demographics; (iii) geography and culture; (iv) the task; (v) the output measure; (vi) the presence of a consent form. We find near perfect replication of the experimental results, and full stability of the results across demographics, significantly higher than a group of experts expected. The results differ instead across task and output change, mostly because the task change adds noise to the findings."

Scope of Project

Subject Terms:  View help for Subject Terms Field Experiment; Conceptual Replication; MTurk
JEL Classification:  View help for JEL Classification
      D90 Micro-Based Behavioral Economics: General
Universe:  View help for Universe MTurk
Data Type(s):  View help for Data Type(s) experimental data; program source code


Related Publications

Download this project

Published Versions

V1 [2021-08-24]

Export Metadata

Dublin Core

DDI 2.5

Report a Problem

Found a serious problem with the data, such as disclosure risk or copyrighted content? Let us know.

This material is distributed exactly as received from the data depositor. As of April 2026, depositors are required to submit study materials in accessible formats. ICPSR has not reviewed, checked, or processed this material. For additional information about the study, please contact the investigator(s) directly. If you have questions about the accessibility of materials distributed by ICPSR or require further assistance, please visit ICPSR's Accessibility Center.