Why Research (Does Not) Affect Policy?: Experimental Evidence on the Role of Political Bias

Last registered on February 16, 2024

Pre-Trial

Trial Information

General Information

Title
Why Research (Does Not) Affect Policy?: Experimental Evidence on the Role of Political Bias
RCT ID
AEARCTR-0008967
Initial registration date
May 23, 2022

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
May 23, 2022, 7:25 PM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Last updated
February 16, 2024, 10:39 AM EST

Last updated is the most recent time when changes to the trial's registration were published.

Locations

Region

Primary Investigator

Affiliation
Universidad Autónoma de Madrid

Other Primary Investigator(s)

PI Affiliation
ESADE
PI Affiliation
London School of Economics
PI Affiliation
Universidad Autónoma de Madrid
PI Affiliation
ESADE

Additional Trial Information

Status
Completed
Start date
2022-05-25
End date
2023-05-31
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
One of the critical issues in bridging the divide between scientific evidence and policy is the "perceived credibility" of the evidence. Policymakers may be more or less inclined to follow scientific evidence if they believe the messenger, i.e. who presents the scientific evidence, has an ideological agenda. This may be true even in policy areas with a pressing need for scientific evidence and even when the evidence is produced with the highest scientific standards. This study tests whether the divergence in political biases between who send the evidence and the politician who receives it affects policy adoption using a Randomized Controlled Trial (RCT). Exploiting a sample of all touristic municipalities in Spain, we send policymakers in these municipalities either a policy brief or a link to a newspaper article describing a high-quality scientific-evidence on a very low-cost and effective and uncontroversial policy to increase tourism. Furthermore, we create random variation in the identity of the source of the information to signal a possible ideological bias. We combine survey and administrative data to define our sample of treated and control municipalities and the random assignment to the different treatment arms. Ex post, we then compare different measures of interest in the scientific evidence and the recommended policy. Specifically, we investigate whether policy makers pay attention and read the recommended policy/ evidence and whether they eventually adopt the recommended policy.
External Link(s)

Registration Citation

Citation
Garcia Hombrados, Jorge et al. 2024. "Why Research (Does Not) Affect Policy?: Experimental Evidence on the Role of Political Bias." AEA RCT Registry. February 16. https://doi.org/10.1257/rct.8967-1.7
Sponsors & Partners

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
Experimental Details

Interventions

Intervention(s)
See pre-analysis plan
Intervention Start Date
2022-05-25
Intervention End Date
2022-12-31

Primary Outcomes

Primary Outcomes (end points)
See pre-analysis plan
Primary Outcomes (explanation)
See pre-analysis plan

Secondary Outcomes

Secondary Outcomes (end points)
See pre-analysis plan
Secondary Outcomes (explanation)
See pre-analysis plan

Experimental Design

Experimental Design
See pre-analysis plan
Experimental Design Details
See pre-analysis plan
Randomization Method
Randomization done in office by a computer. See pre-analysis plan for details.
Randomization Unit
Municipality level. See pre-analysis plan for details.
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
5677 municipalities in the sample (No cluster in the analysis)
Sample size: planned number of observations
5677 municipalities in the sample
Sample size (or number of clusters) by treatment arms
See pre-analysis plan for details:

Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
See pre-analysis plan
Supporting Documents and Materials

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
IRB

Institutional Review Boards (IRBs)

IRB Name
The committee on the use of human subjects in research
IRB Approval Date
2022-04-10
IRB Approval Number
012/2022
Analysis Plan

Analysis Plan Documents

Pre-analysis plan

MD5: 96fa258b0b499a2b1e932bbfbe55ffee

SHA1: ab8d57604efe2a6c340bc35cc78b0047910f46fe

Uploaded At: May 23, 2022

Pre-analysis plan (Amendment 24/05/2022) - Tables 1 and 2 with updated number of observations per group

MD5: f317dff12b5a5e5c47dc6d332251b624

SHA1: c170413ccaa9fb09bcff1ca4562a8f07874045ea

Uploaded At: May 24, 2022

Pre-analysis plan (Amendment 31/05/2022)

MD5: 42b59256302056e458eea7e4d750c604

SHA1: 61ce76068f796842c163b031a688ff044f2e6f13

Uploaded At: May 31, 2022

Pre-analysis pla (Amendment 28/11/2022)

MD5: 143a22c37ef57d5f288643fd835e38e3

SHA1: b84bc26a793e638b913a049b447fe4b0221845b6

Uploaded At: November 28, 2022

Updated pre-analysis plan Amendments 28/11/2022

MD5: 143a22c37ef57d5f288643fd835e38e3

SHA1: b84bc26a793e638b913a049b447fe4b0221845b6

Uploaded At: November 28, 2022

Pre-analysis plan (Amendment 13/06/2022)

MD5: fc52470533abd0b274d9798f7919797a

SHA1: 649b3adcae4259b5939fdf6fdc24f71c9c6eaebb

Uploaded At: June 13, 2022

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials