New Paper asks: “Do journals journals enforce their data policies?”

Posted: April 16th, 2018 | Author: | Filed under: EDaWaX, journals | Tags: , , | Comments Off on New Paper asks: “Do journals journals enforce their data policies?”

I am happy to announce that our paper “Journals in Economic Sciences: Paying Lip Service to Reproducible Research?” finally has been released.

The article, published in the latest issue of the IASSIST Quarterly, regards the practice of 37 journals in economics and business administration when it comes to the enforcement of their data policies.

For this purpose, we checked 599 articles which have been published in two issues of these journals. We chose the issues 1/2013 and 1/2014.

First, we estimated the share of articles that fall under a data policy, because replication data is needed to verify the published results. Afterwards, we checked the journal data archives and supplemental information section of each of these articles for the availability of replication files.

For a reduced sub-sample of 245 data-based articles, we checked in depth whether the replication files we found are compliant with the requirements of the journal’s respective data policy. Thereby, we are able to determine how much journals in economic sciences enforce their data policies and to calculate the ‘compliance rate’ for each journal in our sample.

Our findings suggest a mixed picture: While some journals achieve high compliance rates, a significant share of journals only sporadically provides replication files for data-based research papers.
The paper presents a useful snapshow of journals’ enforcement of their data policies for the time period 2013/2014. For subsequent research it would be of interest to provide an updated analysis on journal practises for the years 2015, 2016 and 2017.

# Update 2018-10-28: Another (more extended) summary of our paper and its findings is available on the Guest Blog of the Replication Network (TRN)

Here is the full citation:

Vlaeminck, S. & Podkrajac, F. (2017). Journals in Economic Sciences: Paying Lip Service to Reproducible Research? IASSIST Quarterly 41 (1-4). DOI: 10.29173/iq6

document

 

 

 

Comments are closed.