German Research Foundation (DFG) publishes Statement on Replicability

The German Research Foundation (DFG) has currently released a statement on the replicability of research results.

Interestingly (at least for me), the five-pager first starts with a broader definition of what replicable research is NOT.

Of course, replication is a very important method for testing empirical knowledge claims based on experimental and quantitative research in medicine, the natural, life, engineering, social and behavioural sciences, as well as the humanities.

But, according to DFG, there are limitations:

• Replicability is not a universal criterion for scientific knowledge.
• Ascertaining the replicability or non-replicability of a scientific result is itself a scientific result. As such, it is not final but subject to methodological scepticism and further investigation.
• Non-replicability is not a universal proof by falsification.
• Non-replicability is not a universal indicator of poor science.

‘Well, an unorthodox starting point for a paper on reproducible research‘ – so, at least, were my thoughts when I read the first page of the statement. Wouldn’t it be more common to first depict the important aspects of reproducible research and to suggest measures to support it, instead of rowing back at the beginning of such a statement? Read the rest of this entry »

Managing research data using the ZBW Journal Data Archive

Yesterday, a new blog post has been published on ZBW Mediatalk in which I describe the history and the background of the EDaWaX-project that led to the development of the ZBW Journal Data Archive. The Journal Data Archive (JDA) is a service for editorial offices of journals in economics and partially also in the social sciences. Currently this service is free of charge and already two renowned journals are using our services productively.

The  JDA offers direct linking between published research papers and the underlying data, that has been used to generate the findings of an article. The workflow is time-saving and easy to handle: Authors of a journal’s article submit their replication files to the system and describe these files with additional metadata. For us it was quite important to find a useful balance between the efforts a user has to invest to generate these additional metadata and the needs of our information systems. For the development of our metadata schema, we followed the motto ‘as much as necessary, as little as possible.’ Read the rest of this entry »