Please note that the RRNLP workshop has been merged with the IJCAI Workshop on Adaptive NLP into the Workshop on Replicability and Reproducibility in Natural Language Processing: adaptive methods, resources and software
| Workshop description | Submission details | Important dates | Workshop committees |
|---|
Even experiments reported in the best journals often present results that cannot be reproduced, either because the original data or software is not available, or because re-running the presented programs leads to different results. Moreover, slight changes in the implementations (e.g., different parameter settings, dataset size or representation) often lead to significantly different results. At the same time, a number of repositories, web services or processing pipelines for natural language processing (NLP) are being developed, but, so far, without a focus on experiment replicability and comparability.
Therefore there is an urgent need to provide repositories of stable NLP datasets, as well as mechanisms and platforms for running experiments that would enable easy comparison of results. Such platforms, enabling the sharing of workflows, could provide major benefits for the entire community: for replicability of experiments it should be enough for the authors to provide the datasets, the URL of the developed workflow and the parameters used.
We welcome submissions of long and short papers and demonstrations, relating to any aspect of replicability and reusability in Natural Language Processing, including but not limited to:
The papers should report original and unpublished research on topics of interest for the workshop. The maximum length is eight (8) pages of content for long papers or four (4) pages of content for short papers and demonstrations, plus up to two (2) pages of references. The papers should be formatted according to the IJCAI guidelines. The papers will be published on-line in the Workshop proceedings. Depending on the number and quality of submissions, we plan to include selected papers from the workshop in a special issue on Reproducibility of the journal Language Resources and Evaluation, to appear next year.
Extended submission deadline: May 4th, 2015, 23:59 GMT.
Submission site: please submit your paper in PDF format via EasyChair:
https://easychair.org/conferences/?conf=rrnlp2015
The RRNLP 2015 Workshop is supported by the EU FET project FP7-296703 MUSE “Machine Understanding for interactive StorytElling”.
Page http://nl.ijs.si/rrnlp2015/ last updated on 2015-05-26 by et.