Community Involvement in Artifact Evaluation
AlumniPaolo Giarrusso was invited to participate in the Artifact Evaluation
Committee of
ECOOP 2015.
Artifact evaluation is a new trend in peer review, and
AlumniPaolo Giarrusso is enthusiastic about it, because he believes that it will improve the quality of research in our field. From the ECOOP website:
Traditionally, technical research papers are published without including any artifacts (such as tools, data, models, videos, etc.), even though the artifacts may serve as crucial and detailed evidence for the quality of the results that the associated paper offers. They support the repeatability of experiments and precise comparison with alternative approaches, thus enabling higher quality in the research area as a whole. They may also make it easier for other researchers to perform their own experiments, thus helping the original authors disseminating their ideas in detail. Hence, artifacts should be taken seriously and recognized separately.