After arranging many Artifact Evaluations to reproduce and validate experimental results from published papers at various ACM and IEEE computer systems conferences (CGO, PPoPP, PACT, SC), we saw the need for a common reviewing and badging methodology.
In 2016, the cTuning foundation joined ACM internal workgroup on reproducibility and provided feedback and suggestions to develop a common methodology for artifact evaluation. The outcome of this collaborative effort is the common ACM policy on Result and Artifact Review and Badging published here:
We started aligned artifact submission and reviewing procedures for computer systems conferences:
We expect that this document will gradually evolve based on our AE experience - please, stay tuned for more news!
News from the non-profit cTuning foundation about our open source tools and the Collective Knowledge platform to enable collaborative, reproducible and reusable AI/ML/Quantum/IoT R&D: https://cTuning.org .
No comments:
Post a Comment