Greetings!

Dear colleagues,
We wish you happy holidays and very successful New Year!
cTuning team

ADAPT'15 preliminary program is online

Dear colleagues,

Preliminary program for ADAPT'15 co-located with HiPEAC'15 is now available online:
http://adapt-workshop.org/program.htm

Early registration fees deadline for HiPEAC is Dec.23, 2014:
https://www.hipeac.org/2015/amsterdam

Looking forward to see you there,
Grigori and Christophe
ADAPT'15 organizers

NVIDIA is sponsiring our ADAPT'15 best paper award

We are glad to announce that NVIDIA kindly provided Tesla K40 (~$5000) for our ADAPT's best paper award!

ADAPT'15 submission deadline is in 1 week

ADAPT'15 submission deadline is in 1 week!
Don't forget that we are trying to check our new publication model with the community-driven reviewing of papers and artifacts:
http://adapt-workshop.org

Podcast on program optimization and reproducibility

I had an interesting chat about program optimization and reproducibility with Michael Pankov and Alexander Turok which resulted in a public podcast:
http://podcast.codespeakloop.com/2014/10/episode-17-researcher-grigori-fursin-on.html

CFP: ADAPT'15 with a new community-driven paper and artifact evaluation

=================================================================

                       CALL FOR PAPERS

             ADAPT: 5th International Workshop on
            Adaptive Self-tuning Computing Systems                           

         21 January 2015, Amsterdam, The Netherlands
               (co-located with HiPEAC 2015)

               http://www.adapt-workshop.org

        New Community-Driven Paper Evaluation Option!

               Continuing Artifact Evaluation!

=================================================================

Computing systems are rapidly evolving into heterogeneous
machines featuring many processor cores. This leads to
a tremendous complexity with an unprecedented number of available
design and optimization choices for architectures, applications,
compilers and run-time systems. Using outdated, non-adaptive
technology results in an enormous waste of expensive computing
resources and energy, while slowing down time to market.

The 5th International Workshop on Adaptive Self-tuning Computing
Systems is an interdisciplinary forum for researchers,
practitioners, developers and application writers to discuss
ideas, experience, methodology, applications, compilers,
hardware, practical techniques and tools that can improve
or change existing and future computing systems using
self-tuning technology.

Such systems should be able to automatically adjust their
behavior at all levels (hardware and software) and improve
various characteristics including execution time, energy usage,
reliability, size and costs based on empirical, dynamic,
iterative, auto-tuning, statistical, collective, bio-inspired,
machine learning and alternative techniques while fully utilizing
available resources.

=== Optional Community-Driven Evaluation ===

Although not mandatory, we encourage authors to opt-in for our
new experimental publication model where papers, artifacts and
experimental results are pre-validated by the community. If you
wish to participate in this experiment, simply submit your paper
as usual on the submission website and send an email to the PC
chairs indicating you wish to take part. We will give you
instruction about how to upload your paper to arXiv and we will
open a discussion thread on the reddit social platform to allow
anyone to evaluate and comment on it (the authors will be allowed
to respond to all the comments at any time). One week before the
notification deadline, we will close the discussion thread and
the members of the program chair will reach their decisions based
on their own evaluation but also from the comments of others
(including the authors) found on the discussion thread. We hope
that this will help us make the reviewing process more fair,
transparent and interactive while picking up papers that can
raise interesting discussions at the workshop as described in our
vision paper available in ACM DL and arXiv.

=== Optional Artifact Evaluation ===

To continue our public effort started in 2007 to enable
collaborative, systematic and reproducible research and
experimentation on auto-tuning combined with machine learning,
crowdsourcing and run-time adaptation, we particularly welcome
papers where all related research material including code, data
and experimental results is shared and validated by the
community. Therefore, we encourage authors to either provide
a paragraph in their submitted papers describing how to validate
their experimental results or to submit artifacts for validation
after their paper is accepted. See our reproducibility wiki for
more details: http://c-mind.org/reproducibility

====  Important Dates ====

* Paper submission deadline: 24 October 2014
* Author notification:         19 November 2014
* Final paper version:          3 December 2014

==== Program Chairs/organisers: ====

* Christophe Dubach (University of Edinburgh, UK)
* Grigori Fursin (INRIA Saclay, France)

==== Program Committee: ====

* Rosa M. Badia (BSC, Spain)
* Tianshi Chen (ICT, China)
* Bruce Childers (University of Pittsburgh, USA)
* Koen De Bosschere (Ghent University, Belgium)
* Thomas Fahringer (University of Innsbruck, Austria)
* Michael Gerndt (TU Munich, Germany)
* Marisa Gil (UPC, Spain)
* Timothy Jones (University of Cambridge, UK)
* Anton Lokmotov (ARM, UK)
* Chi-Keung Luk (Intel, USA)
* Tipp Moseley (Google, USA)
* Toshio Nakatani (IBM, Japan)
* Lasse Natvig (NTNU, Norway)
* David Padua (UIUC, USA)
* Raphael Poss (University of Amsterdam, Netherlands)
* Aaron Smith (Microsoft Research, USA)
* Juergen Teich (University of Erlangen-Nuremberg, Germany)
* Petr Tuma (Charles University, Czech Republic)
* Ana Lucia Varbanescu (University of Amsterdam, Netherlands)
* Vittorio Zaccaria (Politecnico di Milano, Italy)

==== Paper Submission Guidelines ====
                    
We invite papers in three categories:

* T1: Unpublished Papers presenting novel unpublished ideas
  (did not appear in any proceedings). Depending on the maturity
  of the work, these papers should be between 2 and 6 pages long
  (excluding bibliography). In addition to mature ideas,
  preliminary and exploratory work is also welcome in this
  category, including wild & crazy ideas.

* T2: Already Published Work (must be your own) presenting
  ideas relevant to the ADAPT workshop. These papers should be up
  to 2 pages long (excluding bibliography) summarising the
  contribution of the original work (including link to it).

* T3: Software/Hardware Demonstration (must be your own)
  presenting publicly available and adaptive software and hardware.
  Description should be up to 6 pages long summarizing the tool,
  demonstration, and relevance to the workshop.

Submissions should be in PDF formatted with double
column/single-spacing, using 10pt fonts and printable on US
letter or A4 sized paper. Accepted papers will be published
online on the conference website and it will not prevent later
publication of extended papers. Depending on the author wish,
we may consider arranging ACM digital library proceedings or
a special journal issue.

Paper submission website:
  https://easychair.org/conferences/?conf=adapt2015

We particularly welcome papers where experimental results can be
validated by the community. If accepted, the final papers should
include Appendix with detailed research methodology and
references to all used data and tools (should be publicly
available by the time of the workshop). Such submissions should
include (reproducible) in the title.

More details for paper submission here:
  http://www.adapt-workshop.org
                                                 
==== Past ADAPT workshops ====

* 4th ADAPT 2014 at HiPEAC 2014, Vienna, Austria
  http://adapt-workshop.org/2014

* 3rd ADAPT 2013 at HiPEAC 2013, Berlin, Germany
  http://homepages.inf.ed.ac.uk/cdubach/adapt2013/

* 2nd EXADAPT 2012 at ASPLOS 2012, London, UK
  http://exadapt.org/2012

* 1st ACM SIGPLAN EXADAPT 2011 at PLDI 2011/FCRC 2011, San Jose, CA, USA
  http://exadapt.org/2011

Collective Mind vision paper has been published!

Our vision paper on collaborative and reproducible analysis, optimization and co-design of computer systems has been published in the Journal of Scientific Programming:
http://hal.inria.fr/hal-01054763

Artifact Evaluation for CGO'15 and PPoPP'15

As a continuing effort on reproducible R&D in computer engineering, we will be evaluating artifacts of the accepted papers for CGO’15 and PPoPP’15 conferences this autumn:

http://cTuning.org/event/ae-cgo2015
http://cTuning.org/event/ae-ppopp2015

It will be a tough and useful experience! More info to come soon!

"Automatic performance tuning and reproducibility as a side effect"

Our blog article on "Automatic performance tuning and reproducibility as a side effect" for the Software Sustainability Institute is now available online:
http://www.software.ac.uk/blog/2014-07-22-automatic-performance-tuning-and-reproducibility-side-effect

Next ADAPT will be co-located with HiPEAC

We just received confirmation that ADAPT'15 will be co-located with the HiPEAC'15 conference held in Amsterdam in January 2015. More information to follow ...

CFP for CCGrid'15

                               CALL FOR PAPERS
========================================================================
                                 CCGrid 2015
    15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing
                                May 4-7, 2015
                               Shenzhen, China
                      http://cloud.siat.ac.cn/ccgrid2015/
========================================================================

Rapid advances in architectures, networks, and systems and middleware technologies
are leading to new concepts and platforms for computing, ranging from Clusters and
Grids to Clouds and Datacenters. The 15th Annual IEEE/ACM International Symposium
in Cluster, Cloud, and Grid Computing (CCGrid 2015) is a forum bringing together
international researchers, developers, and practitioners to present leading research
activities and results on a broad range of topics related to these concepts and
platforms, and their applications. The conference features keynotes, technical
presentations, workshops, and posters, as well as the Doctoral Symposium and the
SCALE challenge, featuring live demonstrations.

In 2015, CCGrid will return to China and be held in Shenzhen in the Pearl River Delta,
China's fifth largest city. The main conference will be held on May 5-7, 2015,
with affiliated workshops taking place on May 4, 2015.

IMPORTANT DATES (Anywhere on Earth)
===========================
Papers Due: October 27, 2014
Author Notifications: January 15, 2015
Camera Ready Papers Due: March 20, 2015

TOPICS OF INTEREST
===========================
CCGrid 2015 will have a focus on important and immediate issues that are
significantly influencing all aspects of cluster, cloud and grid
computing. Topics of interest include, but are not limited to:

- Applications:
    Applications of new computing concepts and platforms to real and complex problems
    in science, engineering, business, and society; User studies; Experiences with
    large-scale deployments, systems, or applications; Application-level security
- Architecture:
    Design and use of emergent system architectures including but not limited to
    accelerators; Multicores; Security and reliability; High availability solutions
- Autonomic Computing, Datacenters, and Advanced Cyberinfrastructure:
    Self-managed behavior, models and technologies; Autonomic paradigms and systems
    (control-based, bio-inspired, emergent, etc.); Development, evaluation, and
    optimization of large-scale cloud, grid, and HPC architectures;
    Datacenter-level security
- Cloud Computing:
    Software tools and techniques for clouds
- Performance Modeling, Analysis, and Evaluation:
    Prediction of speed, time, energy, etc.; Modeling and analysis;
    Monitoring and evaluation tools; Benchmarks and testbeds
- Programming Models and Runtime Systems:
    Programming models, systems software and environments for cluster, cloud, and
    grid computing; Fault-tolerant systems, programs and algorithms; MapReduce
    model and implementation; programming and runtime optimizations for VM environments
- Scheduling and Resource Management:
    Techniques to schedule jobs and resources on cluster, cloud, and grid
    computing platforms; SLA definition and enforcement
- Storage and I/O:
    System design and optimization for data storage and processing in cluster
    and cloud environments

PAPER SUBMISSION GUIDELINES
===========================
Authors are invited to submit papers electronically in PDF format.
Submitted manuscripts should be structured as technical papers and may
not exceed 10 letter-size (8.5 x 11) pages including figures, tables and
references using the IEEE format for conference proceedings. Submissions
not conforming to these guidelines may be returned without review. The
official language of the conference is English. All manuscripts will be
reviewed and judged on correctness, originality, technical strength,
significance, quality of presentation, and interest and relevance to the
conference attendees.

Paper submissions are limited to 10 pages in 2-column IEEE format
including all figures and references. Submitted manuscripts exceeding
this limit will be returned without review. For the final camera-ready
version, authors with accepted papers may purchase additional pages at
the following rates: 100 USD for each of the first two additional pages;
200 USD for each of the third and fourth additional pages.

Submitted papers must represent original unpublished research that is not
currently under review for any other conference or journal. Papers not
following these guidelines will be rejected without review and further
action may be taken, including (but not limited to) notifications sent to
the heads of the institutions of the authors and sponsors of the
conference. Submissions received after the due date, exceeding the page
limit, or not appropriately structured may not be considered. Authors may
contact the conference chairs for more information. The proceedings will
be published through the IEEE Computer Society Conference Publishing Services.

The paper submission online system is https://www.easychair.org/conferences/?conf=ccgrid2015.

JOURNAL SPECIAL ISSUE
===========================
A special issue of Future Generation Computing Systems
(FGCS, http://www.journals.elsevier.com/future-generation-computer-systems)
will invite extended versions of the top 10-15 CCGrid 2015 papers. Authors
of these papers will be notified of this opportunity by the CCGrid Program
Co-chairs, who will be the editors of this special issue.

CALL FOR WORKSHOP PROPOSALS, POSTERS, DOCTORAL SYMPOSIUM, AND SCALE CHALLENGE
===========================
Workshops affiliated with CCGrid 2015 will be held on May 4, 2015. Poster
presentations will be done during the main conference dates on May 5, 2015.
The Doctoral Symposium and the SCALE Challenge will held during the main
conference, May 5-7, 2015.

For more information on the workshops, posters, and doctoral symposium,
see the following links:
- Workshops: http://cloud.siat.ac.cn/ccgrid2015/call-workshops.html
- Posters: http://cloud.siat.ac.cn/ccgrid2015/call-posters.html
- Doctoral Symposium: http://cloud.siat.ac.cn/ccgrid2015/call-doctoral.html
- SCALE Challenge: http://cloud.siat.ac.cn/ccgrid2015/call-scale.html

Organization
===========================
Honorary General Chair
    Jianping Fan, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, China

General Chairs
    Pavan Balaji, Argonne National Laboratory, USA
    Cheng-zhong Xu, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, China &
                    Wayne State University, USA

Program Committee Chairs
    Daniel S. Katz, University of Chicago & Argonne National Laboratory, USA
    Xiaobo Zhou, University of Colorado, Colorado Springs, USA

Program Committee Tracks and Vice-Chairs
    APPLICATIONS
        Gabrielle Allen, University of Illinois, USA
    ARCHITECTURE
        Satoshi Matsuoka, Tokyo Institute of Technology, Japan
    AUTONOMIC COMPUTING, DATACENTERS, and ADVANCED CYBERINFRASTUCTURE
        Manish Parashar, Rutgers University, USA
    CLOUD COMPUTING
        Kate Keahey, Argonne National Laboratory, USA
    PERFORMANCE MODELING, ANALYSIS, and EVALUATION
        Darren Kerbyson, Pacific Northwest National Laboratory, USA
    PROGRAMMING MODELS and RUNTIME SYSTEMS
        Qing Yi, University of Colorado Colorado Springs, USA
        Xipeng Shen, College of William & Mary, USA
    SCHEDULING and RESOURCE MANAGEMENT
        Peter Troger, Hasso Plattner Institute, University of Pottsdam, Germany
    STORAGE and I/O
        Toni Cortes, Barcelona Supercomputing Center, Spain
        Dan Feng, Huazhong University of Science and Technology, China

Poster Chair
    Sunita Chandrasekaran, University of Houston, USA

Proceedings Chair
    Yanjie Wei, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, China

Workshop Co-chairs
    Zhiyi Huang, University of Otago, New Zealand
    Kun Yang, Essex University, UK

Doctoral Symposium Co-chairs
    Lisong Xu, University of Nebraska-Lincoln, USA
    Zhihui Du, Tsinghua University, China

SCALE Challenge Co-chairs
    Yogesh Simmhan, Indian Institute of Sciences, India
    James Lin, Shanghai Jiao-Tong University, China

Publicity Co-chairs
    Junchao Zhang, Argonne National Laboratory, USA
    Kenli Li, Hunan University, China

Sponsor/Exhibitors Co-chairs
    Yong Chen, Texas Tech University, USA
    Yunquan Zhang, Institute of Computing Technology, Chinese Academy of Sciences, China

Local Arrangements Co-chairs
    Shengzheng Feng, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, China
    Zhibin Yu, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, China

Web Co-chairs
    Huiwei Lu, Argonne National Laboratory, USA
    Dong Lin, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, China

Finance and Registration Co-chairs
    Zhangqiong Huo, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, China
    Mary Dzielski, Argonne National Laboratory, USA
    Sangmin Seo, Argonne National Laboratory, USA

Technical Program Committee
===========================
APPLICATIONS
    Metin Aktulga, Michigan State University, USA
    Bill Barth, Texas Advanced Computing Center, USA
    Costas Bekas, IBM Research-Zurich, Switzerland
    Sanjukta Bhowmick, University of Nebraska, USA
    Sunita Chandrasekaran, University of Houston, USA
    Yifeng Chen, Peking University, China
    Alfredo Cuzzocrea,  ICAR-CNR & University of Calabria, Italy
    Frederic Desprez, INRIA, France
    Adriana Iamnitchi, University of South Florida, USA
    Frank Loeffler, Louisiana State University, USA
    Hai Ah Nam, Oak Ridge National Laboratory,  USA
    Esmond Ng, Lawrence Berkeley National Laboratory, USA
    Judy Qiu, Indiana University, USA
    Ashok Srinivasan, Florida State University, USA
    Matthew Turk, University of Illinois, USA
    Rio Yokota, KAUST, Saudia Arabia

ARCHITECTURE
    Michela Becchi, University of Missouri, USA
    Suren Byna, Lawrence Berkeley National Lab, USA
    Kirk Cameron, Virginia Tech, USA
    Wenguang Chen, Tsinghua University, China
    Toshio Endo, Tokyo Institute of Technology, Japan
    Wu Feng, Virginia Tech, USA
    Torsten Hoefler, ETH Zurich, Switzerland
    Michihiro Koibuchi, National Institute of Informatics, Japan
    Masaaki Kondo, The University of Tokyo, Japan
    Akira Naruse, NVIDIA, Japan
    Martin Schulz, Lawrence Livermore National Lab, USA
    John Shalf, Lawrence Berkeley National Lab, USA
    Cadambi Srihari, NEC Labs America Inc., USA
    Shinji Sumimoto, Fujitsu Laboratories, Japan
    Guangming Tan, Chinese Academy of Sciences, China
    Keith Underwood, Intel, USA
    Jeff Vetter, Oak Ridge National Lab / Georgia Tech, USA
    Abhinav Vishnu, Pacific Northwest National Lab, USA

AUTONOMIC COMPUTING, DATACENTERS, and ADVANCED CYBERINFRASTUCTURE
    Ilkay Altintas, San Diego Supercomputing Center, USA
    Amy Apon, Clemson University, USA
    Umesh Bellur, Indian Institute of Technology, USA
    Suren Byna, Lawrence Berkeley National Lab, USA
    Ann Chervenak, University of Southern California, USA
    Neil Chue Hong, Software Sustainability Institute, UK
    Paolo Costa, Microsoft Research, UK
    Ewa Deelman, University of Southern California, USA
    Liana Fong, IBM, USA
    Geoffrey Fox, Indiana University, USA
    Vladimir Getov, University of Westminster, UK
    Salima Hassas, LIRIS, France
    Dieter Kranzlmuller, Ludwig-Maximilians-Universitat Munchen, Germany
    Gregor von Laszewski, Indiana University, USA
    Laurent Lefevre, INRIA, France
    Xiaolin Li, University of Florida, USA
    Xiaosong Ma, Qatar Computing Research Institute, Qatar
    Julie McCann, Imperial College, UK
    Jarek Nabrzyski, University of Notre Dame, USA
    Shrideep Pallickara, Colorado State University, USA
    Marlon Pierce, Indiana University, USA
    Jean-Marc Pierson, Universite Paul Sabatier, France
    Andres Quiroz, Xerox, USA
    Omer Rana, Cardiff University, UK
    Ivan Rodero, Rutgers University, USA
    Masoud Sadjadi, Florida International University, USA
    John Shalf, Lawrence Berkeley National Lab, USA
    Weisong Shi, Wayne State University, USA
    Alan Sill, Texas Tech University, USA
    Shu Tao, IBM, USA
    Rafael Tolosana, University of Zaragoza, Spain
    Lizhe Wang, Chinese Academy of Sciences, China
    Jon Weissman, University of Minnesota, USA
    Tim Wood, George Washington University, USA
    Ming Zhao, Florida International University, USA
    Xiaoyun Zhu, VMware, USA

CLOUD COMPUTING
    Gabriel Antoniu, INRIA, France
    Susanne Balle, HP, USA
    Jim Basney, NCSA, USA
    Tekin Bicer, Argonne National Lab, USA
    Vincent Breton, CNRS-IN2P3, France
    Young-Ri Choi, UNIST, Korea
    Minh Dinh, The University of Queensland, Australia
    Gilles Fedak, INRIA & University of Lyon, France
    Geoffrey Fox, Indiana University, USA
    Kartik Gopalan, Binghamton University, USA
    Madhusudhan Govindaraju, Binghamton University, USA
    Abhishek Gupta, University of Illinois, USA
    Soonwook Hwang, KISTI, Korea
    Alexandru Iosup, University of Delft, Netherlands
    Shantenu Jha, Rutgers University, USA
    Jens Jensen, Science and Technology Facilities Council, UK
    Chao Jin, The University of Queensland, Australia
    Michael Kozuch, Intel, USA
    James Lin, Shanghai Jiao Tong University, China
    Bogdan Nicolae, IBM Research, Ireland
    Anne-Cecile Orgerie, CNRS, France
    Christian Perez, INRIA, France
    Paul Rad, Rackspace, USA
    Lavanya Ramakrishnan, Lawrence Berkeley National Lab, USA
    Paul Ruth, RENCI - UNC Chapel Hill, USA
    Haiying Shen, Clemson University, USA
    Domenico Talia, University of Calabria, Italy
    Osamu Tatebe, University of Tsukuba, Japan
    Cho-li Wang, The University of Hong Kong, Hong Kong
    Von Welch, Indiana University, USA
    Chuliang Weng, Huawei Shannon Lab, China
    Fan Wu, Shanghai Jiao Tong University, China
    Lamia Youseff, Google, USA
    Jianfeng Zhan, Chinese Academy of Sciences, China

PERFORMANCE MODELING, ANALYSIS, and EVALUATION
    Dorian Arnold, University of New Mexico, USA
    Yungang Bao, Chinese Academy of Sciences, China
    Taisuke Boku, University of Tsukuba, Japan
    Chris Carothers, Rensselaer Polytechnic Institute, USA
    Laura Carrington, San Diego Supercomputing Center, USA
    I-Hsin Chung, IBM Research, USA
    Karen Karavanic, Portland State University, USA
    Karl Fuerlinger, LMU Munich, Germany
    Todd Gamblin, Lawrence Livermore National Lab, USA
    Judit Gimenez, Barcelona Supercomputing Center, Spain
    Simon Hammond, Sandia National Lab, USA
    Mike Heroux, Sandia National Lab, USA
    Stephen Jarvis, University of Warwick, UK
    Mike Lang, Los Alamos National Lab, USA
    Edgar Leon, Lawrence Livermore National Lab, USA
    Ram Rajamony, IBM Research, USA
    Barry Rountree, Lawrence Livermore National Lab, USA
    Jose Sancho, Barcelona Supercomputing Center, Spain
    Sameer Shende, University of Oregon, USA
    Nathan Tallent, Pacific Northwest National Lab, USA
    Ana Varbanescu, Delft University of Technology, Netherlands
    Michele Weiland, Edinburgh Parallel Computing Center, UK
    Patrick Worley, Oak Ridge National Lab, USA
    Nick Wright, Lawrence Berkeley National Lab, USA

PROGRAMMING MODELS and RUNTIME SYSTEMS
    Gagan Agrawal, Ohio State University, USA
    Wesley Bland, Angonne National Laboratory, USA
    John Cavazos, University of Delaware, USA
    Daniel Chavarria, Pacific Northwest National Laboratory, USA
    Albert Cohen, INRIA, France
    Huimin Cui, Chinese Academy of Sciences, China
    Damian Dechev, University of Central Florida, USA
    Chen Ding, University of Rochester, USA
    Grigori Fursin, INRIA, France
    Rajiv Gupta, University of California Riverside, USA
    Martin Hirzel, IBM, USA
    Zhiyi Huang, University of Otago, New Zealand
    Paul H J Kelly, Imperial College London, UK
    Sriram Krishnamoorthy, Pacific Northwest National Lab, USA
    Palden Lama, University of Texas at San Antonio, USA
    Andrew Lenharth, University of Texas at Austin, USA
    Dong Li, Oak Ridge National Lab, USA
    Chunhua Liao, Lawrence Livermore National Lab, USA
    Jiayuan Meng, Angonne National Lab, USA
    Frank Mueller, North Carolina State University, USA
    Dimitrios Nikolopoulos, Queen's University at Belfast, Ireland
    Judy Qiu, Indiana University, USA
    Kenjiro Taura, Tokyo University, Japan
    Didem Unat, Lawrence Berkeley National Lab, USA
    Hans Vandierendonck, Queen's University Belfast, United Kingdom
    Richard Vuduc, Georgia Tech, USA
    Chenggang Wu, Chinese Academy of Sciences, China
    Peng Wu, Huawei America R&D Laboratory, USA
    Jingling Xue, University of New South Wales, Australia
    Zheng Zhang, Rutgers University, USA

SCHEDULING and RESOURCE MANAGEMENT
    Henri Bal, Vrije University, Netherlands
    Anne Benoit, ENS Lyon et IUF, France
    Luiz F. Bittencourt, University of Campinas, Brazil
    Ivona Brandic, TU Wien, Austria
    Julita Corbalan, Universitat Politecnica de Catalunya, Spain
    Ewa Deelman, University of Southern California, USA
    Erik Elmroth, Umea University and Elastisys, Sweden
    Christian Engelmann, Oak Ridge National Lab, USA
    Thomas Fahringer, University of Innsbruck, Austria
    Frank Feinbube, University of Potsdam, Germany
    Gideon Juve, University of Southern California, USA
    Helen Karatza, Aristotle University of Thessaloniki, Greece
    Alexey Lastovetsky, University College Dublin, Ireland
    Lars Lundberg, Blekinge Institute of Technology, Sweden
    Maciej Malawski, AGH University of Science and Technology, Poland
    Nandini Mukherjee, Jadavpur University, India
    Jorg Nolte, TU Cottbus, Germany
    George Pallis, University of Cyprus, Cyprus
    Alexander Papaspyrou, Adesso Mobile Solutions GmbH, Germany
    Andreas Polze, University of Potsdam, Germany
    Rizos Sakellariou, University of Manchester, UK
    Bettina Schnor, University of Potsdam, Germay
    Uwe Schwiegelshohn, TU Dortmund University, Germany
    Denis Trystram, university of Grenoble-Alpes, France
    Kurt Vanmechelen, University of Antwerp, Belgium
    Carlos A. Varela, Rensselaer Polytechnic Institute, USA
    Vladimir Vlassov, Royal Institute of Technology (KTH), Sweden
    Ramin Yahyapour, University of Gottingen, Germany
    Wolfgang Ziegler, Fraunhofer Institute SCAI, Germany

STORAGE AND I/O SYSTEMS
    Gabriel Antoniou, INRIA, France
    Andre Brinkmann, Johannes Gutenberg-Universitat Mainz, Germany
    Richard-Shane Canon, Lawrence Berkeley National Laboratory, USA
    Jesus Carretero, Universidad Carlos III de Madrid, Spain
    Jianxi Chen, Huazhong University of Science and Technology, China
    Yafei Dai, Peking University, China
    Francisco Javier Garcia Blas, Universidad Carlos III de Madrid, Spain
    Xubin He, Virginia Commonwealth University, USA
    Scott Klasky, Oak Ridge National Laboratory, USA
    Quincey Koziol, HDF Group, USA
    Julian Kunkel, German Climate Computing Centre (DKRZ), Germany
    Robert Latham, Argonne National Laboratory, USA
    Adrien Lebre, INRIA, France
    Jay Lofstead, Sandia National Lab, USA
    Carlos Maltzahn, UC Santa Cruz, USA
    Bo Mao, Xiamen University, China
    Dirk Meister, Pure Storage, USA
    Christine Morin, INRIA, France
    Sai Narasimhamurthy, Xyratex, UK
    Juan Piernas, Universidad de Murcia, Spain
    Maria S. Perez, Universidad Politecnica de Madrid, Spain
    Rob Ross, Argonne National Laboratory, USA
    Qingsong Wei, Data Storage Institute, Singapore
    Yifeng Zhu, University of Maine, USA

Our new publication model proposal

Dear colleagues,

At our next ADAPT'15 (adapt-workshop.org) we will try to validate our new publication model where publications and experimental results are validated by the community.

Check out our proposal here:

• http://dl.acm.org/citation.cfm?id=2618142
• http://arxiv.org/abs/1406.4020

We hope it will help initiatives on reproducibility and open access publications (workshops, conferences and journals) as a side effect, rather than being enforced.

Further information is available at our collaborative Wiki: c-mind.org/reproducibility

Take care,
Grigori

pre-vacation digest on reproducibility

Dear colleagues,

Here is my pre-vacations' digest on collaborative and reproducible research in computer engineering:

=== Common benchmarks ===

* PRACE HPC benchmark (Unified European Applications Benchmark Suite)
** Link: http://www.prace-ri.eu/ueabs
** Description: http://www.prace-ri.eu/IMG/pdf/d7.4_3ip.pdf

=== Online courses ===

Reproducible Research as a part of the "Data Science" Specialization:

https://www.coursera.org/course/repdata

=== Events ===

* 2nd Workshop on Sustainable Software for Science: Practice and Experiences (WSSSPE2) (to be held in conjunction with SC14, Sunday, 16 November 2014, New Orleans, LA, USA)
http://wssspe.researchcomputing.org.uk/wssspe2

=== Articles and presentations ===

* Predatory publishing:
  http://www.the-scientist.com/?articles.view/articleNo/32426/title/Predatory-Publishing
* "Begin with an Author's response to Reviews" - proposal to submit past reviews along with articles
  Only for ACM DL subscribers:
  http://dl.acm.org/citation.cfm?id=1536616.1536619&coll=portal&dl=ACM
* Three myths about scientific peer review:
  http://michaelnielsen.org/blog/three-myths-about-scientific-peer-review

=== Blogs ===

* http://www.reproducibleresearch.net/blog

=== Misc repositories ===
Public repositories in other sciences:

* (GIGA)n DB:
  http://gigadb.org/site/index
* Data Intensive Biology:
  http://galaxyproject.org
* GalaxyZoo (classification of galaxies)
  http://www.galaxyzoo.org/?lang=en

=== Tools ===
* R-studio (Open source and enterprise-ready professional software for R)
  http://www.rstudio.com
* Codelab (an experimental platform for collaboration and competition)
  https://www.codalab.org
* FigShare (managing research in a cloud)
  http://figshare.com
* Taverna (designing and executing workflows)
  http://www.taverna.org.uk
* BOINC (open-source software for volunteer computing and grid computing)
  http://boinc.berkeley.edu

Further info is at http://c-mind.org/reproducibility

Take care,
Grigori

Papers and presentations from the 1st ACM SIGPLAN TRUST workshop

Dear colleagues,

Just a note that all papers and presentations from our 1st ACM SIGPLAN TRUST workshop on Reproducible Research Methodologies and New Publication Models in Computer Engineering are now available online at:

http://c-mind.org/events/trust2014

We had many interesting and lively discussions, and it looks like one of the major current concern is about how to share experimental results in a reproducible way with all related software and (possibly rare) hardware dependencies. We also need to keep track and  attribution of all artifacts in ever changing environments.

Finally, we need to improve the reviewing process for publications
as well as shared artifacts. Hence, we proposed a new publication
model which we will try at the next ADAPT'15:
http://dl.acm.org/citation.cfm?doid=2618137.2618142

Since there is no yet universal solution to these problems, we will continue monitoring new tools and hope to continue our public discussions in the future!

Have fun,
Grigori

Call for Participation: ACM SIGPLAN TRUST'14 @ PLDI'14 with a panel on conference artifact evaluation and reproducible research

===============================================================
                  CALL FOR PARTICIPATION

      ACM SIGPLAN TRUST 2014 co-located with PLDI 2014

     1st Workshop on Reproducible Research Methodologies
     and New Publication Models  in Computer Engineering

               June 12, 2014, Edinburgh, UK
   
            http://c-mind.org/events/trust2014
===============================================================
   Early PLDI and workshop registration deadline: 7 May 2014

           http://conferences.inf.ed.ac.uk/pldi2014

       Make sure to tick the box for the TRUST workshop 
===============================================================
Program:

* Panel on conference artifact evaluation experience

  Participants:

  - Jan Vitek (Purdue University, USA)
  - Shriram Krishnamurthi (Brown University, USA)
  - Christophe Dubach (University of Edinburgh, UK)
  - Grigori Fursin (INRIA, France)

* Talks:

  1) "Invited presentation"
     Christian Collberg, University of Arizona, USA

  2) "CARE, the Comprehensive Archiver for Reproducible Execution"
     Yves Janin, Cedric Vincent and Remi Duraffort
     STMicroelectronics, France

  3) "Academia 2.0: removing the publisher middle-man while retaining impact"
     Raphael Poss (A), Sebastian Altmeyer (A), Mark Thompson (B), Rob Jelier (C)
     (A) University of Amsterdam, Netherlands
     (B) L.U.M.C., Netherlands
     (C) KU Leuven, Belgium

  4) "Falsifiability of network security research:
     the Good, the Bad, and the Ugly"
     Dennis Gamayunov, Lomonosov Moscow State University, Russia

  5) "Software in reproducible research: advice and best practice
     collected from experiences at the Collaborations Workshop"
     Mario Antonioletti, Neil Chue Hong, Stephen Crouch, Alexander Hay,
     Simon Hettrick, Devasena Inupakutika, Mike Jackson, Aleksandra Pawlik,
     Giacomo Peru, John Robinson, Shoaib Sufi, Les Carr, David De Roure,
     Carole Goble, and Mark Parsons, UK

  6) "Introducing OCCAM project"
     Bruce Chillders, University of Pittsburgh, USA
===============================================================
Preliminary schedule and further information is available
at the TRUST workshop website:

http://c-mind.org/events/trust2014

Thematic session at HiPEAC CSW "Is Current Research on Heterogeneous HPC Platforms inline with Real-world Application needs?"

My colleagues Marisa Gill and Chris Fench are organizing an interesting
thematic session and a panel "Is Current Research on Heterogeneous HPC Platforms
inline with Real-world Application needs?".

It will be held on the 15th of May during HiPEAC Computing Systems Week
in Barcelona. Join us there:

http://www.hipeac.net/add/res/102/467
http://www.hipeac.net/csw/2014/barcelona

Weekend digest of tools and licenses related to reproducible R&D

Dear colleagues,

Here is a small summary of tools and licenses that may be useful
for reproducible research and experimentation that I assembled
after SEA'14 conference in Boulder:

* CDE tool: automatically create portable Linux applications
  with all dependencies:
  http://www.pgbovine.net/cde.html

* Docker tool: pack, ship and run applications as a lightweight container
  https://www.docker.io

* The IPython Notebook: a web-based interactive computational
  environment where you can combine code execution, text,
  mathematics, plots and rich media into a single document:
  http://ipython.org/notebook.html

* CRAPL license: promote academic code sharing even if it's ugly -
  it's an interesting concept, though not helping my research problems
  at this moment since I need (and promote) not just code and data
  sharing but also their APIs and meta-description to be reusable...
  http://matt.might.net/articles/crapl

Have a good weekend,
Grigori

Digest on reproducible research initiatives

Dear colleagues,

 

Just wanted to share a few links related to reproducible research:

 

* Many interesting software projects for research reproducibility

have been presented at the Collaborations Workshop 2014:
http://www.software.ac.uk/collaborations-workshop-2014-cw14-software-your-reproducible-research/cw14-agenda
All presentations should be available soon!

 

* Prof. Carole Globe presented a nice overview of software projects for reproducibility of research and experimentation:

https://www.dropbox.com/s/67n49i9k3cb28mo/GOBLE-CW2014.ppt

 

* Prof. Globe mentioned yet another interesting initiative on reproducible research:

http://reproduciblescience.org

 

* Interesting and a bit controversial article about scientific peer reviewing:

http://michaelnielsen.org/blog/three-myths-about-scientific-peer-review

 

Hope of it will of any interest and take care,

Grigori

 

ADAPT'14 shared and validated research material

As a continuing effort for validation of experimental results by the community and for testing of Collective Mind repository, we validated two papers from ADAPT'14 workshop with the great help of volunters (Alberto Magni from the University of Edinburgh, UK and Sascha Hunold from Vienna University of Technology, Austria) and shared results here:

• Cedric Nugteren et.al. "Roofline-aware DVFS for GPUs" [ cM link ]
• Chris Schneider et.al. "Autonomous Fault Detection in Self-Healing Systems: Comparing Hidden Markov Models and Artificial Neural Networks" [ cM link ]

ADAPT'14 panel on reproducible research methodologies and new publication models

Finally, I found some time to add all slides from the ADAPT'14 panel on reproducible research methodologies and new publication models here: http://adapt-workshop.org/program.htm

 

I was very glad to see many participants and hot discussions on how to:

• improve publication reviewing process involving more reviewers, sharing of all related material for reproducibility, developing standards for fair and statistical evaluation , etc.
• involve ACM and encourage conferences/journals to promote sharing of related research material and validation of experimental results 
• validate and rank shared research artifacts
• encourage validation and public implementation of already published techniques
• develop common repository for shared material including benchmarks, data sets, tools, models, etc.
• encourage companies to share tools and data

Though there is now yet unified way on the above problems, I was very glad to see active participation and hot discussions. In order to continue and systematize these discussions, I strongly encourage to submit (short position) papers on these topics to our 1st ACM SIGPLAN TRUST'14 workshop that will be co-located with PLDI'14 (June 12, Edinburgh, UK).