Programme

09:00-10:00
Keynote Presentation

Session Chair: Nicola Ferro (University of Padua, Italy)

An Infrastructure for Supporting the Evaluation of Interactive Information Retrieval [slides] [paper]
Norbert Fuhr (University of Duisburg-Essen, Germany)
10:00-10:30
Papers Session 1

Session Chair: Maristella Agosti (University of Padua, Italy)

Principles for Robust Evaluation Infrastructure [slide][paper]
Justin Zobel, William Webber, Alistair Moffat (Department of Computer Science and Software Engineering, The University of Melbourne, Australia)
Mark Sanderson (School of Computer Science and Information Technology, RMIT University, Australia)
 
A Lightweight Framework for Reproducible Parameter Sweeping in Information Retrieval [slide][paper]
Richard Eckart de Castilho, Iryna Gurevych (Ubiquitous Knowledge Processing Lab, Technical University of Darmstadt, Germany)
 
10:30-11:00
Coffee Break
11:00-12:00
Keynote Presentation

Session Chair: Costantino Thanos (ISTI-CNR, Pisa, Italy)

Ontology-based Data Management [slide][paper]

Maurizio Lenzerini (Sapienza University of Rome, Italy)
12:00-13:00
Papers Session 2

Session Chair: Nicola Ferro (University of Padua, Italy)

Evaluation with the VIRTUOSO Platform [slide][paper]
Gérard Dupont (CASSIDIAN, Elancourt, France)
Gaël de Chalendar, Dmitri Voitsekhovitchy, Géraud Canet (CEA, Fontenay-aux-Roses, France)
Khaled Kheliff, Stéphan Brunessaux (CASSIDIAN, Val de Reuil, France)
 
Use Cases as a Component of Information Access Evaluation [slide][paper]
Jussi Karlgren, Anni Järvelin, Preben Hansen, Gunnar Eriksson (Swedish Institute of Computer Science, Sweden)
 
PatOlympics - An Infrastructure for Interactive Evaluation of Patent Retrieval Tools [slide][paper]
Mihai Lupu (Vienna University of Technology, Austria)
 
Infrastructure and Workflow for the Formal Evaluation of Semantic Search Technologies [slides] [paper]
Stuart N. Wrigley (Dept. Computer Science, University of Sheffield, UK)
Raúl García-Castro (Facultad de Informática Universidad Politécnica de Madrid, Spain)
Cássia Trojahn (INRIA & LIG, Montbonnot Saint Martin, France)
13:00-14:00
Lunch
14:00-15:30
Discussion Session in Groups for Determining the Research Roadmap
15:30-16:00
Coffee Break
16:00-17:00
Report from the Groups
17:00-18:00
Final Discussion: Continuation of the Work and Planning Future Activities