[Asis-l] 2nd CfP: CHIIR 2018 Workshop on Barriers to Interactive IR Resources Re-use

[Toine Bogers]

Second Call for Participation: BIIRRR 2018

*************************************************************************
CHIIR 2018 Workshop on Barriers to Interactive IR Resources Re-use

Thursday, March 15 2018, 9:00-17:00

http://biirrr2018.aau.dk
*************************************************************************

The goal of the BIIRRR 2018 workshop is to serve as a starting point for a community-driven effort to design and implement a platform for the collection, organization, maintenance, and sharing of resources for interactive information retrieval (IIR) experimentation. Examples include search tasks, experimental protocols, questionnaire designs, reporting standards, evaluation procedures, data collections, and the search interaction data produced in such experiments.

While the idea of collecting such resources in a central location is perhaps not a new one, the effort required in designing, implementing, and maintaining such a platform can only be borne by the community as a collective effort.

Please join us in a full-day workshop to brainstorm about the shape this iRepository should take. If you yourself have conducted interactive IR experiments, we would love to hear about your experiences too! Please fill out our survey at http://bit.ly/BIIRRR-survey, it shouldn’t take more than 10 minutes of your time! The result of the survey will help us prepare the workshop and get an overview of the current state of re-use of IIR resources.

One of the goals of the workshop is to produce a set of requirements and activities in order to develop an iRepository, which the organizers commit to publishing as a short report right after the workshop. After this immediate follow-up, we then plan further documented dissemination of the workshop outcomes but also envisage a more extensive activity, such as a Dagstuhl-style seminar, which will provide the time to discuss the requirements and solutions in more detail.

*************************************************************************

Tentative program:

-Introduction of workshop purpose, goals and planned activities
-2 keynotes:
---Nils Pharo, Oslo Metropolitan University: The importance and challenges for standardization in IIR Evaluation - Basis for an iRepository
---Luanne Freund, University of British Columbia: Previous experiences at IIR evaluation campaigns: INEX, TREC, CLEF, RepAST
-2 break-out sessions:
---Viewpoints on standardization: which components of IIR experiments could be re-used?
---Requirements for IIR reuse: how can documentation and archiving be standardized?

*************************************************************************

BIIRRR 2018 Workshop homepage: http://toinebogers.com/biirrr2018

Registration for BIIRR 2018 Workshop: http://sigir.org/chiir2018

Contact the organizers: biirrr at googlegroups.com