[Asis-l] Call for Participation: CLEF Living Labs for IR Evaluation Lab (LL4IR)

Liadh Kelly liadh.kelly at gmail.com
Fri Feb 26 09:04:42 EST 2016


​
================================================================================

The Living Labs for Information Retrieval Evaluation (LL4IR) CLEF Lab
Product Search Task & New Ideas Track

September, 2016, Évora, Portugal

http://living-labs.net/clef-ll4ir-2016/

Register at:  http://clef2016-labs-registration.dei.unipd.it/

================================================================================

Product Search Task:
This task provides a benchmarking platform for researchers to evaluate
their product search ranking systems in a live setting (the REGIO JÁTÉK
online toy store) with real users in their natural task environments. The
lab acts as a proxy between commercial organizations (live environments)
and lab participants (experimental systems).

New Ideas Track:
This year’s lab also invites submissions of position statements (max. 2
pages) describing new use-case and design ideas related to living labs.
These ideas can be speculative, opening up new challenges in the space or
more concrete task proposals for future editions of the CLEF Living Labs
series which the authors would like to run. Accepted submissions will be
presented and discussed at the LL4IR workshop at CLEF'16 and will be
published in the CEUR-WS Lab proceedings.

-----------------------
Current Important dates
-----------------------
22 Apr, 2016 CLEF lab registration closes

Lab Task:
15 Mar, 2016 Training period begins
14 Apr, 2016 Training period ends
15 Apr, 2016 Testing period begins
30 Apr, 2016 Testing period ends
15 May, 2016 Additional Testing period begins
25 May, 2016 CLEF Working notes papers due
17 Jun, 2016 Notification of paper acceptance

New Ideas Track:
25 May, 2016 New Ideas Track paper submission deadline
17 Jun, 2016 Notification of paper acceptance

-------------------
Further Information
-------------------

Further information is available on the lab website (
http://living-labs.net/clef-ll4ir-2016/), on the mailing list (
https://groups.google.com/forum/#!forum/living-labs) or by emailing the lab
organisers.

--------------
Lab Organisers
--------------

Krisztian Balog – University of Stavanger, Norway (krisztian.balog (at)
uis.no)
Liadh Kelly – Trinity College Dublin, Ireland (liadh.kelly (at) tcd.ie)
Anne Schuth – University of Amsterdam, The Netherlands (anne.schuth (at)
gmail.com)
​
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.asis.org/pipermail/asis-l/attachments/20160226/d4e5d9a7/attachment-0001.html>


More information about the Asis-l mailing list