[Asis-l] Free Registration Open: Living Labs for IR Evaluation, Challenge Preparation Workshop in Amsterdam

Liadh Kelly lkelly at computing.dcu.ie
Tue May 20 04:25:08 EDT 2014


===========================================================================================
The Living Labs for Information Retrieval (IR) Evaluation - Challenge
Preparation Workshop

6 June, 2014, Amsterdam, The Netherlands
http://living-labs.net/llc/

[Challenge runs June 15 – August 15, as part of
​CIKM ​
2nd Living Labs for IR
​Evaluation ​
Workshop]

https://groups.google.com/forum/#!forum/living-labs

===========================================================================================

The basic idea of living labs for information retrieval (IR) is that rather
than individual research groups independently developing experimental
search infrastructures and gathering their own groups of test searchers for
IR evaluations, a central and shared experimental environment is developed
to facilitate the sharing of resources in a live setting (most important of
all: users). See http://living-labs.net/ for details.

The aim of the Challenge Preparation Workshop is to test and further
develop a living labs for IR evaluation methodology and a living labs for
IR platform, which has been created as part of the CIKM'14 2nd Living Labs
for IR Evaluation Workshop. This is to be initially used in a community
challenge as part of CIKM'14 2nd Living Labs for IR Evaluation Workshop.
The challenge at CIKM focuses on two use-cases: product search (on an
e-commerce site) and local domain search (on a university’s website).
During the first month of the challenge participants will have the
opportunity to tune their system through the product and local domain
search websites. The second month of the challenge will examine the
performance of participants’ systems on these search websites.

The programme for the Challenge Preparation Workshop includes (1) invited
talks and discussions with invited guests to learn from their knowledge in
this space, and (2) a hackathon and system testing session with prospective
participants for testing the challenge components.


-------------
Participation
-------------
The workshop is free and open to all interested participants, but
registration is required.

Click here to register:
https://docs.google.com/forms/d/1L3o_AWKNTXw8iFaK7_gGMFqmBhi4d_Sy-GFGoz_7KuI/viewform
Registration will close May 29.

We have a limited number of travel grants to cover travel and accommodation
costs (reserved for those with academic affiliations and outside The
Netherlands); enquiries can be sent to the workshop organisers.


---------------
Date & Location
---------------
July 6, 2014 - Living Labs Challenge Workshop, at the University of
Amsterdam, The Netherlands

[Challenge runs June 15 – August 15]


-------------------
Further Information
-------------------
Further information is available on the workshop website (
http://living-labs.net/llc/) or by emailing the workshop organisers.


-------------------
Workshop Organisers
-------------------
Krisztian Balog – University of Stavanger, Norway (krisztian.balog (at)
uis.no)
Liadh Kelly – Dublin City University, Ireland (liadh.kelly (at)
computing.dcu.ie)
Anne Schuth – University of Amsterdam, The Netherlands (anne.schuth (at)
uva.nl)
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.asis.org/pipermail/asis-l/attachments/20140520/bd383e21/attachment.html>


More information about the Asis-l mailing list