[Asis-l] CFP 2nd Workshop on the Evaluation of Collaborative Information Retrieval and Seeking ECol at CHIIR'2017

[Chirag Shah]

==========================================================
ECol Workshop @ CHIIR 2017: Call for papers
==========================================================

The 2nd International Workshop on the Evaluation of Collaborative Information Retrieval and Seeking (ECol 2017)
In conjunction with the ACM SIGIR Conference on Human Information Interaction & Retrieval (CHIIR 2017)

Oslo, Norway, March 11, 2017

http://www.irit.fr/ECol2017/ <http://www.irit.fr/ECol2017/>

OVERVIEW
The ECol workshop mainly addresses challenges related to collaborative information terieval (CIR) or seeking (CIS) which refer to methodologies and technologies that support collective-knowledge sharing within a work team in order to solve a shared complex problem. Collaborative search is also known as a social process in which users leverage from other usersÕ interactions and social signals (e.g., bookmarks and annotations).

While a follow on from our previous workshop, this workshop has two distinguishing and novel elements: (i) a specific focus on social IR and collaborative IR evaluation, bridging the gap within this space, and (ii) we provide datasets, tools and new tasks for participants and others to undertake evaluations and explore this space (download from http://www.irit.fr/ECol2017/resources.php <http://www.irit.fr/ECol2017/resources.php>).

SCOPE AND TOPICS (non exhaustive list)
* Evaluation
- Studies on collective relevance judging.
- Studies of collaborative behavior applicable to evaluation.
- Simulation vs. log-studies vs. user-studies for collaborative search.
- Evaluation of single vs. collaborative search session.
- Novel or extended traditional evaluation measures, test collections, methodologies of operational evaluation.
- Evaluation Concerns and Issues: Reliability, Repeatability, Reproducibility, Replicability.
* Tasks - Exploratory search (knowledge acquisition, multi-faceted search)
- Recommending social collaborators (experts, answerers, sympathizers)
- Collaborative ranking on social platforms
- Collaborative intent understanding
* Application
- Medical CIS/CIR
- Legal CIS/CIR
- E-science and digital libraries
=========================================================

PAPER SUBMISSION AND GUIDELINES
- Research papers: both theoretical and practical research papers are welcome from both research and industrial communities addressing the main conference topic (evaluation framework), but will also consider related aspects including models, methods, techniques and, examples of CIS/CIR in theory and in practice.
Authors have the opportunity to: - Use their own datasets/tools to propose an evaluation framework for the identified tasks.
- Use the provided datasets/tools to propose an eval- uation framework for a task they have identified.
- Propose an evaluation framework without support of datasets/tools for a task we/they have identified.
- Designing possible tasks (with/without proposing models and evaluation frameworks) on provided or their own datasets
- Collection papers: We are also seeking papers describing test collections usable for the experimental evaluation of contributions related to CIS/CIR. The collection should be publicly available and different from previously available collections and data sets and allowing to investigate a variety of research questions that could rise from CIS/CIR challenges.
The submissions will be peer reviewed (double blind) and should be no longer than 4 pages in the ACM format (http://www.acm.org/sigs/publications/proceedings-templates <http://www.acm.org/sigs/publications/proceedings-templates>). The papers should be submitted online through the EasyChair workshop submission system at: https://easychair.org/conferences/?conf=ecol2017 <https://easychair.org/conferences/?conf=ecol2017>. All submitted papers will be peer-reviewed by at least two members of the workshop program committee. At least one author of each accepted paper must attend the workshop to present the paper. All accepted papers will be required to be published on ArXiv, and might be submitted elsewhere. The ECol 2017 website will however refer to the published ArXiv papers.
=========================================================
IMPORTANT DATES

Paper Submission: January 27 2017
Notification of Acceptance: February 20, 2017
Camera-Ready papers due: March 1, 2017
Workshop: March 11, 2017
=========================================================
ORGANIZERS

Leif Azzopardi, School of Computing Science at the University of Glasgow - UK (Leif.Azzopardi at glasgow.ac.uk <mailto:Leif.Azzopardi at glasgow.ac.uk>)
Jeremy Pickens, Catalyst Repository Systems - USA (jpickens at catalystsecure.com <mailto:jpickens at catalystsecure.com>)
Chirag Shah, Rutgers University - USA (chirags at rutgers.edu <mailto:chirags at rutgers.edu>) 
Laure Soulier, LIP6 - Pierre and Marie Curie University, FranceÊ (laure.soulier at lip6.fr <mailto:laure.soulier at lip6.fr>)
Lynda Tamine-Lechani, Paul Sabatier University - IRIT, France (Lynda.Tamine-Lechani at irit.fr <mailto:Lynda.Tamine-Lechani at irit.fr>)

For any question, send an e-mail to ecol2017 at irit.fr <mailto:ecol2017 at irit.fr>

PROGRAM COMMITTEE

To be announced


******

Chirag Shah, PhD
Associate Professor of Information and Computer Science, Rutgers University
Director, InfoSeeking Lab (http://infoseeking.org)
http://comminfo.rutgers.edu/~chirags