[Sigdl-l] CLEF 2011 - Call for Papers

Thu Feb 17 10:21:19 EST 2011

CLEF 2011, AMSTERDAM

September 19th-22nd 2011

Amsterdam, The Netherlands

--------------------------------- 

CLEF2011 is the second CLEF conference continuing the popular CLEF campaigns. It will cover a broad range of issues in the fields of multilingual and multimodal information access evaluation. It will consist of two main parts: a peer-reviewed conference on research papers, and a series of labs, which will continue the CLEF tradition of community-based evaluation and discussion on evaluation issues.

AIMS AND SCOPE

The CLEF2011 conference aims at advancing the evaluation of complex multimodal and multilingual information systems in order to support individuals, organizations, and communities who design, develop, employ, and improve such systems. The growth of the Internet has been exponential with respect to the number of users, media, and languages used regularly for global information dissemination. Language and media barriers are no longer seen as inviolable and they are constantly crossed and mixed to provide content that can be accessed on a global scale within a multicultural and multilingual setting.

Users need to be able to co-operate and communicate across language and media boundaries, going beyond separate search in diverse media/languages and exploiting interactions between different languages and media.

Experimental evaluation — both laboratory and interactive — is a key to fostering the development of multilingual and multimodal information systems that address increasingly complex information needs.

We invite submissions for presentation at the CLEF2011 conference. We welcome submissions on all aspects of multilingual and multimodal information access evaluation. All submissions will be reviewed on the basis of relevance, originality, importance, and clarity. 

TOPICS

Relevant topics for the CLEF2010 conference include but are not limited to:
Novel methodologies for the design of evaluation tasks, especially user-centric ones;
Analysis of the impact of multilingual/multicultural/multimodal differences in interface and search design;
Assessing multilinguality and multimodality in relevant application communities, e.g. digital libraries, intellectual property, medical, music, video, and social media;
Testing and evaluation of translation and summaries over documents and of linked documents in multilingual information retrieval;
Benefits of multilingual information retrieval methods for different user groups or in different use cases, including those relevant to the developing world;
Alternative methods for improving and automating ground-truth creation, for example crowd-sourcing or log-based;
Alternatives and comparison of item-based, list-based, set-based, and session-based evaluation;
Prediction of success and satisfaction rate;
Task-oriented metrics of success and failure;
Simulation (of queries, sessions, users) and information retrieval;
Innovative and easy to communicate techniques for analysing the experimental results, including statistical analyses, data mining, and information visualization;
Infrastructures for bringing automation and collaboration in the evaluation process;
Living laboratories and evaluating live systems;
Economic impact/sustainability of multilingual and multimodal information approaches, evaluation methodologies, and deployed systems.

FORMAT

The conference proceedings will be published in the Springer Lecture Notes in Computer Science (LNCS) series.

Authors are invited to submit electronically original papers, which have not been published and are not under consideration elsewhere, using the LNCS proceedings format. http://www.springer.com/computer/lncs?SGWID=0-164-7-72376-0

Two types of papers are solicited:
full papers: 12 pages max;
short papers: 6 pages max.

Papers will be peer-reviewed by at least 3 members of the program committee. Papers should be submitted in PDF format to the following address: 

http://senldogo0039.springer-sbm.com/CLEF2011/servlet/Conference/

IMPORTANT DATES

May 1st, 2011 Submission deadline
June 10th, 2011 Notification of acceptance
June 17th, 2011 Camera ready versions
September 19th-22nd, 2011 CLEF Conference

ORGANIZATION

General chairs

Maarten de Rijke, University of Amsterdam, The Netherlands
Julio Gonzalo, UNED, Spain

Program chairs

Mounia Lalmas, Yahoo! Research, Spain
Jaana Kekäläinen, University of Tampere, Finland

Lab chairs

Vivien Petras, Humboldt University, Germany
Paul Clough, University of Sheffield, UK

Organization chair

Emanuele Pianta, CELCT, Italy

Resource and Publicity chair

Khalid Choukri, ELDA, France

Technical management

Pamela Forner, CELCT, Italy
Giovanni Moretti, CELCT, Italy

Local organizers

Richard Berendsen, University of Amsterdam, The Netherlands
Bouke Huurnink, University of Amsterdam, The Netherlands
Edgar Meij, University of Amsterdam, The Netherlands

Program committee

Pia Borlund, Royal School of Library and Information Science, Denmark
Pavel Braslavski, Yandex, Russia
Ben Carterette, University of Delaware, USA
Nicola Ferro, University of Padua, Italy
Norbert Fuhr, University of Duisburg, Germany
Gareth Jones, Dublin City University, Ireland
Marko Junkkari, University of Tampere, Finland
Kal Järvelin, University of Tampere, Finland
Noriko Kando, National Institute of Informatics, Japan
Heikki Keskustalo, University of Tampere, Finland
Birger Larsen, Royal School of Library and Information Science, Denmark
Ray Larson, University of California, Berkeley, USA
Prasenjit Majumder, Dhirubhai Ambani Institute of Information and Communication Technology, India
Paul McNamee, Johns Hopkins University, USA
Stefano Mizzarro, University of Udine, Italy
Jian-Yun Nie, University of Montreal, Canada
Carol Peters, ISTI CNR Pisa, Italy
Vivien Petras, Humboldt University, Germany
Ian Ruthven, University of Strathclyde, United Kingdom
Christa Womser-Hacker, University of Hildesheim, Germany

_______________________________________________
Cross-Language Evaluation Forum (CLEF) mailing list
clef at dei.unipd.it
http://www.clef-campaign.org/
http://www.promise-noe.eu/
To (un-)subscribe, please, write to Nicola Ferro (ferro at dei.unipd.it)
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mail.asis.org/pipermail/sigdl-l/attachments/20110217/e7622ee7/attachment.html 