[Asis-l] Call for Participation CLEF 2010, 20–23 September 2010, Padua, Italy

[Nicola Ferro]

CLEF 2010 - Conference on Multilingual and Multimodal Information Access Evaluation

20–23 September 2010, Padua, Italy

http://www.clef2010.org/

---------------------------------------------------------------------------------------
KEY DATES

 Regular registration deadline: August 31, 2010
 
 Student discounts are available only in regular registration.


REGISTRATION

http://www.clef2010.org/index.php?page=pages/registrationVenue.html

PROGRAM:

http://www.clef2010.org/index.php?page=pages/schedule.html

FLYER:

http://www.clef2010.org/resources/download/clef2010-flyer-final.pdf

---------------------------------------------------------------------------------------


OVERVIEW

CLEF2010 is the continuation of the popular CLEF campaigns that have run for the past ten years. It covers a broad range of issues in the fields of multilingual and multimodal information access evaluation. It consists of two main parts: a peer-reviewed conference (20-21 September) on experimental evaluation, which innovates the CLEF tradition, and a series of labs (22-23 September), which continue the CLEF tradition of community-based evaluation and discussion on evaluation issues.

The CLEF2010 conference aims at advancing the evaluation of complex multimodal and multilingual information systems in order to support individuals, organizations, and communities who design, develop, employ, and improve such systems.

The growth of the Internet has been exponential with respect to the number of users, media, and languages used regularly for global information dissemination. Language and media barriers are no longer seen as inviolable and they are constantly crossed and mixed to provide content that can be accessed on a global scale within a multicultural and multilingual setting.

Users need to be able to co-operate and communicate across language and media boundaries, going beyond separate search in diverse media/languages and exploiting interactions between different languages and media.

Experimental evaluation - both laboratory and interactive - is a key to fostering the development of multilingual and multimodal information systems that address increasingly complex information needs.

The CLEF2010 labs continue the CLEF tradition of community-based benchmarking and will complement these with workshops on emerging issues in evaluation methodology. 


KEYNOTE TALKS (http://www.clef2010.org/index.php?page=pages/keynotes.html)

* IR Between Science and Engineering, and the Role of Experimentation
  Norbert Fuhr, University of Duisburg-Essen, Germany

* Retrieval Evaluation in Practice
  Ricardo Baeza-Yates, Yahoo! Research, Spain



ACCEPTED PAPERS (http://www.clef2010.org/index.php?page=pages/acceptedPapers.html)

* Creating a Persian-English Comparable Corpus 
  Homa Baradaran Hashemi, Azadeh Shakery, and Heshaam Faili

* Tie-breaking Bias: Effect of an Uncontrolled Parameter on Information Retrieval Evaluation 
  Guillaume Cabanac, Gilles Hubert, Mohand Boughanem, and Claude Chrisment

* A New Approach for Cross-Language Plagiarism Analysis 
  Rafael Corezola Pereira, Viviane P. Moreira, and Renata Galante

* Evaluating Information Extraction 
  Andrea Esuli and Fabrizio Sebastiani

* Which Log for which Information? Gathering Multilinguality Data from Different Log File Types
  Maria Gäde, Vivien Petras, and Juliane Stiller

* Automated Component-Level Evaluation: Present and Future 
  Allan Hanbury and Henning Müller

* MapReduce for information retrieval evaluation: “Let's quickly test this on 12 TB of data”
  Djoerd Hiemstra and Claudia Hauff

* Validating Query Simulators: An Experiment Using Commercial Searches and Purchases
  Bouke Huurnink, Katja Hofmann, Maarten de Rijke and, Marc Bron

* A Dictionary- and Corpus-Independent Statistical Lemmatizer for Information Retrieval in Low Resource Languages 
  Aki Loponen and Kalervo Järvelin

* Examining the Robustness of Evaluation Metrics for Patent Retrieval with Incomplete Relevance Judgements
  Walid Magdy and Gareth Jones

* On the Evaluation of Entity Profiles 
  Maarten de Rijke, Krisztian Balog, Toine Bogers, and Antal van den Bosch

* Using Parallel corpora for Multilingual(Multi-Document) Summarisation Evaluation
  Marco Turchi, Josef Steinberger, Ralf Steinberger, and Mijail Kabadjov


PANELS (http://www.clef2010.org/index.php?page=pages/panels.html)

* A PROMISE for Experimental Evaluation
  Chair: Jussi Karlgren, Swedish Institute of Computer Science, Sweden
	
* The Four Ladies of Experimental Evaluation
  Chair: Donna Harman, NIST, USA 


LABS AND WORKSHOPS (http://www.clef2010.org/index.php?page=pages/labs.html)

* CLEF-IP: A benchmarking activity on intellectual property.
    
* ImageCLEF: A benchmarking activity on image retrieval.
    
* PAN: A benchmarking activity on plagiarism and Wikipedia vandalism detection.
    
* RespubliQA: A benchmarking activity on question answering using multilingual political data.
    
* WePS: A benchmarking activity on web people search.

* CriES: A workshop aimed at exploring the evaluation of searching for expertise in social media.
    
* LogCLEF: A workshop aimed at exploring methodologies for studying search engine log files.


Further details on the program, such as invited talks and panels, will be available soon on the CLEF 2010 Web site.


ORGANIZATION

Honorary Chair
- Carol Peters, ISTI-CNR Pisa, Italy

General Chairs
- Maristella Agosti, University of Padua, Italy
- Maarten de Rijke, University of Amsterdam, The Netherlands

Programme Chairs
- Nicola Ferro, University of Padua, Italy
- Alan Smeaton, Dublin City University, Ireland

Lab Chairs
- Martin Braschler, Zurich University of Applied Sciences, Switzerland
- Donna Harman, National Institute of Standards and Technology (NIST), USA

Organization Chair
- Emanuele Pianta, Center for the Evaluation of Language and Communication
Technologies (CELCT), Italy

Resource Chair
- Khalid Choukri, Evaluations and Language resources Distribution Agency (ELDA), France

REGISTRATION

http://www.clef2010.org/index.php?page=pages/registrationVenue.html

Regular registration deadline: August 31, 2010
 
Student discounts are available only in regular registration.

We are looking forward to meeting you in Padua, next September.


The CLEF 2010 Chairs