Elsnet
 
   


ELSNET-list archive

Category:   E-Announce
Subject:   Answer Validation Exercise 2007: Call for Participation
From:  
Email:   alvarory_(on)_lsi.uned.es
Date received:   09 May 2007
Deadline:   01 Jun 2007
Start date:   19 Sep 2007

The Answer Validation Exercise (AVE) 2007 is part of the QA Track at the Cross Language Evaluation Forum (CLEF). The objective of the task is to promote the development and evaluation of subsystems aimed at validating the correctness of the answers given by a QA system. This year the exercise introduces some variations with respect to AVE 2006. Participant systems will receive a set of triplets (Question, Answer, Supporting Text) and they must return a validation value (SELECTED, ACCEPTED or REJECTED) for each triplet. Results will be evaluated against the QA human assessments. Please visit the "Exercise Description" at http://nlp.uned.es/QA/ave/index.php?option=com_content&task=view&id=16&Itemid=29 for more details. There will be a subtask for each language involved in QA at CLEF 2007: Bulgarian, German, English, Spanish, French, Italian, Dutch, Portuguese and Romanian The development collections for Answer Validation Exercise (AVE) 2007 are now available at the AVE site (http://nlp.uned.es/QA/ave/) under the "2007" tab of your menu, after login as a registered participant. Important dates: Registration for the AVE sub-exercises (languages) at http://nlp.uned.es/QA/ave : June 1, 2007 Test set release: June 15, 2007 Submission of runs: June 22 , 2007 Release of individual results: July 9, 2007 Submission of Paper for Working Notes: August 15, 2007 CLEF 2007 Workshop: 19-21 September 2007 Thank you for your interest. For further information please visit the website or contact: Anselmo Peñas anselmo_(on)_lsi.uned.es Alvaro Rodrigo alvarory_(on)_lsi.uned.es _______________________________________________
 

[print/pda] [no frame] [navigation table] [navigation frame]     Page generated 14-02-2008 by Steven Krauwer Disclaimer / Contact ELSNET