Elsnet
 
   


ELSNET-list archive

Category:   E-Announce
Subject:   Call for participation: Semeval competition
From:  
Email:   e.agirre_(on)_ehu.es
Date received:   17 Feb 2007
Deadline:   17 Apr 2007
Start date:   23 Jun 2007

~~~~~ Apologies for multiple postings ~~~~~~ WORKSHOP ANNOUNCEMENT AND CALL FOR PARTICIPATION SemEval-2007 (formerly Senseval) 4th International Workshop on Semantic Evaluations an ACL-SIGLEX event at ACL, Prague June 23-24 http://nlp.cs.swarthmore.edu/semeval http://www.acl2007.org/ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ REGISTRATION IS NOW OPEN!! START OF COMPETITION: FEBRUARY 26 END OF COMPETITION: APRIL 1 The main purpose of this workshop is to analyze and discuss the results of systems participating in the SemEval-2007 evaluations, to be held in February-March 2007. Nineteen different tasks are planned for SemEval, to conduct evaluations of systems that perform automatic semantic analysis of text, covering a wide range of aspects of semantics and multilinguality. Background and motivation ------------------------------------ There are now many computer systems that do automatic semantic analysis of text. The purpose of SemEval is to evaluate the strengths and weaknesses of such systems with respect to different words, relations, types of texts, different varieties of language, and different languages. This workshop is a follow-up to the Senseval series of workshops on semantic evaluation. Senseval-1 took place in the summer of 1998 for English, French, and Italian, culminating in a workshop held at Herstmonceux Castle, Sussex, England on September 2-4. Senseval-2 took place in the summer of 2001, and was followed by a workshop held in July 2001 in Toulouse, in conjunction with ACL-2001. It included tasks for 12 languages. Senseval-3 took place in the spring of 2004, and was followed by a workshop held in July 2004 in Barcelona, in conjunction with ACL-2004. More than 55 teams participated with over 160 systems in its 16 tasks. For this fourth edition, Senseval is changing its name to SemEval (for Semantic Evaluation). The change of name is motivated by a desire to broaden the spectrum of accepted works to all aspects of computational semantic analysis of language. In the call for task proposals we especially encouraged the proposal of tasks for different languages, cross-lingual tasks, and tasks that are relevant to particular NLP applications such as machine translation, information retrieval and information extraction. In recent years, the deployment of multiple semantic lexicons and accordingly tagged corpora (WordNet-SemCor, VerbNet-PropBank, FrameNet and Prague Dependency Treebank, to name a few) have radically changed the way semantic analysis is performed, especially at the disambiguation stage. Some of the proposals at SemEval 2007 are trying to take this one step further by proposing multiple layers of semantic annotation of the same corpus (e.g., senses, roles, name-entity classes), allowing for novel research to be performed. Tasks ---------- 1 Evaluating WSD on Cross Language Information Retrieval 2 Evaluating Word Sense Induction and Discrimination Systems 3 Multipart Semantic Tagging of Czech 4 Classification of Semantic Relations between Nominals 5 Multilingual Chinese-English Lexical Sample Task 6 Word-Sense Disambiguation of Prepositions 7 Coarse-grained English all-words 8 Metonymy Resolution at Semeval-2007 9 Multilevel Semantic Annotation of Catalan and Spanish 10 English Lexical Substitution Task for SemEval-2007 11 English Lexical Sample Task via English-Chinese Parallel Text 12 Turkish Lexical Sample Task 13 Web People Search 14 Affective Text 15 TempEval: A proposal for Evaluating Time-Event Temporal Relation Identification 16 Evaluation of wide coverage knowledge resources 17 English Lexical Sample, English SRL and English All-Words Tasks 18 Arabic Semantic Labeling 19 Frame Semantic Structure Extraction Check Semeval website for details. Participation and papers ------------------------------ Systems that plan to participate in any of the tasks can register in the Semeval website now. The evaluation period starts on February 26 and finishes the 1st of April. For further details check the Semeval website and the instruction for participants in: http://nlp.cs.swarthmore.edu/semeval/participants.shtml For registration: http://nlp.cs.swarthmore.edu/semeval/team/registration.shtml The workshop will include presentations by participants and task organizers. The proceedings will include papers by participants and task organizers. Schedule -------- Registration for tasks: Open now! Evaluation period: February 26 - April 1, 2007 Submission of description papers: April 17, 2007 Notification of acceptance: April 23, 2007 Camera ready due: May 6, 2007 Workshop Date: June 23-24, 2007 Workshop Organizers ------------------- Eneko Agirre (University of the Basque Country, UPV/EHU, Spain) Lluís Màrquez (Technical University of Catalonia, UPC, Spain) Richard Wicentowski (Swarthmore College, USA) Program Committee ----------------- Collin Baker, University of California, Berkeley, USA Nicoletta Calzolari, Istituto di Linguistica Computazionale - CNR, Pisa Xavier Carreras, Massachusetts Institute of Technology, USA Walter Daelemans, University of Antwerp, Belgium Phil Edmonds, Sharp Laboratories of Europe Julio Gonzalo, UNED, Spain Veronique Hoste, University of Antwerp Eduard Hovy, Information Science Institute, USA Nancy Ide, Vassar College, USA Dimitrios Kokkinakis, Goteborg University Sadao Kurohashi, The University of Kyoto Kenneth Litkowski, CL Research, USA Bernardo Magnini, IRST, Italy David Martínez, University of Melbourne, Australia Diana McCarthy, University of Sussex Paola Merlo, University of Geneva, Switzerland Rada Mihalcea University of North Texas Hwee Tou Ng, National University of Singapore German Rigau, Basque Country University, Basque Country Mark Stevenson, University of Sheffield, UK Suzanne Stevenson, University of Toronto, Canada Carlo Strapparava, ITC-IRST, Italy Yorick Wilks, University of Sheffield, UK Dekai Wu, The Hong Kong University of Science & Technology, China Deniz Yuret, Koc University, Turkey _______________________________________________ Elsnet-list mailing list Elsnet-list_(on)_elsnet.org http://mailman.elsnet.org/mailman/listinfo/elsnet-list
 

[print/pda] [no frame] [navigation table] [navigation frame]     Page generated 14-02-2008 by Steven Krauwer Disclaimer / Contact ELSNET