 |
Towards a Roadmap for
Multimodal Language Resources and Evaluation
OVERVIEW
Towards a Roadmap for Multimodal Language Resources and Evaluation
An ELSNET workshop at LREC 2002
Las Palmas, Canary Islands, Spain
Sunday, June 2 2002
Aim of the workshop:
The aim of the proposed workshop was to bring together key players in the field of resources and evaluation in order to make a first step towards the creation of a broadly supported Roadmap for Language Resources, i.e. a broadly supported view on the longer, medium and shorter term needs and priorities. This activity should be seen in the context of ELSNET's other roadmapping activities (see http://www.elsnet.org/roadmap.html), which aim at developing a technological roadmap for the whole field of Human Language Technologies.
The purpose of such roadmaps is to give the R&D community an instrument to identify opportunities for concertation of their activities and better exploitation of possible synergies between players all over the world.
Scope of this workshop:
The scope of this roadmapping workshop was narrowed down to a specific sub-area: Multimodal Language Resources and Evaluation. This made it possible for us to exploit the fact that this workshop took place the day after the workshop dedicated to Multimodal Resources and Evaluation of Multimodal Systems (MREMS) in general, organized by Mark Maybury (Mitre) and Jean-Claude Martin (LIMSI).
Program:
| Action | Title | Actor(s) |
|---|---|---|
| Opening | Introduction to this workshop | Steven Krauwer |
| Interactive Talk | Summary of the MREMS Workshop | Mark Maybury / Jean-Claude Martin |
| Talk | Challenges and Important Aspects in Planning and Performing Evaluation Studies for Multimodal Dialogue Systems | Susanne Höllerer |
| Talk | XML and multimodal corpus design: experiences with multi-layered stand-off annotations in the GeM corpus | John Bateman, Judy Delin, Renate Herschel |
| Talk | Towards a roadmap for Human Language Technologies: Dutch-Flemish experience | Diana Binnenpoorte, Catia Cucchiarini, Elisabeth D'Halleweyn, Janienke Sturm and Folkert de Vriend |
| Invited Talk | The Companions: a possible future Integrating concept | Yorick Wilks |
| Break | ||
| Interactive Talk | About roadmapping: Introduction to the plenary exercises | Steven Krauwer / Hans Uszkoreit |
| Exercise 1 | Identifying priorities | All |
| Exercise 2 | Putting them on a timeline | All |
| Discussion | Where to go from here | All & Steven Krauwer |
| Closing | ||
Recommended reading:
- ELSNET's First Roadmap Report (http://utrecht.elsnet.org/roadmap/docs/rm-bernsen-v2.pdf), edited by Ole Bernsen
- ELSNET's Second Roadmap Report (http://utrecht.elsnet.org/roadmap/docs/rm-eisele-v2.pdf), edited by Dorothee and Andreas Eisele)
URLs:
- Workshop: http://www.elsnet.org/roadmap-lrec2002.html
- Conference: http://www.lrec-conf.org
Core Programme Committee:
- Steven Krauwer (ELSNET / Utrecht University)
- Hans Uszkoreit (DFKI Saarbruecken)
- Antonio Zampolli (Univ of Pisa)
- Joseph Mariani (LIMSI, Paris)
- Ulrich Heid (IMS Stuttgart)
- Khalid Choukri (ELDA Paris)
- Mark Maybury (MITRE)
Contact point:
Steven Krauwer, ELSNET coordinator,
UiL-OTS, Trans 10, 3512 JK Utrecht, NL
phone: +31 30 253 6050,
fax: +31 30 253 6000,
email: s.krauwer@elsnet.org