| Category: ||E-Announce |
| Subject: ||Generation Challenges 2010: Announcement and Call for Tasks |
| From: || |
| Email: ||a.gatt_(on)_abdn.ac.uk |
| Date received: ||10 Jul 2009 |
| Deadline: ||02 Aug 2009 |
| Start date: ||07 Jul 2010 |
Announcement and First Call for Tasks
GENERATION CHALLENGES 2010
To be held in conjunction with INLG 2010.
In order to continue to provide a common forum for the expanding range
of shared-task activities involving language generation, we are
organising Generation Challenges 2010 which will include the following
1. The GIVE-2 Challenge (Koller et al.): Generation of
natural-language instructions to aid human task-solving in a virtual
environment; GIVE-2 will have virtual worlds that permit continuous
moves (rather than discrete steps as in GIVE-1). Call for
Participation has been posted (see http://www.give-challenge.org/research/).
2. Post-processing referring expressions in extractive summaries (Belz
et al.): based on GREC-NEG and DUC data. Call for Participation in
In addition, several more tasks are currently in preparation and will
be presented for discussion at the GenChal'10 session at INLG'10 (with
a view to running them as tasks in 2011):
3. Working group on shared task in surface realisation using Wall
Street Journal corpus.
4. Working group on shared task in referring expression generation in
instructional and cooperative dialogues.
At this point, we invite any team of researchers interested in organising
a shared task as part of the Generation Challenges 2010 event to submit a
task proposal. This is not intended to be a selective process. Anyone
interested in running a shared task as part of Generation Challenges 2010
is in principle welcome to do so. We would simply like to get an idea of
how many tasks there are likely to be for organisational purposes, and
also to be able to offer advice and support where needed. In the unlikely
event that more tasks are proposed than can be accommodated, we would make
a selection together with the INLG'10 organisers. Each team of task
organisers will be reponsible for organising and evaluating their task.
The Generation Challenges 2010 organisers will merely coordinate issues
relating to the special session, presentations and reports.
Please send task proposals to gre-stec_(at)_itri.brighton.ac.uk by 2 August
2009. Please bear in mind the timeline below, and include information
regarding organisers, task description, size and state of completion
of data to be used, evaluation plans and provisional timeline.
Generation Challenges 2010 Timeline:
Submission of task outlines 02 Aug 2009
Recommended first call for participation Aug 2009
Recommended availability of training data Aug-Sep 2009
Recommended evaluation period May 2010
Expected deadline for camera-ready reports 1 June 2010
INLG'10 7-9 July 2010
Don't hesitate to get in touch with any questions. Best wishes,
Anja Belz, Albert Gatt and Alexander Koller
Generation Challenges Steering Committee:
GenChal'10 homepage: http://www.nltg.brighton.ac.uk/research/genchal10
GenChal'10 email: nlg-stec_(at)_itri.brighton.ac.uk
SIGGEN mailing list
The University of Aberdeen is a charity registered in Scotland, No SC013683.
Elsnet-list mailing list