| Category: ||E-Announce |
| Subject: ||BioASQ challenge on biomedical IR, QA, summarization |
| From: || |
| Email: ||ion_(on)_aueb.gr |
| Date received: ||06 Jun 2013 |
| Start date: ||27 Sep 2013 |
[ please distribute - apologies for multiple postings ]
BioASQ challenge on large-scale biomedical semantic indexing and
(BioASQ workshop after CLEF 2013 in Valencia, Spain on September 27, 2013)
Web site: http://bioasq.org/
The second task of the BioASQ challenge (Task 1B: biomedical question
answering) will start on Wednesday June 19, 2013. The task is related to:
* information retrieval, including document and snippet retrieval,
* question answering for document collections and ontologies,
* summarization from documents and structured information.
Task 1B will use benchmark datasets containing English questions and
gold standard (reference) answers. The datasets are being constructed by
a team of biomedical experts from around Europe. Task 1B will run in two
- Phase A: BioASQ will release questions from the benchmark datasets.
The participants will have to respond with relevant concepts (from
designated terminologies and ontologies), relevant articles (in English,
from designated article repositories), relevant snippets (from the
relevant articles), and relevant RDF triples (from designated ontologies).
- Phase B: BioASQ will release questions and gold (correct) relevant
concepts, articles, snippets, and RDF triples from the benchmark
datasets. The participants will have to respond with exact answers
(e.g., named entities in the case of factoid questions) and ideal
answers (paragraph-sized summaries), both in English.
It is allowed to participate in both or only one of the phases, and in
each phase it is allowed to return all or only some of the expected
answers (e.g., only snippets in Phase A, only exact answers in Phase B).
A development dataset of 29 questions and gold answers is already
To make participating in Task 1B easier, the task will run in three
consecutive periods (batches), one every 3 weeks. It is allowed to
participate in some or all of the batches.
Prizes will be awarded to the winners of each batch. Check the following
page for more information: http://www.bioasq.org/participate/prizes
For each batch, first only the questions of the batch will be released,
and the participants will have to submit their answers for Phase A
(concepts, articles, snippets, RDF triples) within 24 hours; then the
gold concepts, articles, snippets, and RDF triples for the questions of
the batch will also be provided, and the participants will again have 24
hours to submit their answers for Phase B (exact and ideal answers
of different types, depending on the question). More information about
the task can be found at: http://bioasq.lip6.fr/general_information/Task1b/
Registration for Task 1B is open and will remain open until the end of
the challenge in August. In order to register and participate, please
visit the BioASQ participants area: http://bioasq.lip6.fr/
June 19, 2013: Start of Task 1B - first batch
July 10, 2013: Second batch of Task 1B
July 31, 2013: Third batch of Task 1B
September 27, 2013: BioASQ Workshop (collocated with CLEF 2013,
Good luck from the BioASQ team!
The BioASQ challenge and workshop are organised by the BioASQ project,
supported by the European Commission within the 7th Framework Programme
(Grant Agreement No. 318652).
- ELSNET mailing list
- To manage your subscription go to: