[Elsnet-list] BioASQ challenge on biomedical IR, QA, summarization (task 1b) about to start

Ion Androutsopoulos ion at aueb.gr
Thu Jun 6 16:06:34 CEST 2013

[ please distribute - apologies for multiple postings ]

BioASQ challenge on large-scale biomedical semantic indexing and 
question answering
(BioASQ workshop after CLEF 2013 in Valencia, Spain on September 27, 2013)

Web site: http://bioasq.org/
twitter: https://twitter.com/bioasq

The second task of the BioASQ challenge (Task 1B: biomedical question 
answering) will start on Wednesday June 19, 2013. The task is related to:
* information retrieval, including document and snippet retrieval,
* question answering for document collections and ontologies,
* summarization from documents and structured information.

Task 1B will use benchmark datasets containing English questions and 
gold standard (reference) answers. The datasets are being constructed by 
a team of biomedical experts from around Europe. Task 1B will run in two 
- Phase A: BioASQ will release questions from the benchmark datasets. 
The participants will have to respond with relevant concepts (from 
designated terminologies and ontologies), relevant articles (in English, 
from designated article repositories), relevant snippets (from the 
relevant articles), and relevant RDF triples (from designated ontologies).
- Phase B: BioASQ will release questions and gold (correct) relevant 
concepts, articles, snippets, and RDF triples from the benchmark 
datasets. The participants will have to respond with “exact” answers 
(e.g., named entities in the case of factoid questions) and “ideal” 
answers (paragraph-sized summaries), both in English.

It is allowed to participate in both or only one of the phases, and in 
each phase it is allowed to return all or only some of the expected 
answers (e.g., only snippets in Phase A, only exact answers in Phase B).

A development dataset of 29 questions and gold answers is already 
available at: 

To make participating in Task 1B easier, the task will run in three 
consecutive periods (batches), one every 3 weeks. It is allowed to 
participate in some or all of the batches.

Prizes will be awarded to the winners of each batch. Check the following 
page for more information: http://www.bioasq.org/participate/prizes

For each batch, first only the questions of the batch will be released, 
and the participants will have to submit their answers for Phase A 
(concepts, articles, snippets, RDF triples) within 24 hours; then the 
gold concepts, articles, snippets, and RDF triples for the questions of 
the batch will also be provided, and the participants will again have 24 
hours to submit their answers for Phase B (“exact” and “ideal” answers 
of different types, depending on the question). More information about 
the task can be found at: http://bioasq.lip6.fr/general_information/Task1b/

Registration for Task 1B is open and will remain open until the end of 
the challenge in August. In order to register and participate, please 
visit the BioASQ participants area: http://bioasq.lip6.fr/

Important dates:
June 19, 2013: Start of Task 1B - first batch
July 10, 2013: Second batch of Task 1B
July 31, 2013: Third batch of Task 1B
September 27, 2013: BioASQ Workshop (collocated with CLEF 2013, 
Valencia, Spain).

Good luck from the BioASQ team!

The BioASQ challenge and workshop are organised by the BioASQ project, 
supported by the European Commission within the 7th Framework Programme 
(Grant Agreement No. 318652).

More information about the Elsnet-list mailing list