[Elsnet-list] Call for Participation: SemEval task "Linking Events
and their Participants in Discourse"
csporled at CoLi.Uni-SB.DE
Mon Jan 25 15:37:31 CET 2010
Call for Participation
SemEval-2010 Shared Task #10:
Linking Events and their Participants in Discourse
--- Training Data now available ---
This shared task should appeal to researchers working on:
* semantic role labelling (FrameNet or PropBank)
* co-reference resolution, or
* information extraction.
Semantic role labelling (SRL) has traditionally been viewed as a
sentence-internal problem. However, it is clear that there is an interplay
between local semantic argument structure and the surrounding discourse.
In this shared task, we would like to take SRL beyond the domain of
isolated sentences by linking local semantic argument structures to the
wider discourse context. In particular, we aim to find fillers for roles
which are left unfilled in the local context (null instantiations, NIs).
An example is given below, where the "charges" role ("arg2" in PropBank)
of "cleared" is left empty but can be linked to "murder" in the previous
In a lengthy court case the defendant was tried for murder.
In the end, he was cleared.
Short Task Description
Participants can tackle either (or both) of the following two tasks, which
will be evaluated independently:
The test set will be annotated with gold standard frames. For each lexical
unit annotated with a frame, participants have to:
* find the semantic arguments (role recognition)
* label them with the correct role (role labelling)
* find links between null instantiated roles and their fillers in the
wider discourse context if such links exist (NI linking)
The test set will be annotated with gold standard local semantic argument
structure; only the fillers of null instantiations have to be found.
NOTE: We provide the annotated data in both FrameNet and PropBank
style. Participants can choose with which framework they want to work.
The two frameworks are evaluated separately.
For more details see the task web site
(http://www.coli.uni-saarland.de/projects/semeval2010_FG/) and the
Josef Ruppenhofer, Caroline Sporleder, Roser Morante, Collin Baker and
Martha Palmer. "SemEval-2010 Task 10: Linking Events and Their
Participants in Discourse". The NAACL-HLT 2009 Workshop on Semantic
Evaluations: Recent Achievements and Future Directions (SEW-09),
Boulder, Colorado, USA, June 4, 2009.
We provide training and (later) test data of running text from the fiction
domain. The data sets are freely available and downloadable from the
SemEval website (http://semeval2.fbk.eu/semeval2.php). The training set
for both tasks is annotated with:
* gold standard semantic argument structure (FrameNet and PropBank style)
* linking information for null instantiations
* co-reference chains (for evaluation purposes)
Participants are also free to make use of external resources, such as the
FrameNet (FN) or PropBank/NomBank releases. (We distribute the FN-style
training set with an intermediate FrameNet release (1.4 alpha)).
Josef Ruppenhofer, Saarland University, Germany
Caroline Sporleder, Saarland University, Germany
Roser Morante, University of Antwerp, Belgium
Collin Baker, ICSI, Berkeley, USA
Martha Palmer, University of Colorado, Boulder, USA
If you are interested in participating in the shared task, please join our
Google group: http://groups.google.com/group/semeval2010-task10
Task #10 website: http://www.coli.uni-saarland.de/projects/semeval2010_FG/
SemEval 2010 website: http://semeval2.fbk.eu/semeval2.php
Cluster of Excellence MMCI / Computational Linguistics,
csporled at coli.uni-sb.de
More information about the Elsnet-list