Data and Tools

Training data for TempEval3:

 

 

DOWNLOADS

DEFINITIVE EVALUATION DATA:

TimeML XSD: This XML schema is taken as reference to decide if a TimeML annotation is valid (Download).

Download annotated English test data : te3-platinumstandard.tar.gz

Download TempEval-3 unannotated English test data : TE3-platinum-test-unannotated

Download TempEval-3 unannotated Spanish test data (no split for different tests): SpanishTestTE3

 

TRAINING DATA:

Download TempEval-3 English training data: TBAQ-cleaned (NEW VERSION no self-relations) and TE3-Silver-data

Download TempEval-3 Spanish training data: SpanishTrainTE3.

Download sample TempEval-3 test data (same format for all langs): Sample-test-data

TOOLS:

Evaluation Toolkit: Toolkit released to evaluate the entity extraction (Task A and B) and relation performance (Task C). Download Evaluation Toolkit
TimeML validator: Tool that validates a TimeML annotation using the official timeml.xsd. (Download).

DESCRIPTION

See the TempEval-3 task1 paper http://www.aclweb.org/anthology/S/S13/S13-2001.pdf 

or ArXiv paper http://arxiv.org/abs/1206.5333

Contact Info

Organizers

- James Allen, University of Rochester
- Leon Derczynski, University of Sheffield
- Hector Llorens, University of Alicante
- James Pustejovsky, Brandeis University
- Naushad UzZaman, University of Rochester/Nuance Communications [Primary Contact]
- Marc Verhagen, Brandeis University


email : naushad@cs.rochester.edu

Other Info

Announcements

  • Program of SemEval 2013 (includes proceedings)
  • March 4, 2013. Evaluation data is released, find it in data and tools section.
  • February 26, 2013. Evaluation toolkit is updated. Please update from data and tools section.
  • September 3, 2012: Hand annotated Spanish training data is available in the data and tools section.
  • August 30, 2012: Silver data is available in the data and tools section. Human reviewed portion of the silver data will be available soon as additional gold data. Cleaned and improved AQUAINT and TimeBank corpus is already available as gold standard data.
  • March 26, 2012: Cleaned and improved AQUAINT and TimeBank corpus is available as gold standard training data for TempEval3. Download from data and tools section.
  • March 26, 2012: Toolkit released to evaluate the entity extraction (Task A and B) and relation performance (Task C). Download from data and tools section.