Evaluation

Ranking of particpants can be downloaded from the following links:

Task 9.1

Task 9.2

 

Evaluation results are reported using the standard precision/recall/f-score metrics. For details, check the following documents here:

- Evaluation Metrics for the task 9.1

- Evaluation metrics for the task 9.2

 

Evaluation scripts are now available here: Evaluation scripts   (update!  09/04/2013)

Please, read readme.txt file for help on running the evaluation scripts:

http://www.cs.york.ac.uk/semeval-2013/task9/data/uploads/readme.txt

Contact Info

Contact info

  • Isabel Segura Bedmar (isegura@inf.uc3m.es)
  • Paloma Martinez (pmf@inf.uc3m.es)
  • Maria Herrero Zazo (mhzazo@pa.uc3m.es)

Other Info

Announcements

  • Deadline extended: April 15.
  • Ranking of participants are now available.
  • Extended deadline for results submission (18th of March at 23.55 h. Madrid time (GMT +1)) .
  • Evaluation scripts are now available!!!.
  • Please read the information on format for submission.
  • Please read the documents on evaluation metrics for the task 9.1 and 9.2.
  • Please join the mailing list for updates: http://groups.google.com/group/ddiextraction_semeval.
  • Please, download training dataset again from the data section (last updated 31/01/2013).
  • Please, read the annotation guidelines of the DDI corpus.