Data

 

Dataset

The dataset contains the 100 queries, organized as illustrated in the Task Description page.

The dataset includes gold standard annotations for Web search results.

Download the Dataset

 

Java Evaluator

The evaluator for this task is now available. It will be used for all evaluations against the test set which will be released in March.

Download the Evaluator for WSI and WSD systems

 

Trial data

The trial dataset contains the first 4 queries, organized as illustrated in the Task Description page.

Download the Trial Data

 

Test data

The test data can be downloaded from the ftp sever.

You should have received an email with login instructions.

The test data for task11 is available in the directoy /home/task11/test data/

Contact Info

Organizers

Roberto Navigli
 Sapienza University of Rome, Italy
Daniele Vannella
 Sapienza University of Rome, Italy

Other Info

Announcements

  • February 22, 2013: Registration Deadline
  • March 5, 2013: Start of evaluation period
  • The files need to be uploaded by 11:59pm PST today (3 system runs per team at most.)
  • March 15, 2013: End of evaluation period
  • April 15, 2013: Paper submission deadline
  • April 22, 2013: Reviews Due
  • April 29, 2013 Camera ready Due
  • June 14-15, 2013 , SemEval Workshop, (and, June 13-14, *Sem Conference), Atlanta, Georgia