Extended deadline for results submission (18th of March at 23.55 h. Madrid time (GMT +1))
To get updates about data, evaluation and other information, please subscribe to http://groups.google.com/group/ddiextraction_semeval
- The start of the evaluation period will be 1 March 2013
- Format for submission
- Information on evaluation metrics
The DDIExtraction 2013 task concerns the recognition of drugs and extraction of drug-drug interactions that appear in biomedical literature. The definition of drug-drug interaction (DDI) is broadly described as a change in the effects of one drug by the presence of another drug (e.g. Acetazolamide reduces urinary excretion of quinidine and may enhance its effect.). The detection of DDIs is an important research area in patient safety since these interactions can become very dangerous and increase health care costs.
Drug interactions are frequently reported in journals, making medical literature the most effective source for their detection. Information Extraction (IE) can be of great benefit in the pharmaceutical industry allowing identification and extraction of relevant information on DDIs and providing an interesting way of reducing the time spent by health care professionals on reviewing the literature.
The goal of the task is to provide a common framework for evaluation of information extraction techniques applied to the recognition of pharmacological substances and detection of drug-drug interactions from biomedical texts. The DDIExtraction 2011 task (see http://labda.inf.uc3m.es/DDIExtraction2011/) concentrated efforts on the novel aspects of the DDI extraction task, the drug recognition was assumed and the annotations for drugs were provided to the participants. This new DDIExtraction 2013 task will pursue the extraction of drug interactions as well as the recognition of drug names. Additionally, while the DDIExtraction 2011 shared task relied on the DDI corpus composed by texts describing DDIs from the DrugBank database, the DDIExtraction2013 also integrates MedLine abstracts in order to deal with different type of texts and language styles.
The DDIExtraction2013 Shared Task focuses on extraction of drug-drug interactions. This shared task is designed to address the extraction of DDIs as a whole, but divided into two subtasks to allow separate evaluation of the performance for different aspects of the problem. The shared task includes two challenges:
- Task 9.1: Recognition and classification of drug names.
Task 9.2: Extraction of drug-drug interactions. The extraction of drug-drug interactions is a specific relation extraction task in biomedical literature. This task could be very appealing to groups studying PPI (protein-protein interaction) extraction because they could adapt their systems to extract drug-drug interactions.
The DDIExtraction 2013 task relies on the DDI corpus which contains MedLine abstracts on drug-drug interactions as well as documents describing drug-drug interactions from the DrugBank database.
Evaluation results are reported using the standard precision/recall/f-score metrics. For details, check the following documents here:
The DDI Corpus
A description of the corpus can be downloaded here.
The annotation guidelines of the DDI corpus can be downloaded here.