QALD-2 » Open Challenge
May 28, 2012 ⋅ Co-located with: ESWC 2012  

Open Challenge

The workshop is preceded by an open challenge in Question Answering over Linked Data, in order to provide a benchmark for comparing different approaches and systems that mediate between a user (expressing his or her information need in natural language) and semantic data.

Full description: qald-2-challenge.pdf (last updated: March 26, 2012)


Schedule

Release of training dataset January 31
Release of test set March 28 25
Submission of results April 1


Datasets

DBpedia 3.7

MusicBrainz (RDF export):

  • musicbrainz.tar.gz (226.8 MB)

Training questions

DBpedia:

MusicBrainz:


Participant's challenge:


Test questions:

Test questions with annotations:

 


Evaluation

For both training and the test phase, results can be uploaded with the following evaluation form:

Evaluation results (test phase)