Repository files navigation

We presentRuBQ (pronounced [`rubik]) --Russian KnowledgeBaseQuestions, a KBQA dataset that consists of 1,500 Russian questions of varying complexity along with their English machine translations, corresponding SPARQL queries, answers, as well as a subset of Wikidata covering entities with Russian labels. To the best of our knowledge, this is the first Russian KBQA and semantic parsing dataset. The dataset is thought to be used as a development and test sets in cross-lingual transfer, few-shot learning, or learning with synthetic data scenarios.

Data set files are presented in JSON format as an array of dictionary entries. See full specifications here.

SELECT ?answer
WHERE {
  wd:Q2222 wdt:P50 ?answer .
}

SELECT ?answer
WHERE {
  wd:Q845176 p:P161 [
    ps:P161 ?answer;
    pq:P453 wd:Q2737140
  ] .
}

SELECT ?answer
WHERE {
  wd:Q181517 wdt:P366 [
    wdt:P3095 ?answer
  ] .
}

SELECT ?answer
WHERE {
  ?answer p:P2046/
     psn:P2046/
     wikibase:quantityAmount ?sq .
  ?answer wdt:P31 wd:Q9430 .
}
ORDER BY ASC(?sq)
LIMIT 1

We provide a Wikidata sample containing all the entities with Russian labels. It consists of about 212M triples with 8.1M unique entities. This snapshot mitigates the problem of Wikidata’s dynamics – a reference answer may change with time as the knowledge base evolves. The sample guarantees the correctness of the queries and answers. In addition, the smaller dump makes it easier to conduct experiments with our dataset.

We strongly recommend using this sample for evaluation.

Sample is a collection of several RDF files in Turtle.

• wdt_all.ttl contains all the truthy statements.
• names.ttl contains Russian and English labels and aliases for all entities. Names in other language also provided when needed.
• onto.ttl contains all Wikidata triples with relationwdt:P279 -subclass of. It represents some class hierarchy, but remember that there is noclass orinstance concepts in Wikidata.
• pch_{0,6}.ttl contain all statetment nodes and their data for all entities.

Some question in our dataset require usingrdfs:label orskos:altLabel for retrieving answer which is a literal. In cases where answer language doesn't have to be inferred from question, our evaluation script takes into account Russian literals only.

This work is licensed under aCreative Commons Attribution 4.0 International License.