Data and Knowledge Group

RODI Benchmark

Overview

Accessing and utilizing enterprise or Web data that is scattered across multiple data sources is an important task for both applications and users. Ontology-based data integration, where an ontology mediates between the raw data and its consumers, is a promising approach to facilitate such scenarios. This approach crucially relies on high-quality mappings to relate the ontology and the data, the latter being typically stored in relational databases. A number of systems to help mapping construction have recently been developed. A generic and effective benchmark for reliable and comparable evaluation of mapping quality would make an important contribution to the development of ontology-based integration systems and their application in practice. RODI represents such a benchmark. RODI offers test scenarios from conference, geographical, and oil and gas domains. Scenarios are constituted of databases, ontologies, mappings, and queries to test expected results. Systems that compute relational-to-ontology mappings can be evaluated using RODI by checking how well they can handle various features of relational schemas and ontologies, and how well computed mappings work for query answering.

Using RODI

Below you can find the RODI Benchmark distribution. The archive contains sources, binaries, required libraries, scenarios, examples for BootOX, IncMap and D2RQ systems, documentation, and scripts to run experiments.

Source codes, together with a pre-configured Eclipse project, are also available at RODIs github webpage. The pre-configured Eclipse project assumes that all required libraries are placed under the 'lib' folder.

By downloading the sources and/or binaries of RODI, you agree to the following licence.