About the demo

The HOBBIT evaluation platform is a distributed FAIR benchmarking platform for the Linked Data lifecycle. This means that the platform was designed to provide means to:

benchmark any step of the Linked Data lifecycle, including generation and acquisition, analytics and processing, storage and curation as well as visualization and services ensure that benchmarking results can be found, accessed, integrated and reused easily (FAIR principles) benchmark Big Data platforms by being the first distributed benchmarking platform for Linked data.

We are hosting an online instance of our platform for

• running public challenges and
• making sure that even people without the required infrastructure are able to run the benchmarks they are interested in.

The platform is open-source and can be downloaded and executed locally.

Underlying Principles

The HOBBIT benchmarking platform ensures that:

1. Users can test systems with the HOBBIT benchmarks without having to worry about finding standardized hardware
2. New benchmarks can be easily created and added to the platform by third parties.
3. The evaluation can be scaled out to large datasets and on distributed architectures.
4. The publishing and analysis of the results of different systems can be carried out in a uniform manner across the different benchmarks.

The first version of the platform has been released in February 2017. It offers the main features of an evaluation platform and has been further enhanced over time. The release of the second version is planned for February 2018. For this release we are mainly focussing on the usability of the platform as well as its support for additional features that can be used by the benchmark implementations (e.g., shared volumes or hardware statistics).

How to use the platform The online instance of the HOBBIT benchmarking platform is accessible at master.project-hobbit.eu. More information about its features and how to use it can be found in deliverable D2.2.1 and our online documentation.

Tutorial videos can be found in the HOBBIT YouTube channel.