Alumni project (December 2015 - November 2018)
Holistic Benchmarking of Big Linked Data
A key step towards abolishing the barriers to the adoption and deployment of Big Data is to provide European companies with open benchmarking reports that allow them to assess the fitness of existing solutions for their purposes. Achieving this goal demands: The deployment of benchmarks on data that reflects reality within realistic settings. The provision of corresponding industry-relevant key performance indicators. The computation of comparable results on standardized hardware.
HOBBIT aims to address these tasks by means of a strong team composed of leading research institutes, large industry customers and innovative small and medium-sized enterprises. In particular, the consortium will aim to achieve the following goals: Define benchmarks for domains of industrial relevance in Europe that make use of Big Linked Data. Determine the key performance indicators for processing Big Linked Data by collaborating with stakeholders from industry and research. Create an open benchmarking platform to evaluate the performance of state-of-the-art systems on standardized hardware. Organize yearly evaluation campaigns, using the platform and the industry-defined KPIs.