H2020 IOStack

This deliverable reviews the implementation of the SDS services for analytics in IOStack in 2017. In a first part, we review the design and implementation of the Pluggable Spark Filters technology, which enables the acceleration of Spark Big Data analytics on data stored in object stores through a-priori filtering of objects, followed by a review and discussion of the experimental evaluation that we performed on a large cluster. In the second part of this document, we review the design and results of the stocator connector which very much enhances the access of Object Stores from Apache Spark.