RNTI

MODULAD
Huawei Open Data Analytics Platform
In EDA 2015, vol. RNTI-B-11, pp.201-204
Résumé
New frameworks such as Spark, Tez, Flink, or Hive offer new possibilities, but using more than one framework is generally not easy. We build an abstraction layer that allows users to define their big data operations in a declarative way. This abstraction layer is backed by a platform that optimizes the workflow by carefully profiling each operation and running them, transparently, on the most appropriate framework given the description of the job and the currently available resources.