ApacheCon North America 2014

This talk is about a system developed at InMobi to support data cubes on top of Hive metastore and Hive Query Language. The Hive metastore in its current state allows users to represent structured data in simple tables. However, it does not allow expressing relationships or richer DWH concepts like facts, dimensions and etc. With Hive data cubes, users can query data stored in HDFS, S3, Redshift and etc, with a single query language and schema. Underlying execution engines like Hive, Impala, Shark can be plugged in and utilized at run time. The execution engine used is transparent to the user. The system provides a unified logical schema to users consisting of cubes, facts and dimensions; and users can issue queries at a conceptual level without knowing about roll-up intervals, partitions, data types, underlying storage and table relationships; they will be figured out automatically.