English
资源说明：The size of data sets being collected and analyzed in the
industry for business intelligence is growing rapidly, mak-
ing traditional warehousing solutions prohibitively expen-
sive. Hadoop [3] is a popular open-source map-reduce im-
plementation which is being used as an alternative to store
and process extremely large data sets on commodity hard-
ware. However, the map-reduce programming model is very
low level and requires developers to write custom programs
which are hard to maintain and reuse.
In this paper, we present Hive, an open-source data ware-
housing solution built on top of Hadoop. Hive supports
queries expressed in a SQL-like declarative language - HiveQL,
which are compiled into map-reduce jobs executed on Hadoop.
In addition, HiveQL supports custom map-reduce scripts to
be plugged into queries. The language includes a type sys-
tem with support for tables containing primitive types, col-
lections like arrays and maps, and nested compositions of
the same. The underlying IO libraries can be extended to
query data in custom formats. Hive also includes a system
catalog, Hive-Metastore, containing schemas and statistics,
which is useful in data exploration and query optimization.
In Facebook, the Hive warehouse contains several thousand
tables with over 700 terabytes of data and is being used ex-
tensively for both reporting and ad-hoc analyses by more
than 100 users.
The rest of the paper is organized as follows. Section 2
describes the Hive data model and the HiveQL language
with an example. Section 3 describes the Hive system ar-
chitecture and an overview of the query life cycle. Section 4
provides a walk-through of the demonstration. We conclude
with future work in Section 5.
本源码包内暂不包含可直接显示的源代码文件，请下载源码包。
