kettle 5.1.0 连接 Hadoop hive 2 (hive 1.2.1)

1. 配置HiveServer2，在hive-site.xml中添加如下的属性

<property>

    <name>hive.server2.thrift.bind.host</name>

    <value>192.168.56.101</value>

    <description>Bind host on which to run the HiveServer2 Thrift service.</description>

</property>

<property>

    <name>hive.server2.thrift.port</name>

    <value>10001</value>

    <description>Port number of HiveServer2 Thrift interface when hive.server2.transport.mode is 'binary'.</description>

</property>

<property>

    <name>hive.server2.thrift.min.worker.threads</name>

    <value>5</value>

    <description>Minimum number of Thrift worker threads</description>

</property>

<property>

    <name>hive.server2.thrift.max.worker.threads</name>

    <value>500</value>

    <description>Maximum number of Thrift worker threads</description>

</property>

2. 启动HiveServer2

$HIVE_HOME/bin/hiveserver2

3. 修改kettle的配置文件

%KETTLE_HOME%/plugins/pentaho-big-data-plugin/plugin.properties

修改成下面的值

active.hadoop.configuration=hdp20

4. 启动kettle，配置数据库连接，如图1所示



图1

5. 测试

（1）在hive中建立测试表和数据

CREATE DATABASE test;

USE test;

CREATE TABLE a(a int,b int) ROW FORMAT DELIMITED FIELDS TERMINATED BY ',';

LOAD DATA LOCAL INPATH '/home/grid/a.txt' INTO TABLE a;

SELECT * FROM a;

查询结果如图2所示



图2
（2）在kettle建立表输入步骤，结果如图3所示



图3
注意：这里需要加上库名test，否则查询的是default库。

（3）点击预览，显示的数据如图4所示



图4
参考：
https://cwiki.apache.org/confluence/display/Hive/Setting+up+HiveServer2 http://stackoverflow.com/questions/25625088/pentaho-data-integration-with-hive-connection http://blog.csdn.net/victor_ww/article/details/40041589