从零搭建Hadoop+zookeeper+hbase+hive完全分布式环境（04）——Hive

在上一篇hbase搭建的基础上搭建hive集群
(https://editor.csdn.net/md/?articleId=106999922)

安装mysql数据库

请查看博主前面的mysql搭建过程：(https://editor.csdn.net/md/?articleId=106991232)

配置hive.env.sh(若名字不对应则mv改名)

切换到/opt/hive/conf目录下
vi hive.env.sh

HADOOP_HOME=/opt/hadoop    //hadoop路径
export HIVE_CONF_DIR=/opt/hive/conf    //hive的conf路径
export HIVE_AUX_JARS_PATH=/opt/hive/lib    //hive的jar包路径
export JAVA_HOME=/opt/java8    //jdk安装路径

配置hive-site.xml(若不存在直接新建)

vi hive-site.xml

<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
<name>hive.metastore.warehouse.dir</name>
<value>/opt/hive/warehouse</value>
</property>
<property>
<name>hive.metastore.local</name>
<value>true</value>
</property>
<!-- 如果是远程mysql数据库的话需要在这里写入远程的IP或hosts -->
<property>
<name>javax.jdo.option.ConnectionURL</name>
<value>jdbc:mysql://192.168.109.110:3306/hive_matadata?createDatabaseIfNotExist=true</value>    //数据库所在主机的IP
</property>
<property>
<name>javax.jdo.option.ConnectionDriverName</name>
<value>com.mysql.jdbc.Driver</value>
</property>
<property>
<name>javax.jdo.option.ConnectionUserName</name>
<value>root</value>
</property>
<property>
<name>javax.jdo.option.ConnectionPassword</name>
<value>ok</value>
</property>
</configuration>

将java连接数据库的jar包移入hive的lib目录下

mv /software/mysql-connector-java-5.1.0-bin.jar /opt/hive/lib/

按照hive-site.xml配置的warehouse目录创建warehouse文件夹

hadoop fs -mkdir -p /opt/hive/warehouse

给warehouse目录和hive目录赋权

hadoop fs -chmod 777 /opt/hive/warehouse
hadoop fs -chmod -R 777 /opt/hive/

初始化hive

schematool -dbType mysql -initSchema

启动hive

hive

Hadoop环境启动顺序

//hadoop
start-all.sh

//zookeeper
//bin目录下
./zkServer.sh start

//hbase
//bin目录下
./start-hbase.sh

//hivehive

Hadoop环境关闭顺序

//hivejps命令找到Runjar进程kill掉

//hbase
//bin目录下
./stop-hbase.sh

//zookeeper
//bin目录下
./zkServer.sh stop

//hadoop
stop-all.sh

至此，整个Hadoop环境就搭建完成了！