Hive2.0.0安装步骤(配置mysql+简单入门)
2016-09-13 10:17
447 查看
1、下载https://mirrors.tuna.tsinghua.edu.cn/apache/hive/hive-2.0.0/apache-hive-2.0.0-bin.tar.gz
2、拷贝到/usr/local/wl/hive目录下进行解压并重新命名hive
拷贝mysql-connector-java-5.1.8-bin.jar(下面删除表出现问题需要换成mysql-connector-java-5.1.34.jar)到/usr/local/wl/hive/hive/lib下
cp /usr/local/wl/hive/hive/conf/hive-default.xml.template /usr/local/wl/hive/hive/conf/hive-site.xml
3、配置环境变量
vi /etc/profile
export HIVE_HOME=/usr/local/wl/hive/hive
export PATH=$PATH:$HIVE_HOME/bin
source /etc/profile
4、修改hive-site.xml相关内容:
${system:java.io.tmpdir}->全部替换成->/usr/local/wl/hive/tmp(新建/usr/local/wuliu/hive/tmp/root目录)
${system:user.name}->全部替换成->root
<property>
<name>hive.metastore.warehouse.dir</name>
<value>/user/hive/warehouse</value><!-- Hadoop服务器会出现此文件夹-->
<description>location of default database for the warehouse</description>
5、修改mysql配置
<property>
<name>javax.jdo.option.ConnectionURL</name>
<value>jdbc:mysql://123.206.26.35:3306/hive?createDatabaseIfNotExist=true</value>
<description>JDBC connect string for a JDBC metastore</description>
</property>
<property>
<name>javax.jdo.option.ConnectionDriverName</name>
<value>com.mysql.jdbc.Driver</value>
<description>Driver class name for a JDBC metastore</description>
</property>
<property>
<name>javax.jdo.option.ConnectionUserName</name>
<value>root</value>
<description>Username to use against metastore database</description>
</property>
<property>
<name>javax.jdo.option.ConnectionPassword</name>
<value>123456</value>
<description>password to use against metastore database</description>
</property>
6、初始化db(hive2.1之后)
进入/usr/local/wuliu/hive/hive/bin
hive元数据库初始化
schematool -initSchema -dbType mysql(或schematool -dbtype mysql -initSchema)
(注意:初始化完成后数据库hive下面会生成很多表55张)
查看初始化后信息
7、进入/usr/local/wuliu/hive/hive/bin
show databases;
use default;
8、创建表
create table t_user(id int,username string, password string)row format delimited fields terminated by '\t' lines terminated by '\n';
(导入数据表的数据格式是:字段之间是tab键分割,行之间是断行)
Hadoop出现
从本地文件系统中加载数据:
load data local inpath "/usr/local/wuliu/hive/sql/t_user.txt"overwrite into table t_user;
//从hdfs中加载数据
Load data inpath “/usr/local/wuliu/hive/student.txt” into table student;
2 admin2 123456
mysql数据库设置
1、创建hive database
2、alter database hive character set latin1;
3、set global binlog_format=’MIXED’;
=================================================异常===========================================================
1、出现(org.apache.hadoop.security.authorize.AuthorizationException): User: root is not allowed to impersonate root),配置下面的内容重新启动hadoop
<property>
<name>hadoop.proxyuser.root.hosts</name>
<value>*</value>
</property>
<property>
<name>hadoop.proxyuser.root.groups</name>
<value>*</value>
</property>
进入/usr/local/wl/hive/hive/bin查看修改之后的结果
hive --service hiveserver2
./beeline -u 'jdbc:hive2://localhost:10000/default' -n root
2、drop table t_test;
出现: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:For direct MetaStore DB connections, we don't support retries at the client level.)
将mysql 需要的jar用
2、拷贝到/usr/local/wl/hive目录下进行解压并重新命名hive
拷贝mysql-connector-java-5.1.8-bin.jar(下面删除表出现问题需要换成mysql-connector-java-5.1.34.jar)到/usr/local/wl/hive/hive/lib下
cp /usr/local/wl/hive/hive/conf/hive-default.xml.template /usr/local/wl/hive/hive/conf/hive-site.xml
3、配置环境变量
vi /etc/profile
export HIVE_HOME=/usr/local/wl/hive/hive
export PATH=$PATH:$HIVE_HOME/bin
source /etc/profile
4、修改hive-site.xml相关内容:
${system:java.io.tmpdir}->全部替换成->/usr/local/wl/hive/tmp(新建/usr/local/wuliu/hive/tmp/root目录)
${system:user.name}->全部替换成->root
<property>
<name>hive.metastore.warehouse.dir</name>
<value>/user/hive/warehouse</value><!-- Hadoop服务器会出现此文件夹-->
<description>location of default database for the warehouse</description>
5、修改mysql配置
<property>
<name>javax.jdo.option.ConnectionURL</name>
<value>jdbc:mysql://123.206.26.35:3306/hive?createDatabaseIfNotExist=true</value>
<description>JDBC connect string for a JDBC metastore</description>
</property>
<property>
<name>javax.jdo.option.ConnectionDriverName</name>
<value>com.mysql.jdbc.Driver</value>
<description>Driver class name for a JDBC metastore</description>
</property>
<property>
<name>javax.jdo.option.ConnectionUserName</name>
<value>root</value>
<description>Username to use against metastore database</description>
</property>
<property>
<name>javax.jdo.option.ConnectionPassword</name>
<value>123456</value>
<description>password to use against metastore database</description>
</property>
6、初始化db(hive2.1之后)
进入/usr/local/wuliu/hive/hive/bin
hive元数据库初始化
schematool -initSchema -dbType mysql(或schematool -dbtype mysql -initSchema)
(注意:初始化完成后数据库hive下面会生成很多表55张)
查看初始化后信息
7、进入/usr/local/wuliu/hive/hive/bin
show databases;
use default;
8、创建表
create table t_user(id int,username string, password string)row format delimited fields terminated by '\t' lines terminated by '\n';
(导入数据表的数据格式是:字段之间是tab键分割,行之间是断行)
Hadoop出现
从本地文件系统中加载数据:
load data local inpath "/usr/local/wuliu/hive/sql/t_user.txt"overwrite into table t_user;
//从hdfs中加载数据
Load data inpath “/usr/local/wuliu/hive/student.txt” into table student;
t_user.txt文件内容:(特别注意中间空格用\t)
1 admin1 1234562 admin2 123456
mysql数据库设置
1、创建hive database
2、alter database hive character set latin1;
3、set global binlog_format=’MIXED’;
=================================================异常===========================================================
1、出现(org.apache.hadoop.security.authorize.AuthorizationException): User: root is not allowed to impersonate root),配置下面的内容重新启动hadoop<property>
<name>hadoop.proxyuser.root.hosts</name>
<value>*</value>
</property>
<property>
<name>hadoop.proxyuser.root.groups</name>
<value>*</value>
</property>
进入/usr/local/wl/hive/hive/bin查看修改之后的结果
hive --service hiveserver2
./beeline -u 'jdbc:hive2://localhost:10000/default' -n root
2、drop table t_test;
出现: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:For direct MetaStore DB connections, we don't support retries at the client level.)
将mysql 需要的jar用
mysql-connector-java-5.1.34.jar
相关文章推荐
- 安装mysql 5.7.11(原创)
- Mysql经纬度查询
- 修改MySQL 5.7.9版本的root密码方法以及一些新变化整理
- mysql HA-keepalived
- mysql数据类型
- mysql数据类型
- MySQL压测工具mysqlslap的介绍与使用
- Mysql-proxy
- 【Mysql】Mysql对记录的操作
- mysql触发器简单实例
- MySQL主从复制(Master-Slave)与读写分离(MySQL-Proxy)实践
- MySQL支持emoji图标存储
- 转!!mysql order by 中文排序
- mysql导入excel表格数据时出错的解决
- Mysql主从备份、主主备份
- mysql 5.7.15 安装配置方法图文教程
- Mysql在Ubuntu上面彻底删除与安装
- MySQL 一些查询语句及技巧
- mysql使用技巧
- MySQL5.6多实例部署