您的位置:首页 > 运维架构 > Apache

FAILED: Error in metadata: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.

2015-10-04 08:50 1101 查看
安装配置Hive时报错:

FAILED: Error in metadata: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient

FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask

用调试模式报错如下:

[root@hadoop1 bin]# hive -hiveconf hive.root.logger=DEBUG,console

13/10/09 16:16:27 DEBUG common.LogUtils: Using hive-site.xml found on CLASSPATH at /opt/hive-0.11.0/conf/hive-site.xml

13/10/09 16:16:27 DEBUG conf.Configuration: java.io.IOException: config()

at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:227)

at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:214)

at org.apache.hadoop.hive.conf.HiveConf.<init>(HiveConf.java:1039)

at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:636)

at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

at java.lang.reflect.Method.invoke(Method.java:597)

at org.apache.hadoop.util.RunJar.main(RunJar.java:156)

13/10/09 16:16:27 DEBUG conf.Configuration: java.io.IOException: config()

at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:227)

at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:214)

at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:330)

at org.apache.hadoop.hive.conf.HiveConf.initialize(HiveConf.java:1073)

at org.apache.hadoop.hive.conf.HiveConf.<init>(HiveConf.java:1040)

at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:636)

at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

at java.lang.reflect.Method.invoke(Method.java:597)

at org.apache.hadoop.util.RunJar.main(RunJar.java:156)

Logging initialized using configuration in file:/opt/hive-0.11.0/conf/hive-log4j.properties

13/10/09 16:16:27 INFO SessionState:

Logging initialized using configuration in file:/opt/hive-0.11.0/conf/hive-log4j.properties

13/10/09 16:16:27 DEBUG parse.VariableSubstitution: Substitution is on: hive

Hive history file=/tmp/root/hive_job_log_root_4666@hadoop1_201310091616_1069706211.txt

13/10/09 16:16:27 INFO exec.HiveHistory: Hive history file=/tmp/root/hive_job_log_root_4666@hadoop1_201310091616_1069706211.txt

13/10/09 16:16:27 DEBUG conf.Configuration: java.io.IOException: config()

at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:227)

at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:214)

at org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:187)

at org.apache.hadoop.security.UserGroupInformation.isSecurityEnabled(UserGroupInformation.java:239)

at org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:438)

at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:424)

at org.apache.hadoop.hive.shims.HadoopShimsSecure.getUGIForConf(HadoopShimsSecure.java:491)

at org.apache.hadoop.hive.ql.security.HadoopDefaultAuthenticator.setConf(HadoopDefaultAuthenticator.java:51)

at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:62)

at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)

at org.apache.hadoop.hive.ql.metadata.HiveUtils.getAuthenticator(HiveUtils.java:365)

at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:270)

at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:670)

at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

at java.lang.reflect.Method.invoke(Method.java:597)

at org.apache.hadoop.util.RunJar.main(RunJar.java:156)

13/10/09 16:16:27 DEBUG security.Groups: Creating new Groups object

13/10/09 16:16:27 DEBUG security.Groups: Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping; cacheTimeout=300000

13/10/09 16:16:27 DEBUG security.UserGroupInformation: hadoop login

13/10/09 16:16:27 DEBUG security.UserGroupInformation: hadoop login commit

13/10/09 16:16:27 DEBUG security.UserGroupInformation: using local user:UnixPrincipal锛?root

13/10/09 16:16:27 DEBUG security.UserGroupInformation: UGI loginUser:root

13/10/09 16:16:27 DEBUG security.Groups: Returning fetched groups for 'root'

13/10/09 16:16:27 DEBUG security.Groups: Returning cached groups for 'root'

13/10/09 16:16:27 DEBUG conf.Configuration: java.io.IOException: config(config)

at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:260)

at org.apache.hadoop.hive.conf.HiveConf.<init>(HiveConf.java:1044)

at org.apache.hadoop.hive.ql.security.authorization.DefaultHiveAuthorizationProvider.init(DefaultHiveAuthorizationProvider.java:30)

at org.apache.hadoop.hive.ql.security.authorization.HiveAuthorizationProviderBase.setConf(HiveAuthorizationProviderBase.java:108)

at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:62)

at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)

at org.apache.hadoop.hive.ql.metadata.HiveUtils.getAuthorizeProviderManager(HiveUtils.java:339)

at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:272)

at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:670)

at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

at java.lang.reflect.Method.invoke(Method.java:597)

at org.apache.hadoop.util.RunJar.main(RunJar.java:156)

13/10/09 16:16:27 DEBUG conf.Configuration: java.io.IOException: config()

at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:227)

at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:214)

at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:330)

at org.apache.hadoop.hive.conf.HiveConf.initialize(HiveConf.java:1073)

at org.apache.hadoop.hive.conf.HiveConf.<init>(HiveConf.java:1045)

at org.apache.hadoop.hive.ql.security.authorization.DefaultHiveAuthorizationProvider.init(DefaultHiveAuthorizationProvider.java:30)

at org.apache.hadoop.hive.ql.security.authorization.HiveAuthorizationProviderBase.setConf(HiveAuthorizationProviderBase.java:108)

at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:62)

at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)

at org.apache.hadoop.hive.ql.metadata.HiveUtils.getAuthorizeProviderManager(HiveUtils.java:339)

at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:272)

at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:670)

at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

at java.lang.reflect.Method.invoke(Method.java:597)

at org.apache.hadoop.util.RunJar.main(RunJar.java:156)

更多0分享到:
相关主题推荐: logging object 调试 login 91
相关帖子推荐:

hive 或者 impala分页
新手求问,hadoop集群中,master节点上会跑map/reduce任务吗
hadoop遇到从节点没运行起来
用sqoop从hive向mysql中导入数据时报错,求解
Nutch1.8 + Hadoop2.3.0 在 inject 时出现 java.lang.IllegalArgumentException: Wrong FS
MapReduce中Partition问题
请教sqoop1.99.3将Oracle导入HDFS
wordcount程序在linux系统上运行成功,在windows上运行失败

对我有用[0] 丢个板砖[0] 引用 | 举报 | 管理
回复次数:11


关注s060403072

s060403072等级:


#1 得分:0回复于: 2013-10-09 17:08:41
这个错误应该是你集成了mysql,从而报错。解决方法是修改hive-site.xml,参照:

<property>

<name>javax.jdo.option.ConnectionURL</name>

<value>jdbc:mysql://192.168.1.101:3306/hive?createDatabaseIfNotExist=true</value>

<description>JDBC connect string for a JDBC metastore</description>

</property>


也可参考:http://write.blog.csdn.net/postlist
对我有用[0] 丢个板砖[0] 引用 | 举报 | 管理

jxlhc09jxlhc09等级:


#2 得分:0回复于: 2013-10-09 18:05:12

引用 1 楼 s060403072 的回复:
这个错误应该是你集成了mysql,从而报错。解决方法是修改hive-site.xml,参照:

<property>

<name>javax.jdo.option.ConnectionURL</name>

<value>jdbc:mysql://192.168.1.101:3306/hive?createDatabaseIfNotExist=true</value>

<description>JDBC connect string for a JDBC metastore</description>

</property>


也可参考:http://write.blog.csdn.net/postlist

嗯 +1 看错误应该是元数据库配置有问题。
对我有用[0] 丢个板砖[0] 引用 | 举报 | 管理



关注bbbbb001bbbbb001等级:


#3 得分:0回复于: 2013-10-09 18:10:32
hite-site.xml已经配置过了,如下:

<property>

<name>hive.metastore.warehouse.dir</name>

<value>/user/hive/warehouse</value>

<description>locationof default database for the warehouse</description>

</property>

<property>

<name>hive.exec.scratchdir</name>

<value>/usr/hive/temp</value>

<description>Scratchspace for Hive jobs</description>

</property>

<property>

<name>javax.jdo.option.ConnectionURL</name>

<value>jdbc:mysql://hadoop4:3306/hive?characterEncoding=UTF-8</value>

</property>

<property>

<name>javax.jdo.option.ConnectionDriverName</name>

<value>com.mysql.jdbc.Driver</value>

</property>

<property>

<name>javax.jdo.option.ConnectionUserName</name>

<value>hive</value>

</property>

<property>

<name>javax.jdo.option.ConnectionPassword</name>

<value>password</value>

</property>
对我有用[0] 丢个板砖[0] 引用 | 举报 | 管理



关注zuochanxiaoheshangzuochanxiaoheshang等级:


#4 得分:0回复于: 2013-10-09 22:59:27
检查一下MySQL的hive用户(avax.jdo.option.ConnectionUserName:hive)在Hive安装的机器的IP上是否有足够的权限。
对我有用[0] 丢个板砖[0] 引用 | 举报 | 管理



关注u011450470u011450470等级:


#5 得分:0回复于: 2014-03-25 21:19:02
我也遇到这个问题了 请问你是怎么解决的?
对我有用[0] 丢个板砖[0] 引用 | 举报 | 管理



关注mearermearer等级:


#6 得分:0回复于: 2014-03-26 10:13:23
我也遇到这个问题,搞了一天也没解决,求方法


对我有用[0] 丢个板砖[0] 引用 | 举报 | 管理



关注mearermearer等级:


#7 得分:0回复于: 2014-03-26 10:14:01
楼主,请问你解决这个问题了吗,能不能分享一下
对我有用[0] 丢个板砖[0] 引用 | 举报 | 管理



关注mearermearer等级:


#8 得分:0回复于: 2014-03-26 10:28:11

引用 5 楼 u011450470 的回复:
我也遇到这个问题了 请问你是怎么解决的?

我找到问题所在了,如果你登陆mysql的IP是locahost的话,那这里的配置应该修改为

<property> <name>javax.jdo.option.ConnectionURL</name> <value>jdbc:mysql://192.168.1.101:3306/hive?createDatabaseIfNotExist=true</value> <description>JDBC connect string for a JDBC metastore</description> </property>

把192.168.1.101改为localhost
对我有用[1] 丢个板砖[0] 引用 | 举报 | 管理



关注u013326971u013326971等级:


#9 得分:0回复于: 2014-05-14 22:15:25
楼主你好,我配置的hive创建了表,但是在show databases、show tables的时候出现以下异常:

FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient

我用调试模式报的异常是

14/05/14 19:34:54 DEBUG conf.Configuration: java.io.IOException: config()

at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:211)

at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:198)

at org.apache.hadoop.hive.conf.HiveConf.<init>(HiveConf.java:1091)

at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:636)

at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

14/05/14 19:34:54 DEBUG conf.Configuration: java.io.IOException: config()

at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:211)

at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:198)

at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:173)

at org.apache.hadoop.hive.conf.HiveConf.initialize(HiveConf.java:1125)

at org.apache.hadoop.hive.conf.HiveConf.<init>(HiveConf.java:1092)

at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:636)

at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

at java.lang.reflect.Method.invoke(Method.java:597)

at org.apache.hadoop.util.RunJar.main(RunJar.java:156)

Logging initialized using configuration in file:/opt/hive/conf/hive-log4j.properties

14/05/14 19:34:55 INFO SessionState:

Logging initialized using configuration in file:/opt/hive/conf/hive-log4j.properties

14/05/14 19:34:55 DEBUG parse.VariableSubstitution: Substitution is on: hive

14/05/14 19:34:55 DEBUG security.UserGroupInformation: Unix Login: root,root,bin,daemon,sys,adm,disk,wheel

14/05/14 19:34:55 DEBUG conf.Configuration: java.io.IOException: config(config)

at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:226)

at org.apache.hadoop.hive.conf.HiveConf.<init>(HiveConf.java:1096)

at org.apache.hadoop.hive.ql.security.authorization.DefaultHiveAuthorizationProvider.init(DefaultHiveAuthorizationProvider.java:30)

at org.apache.hadoop.hive.ql.security.authorization.HiveAuthorizationProviderBase.setConf(HiveAuthorizationProviderBase.java:112)

at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:62)

at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)

at org.apache.hadoop.hive.ql.metadata.HiveUtils.getAuthorizeProviderManager(HiveUtils.java:339)

at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:280)

at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:670)

at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

at java.lang.reflect.Method.invoke(Method.java:597)

at org.apache.hadoop.util.RunJar.main(RunJar.java:156)

14/05/14 19:34:55 DEBUG conf.Configuration: java.io.IOException: config()

at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:211)

at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:198)

at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:173)

at org.apache.hadoop.hive.conf.HiveConf.initialize(HiveConf.java:1125)

at org.apache.hadoop.hive.conf.HiveConf.<init>(HiveConf.java:1097)

at org.apache.hadoop.hive.ql.security.authorization.DefaultHiveAuthorizationProvider.init(DefaultHiveAuthorizationProvider.java:30)

at org.apache.hadoop.hive.ql.security.authorization.HiveAuthorizationProviderBase.setConf(HiveAuthorizationProviderBase.java:112)

at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:62)

at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)

at org.apache.hadoop.hive.ql.metadata.HiveUtils.getAuthorizeProviderManager(HiveUtils.java:339)

at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:280)

at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:670)

at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

at java.lang.reflect.Method.invoke(Method.java:597)

at org.apache.hadoop.util.RunJar.main(RunJar.java:156)

请楼主帮忙看一下,可能是什么原因造成的
对我有用[0] 丢个板砖[0] 引用 | 举报 | 管理



关注lyayfylyayfy等级:


#10 得分:0回复于: 2014-06-25 17:13:15
楼主,我报了同样的问题,想问你解决这个问题没有。!!!!
对我有用[0] 丢个板砖[0] 引用 | 举报 | 管理



关注tjytad1982tjytad1982等级:


#11 得分:0回复于: 2014-06-25 17:59:33
学习


内容来自用户分享和网络整理,不保证内容的准确性,如有侵权内容,可联系管理员处理 点击这里给我发消息
标签: