java.lang.ClassNotFoundException: org.apache.hadoop.hive.hbase.HBaseSplit
2016-07-13 17:23
946 查看
hive关联hbase表,使用select count(*) from tablename报如下异常:
问题原因:
1.hive hive.aux.jars.path三个jar包不准确file:///形式
2.hbase hbase.zookeeper.quorum没有配置完整,按注释说根据HBASE_MANAGES_ZK来启用自带还是外部的zookeeper,测试证明HBASE_MANAGES_ZK设false时该配置也是起作用的,所有必须配全。
java.io.IOException: Cannot create an instance of InputSplit class = org.apache.hadoop.hive.hbase.HBaseSplit:org.apache.hadoop.hive.hbase.HBaseSplit at org.apache.hadoop.hive.ql.io.HiveInputFormat$HiveInputSplit.readFields(HiveInputFormat.java:146) at org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:67) at org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:40) at org.apache.hadoop.mapred.MapTask.getSplitDetails(MapTask.java:396) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:412) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372) at org.apache.hadoop.mapred.Child$4.run(Child.java:255) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121) at org.apache.hadoop.mapred.Child.main(Child.java:249) Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.hbase.HBaseSplit at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:247) at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:820) at org.apache.hadoop.hive.ql.io.HiveInputFormat$HiveInputSplit.readFields(HiveInputFormat.java:143) ... 9 more
问题原因:
1.hive hive.aux.jars.path三个jar包不准确file:///形式
2.hbase hbase.zookeeper.quorum没有配置完整,按注释说根据HBASE_MANAGES_ZK来启用自带还是外部的zookeeper,测试证明HBASE_MANAGES_ZK设false时该配置也是起作用的,所有必须配全。
相关文章推荐
- apache commons fileupload 依赖信息(2016-07-01更新)
- org.apache.struts.action.InvalidCancelException异常解决方法
- Windows端Apache的域名映射
- apache安装及配置
- How To Set Up Apache Virtual Hosts on Ubuntu 14.04 LTS
- 使用VisualSVN 钩子脚本,同步到web应用目录
- apache commons fileupload checkstyle报告(2016-07-01更新)
- Linux/CentOS 服务安装/卸载,开机启动chkconfig命令详解|如何让MySQL、Apache开机启动?
- centos apache PHP mkdir: Permission denied problem
- 记一次神奇的优化过程:Java反射 VS Apache BeanUtils VS Spring BeanUtils
- Apache限制某个目录下的PHP文件没有执行权限
- apache commons fileupload JDepend报告(2016-07-01更新)
- Mac平台Apache服务器配置&开启PHP
- Error: org.apache.hadoop.mapreduce.task.reduce.Shuffle$ShuffleError: error in shuffle in fetcher#2
- 企业应用纯svn与apache+svn配置整理
- rrdtool结合apache展现
- Apache日志Shell分析
- apache日志切割
- Linux Apache Wed
- Linux Apache Wed