sqoop把mysql数据导入hive中,报错:java.lang.NullPointerException at org.json.JSONObject.
2018-02-09 09:28
856 查看
在大数据环境中,使用sqoop导入mysql数据到hive中,报错,如下
解决办法:
这是因为sqoop缺少java-json.jar包.
下载java-json.jar包:
http://www.java2s.com/Code/Jar/j/Downloadjavajsonjar.htm
把java-json.jar添加到../sqoop/lib目录:
还有其他问题
问题2:root用户写入HDFS文件错误 "Permission denied: user=root"
解决办法:
因为在使用sqoop导入HDFS文件时,使用的是root用户,没有写hdfs文件的权限。
CDH安装时创建了hdfs用户,应使用hdfs用户登录,再时行sqoop导入
[root@hadoop1 ~]# su - hdfs
[hdfs@hadoop1 ~]$ pwd
/var/lib/hadoop-hdfs
[hdfs@hadoop1 ~]$ ls
问题3:其它hadoop节点不连接MySql "is not allowed to connect to this MySQL server"
解决办法:
这是因为客户端没有访问mysql的权限,修改sqoop用户的客户端访问权限。
--登录mysql服务器
[root@hadoop2 ~]# mysql -uroot -proot
mysql> grant all privileges on *.* to 'sqoop'@'%' identified by 'sqoop' with grant option;
Query OK, 0 rows affected (0.00 sec)
解决办法:
这是因为sqoop缺少java-json.jar包.
下载java-json.jar包:
http://www.java2s.com/Code/Jar/j/Downloadjavajsonjar.htm
把java-json.jar添加到../sqoop/lib目录:
还有其他问题
问题2:root用户写入HDFS文件错误 "Permission denied: user=root"
解决办法:
因为在使用sqoop导入HDFS文件时,使用的是root用户,没有写hdfs文件的权限。
CDH安装时创建了hdfs用户,应使用hdfs用户登录,再时行sqoop导入
[root@hadoop1 ~]# su - hdfs
[hdfs@hadoop1 ~]$ pwd
/var/lib/hadoop-hdfs
[hdfs@hadoop1 ~]$ ls
问题3:其它hadoop节点不连接MySql "is not allowed to connect to this MySQL server"
解决办法:
这是因为客户端没有访问mysql的权限,修改sqoop用户的客户端访问权限。
--登录mysql服务器
[root@hadoop2 ~]# mysql -uroot -proot
mysql> grant all privileges on *.* to 'sqoop'@'%' identified by 'sqoop' with grant option;
Query OK, 0 rows affected (0.00 sec)
相关文章推荐
- sqoop导入mysql到HDFS时报错:java.lang.NoClassDefFoundError: org/json/JSONObject
- spark 从HIVE读数据导入hbase中发生空指针(java.lang.NullPointerException)问题的解决
- java.lang.NullPointerException at org.apache.struts.action.ActionServlet.parseModuleConfigFile(Actio
- java.lang.NullPointerException at org.apache.jsp.**_jsp.jspInit(index_jsp.java)异常 解决方案
- java.lang.NullPointerException at org.apache.jsp.index_jsp._jspInit(index_jsp.ja
- java.lang.NullPointerException at org.apache.jsp.index_jsp._jspInit(index_jsp.java:22)
- java.lang.NullPointerException-net.sf.json.JSONObject.defaultBeanProcessing(JSONObject.java:749)
- java.lang.NullPointerException at org.apache.jsp.index_jsp._jspInit
- java.lang.NullPointerException at org.apache.jsp.**_jsp.jspInit(**_jsp.java)tomcat启动异常解决方法
- java.lang.NullPointerException at org.hibernate.tuple.AbstractEntityTuplizer.createProxy(AbstractEn
- java.lang.NullPointerException at org.hibernate.type.LongType.next(LongType.java
- java.lang.NullPointerException at org.apache.jsp.index_jsp._jspInit
- java.lang.NullPointerException at org.apache.jsp.index_jsp._jspInit(index_jsp.java:22)
- java.lang.NullPointerException at org.apache.jsp.index_jsp._jspInit(index_jsp.ja
- java.lang.NullPointerException at org.apache.jsp.index_jsp._jspInit(index_jsp.java:23)
- java.lang.NullPointerException at org.apache.jsp.***_jsp._jspInit(***_jsp.java:22)
- java.lang.NullPointerException at org.apache.jsp.index_jsp._jspInit(index_jsp.java)
- gson转JSON数据 报错java.lang.NullPointerException的解决方法
- java.lang.NullPointerException at org.apache.jsp.index_jsp._jspInit(index_jsp.java:23)
- Hibernate HQL view join: java.lang.NullPointerException at org.hibernate.util.ReflectHelper.getConst