hadoop错误INFO ipc.Client Retrying connect to server
2019-05-08 18:19
1246 查看
问题
- 今天在测试环境上跑任务的时候遇到了这个问题,找遍了网上的文章,都是让改配置文件的,比如这一个 Retrying connect to server ,但是在测试环境上我没有权限改配置文件,所以也就没有测试
解决方案
- 之前的运行语句和jar包都是可以正常跑出结果的,这次也是在之前的jar包基础上做了一些修改,为什么就不能跑了呢?
- 之后用控制变量法测试了很多参数,发现之前的跑的数据比这次小,之前5.4T,这次16T,于是将这次的数据分批次跑,减少一次跑的数据量,成功运行
总结
- 出现这个错误的原因是数据量太大,导致hadoop出现连接错误
- 改配置文件的方法没有试过,因为没有权限
- 我的解决方案是写了个脚本分批次跑数据,减少一次跑的数据量
相关文章推荐
- hadoop错误INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1
- hadoop HA模式重新格式化出现错误:INFO ipc.Client: Retrying connect to server:***:8485. Already
- hadoop中 INFO ipc.Client: Retrying connect to server错误解决办法
- hadoop错误INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1
- hadoop 异常 INFO ipc.Client: Retrying connect to server:
- hadoop数据节点通信异常【启动hadoop集群遇到错误org.apache.hadoop.ipc.Client: Retrying connect to server】
- hadoop无法启动 INFO ipc.Client: Retrying connect to server
- Hadoop HA HDFS启动错误之org.apache.hadoop.ipc.Client: Retrying connect to server问题解决
- hadoop INFO ipc.Client: Retrying connect to server: master/192.168.0.45:54310. Already tried 0 time
- Hadoop— ipc.Client: Retrying connect to server: localhost/127.0.0.1:8020. Already tried 5 time(s).
- application master 持续org.apache.hadoop.ipc.Client: Retrying connect to server
- org.apache.hadoop.ipc.Client: Retrying connect to server异常的解决
- INFO ipc.Client: Retrying connect to server: dn79/10.10.10.79:18080
- org.apache.hadoop.ipc.Client - Retrying connect to server: 0.0.0.0/0.0.0.0:10020. Already tried 0 ti
- org.apache.hadoop.ipc.Client: Retrying connect to server异常的解决
- [sqoop][mysql导入到hadoop]ipc.Client: Retrying connect to server: spark002/10.211.55.12:60587. Already
- org.apache.hadoop.ipc.Client: Retrying connect to server
- org.apache.hadoop.ipc.Client: Retrying connect to server异常的解决
- org.apache.hadoop.ipc.Client: Retrying connect to server: localhost/127.0.0.1:7359. Already tried 7
- org.apache.hadoop.ipc.Client: Retrying connect to server