azkaban做mr调度时报错 Call From SparkMaster/192.168.237.128 to 0.0.0.0:10020 failed on connection except
2018-02-12 11:06
477 查看
做点击流项目时,数据清洗后生成pageviews模型和visit模型,需要运行两次mr程序,所以在azkaban中把他俩作为一个job提交,先运行生成pv的mr程序,再去运行生成visit的mr程序(job中添加depandence依赖关系),但是在生成pv时,查看azkaban的web界面中flow的details,发现报错(虽然报错但是生成pv的mr程序运行结果是对的,但是因为前一个任务报错,azkaban会认为执行失败,而没办法去执行下一个任务visit,所以要这个错误解决。也可以把生成pv和visit分成两个job提交给azkaban。):
原因是需要访问hadoop的historyserver,而hadoop的historyserver服务没有启动,所以将其启动即可:在namenode上执行命令:mr-jobhistory-daemon.sh start historyserver 历史服务器 用于记录hadoop运行的日志信息
还有,azkaban经常出现各种bug,有时页面刷新不出来,运行时卡顿啊。。。。。但是不影响运行结果。。。
原因是需要访问hadoop的historyserver,而hadoop的historyserver服务没有启动,所以将其启动即可:在namenode上执行命令:mr-jobhistory-daemon.sh start historyserver 历史服务器 用于记录hadoop运行的日志信息
还有,azkaban经常出现各种bug,有时页面刷新不出来,运行时卡顿啊。。。。。但是不影响运行结果。。。
相关文章推荐
- Call From SparkMaster/192.168.237.128 to 0.0.0.0:10020 failed on connection exception
- Call From s150/192.168.109.150 to 0.0.0.0:10020 failed on connection exception:
- sqoop导入MySQL数据出现Call From hadoop/172.16.59.90 to hadoop:10020 failed on connection exception: java.n
- Call From master/192.168.128.135 to master:8485 failed on connection exception: java.net.ConnectExce
- Caused by: java.net.ConnectException: Call From master/192.168.199.130 to master:9000 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.
- ubuntu上运行eclipse出现 Call From master to localhost:9000 failed on connection exception
- Call From master.hadoop/192.168.31.149 to master.hadoop:8020 failed on connection exception: java.ne
- Call From master/192.168.128.135 to master:8485 failed on connection exception: java.net.ConnectException: Connection refused
- Call From master/192.168.170.128 to master:8020 failed on connection exception: java.net.ConnectExce
- java.net.ConnectException: Call From localhost/127.0.0.1 to localhost:8020 failed on connection
- hadoop安装后运行出现Call to localhost/127.0.0.1:9000 failed on connection exception: java.net.ConnectExcept
- hadoop 遇到java.net.ConnectException: to 0.0.0.0:10020 failed on connection
- Call to master/192.168.137.101:9001 failed on connection exception: java.net.ConnectException: Connection refused
- Call to master/*:9000 failed on connection exception: java.net.ConnectException: Conne 错误解决
- hadoop 遇到java.net.ConnectException: to 0.0.0.0:10020 failed on connection
- 异常解决:java.net.ConnectException: Call To Master/127.0.0.1:9000 failed on connection exception
- Call From ubuntu/127.0.1.1 to localhost:8020 failed on connection exception
- Call From hostname/169.168.1.12 to cm:9000 failed on connection exception 解决方法
- hadoop 运行过程中出现Call to localhost/127.0.0.1:9000 failed on connection exception错误。
- java.net.ConnectException: Call From db96/192.168.8.96 to db96:49002 failed on connection exception: