spark单机部署问题
2016-04-07 21:38
344 查看
spark单机部署问题
(2015-02-27 15:39:33)转载▼
标签:
| 分类: spark |
15/02/27 16:14:36 INFO Remoting: Starting remoting
15/02/27 16:14:36 ERROR NettyTransport: failed to bind to bt-199-037.bta.net.cn/202.106.199.37:0, shutting down Netty
transport
15/02/27 16:14:36 WARN Utils: Service 'sparkDriver' could not bind on port 0. Attempting port 1.
15/02/27 16:14:36 INFO RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon.
15/02/27 16:14:36 INFO RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing
remote transports.
15/02/27 16:14:36 INFO RemoteActorRefProvider$RemotingTerminator: Remoting shut down.
15/02/27 16:14:36 INFO Slf4jLogger: Slf4jLogger started
15/02/27 16:14:36 INFO Remoting: Starting remoting
15/02/27 16:14:36 ERROR NettyTransport: failed to bind to bt-199-037.bta.net.cn/202.106.199.37:0, shutting down Netty
transport
Exception in thread "main" java.net.BindException: Failed to bind to: bt-199-037.bta.net.cn/202.106.199.37:0: Service
'sparkDriver' failed after 16 retries!
at org.jboss.netty.bootstrap.ServerBootstrap.bind(ServerBootstrap.java:272)
at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:393)
。。。
处理方法
从现象来看应该akka不能绑定到ip或者端口,从http://mail-archives.apache.org/mod_mbox/spark-user/201402.mbox/<9A13072E9AA64A9B846FACA846FCA7C8@gmail.com>中找到方法。
spark-env.sh中添加配置:
export SPARK_MASTER_IP=127.0.0.1
export SPARK_LOCAL_IP=127.0.0.1
相关文章推荐
- zepto.1.1.6.js源码中的each方法学习笔记
- Eclipse中使用git管理代码
- java日期处理类
- LeetCode(33)-Pascal's Triangle II
- java单例设计模式
- SVN错误处理方法
- LeetCode(33)-Pascal's Triangle II
- LeetCode(33)-Pascal's Triangle II
- POJ1659 Frogs' Neighborhood
- Program2_1008
- jq获取鼠标位置
- 对话框
- 解决gradle project sync failed.Basic functionality(e.g.editing,debugging) will not work properly
- JAVA集合(一)
- Python抓取电影天堂电影信息的代码
- 关于C语言的问卷调查
- 【BZOJ 1016】【JSOI 2008】最小生成树计数
- SICP(二):过程抽象
- WebSocket ——多人实时聊天
- DPDK与Socket区别