hadoop异常处理之exceeds the limit of concurrent xcievers 256
2014-02-22 15:20
471 查看
异常描述
java.io.IOException: xceiverCount 258 exceeds the limit of concurrent xcievers 256
at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:165)
查看datanode日志存在*:50010:DataXceiver error processing WRITE_BLOCK operation src
异常分析
文件操作超租期，实际上就是data stream操作过程中文件被删掉了。之前也遇到过，通常是因为Mapred多个task操作同一个文件，一个task完成后删掉文件导致。
不过这次在hdfs上传文件时发生了这个异常，导致上传失败
解决方案
修改hdfs-site.xml
<property>
<name>dfs.datanode.max.xcievers</name>
<value>8192</value>
</property>
拷贝到各datanode节点并重启datanode即可
java.io.IOException: xceiverCount 258 exceeds the limit of concurrent xcievers 256
at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:165)
查看datanode日志存在*:50010:DataXceiver error processing WRITE_BLOCK operation src
异常分析
文件操作超租期，实际上就是data stream操作过程中文件被删掉了。之前也遇到过，通常是因为Mapred多个task操作同一个文件，一个task完成后删掉文件导致。
不过这次在hdfs上传文件时发生了这个异常，导致上传失败
解决方案
修改hdfs-site.xml
<property>
<name>dfs.datanode.max.xcievers</name>
<value>8192</value>
</property>
拷贝到各datanode节点并重启datanode即可
内容来自用户分享和网络整理，不保证内容的准确性，如有侵权内容，可联系管理员处理 
相关文章推荐
- hadoop报错导致flume无法写入日志文件，hadoop报错如下xceiverCount 258 exceeds the limit of concurrent xcievers 256
- hadoop之 exceeds the limit of concurrent xcievers处理
- hadoop之 exceeds the limit of concurrent xcievers处理
- hadoop java.io.IOException: Xceiver count 4097 exceeds the limit of concurrent xcievers
- xceiverCount 258 exceeds the limit of concurrent xcievers 256
- 【OpenCV学习笔记】【异常处理】一（The Matrix is not continuous, thus its number of rows can not be changed）
- 处理The content of the adapter has changed but ListView did not receive a notification异常
- hadoop1安全异常：The ratio of reported blocks 1.0000 has reached the threshold 0.9990.
- 处理The content of the adapter has changed but ListView did not receive a notification异常
- 异常：java.sql.SQLException: The total number of locks exceeds the lock table size
- .net连接DB2的异常SQL0666 - SQL query exceeds specified time limit or storage limit.错误处理
- exchange2013警告The maximum number of concurrent connections has exceeded a limit
- android 内存溢出处理办法（出现java.lang.OutOfMemoryError: bitmap size exceeds VM budget 异常）
- 处理The content of the adapter has changed but ListView did not receive a notification异常
- 处理The content of the adapter has changed but ListView did not receive a notification异常
- Guru of the Week 条款08：GotW挑战篇——异常处理的安全性
- ORA-27092: size of file exceeds file size limit of the process
- Kylin启动异常:java.lang.outofMemoryError:Requested array size exceeds VM limit
- 处理The content of the adapter has changed but ListView did not receive a notification异常
- Sybase的查询Group by 中的 This exceeds the maximum allowable limit of 600解决方案