您的位置:首页 > 其它

Reduce运行到99.99%到100%,最后出现了错误,导致任务失败

2017-08-04 07:56 2376 查看
Error: java.io.IOException: Failing write. Tried pipeline recovery 5 times without success.

at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.processDatanodeError(DFSOutputStream.java:1113)

at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:622)

attempt_1501681898109_0016_r_000006_0 100.00FAILED
reduce > reducehadoopserver04:8042
logs

Thu Aug 3 12:44:22 +0800 2017 Thu Aug 3 18:31:01 +0800 20175hrs, 46mins, 39sec

Error: java.io.IOException: Failing write. Tried pipeline recovery 5 times without success.

at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.processDatanodeError(DFSOutputStream.java:1113)

at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:622)

attempt_1501681898109_0016_r_000015_0 100.00FAILED
reduce > reducehadoopserver13:8042
logs

Thu Aug 3 12:44:29 +0800 2017 Thu Aug 3 18:29:31 +0800 20175hrs, 45mins, 1sec

Error: java.io.IOException: Failing write. Tried pipeline recovery 5 times without success.

at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.processDatanodeError(DFSOutputStream.java:1113)

at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:622)

attempt_1501681898109_0016_r_000019_0 100.00FAILED
reduce > reducehadoopserver13:8042
logs

Thu Aug 3 12:44:31 +0800 2017 Thu Aug 3 18:31:20 +0800 20175hrs, 46mins, 49sec

Error: java.io.IOException: Failing write. Tried pipeline recovery 5 times without success.

at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.processDatanodeError(DFSOutputStream.java:1113)

at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:622)

attempt_1501681898109_0016_r_000032_0 100.00FAILED
reduce > reducehadoopserver07:8042
logs

Thu Aug 3 12:45:18 +0800 2017 Thu Aug 3 18:15:00 +0800 20175hrs, 29mins, 41sec

Error: java.io.IOException: Failing write. Tried pipeline recovery 5 times without success. a

Mmeory CPU--IO

why???
内容来自用户分享和网络整理,不保证内容的准确性,如有侵权内容,可联系管理员处理 点击这里给我发消息
标签: 
相关文章推荐