Hadoop put file 错误：fs.FSInputChecker: Found checksum error

Hadoop往hdfs上put file的时候，今天报错如下：

16/03/12 08:15:17 INFO fs.FSInputChecker: Found checksum error: b[0,                                                                                                   

10240]=3832393432392c302e303133343233360932333031363531312c302e303132393938340932343832393330342c302e303132363637320932343832323132332c302e3031323431363109323438333635

31372c302e303131363036310932333031363531322c302e303130363630370932343832393236342c302e30303933320932343832393330302c302e303039323531330932343832393238352c302e303039313

239350932343832393236382c302e303038373732390932343832393238322c302e3030383036340932343832393237312c302e303037333735370932343832393236372c302e30303731353337093234373839

3235342c302e303033383334370932343738393236322c302e303033343336330932343738393236392c302e303032383033360a3736373534310932343739373732362c302e303830373537390932343136373

732392c302e303636393737390932343831363636362c302e303530363436340932343834323733362c302e303433363435340932343831363436382c302e303334333334330932343832393330382c302e3032

35343833320932333031363531302c302e303233363530330932333031363530382c302e303139373833350932343832393432392c302e303136333435320932333031363531312c302e3031353335343309323

43833363531372c302e303134363435380932333031363531332c302e303134353837320932343832323132332c302e303133323434330932343832393330342c302e303132383139330932333031363531322c

302e3031323130350932343832393236342c302e303131343339340932343832393238352c302e303130313031360932343832393236372c302e303038373232370932343832393236382c302e3030383131313

40932343832393237312c302e303038303239360932343832393238322c302e303037393939350932343832393330302c302e30303734370932343738393235342c302e30303430383635093234373839323632

2c302e303033363332310932343738393236392c302e303033303438360a3736373730330932343739373732362c302e303733373837350932343136373732392c302e303630353336360932343831363636362

c302e303435323438340932343834323733362c302e303434383930310932343831363436382c302e303334323733370932333031363530382c302e303230373538320932333031363531302c302e3032303638

39310932343832393432392c302e303137333238390932343832393330382c302e3031363931330932333031363531312c302e303136343337330932333031363531322c302e303135353138350932333031363

531332c302e3031343131340932343832393330342c302e303132333134350932343832323132332c302e303039383334370932343833363531372c302e303039363834310932343832393236372c302e303039

3235320932343832393236382c302e303038383931350932343832393236342c302e3030383438310932343832393238322c302e3030383334350932343832393237312c302e303038313137360932343832393

238352c302e303037363133310932343832393330302c302e303037303134340932343738393235342c302e3030343435380932343738393236322c302e303033323534370932343738393236392c302e303033

303732330a3737333434350932343739373732362c302e313134323435360932343831363636362c302e303433393031360932343834323733362c302e3034323639380932343831363436382c302e303338313

0360932343832393330382c302e303334373935350932343832393330342c302e3032323631380932343832393432392c302e3032323334350932343832393236342c302e303137313430380932343832323132

332c302e303136373430330932343833363531372c302e3031363535360932343832393330302c302e303135383838340932343832393238352c302e303135363038310932343832393238322c302e303132313

231340932343832393236372c302e303131393538350932343832393236382c302e303131373934380932343832393237312c302e303130343639350932343738393235342c302e303035333435350932343738

393236322c302e303034373138330932343738393236392c302e303033333930340932343738303432382c302e303031353832310a3835373631330932343739373732362c302e3137303030350932343831363

436382c302e313336333039310932343834323733362c302e313230303030360932343831363636362c302e313135363339340932343832393330382c302e303439303738380932343832393432392c302e3034

30383236350932343832323132332c302e3033383735380932343832393330342c302e303336383737320932343833363531372c302e303333313837360932343832393238352c302e303234383434330932343

832393330302c302e303232323534320932343832393236382c302e303232313532390932343832393236372c302e303232303433310932343832393237312c302e303231393837390932343832393238322c30

2e303231373936340932343832393236342c302e303231343335330932343738393235342c302e303131363236320932343738393236322c302e303131333035360932343738393236392c302e3030393433383

90932343738303432382c302e303034343134370a3836343332370932343739373732362c302e313437343336310932343831363436382c302e313235373831330932343834323733362c302e30393636353836

0932343831363636362c302e303931323631380932343832393330382c302e3034393339330932343832393330342c302e303430333632370932343832393432392c302e3034303133303409323438323231323

查原因为：Hadoop在往hdfs上put file的时候，会进行校验。如果有对应的".XXXX.crc"文件，会与其进行比对校验。如果不对就会报上面这个错误。

crc文件是在getmerge文件夹的时候自动生成的，无参数可以关闭。

所以，修改了HadoopUtil，在put file之前check下crc文件是否存在，存在的话删掉。或者，使用不同的文件名。

参考：
http://www.cnblogs.com/gpcuster/archive/2011/01/26/1945363.html