您的位置:首页 > 编程语言 > Java开发

用Eclipse对Hadoop文件进行压缩和解压缩编译过程中遇到的问题

2014-04-24 22:07 489 查看
这是解压过程的代码

import java.io.*;

import org.apache.hadoop.conf.Configuration;
import org.apache.hadoop.fs.Path;
import org.apache.hadoop.io.IOUtils;
import org.apache.hadoop.io.compress.*;

public class TestDecompression {

public static void main(String[] args) throws FileNotFoundException, IOException {
String file = "/home/hadoop/zlib.tar.gz";
Configuration conf = new Configuration();
CompressionCodecFactory codecFactory = new CompressionCodecFactory(conf);
CompressionCodec codec = codecFactory.getCodec(new Path(file));
CompressionInputStream in = codec.createInputStream(new FileInputStream(new File(file)));
FileOutputStream out = new FileOutputStream(new File(codecFactory.removeSuffix(file, codec.getDefaultExtension())));
IOUtils.copyBytes(in, out, 4096);
in.close();
out.close();
}

}


运行时出现下列错误

14/04/24 22:00:59 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

原因是因为没有找到native库,需要在运行配置中配置native的路径。解决方法是右键Run As->Run Configurations->Arguments->VM arguments中写入libhadoop.so和libSnappy.so的路径即可。

-Djava.library.path=/home/hadoop/hadoop-1.2.1/lib/native/Linux-amd64-64:/usr/local/lib
内容来自用户分享和网络整理,不保证内容的准确性,如有侵权内容,可联系管理员处理 点击这里给我发消息
标签: