用Eclipse对Hadoop文件进行压缩和解压缩编译过程中遇到的问题
2014-04-24 22:07
489 查看
这是解压过程的代码
运行时出现下列错误
14/04/24 22:00:59 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
原因是因为没有找到native库,需要在运行配置中配置native的路径。解决方法是右键Run As->Run Configurations->Arguments->VM arguments中写入libhadoop.so和libSnappy.so的路径即可。
import java.io.*; import org.apache.hadoop.conf.Configuration; import org.apache.hadoop.fs.Path; import org.apache.hadoop.io.IOUtils; import org.apache.hadoop.io.compress.*; public class TestDecompression { public static void main(String[] args) throws FileNotFoundException, IOException { String file = "/home/hadoop/zlib.tar.gz"; Configuration conf = new Configuration(); CompressionCodecFactory codecFactory = new CompressionCodecFactory(conf); CompressionCodec codec = codecFactory.getCodec(new Path(file)); CompressionInputStream in = codec.createInputStream(new FileInputStream(new File(file))); FileOutputStream out = new FileOutputStream(new File(codecFactory.removeSuffix(file, codec.getDefaultExtension()))); IOUtils.copyBytes(in, out, 4096); in.close(); out.close(); } }
运行时出现下列错误
14/04/24 22:00:59 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
原因是因为没有找到native库,需要在运行配置中配置native的路径。解决方法是右键Run As->Run Configurations->Arguments->VM arguments中写入libhadoop.so和libSnappy.so的路径即可。
-Djava.library.path=/home/hadoop/hadoop-1.2.1/lib/native/Linux-amd64-64:/usr/local/lib
相关文章推荐
- spring+quartz
- java实现数据备份和恢复
- java 解析excel文件
- Maven项目,右键-update project后报错
- Struts2再曝S2-020补丁绕过漏洞 – 万恶的正则表达式
- Could not create the view: An unexpected exception was thrown. 电脑突然断电,myeclipse非正常关闭,出现错误
- Java运用蒙特卡洛方法计算圆周率
- 第一个Java程序
- Java 列举数组中任意元素和为定值的组合
- Myeclipse Servers 出错
- Java中GridBagLayout的使用
- 转java实现数组全排列
- Cause: java.sql.SQLException: JZ0C0: Connection is already closed
- java的System类学习笔记
- jar包引发的”血案“
- Eclipse快捷键 10个最有用的快捷键
- java中访问权限控制public protected default(friendly) 和private
- 简单json数据解析-java篇
- java Bean
- java当中多线程