您的位置:首页 > 大数据 > Hadoop

hdfs下载文件到本地

2015-09-17 17:27 375 查看
import java.io.FileOutputStream;

import java.io.OutputStream;

import java.net.URI;

import org.apache.hadoop.conf.Configuration;

import org.apache.hadoop.fs.FSDataInputStream;

import org.apache.hadoop.fs.FileSystem;

import org.apache.hadoop.fs.Path;

import org.apache.hadoop.io.IOUtils;

public static void main(String[] args) throws Exception

{
 String dest = "hdfs://master001:9000/zhaimo/test62015_09_17_04_38_02/part-r-00000";
 String local = "d:\\test16.txt";
 Configuration conf = new Configuration();
 FileSystem fs = FileSystem.get(URI.create(dest),conf);
 FSDataInputStream fsdi = fs.open(new Path(dest));
 OutputStream output = new FileOutputStream(local);
 IOUtils.copyBytes(fsdi,output,4096,true);
}
内容来自用户分享和网络整理,不保证内容的准确性,如有侵权内容,可联系管理员处理 点击这里给我发消息
标签:  hdfs mapreduce