Hadoop学习笔记———《读、写HDFS文件》
2015-12-24 11:12
651 查看
读取HDFS上的文件
写入HDFS文件
/** * Created by MJ on 15/12/06. * * @use 读取HDFS上的指定文件的内容并返回 * * @param filePath 待写入的HDFS文件路径 * @return String 文件的内容 * @exception Exception 异常返回null */ public String readHdfsFile(String filePath) throws Exception { FileSystem fileSystem = null; BufferedReader bufferedReader = null; try { String result = ""; Configuration conf = new Configuration(); fileSystem = FileSystem.get(conf); FSDataInputStream fs = fileSystem.open(new Path(filePath)); bufferedReader = new BufferedReader(new InputStreamReader(fs)); String lineString; while (null != (lineString = bufferedReader.readLine())) { result += lineString; } return result; } catch (Exception e) { e.printStackTrace(); } finally { if (null != bufferedReader) { bufferedReader.close(); } if (null != fileSystem) { fileSystem.close(); } } return null; }
写入HDFS文件
/** * Created by MJ on 15/12/06. * * @use 将text内容写入到HDFS上的指定文件 * * @param filePath 待写入的HDFS文件路径 * @param text 待写入的内容 * @exception */ public void writeHdfsFile(String filePath, String text) throws Exception { FileSystem fileSystem = null; BufferedWriter bufferedWriter = null; try { Configuration conf = new Configuration(); fileSystem = FileSystem.get(conf); FSDataOutputStream fs = fileSystem.create(new Path(filePath)); bufferedWriter = new BufferedWriter(new OutputStreamWriter(fs)); bufferedWriter.write(text + "\n"); } catch (Exception e) { e.printStackTrace(); } finally { if (null != bufferedWriter) { bufferedWriter.flush(); bufferedWriter.close(); } if (null != fileSystem) { fileSystem.close(); } } }
相关文章推荐
- CentOS7.0上安装mysql重置root密码
- Linux 下的 Nginx 反向代理配置.
- Using Open Live Writer
- Centos下安装zmq库及pyzmq
- 我自己做的网站终于上线啦,用tornado做的,求围观 www.yustock.live
- CentOS6.5-YUM安装最新MySQL5.7.10
- 腾讯分析系统架构解析
- centos安装composer
- Nginx配置upstream实现负载均衡
- Nginx配置upstream实现负载均衡
- linux常用操作命令
- 个人杂记-Linux桌面快捷方式-查看图片命令
- 巧妙获取360 doc网站上的内容
- 个人杂记-Linux操作快捷键命令-vim中的问题
- Linux下用C编写WebSocet服务以响应HTML5的WebSocket请求
- Linux信号(signal) 机制分析
- ssl + nginx + tomcat 部署方案
- linux复习(二)
- linux系统中查找命令grep命令详解
- Linux filesystem detection