Hadoop2.5.1测试(运行自带的wordcount)
2015-03-20 11:58
417 查看
一、准备工作
启动hadoop(如有疑问见上篇博文),jps查看进程:hadoop@h1:~$ jps 3395 SecondaryNameNode 5222 Jps 3177 NameNode 4394 JobHistoryServer 3565 ResourceManager
二、进行测试
1、建立输入文件:echo "My first hadoop example. Hello Hadoop in input. " > input
2、在hadoop上建立目录:
hdfs dfs -mkdir -p /user/hadoop查看建立的目录,
hadoop@h1:~$ hdfs dfs -ls /user Found 1 items drwxr-xr-x - hadoop supergroup 0 2015-03-22 20:17 /user/hadoop
3、上传文件:
hdfs dfs -put input /user/hadoop查看上传的文件,
hadoop@h1:~$ hdfs dfs -ls /user/hadoop Found 1 items -rw-r--r-- 2 hadoop supergroup 49 2015-03-22 20:21 /user/hadoop/input
4、运行wordcount程序
hadoop jar /home/hadoop/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.5.1.jar wordcount /user/hadoop/input /user/hadoop/output
5、查看运行结果
hadoop@h1:~$ hdfs dfs -ls /user/hadoopFound 2 items -rw-r--r-- 2 hadoop supergroup 49 2015-03-22 20:21 /user/hadoop/input drwxr-xr-x - hadoop supergroup 0 2015-03-22 20:26 /user/hadoop/output hadoop@h1:~$ hdfs dfs -ls /user/hadoop/output Found 2 items -rw-r--r-- 2 hadoop supergroup 0 2015-03-22 20:26 /user/hadoop/output/_SUCCESS -rw-r--r-- 2 hadoop supergroup 64 2015-03-22 20:26 /user/hadoop/output/part-r-00000 hadoop@h1:~$ hdfs dfs -cat /user/hadoop/output/part-r-00000 Hadoop 1 Hello 1 My 1 example. 1 first 1 hadoop 1 in 1 input. 1
相关文章推荐
- 大数据之Hadoop平台(二)Centos6.5(64bit)Hadoop2.5.1伪分布式安装记录,wordcount运行测试
- 大数据之Hadoop平台(二)Centos6.5(64bit)Hadoop2.5.1伪分布式安装记录,wordcount运行测试
- hadoop自带例子wordcount的具体运行步骤
- Hadoop2.5.1 运行wordcount
- 运行hadoop自带wordcount例子
- linux下在eclipse上运行hadoop自带例子wordcount
- hadoop基础----hadoop实战(三)-----hadoop运行MapReduce---对单词进行统计--经典的自带例子wordcount
- hadoop基础----hadoop实战(三)-----hadoop运行MapReduce---对单词进行统计--经典的自带例子wordcount
- hadoop 自带示例wordcount 详细运行步骤
- Hadoop 2.6.3运行自带WordCount程序笔记
- 关于hadoop1.0.4运行自带例子WordCount内存溢出问题。
- 运行hadoop自带的wordcount例子
- Hadoop系列--Hadoop自带程序wordcount运行示例
- 在linux下eclipse中运行hadoop自带的WordCount例子出现的两个错误
- Hadoop2.5.1在Ubuntu14中的伪分布配置+wordcount测试+eclipse环境配置
- Hadoop—测试hadoop自带wordcount 实例
- cloudera CDH5.13.1 Hadoop2.6.0 测试运行wordcount大数据统计作业
- 运行Hadoop自带的wordcount单词统计程序
- hadoop2.2使用手册2:如何运行自带wordcount
- linux下eclipse上运行hadoop自带wordcount程序